Signal processing method and system

By modulating the audio signal into the ultrasonic range and demodulating it into an audible signal in the hearing aid, the reverberation and poor sound quality problems of hearing aid users are solved, improving the listening experience.

WO2026091659A1PCT designated stage Publication Date: 2026-05-07HUAWEI TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
HUAWEI TECH CO LTD
Filing Date
2025-07-01
Publication Date
2026-05-07

AI Technical Summary

Technical Problem

Users who wear hearing aids are prone to reverberation due to room reflections during sound propagation, and poor speaker quality leads to a poor listening experience.

Method used

By modulating audio signals within the audible range into signals within the ultrasonic range, and then demodulating them back into the audible range in the hearing aid, the high frequency and strong directivity of ultrasound reduce signal transmission loss and output clean sound.

Benefits of technology

Without increasing power consumption and latency, it improves the listening experience for hearing aid users and reduces reverberation and poor sound quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025106448_07052026_PF_FP_ABST
    Figure CN2025106448_07052026_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed are a signal processing method and system, which relate to the field of media. The method comprises: an audio device modulating, to an ultrasonic range, an audio signal within an audible range that needs to be outputted, and outputting a signal within the ultrasonic range; and a hearing aid receiving the signal within the ultrasonic range, demodulating the signal within the ultrasonic range to the audible range, and outputting the signal within the audible range that is obtained from the signal within the ultrasonic range. Due to the high frequency and strong directivity of ultrasound, the loss during transmission is low; and the transmission of a signal within an ultrasonic range reduces the damage degree of a signal received by a hearing aid, such that the hearing aid outputs a signal within an audible range on the basis of the signal within the ultrasonic range, thereby solving the problems of the poor quality and reverberation of a sound heard by a user wearing the hearing aid, without introducing additional power consumption or delays, and thus improving the listening experience of the user wearing the hearing aid.
Need to check novelty before this filing date? Find Prior Art

Description

Signal processing methods and systems

[0001] This application claims priority to Chinese patent application filed on November 4, 2024, with application number 202411569838.2 and entitled “Signal Processing Method and System”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the media field, and more particularly to a signal processing method and system. Background Technology

[0003] During sound propagation, reverberation may occur due to reflections from room walls. Additionally, in cases of poor speaker quality, the speaker struggles to reproduce low-frequency sounds, resulting in a poorer hearing experience for hearing aid users and negatively impacting their listening experience. Summary of the Invention

[0004] This application provides a signal processing method and system that effectively improves the hearing experience of users wearing hearing aids.

[0005] In a first aspect, a signal processing method is provided for use in a hearing aid. The method includes: receiving a first signal output from a broadcasting device external to the hearing aid, and outputting a second signal, processed from the first signal, to the user. The first signal is within the ultrasonic range. The second signal is within the audible range. The audio content of the second signal is the same as the audio content of the first signal.

[0006] Because ultrasound has a high frequency and strong directionality, it loses little during transmission. By transmitting signals within the range of ultrasound, the damage to the signals received by the hearing aid is reduced. This allows the hearing aid to output signals within the audible range based on the signals within the ultrasound range. Thus, without introducing additional power consumption and time delay, the problems of poor sound quality and reverberation heard by hearing aid users are solved, improving the listening experience of hearing aid users.

[0007] In one possible implementation, outputting a second signal includes: demodulating the first signal and outputting the second signal.

[0008] This demodulates the signal within the ultrasonic range to the audible range, outputting a signal within the audible range derived from the signal within the ultrasonic range, thus improving the listening experience for users wearing hearing aids.

[0009] In another possible implementation, the method further includes receiving a third signal output from a broadcasting device outside the hearing aid, the third signal being within the audible range, and the audio content of the third signal being the same as the audio content of the first signal.

[0010] In another possible implementation, the method also includes: eliminating the third signal based on the second signal.

[0011] Eliminating identical audio signals received by the hearing aid within its audible range prevents the hearing aid from outputting two sounds containing the same audio content, resulting in a clean, interference-free sound output, improved sound quality, and enhanced hearing experience for users wearing hearing aids.

[0012] In another possible implementation, the method further includes instructing a broadcasting device external to the hearing aid to output a signal in a first output mode. The first output mode indicates that only signals within the ultrasonic range are output.

[0013] This design ensures that the hearing aid only receives signals within the ultrasonic range output by an external broadcasting device, and does not receive signals with the same audio content within the audible range. This prevents the hearing aid from outputting two sounds with the same audio content, resulting in a clean, interference-free sound output, improved sound quality, and enhanced hearing experience for the user.

[0014] In another possible implementation, the method further includes instructing a broadcasting device external to the hearing aid to output a signal in a second output mode. The second output mode indicates the output of signals within the ultrasonic range and signals within the audible range.

[0015] In another possible implementation, the method further includes: receiving an external signal and outputting the external signal to the user, wherein the audio content of the external signal is different from the audio content of the second signal.

[0016] Hearing aids can also receive other sounds, allowing them to output additional sounds in addition to the audio output of the audio device, making the hearing experience more realistic and enhancing the user's listening experience.

[0017] Secondly, a signal processing method is provided, applied to an audio device. The method includes: modulating an audio signal to be output into a first signal, and outputting the first signal. The audio signal is within the audible range, the first signal is within the ultrasonic range, and the audio content of the audio signal and the audio content of the first signal are the same.

[0018] Because ultrasound has a high frequency and strong directionality with minimal transmission loss, it modulates the signal within the audible range to the ultrasonic range, outputting the signal within the ultrasonic range. This reduces the degree of signal loss received by the hearing aid, allowing the hearing aid to output the signal within the audible range based on the ultrasonic range. Thus, without introducing additional power consumption and time delay, it solves the problems of poor sound quality and reverberation heard by hearing aid users, improving their listening experience.

[0019] In one possible implementation, the method further includes: displaying a first output mode and a second output mode; outputting a first signal, including: receiving a selection operation of the first output mode and outputting the first signal.

[0020] It only outputs signals within the ultrasonic range, allowing the hearing aid to output signals within the audible range based on the signals within the ultrasonic range. This results in clean, interference-free sound output from the hearing aid, improving sound quality and enhancing the hearing experience for users wearing the hearing aid.

[0021] In another possible implementation, the method further includes: displaying a first output mode and a second output mode; outputting a first signal, including: receiving a selection operation of the second output mode, and outputting the first signal and an audio signal.

[0022] It displays multiple output modes so that audio devices can output signals according to the user's wishes, thereby improving the listening experience for users wearing hearing aids.

[0023] In another possible implementation, outputting a first signal includes: outputting a first signal according to the instructions of the hearing aid.

[0024] Thirdly, a signal processing apparatus is provided for implementing the various methods described above. This signal processing apparatus includes modules, units, or means corresponding to the methods described above. These modules, units, or means can be implemented in hardware, software, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the functions described above.

[0025] In some possible designs, the signal processing device includes a demodulation module and an interface module. The interface module is used to implement the transmission and / or reception functions in any of the above aspects and their possible implementations. The demodulation module can be used to implement the processing functions in any of the above aspects and their possible implementations.

[0026] For example, the interface module is used to receive a first signal output from a broadcasting device outside the hearing aid, the first signal being within the ultrasonic range; the interface module is also used to output a second signal processed from the first signal to the user, the second signal being within the audible range, and the audio content of the second signal being the same as the audio content of the first signal.

[0027] In one possible implementation, the device further includes a demodulation module for: demodulating the first signal and outputting a second signal.

[0028] In another possible implementation, the interface module is also used to: receive a third signal output from a broadcasting device outside the hearing aid, the third signal being within the audible range, and the audio content of the third signal being the same as the audio content of the first signal.

[0029] In another possible implementation, the interface module is also used to: eliminate the third signal based on the second signal.

[0030] In another possible implementation, the interface module is also used to instruct a broadcasting device external to the hearing aid to output a signal in a first output mode. The first output mode indicates that only signals within the ultrasonic range are output.

[0031] In another possible implementation, the interface module is also used to instruct a broadcasting device external to the hearing aid to output a signal in a second output mode. The second output mode indicates the output of signals within both the ultrasonic range and the audible range.

[0032] In another possible implementation, the interface module is also used to: receive external signals and output external signals to the user, wherein the audio content of the external signals is different from the audio content of the second signal.

[0033] Fourthly, a signal processing apparatus is provided for implementing the various methods described above. This signal processing apparatus includes modules, units, or means corresponding to the methods described above. These modules, units, or means can be implemented in hardware, software, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the functions described above.

[0034] In some possible designs, the signal processing device includes a modulation module and an interface module. The interface module is used to implement the transmission and / or reception functions in any of the above aspects and their possible implementations. The modulation module can be used to implement the processing functions in any of the above aspects and their possible implementations.

[0035] For example, a modulation module is used to modulate the audio signal to be output into a first signal, wherein the audio signal is within the audible range, the first signal is within the ultrasonic range, and the audio content of the audio signal is the same as the audio content of the first signal; an interface module is used to output the first signal.

[0036] In one possible implementation, the device further includes a display module for displaying a first output mode and a second output mode; when the interface module outputs a first signal, it is specifically used for receiving a selection operation of the first output mode and outputting the first signal.

[0037] In another possible implementation, the device further includes a display module for displaying a first output mode and a second output mode; when the interface module outputs a first signal, it is specifically used for receiving a selection operation of the second output mode and outputting the first signal and an audio signal.

[0038] In another possible implementation, when the interface module outputs the first signal, it is specifically used to: output the first signal according to the instructions of the hearing aid.

[0039] Fifthly, an audio device is provided, comprising: a processor, a memory, and a speaker; the memory is used to store computer instructions, which, when executed by the processor, cause the audio device to perform the method of the second aspect described above. The memory may be coupled to the processor, or may be independent of the processor, and the speaker is used to output signals within the ultrasonic range and signals within the audible range.

[0040] In a sixth aspect, a hearing aid is provided, comprising a microphone, a processor, and a speaker, the processor being used to perform the method of the first aspect described above. The microphone is used to acquire signals within the ultrasonic range and signals within the audible range. The speaker is used to output signals within the audible range obtained by demodulating signals within the ultrasonic range.

[0041] In a seventh aspect, a signal processing system is provided, comprising the audio device described in the fifth aspect and the hearing aid described in the sixth aspect.

[0042] Eighthly, a computer-readable storage medium is provided that stores a computer program or instructions that, when executed on a signal processing apparatus, enable the signal processing apparatus to perform the methods of any of the above aspects or any implementation thereof.

[0043] Ninthly, a computer program product containing instructions is provided, which, when run on a signal processing apparatus, enables the signal processing apparatus to perform the method of any of the above aspects or any implementation thereof.

[0044] The technical effects of any of the implementation methods in aspects three through nine can be found in the technical effects of the corresponding implementation methods in aspects one and two, and will not be repeated here.

[0045] Among these, any possible implementation methods of any one of the above aspects can be combined, provided that the solutions do not contradict each other. Attached Figure Description

[0046] Figure 1 is a schematic diagram of a signal processing system provided by the prior art;

[0047] Figure 2 is a schematic diagram of a signal processing system provided in this application;

[0048] Figure 3 is a structural schematic diagram of an audio device and a hearing aid provided in this application;

[0049] Figure 4 is a flowchart illustrating a signal processing method provided in this application;

[0050] Figure 5 is a schematic diagram of an output mode selection provided in this application;

[0051] Figure 6 is a schematic diagram of a signal processing procedure provided in this application;

[0052] Figure 7 is a schematic diagram of the structure of a signal processing device provided in this application. Detailed Implementation

[0053] To facilitate understanding, the main terms used in this application will be explained first.

[0054] A hearing aid is an electronic device primarily used to help users improve their hearing and enhance their verbal communication abilities. The main principle of a hearing aid is to convert sound signals into electrical signals, then amplify these signals before transmitting them to the ear.

[0055] Reverberation is a phenomenon in physics and acoustics. When sound waves propagate in a room, some sound reaches the listener's ears directly, called direct sound, while other sound is reflected back after encountering obstacles, called reflected sound. Reflected sound continuously propagates and reflects in space, superimposing with direct sound, thus producing reverberation.

[0056] Typically, hearing aids receive both direct sound and reverberation. Additionally, low-quality speakers struggle to reproduce low-frequency sounds, which can lead to hearing difficulties or poor sound perception for hearing aid users, thus impacting their overall listening experience. The users of hearing aids mentioned in this article are also referred to as hearing aid users.

[0057] In some embodiments, the audio device encodes the signal and transmits the bitstream to the hearing aid to reduce sound loss. For example, Figure 1 illustrates a signal processing system provided by the prior art. The transmitting end 110 includes an analog-to-digital converter module 111, a digital signal processor (DSP) module 112, and a Bluetooth module 113. The receiving end 120 includes a digital-to-analog converter module 121, a DSP module 122, a Bluetooth module 123, and a speaker 124. The transmitting end includes, but is not limited to, televisions, computers, and speakers. The receiving end includes, but is not limited to, hearing aids. Bluetooth module 113 refers to a Bluetooth transmitter (BT-Tx). Bluetooth module 123 refers to a Bluetooth receiver (BT-Rx).

[0058] After the transmitter 110 acquires the audio, the analog-to-digital converter 111 converts the analog signal into a digital signal, and the digital signal processing 112 encodes the digital signal. The bitstream is then transmitted via the Bluetooth module 113.

[0059] The receiver 120 receives the bit stream via the Bluetooth module 123, the digital signal processing module 122 decodes the bit stream, the digital-to-analog converter module 121 converts the digital signal into an analog signal, and the speaker 124 outputs audio.

[0060] Both the sending and receiving ends need to support Bluetooth transmission and require encoding and decoding processing, which introduces additional power consumption and latency.

[0061] To address the issue of poor hearing for users of hearing aids, this application provides a signal processing method. The method includes: an audio device modulating an audio signal within the audible range to an ultrasonic range, and outputting a signal within the ultrasonic range; the hearing aid receiving the signal within the ultrasonic range demodulating the signal within the ultrasonic range to the audible range, and outputting a signal within the audible range derived from the signal within the ultrasonic range.

[0062] Because ultrasound has a high frequency and strong directionality, it loses little during transmission. By transmitting signals within the range of ultrasound, the damage to the signals received by the hearing aid is reduced. This allows the hearing aid to output signals within the audible range based on the signals within the ultrasound range. Thus, without introducing additional power consumption and time delay, the problems of poor sound quality and reverberation heard by hearing aid users are solved, improving the listening experience of hearing aid users.

[0063] The audio devices described in this application include devices capable of outputting sound, such as televisions, stereos, computers, mobile phones, and tablets.

[0064] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0065] Figure 2 is a schematic diagram of a signal processing system provided in this application. As shown in Figure 2, the signal processing system 200 includes an audio device 210 and a hearing aid 220. The audio device 210 is a device capable of outputting sound, such as a television, stereo, computer, mobile phone, tablet, etc.

[0066] Audio device 210 is used to modulate an audio signal within the audible range to the ultrasonic range and output a signal within the ultrasonic range.

[0067] The hearing aid 220 is used to receive signals within the ultrasonic range, demodulate the signals within the ultrasonic range to the audible range, and output signals within the audible range obtained from the signals within the ultrasonic range.

[0068] In some embodiments, as shown in FIG3(a), the audio device 210 includes a processor 211, a speaker 212, a communication interface 213, and a storage medium 214. The processor 211, speaker 212, communication interface 213, and storage medium 214 are connected together.

[0069] Processor 211 is used to modulate audio signals within the audible range to the ultrasonic range. Speaker 212 is used to output signals within the ultrasonic range.

[0070] The communication interface 213 is used to enable communication between the audio device 210 and external devices or components.

[0071] Storage medium 214 can be used to store relevant information during signal processing, such as signals within the audible range, signals within the ultrasonic range, etc., such as a disk, like a solid-state drive.

[0072] Optionally, the audio device 210 may also include a Wi-Fi module, a Bluetooth module, an input unit, a display unit, sensors, etc., which will not be described in detail here. Those skilled in the art will understand that the wireless communication device structure shown in the figures does not constitute a limitation on the wireless communication device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0073] The input unit can be used to receive input numerical or character information, and to generate key signal inputs related to user settings and function control of the wireless communication device. The input unit may include a touchscreen and other input devices. The touchscreen can collect user touch operations on or near it and drive corresponding connected devices according to a pre-set program. For example, touch operations may include user actions using fingers, styluses, or any suitable object or accessory on or near the touchscreen. Optionally, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys, trackball, mouse, joystick, etc., such as volume control buttons, power switch buttons, etc.

[0074] The display unit can be used to display information input by the user or information provided to the user, as well as various menus of the wireless communication device. In one example, the display unit may include a display screen, which can be configured as a liquid crystal display (LCD), organic light-emitting diode (OLED), or similar form factor. Furthermore, a touchscreen can cover the display screen. When the touchscreen detects a touch operation on or near it, it transmits the information to the processor to determine the type of touch event. Subsequently, the processor provides corresponding visual output on the display screen based on the type of touch event. Although in the figures, the touchscreen and display screen are presented as two separate components to implement the input and output functions of the wireless communication device, in some embodiments, the touchscreen and display screen can be integrated to achieve the input and output functions of the wireless communication device.

[0075] As shown in Figure 3(b), the hearing aid 220 includes a microphone 221, a processor 222, and a speaker 223. The microphone 221, processor 222, and speaker 223 are connected together.

[0076] Microphone 221 is used to receive signals within the ultrasonic range. Processor 222 is used to demodulate the signals within the ultrasonic range to an audible range. Speaker 223 is used to output the audible signal obtained from the signals within the ultrasonic range.

[0077] Optionally, the processor 222 can also perform operations such as signal amplification, noise reduction, filtering, and frequency compensation to improve the listening experience of users wearing hearing aids.

[0078] The processor can be a CPU, or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0079] As an example, audio device 210 and / or hearing aid 220 include multiple processors. The processor is a multi-core (multi-CPU) processor. Here, "processor" can refer to one or more devices, circuits, and / or computing units for processing data (e.g., computer program instructions). Optionally, audio device 210 and / or hearing aid 220 may also include an NPU, a DPU, or one or more integrated circuits for controlling the execution of programs according to the present application.

[0080] It is worth noting that Figure 1 only uses one processor as an example. Here, the processor is used to indicate a type of device or equipment. In specific embodiments, the number of each type of device or equipment can be determined according to business needs.

[0081] Optionally, the hearing aid 220 also includes a Wi-Fi module, a Bluetooth module, etc., to facilitate connection between the hearing aid and devices capable of outputting sound, such as mobile phones and televisions, enhancing functionality and entertainment experience. The hearing aid 220 also includes buttons for adjusting volume, switching programs, etc.

[0082] The signal processing method provided in this application embodiment will be described below with reference to the audio device and hearing aid included in the signal processing system shown in Figure 2 or Figure 3. Figure 4 is a flowchart of a signal processing method provided in an embodiment of this application. As shown in Figure 4, the method may include the following steps.

[0083] Step 410: The audio device modulates the audio signal to be output into a first signal.

[0084] In some embodiments, the audio device retrieves audio from its local storage or from storage outside the audio device via a network. For example, the audio device downloads audio from a network or retrieves audio from other devices via wireless communication technologies (such as Bluetooth, Wi-Fi, etc.). This application does not limit the source of the audio or the method by which the audio device retrieves the audio.

[0085] Audio devices acquire audio signals within the audible range. An audio signal refers to the audio and video signals that the audio device needs to play. The audible range refers to the frequency range of sounds that the human ear can hear. For example, the audible range is 20Hz to 20kHz. An audio signal may fall within a portion or all of the audible range.

[0086] Audio equipment modulates audio signals to obtain the first signal within the ultrasonic range. Ultrasonic waves are sound waves with frequencies higher than 20 kHz. The ultrasonic range is above 20 kHz. Because the vibration frequency of ultrasonic waves is higher than the range of human hearing, the human ear cannot hear them. The first signal may be located in a portion or all of the ultrasonic range.

[0087] In some embodiments, the audio device performs amplitude modulation on the audio signal to obtain a first signal within the ultrasonic range. For example, the audio device multiplies the audio signal by a carrier signal to obtain a first signal within the ultrasonic range, thus shifting the audio signal from the audible range to the ultrasonic range.

[0088] Step 420: The audio device outputs the first signal.

[0089] In some embodiments, after the audio device acquires a first signal within the ultrasonic range, it outputs the first signal but does not output an audio signal within the audible range.

[0090] In other embodiments, after acquiring a first signal within the ultrasonic range, the audio device outputs both the first signal within the ultrasonic range and an audio signal within the audible range. For example, the signal output by the audio device includes both the first signal within the ultrasonic range and the audio signal within the audible range. Understandably, the frequency band of the signal output by the audio device encompasses both the frequency band within the ultrasonic range and the frequency band within the audible range. Alternatively, the signal output by the audio device may fall within both the ultrasonic range and the audible range. As another example, the audio device may output both the first signal within the ultrasonic range and the audio signal within the audible range, meaning the audio device outputs two signals within two different frequency bands.

[0091] Optionally, the audio device outputs a first signal within the ultrasonic range and / or an audio signal within the audible range, according to user instructions.

[0092] For example, as shown in Figure 5(a), the audio device displays a first output mode and a second output mode. The first output mode indicates that only signals within the ultrasonic range are output. The second output mode indicates that signals within the ultrasonic range and signals within the audible range are output.

[0093] In a first possible implementation, as shown in Figure 5(b), the audio device receives a selection operation for a first output mode and outputs a first signal within the ultrasonic range. For example, if only a user wearing a hearing aid is present in the room, and the user selects the first output mode, the audio device will only output the first signal within the ultrasonic range. This avoids the hearing aid receiving signals within its audible range, reduces the influence of signals within the audible range on the hearing aid's output signal, and improves the listening experience for the user wearing the hearing aid.

[0094] In a second possible implementation, as shown in Figure 5(c), the audio device receives a second output mode selection operation and outputs a first signal within the ultrasonic range and an audio signal within the audible range. For example, in a room with a user wearing a hearing aid and other users, the user wearing the hearing aid selects the second output mode. The audio device outputs the first signal within the ultrasonic range and an audio signal within the audible range, causing the hearing aid to receive both the first signal within the ultrasonic range and a third signal within the audible range. The user wearing the hearing aid hears the second signal processed from the first signal output by the hearing aid, while other users receive the third signal within the audible range. This allows users other than the user wearing the hearing aid to hear the sound emitted by the audio device. The audio content of the third signal is the same as the audio content of the first signal. The audio content of the second signal is also the same as the audio content of the first signal.

[0095] Optionally, the audio device may also display a third output mode, indicating that only signals within the audible range will be output. The audio device receives a selection of the third output mode and outputs signals within the audible range. For example, if no user wearing a hearing aid is present in the room, and other users select the third output mode, they will receive signals within their audible range.

[0096] In this application, the user uses a controller or hearing aid to control the output mode of the audio device. The controller could be, for example, a TV remote control or a mouse. Optionally, the various aspects of communication between the controller or hearing aid and the audio device can be extended to other networks employing various standards or protocols, such as Bluetooth, StarFlash, High Performance Radio LAN (HIPER LAN) (a wireless standard similar to IEEE 802.11, primarily used in Europe), and wide area networks (WANs), WLANs, personal area networks (PANs), or other networks now known or to be developed in the future. Therefore, regardless of the coverage area and wireless access protocol used, the various aspects provided in this application can be applied to any suitable wireless network.

[0097] Step 430: The hearing aid receives the first signal output by the external broadcasting device.

[0098] The audio device outputs a first signal within the ultrasonic range. This first signal propagates through the air, and the hearing aid receives it. External broadcasting devices for the hearing aid include, but are not limited to, speakers of devices capable of outputting sound.

[0099] Step 440: The hearing aid outputs the second signal after the first signal processing to the user.

[0100] The hearing aid demodulates the first signal within the ultrasonic range to obtain the second signal within the audible range, and then outputs the second signal to the user.

[0101] In some embodiments, the hearing aid modulates the amplitude of a first signal within the ultrasonic range to obtain a second signal within the audible range. For example, the hearing aid multiplies the first signal within the ultrasonic range by a carrier signal to obtain the second signal within the audible range, thus shifting the first signal from the ultrasonic range to the audible range.

[0102] In other embodiments, the hearing aid also receives a third signal output from a broadcasting device external to the hearing aid. After demodulating the first signal within the ultrasonic range to obtain a second signal within the audible range, the hearing aid eliminates the third signal based on the second signal, i.e., it uses the second signal for mixing. For example, the hearing aid employs an adaptive filtering method to eliminate the third signal based on the second signal, using the second signal as a reference signal to eliminate the third signal.

[0103] In this case, because the audio signal output by the audio device is transmitted through the air, the audio signal is attenuated, and it is affected by noise, the hearing aid receives a damaged audio signal, that is, the hearing aid receives a third signal within the audible range.

[0104] In other embodiments, the audio device outputs a first signal within the ultrasonic range and an audio signal within the audible range, meaning the audio device outputs two signals in two different frequency bands. For example, the audio device outputs a first signal within the ultrasonic range and an audio signal within the audible range via a Bluetooth module. The hearing aid receives the first signal within the ultrasonic range, demodulates it, and the user wearing the hearing aid hears the second signal within the audible range output by the hearing aid. The Bluetooth headset receives the audio signal within the audible range, and other users wearing the Bluetooth headset hear the signal output by the Bluetooth headset.

[0105] Among them, the audio content of each of the following signals is the same: the audio signal output by the audio device within the audible range, the first signal within the ultrasonic range, the third signal received by the hearing aid within the audible range, the first signal within the ultrasonic range, and the second signal output by the hearing aid within the audible range.

[0106] Optionally, in step 450, the hearing aid receives an external signal. The hearing aid outputs an external signal. The audio content of the external signal differs from the audio content of the second signal within the ultrasonic range. For example, the external signal may be sounds emitted by devices, users, objects, animals, etc., in the space where the hearing aid wearer is located, other than the audio device. The hearing aid can also receive other sounds, so that while outputting the sound from the audio device, the hearing aid also outputs other sounds, making the hearing experience more realistic for the user and enhancing their listening experience.

[0107] The signal processing method provided in this application modulates the original audio signal into the ultrasonic range, and then directly sends the clean original audio to the user wearing a hearing aid via ultrasound, improving sound quality. Specifically, it enhances the signal within the audible range using the ultrasonic range, improving the sound quality of the signal from the audio device and eliminating reverberation. Furthermore, the hearing aid can still amplify other sounds besides television and speakers, improving the user's hearing experience. Additionally, the audio device outputs the original audio signal without affecting other users' listening experience.

[0108] For example, as shown in Figure 6, the audio device modulates an audio signal of 0Hz to 20kHz to obtain a first signal of 20kHz to 40kHz. The audio device outputs the audio signal of 0Hz to 20kHz and the first signal of 20kHz to 40kHz. The hearing aid receives a third signal of 0Hz to 20kHz and the first signal of 20kHz to 40kHz. The hearing aid demodulates the first signal of 20kHz to 40kHz to obtain a second signal of 20kHz to 40kHz. The second signal of 20kHz to 40kHz is used to eliminate the third signal of 0Hz to 20kHz, and the second signal of 20kHz to 40kHz is output. Optionally, the hearing aid also receives an external signal of 20Hz to 20kHz output from a broadcasting device outside the hearing aid and outputs the external signal of 20Hz to 20kHz. In some embodiments, the hearing aid superimposes the second signal and the external signal and outputs the combined signal. Optionally, the hearing aid also uses a hearing aid algorithm to process the second signal and the external signal. A hearing aid algorithm is a technology used to help users with hearing loss improve their auditory experience. By extracting and enhancing meaningful sounds and reducing background noise and interference, users can hear conversations and other important sounds more clearly.

[0109] This application provides a method for testing the output signal of an audio device. It assumes the audio device generates a signal within the ultrasonic range and outputs a signal within the ultrasonic range, or outputs both a signal within the ultrasonic range and a signal within the audible range. The frequency band of the signal output by the audio device is detected to prove that the audio device can output a signal within the ultrasonic range.

[0110] This application provides a method for testing the output signal of a hearing aid. The hearing aid receives a signal within the ultrasonic range and outputs a signal within the audible range. The frequency bands of the input and output signals are detected to prove that the hearing aid inputs a signal within the ultrasonic range and outputs a signal within the audible range. This demonstrates that the hearing aid can output a signal within the audible range based on a signal within the ultrasonic range. Furthermore, by detecting that the audio content of the signal within the ultrasonic range is identical to the audio content of the output signal within the audible range, evidence is obtained that the output signal is derived from a signal within the ultrasonic range. Audio analysis software can be used to analyze and obtain characteristics such as audio content and frequency bands. This testing method improves the ease of operation and the verifiability of the testing method for hearing aids.

[0111] In other testing methods, it is assumed that the audio device generates signals within the ultrasonic range and the audible range, and outputs both signals. The hearing aid receives both signals and outputs the audible range signal, resulting in the hearing aid outputting only one sound. If the hearing aid outputs two sounds, it indicates that the hearing aid has not eliminated the audible range signal; if it outputs only one sound, it indicates that the hearing aid has eliminated the audible range signal received by the audio device. If the quality of the audible range signal received by the hearing aid is worse than the quality of the audible range signal obtained based on the ultrasonic range signal (e.g., poorer perceived hearing), it proves that the hearing aid can output the audible range signal based on the ultrasonic range signal. Using this testing method improves the ease of operation and verifiability of the testing method.

[0112] In other testing methods, the hearing aid also receives signals from other audible ranges, detects the frequency band of the received signals, and obtains evidence that signals from other audible ranges are received. In addition, by detecting that the audio content carried by the signal in the ultrasonic range is different from the audio content of the signal in other audible ranges, it is proven that the hearing aid also receives signals from other audible ranges.

[0113] The various embodiments of this application can be implemented independently or in combination, without limitation. Unless otherwise specified or in conflict of logic, the terminology and / or descriptions between the different embodiments provided in this application are consistent and can be referenced mutually. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0114] It is understood that in the embodiments of this application, the executing entity may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application may also perform other operations or variations thereof. Furthermore, the various steps may be executed in different orders as presented in the embodiments of this application, and it is not necessarily necessary to execute all the operations in the embodiments of this application.

[0115] The foregoing primarily describes the solutions provided in this application from the perspective of device-to-device interaction. It is understood that each device, in order to achieve the aforementioned functions, includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0116] This application embodiment can divide each device into functional modules according to the above method example. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0117] Figure 7 shows a signal processing device 700, which can perform the actions performed by the audio device or hearing aid in the method shown in Figure 4 above, when each functional module is divided according to its corresponding function. All relevant content of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and the technical effects that can be obtained can be referred to the above method embodiment, which will not be repeated here.

[0118] The signal processing device 700 includes an interface module 710, a modulation module 720, and a storage module 730.

[0119] As shown in Figure 7(a), when the signal processing device 700 is used to implement the functions of an audio device, each module is used to implement the following functions.

[0120] The modulation module 720 is used to modulate the audio signal to be output into a first signal. The audio signal is within the audible range, the first signal is within the ultrasonic range, and the audio content of the audio signal is the same as the audio content of the first signal. For example, the modulation module 720 is used to perform step 410 in Figure 4.

[0121] Interface module 710 is used to output a first signal. For example, interface module 710 is used to perform step 420 in Figure 4.

[0122] As shown in Figure 7(b), the signal processing device 700 includes an interface module 710, a demodulation module 740, and a storage module 730. When the signal processing device 700 is used to implement the functions of a hearing aid, each module is used to perform the following functions.

[0123] Interface module 710 is used to receive a first signal output from a broadcasting device outside the hearing aid, the first signal being within the ultrasonic range. For example, interface module 710 is used to perform step 430 in FIG4.

[0124] The demodulation module 740 is used to demodulate the first signal and output the second signal through the interface module 710. For example, the demodulation module 740 is used to perform step 440 in Figure 4.

[0125] The storage module 730 is used to store relevant information during signal processing, such as amplitude information.

[0126] It should be understood that the signal processing device 700 in this embodiment can be implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD can be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. Alternatively, when the signal processing method shown in FIG4 is implemented in software, the signal processing device 700 and its various modules can also be software modules.

[0127] A more detailed description of the communication module, modulation module, demodulation module, and storage module can be obtained directly from the relevant descriptions in the method embodiment shown in Figure 4, and will not be repeated here.

[0128] This application also provides a computer program product that, when executed by a computer, can implement the functions of any of the above method embodiments.

[0129] This application also provides a computer program that, when executed by a computer, can implement the functions of any of the above method embodiments.

[0130] This application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be implemented by a computer program instructing related hardware. This program can be stored in the computer-readable storage medium, and when executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be an internal storage unit of the terminal (including a data sending end and / or a data receiving end) of any of the foregoing embodiments, such as the terminal's hard disk or memory. The computer-readable storage medium can also be an external storage device of the terminal, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the terminal. Further, the computer-readable storage medium can include both the terminal's internal storage unit and external storage devices. The computer-readable storage medium is used to store the computer program and other programs and data required by the terminal. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0131] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.

[0132] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0133] It should be understood that in this application, "at least one (item)" means one or more. "More than one" means two or more. "At least two (items)" means two or three or more. "And / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple. Both "...when" and "if" indicate that a corresponding action will be taken under certain objective circumstances. They are not time limits, nor do they require a judgment action to be taken when the action is taken, nor do they imply any other limitations.

[0134] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner to facilitate understanding.

[0135] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0136] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0137] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0138] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0139] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of this application embodiment, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

Claims

1. A signal processing method, characterized in that, Applied to hearing aids, the method includes: Receive a first signal output from a broadcasting device outside the hearing aid, wherein the first signal is within the ultrasonic range; The second signal, processed from the first signal, is output to the user. The second signal is within the audible range, and the audio content of the second signal is the same as the audio content of the first signal.

2. The method according to claim 1, characterized in that, The method further includes: The hearing aid receives a third signal output from a broadcasting device outside the hearing aid. The third signal is within the audible range, and the audio content of the third signal is the same as the audio content of the first signal.

3. The method according to claim 2, characterized in that, The method further includes: The third signal is eliminated based on the second signal.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The device is instructed to output a signal from an external broadcasting device in either a first output mode or a second output mode, wherein the first output mode indicates that only signals within the ultrasonic range are output, and the second output mode indicates that both signals within the ultrasonic range and signals within the audible range are output.

5. The method according to any one of claims 1-4, characterized in that, The method further includes: The system receives an external signal and outputs the external signal to the user, wherein the audio content of the external signal is different from the audio content of the second signal.

6. A signal processing method, characterized in that, Applied to an audio device, the method includes: The audio signal to be output is modulated into a first signal, wherein the audio signal is within the audible range, the first signal is within the ultrasonic range, and the audio content of the audio signal is the same as the audio content of the first signal. Output the first signal.

7. The method according to claim 6, characterized in that, The method further includes: Displays the first output mode and the second output mode; Outputting the first signal includes: Receive the selection operation of the first output mode and output the first signal.

8. The method according to claim 6 or 7, characterized in that, The method further includes: Displays the first output mode and the second output mode; Outputting the first signal includes: Receive the selection operation of the second output mode, and output the first signal and the audio signal.

9. The method according to any one of claims 6-8, characterized in that, Outputting the first signal includes: The first signal is output according to the instructions of the hearing aid.

10. A signal processing system, characterized in that, The signal processing system includes an audio device and a hearing aid; the hearing aid is used to perform the method as described in any one of claims 1-5; the audio device is used to perform the method as described in any one of claims 6-9.

Citation Information

Patent Citations

  • Programmable digital hearing aid system and method thereof

    CN104023302A

  • Adjusting of hearing aid parameters using ultrasonic signal generator

    CN110545515A

  • Signal processing method and device and electronic equipment

    CN111629300A

  • Method and device for adjusting audio equipment based on ultrasonic signal, equipment and medium

    CN112866863A

  • Voice interaction method, device and equipment

    CN113628636A