Listening assisting method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a listening assisting method and device, equipment and a storage medium. According to the technical scheme, under the condition that the first earphone and the second earphone are in the auxiliary hearing mode, the auxiliary hearing device obtains the original sound through the first earphone, then carries out gain adjustment on the original sound through the target earphone to obtain the target sound, the target earphone is the first earphone or the second earphone, and finally the target sound is played through the second earphone. According to the auxiliary hearing method, pickup and playing are executed through two different earphone ends, howling can be effectively avoided due to the long distance, and the requirements of partial users with serious hearing loss can be better met.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of assistive listening technology, including but not limited to an assistive listening method, device, equipment, and storage medium. Background Art

[0002] With the aggravation of aging and the increase of hearing-impaired people, the market demand for assistive listening products such as hearing aids has increased. A hearing aid is a small amplifier that amplifies the originally inaudible sound and then uses the residual hearing of the hearing-impaired person to send the sound to the auditory center of the brain, so that the sound can be felt. Since each user has a different gain curve, when the user's hearing loss is severe, a stronger gain is required.

[0003] However, in the current related technologies, ordinary assistive listening devices generally pick up sounds using their own microphones and then play them using their own speakers. Since the microphone and the speaker are very close, it is easy to produce howling when the gain is large, resulting in the user hearing less clearly.

[0004] Therefore, how to effectively avoid howling to better meet the needs of users with severe hearing loss is an urgent problem to be solved. Summary of the Invention

[0005] In view of this, the assistive listening method, device, equipment, and storage medium provided by the embodiments of the present application can effectively avoid howling to better meet the needs of users with severe hearing loss. The assistive listening method, device, equipment, and storage medium provided by the embodiments of the present application are implemented as follows:

[0006] The assistive listening method provided by the embodiments of the present application is applied to an assistive listening device, and the assistive listening device includes a first earphone and a second earphone. The method includes: when the first earphone and the second earphone are in the assistive listening mode, obtaining the original sound through the first earphone; performing gain adjustment on the original sound through a target earphone to obtain a target sound, where the target earphone is the first earphone or the second earphone; playing the target sound through the second earphone.

[0007] In some embodiments, when the target earphone is the first earphone, the performing gain adjustment on the original sound through the target earphone to obtain a target sound includes: performing gain adjustment on the original sound through the first earphone to obtain the target sound; before playing the target sound through the second earphone, the method further includes: the first earphone sending the target sound to the second earphone through a preset protocol.

[0008] In some embodiments, when the target earphone is the second earphone, before the original sound is gain-adjusted by the target earphone to obtain the target sound, the method further includes: the first earphone sends the original sound to the second earphone through a preset protocol.

[0009] In some embodiments, the hearing aid device further includes an earphone charging case, which is used to charge the first earphone and the second earphone, and control the first earphone and the second earphone to switch operating modes, and the operating modes include a Bluetooth mode and the hearing aid mode.

[0010] In some embodiments, when the first earphone and the second earphone are in the hearing aid mode, before the original sound is obtained by the first earphone, the method includes: in response to a selection operation on the earphone charging case, controlling the first earphone and the second earphone to be in the hearing aid mode.

[0011] In some embodiments, the earphone charging case further includes a touch screen, and the selection operation is a touch operation on the touch screen; the controlling the first earphone and the second earphone to be in the hearing aid mode in response to the selection operation on the earphone charging case includes: in response to the selection operation on the touch screen, controlling the earphone charging case to send a control instruction to the first earphone and the second earphone, so that the first earphone and the second earphone are in the hearing aid mode.

[0012] In some embodiments, the gain-adjusting the original sound by the target earphone to obtain the target sound includes: based on a hearing aid algorithm and a target hearing curve, gain-adjusting the original sound to obtain the target sound, and the hearing aid algorithm includes a wide dynamic range compression algorithm.

[0013] In some embodiments, the target hearing curve is preset; or, the hearing aid device includes a plurality of hearing curves corresponding to users one by one, and the target hearing curve is determined by the target earphone from the plurality of hearing curves corresponding to users one by one based on a target instruction, and the target instruction is sent by the earphone charging case in the hearing aid device or a terminal device connected to the hearing aid device; or, when the target earphone does not receive the target instruction, the target hearing curve is determined by the target earphone according to the hearing curve of the user corresponding to the first earphone and the second earphone when they were last in the Bluetooth mode.

[0014] In some embodiments, the method further includes: when the first earphone and the second earphone are in the Bluetooth mode, detecting a first duration during which the first earphone and the second earphone are in the Bluetooth mode and in an unused state; and when the first duration is greater than or equal to a preset duration, triggering the first earphone and the second earphone to switch to the hearing aid mode.

[0015] In some embodiments, before obtaining the original sound through the first earphone, the method further includes: determining the wearing states of the first earphone and the second earphone; obtaining the original sound through the first earphone includes: when the first earphone and the second earphone are both in a worn state, obtaining the original sound through a microphone of the first earphone.

[0016] The hearing aid device provided by an embodiment of the present application is applied to a hearing aid device, and the hearing aid device includes a first earphone and a second earphone. The device includes: an obtaining module, configured to obtain an original sound through the first earphone when the first earphone and the second earphone are in the hearing aid mode; a processing module, configured to perform gain adjustment on the original sound through a target earphone to obtain a target sound, where the target earphone is the first earphone or the second earphone; and a playing module, configured to play the target sound through the second earphone.

[0017] In some embodiments, when the target earphone is the first earphone, the processing module is specifically configured to: perform gain adjustment on the original sound through the first earphone to obtain the target sound; the device further includes: a sending module, configured to send the target sound to the second earphone through a preset protocol.

[0018] In some embodiments, when the target earphone is the second earphone, the sending module is further configured to send the original sound to the second earphone through a preset protocol.

[0019] In some embodiments, the hearing aid device further includes an earphone charging case, configured to charge the first earphone and the second earphone, and control the first earphone and the second earphone to switch operating modes, where the operating modes include a Bluetooth mode and the hearing aid mode.

[0020] In some embodiments, when the first earphone and the second earphone are in the hearing aid mode, the device includes: a control module, configured to control the first earphone and the second earphone to be in the hearing aid mode in response to a selection operation on the earphone charging case.

[0021] In some embodiments, the headphone charging case further includes a touch screen, and the selection operation is a touch operation on the touch screen; specifically, the control module is configured to: in response to the selection operation on the touch screen, control the headphone charging case to send a control instruction to the first headphone and the second headphone, so that the first headphone and the second headphone are in the assisted listening mode.

[0022] In some embodiments, the processing module is specifically configured to: perform gain adjustment on the original sound based on an assisted listening algorithm and a target hearing curve to obtain the target sound, and the assisted listening algorithm includes a wide dynamic range compression algorithm.

[0023] In some embodiments, the target hearing curve is preset; alternatively, the assisted listening device includes a plurality of hearing curves corresponding to users one by one, the target hearing curve is determined by the target headphone from the plurality of hearing curves corresponding to users one by one based on a target instruction, and the target instruction is sent by the headphone charging case in the assisted listening device or a terminal device connected to the assisted listening device; or, in the case where the target headphone does not receive the target instruction, the target hearing curve is determined by the target headphone according to the hearing curve of the user corresponding to the first headphone and the second headphone when they were last in the Bluetooth mode.

[0024] In some embodiments, the device further includes: a detection module and a switching module. The detection module is configured to detect a first duration during which the first headphone and the second headphone are in the Bluetooth mode and in an unused state when the first headphone and the second headphone are in the Bluetooth mode; the switching module is configured to trigger the first headphone and the second headphone to switch to the assisted listening mode when the first duration is greater than or equal to a preset duration.

[0025] In some embodiments, the device further includes: a judgment module. The judgment module is configured to judge the wearing states of the first headphone and the second headphone; specifically, the acquisition module is configured to: when the first headphone and the second headphone are both in the worn state, acquire the original sound through the microphone of the first headphone.

[0026] The computer device provided by the embodiments of the present application includes a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the program, the assisted listening method described in the embodiments of the present application is implemented.

[0027] The computer-readable storage medium provided by the embodiments of the present application stores a computer program thereon, and when the computer program is executed by a processor, the assisted listening method provided by the embodiments of the present application is implemented.

[0028] In the hearing assistance method, device, computer device, and computer-readable storage medium provided by the embodiments of the present application, sound pickup and playback are performed through two different headphone terminals. A long distance can effectively avoid howling, so as to better meet the needs of some users with severe hearing loss and solve the technical problems proposed in the background art. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification. These drawings show embodiments consistent with the present application and, together with the specification, are used to explain the technical solutions of the present application.

[0030] Figure 1 Schematic diagram of the system architecture of the hearing assistance device provided by an embodiment of the present application;

[0031] Figure 2 Schematic diagram of the implementation process of the hearing assistance method provided by an embodiment of the present application;

[0032] Figure 3 Schematic diagram of the implementation process of the hearing assistance method provided by another embodiment of the present application;

[0033] Figure 4 Schematic diagram of the implementation process of the hearing assistance method provided by yet another embodiment of the present application;

[0034] Figure 5 Schematic diagram of the implementation process of the hearing assistance method provided by yet another embodiment of the present application;

[0035] Figure 6 Exemplary diagram of the touch screen in the headphone charging case provided by an embodiment of the present application;

[0036] Figure 7 Schematic structural diagram of the hearing assistance device provided by an embodiment of the present application;

[0037] Figure 8 Schematic structural diagram of the computer device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0038] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following will further describe the specific technical solutions of the present application in detail with reference to the accompanying drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application but are not intended to limit the scope of the present application.

[0039] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0040] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments. However, it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0041] It should be noted that the terms "first / second / third" involved in the embodiments of the present application are used to distinguish similar or different objects and do not represent a specific order for the objects. It can be understood that "first / second / third" can be interchanged in a specific order or sequence when permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0042] With the intensification of aging and the increase in the number of hearing-impaired people, the market demand for hearing aids and other assistive listening products has increased. A hearing aid is a small amplifier that amplifies sounds that were originally inaudible and then uses the residual hearing of the hearing-impaired person to send the sounds to the auditory center of the brain so that the person can perceive the sounds.

[0043] Generally, the algorithms of hearing aids can include independent research and development of hearing aid algorithms such as multi-channel compression, intelligent noise reduction, speech enhancement algorithms, adaptive directivity, acoustic feedback processing, frequency shifting, tinnitus treatment, and in-situ audiometry. Among them, the most core algorithm for compensating for hearing loss is multi-channel compression, or wide dynamic range compression, which compresses external sound signals into the audible range of the user according to the measured hearing curve, enabling the user to hear some sounds that cannot be heard without wearing a hearing aid.

[0044] Since each user has a different gain curve, when the user's hearing loss is severe, a stronger gain is required. However, in the current related technologies, ordinary assistive listening devices generally pick up sounds using their own microphones and then play them using their own speakers. Since the microphone and the speaker are very close, when the gain is large, it is easy to produce howling, resulting in the user hearing less clearly.

[0045] Therefore, how to effectively avoid howling to better meet the needs of users with severe hearing loss is an urgent problem to be solved.

[0046] In view of this, the embodiments of the present application provide an assistive listening method, which is applied to an assistive listening device. The method specifically includes: when the first earphone and the second earphone are in the assistive listening mode, obtaining the original sound through the first earphone, then adjusting the gain of the original sound through the target earphone to obtain the target sound, where the target earphone is the first earphone or the second earphone, and finally playing the target sound through the second earphone. In the assistive listening method of the present application, sound pickup and playback are performed through two different earphone ends, and the long distance can effectively avoid howling to better meet the needs of some users with severe hearing loss.

[0047] Exemplarily,Figure 1 Schematic diagram of the system architecture of the hearing assistance device provided by an embodiment of the present application. As Figure 1 shown, the hearing assistance device includes a first earphone 110, a second earphone 120, and an earphone charging case 130. The earphone charging case 130 is used to accommodate the first earphone 110 and the second earphone 120 and provide charging services for them.

[0048] Among them, the first earphone 110 includes a first central processing unit (CPU) module 111, a first Bluetooth module 112, and a first speaker 113. The second earphone 120 includes a second CPU module 121, a second Bluetooth module 122, and a second speaker 123. The earphone charging case 130 includes a third CPU module 131, a third Bluetooth module 132, and a touch screen module 133.

[0049] Specifically, the first CPU module 111 and the second CPU module 121 are used to process matters at the earphone end, such as performing gain adjustment on the sound obtained at the earphone end, etc.; the third CPU module 131 is used to process matters at the earphone charging case end, such as controlling the operation mode of the hearing assistance device, etc. The first Bluetooth module 112, the second Bluetooth module 122, and the third Bluetooth module 132 are used to establish communication connections with each other when the hearing assistance device is in the Bluetooth mode. The first speaker 113 and the second speaker 123 are used to play sound. The touch screen module 133 is used to receive the touch operation of the user, and then control the hearing assistance device to execute corresponding tasks in response to the touch operation.

[0050] It can be understood that the structure schematically shown in the embodiments of the present application does not constitute a specific limitation on the hearing assistance device. In other embodiments of the present application, the hearing assistance device may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0051] In order to make the purpose and technical solutions of the present application clearer and more intuitive, the hearing assistance method, device, equipment, and storage medium provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0052] Please refer to Figure 2 , the schematic implementation flowchart of the hearing assistance method provided by an embodiment of the present application. This method can be applied to the hearing assistance device as Figure 1 shown. Correspondingly, the first earphone in the following text is Figure 1 the first earphone 110 shown, and the second earphone in the following text is Figure 1The second earphone 120 shown, and the earphone charging case hereinafter is Figure 1 the earphone charging case 130 shown. As Figure 2 shown, the method may include the following steps 201 to step 203:

[0053] Step 201, when the first earphone and the second earphone are in the assisted listening mode, obtain the original sound through the first earphone.

[0054] In some embodiments, the first earphone and the second earphone may be true wireless stereo (TWS) Bluetooth earphones, which are connected to the terminal device via Bluetooth to implement audio playback or voice calls, etc.; the first earphone and the second earphone also have the assisted listening function and can process the picked-up sound to meet the needs of people with hearing impairments.

[0055] Optionally, the first earphone and the second earphone further include a microphone. The way for the first earphone to obtain the original sound may be to obtain the original sound through the microphone of the first earphone when the first earphone and the second earphone are in the assisted listening mode, or the first earphone receives the original sound sent by another device. This application does not make a limitation on this.

[0056] Step 202, perform gain adjustment on the original sound through the target earphone to obtain the target sound, where the target earphone is the first earphone or the second earphone.

[0057] In some embodiments, the first earphone or the second earphone may perform gain adjustment on the original sound based on an assisted listening algorithm to obtain the target sound, where the assisted listening algorithm may be a multi-channel wide dynamic range compression algorithm, an intelligent noise reduction algorithm, a speech enhancement algorithm, etc. This application does not make a limitation on this.

[0058] Among them, the principle of the multi-channel wide dynamic range compression algorithm is to perform dynamic compression processing independently in each channel, which can meet the corresponding gain compensation requirements of hearing loss patients in different frequency bands. The intelligent noise reduction algorithm is mainly used to reduce the interference of noise in the signal. For example, filters of statistical models such as a mean filter and a median filter can be used to perform an average or median operation on the signal to reduce noise; or an adaptive mean filter can be used to automatically adjust the filter parameters according to the statistical characteristics of the signal to better adapt to different noise environments. The purpose of the speech enhancement algorithm is to extract as pure original speech as possible from the noisy speech to improve the speech quality and intelligibility.

[0059] Step 203, play the target sound through the second earphone.

[0060] In some embodiments, the second earphone includes a speaker. After obtaining the target sound in step 202, the target sound can be played through the speaker of the second earphone.

[0061] In this embodiment, when the first earphone and the second earphone are in the auxiliary listening mode, the sound is acquired through the first earphone and the sound is played through the second earphone, that is, the sound pickup and playback are performed through two different earphone ends. The long distance can effectively avoid howling, so as to better meet the needs of some users with severe hearing loss.

[0062] Based on the above embodiments, Figure 3 A schematic diagram of the implementation flow of the assisted listening method provided in another embodiment of the present application. In this embodiment, the target earphone is taken as the first earphone as an example. Figure 3 As shown, the method may include the following steps 301 to 304:

[0063] Step 301: When the first earphone and the second earphone are in an auxiliary listening mode, original sound is acquired through the first earphone.

[0064] In some embodiments, the first earphone and the second earphone also include a microphone. The first earphone obtains the original sound by, for example, obtaining the original sound through the microphone of the first earphone when the first earphone and the second earphone are in auxiliary listening mode, or by receiving the original sound sent by another device. This application does not limit this.

[0065] Step 302: adjust the gain of the original sound through the first earphone to obtain the target sound.

[0066] In some embodiments, after acquiring the original sound, the first earphone can adjust the gain of the original sound based on an auxiliary hearing algorithm through its own CPU module to obtain the target sound, for example, based on a multi-channel wide dynamic range compression algorithm, an intelligent noise reduction algorithm, a speech enhancement algorithm, etc.

[0067] Optionally, before the first earphone performs gain adjustment on the original sound, it may also first perform basic noise reduction processing on the original sound to eliminate the influence of noise as much as possible, so that the processed sound is clearer.

[0068] Step 303: The first earphone sends the target sound to the second earphone through a preset protocol.

[0069] In some embodiments, the preset protocol may be a private protocol between the first headset and the second headset, and the first headset sends the target sound to the second headset through the private protocol.

[0070] Understandably, the transmission of audio data between the first earphone and the second earphone through a private protocol can reduce the size of pairing and data packets, remove the retransmission mechanism, and improve the transmission speed. At the same time, the use of a private protocol to transmit data can also effectively avoid the delay caused by the Bluetooth protocol. For example, the specific delay can be optimized to less than 20 milliseconds.

[0071] Step 304, play the target sound through the second earphone.

[0072] In some embodiments, the second earphone includes a speaker. After the first earphone sends the target sound to the second earphone in step 303, the target sound can be played through the speaker of the second earphone.

[0073] In this embodiment, when the first earphone and the second earphone are in the assisted listening mode, the sound is acquired by the first earphone and played by the second earphone. That is to say, the sound pickup and playback are performed through two different earphone ends. The long distance can effectively avoid howling, so as to better meet the needs of some users with severe hearing loss. In addition, in this embodiment, the first earphone performs gain adjustment processing on the original sound to obtain the target sound, and then sends it to the second earphone. This method of transmitting data using a private protocol between the two earphones has a low delay and can improve the transmission speed.

[0074] Based on the above embodiments, Figure 4 FIG. is a schematic implementation flow diagram of an assisted listening method provided by another embodiment of the present application. In this embodiment, taking the target earphone as the second earphone as an example, as Figure 4 shown, the method may include the following steps 401 to 404:

[0075] Step 401, when the first earphone and the second earphone are in the assisted listening mode, acquire the original sound through the first earphone.

[0076] In some embodiments, the first earphone and the second earphone further include microphones. The way for the first earphone to acquire the original sound may be to acquire the original sound through the microphone of the first earphone when the first earphone and the second earphone are in the assisted listening mode, or the first earphone receives the original sound sent by another device. The present application does not limit this.

[0077] Step 402, the first earphone sends the original sound to the second earphone through a preset protocol.

[0078] In some embodiments, the preset protocol may be a private protocol between the first earphone and the second earphone, and the first earphone sends the original sound to the second earphone through the private protocol.

[0079] Understandably, transmitting audio data between the first earphone and the second earphone through a private protocol can reduce pairing and packet size, remove the retransmission mechanism, and improve the transmission speed. At the same time, using a private protocol to transmit data can also effectively avoid the delay caused by the Bluetooth protocol. For example, the specific delay can be optimized to less than 20 milliseconds.

[0080] Step 403, perform gain adjustment on the original sound through the second earphone to obtain the target sound.

[0081] In some embodiments, after receiving the original sound, the second earphone can adjust the gain of the original sound based on the auxiliary hearing algorithm through its own CPU module to obtain the target sound, for example, it can be based on a multi-channel wide dynamic range compression algorithm, an intelligent noise reduction algorithm, a speech enhancement algorithm, etc.

[0082] Optionally, before sending the original sound to the second earphone, the first earphone may first perform basic noise reduction processing on the original sound to eliminate the influence of noise as much as possible; or after the first earphone sends the original sound to the second earphone, the second earphone first performs basic noise reduction processing on the original sound, and then adjusts the gain of the original sound after the noise reduction processing to obtain the target sound. The application does not impose any limitation on this.

[0083] Step 404: Play the target sound through the second earphone.

[0084] In some embodiments, the second earphone includes a speaker, and after the target sound is obtained in step 403, the target sound can be played through the speaker of the second earphone.

[0085] In this embodiment, when the first earphone and the second earphone are in the auxiliary listening mode, the sound is obtained by the first earphone and the sound is played by the second earphone, that is, the sound pickup and playback are performed by two different earphone ends. The long distance can effectively avoid howling, so as to better meet the needs of some users with severe hearing loss. In addition, in this embodiment, the first earphone sends the original sound to the second earphone through a private protocol, and then the second earphone performs gain adjustment processing on the original sound to obtain the target sound. This method of transmitting data using a private protocol between two earphones has a low delay and can improve the transmission speed.

[0086] Based on the above embodiments, Figure 5 A schematic diagram of the implementation flow of the auxiliary listening method provided in another embodiment of the present application is provided. In this embodiment, the auxiliary listening device also includes an earphone charging box as an example. Figure 5 As shown, the method may include the following steps 501 to 504:

[0087] Step 501: In response to a selection operation on the earphone charging box, control the first earphone and the second earphone to be in an auxiliary listening mode.

[0088] In some embodiments, the earphone charging box is used to charge the first earphone and the second earphone, and control the first earphone and the second earphone to switch operating modes, where the operating modes include a Bluetooth mode and an auxiliary listening mode. Generally, the earphone charging box is connected to the first earphone and the second earphone via Bluetooth to control the first earphone and the second earphone to switch operating modes.

[0089] Optionally, the earphone charging case further includes a touch screen, and the selection operation is a touch operation on the touch screen. The hearing assist device controls the earphone charging case to send a control instruction to the first earphone and the second earphone in response to the touch operation, so that the first earphone and the second earphone are in the hearing assist mode.

[0090] Exemplarily, please refer to Figure 6 , which is an exemplary schematic diagram of the touch screen in the earphone charging case provided by an embodiment of the present application. As Figure 6 shown, two modes are displayed on the touch screen: Bluetooth mode and hearing assist mode. The user can directly select the mode to be used on the touch screen, for example, select the hearing assist mode.

[0091] In a possible implementation manner, the hearing assist device can also detect a first duration when the first earphone and the second earphone are in the Bluetooth mode and in an unused state. When the first duration is greater than or equal to a preset duration, the hearing assist device triggers the first earphone and the second earphone to switch to the hearing assist mode. That is, if the first earphone and the second earphone are in the Bluetooth mode for a long time but the user does not use them, they will automatically switch to the hearing assist mode after reaching the preset duration.

[0092] Step 502, when the first earphone and the second earphone are in the hearing assist mode, obtain the original sound through the first earphone.

[0093] In some embodiments, the first earphone and the second earphone further include microphones. The way for the first earphone to obtain the original sound can be to obtain the original sound through the microphone of the first earphone when the first earphone and the second earphone are in the hearing assist mode, or the first earphone receives the original sound sent by another device, etc.

[0094] In a possible implementation manner, before obtaining the original sound through the first earphone, the hearing assist device can first determine the wearing states of the first earphone and the second earphone, and then obtain the original sound through the microphone of the first earphone when both the first earphone and the second earphone are in the wearing state.

[0095] Step 503, perform gain adjustment on the original sound through the target earphone based on the hearing assist algorithm and the target hearing curve to obtain the target sound. The hearing assist algorithm includes a wide dynamic range compression algorithm, and the target earphone is the first earphone or the second earphone.

[0096] Optionally, the target hearing curve is preset; alternatively, the hearing aid device includes multiple hearing curves corresponding to users one by one, and the target hearing curve is determined by the target earphone from multiple hearing curves corresponding to users one by one based on a target instruction, where the target instruction is sent by the earphone charging case in the hearing aid device or a terminal device connected to the hearing aid device; or, in the case where the target earphone does not receive the target instruction, the target hearing curve is determined by the target earphone according to the hearing curve of the user corresponding to the first earphone and the second earphone when they were last in the Bluetooth mode.

[0097] Exemplarily, in the case where the earphone charging case includes a touch screen, the user can select the target hearing curve through the touch screen; and then, through the wide dynamic range compression algorithm, adjust the gain in combination with the target hearing curve, and perform multi-channel compression and spectrum shifting on the original sound signal to obtain the target sound.

[0098] Step 504, play the target sound through the second earphone.

[0099] In some embodiments, the second earphone includes a speaker. After obtaining the target sound in step 503, the target sound can be played through the speaker of the second earphone.

[0100] In this embodiment, when the first earphone and the second earphone are in the hearing aid mode, the sound is acquired through the first earphone and played through the second earphone. That is to say, the sound pickup and playback are executed through two different earphone ends. The long distance can effectively avoid howling, so as to better meet the needs of some users with severe hearing loss.

[0101] In summary, in the hearing aid algorithm provided by the embodiments of the present application, the sound pickup and playback are executed through two different earphone ends. The long distance can effectively avoid howling, and the gain can easily reach 50 dB or even higher, which can meet the needs of some users with severe hearing loss; the private protocol between the two earphones is used to transmit audio data, which can reduce pairing and the packet size, remove the retransmission mechanism, improve the transmission speed, and effectively avoid the delay caused by the Bluetooth protocol. The specific delay can be optimized to less than 20 MS. In addition, most of the hearing aid functions such as operation and acquisition are integrated into the earphone end for execution, the overall power consumption of the system is low, and the later energy replenishment is convenient, which can increase the usage time of the hearing aid device.

[0102] It should be understood that although the steps in the above flowcharts are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise clearly stated in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above flowcharts may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0103] Based on the foregoing embodiments, an embodiment of the present application provides an assistive listening device. The device includes each module included and each unit included in each module, and can be implemented by a processor; of course, it can also be implemented by specific logic circuits. During implementation, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), a field programmable gate array (FPGA), etc.

[0104] Figure 7 A schematic structural diagram of an assistive listening device provided by an embodiment of the present application is shown in Figure 7 As shown, the assistive listening device 700 includes an acquisition module 701, a processing module 702, and a playback module 703. Among them:

[0105] The acquisition module 701 is configured to acquire the original sound through the first earphone when the first earphone and the second earphone are in the assistive listening mode; the processing module 702 is configured to perform gain adjustment on the original sound through the target earphone to obtain a target sound, where the target earphone is the first earphone or the second earphone; the playback module 703 is configured to play the target sound through the second earphone.

[0106] In some embodiments, when the target earphone is the first earphone, the processing module 702 is specifically configured to: perform gain adjustment on the original sound through the first earphone to obtain the target sound; the device further includes: a sending module. The sending module is configured to send the target sound to the second earphone through a preset protocol.

[0107] In some embodiments, when the target earphone is the second earphone, the sending module is further configured to send the original sound to the second earphone through a preset protocol.

[0108] In some embodiments, the assistive listening device further includes a headphone charging case, which is used to charge the first headphone and the second headphone, and control the first headphone and the second headphone to switch operating modes, where the operating modes include a Bluetooth mode and the assistive listening mode.

[0109] In some embodiments, when the first headphone and the second headphone are in the assistive listening mode, the device includes: a control module. The control module is configured to control the first headphone and the second headphone to be in the assistive listening mode in response to a selection operation on the headphone charging case.

[0110] In some embodiments, the headphone charging case further includes a touch screen, and the selection operation is a touch operation on the touch screen; specifically, the control module is configured to: in response to the selection operation on the touch screen, control the headphone charging case to send a control instruction to the first headphone and the second headphone, so that the first headphone and the second headphone are in the assistive listening mode.

[0111] In some embodiments, the processing module 702 is specifically configured to: perform gain adjustment on the original sound based on an assistive listening algorithm and a target hearing curve to obtain the target sound, where the assistive listening algorithm includes a wide dynamic range compression algorithm.

[0112] In some embodiments, the target hearing curve is preset; or, the assistive listening device includes multiple hearing curves corresponding to users one by one, and the target hearing curve is determined by the target headphone from the multiple hearing curves corresponding to users one by one based on a target instruction, where the target instruction is sent by the headphone charging case in the assistive listening device or a terminal device connected to the assistive listening device; or, when the target headphone does not receive the target instruction, the target hearing curve is determined by the target headphone according to the hearing curve of the user corresponding to the first headphone and the second headphone when they were last in the Bluetooth mode.

[0113] In some embodiments, the device further includes: a detection module and a switching module. The detection module is configured to detect a first duration during which the first headphone and the second headphone are in the Bluetooth mode and in an unused state when the first headphone and the second headphone are in the Bluetooth mode; the switching module is configured to trigger the first headphone and the second headphone to switch to the assistive listening mode when the first duration is greater than or equal to a preset duration.

[0114] In some embodiments, the device further includes: a judgment module. The judgment module is used to judge the wearing states of the first earphone and the second earphone; specifically, the obtaining module 701 is configured to: when both the first earphone and the second earphone are in the wearing states, obtain the original sound through the microphone of the first earphone.

[0115] The description of the above device embodiments is similar to that of the above method embodiments and has similar beneficial effects to those of the method embodiments. For the technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0116] It should be noted that in the embodiments of the present application Figure 7 The division of the modules of the assisted listening device shown is illustrative. It is only a logical function division, and there may be other division methods in actual implementation. In addition, in each embodiment of the present application, each functional unit may be integrated in a processing unit, or may exist physically alone, or two or more units may be integrated in one unit. The above integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software functional unit. It may also be implemented in the form of a combination of software and hardware.

[0117] It should be noted that in the embodiments of the present application, if the above method is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the related technology, may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing an electronic device to execute all or part of the methods described in the embodiments of the present application. The foregoing storage medium includes: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disc that can store program codes. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0118] The embodiments of the present application provide a computer device, which may be a server, and its internal structure diagram may be as Figure 8As shown. The computer device includes a processor, a memory, and a network interface connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with an external terminal via a network connection. The computer program, when executed by the processor, implements the above method.

[0119] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the steps in the auxiliary listening method provided in the above embodiment.

[0120] An embodiment of the present application provides a computer program product containing instructions. When it runs on a computer, it causes the computer to execute the steps in the auxiliary listening method provided in the above method embodiment.

[0121] Those skilled in the art can understand that Figure 8 the structure shown in is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different component layout.

[0122] In one embodiment, the auxiliary listening device provided by the present application can be implemented in the form of a computer program, and the computer program can run on a computer device such as Figure 8 shown. Each program module constituting the above device can be stored in the memory of the computer device. The computer program constituted by each program module causes the processor to execute the steps in the methods of the various embodiments of the present application described in this specification.

[0123] It should be pointed out here that: the descriptions of the above storage medium and device embodiments are similar to the descriptions of the above method embodiments, and have beneficial effects similar to those of the method embodiments. For the technical details not disclosed in the storage medium, storage medium, and device embodiments of the present application, please refer to the descriptions of the method embodiments of the present application for understanding.

[0124] It should be understood that the "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the "in one embodiment" or "in an embodiment" or "in some embodiments" that appear throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the magnitudes of the serial numbers of the above processes do not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The serial numbers of the embodiments of the present application above are only for description and do not represent the advantages or disadvantages of the embodiments. The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referred to each other. For the sake of brevity, they will not be repeated herein.

[0125] The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, object A and / or object B can represent: the situation where object A exists alone, the situation where object A and object B exist simultaneously, and the situation where object B exists alone.

[0126] It should be noted that in this article, the term "comprise", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element.

[0127] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only illustrative. For example, the division of the modules is only a logical function division, and there can be other division methods in actual implementation. For example, multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling or communication connection between the components shown or discussed with each other can be through some interfaces, and the indirect coupling or communication connection of the devices or modules can be electrical, mechanical or other forms.

[0128] The modules described above as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network elements; some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] In addition, in each embodiment of the present application, all the functional modules may be integrated into one processing unit, or each module may be separately used as a unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of a combination of hardware and software functional units.

[0130] Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions. The foregoing program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps including the above method embodiments; and the foregoing storage medium includes: removable storage devices, read-only memory (ROM), magnetic disks, or optical disks, etc., which can store program codes.

[0131] Alternatively, if the above integrated unit of the present application is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of the present application, in essence or the part that contributes to the related art, may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing an electronic device to execute all or part of the methods described in the embodiments of the present application. And the foregoing storage medium includes: removable storage devices, ROM, magnetic disks, or optical disks, etc., which can store program codes.

[0132] The methods disclosed in several method embodiments provided by the present application can be arbitrarily combined without conflict to obtain new method embodiments.

[0133] The features disclosed in several product embodiments provided by the present application can be arbitrarily combined without conflict to obtain new product embodiments.

[0134] The features disclosed in several method or device embodiments provided by the present application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0135] As described above, it is only the implementation mode of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the said claims.

Claims

1. An auxiliary hearing method, characterized in that, Applied to a hearing assistance device, the hearing assistance device includes a first earphone and a second earphone, and the method includes: When the first earphone and the second earphone are in the hearing assistance mode, obtain the original sound through the first earphone; Perform gain adjustment on the original sound through the target earphone to obtain the target sound, where the target earphone is the first earphone or the second earphone; Play the target sound through the second earphone.

2. The method according to claim 1, wherein When the target earphone is the first earphone, the performing gain adjustment on the original sound through the target earphone to obtain the target sound includes: Perform gain adjustment on the original sound through the first earphone to obtain the target sound; Before playing the target sound through the second earphone, the method further includes: The first earphone sends the target sound to the second earphone through a preset protocol.

3. The method according to claim 1, characterized in that, When the target earphone is the second earphone, before performing gain adjustment on the original sound through the target earphone to obtain the target sound, the method further includes: The first earphone sends the original sound to the second earphone through a preset protocol.

4. The method according to claim 1, characterized in that The hearing assistance device further includes an earphone charging case, which is used to charge the first earphone and the second earphone, and control the first earphone and the second earphone to switch operating modes, and the operating modes include a Bluetooth mode and the hearing assistance mode.

5. The method according to claim 4, characterized in that, Before obtaining the original sound through the first earphone when the first earphone and the second earphone are in the hearing assistance mode, the method includes: In response to a selection operation on the earphone charging case, control the first earphone and the second earphone to be in the hearing assistance mode.

6. The method according to claim 5, wherein The earphone charging case further includes a touch screen, and the selection operation is a touch operation on the touch screen; The controlling the first earphone and the second earphone to be in the hearing assistance mode in response to the selection operation on the earphone charging case includes: In response to the selection operation on the touch screen, control the earphone charging case to send a control instruction to the first earphone and the second earphone, so that the first earphone and the second earphone are in the hearing assistance mode.

7. The method according to claim 1, wherein The performing gain adjustment on the original sound through the target earphone to obtain the target sound includes: Perform gain adjustment on the original sound based on a hearing assistance algorithm and a target hearing curve to obtain the target sound, and the hearing assistance algorithm includes a wide dynamic range compression algorithm.

8. The method according to claim 7, wherein The target hearing curve is preset; or, The hearing assistance device includes multiple hearing curves corresponding to users one by one, and the target hearing curve is determined by the target earphone from the multiple hearing curves corresponding to users one by one based on a target instruction, and the target instruction is sent by the earphone charging case in the hearing assistance device or a terminal device connected to the hearing assistance device; Or, when the target earphone does not receive the target instruction, the target hearing curve is determined by the target earphone according to the hearing curve of the user corresponding to the first earphone and the second earphone when they were last in the Bluetooth mode.

9. The method according to claim 4, wherein The method further includes: When the first earphone and the second earphone are in the Bluetooth mode, detect a first duration during which the first earphone and the second earphone are in the Bluetooth mode and in an unused state; When the first duration is greater than or equal to a preset duration, trigger the first earphone and the second earphone to switch to the hearing aid mode.

10. The method according to claim 1, characterized in that Before obtaining the original sound through the first earphone, the method further includes: Judge the wearing states of the first earphone and the second earphone; The obtaining the original sound through the first earphone includes: When the first earphone and the second earphone are both in a worn state, obtain the original sound through the microphone of the first earphone.

11. An assistive listening device, characterized in that, Applied to a hearing aid device, the hearing aid device includes a first earphone and a second earphone, and the device includes: An obtaining module, configured to obtain original sound through the first earphone when the first earphone and the second earphone are in the hearing aid mode; A processing module, configured to perform gain adjustment on the original sound through a target earphone to obtain a target sound, where the target earphone is the first earphone or the second earphone; A playing module, configured to play the target sound through the second earphone.

12. A computer device, comprising a memory and a processor, the memory storing a computer program that can run on the processor, characterized in that, When the processor executes the program, the steps of the method according to any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images