Audio shielding method, hearing aid device, control device and system

Abstract

The embodiment of the invention discloses an audio shielding method, hearing aid equipment, control equipment and system, and the method comprises the steps: continuously collecting first audio data sent by at least one sound production object in an external space in a working mode, and enabling each sound production object to have the corresponding first audio data; in the collection process, the collected first audio data are sent to the control equipment; receiving an audio shielding instruction generated by the control device based on the first audio data, wherein the audio shielding instruction is used for instructing the hearing aid device to shield the first audio data sent by a target sounding object in the at least one sounding object; and shielding real-time first audio data of the target sounding object according to the audio shielding instruction, and amplifying real-time first audio data of other unshielded sounding objects. By adopting the method, the technical problem that a hearing aid cannot shield specified sound in the prior art can be solved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of audio processing technology, and in particular to an audio shielding method, a hearing aid device, a control device and a system. Background Art

[0002] Hearing aids are small loudspeakers that can amplify sounds that the hearing-impaired cannot hear, allowing them to hear them. At present, hearing aids on the market are usually used alone and cannot block specific sounds. When hearing-impaired people wear hearing aids, they often hear sounds they don’t like, such as insults from people they don’t like, children crying, high-frequency noises in construction sites, etc., which cause trouble for the hearing-impaired. Summary of the invention

[0003] The embodiments of the present application provide an audio shielding method, a hearing aid device, a control device and a system to solve the technical problem in the related art that the hearing aid cannot shield the specified sound.

[0004] In a first aspect, an embodiment of the present application provides an audio shielding method, which is applied to a hearing aid device, and the method includes:

[0005] In the working mode, first audio data emitted by at least one sound-emitting object in the external space is continuously collected, and each of the sound-emitting objects has corresponding first audio data;

[0006] During the acquisition process, the acquired first audio data is sent to the control device;

[0007] receiving an audio shielding instruction generated by the control device based on the first audio data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects;

[0008] The real-time first audio data of the target sound-emitting object is shielded according to the audio shielding instruction, and the real-time first audio data of other sound-emitting objects that are not shielded are amplified.

[0009] In a second aspect, an embodiment of the present application further provides an audio shielding method, which is applied to a control device, comprising:

[0010] Receive at least one first audio data collected by a hearing aid device, each of the first audio data corresponds to a sound object;

[0011] identifying voiceprint data of the first audio data;

[0012] Determine, in the identified voiceprint data, voiceprint data that matches the shielded voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects, and the sound-emitting object corresponding to the matched voiceprint data is the target sound-emitting object;

[0013] The audio shielding instruction is sent to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction.

[0014] In a third aspect, an embodiment of the present application further provides a hearing aid device, including: an audio module, an amplified audio module, and a first communication module.

[0015] The audio module is used to continuously collect first audio data emitted by at least one sound-emitting object in the external space in the working mode, and each of the sound-emitting objects has corresponding first audio data;

[0016] The first communication module is used to send the collected first audio data to the control device during the collection process; and is used to receive an audio shielding instruction generated by the control device based on the first audio data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects;

[0017] The audio amplification module is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, and amplify the real-time first audio data of other sound-emitting objects that are not shielded.

[0018] In a fourth aspect, an embodiment of the present application further provides a control device, including: a second processor and a second communication module,

[0019] The second communication module is used to receive at least one first audio data collected by the hearing aid device, each of the first audio data corresponds to a sound object;

[0020] The second processor is used to identify the voiceprint data of the first audio data; and to determine the voiceprint data that matches the shielding voiceprint data in the identified voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by a target sounding object among at least one of the sounding objects, and the sounding object corresponding to the matched voiceprint data is the target sounding object;

[0021] The second communication module is further configured to send the audio shielding instruction to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction.

[0022] In a fifth aspect, an embodiment of the present application further provides an audio shielding system, comprising: the hearing aid device as described in the third aspect and the control device as described in the fourth aspect.

[0023] In one embodiment of the present application, in working mode, first audio data emitted by at least one sound-emitting object in the external space is continuously collected, and the first audio data is sent to a control device to receive an audio shielding instruction obtained by the control device based on the first audio data, and a technical means is used to shield the real-time first audio data of the target sound-emitting object based on the audio shielding instruction. This solves the technical problem in the related art that the hearing aid cannot shield the specified sound. Through the cooperation between the hearing aid device and the control device, the control device instructs the hearing aid device to shield the sound emitted by the specified sound-emitting object, so that the user can only hear the required sound, thereby improving the user's hearing aid experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A structural schematic diagram of a hearing aid device provided in one embodiment of the present application;

[0025] Figure 2 A schematic diagram of the structure of a control device provided in one embodiment of the present application;

[0026] Figure 3 A schematic diagram of an audio shielding system at a first viewing angle provided by an embodiment of the present application;

[0027] Figure 4 A schematic diagram of an audio shielding system at a second viewing angle provided by an embodiment of the present application;

[0028] Figure 5 A schematic diagram of an audio shielding system explosion from a second viewing angle provided by an embodiment of the present application;

[0029] Figure 6 A schematic diagram of an audio shielding system explosion from a third perspective provided by an embodiment of the present application;

[0030] Figure 7 A flowchart of an audio shielding method provided for one embodiment of the present application;

[0031] Figure 8 Flow chart of another audio shielding method provided for one embodiment of the present application

[0032] Fig. 9 A flowchart of another audio shielding method provided for an embodiment of the present application. DETAILED DESCRIPTION

[0033] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.

[0034] An audio shielding method is provided in an embodiment of the present application, and the audio shielding method is applicable to an audio shielding system. The audio shielding system is applied in a hearing aid scenario for the hearing-impaired (i.e., the user). Specifically, after the audio shielding system is used by the user, the user can hear the sound, and can shield the sound that the user does not like, so as to improve the user's hearing aid experience. In one embodiment, the audio shielding system includes a hearing aid device and a control device.

[0035] The hearing aid device may also be referred to as a hearing aid, which can be worn on the user's ear for use by the user. The hearing aid device may be an ear canal type or an in-ear type, and the embodiment does not limit this. Figure 1 A structural diagram of a hearing aid device provided in one embodiment of the present application, referring to Figure 1 The hearing aid device 10 is at least provided with an audio module 11 , an amplified audio module 12 and a first communication module 13 .

[0036] The audio module 11 can collect sounds within a certain distance range in the space where the user is located to obtain audio data. In one embodiment, the audio module 11 includes a sound pickup microphone (also referred to as a sound pickup MIC) 111 and a noise reduction microphone (also referred to as a noise reduction MIC) 112. The sound pickup microphone 111 can collect external sounds to obtain corresponding audio data. The noise reduction microphone 112 is used to perform noise reduction processing on the audio data collected by the sound pickup microphone 111. The working methods of the sound pickup microphone 111 and the noise reduction microphone 112 can refer to the working methods of the sound pickup microphone and the noise reduction microphone in the existing hearing aid, and are not described separately at present. The process of collecting audio data by the hearing aid device mentioned in the embodiment refers to the process of collecting and reducing noise by the audio module 11, and the audio data collected by the hearing aid device refers to the audio data obtained after the audio module 11 collects and reduces noise.

[0037] It should be noted that when there are multiple sound-emitting objects in the space where the user is located (the range that can be collected by the audio module 11), the audio data collected by the pickup microphone 111 includes the sounds emitted by the multiple sound-emitting objects. Among them, the sound-emitting object refers to an object that can emit sound. For example, everyone can be a sound-emitting object. When a working device emits sound, the device can also be a sound-emitting object.

[0038] The amplified audio module 12 includes a loudspeaker 121 and a first processor 122. The loudspeaker 122 is used to amplify the audio data collected by the audio module 11 (the audio data is currently the audio data processed by the noise reduction microphone 112) so that the user can hear the audio data. The amplification method used by the loudspeaker 121 to amplify the audio data can refer to the existing audio amplification method and is not described separately at present. The first processor 122 can also be recorded as an audio processor, which implements control, information and data processing in the hearing aid device 10 so that the hearing aid device 10 can implement corresponding functions. In one embodiment, the first processor 122 can control the loudspeaker 121 to shield (i.e., not amplify) certain specified audio data when the loudspeaker 121 amplifies the audio data, so that the user can only hear part of the audio data. The type of processor used by the first processor 122 is not currently limited, and it only needs to meet the function of the audio processor in the embodiment. In other words, the process of amplifying audio data by the hearing aid device mentioned in the embodiments refers to the process of amplifying audio data by the amplifying audio module 12, and the data processing processes related to shielding of the hearing aid device (such as identifying voiceprint data, etc.) mentioned in the embodiments refers to the data processing processes performed by the amplifying audio module 12.

[0039] The first communication module 13 is used to realize communication between the hearing aid device 10 and the outside. Currently, the hearing aid device 10 can realize communication with the control device through the first communication module 13. The first communication module 13 can be a Bluetooth module or a WIFI module, etc. In the embodiment, the first communication module 13 is described as a Bluetooth module as an example, that is, the hearing aid device communicates with the control device via Bluetooth. The communication content of the first communication module 13 is determined by the first processor 122 of the amplified audio module 12, and the process of communication between the hearing aid device 10 and the control device mentioned in the embodiment is realized by the first communication module.

[0040] It should be noted that the hearing aid device 10 may also include other components, such as a battery component, a charging pin, etc., which is not limited in the embodiment.

[0041] The control device is a portable terminal device for users to use. In the embodiment, the control device is mainly used for the user to select the sound object to be blocked, and instruct the hearing aid device to block the audio data emitted by the sound object. The control device can be a mobile phone, a smart bracelet or a smart watch. In one embodiment, the control device is described as a smart watch. Figure 2 A schematic diagram of a control device provided in one embodiment of the present application, referring to Figure 2 The control device 20 includes: a second processor 21 and a second communication module 23.

[0042] The second processor 21 implements control, information and data processing in the control device 20 so that the control device can realize the corresponding functions. The type of processor used by the second processor 21 is not limited at present, and it only needs to meet the functions of the second processor 21 in the embodiment. Multiple programs can be installed in the second processor 21, and different programs are used to realize different functions. At present, at least a voiceprint shielding program is installed in the second processor 21. After the voiceprint shielding program is started, it can realize the recognition of the voiceprint data of the audio data collected by the hearing aid device, and then obtain the corresponding voiceprint model. It can also determine the voiceprint model for shielding and resuming playback based on the user's interaction, and instruct the hearing aid device to shield or resume playing the corresponding audio data. That is, the data processing processes related to the control device and shielding mentioned in the embodiment can be realized by the second processor 21, and specifically by the voiceprint shielding program in the second processor 21.

[0043] The second communication module 23 is used to realize the communication between the control device 20 and the outside. Currently, the control device 20 can realize the communication with the control device 20 through the second communication module 23. That is, the second communication module 23 is used in conjunction with the first communication module 13. At this time, the communication type realized by the second communication module 23 is the same as the communication type realized by the first communication module 13. For example, the second communication module 23 and the first communication module 13 are both Bluetooth modules to realize Bluetooth communication. The communication content of the second communication module 23 is determined by the second processor 21, and the process of the control device 20 and the hearing aid device 10 mentioned in the embodiment is realized by the second communication module.

[0044] refer to Figure 2 , the control device 20 may also include a touch display screen 22. The touch display screen 22 may also be recorded as a touch screen, a touch display screen, etc., which has display and touch functions. The user can interact with the control device 20 by touching the touch display screen with a finger, so as to issue instructions to the control device 20 to instruct the control device to implement a certain function. At present, the types corresponding to the display part and the touch part in the touch display screen 22 are not limited in the embodiment. The content displayed by the touch display screen 22 is determined by the second processor 21, and the interactive operations received by the touch display screen 22 are all responded to by the second processor 21. The display of the control device mentioned in the embodiment and the reception of the user's operation are both implemented by the touch display screen 22.

[0045] It should be noted that the second processor 21, the touch display screen 22 and the second communication module 23 can all be located in the dial of the smart watch. The control device 20 may also include other components, such as: a strap, a bezel, a strap quick release part and a charging pin, etc., which are not limited in the embodiment.

[0046] In one embodiment, in order to facilitate the user to store and charge the hearing aid device 10, the hearing aid device 10 can be fixed on the control device 20 when not in use by the user, that is, when the hearing aid device 10 is not working, it can be detachably fixed in the control device 20. The hearing aid device 10 and the control device 20 can be fixed by magnetism or other means.

[0047] For example, when the control device 20 is a smart watch, Figure 3 to Figure 4 Schematic diagrams of the audio shielding system when the hearing aid device 10 is fixed on the control device 20 at different viewing angles, Figures 5 and 6 Schematic diagrams of the audio shielding system when the hearing aid device 10 and the control device 20 explode at different viewing angles. Figures 3 to 6 It can be seen that the control device 20 includes a bezel 24, a host 25 (including a second processor 21 and a second communication module 23), a touch screen 22, a strap 26, a strap quick release 27, and a charging pin 28. The hearing aid device 10 is fixed to the back of the bezel 24 and both sides of the touch screen 22, and the user can take out the hearing aid device 10 from the control device 20 for use when needed.

[0048] In one embodiment, taking the magnetic fixation method as an example, when the hearing aid device 10 is fixed to the control device 20, the control device 20 can charge the hearing aid device 10, and the hearing aid device 10 does not work, that is, it does not collect sound for amplification, and does not communicate data with the control device 20. When the user takes the hearing aid device 10 out of the control device 20 and wears it, the hearing aid device 20 works, that is, it collects and amplifies sound, and can also communicate with the control device 20, such as shielding certain audio data based on the instructions of the control device 20.

[0049] Need to explain, Figures 3 to 6 The fixing method of the control device 20 and the hearing aid device 10 is merely exemplified. In actual applications, the hearing aid device 10 may also be fixed at other locations.

[0050] When the hearing aid device 10 and the control device 20 are used in conjunction with each other, an audio shielding method can be implemented.

[0051] Figure 7 A flowchart of an audio shielding method provided by an embodiment of the present application. The audio shielding method can be performed by a hearing aid device, refer to Figure 7 , the audio shielding method includes steps 310 to 340.

[0052] Step 310: In the working mode, first audio data emitted by at least one sound-emitting object in the external space is continuously collected, and each sound-emitting object has corresponding first audio data.

[0053] Currently, in order to facilitate understanding of the technical solution, the hearing aid device includes a working mode and a non-working mode. The working mode refers to the state in which the hearing aid device is separated from the control device and is used by the user. At this time, the hearing aid device collects and amplifies audio data. The non-working mode refers to the state in which the hearing aid device is fixed on the control device. At this time, the hearing aid device does not collect and amplify audio data.

[0054] In working mode, the hearing aid device continuously collects sounds from the external space and obtains audio data. The external space refers to the space within a certain distance range where the user is located, and the certain distance range can also be understood as the collection range of the hearing aid device.

[0055] In one embodiment, when the control device determines that certain audio data needs to be shielded, the audio data emitted by the sound-emitting object in the external space is recorded as the first audio data. It should be noted that when there is at least one sound-emitting object in the external space, the audio data corresponding to the sound emitted by each sound-emitting object can be collected by the hearing aid device. That is, for each sound-emitting object, the hearing aid device can collect the corresponding first audio data. At this time, the audio data collected by the hearing aid device is audio data mixed with multiple first audio data, and the hearing aid device does not distinguish each first audio data.

[0056] Optionally, in the working mode, the collection process of the first audio data is continuous, that is, the hearing aid device continuously collects the first audio data.

[0057] Step 320: During the collection process, the collected first audio data is sent to the control device.

[0058] Exemplarily, when collecting the first audio data, the hearing aid device sends each first audio data currently collected to the control device.

[0059] In an optional manner, the hearing aid device sends the first audio data collected at the beginning to the control device. Optionally, the first audio data collected at the beginning can be the first audio data collected within a set time (the specific value is set in combination with actual conditions). That is, when the hearing aid device starts to collect the first audio data, it sends the first audio data to the control device and starts timing. When the timing reaches the set time, the hearing aid device stops sending the first audio data to the control device.

[0060] Optionally, the hearing aid device may send the first audio data to the control device upon receiving a corresponding instruction sent by the control device. For example, when the control device sets the voiceprint data to be shielded, it sends an instruction to the hearing aid device, and the hearing aid device sends the first audio data to the control device based on the instruction.

[0061] Step 330: Receive an audio shielding instruction generated by the control device based on the first audio data, where the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by a target sound-emitting object among at least one sound-emitting object.

[0062] Currently, the control device can receive the first audio data corresponding to each sound-emitting object in the external space. Afterwards, the control device determines whether the sound-emitting object corresponding to each first audio data needs to be shielded.

[0063] The method by which the control device determines whether shielding is required is not currently limited. In one embodiment, whether the sound object corresponding to the first audio data needs to be shielded is determined by comparing voiceprint data. Voiceprint refers to the sound wave spectrum carrying speech information displayed by an electroacoustic instrument, which can also be recorded as voiceprint data or voiceprint model. It is a concrete model generated by piling up various data. Voiceprint data is unique and relatively stable. Therefore, different sound objects can be identified by distinguishing different voiceprint data, that is, different sound objects emit different voiceprint data.

[0064] Specifically, the control device pre-stores the voiceprint data of the sound-emitting object that needs to be shielded. Currently, the voiceprint data that needs to be shielded is recorded as shielded voiceprint data. After receiving the first audio data, the control device identifies the voiceprint data of the first audio data, and then compares the voiceprint data with the shielded voiceprint data. If the voiceprint data and the shielded voiceprint data are highly similar (the similarity is higher than the preset similarity threshold), it means that the sound emitted by the sound-emitting object corresponding to the voiceprint data (i.e., the corresponding first audio data) needs to be shielded. At this time, the control device can notify the hearing aid device to shield the first audio data emitted by the sound-emitting object. It can be understood that if there are currently multiple voiceprint data of the first audio data that are highly similar to the corresponding multiple shielded voiceprint data, then the control device notifies the hearing aid device to shield multiple first audio data emitted by multiple sound-emitting objects.

[0065] Currently, the instruction for the control device to notify the hearing aid device to shield the specified voiceprint data is recorded as an audio shielding instruction, and the sound object of the voiceprint data shielded by the audio shielding instruction is recorded as the target sound object. Exemplarily, after the control device generates the audio shielding instruction based on the comparison result of the voiceprint data, the audio shielding instruction is sent to the hearing aid device.

[0066] It should be noted that after receiving the audio shielding instruction sent by the control device, the hearing aid device stops sending the first audio data to the control device.

[0067] Optionally, before receiving the audio shielding instruction, the hearing aid device may amplify the first audio data collected in real time, that is, play all the first audio data in real time. Alternatively, the first audio data collected in real time is not amplified, that is, all the first audio data is not played, and after receiving the audio shielding instruction, a portion of the first audio data specified in the audio shielding instruction is amplified in a targeted manner.

[0068] Step 340: shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, and amplify the real-time first audio data of other sound-emitting objects that are not shielded.

[0069] Exemplarily, after receiving the audio shielding instruction, the hearing aid device can shield the first audio data emitted by the target sound-emitting object according to the audio shielding instruction. At this time, the hearing aid device only needs to amplify the first audio data emitted by other sound-emitting objects other than the target sound-emitting object. Although the first audio data emitted by the subsequent target sound-emitting object will be collected by the hearing aid device, it will not be amplified and will not be heard by the user, thereby shielding the first audio data of the target sound-emitting object.

[0070] In one embodiment, the hearing aid device can identify which first audio data currently belongs to the target sound-emitting object through the voiceprint data of the target sound-emitting object. At this time, the audio shielding instruction includes the voiceprint data of the target sound-emitting object, and shielding the real-time first audio data of the target sound-emitting object according to the audio shielding instruction may include steps 341-342.

[0071] Step 341: Obtain the voiceprint data contained in the audio shielding instruction.

[0072] Exemplarily, the audio shielding instruction includes the voiceprint data of each target sound-emitting object that needs to be shielded (i.e., there is at least one target sound-emitting object). It can be understood that since the voiceprint data is unique, the voiceprint data of the target sound-emitting object contained in the audio shielding instruction and the voiceprint data corresponding to the real-time first audio data of the target sound-emitting object collected by the hearing aid device should be consistent or highly similar. Therefore, after receiving the audio shielding instruction, the hearing aid device can parse the audio shielding instruction to obtain the voiceprint data contained therein.

[0073] Step 342: Stop amplifying the real-time first audio data corresponding to the voiceprint data.

[0074] After the hearing aid device obtains the voiceprint data contained in the audio shielding instruction, it can identify the voiceprint data corresponding to the first audio data currently collected in real time, and then amplify the first audio data whose own voiceprint data is different from the voiceprint data contained in the audio shielding instruction, and abandon processing (i.e. stop amplifying) the first audio data whose own voiceprint data is the same as or highly similar to the voiceprint data contained in the audio shielding instruction (i.e. the degree of similarity is higher than the similarity threshold).

[0075] It can be understood that after identifying the first audio data whose amplified own voiceprint data is different from the voiceprint data contained in the audio shielding instruction and the first audio data that is the same as or highly similar to the voiceprint data, the first audio data subsequently collected by the hearing aid device can directly use the current recognition result.

[0076] In the above, in the working mode, the first audio data emitted by at least one sound-emitting object in the external space is continuously collected, and the first audio data is sent to the control device to receive the audio shielding instruction obtained by the control device based on the first audio data, and the technical means of shielding the real-time first audio data of the target sound-emitting object based on the audio shielding instruction solves the technical problem that the hearing aid cannot shield the specified sound in the related art. Through the cooperation of the hearing aid device and the control device, the control device instructs the hearing aid device to shield the sound emitted by the specified sound-emitting object, so that the user can only hear the required sound, thereby improving the user's hearing aid experience. In addition, by utilizing the uniqueness of the voiceprint data, the sounds emitted by different sound-emitting objects are distinguished by the voiceprint data, and then it is determined whether the sound emitted by the sound-emitting object needs to be shielded, which also makes the shielding of the specified sound simple and accurate.

[0077] In one embodiment of the present application, the shielded voiceprint data pre-stored in the control device can be determined based on the audio data previously collected by the hearing aid device and sent to the control device. Figure 8 The audio shielding method performed by the aforementioned hearing aid device may further include steps 410 to 430:

[0078] Step 410: When a shielding control instruction is received from a control device, second audio data emitted by at least one sound-emitting object in the external space is collected and sent to the control device. Each sound-emitting object has corresponding second audio data. The shielding control instruction is a shielding start instruction or a shielding new instruction.

[0079] The shielding control instruction refers to the instruction that the control device needs to set to shield the voiceprint data. The shielding control instruction is generated by the control device and sent to the hearing aid device.

[0080] In one embodiment, the shielding control instruction may be a shielding start instruction or a shielding new addition instruction.

[0081] The shielding start instruction refers to an instruction for starting the voiceprint data shielding function. Exemplarily, after the control device starts the voiceprint shielding program, the voiceprint shielding program generates a shielding start instruction, or, after the control device starts the voiceprint shielding program, the user operates the voiceprint shielding program to start the voiceprint data shielding function, and the voiceprint shielding program generates a shielding start instruction. Afterwards, the control device sends the shielding start instruction to the hearing aid device. After receiving the shielding start instruction, the hearing aid device determines that the voiceprint data shielding function is activated, and subsequently needs to set the shielded voiceprint data used this time. At this time, the hearing aid device needs to send the audio data of each sound object currently collected to the control device, so that the user can select the sound object to be shielded through the control device.

[0082] Optionally, if the user has set shielded voiceprint data when the voiceprint shielding program was started and run last time, then after starting the voiceprint shielding program this time, the voiceprint shielding program can prompt the user on the touch screen whether to use the previously set shielded voiceprint data. If the user chooses to use it, the voiceprint shielding program continues to use the previously set shielded voiceprint data, and generates a shielding start instruction to send to the hearing aid device. At this time, the user can determine whether to add new shielded voiceprint data based on the audio data currently collected by the hearing aid device.

[0083] The shielding new instruction refers to the instruction to add shielding voiceprint data after the voiceprint data shielding function has been started (that is, shielded voiceprint data has been obtained). Currently, the control device has started and run the voiceprint shielding program. The user can instruct the voiceprint shielding program to add new shielding voiceprint data by operating the control device. At this time, the voiceprint shielding program can generate a shielding new instruction based on the user's operation and send it to the hearing aid device.

[0084] It should be noted that the hearing aid device responds in the same way after receiving the shielding new instruction as after receiving the shielding start instruction. The difference is that the generation node of the shielding start instruction is after the voiceprint shielding program is started, while the generation node of the shielding new instruction is when the voiceprint shielding program is already running.

[0085] After receiving the shielding control instruction, the hearing aid device determines that it is necessary to set the shielding voiceprint data (i.e., select the target sounding object). At this time, the hearing aid device sends the currently collected audio data to the control device. In the embodiment, when the shielding voiceprint data is set, the audio data sent by the hearing aid device is recorded as the second audio data. It can be understood that, currently, the first audio data and the second audio data correspond to the same external space. For the hearing aid device, whether collecting the first audio data or the second audio data, it is collecting audio data. In the embodiment, only for the convenience of understanding the technical solution, the audio data collected at different time nodes (or for different purposes) are recorded as the first audio data and the second audio data respectively.

[0086] Exemplarily, the hearing aid device continuously collects the second audio data and sends the real-time second audio data to the control device.

[0087] Optionally, when the shielding control instruction is a shielding new addition instruction, when the hearing aid device sends the second audio data, if there is currently first audio data that needs to be shielded, the first audio data may not be sent as the second audio data.

[0088] Step 420: The receiving control device obtains alternative audio data based on the second audio data, and the sound object corresponding to the alternative audio data is the alternative shielded sound object.

[0089] Exemplarily, after receiving the second audio data, the control device identifies the voiceprint data corresponding to the second audio data. At this time, each sound-emitting object has corresponding voiceprint data. Afterwards, the control device can display an audio list (or sequence), and each audio data in the audio list (or sequence) corresponds to a voiceprint data (i.e., corresponds to a sound-emitting object). The audio data can be the second audio data currently received, or it can be a section of audio data of a preset duration (such as 3s to 6s) intercepted from the second audio data, or it can be a section of audio data of a preset duration generated based on voiceprint data. Currently, the audio data is described as an example of an audio data of a preset duration intercepted from the second audio data. In the embodiment, the audio data is recorded as the third audio data.

[0090] The user can view the audio list (or sequence) on the touch display screen of the control device and select at least one audio data. Currently, the voiceprint data corresponding to the audio data selected by the user can be considered as the alternative shielded voiceprint data. In the embodiment, the audio data selected by the user is recorded as the alternative audio data, that is, the sound object corresponding to the alternative voiceprint data is the current alternative shielded sound object.

[0091] After the user selects the candidate audio data, the control device sends the candidate audio data to the hearing aid device, so that the hearing aid device receives the candidate audio data.

[0092] Step 430: Amplify the candidate audio data so that the user can hear the candidate audio data and determine whether to select the sound object corresponding to the candidate audio data as the target sound object by operating the control device.

[0093] Exemplarily, the hearing aid device amplifies the received alternative audio data so that the user can hear the alternative audio data. Afterwards, the user can determine whether the sound object corresponding to the currently played alternative audio data needs to be shielded, and operate the control device to mark the voiceprint data corresponding to the alternative audio data as shielded voiceprint data when the sound object is a target sound object that needs to be shielded. When the sound object is a sound object that does not need to be shielded, the control device does not mark the corresponding voiceprint data.

[0094] Optionally, after the control device sends the alternative audio data to the hearing aid device, a prompt of whether to block it can be displayed on the touch display screen to allow the user to make a selection, and then a corresponding operation is performed according to the user's selection.

[0095] It is understandable that the user can select multiple alternative audio data in sequence, and after each selection of an alternative audio data, the control device sends the selected alternative audio data to the hearing aid device and displays a prompt whether to block it. After that, the control device determines whether the user chooses to block it and performs the corresponding operation. After that, the user can select another alternative audio data, and so on.

[0096] Exemplarily, after the control device has set the shielding voiceprint data (i.e., the user has not selected new alternative audio data or the user has exited the selection of alternative audio data), it can continue to receive the audio data (currently the first audio data) collected by the hearing aid device, and based on the first audio data and the shielding voiceprint data, determine the target sound object that needs to be shielded, and then generate an audio shielding instruction and send it to the hearing aid device so that the hearing aid device responds. Alternatively, after the control device has set the shielding voiceprint data (i.e., the user has not selected new alternative audio data or the user has exited the selection of alternative audio data), it can generate a notification to prompt that the shielding voiceprint data has been set, and then the control device sends the notification to the hearing aid device. After receiving the notification, the hearing aid device determines that the audio data of the target sound object needs to be shielded, and then step 310 can be executed.

[0097] In the above, by receiving the shielding control instruction sent by the control device, the second audio data currently collected is sent to the control device, so that the control device obtains alternative audio data based on the second audio data, and then amplifies the alternative audio data to enable the user to determine whether the sound object corresponding to the shielded alternative audio data is the target sound object, so that the control device sets the shielding voiceprint data based on the user's selection, that is, the technical means of setting the target sound object can realize the setting of the target sound object (shielded voiceprint data) and the setting result meets the user's needs, and the setting process is simple and easy to implement.

[0098] In one embodiment of the present application, the control device can also delete the pre-stored shielded voiceprint data, and accordingly, the hearing aid device can also stop shielding the audio data corresponding to the deleted shielded voiceprint data. At this time, in the audio shielding method executed by the aforementioned hearing aid device, after step 340, steps 510-520 may also be included:

[0099] Step 510: Receive a masking deletion instruction sent by a control device, where the masking deletion instruction is used to instruct the hearing aid device to cancel masking of first audio data emitted by at least one target sound-emitting object.

[0100] Exemplarily, when the user wants to cancel the shielding of specific audio data, the user can operate the control device to call out all the shielded voiceprint data currently used in the control device, and then select the shielded voiceprint data to be deleted so that the control device can delete it. Alternatively, the user operates the control device to call out all the shielded voiceprint data currently used in the control device, and then the user selects the shielded voiceprint data, and the control device sends the audio data corresponding to the shielded voiceprint data selected by the user to the hearing aid device, and the hearing aid device amplifies the audio data. After that, the user determines whether to delete the corresponding shielded voiceprint data in the control device based on the audio data heard, and when the user chooses to delete, the control device deletes the shielded voiceprint data. It should be noted that the user can delete one or more shielded voiceprint data at the same time, and the embodiment does not limit this.

[0101] After the control device deletes the shielded voiceprint data, a shielding deletion instruction is generated. Optionally, the shielding deletion instruction may include the voiceprint data to be unshielded. Afterwards, the control device sends the shielding deletion instruction to the hearing aid device. After receiving the shielding deletion instruction, the hearing aid device may determine to unshield the first audio data emitted by the target sounding object of the corresponding voiceprint data.

[0102] Step 520: restore and amplify the real-time first audio data corresponding to at least one target sound-emitting object according to the shielding and deletion instruction.

[0103] Exemplarily, after receiving the masking deletion instruction, the hearing aid device obtains the voiceprint data contained therein, and then finds the corresponding voiceprint data in the currently masked first audio data based on the uniqueness of the voiceprint data to determine the unmasked first audio data. After that, the hearing aid device amplifies the first audio data normally so that the user can hear the first audio data.

[0104] It is understandable that, in addition to the shielding deletion instruction, the control device can also send a shielding cancellation instruction, which is used to instruct the hearing aid device to cancel the shielding of all first audio data emitted by the target sound-emitting object. For example, when the user exits the voiceprint shielding program in the control device, the voiceprint shielding program generates a shielding deletion instruction before exiting and sends it to the hearing aid device. After receiving the shielding cancellation instruction, the hearing aid device normally amplifies all current first audio data.

[0105] As mentioned above, by receiving the shielding deletion instruction sent by the control device, the technical means of restoring and amplifying the real-time first audio data of the target sound-emitting object corresponding to the shielding deletion instruction realizes the flexible management of the target sound-emitting object (shielded voiceprint data), which is convenient for users to unshield the first audio data emitted by a target sound-emitting object at any time according to actual needs.

[0106] It should be noted that the hearing aids can appear as a set, that is, the user wears hearing aids on both the left and right ears. At this time, the two hearing aids can communicate with each other and can both communicate with the control device. At this time, one of the hearing aids can send the collected audio data to the control device, and the two hearing aids can simultaneously block or restore certain audio data based on the instructions of the control device.

[0107] Fig. 9 A flowchart of another audio shielding method provided by an embodiment of the present application. The audio shielding method is executed by a control device. The relevant description of the control device can refer to the relevant description of the control device in the above content, and refer to Fig. 9 , the audio shielding method includes steps 610 to 640:

[0108] Step 610: Receive at least one first audio data collected by a hearing aid device, where each first audio data corresponds to a sound object.

[0109] Exemplarily, when there are multiple first audio data, the hearing aid device receives audio data obtained by mixing the multiple first audio data.

[0110] Step 620: Identify the voiceprint data of the first audio data.

[0111] Exemplarily, the voiceprint shielding program of the control device can identify the acoustic features of the first audio data, such as the spectrum, inverse spectrum, formant, pitch, reflection coefficient, nasal sound, deep breath sound, hoarse sound, laughter, etc., rhythm, tempo, speed, intonation, volume and other features of the first audio data. After that, the voiceprint data of the first audio data can be determined from the perspective of modeling using acoustic features (such as inverse spectrum), lexical features (word n-gram, phoneme n-gram), prosodic features, language, dialect and accent information. It can be understood that the method of identifying voiceprint data is an already implemented method and is not described in detail at present.

[0112] It should be noted that when there are multiple first audio data, for the control device, what it receives is mixed first audio data, and then each voiceprint data is identified based on the mixed first audio data.

[0113] Step 630: Determine the voiceprint data that matches the shielded voiceprint data in the identified voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data. The audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by the target sound-emitting object among at least one sound-emitting object. The sound-emitting object corresponding to the matched voiceprint data is the target sound-emitting object.

[0114] Exemplarily, after obtaining the voiceprint data of each first audio data, the voiceprint data is compared with all the shielded voiceprint data currently in use to determine whether there is voiceprint data that matches the shielded voiceprint data, that is, voiceprint data with a higher similarity. If so, it means that the sound emitted by the sound-emitting object corresponding to the voiceprint data needs to be shielded, that is, the sound-emitting object is the target sound-emitting object.

[0115] Optionally, the control device currently uses all shielded voiceprint data to store in a list. In an embodiment, the list is recorded as a shielded voiceprint record table, and the shielded voiceprint data and associated serial numbers can be recorded in the table. Afterwards, the voiceprint shielding program of the control device can use each shielded voiceprint data recorded in the shielded voiceprint record table to match the voiceprint data corresponding to each current first audio data.

[0116] In one embodiment, the voiceprint data and the shielded voiceprint data are compared by calculating similarity. At this time, determining the voiceprint data that matches the shielded voiceprint data may include steps 631 and 632:

[0117] Step 631: Calculate the similarity between each voiceprint data and each shielded voiceprint data.

[0118] Exemplarily, the voiceprint shielding program of the control device obtains all shielded voiceprint data currently in use, and then compares each currently identified voiceprint data with each shielded voiceprint data. The comparison process can also be considered as the process of determining whether the voiceprint data is shielded voiceprint data.

[0119] When comparing, the distortion between the voiceprint data and the shielded voiceprint data can be used as the similarity. For example, the similarity between the two can be calculated using a vector quantization (VQ) model or a dynamic time warping (DTW) model, or other methods can be used to calculate the similarity between the two, which is not limited in the embodiment.

[0120] Step 632: Determine the voiceprint data with a similarity higher than a similarity threshold as the voiceprint data that matches the corresponding shielded voiceprint data.

[0121] Exemplarily, the more similar the voiceprint data is to the shielded voiceprint data, the greater the possibility that the voiceprint data is the shielded voiceprint data. In the embodiment, a similarity threshold is pre-set in the voiceprint shielding program of the control device, and its specific value can be set in combination with actual needs, such as 90%. When the similarity between a certain voiceprint data and a certain shielded voiceprint data is higher than the similarity threshold, it is determined that the voiceprint data and the shielded voiceprint data belong to the same sounding object, that is, it is determined that the voiceprint data matches the shielded voiceprint data.

[0122] In this way, after comparing each voiceprint data with each shielded voiceprint data, the voiceprint data matching the shielded voiceprint data can be determined. It is understandable that there is a situation where a certain voiceprint data has no matching shielded voiceprint data, which means that the sound of the sound object corresponding to the voiceprint data does not need to be shielded.

[0123] Exemplarily, after obtaining the voiceprint data matching the shielding voiceprint data, an audio shielding instruction may be generated. When generating the audio shielding instruction, the voiceprint data matching the shielding voiceprint data is written into the audio shielding instruction, so that the hearing aid device determines which first audio data to shield based on the voiceprint data in the audio shielding instruction.

[0124] It can be understood that when there are multiple voiceprint data that match multiple shielding voiceprint data (the shielding voiceprint data corresponds to the voiceprint data one by one), the multiple voiceprint data are written into the audio shielding instruction together.

[0125] Step 640: Send the audio shielding instruction to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction.

[0126] Exemplarily, an audio shielding instruction is obtained and sent to the hearing aid device, so that the hearing aid device can determine which sounds (ie, first audio data) emitted by the target sound-emitting object need to be shielded based on the audio shielding instruction and shield them.

[0127] In the above, by receiving at least one first audio data collected by the hearing aid device and identifying the corresponding voiceprint data, and then by comparing the voiceprint data with the shielded voiceprint data, the voiceprint data matching the shielded voiceprint data is determined, and then an audio shielding instruction is generated and sent to the hearing aid device so that the hearing aid device shields the corresponding first audio data. The technical means solves the technical problem that the hearing aid cannot shield the specified sound in the related art. Through the cooperation of the hearing aid device and the control device, the control device instructs the hearing aid device to shield the sound emitted by the specified sound-emitting object, so that the user can only hear the required sound when using the hearing aid device, thereby improving the user's hearing aid experience. In addition, by utilizing the uniqueness of the voiceprint data, the sounds emitted by different sound-emitting objects are distinguished by the voiceprint data, and then it is determined whether the sound emitted by the sound-emitting object needs to be shielded, which also makes the shielding of the specified sound simple and accurate.

[0128] In one embodiment of the present application, the shielded voiceprint data pre-stored in the control device can be determined based on the audio data previously collected by the hearing aid device and sent to the control device. In this case, the audio shielding method executed by the aforementioned control device also includes steps 710 to 780:

[0129] Step 710: Generate a shielding control instruction based on the shielding control operation, where the shielding control instruction is a shielding start instruction or a shielding new instruction.

[0130] Exemplarily, when the shielding control device is for shielding start instructions, after the control device starts the voiceprint shielding program, the voiceprint shielding program generates a shielding start instruction, or, after the control device starts the voiceprint shielding program, the voiceprint shielding program displays the main menu interface, and the button for starting the voiceprint data shielding function in the main menu interface, when it is detected that the user operates the button to start the voiceprint data shielding function, the voiceprint shielding program generates a shielding start instruction.

[0131] When the shielding control device is for shielding new instructions, the control device has started and run the voiceprint shielding program, and the user can operate the voiceprint shielding program in the control device to add new shielded voiceprint data. At this time, the voiceprint shielding program can generate shielding new instructions based on the user's operation. For example, the main menu interface of the voiceprint shielding program also displays a button for adding shielded voiceprint data. When it is detected that the user operates the button, the voiceprint shielding program generates a shielding new instruction.

[0132] Both shielding new instructions and shielding start instructions can be considered as shielding control instructions.

[0133] It is understandable that after the voiceprint data shielding function is activated, a shielding startup instruction is generally generated first, and then a shielding new instruction can be generated based on the user's operation.

[0134] Optionally, after the voiceprint shielding program is started, if it is determined that shielded voiceprint data used in the previous operation process exists, the user may be prompted whether to continue to use the shielded voiceprint data used in the previous operation process. If the user chooses to use it, the shielded voiceprint data will continue to be used, and a shielding start instruction may be generated. If the user chooses not to use it, a shielding start instruction is generated.

[0135] Step 720: Send the shielding control instruction to the hearing aid device.

[0136] Exemplarily, after the voiceprint shielding program generates the shielding control instruction, it sends the shielding control instruction to the hearing aid device.

[0137] Step 730: Receive at least one second audio data collected by the hearing aid device based on the shielding control instruction, and each sound-emitting object has corresponding second audio data.

[0138] After receiving the shielding control instruction, the hearing aid device makes a corresponding response. During the response process, the hearing aid device sends the currently collected second audio data to the control device so that the control device receives the second audio data.

[0139] Step 740: Identify the voiceprint data of the second audio data, and display the third audio data corresponding to the voiceprint data.

[0140] Exemplarily, the voiceprint shielding program of the control device identifies the voiceprint data of the second audio data. This process may refer to the process of the voiceprint shielding program identifying the voiceprint data of the first audio data, which will not be described in detail here.

[0141] After obtaining the voiceprint data of the second audio data, the audio data corresponding to the voiceprint data can be displayed. Currently, the displayed audio data is recorded as the third audio data. Optionally, when displaying the third audio data, only the name of the third audio data can be displayed, and an association between the third audio data, the name and the corresponding voiceprint data can be established in the background. When there are multiple second audio data, the third audio data corresponding to the multiple voiceprint data can be displayed in a list, and each list also displays the serial number corresponding to each third audio data. Among them, the method of generating the serial number is not currently limited. Currently, the list displaying the third audio data is recorded as a voiceprint audio list.

[0142] In one embodiment, the voiceprint shielding program can generate a third audio data of a set duration based on the voiceprint data. Alternatively, the voiceprint shielding program intercepts a set duration of audio data from the second audio data corresponding to the voiceprint data as the third audio data. The set duration can be set according to actual conditions, for example, the set duration is 3-6s.

[0143] Step 750: Receive an audio data selection operation, and determine the third audio data selected by the audio data selection operation as candidate audio data.

[0144] Exemplarily, after the third audio data is displayed, the user selects the third audio data according to actual conditions. Currently, the operation of the user selecting the third audio data is recorded as an audio data selection operation. The operation mode of the audio data selection operation is not currently limited.

[0145] Exemplarily, the third audio data selected by the audio data selection operation can be considered as the audio data that the user needs to listen to to determine whether it needs to be blocked. That is, the selected third audio data may be the data that the user selects to be blocked. Therefore, in an embodiment, the third audio data selected by the audio data selection operation is recorded as alternative audio data. The alternative audio data may be the audio data displayed in the aforementioned voiceprint audio list. That is, the audio data selected by the audio data selection operation in the voiceprint audio list is recorded as alternative audio data.

[0146] Optionally, the user can only select one candidate audio data at a time, that is, only one candidate audio data can be selected in one audio data selection operation.

[0147] Step 760: Send the alternative audio data to the hearing aid device for amplification so that the user can hear the alternative audio data.

[0148] Exemplarily, after selecting the candidate audio data, the voiceprint shielding program sends the currently selected candidate audio data to the hearing aid device. After receiving the candidate audio data, the hearing aid device amplifies the candidate audio data, and the user can hear the candidate audio data.

[0149] Step 770: When the alternative audio confirmation operation is received, the voiceprint data corresponding to the alternative audio data is determined as the shielded voiceprint data, and the sound object corresponding to the shielded voiceprint data is the target sound object.

[0150] Exemplarily, after the voiceprint shielding program sends the alternative audio data to the hearing aid device, an audio data confirmation interface is displayed, which includes a confirmation button for shielding the sound object corresponding to the alternative audio data, and a confirmation button for not shielding the sound object corresponding to the alternative audio data. Afterwards, the user notifies the voiceprint shielding program whether to shield the sound object corresponding to the alternative audio data by operating the two confirmation buttons.

[0151] Currently, the operation of the user confirming to shield the sound object corresponding to the alternative audio data (such as the click operation of clicking the response confirmation button) is recorded as the alternative audio confirmation operation. When the voiceprint shielding program receives the alternative audio confirmation operation, it determines to shield the sound object corresponding to the alternative audio data, that is, to confirm the sound object as the target sound object. At this time, the voiceprint data corresponding to the target sound object is the shielded voiceprint data. When the shielded voiceprint record table is used, the shielded voiceprint data is added to the shielded voiceprint record table. After that, step 780 is executed.

[0152] It is understandable that when the user confirms not to shield the sound object corresponding to the candidate audio data, the voiceprint shielding program abandons shielding the corresponding voiceprint data. Then, step 780 is executed.

[0153] Step 780: Return to the operation of displaying the third audio data corresponding to the voiceprint data until no more audio data selection operation is received.

[0154] Optionally, the voiceprint shielding program continues to display the third audio data for the user to continue to select until the user stops selecting the alternative audio data, that is, no audio data selection operation is received, and the voiceprint shielding program determines that the current shielded voiceprint data selection is completed. After that, the voiceprint shielding program can receive the first audio data sent by the hearing aid device, or the voiceprint shielding program can notify the hearing aid device so that the hearing aid device clearly knows that the shielded voiceprint data selection is completed and starts to send the first audio data to the control device.

[0155] Optionally, the audio data confirmation interface also displays a return button (such as a button for returning to the main menu of the voiceprint masking program). When it is detected that the button has received a click operation, it is determined that the user is no longer selecting alternative audio data, that is, no audio data selection operation is received.

[0156] In the above, by receiving the shielding control operation, sending the shielding control instruction to the hearing aid device, then receiving the second audio data sent by the hearing aid device and identifying the corresponding voiceprint data, then, after displaying the third audio data corresponding to the voiceprint data, sending alternative audio data to the hearing aid device based on the audio data selection operation, and determining that the voiceprint data corresponding to the alternative audio data is the shielding voiceprint data based on the receipt of the alternative audio confirmation operation. The technical means realizes the setting of the target sounding object (shielded voiceprint data) and the setting result meets the needs of the user. The setting process is simple and easy to implement.

[0157] In one embodiment of the present application, the control device may also delete the pre-stored shielded voiceprint data. At this time, the audio shielding method executed by the aforementioned control device further includes steps 810 to 850:

[0158] Step 810: Receive a shield deletion operation.

[0159] Exemplarily, the main menu interface of the voiceprint shielding program also displays a button for deleting shielded voiceprint data, and when it is detected that the button receives a click operation, it is determined that a shielding deletion operation is received. The shielding deletion operation refers to an operation that indicates that the voiceprint shielding program needs to delete shielded voiceprint data.

[0160] Step 820: Display all shielded voiceprint data according to the shielding deletion operation.

[0161] Exemplarily, when receiving a shielding deletion operation, the voiceprint shielding program retrieves all currently used voiceprint data and displays them.

[0162] Optionally, when displaying, the specific voiceprint pattern of the shielded voiceprint data may be displayed, the serial number corresponding to the shielded voiceprint data may be displayed, the third audio data used to confirm the shielded voiceprint data may be displayed, and other content that can distinguish the shielded voiceprint data may be displayed.

[0163] Step 830: Receive a shielding voiceprint data selection operation.

[0164] Exemplarily, after all the shielded voiceprint data are displayed, the user can select the shielded voiceprint data to be deleted. Currently, the selection operation performed by the user is recorded as a shielded voiceprint data selection operation.

[0165] Step 840: Delete the shielded voiceprint data selected by the shielded voiceprint data selection operation, and generate a corresponding shielded deletion instruction.

[0166] Exemplarily, the voiceprint masking program determines the masked voiceprint data selected by the masked voiceprint data selection operation, and then generates a masking deletion instruction, which contains all the masked voiceprint data selected by the user.

[0167] Step 850: Send a masking deletion instruction to the hearing aid device, so that the hearing aid device amplifies the real-time first audio data of the target sound-making object corresponding to the masked voiceprint data.

[0168] Exemplarily, after generating the masking deletion instruction, the voiceprint masking program sends the instruction to the hearing aid device, so that the hearing aid device can restore and amplify the real-time first audio data of the target sound-making object corresponding to the voiceprint masking instruction.

[0169] In an optional manner, after the user selects the selected shielded voiceprint data based on the shielded voiceprint data, the voiceprint shielding program can send the third audio data corresponding to the selected shielded voiceprint data to the hearing aid device for the user to listen to, and then operate the control device to determine whether to delete the shielded voiceprint data. If the user determines to delete the shielded voiceprint data, the voiceprint shielding program generates a shielding deletion instruction and sends it to the hearing aid device.

[0170] In the above, by receiving the shielding deletion operation, displaying all the shielded voiceprint data, and selecting the operation based on the shielded voiceprint data, deleting the corresponding shielded voiceprint data, and generating a shielding deletion instruction to send to the hearing aid device, so that the hearing aid device can amplify the corresponding first audio data, the technical means realizes the flexible management of the target sound-emitting object (shielded voiceprint data), which is convenient for users to cancel the shielding of the first audio data emitted by a target sound-emitting object at any time according to actual needs.

[0171] It should be noted that the undisclosed technical details in the audio shielding method performed by the control device can refer to the technical details in the audio shielding method performed by the aforementioned hearing aid device, which has corresponding functions and beneficial effects.

[0172] An embodiment of the present application also provides a hearing aid device, referring to Figure 1 The hearing aid device includes: an audio module 11, an amplified audio module 12 and a first communication module 13.

[0173] In one embodiment of the present application, the audio module 11 is used to continuously collect first audio data emitted by at least one sound-emitting object in the external space in the working mode, and each sound-emitting object has corresponding first audio data. The first communication module 13 is used to send the collected first audio data to the control device during the collection process; and to receive an audio shielding instruction generated by the control device based on the first audio data, and the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by the target sound-emitting object among at least one sound-emitting object. The amplified audio module 12 is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, and amplify the real-time first audio data of other sound-emitting objects that are not shielded.

[0174] In one embodiment of the present application, the audio shielding instruction includes the voiceprint data of the target sound-emitting object. When the amplifying audio module 12 is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, it is specifically used to: obtain the voiceprint data included in the audio shielding instruction; and stop amplifying the real-time first audio data corresponding to the voiceprint data.

[0175] In one embodiment of the present application, the first communication module 13 is also used to receive a shielding control instruction sent by a control device. The audio module 11 is also used to collect second audio data emitted by at least one sound-emitting object in the external space when the first communication module 13 receives the shielding control instruction sent by the control device. The first communication module 13 is also used to send the second audio data to the control device, each sound-emitting object has corresponding second audio data, the shielding control instruction is a shielding start instruction or a shielding new instruction, and is used to receive alternative audio data obtained by the control device based on the second audio data, and the sound-emitting object corresponding to the alternative audio data is an alternative shielded sound-emitting object. The amplified audio module 12 is also used to amplify the alternative audio data so that the user can hear the alternative audio data and determine whether to select the sound-emitting object corresponding to the alternative audio data as the target sound-emitting object by operating the control device.

[0176] In one embodiment of the present application, the first communication module 13 is also used to receive a shielding deletion instruction sent by the control device after the amplified audio module 12 shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction and amplifies the real-time first audio data of other unshielded sound-emitting objects, and the shielding deletion instruction is used to instruct the hearing aid device to cancel shielding of the first audio data emitted by at least one target sound-emitting object. The amplified audio module 12 is also used to resume amplifying the real-time first audio data of the corresponding at least one target sound-emitting object according to the shielding deletion instruction.

[0177] The above-mentioned hearing aid device can be used to execute the audio shielding method executed by the aforementioned hearing aid device, and has corresponding functions and beneficial effects.

[0178] An embodiment of the present application also provides a control device, referring to Figure 2 The control device includes: a second processor 21 and a second communication module 23.

[0179] In one embodiment of the present application, the second communication module 23 is used to receive at least one first audio data collected by the hearing aid device, and each first audio data corresponds to a sound object. The second processor 21 is used to identify the voiceprint data of the first audio data; and to determine the voiceprint data that matches the shielded voiceprint data in the identified voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by the target sound object in at least one sound object, and the sound object corresponding to the matched voiceprint data is the target sound object. The second communication module 23 is also used to send the audio shielding instruction to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound object according to the audio shielding instruction.

[0180] In one embodiment of the present application, when the second processor 21 is used to determine the voiceprint data that matches the shielded voiceprint data, it is specifically used to: calculate the similarity between each voiceprint data and each shielded voiceprint data; and determine the voiceprint data whose similarity is higher than the similarity threshold as the voiceprint data that matches the corresponding shielded voiceprint data.

[0181] In one embodiment of the present application, reference Figure 2 , the control device also includes a touch display screen 22. Accordingly, the second processor 21 is also used to generate a shielding control instruction based on the shielding control operation, and the shielding control instruction is a shielding start instruction or a shielding new instruction. The second communication module 23 is also used to send the shielding control instruction to the hearing aid device; receive at least one second audio data collected by the hearing aid device based on the shielding control instruction, and each sound object has corresponding second audio data. The second processor 21 is also used to identify the voiceprint data of the second audio data; instruct the touch display screen 22 to display the third audio data corresponding to the voiceprint data; receive an audio data selection operation, and determine the third audio data selected by the audio data selection operation as the alternative audio data. The second communication module 23 is also used to send the alternative audio data to the hearing aid device for amplification so that the user can hear the alternative audio data. The second processor 21 is also used to determine the voiceprint data corresponding to the alternative audio data as the shielding voiceprint data when receiving the alternative audio confirmation operation, and the sound object corresponding to the shielding voiceprint data is the target sound object; return to execute the operation of instructing the touch display screen 22 to display the third audio data corresponding to the voiceprint data until the audio data selection operation is no longer received.

[0182] In one embodiment of the present application, the second processor 21 is further used to receive a shielding deletion operation after the second communication module 23 sends the audio shielding instruction to the hearing aid device; instruct the touch screen 22 to display all shielded voiceprint data according to the shielding deletion operation; receive a shielding voiceprint data selection operation; delete the shielding voiceprint data selected by the shielding voiceprint data selection operation, and generate a corresponding shielding deletion instruction. The second communication module 23 is also used to send the shielding deletion instruction to the hearing aid device so that the hearing aid device amplifies the real-time first audio data of the target sound object corresponding to the shielding voiceprint data.

[0183] The above-mentioned control device can be used to execute the audio shielding method executed by the aforementioned control device, with corresponding functions and beneficial effects.

[0184] An embodiment of the present application further provides an audio shielding device, which is applied to a hearing aid device. The audio shielding device comprises:

[0185] The first acquisition unit is configured in the audio module and is used to continuously acquire first audio data emitted by at least one sound-emitting object in the external space in a working mode, and each sound-emitting object has corresponding first audio data.

[0186] The first sending unit is configured in the first communication module, and is used to send the collected first audio data to the control device during the collection process; and is used to receive an audio shielding instruction generated by the control device based on the first audio data, and the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by the target sound-emitting object among at least one sound-emitting object.

[0187] The first shielding unit is configured in the amplifying audio module, and is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, and amplify the real-time first audio data of other sound-emitting objects that are not shielded.

[0188] In one embodiment of the present application, when the first shielding unit is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, it includes: a voiceprint acquisition subunit, used to obtain the voiceprint data contained in the audio shielding instruction; and a stop amplification subunit, used to stop amplifying the real-time first audio data corresponding to the voiceprint data.

[0189] In one embodiment of the present application, the audio shielding device also includes: a first receiving unit, configured in the first communication module, for receiving a shielding control instruction sent by the control device. A second collecting unit, configured in the audio module, is used to collect second audio data emitted by at least one sound-emitting object in the external space when receiving the shielding control instruction sent by the control device. A second sending unit, configured in the communication module, is used to send the second audio data to the control device, each sound-emitting object has corresponding second audio data, and the shielding control instruction is a shielding start instruction or a shielding new instruction. The second receiving unit, configured in the first communication module, is used to receive the alternative audio data obtained by the control device based on the second audio data, and the sound-emitting object corresponding to the alternative audio data is the alternative shielded sound-emitting object. A first amplifying unit, configured in the amplifying audio module, is used to amplify the alternative audio data so that the user can hear the alternative audio data and determine whether to select the sound-emitting object corresponding to the alternative audio data as the target sound-emitting object by operating the control device.

[0190] In one embodiment of the present application, the audio shielding device further includes: a third receiving unit, configured in the first communication module, for receiving a shielding deletion instruction sent by the control device after shielding the real-time first audio data of the target sound-emitting object according to the audio shielding instruction and amplifying the real-time first audio data of other unshielded sound-emitting objects, wherein the shielding deletion instruction is used to instruct the hearing aid device to cancel shielding of the first audio data emitted by at least one target sound-emitting object. A shielding deletion unit, configured in the amplifying audio module, is used to restore and amplify the real-time first audio data of the corresponding at least one target sound-emitting object according to the shielding deletion instruction.

[0191] The audio shielding device provided in the embodiment of the present application is included in a hearing aid device and can be used to execute the audio shielding method performed by the hearing aid device provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0192] An embodiment of the present application further provides an audio shielding device, which is applied to a control device. The audio shielding device comprises:

[0193] The fourth receiving unit is configured in the second communication module, and is used to receive at least one first audio data collected by the hearing aid device, and each first audio data corresponds to a sound object. The first recognition unit is configured in the second processor, and is used to recognize the voiceprint data of the first audio data. The voiceprint matching unit is configured in the second processor, and is used to determine the voiceprint data that matches the shielded voiceprint data in the recognized voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, and the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by the target sound object in at least one sound object, and the sound object corresponding to the matched voiceprint data is the target sound object. The third sending unit is configured in the second communication module, and is used to send the audio shielding instruction to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound object according to the audio shielding instruction.

[0194] In one embodiment of the present application, when the voiceprint matching unit is used to determine the voiceprint data that matches the shielded voiceprint data, it specifically includes: a similarity calculation subunit, used to calculate the similarity between each voiceprint data and each shielded voiceprint data; a similarity comparison unit, used to determine the voiceprint data with a similarity higher than a similarity threshold as the voiceprint data that matches the corresponding shielded voiceprint data.

[0195] In one embodiment of the present application, the audio shielding device further includes: a first generating unit, configured in the second processor, for generating a shielding control instruction based on the shielding control operation, the shielding control instruction being a shielding start instruction or a shielding new instruction. A fourth sending unit, configured in the second communication module, for sending the shielding control instruction to the hearing aid device. A fifth receiving unit, configured in the second communication module, for receiving at least one second audio data collected by the hearing aid device based on the shielding control instruction, each sound-emitting object having corresponding second audio data. A second identifying unit, configured in the second processor, for identifying the voiceprint data of the second audio data. A first display unit, configured in the second processor, for instructing the touch display screen to display the third audio data corresponding to the voiceprint data. A sixth receiving unit, configured in the second processor, is further used to receive an audio data selection operation, and to determine the third audio data selected by the audio data selection operation as the alternative audio data. A fifth sending unit, configured in the second communication module, for sending the alternative audio data to the hearing aid device for amplification so that the user can hear the alternative audio data. The seventh receiving unit is configured in the second processor, and is used to determine the voiceprint data corresponding to the candidate audio data as the shielded voiceprint data when receiving the alternative audio confirmation operation, and the sound object corresponding to the shielded voiceprint data is the target sound object. The return execution unit is configured in the second processor, and is used to return to the operation of displaying the third audio data corresponding to the voiceprint data until the audio data selection operation is no longer received.

[0196] In one embodiment of the present application, the audio shielding device also includes: an eighth receiving unit, configured in the second processor, for receiving a shielding deletion operation after sending the audio shielding instruction to the hearing aid device. A data display unit, configured in the second processor, for instructing the touch screen to display all shielded voiceprint data according to the shielding deletion operation. A ninth receiving unit, configured in the second processor, for receiving a shielding voiceprint data selection operation. A data deletion unit, configured in the second processor, for deleting the shielding voiceprint data selected by the shielding voiceprint data selection operation and generating a corresponding shielding deletion instruction. A sixth sending unit, configured in the second communication module, for sending the shielding deletion instruction to the hearing aid device, so that the hearing aid device amplifies the real-time first audio data of the target sound object corresponding to the shielding voiceprint data.

[0197] The audio shielding device provided in the embodiment of the present application is included in a control device and can be used to execute the audio shielding method performed by the control device provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0198] It is worth noting that in the embodiment of the above-mentioned audio shielding device, the various units included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0199] One embodiment of the present application also provides a storage medium containing computer-executable instructions, which, when executed by a hearing aid device or a control device, are used to perform relevant operations in the audio shielding method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0200] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0201] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0202] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0203] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0204] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. An audio shielding method, applied to a hearing aid device, characterized in that: include: In the working mode, first audio data emitted by at least one sound-emitting object in the external space is continuously collected, and each of the sound-emitting objects has corresponding first audio data; During the acquisition process, the acquired first audio data is sent to the control device; receiving an audio shielding instruction generated by the control device based on the first audio data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield the first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects; The real-time first audio data of the target sound-emitting object is shielded according to the audio shielding instruction, and the real-time first audio data of other sound-emitting objects that are not shielded are amplified.

2. The audio shielding method according to claim 1, characterized in that: The audio shielding instruction includes the voiceprint data of the target sounding object; The step of shielding the real-time first audio data of the target sound-emitting object according to the audio shielding instruction includes: Acquire the voiceprint data contained in the audio shielding instruction; Stop amplifying the real-time first audio data corresponding to the voiceprint data.

3. The audio shielding method according to claim 1, characterized in that: The method further comprises: When receiving the shielding control instruction sent by the control device, collecting the second audio data emitted by at least one of the sound-emitting objects in the external space, and sending the second audio data to the control device, each of the sound-emitting objects has corresponding second audio data, and the shielding control instruction is a shielding start instruction or a shielding new instruction; receiving candidate audio data obtained by the control device based on the second audio data, wherein the sound-emitting object corresponding to the candidate audio data is a candidate shielded sound-emitting object; The candidate audio data is amplified so that the user can hear the candidate audio data and determine whether to select the sound object corresponding to the candidate audio data as the target sound object by operating the control device.

4. The audio shielding method according to claim 1, characterized in that: After shielding the real-time first audio data of the target sound-emitting object according to the audio shielding instruction and amplifying the real-time first audio data of other sound-emitting objects that are not shielded, the method further includes: receiving a shielding deletion instruction sent by the control device, wherein the shielding deletion instruction is used to instruct the hearing aid device to cancel shielding of first audio data emitted by at least one target sound-emitting object; The real-time first audio data of at least one of the target sound-emitting objects is restored and amplified according to the masking and deleting instruction.

5. An audio shielding method, applied to a control device, characterized in that: include: Receive at least one first audio data collected by a hearing aid device, each of the first audio data corresponds to a sound object; identifying voiceprint data of the first audio data; Determine, in the identified voiceprint data, voiceprint data that matches the shielded voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects, and the sound-emitting object corresponding to the matched voiceprint data is the target sound-emitting object; The audio shielding instruction is sent to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction.

6. The audio shielding method according to claim 5, characterized in that: The determining of the voiceprint data to be matched with the shielded voiceprint data includes: Calculating the similarity between each voiceprint data and each shielded voiceprint data; The voiceprint data with a similarity higher than a similarity threshold is determined as the voiceprint data that matches the corresponding shielded voiceprint data.

7. The audio shielding method according to claim 5, characterized in that: The method further comprises: Generate a shielding control instruction based on the shielding control operation, wherein the shielding control instruction is a shielding start instruction or a shielding new instruction; sending the shielding control instruction to the hearing aid device; Receiving at least one second audio data collected by the hearing aid device based on the shielding control instruction, each of the sound-emitting objects has corresponding second audio data; identifying voiceprint data of the second audio data, and displaying third audio data corresponding to the voiceprint data; receiving an audio data selection operation, and determining the third audio data selected by the audio data selection operation as candidate audio data; sending the alternative audio data to the hearing aid device for amplification so that the user can hear the alternative audio data; When receiving the candidate audio confirmation operation, the voiceprint data corresponding to the candidate audio data is determined as the shielded voiceprint data, and the sound object corresponding to the shielded voiceprint data is the target sound object; The operation of displaying the third audio data corresponding to the voiceprint data is returned until no audio data selection operation is received.

8. The audio shielding method according to claim 5, characterized in that: After sending the audio shielding instruction to the hearing aid device, the method further includes: Receive shield removal operations; Displaying all shielded voiceprint data according to the shielding deletion operation; Receive shielded voiceprint data selection operation; Deleting the shielded voiceprint data selected by the shielded voiceprint data selection operation, and generating a corresponding shielding deletion instruction; The shielding deletion instruction is sent to the hearing aid device, so that the hearing aid device amplifies the real-time first audio data of the target sound object corresponding to the shielded voiceprint data.

9. A hearing aid device, characterized in that: include: An audio module, an amplified audio module and a first communication module, The audio module is used to continuously collect first audio data emitted by at least one sound-emitting object in the external space in the working mode, and each of the sound-emitting objects has corresponding first audio data; The first communication module is used to send the collected first audio data to the control device during the collection process; and receiving an audio shielding instruction generated by the control device based on the first audio data, the audio shielding instruction being used to instruct the hearing aid device to shield the first audio data emitted by a target sound-emitting object among at least one of the sound-emitting objects; The amplified audio module is used to shield the real-time first audio data of the target sound-emitting object according to the audio shielding instruction, and amplify the real-time first audio data of other sound-emitting objects that are not shielded.

10. A control device, characterized in that: include: a second processor and a second communication module, The second communication module is used to receive at least one first audio data collected by the hearing aid device, each of the first audio data corresponds to a sound object; The second processor is used to identify the voiceprint data of the first audio data; and used to determine, in the identified voiceprint data, voiceprint data that matches the shielding voiceprint data, and generate an audio shielding instruction based on the matched voiceprint data, wherein the audio shielding instruction is used to instruct the hearing aid device to shield first audio data emitted by a target sounding object among at least one of the sounding objects, and the sounding object corresponding to the matched voiceprint data is the target sounding object; The second communication module is further configured to send the audio shielding instruction to the hearing aid device, so that the hearing aid device shields the real-time first audio data of the target sound-emitting object according to the audio shielding instruction.

11. An audio shielding system, characterized in that: include: The hearing aid device as claimed in claim 9 and the control device as claimed in claim 10.

Images