Hearing aid system control method and device, hearing aid and storage medium

Abstract

The invention discloses a hearing aid system control method and device, a hearing aid and a storage medium, and relates to the technical field of voice recognition, and the method comprises the steps: responding to a voice control instruction for a target hearing aid, and recognizing parameter access information in the voice control instruction; under the condition that the parameter access information is parameter control information, obtaining target noise information in a target noise environment where the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructing a target feature vector based on the target noise information and the target voiceprint information; inputting the target feature vector into a target model to obtain a hearing aid use habit of the target user in the target noise environment; and controlling the hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habit. The hearing aid parameter adjusting efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the field of speech recognition technology, and in particular to a control method and device for a hearing aid system, a hearing aid, and a storage medium. Background Art

[0002] With the continuous development of science and technology, hearing aids, as key devices for assisting hearing, provide more diverse hearing solutions for people with hearing impairments.

[0003] When users wear hearing aids and do not travel between different environments, they may need to adjust various hearing aid parameters (such as volume, noise suppression effect, and mixing effect, etc.) to adapt to the current environment when facing environmental noise of different intensities. However, most hearing aid parameter adjustment methods usually require users to manually adjust hearing aid parameters based on physical buttons on the hearing aids. This method requires users to temporarily remove the hearing aids from their ears to accurately find and operate the corresponding physical buttons, and then put them back on after adjustment to test the adjustment effect, and repeatedly adjust until the user's needs are met. In this way, the hearing aid parameter adjustment method has the problem of cumbersome operation during the parameter adjustment process, resulting in low adjustment efficiency.

[0004] Therefore, how to improve the efficiency of hearing aid parameter adjustment is a problem that needs to be solved urgently. Summary of the invention

[0005] The main purpose of the present application is to provide a control method, device, hearing aid and storage medium for a hearing aid system, aiming to improve the efficiency of hearing aid parameter adjustment.

[0006] To achieve the above object, the present application provides a control method for a hearing aid system, the control method for a hearing aid system comprising:

[0007] In response to a voice control instruction for a target hearing aid, identifying parameter access information in the voice control instruction;

[0008] In a case where the parameter access information is parameter control information, obtaining target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructing a target feature vector based on the target noise information and the target voiceprint information;

[0009] Inputting the target feature vector into a target model to obtain the hearing aid usage habits of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data and using label data constructed based on the actual hearing aid usage habits of the user in the noise environment as model training labels;

[0010] The target hearing aid is controlled to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

[0011] In one embodiment, before the step of identifying parameter access information in the voice control instruction in response to the voice control instruction for the target hearing aid, the method further comprises:

[0012] Collecting a composite sound signal through the microphone of the target hearing aid, and detecting whether each segment of text information corresponding to the composite sound signal contains a preset wake-up word;

[0013] The target text information containing the preset wake-up word in each segment of the text information is used as a voice control instruction for the target hearing aid.

[0014] In one embodiment, the step of obtaining target noise information in the target noise environment where the target hearing aid is located and target voiceprint information of the target user includes:

[0015] Acquire a target composite sound signal in a target noise environment where the target hearing aid is located, wherein the target composite sound signal is a sound signal including a user sound signal corresponding to the voice control instruction;

[0016] Extracting the user voice signal from the target composite voice signal to obtain an ambient voice signal, wherein the ambient voice signal is a voice signal other than the user voice signal in the target composite voice signal;

[0017] The target noise information in the target noise environment is determined based on the environmental sound signal, and the target voiceprint information of the target user is determined based on the user sound signal.

[0018] In one embodiment, the step of identifying parameter access information in the voice control instruction in response to the voice control instruction for the target hearing aid comprises:

[0019] In response to a voice control instruction for a target hearing aid, determining a user intention of the target user in the voice control instruction, and semantically matching the user intention with a preset parameter access text to obtain a matching result;

[0020] When the matching result is a consistent match, the preset parameter access text is determined to be the parameter access information in the voice control instruction.

[0021] In one embodiment, the step of controlling the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habits comprises:

[0022] Obtaining a first parameter value corresponding to the parameter to be controlled in the parameter control information;

[0023] Determining a target parameter value of the parameter to be controlled based on the hearing aid usage habits;

[0024] determining a customary adjustment direction for adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0025] When the target adjustment direction of the parameter to be controlled in the parameter control information is the same as the customary adjustment direction, performing a parameter control operation of adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0026] In the case that the target adjustment direction is different from the habitual adjustment direction, inquiry information is output through the speaker of the target hearing aid to re-confirm the user's needs.

[0027] In one embodiment, after the step of identifying parameter access information in the voice control instruction in response to the voice control instruction for the target hearing aid, the method further comprises:

[0028] In the case where the parameter access information is parameter query information, a second parameter value corresponding to the parameter to be queried is acquired based on the parameter to be queried in the parameter query information, and the second parameter value is output through a speaker of the target hearing aid.

[0029] In one embodiment, the method further comprises:

[0030] Acquire a sample data set, wherein the sample data set includes a plurality of sample data, and one sample data includes noise information in a noise environment where the hearing aid is located and voiceprint information of a user of the hearing aid, as well as actual hearing aid usage habits of the user in the noise environment;

[0031] constructing sample feature vectors based on the noise information and the voiceprint information in each piece of the sample data, and constructing sample label data based on the actual hearing aid usage habits in each piece of the sample data;

[0032] The sample feature vector corresponding to each piece of the sample data is used as model input data, and the sample label data corresponding to each piece of the sample data is used as a model training label, and the training model is trained to obtain the target model for predicting user habits.

[0033] In addition, to achieve the above-mentioned purpose, the present application also provides a control device for a hearing aid system, the control device for a hearing aid system comprising:

[0034] a response module, configured to respond to a voice control instruction for a target hearing aid and identify parameter access information in the voice control instruction;

[0035] an acquisition module, configured to acquire, when the parameter access information is parameter control information, target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and construct a target feature vector based on the target noise information and the target voiceprint information;

[0036] A prediction module, used for inputting the target feature vector into a target model to obtain the hearing aid usage habits of the target user in the target noise environment, wherein the target model is trained by using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the actual hearing aid usage habits of the user in the noise environment as model training labels;

[0037] A control module is used to control the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

[0038] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a program for implementing the control method of the hearing aid system is stored on the computer-readable storage medium. The program for implementing the control method of the hearing aid system is executed by a processor to implement the steps of the control method of the hearing aid system as described above.

[0039] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the control method of the hearing aid system as described above are implemented.

[0040] The present application provides a control method for a hearing aid system. The present application responds to a voice control instruction for a target hearing aid, identifies parameter access information in the voice control instruction, obtains target noise information in a target noise environment where the target hearing aid is located and target voiceprint information of a target user of the target hearing aid when the parameter access information is parameter control information, and constructs a target feature vector based on the target noise information and the target voiceprint information; then the target feature vector is input into a pre-trained target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on the noise information in the noise environment where the hearing aid is located and the voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the user's actual hearing aid usage habit in the noise environment as a model training label; finally, the hearing aid is controlled to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

[0041] In summary, compared to the traditional method that requires users to repeatedly adjust the physical buttons of the hearing aid to meet their personal hearing needs, the present application obtains the voice control instructions issued by the user and combines the voice control instructions with the target model to predict the user's hearing aid usage habits in the current noisy environment, thereby controlling the hearing aid to perform parameter control operations, thereby improving the efficiency of adjusting the working parameters of the hearing aid. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0044] Figure 1 This is a flow chart of a first embodiment of a control method for a hearing aid system of the present application;

[0045] Figure 2 A schematic diagram of a control flow of a hearing aid system according to an embodiment of a control method of a hearing aid system of the present application;

[0046] Figure 3 A schematic diagram of the module structure of the control device of the hearing aid system of the present application;

[0047] Figure 4 Schematic diagram of the device structure of the hardware operating environment involved in the control method of the hearing aid system in the embodiment of the present application.

[0048] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0050] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0051] The main solution of the present application is: in response to a voice control instruction for a target hearing aid, identifying parameter access information in the voice control instruction; when the parameter access information is parameter control information, obtaining target noise information in a target noise environment where the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructing a target feature vector based on the target noise information and the target voiceprint information; inputting the target feature vector into a target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the user's actual hearing aid usage habit in the noise environment as model training labels; and controlling the target hearing aid to perform parameter control operations based on the parameter control information and the hearing aid usage habit.

[0052] At present, most hearing aid parameter adjustment methods are usually for users to manually adjust the hearing aid parameters based on the physical buttons on the hearing aid. This method requires the user to temporarily remove the hearing aid from the ear to accurately find and operate the corresponding physical buttons, and put the hearing aid back on after adjustment to test the adjustment effect, and repeatedly adjust until the user's needs are met. In this way, the hearing aid parameter adjustment method has the problem of cumbersome operation during the parameter adjustment process, resulting in low adjustment efficiency.

[0053] Compared with the traditional method that requires users to repeatedly adjust the hearing aid's physical buttons to meet their personal hearing needs, the present application obtains the voice control instructions issued by the user and combines the voice control instructions with the target model to predict the user's hearing aid usage habits in the current noisy environment, thereby controlling the hearing aid to perform parameter control operations, thereby improving the efficiency of adjusting the hearing aid working parameters.

[0054] It should be noted that the execution subject of the method in each embodiment of the control method of the hearing aid system of the present application may be a hearing aid control system, or a hearing aid capable of realizing the above functions, etc., and this embodiment does not specifically limit this. The following takes the hearing aid control system as an example to illustrate this embodiment and the following embodiments.

[0055] Based on this, the present application proposes a control method of a hearing aid system of the first embodiment, please refer to Figure 1 , the control method of the hearing aid system comprises steps S10 to S40:

[0056] Step S10, in response to a voice control instruction for a target hearing aid, identifying parameter access information in the voice control instruction;

[0057] It should be noted that the hearing aid control system includes a voice assistant integrated in the hearing aid. Specifically, when the user wears the hearing aid, he can wake up the voice assistant in the hearing aid according to the preset wake-up word, for example, the wake-up word can be "Hey, little ear", and then issue voice control commands, such as "turn up the volume", "turn on noise reduction mode", etc.

[0058] Respond to a voice control instruction for a hearing aid to be controlled (hereinafter referred to as a target hearing aid for distinction), and identify parameter access information in the voice control instruction, wherein the parameter access information includes parameter control information and parameter query information. It should be understood that the parameter control information is used to indicate adjustment of the working parameters of the target hearing aid, and the parameter query information is used to indicate feedback on the working status of the target hearing aid.

[0059] In this embodiment, before step S10, the method further includes:

[0060] Step A10, collecting a composite sound signal through the microphone of the target hearing aid, and detecting whether each segment of text information corresponding to the composite sound signal contains a preset wake-up word;

[0061] It should be noted that the composite sound signal collected by the microphone of the target hearing aid is all sounds that can be collected by the microphone in the current noise environment.

[0062] After the composite sound signal is collected by the microphone of the target hearing aid, the text information corresponding to the human voice in the composite sound signal is identified, and it is detected whether each segment of the text information contains a preset wake-up word.

[0063] Step A20: Use the target text information containing the preset wake-up word in each segment of the text information as a voice control instruction for the target hearing aid.

[0064] When it is detected that text information containing a preset wake-up word (hereinafter referred to as target text information for distinction) exists in each segment of text information, the target text information is used as a voice control instruction for the target hearing aid.

[0065] Step S20, when the parameter access information is parameter control information, obtaining target noise information in a target noise environment where the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructing a target feature vector based on the target noise information and the target voiceprint information;

[0066] In this embodiment, when the parameter access information is parameter control information, noise information (hereinafter referred to as target noise information for distinction) in the noise environment (hereinafter referred to as target noise environment for distinction) in which the target hearing aid is located is obtained, and voiceprint information (hereinafter referred to as target voiceprint information for distinction) of the user of the target hearing aid (hereinafter referred to as target user for distinction) is obtained, and a feature vector (hereinafter referred to as target feature vector for distinction) is constructed based on the target noise information and the target voiceprint information.

[0067] In this embodiment, the step S10 may include:

[0068] Step S101, in response to a voice control instruction for a target hearing aid, determining a user intention of the target user in the voice control instruction, and semantically matching the user intention with a preset parameter access text to obtain a matching result;

[0069] Step S102, when the matching result is consistent, determining that the preset parameter access text is the parameter access information in the voice control instruction.

[0070] It should be noted that parameter access texts are preset, such as "increase volume", "decrease volume", "volume query", "power query", "switch working mode to mode 1" and "switch working mode to mode 2".

[0071] In response to a voice control instruction initiated by a user to a target hearing aid, a user extraction of the target user in the voice control instruction is semantically matched with a preset parameter access text to obtain a matching result, and when the matching result is consistent, the preset parameter access text is determined to be the parameter access information in the voice control instruction.

[0072] In this embodiment, the step S20 may include:

[0073] Step S201, obtaining a target composite sound signal in a target noise environment where the target hearing aid is located, wherein the target composite sound signal is a sound signal including a user sound signal corresponding to the voice control instruction;

[0074] It should be noted that the user voice signal corresponding to the voice control instruction can be understood as the voice signal corresponding to the target text information.

[0075] A composite sound signal in a target noise environment collected by a microphone of a target hearing aid (hereinafter referred to as a target composite sound signal for distinction) is obtained, wherein the target composite sound signal is a sound signal including a user sound signal corresponding to a voice control instruction.

[0076] Step S202, extracting the user voice signal from the target composite voice signal to obtain an ambient voice signal, wherein the ambient voice signal is a voice signal other than the user voice signal in the target composite voice signal;

[0077] The user sound signal is extracted from the target composite sound signal to obtain an environmental sound signal of the separated user sound signal, wherein the environmental sound signal is a sound signal other than the user sound signal in the target composite sound signal. Specifically, the embodiment of the present application does not limit the method of extracting the user sound signal. For example, in one feasible implementation, the difference in frequency between the user sound signal and the environmental noise is utilized to separate different frequency bands through a filter to separate the user sound signal from the environmental sound signal. For example, in another feasible implementation, the user sound signal and the environmental sound signal in the target composite sound signal are separated based on a deep neural network model.

[0078] Step S203: determining target noise information in the target noise environment based on the environmental sound signal, and determining target voiceprint information of the target user based on the user sound signal.

[0079] The noise characteristics, noise types (such as traffic noise, background conversation noise, etc.) and noise intensity in the ambient sound signal are determined and integrated into noise information (i.e., the target noise information mentioned above). At the same time, the user sound signal is preprocessed by denoising and enhancement, and the voiceprint features of the preprocessed user sound signal are extracted to obtain the target voiceprint information.

[0080] Step S30, inputting the target feature vector into a target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained by using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the actual hearing aid usage habit of the user in the noise environment as model training labels;

[0081] It should be noted that the target model is obtained by training the model to be trained using a feature vector constructed based on the noise information in the noise environment where the hearing aid is located and the voiceprint information of the user who uses the hearing aid as the model input data, and label data constructed based on the user's actual hearing aid usage habits in the noise environment as the model training label. Among them, the user's hearing aid usage habits refer to the user's configuration habits of the hearing aid working parameters in a specific noise environment. For example, the user is accustomed to adjusting the volume to 50% to 60% (the maximum volume is 100% and the minimum is 0%) and turning on the noise reduction mode in a certain noise environment. And, the embodiments of the present application do not limit the specific types of the above-mentioned models to be trained.

[0082] The target feature vector is input into a pre-trained target model to obtain the hearing aid usage habits of the target user in the target noise environment.

[0083] In this embodiment, the control method of the hearing aid system of the present application further includes:

[0084] Step B10, obtaining a sample data set, wherein the sample data set includes a plurality of sample data, and one sample data includes noise information in a noise environment where the hearing aid is located and voiceprint information of a user of the hearing aid, as well as actual hearing aid usage habits of the user in the noise environment;

[0085] Step B20, constructing sample feature vectors based on the noise information and the voiceprint information in each piece of the sample data, and constructing sample label data based on the actual hearing aid usage habits in each piece of the sample data;

[0086] Step B30, using the sample feature vector corresponding to each piece of the sample data as model input data, and using the sample label data corresponding to each piece of the sample data as model training labels, training the model to be trained to obtain the target model for predicting user habits.

[0087] The training process of the target model is to construct a feature vector (hereinafter referred to as a sample feature vector for distinction) and label data (hereinafter referred to as sample label data for distinction) for each sample data based on multiple sample data in the pre-constructed sample data set. Specifically, the sample feature vector is constructed based on the noise information in the noise environment of the hearing aid in each sample data and the voiceprint information of the hearing aid user, and the sample label data is constructed based on the user's actual hearing aid usage habits in each sample data. Then, the sample feature vector corresponding to each sample data is used as the model input data, and the sample label data corresponding to each sample data is used as the model training label, and the training model is trained to obtain the target model.

[0088] Step S40: controlling the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

[0089] Based on the parameter control information triggered by the target user and the hearing aid usage habits of the target user in the current noisy environment predicted by the target model, the hearing aid is controlled to perform corresponding operations.

[0090] In response to a voice control instruction for a target hearing aid, the embodiment of the present application identifies parameter access information in the voice control instruction, and when the parameter access information is parameter control information, obtains target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructs a target feature vector based on the target noise information and the target voiceprint information; then the target feature vector is input into a pre-trained target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on noise information in the noise environment in which the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the user's actual hearing aid usage habit in the noise environment as model training labels; finally, the hearing aid is controlled to perform parameter control operations based on the parameter control information and the hearing aid usage habit.

[0091] In summary, compared to the traditional method that requires users to repeatedly adjust the physical buttons of the hearing aid to meet their personal hearing needs, the embodiment of the present application obtains the voice control instructions issued by the user, and combines the voice control instructions and the target model to predict the user's hearing aid usage habits in the current noisy environment, and controls the hearing aid to perform parameter control operations. In this way, the efficiency of adjusting the working parameters of the hearing aid is improved.

[0092] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. On this basis, the step S40 may include:

[0093] Step S401, obtaining a first parameter value corresponding to the parameter to be controlled in the parameter control information;

[0094] Obtain an actual parameter value (hereinafter referred to as a first parameter value for distinction) corresponding to a parameter specified in the parameter control information (hereinafter referred to as a parameter to be controlled for distinction). Exemplarily, when the parameter control information is "increase volume", the parameter to be controlled is volume, and the first parameter value corresponding to the parameter to be controlled is 30%.

[0095] Step S402, determining a target parameter value of the parameter to be controlled based on the hearing aid usage habit;

[0096] The parameter value of the parameter to be controlled (hereinafter referred to as the target parameter value for distinction) is extracted from the hearing aid usage habit. Exemplarily, the customary parameter value of the volume is determined to be 50% from the hearing aid usage habit.

[0097] Step S403, determining a customary adjustment direction for adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0098] It should be noted that when the parameter to be controlled is a parameter with an adjustment range such as volume, the adjustment direction of the parameter can be to increase or decrease; when the parameter to be controlled is a parameter with multiple adjustment options such as working mode (which can be an on mode or an off mode, as well as mode 1, mode 2...mode n), the adjustment direction of the parameter is to adjust the working mode to mode n.

[0099] An adjustment direction (hereinafter referred to as a customary adjustment direction for distinction) for adjusting the parameter to be controlled from the first parameter value to the target parameter value is determined. For example, the customary adjustment direction for adjusting the volume from 30% to 50% is to increase the volume.

[0100] Step S404, when the target adjustment direction of the parameter to be controlled in the parameter control information is the same as the customary adjustment direction, performing a parameter control operation of adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0101] The adjustment direction of the parameter to be controlled (hereinafter referred to as the target adjustment direction for distinction) in the parameter control information is compared with the adjustment direction determined based on the user's habit. If the target adjustment direction is the same as the habit adjustment direction, the parameter to be controlled is adjusted from the first parameter value to the target parameter value. For example, if the parameter control information is "increase the volume", the target adjustment direction is to increase, so the operation of adjusting the volume from 30% to 50% is performed.

[0102] Step S405: When the target adjustment direction is different from the habitual adjustment direction, query information is output through the speaker of the target hearing aid to confirm the user's needs for a second time.

[0103] When the target adjustment direction is different from the habitual adjustment direction, the inquiry information is output through the speaker of the target hearing aid to confirm the user's needs for a second time.

[0104] In a feasible implementation, when the target adjustment direction is to decrease the volume, the inquiry message may be “Please confirm whether to decrease the volume?” to determine the user's needs and ensure the accuracy of the control of the hearing aid system.

[0105] In another feasible implementation, the adjustment amplitude is pre-set when the target adjustment direction is different from the customary adjustment direction. For example, the volume adjustment amplitude is set to 2%. That is, when the target adjustment direction is to decrease the volume and the customary adjustment direction is to increase the volume, the operation of adjusting the volume from 30% to 28% is performed to reduce the impact of misjudgment on user experience.

[0106] In this embodiment, the control method of the hearing aid system of the present application further includes:

[0107] Step C10: when the parameter access information is parameter query information, obtaining a second parameter value corresponding to the parameter to be queried based on the parameter to be queried in the parameter query information, and outputting the second parameter value through the speaker of the target hearing aid.

[0108] In the case where the parameter access information is parameter query information, a parameter value corresponding to the parameter to be queried (hereinafter referred to as the second parameter value for distinction) is obtained based on the parameter specified by the parameter query information (hereinafter referred to as the parameter to be queried for distinction), and the second parameter value is output through the speaker of the target hearing aid.

[0109] In one feasible implementation, when the query parameter is the remaining power, the current remaining power of the target hearing aid is obtained to be 80%, and a voice prompt "The remaining power is 80%" is output through the speaker of the target hearing aid to inform the user.

[0110] For example, Figure 2 The figure shows a control flow diagram of a hearing aid system. First, a user voice signal is identified and the user intention in the user voice signal is extracted; it is determined whether the user intention is semantically consistent with a preset parameter access text; if so, the preset parameter access text is determined to be parameter access information; based on the access type (control type or query type) of the preset parameter access text, the parameter access information is determined to be parameter control information or parameter query information; when the parameter access information is parameter control information, noise information in the current noise environment and voiceprint information of the current user are obtained, a feature vector is constructed based on the noise information and voiceprint information, the feature vector is input into a target model, and the hearing aid usage habit of the current user in the current noise environment is obtained, and then a target adjustment direction is determined based on the parameter control information, and a habit adjustment direction is determined based on the hearing aid usage habit, and when the target adjustment direction is consistent with the habit adjustment direction, a step of adjusting the parameter to be controlled to the parameter value that the user is accustomed to is executed, and when the target adjustment direction is inconsistent with the habit adjustment direction, a secondary inquiry prompt is output; when the parameter access information is parameter query information, a current parameter value corresponding to the parameter to be queried is obtained, and the parameter value is output through the speaker of the hearing aid to inform the user.

[0111] In this way, the embodiment of the present application verifies the voice control command issued by the user according to the target user's usage habits in the current noisy environment predicted by the target model, that is, when the target adjustment direction represented by the voice control command is consistent with the habit adjustment direction predicted by the target model, the step of adjusting the parameter to be controlled to the parameter value that the user is accustomed to is executed, and when the target adjustment direction is inconsistent with the habit adjustment direction, a secondary inquiry prompt is output to improve the accuracy of the hearing aid parameter control. In addition, the user can also query the working status of the hearing aid through the voice assistant, thereby further improving the user experience.

[0112] The present application also provides a control device for a hearing aid system. Figure 3 , the control device of the hearing aid system comprises:

[0113] A response module 10, configured to respond to a voice control instruction for a target hearing aid and identify parameter access information in the voice control instruction;

[0114] an acquisition module 20, configured to acquire, when the parameter access information is parameter control information, target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and construct a target feature vector based on the target noise information and the target voiceprint information;

[0115] The prediction module 30 is used to input the target feature vector into a target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained by using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the actual hearing aid usage habit of the user in the noise environment as model training labels;

[0116] The control module 40 is configured to control the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

[0117] Optionally, the control device of the hearing aid system further comprises a wake-up module, wherein the wake-up module is used to:

[0118] Collecting a composite sound signal through the microphone of the target hearing aid, and detecting whether each segment of text information corresponding to the composite sound signal contains a preset wake-up word;

[0119] The target text information containing the preset wake-up word in each segment of the text information is used as a voice control instruction for the target hearing aid.

[0120] Optionally, the acquisition module 20 is further used for:

[0121] Acquire a target composite sound signal in a target noise environment where the target hearing aid is located, wherein the target composite sound signal is a sound signal including a user sound signal corresponding to the voice control instruction;

[0122] Extracting the user voice signal from the target composite voice signal to obtain an ambient voice signal, wherein the ambient voice signal is a voice signal other than the user voice signal in the target composite voice signal;

[0123] The target noise information in the target noise environment is determined based on the environmental sound signal, and the target voiceprint information of the target user is determined based on the user sound signal.

[0124] Optionally, the response module 10 is further used for:

[0125] In response to a voice control instruction for a target hearing aid, determining a user intention of the target user in the voice control instruction, and semantically matching the user intention with a preset parameter access text to obtain a matching result;

[0126] When the matching result is a consistent match, the preset parameter access text is determined to be the parameter access information in the voice control instruction.

[0127] Optionally, the control module 40 is further configured to:

[0128] Obtaining a first parameter value corresponding to the parameter to be controlled in the parameter control information;

[0129] Determining a target parameter value of the parameter to be controlled based on the hearing aid usage habits;

[0130] determining a customary adjustment direction for adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0131] When the target adjustment direction of the parameter to be controlled in the parameter control information is the same as the customary adjustment direction, performing a parameter control operation of adjusting the parameter to be controlled from the first parameter value to the target parameter value;

[0132] In the case that the target adjustment direction is different from the habitual adjustment direction, inquiry information is output through the speaker of the target hearing aid to re-confirm the user's needs.

[0133] Optionally, the control device of the hearing aid system further comprises a query module, wherein the query module is used to:

[0134] In the case where the parameter access information is parameter query information, a second parameter value corresponding to the parameter to be queried is acquired based on the parameter to be queried in the parameter query information, and the second parameter value is output through a speaker of the target hearing aid.

[0135] Optionally, the control device of the hearing aid system further comprises a training module, wherein the training module is used for:

[0136] Acquire a sample data set, wherein the sample data set includes a plurality of sample data, and one sample data includes noise information in a noise environment where the hearing aid is located and voiceprint information of a user of the hearing aid, as well as actual hearing aid usage habits of the user in the noise environment;

[0137] constructing sample feature vectors based on the noise information and the voiceprint information in each piece of the sample data, and constructing sample label data based on the actual hearing aid usage habits in each piece of the sample data;

[0138] The sample feature vector corresponding to each piece of the sample data is used as model input data, and the sample label data corresponding to each piece of the sample data is used as a model training label, and the training model is trained to obtain the target model for predicting user habits.

[0139] The control device of the hearing aid system provided in the embodiment of the present application adopts the control method of the hearing aid system in the above embodiment, which can solve the technical problem of how to improve the efficiency of adjusting the hearing aid parameters. Compared with the prior art, the beneficial effects of the control device of the hearing aid system provided in the embodiment of the present application are the same as the beneficial effects of the control method of the hearing aid system provided in the above embodiment, and other technical features in the control device of the hearing aid system are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0140] The present application provides a hearing aid, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the control method of the hearing aid system in the above-mentioned embodiment 1.

[0141] Reference below Figure 4 , which shows a structural schematic diagram of a hearing aid suitable for implementing an embodiment of the present application. Figure 4 The hearing aid shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0142] like Figure 4As shown, the hearing aid may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM) 1004. In the RAM 1004, various programs and data required for the operation of the hearing aid are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the hearing aid to communicate with other devices wirelessly or by wire to exchange data. Although the figures show hearing aids with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have instead.

[0143] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0144] The hearing aid provided by the present application adopts the control method of the hearing aid system in the above embodiment, which can solve the technical problem of how to improve the efficiency of hearing aid parameter adjustment. Compared with the prior art, the beneficial effects of the hearing aid provided by the present application are the same as the beneficial effects of the control method of the hearing aid system provided by the above embodiment, and the other technical features in the hearing aid are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0145] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0146] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0147] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the control method of the hearing aid system in the above-mentioned embodiment.

[0148] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0149] The computer-readable storage medium may be included in the hearing aid, or may exist independently without being installed in the hearing aid.

[0150] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the hearing aid, the hearing aid: responds to a voice control instruction for a target hearing aid and identifies parameter access information in the voice control instruction; when the parameter access information is parameter control information, obtains target noise information in a target noise environment where the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructs a target feature vector based on the target noise information and the target voiceprint information; inputs the target feature vector into a target model to obtain the hearing aid usage habit of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data and label data constructed based on the user's actual hearing aid usage habit in the noise environment as model training labels; and controls the target hearing aid to perform parameter control operations based on the parameter control information and the hearing aid usage habit.

[0151] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0152] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0153] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0154] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the control method of the hearing aid system, and can solve the technical problem of how to improve the efficiency of hearing aid parameter adjustment. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the control method of the hearing aid system provided in the above embodiment, and will not be repeated here.

[0155] An embodiment of the present application provides a computer program product, including a computer program, which implements the steps of the control method of the hearing aid system as described above when the computer program is executed by a processor.

[0156] The computer program product provided in this application can improve the efficiency of adjusting hearing aid parameters. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiment of this application are the same as the beneficial effects of the control method of the hearing aid system provided in the above embodiment, which will not be repeated here.

[0157] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. A method for controlling a hearing aid system, characterized in that: The control method of the hearing aid system comprises: In response to a voice control instruction for a target hearing aid, identifying parameter access information in the voice control instruction; In a case where the parameter access information is parameter control information, obtaining target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and constructing a target feature vector based on the target noise information and the target voiceprint information; Inputting the target feature vector into a target model to obtain the hearing aid usage habits of the target user in the target noise environment, wherein the target model is trained using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data and using label data constructed based on the actual hearing aid usage habits of the user in the noise environment as model training labels; The target hearing aid is controlled to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

2. The method according to claim 1, characterized in that Before the step of identifying parameter access information in the voice control instruction in response to the voice control instruction for the target hearing aid, the method further includes: Collecting a composite sound signal through the microphone of the target hearing aid, and detecting whether each segment of text information corresponding to the composite sound signal contains a preset wake-up word; The target text information containing the preset wake-up word in each segment of the text information is used as a voice control instruction for the target hearing aid.

3. The method according to claim 2, characterized in that The step of obtaining target noise information of a target noise environment in which the target hearing aid is located and target voiceprint information of the target user comprises: Acquire a target composite sound signal in a target noise environment where the target hearing aid is located, wherein the target composite sound signal is a sound signal including a user sound signal corresponding to the voice control instruction; Extracting the user voice signal from the target composite voice signal to obtain an ambient voice signal, wherein the ambient voice signal is a voice signal other than the user voice signal in the target composite voice signal; The target noise information in the target noise environment is determined based on the environmental sound signal, and the target voiceprint information of the target user is determined based on the user sound signal.

4. The method according to claim 1, characterized in that The step of identifying parameter access information in the voice control instruction in response to the voice control instruction for the target hearing aid comprises: In response to a voice control instruction for a target hearing aid, determining a user intention of the target user in the voice control instruction, and semantically matching the user intention with a preset parameter access text to obtain a matching result; When the matching result is a consistent match, the preset parameter access text is determined to be the parameter access information in the voice control instruction.

5. The method according to claim 1, characterized in that The step of controlling the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habits comprises: Obtaining a first parameter value corresponding to the parameter to be controlled in the parameter control information; Determining a target parameter value of the parameter to be controlled based on the hearing aid usage habits; determining a customary adjustment direction for adjusting the parameter to be controlled from the first parameter value to the target parameter value; When the target adjustment direction of the parameter to be controlled in the parameter control information is the same as the customary adjustment direction, performing a parameter control operation of adjusting the parameter to be controlled from the first parameter value to the target parameter value; In the case that the target adjustment direction is different from the habitual adjustment direction, inquiry information is output through the speaker of the target hearing aid to re-confirm the user's needs.

6. The method according to claim 1, characterized in that After the step of identifying parameter access information in response to the voice control instruction for the target hearing aid, the method further comprises: In the case where the parameter access information is parameter query information, a second parameter value corresponding to the parameter to be queried is acquired based on the parameter to be queried in the parameter query information, and the second parameter value is output through a speaker of the target hearing aid.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: Acquire a sample data set, wherein the sample data set includes a plurality of sample data, and one sample data includes noise information in a noise environment where the hearing aid is located and voiceprint information of a user of the hearing aid, as well as actual hearing aid usage habits of the user in the noise environment; constructing sample feature vectors based on the noise information and the voiceprint information in each piece of the sample data, and constructing sample label data based on the actual hearing aid usage habits in each piece of the sample data; The sample feature vector corresponding to each piece of the sample data is used as model input data, and the sample label data corresponding to each piece of the sample data is used as a model training label, and the training model is trained to obtain the target model for predicting user habits.

8. A control device for a hearing aid system, characterized in that: The control device of the hearing aid system comprises: a response module, configured to respond to a voice control instruction for a target hearing aid and identify parameter access information in the voice control instruction; an acquisition module, configured to acquire, when the parameter access information is parameter control information, target noise information in a target noise environment in which the target hearing aid is located and target voiceprint information of a target user of the target hearing aid, and construct a target feature vector based on the target noise information and the target voiceprint information; A prediction module, used for inputting the target feature vector into a target model to obtain the hearing aid usage habits of the target user in the target noise environment, wherein the target model is trained by using a feature vector constructed based on noise information in the noise environment where the hearing aid is located and voiceprint information of the user of the hearing aid as model input data, and using label data constructed based on the actual hearing aid usage habits of the user in the noise environment as model training labels; A control module is used to control the target hearing aid to perform a parameter control operation based on the parameter control information and the hearing aid usage habit.

9. A hearing aid, characterized in that: The hearing aid comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the control method of the hearing aid system according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method for controlling the hearing aid system according to any one of claims 1 to 7 are implemented.

Images