Earphone control method and device, computer readable storage medium and earphone

Abstract

The invention belongs to the technical field of earphone control, and particularly relates to an earphone control method and device, a computer readable storage medium and an earphone. The method comprises the following steps: sending specific sound waves to eardrums through a sound production unit of the earphone; obtaining target vibration state data through an optical detection sensor of the earphone; wherein the target vibration state data is vibration state data generated when the specific sound wave excites the eardrum; determining the hearing loss condition of the eardrum according to the target vibration state data; and controlling the earphone to execute a hearing optimization strategy corresponding to the hearing loss condition. According to the hearing optimization method and device, the hearing loss condition of the eardrum can be determined through cooperative use of the sound production unit and the optical detection sensor, the corresponding hearing optimization strategy is executed based on the hearing loss condition, and the hearing optimization method and device can adapt to complex and changeable individual differences among different users.

Description

Technical Field

[0001] This application belongs to the technical field of headphone control, and particularly relates to a headphone control method, apparatus, computer-readable storage medium, and headphone. Background Art

[0002] With the influence of population aging and environmental factors, the group with hearing impairments is becoming increasingly large. Based on this background, hearing aids, as an important device for assisting hearing restoration, are becoming more and more popular. With the help of hearing aids, the hearing impairment of users can be effectively improved.

[0003] However, the causes of hearing loss in the human ear are diverse. For example, the natural decline of the auditory organs caused by age growth, long-term exposure to a noisy environment, ear diseases or trauma, etc., which makes the hearing loss situations of different users vary. However, the existing hearing aids generally adopt a relatively simple and fixed working mode and cannot adapt to the complex and variable individual differences among different users. Summary of the Invention

[0004] In view of this, the embodiments of this application provide a headphone control method, apparatus, computer-readable storage medium, and headphone to solve the problem in the existing technology that it cannot adapt to the complex and variable individual differences among different users.

[0005] The first aspect of the embodiments of this application provides a headphone control method, which is applied to a headphone. The headphone may include a sound generating unit and an optical detection sensor. The headphone control method may include:

[0006] Sending a specific sound wave to the eardrum through the sound generating unit;

[0007] Obtaining target vibration state data through the optical detection sensor; wherein, the target vibration state data is the vibration state data generated by the specific sound wave exciting the eardrum;

[0008] Determining the hearing loss situation of the eardrum according to the target vibration state data;

[0009] Controlling the headphone to execute a hearing optimization strategy corresponding to the hearing loss situation.

[0010] In a specific implementation manner of the first aspect, the determining the hearing loss situation of the eardrum according to the target vibration state data may include:

[0011] Inputting the target vibration state data into a preset hearing loss discrimination model and obtaining the hearing loss situation output by the hearing loss discrimination model;

[0012] Among them, the hearing loss discrimination model is an artificial intelligence model pre-trained to determine the hearing loss situation.

[0013] In a specific implementation manner of the first aspect, before inputting the target vibration state data into a preset hearing loss discrimination model, it may further include:

[0014] Construct a training data set for training the hearing loss discrimination model; among them, the training data set includes a number of training samples, and each training sample includes a set of vibration state data and the corresponding hearing loss situation;

[0015] Taking the vibration state data of the training sample as the input and the corresponding hearing loss situation as the expected output, train an initial artificial intelligence model to obtain the trained hearing loss discrimination model.

[0016] In a specific implementation manner of the first aspect, the step of taking the vibration state data of the training sample as the input and the corresponding hearing loss situation as the expected output, training an initial artificial intelligence model to obtain the trained hearing loss discrimination model may include:

[0017] Use the artificial intelligence model to process the vibration state data of the training sample to obtain the actual output of the training sample;

[0018] Use a preset loss function to determine the training loss value according to the expected output and the actual output in the training sample;

[0019] Adjust the model parameters of the artificial intelligence model according to the training loss value until the preset training conditions are met, to obtain the trained hearing loss discrimination model.

[0020] In a specific implementation manner of the first aspect, the step of determining the hearing loss situation of the eardrum according to the target vibration state data may include:

[0021] Determine the data deviation amount between the target vibration state data and the preset reference vibration state data;

[0022] Based on a preset hearing loss mapping relationship, determine the hearing loss situation corresponding to the data deviation amount;

[0023] Among them, the hearing loss mapping relationship is a pre-set mapping relationship between the data deviation amount and the hearing loss situation.

[0024] In a specific implementation manner of the first aspect, the step of determining the hearing loss situation of the eardrum according to the target vibration state data may include:

[0025] Determine the reference vibration state data for each different hearing loss level respectively;

[0026] Determine the data similarity between the target vibration state data and each of the reference vibration state data respectively;

[0027] Determine the hearing loss condition of the eardrum according to the data similarity.

[0028] In a specific implementation manner of the first aspect, the controlling the earphone to execute the hearing optimization strategy corresponding to the hearing loss condition may include:

[0029] Based on a preset optimization strategy mapping relationship, determine the hearing optimization strategy corresponding to the hearing loss condition; wherein, the optimization strategy mapping relationship is a pre-set mapping relationship between the hearing loss condition and the hearing optimization strategy;

[0030] Control the earphone to execute the hearing optimization strategy.

[0031] A second aspect of the embodiments of the present application provides an earphone control device, which is applied to an earphone. The earphone may include a sound generating unit and an optical detection sensor. The earphone control device may include:

[0032] A sound wave sending module, configured to send a specific sound wave to the eardrum through the sound generating unit;

[0033] A vibration state data acquisition module, configured to acquire target vibration state data through the optical detection sensor; wherein, the target vibration state data is the vibration state data generated by the specific sound wave exciting the eardrum;

[0034] A hearing loss condition determination module, configured to determine the hearing loss condition of the eardrum according to the target vibration state data;

[0035] A hearing optimization strategy execution module, configured to control the earphone to execute the hearing optimization strategy corresponding to the hearing loss condition.

[0036] In a specific implementation manner of the second aspect, the hearing loss condition determination module may be configured to: input the target vibration state data into a preset hearing loss discrimination model, and obtain the hearing loss condition output by the hearing loss discrimination model; wherein, the hearing loss discrimination model is an artificial intelligence model pre-trained for determining the hearing loss condition.

[0037] In a specific implementation manner of the second aspect, the earphone control device may further include:

[0038] A training dataset construction module for constructing a training dataset for training the hearing loss discrimination model; wherein, the training dataset includes a number of training samples, and each training sample includes a set of vibration state data and the corresponding hearing loss situation;

[0039] A hearing loss discrimination model training module for training an initial artificial intelligence model with the vibration state data of the training samples as the input and the corresponding hearing loss situation as the expected output to obtain the trained hearing loss discrimination model.

[0040] In a specific implementation manner of the second aspect, the hearing loss discrimination model training module may be configured to: use the artificial intelligence model to process the vibration state data of the training samples to obtain the actual output of the training samples; use a preset loss function to determine the training loss value according to the expected output and the actual output in the training samples; and adjust the model parameters of the artificial intelligence model according to the training loss value until the preset training conditions are met to obtain the trained hearing loss discrimination model.

[0041] In a specific implementation manner of the second aspect, the hearing loss situation determination module may be configured to: determine the data deviation amount between the target vibration state data and the preset reference vibration state data; and determine the hearing loss situation corresponding to the data deviation amount based on a preset hearing loss mapping relationship; wherein, the hearing loss mapping relationship is a mapping relationship between the data deviation amount and the hearing loss situation set in advance.

[0042] In a specific implementation manner of the second aspect, the hearing loss situation determination module may be configured to: respectively determine the reference vibration state data for each different hearing loss level; respectively determine the data similarity between the target vibration state data and each of the reference vibration state data; and determine the hearing loss situation of the eardrum according to the data similarity.

[0043] In a specific implementation manner of the second aspect, the hearing optimization strategy execution module may be configured to: determine the hearing optimization strategy corresponding to the hearing loss situation based on a preset optimization strategy mapping relationship; wherein, the optimization strategy mapping relationship is a mapping relationship between the hearing loss situation and the hearing optimization strategy set in advance; and control the earphone to execute the hearing optimization strategy.

[0044] A third aspect of the embodiments of the present application provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the steps of any of the above earphone control methods are implemented.

[0045] A fourth aspect of the embodiments of the present application provides a headset, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of any of the above headset control methods are implemented.

[0046] A fifth aspect of the embodiments of the present application provides a computer program product. When the computer program product runs on a headset, the headset is caused to execute the steps of any of the above headset control methods.

[0047] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: In the embodiments of the present application, a specific sound wave is sent to the eardrum through the sound generating unit of the headset; target vibration state data is obtained through the optical detection sensor of the headset; wherein, the target vibration state data is the vibration state data generated by the specific sound wave exciting the eardrum; the hearing loss condition of the eardrum is determined according to the target vibration state data; and the headset is controlled to execute a hearing optimization strategy corresponding to the hearing loss condition. In the embodiments of the present application, through the combined use of the sound generating unit and the optical detection sensor, the hearing loss condition of the eardrum can be determined, and based on this, the corresponding hearing optimization strategy can be executed, which can adapt to the complex and variable individual differences among different users. Description of the Drawings

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0049] Figure 1 It is a schematic diagram of an embodiment of a headset in the embodiments of the present application;

[0050] Figure 2 It is a flowchart of an embodiment of a headset control method in the embodiments of the present application;

[0051] Figure 3 It is a schematic diagram of a hearing loss discrimination model;

[0052] Figure 4 It is a structural diagram of an embodiment of a headset control device in the embodiments of the present application;

[0053] Figure 5 It is a schematic block diagram of a headset in the embodiments of the present application. Detailed Embodiments

[0054] To make the objects, features, and advantages of the present application more apparent and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the embodiments described below are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the scope of protection of the present application.

[0055] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, wholes, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0056] It should also be understood that the terms used in this specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification of the present application and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms.

[0057] It should be further understood that the term "and / or" used in this specification of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0058] As used in this specification and the appended claims, the term "if" can be interpreted as "when", "once", "in response to determining", or "in response to detecting" depending on the context. Similarly, the phrase "if determined" or "if detected [the described condition or event]" can be interpreted as meaning "once determined", "in response to determining", "once detected [the described condition or event]", or "in response to detecting [the described condition or event]" depending on the context.

[0059] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0060] With the influence of population aging and environmental factors, etc., the group with hearing impairments is becoming increasingly large. Based on this background, as an important device for assisting hearing recovery, the use of hearing aids is becoming more and more popular. With the help of hearing aids, the hearing impairment situation of users can be effectively improved.

[0061] However, the causes of human ear hearing loss are diverse. For example, the natural decline of the auditory organs due to aging, long-term exposure to noisy environments, ear diseases or traumas, etc., which makes the hearing loss situations of different users vary. However, the assistive hearing headphones in the existing technology generally adopt a relatively simple and fixed working mode and cannot adapt to the complex and variable individual differences among different users.

[0062] In view of this, the embodiments of the present application provide a headphone control method, device, computer-readable storage medium and headphones to solve the problem in the existing technology that it cannot adapt to the complex and variable individual differences among different users.

[0063] In the embodiments of the present application, through the coordinated use of a sound generating unit and an optical detection sensor, the hearing loss situation of the eardrum can be determined, and based on this, the corresponding hearing optimization strategy can be executed, which can adapt to the complex and variable individual differences among different users.

[0064] The execution subject of the embodiments of the present application can be headphones, such as Figure 1 shown, the headphones may include but are not limited to a sound generating unit and an optical detection sensor.

[0065] Please refer to Figure 2 , an embodiment of a headphone control method in the embodiments of the present application may include:

[0066] Step S201, sending a specific sound wave to the eardrum through the sound generating unit.

[0067] In the embodiments of the present application, any sound generator in the existing technology can be selected as the sound generating unit according to the actual situation, which may include but are not limited to a micro piezoelectric ceramic sound generator or other generators, and it is advisable to have characteristics such as small volume, low power consumption, and excellent frequency response characteristics. Through precise drive circuit regulation, the sound generating unit can stably output a specific sound wave with a frequency range of 200 Hertz (Hz) - 10 kilohertz (kHz). This frequency range can accurately cover the main frequency range of human speech communication and can effectively stimulate the eardrum to generate characteristic vibrations.

[0068] In a specific implementation manner of the embodiments of the present application, the intensity of the specific sound wave sent by the sound generator can be finely adjusted, and the adjustment accuracy is preferably ±0.1 decibel (dB). According to different measurement stages and user individual differences, a sound wave with an appropriate intensity can be accurately output, which not only ensures the effectiveness of the measurement but also avoids any potential damage to the eardrum.

[0069] Step S202, obtaining target vibration state data through the optical detection sensor.

[0070] In the embodiments of the present application, any one of the existing optical detection sensors can be selected according to the actual situation, which may include but is not limited to a Laser Doppler Vibrometer (LDV) or other sensors. Taking the Laser Doppler Vibrometer as an example, the Laser Doppler effect can be used to perform non-contact vibration measurement on an object. Its laser beam is emitted onto the surface of the object to be measured, and due to the movement of the surface, the reflected laser beam generates a Doppler frequency shift, from which vibration state data such as the vibration amplitude and frequency of the surface can be extracted.

[0071] By adopting an advanced micro optical detection sensor, extremely subtle changes in light intensity and phase of the eardrum can be captured in real time, and then the vibration state data generated by the eardrum excited by specific sound waves can be accurately deduced and recorded as the target vibration state data.

[0072] Step S203: Determine the hearing loss condition of the eardrum according to the target vibration state data.

[0073] In a specific implementation manner of the embodiments of the present application, as Figure 3 shown, the target vibration state data can be input into a preset hearing loss discrimination model, and the hearing loss condition output by the hearing loss discrimination model can be obtained. Among them, the hearing loss discrimination model is an artificial intelligence model pre-trained for determining the hearing loss condition.

[0074] Specifically, a training data set for training the hearing loss discrimination model can be constructed. Among them, the training data set may include several training samples, and each training sample may include a set of vibration state data and the corresponding hearing loss condition. Using the vibration state data of the training sample as the input and the corresponding hearing loss condition as the expected output, the initial artificial intelligence model can be trained to obtain the trained hearing loss discrimination model.

[0075] During the training process, for each training sample, the artificial intelligence model can be used to process the vibration state data of the training sample to obtain the actual output of the training sample, and then a preset loss function can be used to determine the training loss value according to the expected output and the actual output in the training sample. In the embodiments of the present application, any one of the existing loss functions in the prior art can be selected according to the actual situation for calculating the training loss value, and the embodiments of the present application do not make specific limitations on this.

[0076] After calculating the training loss value, the model parameters of the artificial intelligence model can be adjusted according to the training loss value. In the embodiment of the present application, it is assumed that in the initial state, the model parameters of the artificial intelligence model are W1. The training loss value is backpropagated to modify the model parameters W1 of the artificial intelligence model, and the modified model parameters W2 are obtained. After modifying the parameters, the next training process is continued. In this training process, the training loss value is recalculated, and the training loss value is backpropagated to modify the model parameters W2 of the artificial intelligence model, and the modified model parameters W3 are obtained, and so on. By repeating the above process continuously, the model parameters can be modified in each training process until the preset training conditions are met. Among them, the training conditions can be that the number of training times reaches the preset number threshold, and the number threshold can be set according to the actual situation. For example, it can be set to thousands, tens of thousands, hundreds of thousands or even larger values; the training conditions can also be that the artificial intelligence model converges; since it is possible that the number of training times has not reached the number threshold, but the artificial intelligence model has already converged, which may lead to unnecessary repeated work; or the artificial intelligence model may never converge, which may lead to an infinite loop and the training process cannot end. Based on the above two situations, the training conditions can also be that the number of training times reaches the number threshold or the artificial intelligence model converges. When the training conditions are met, the trained hearing loss discrimination model can be obtained.

[0077] Through the above process, the vibration state data of the training samples and the corresponding hearing loss conditions are used as the learning objects of the artificial intelligence model. After the training process, the artificial intelligence model can establish a mapping relationship between the vibration state data and the corresponding hearing loss conditions. Therefore, when facing new vibration state data, the corresponding hearing loss conditions can also be obtained according to this mapping relationship.

[0078] After completing the training of the hearing loss discrimination model, the obtained target vibration state data can be input into the hearing loss discrimination model, and the hearing loss conditions corresponding to the target vibration state data output by the hearing loss discrimination model can be obtained.

[0079] In another specific implementation manner of the embodiment of the present application, the data deviation amount between the target vibration state data and the preset reference vibration state data can be determined, and based on the preset hearing loss mapping relationship, the hearing loss condition corresponding to the data deviation amount can be determined. Among them, the data deviation amount can be the difference between the target vibration state data and the reference vibration state data, and the reference vibration state data is the vibration state data of a normal eardrum without hearing loss.

[0080] The hearing loss mapping relationship is a pre-set mapping relationship between the data deviation amount and the hearing loss condition, as shown in the following table:

[0081] Data deviation amount Hearing loss situation Data deviation amount 1 Hearing loss situation 1 Data deviation amount 2 Hearing loss situation 2 Data deviation amount 3 Hearing loss situation 3 …… ……

[0082] For example, data deviation amount 1 corresponds to hearing loss condition 1, data deviation amount 2 corresponds to hearing loss condition 2, data deviation amount 3 corresponds to hearing loss condition 3, and so on. Among them, the severity of the hearing loss condition is positively correlated with the magnitude of the data deviation amount, that is, the smaller the data deviation amount, the milder the hearing loss condition; conversely, the larger the data deviation amount, the more severe the hearing loss condition.

[0083] After determining the data deviation amount, the hearing loss condition corresponding to the data deviation amount can be determined based on the hearing loss mapping relationship. For example, if the determined data deviation amount is data deviation amount 2, then according to the hearing loss mapping relationship, the corresponding hearing loss condition can be determined as hearing loss condition 2.

[0084] In another specific implementation manner of the embodiments of the present application, the reference vibration state data for each different hearing loss level can be determined separately. For example, different hearing loss levels such as severe hearing loss, moderate hearing loss, mild hearing loss, and no hearing loss can be preset. For each hearing loss level, the corresponding vibration state data can be obtained separately and used as the reference vibration state data.

[0085] After obtaining the target vibration state data, the data similarity between the target vibration state data and each reference vibration state data can be determined separately. The specific similarity calculation method can be flexibly set according to the actual situation, including but not limited to cosine similarity, Structural Similarity Index (SSIM), or other similarity calculation methods. The embodiments of the present application do not make specific limitations on this. After obtaining the data similarity, the hearing loss condition of the eardrum can be determined according to the data similarity. As an example, the hearing loss level corresponding to the maximum data similarity can be determined as the hearing loss condition of the eardrum. For example, if the data similarity between the reference vibration state data of the severe hearing loss level and the target vibration state data is the largest, then the hearing loss condition of the eardrum can be determined as severe hearing loss.

[0086] Step S204: Control the earphone to execute the hearing optimization strategy corresponding to the hearing loss condition.

[0087] In a specific implementation manner of the embodiments of the present application, the hearing optimization strategy corresponding to the hearing loss condition can be determined based on a preset optimization strategy mapping relationship, and the earphone is controlled to execute the hearing optimization strategy.

[0088] The optimization strategy mapping relationship is a mapping relationship between the preset hearing optimization strategies, as shown in the following table:

[0089] Hearing loss situation Hearing optimization strategy Hearing loss situation 1 Hearing optimization strategy 1 Hearing loss situation 2 Hearing optimization strategy 2 Hearing loss situation 3 Hearing optimization strategy 3 …… ……

[0090] For example, hearing loss situation 1 corresponds to hearing optimization strategy 1, hearing loss situation 2 corresponds to hearing optimization strategy 2, hearing loss situation 3 corresponds to hearing optimization strategy 3, and so on.

[0091] After determining the hearing loss situation, based on the hearing loss mapping relationship, the corresponding hearing optimization strategy can be determined. For example, if the determined hearing loss situation is hearing loss situation 2, then according to the hearing loss mapping relationship, the corresponding hearing optimization strategy can be determined as hearing optimization strategy 2.

[0092] The hearing optimization strategies in the embodiments of the present application may include, but are not limited to, adjusting the amplification gain, optimizing the phase compensation, activating the intelligent noise reduction algorithm, and other strategies. For example, if it is determined that the user's hearing loss intensifies in the low-frequency band, the amplification gain of the low-frequency sound can be increased accordingly, and at the same time, the phase compensation of the audio signal can be optimized to ensure the naturalness and intelligibility of the sound. If the user is in a noisy environment and has weak high-frequency resolution ability, the intelligent noise reduction algorithm can be activated to preferentially enhance the high-frequency components of the target speech signal, suppress the interference of background noise, and improve speech clarity. The response time of the hearing optimization strategy should be as short as possible, preferably within 100 milliseconds, to ensure that the user can immediately feel the optimization effect of the hearing aid.

[0093] In summary, in the embodiments of the present application, a specific sound wave is sent to the eardrum through the sound generating unit of the earphone; the target vibration state data is obtained through the optical detection sensor of the earphone; wherein, the target vibration state data is the vibration state data generated by the specific sound wave exciting the eardrum; the hearing loss situation of the eardrum is determined according to the target vibration state data; and the earphone is controlled to execute the hearing optimization strategy corresponding to the hearing loss situation. In the embodiments of the present application, through the combined use of the sound generating unit and the optical detection sensor, the hearing loss situation of the eardrum can be determined, and the corresponding hearing optimization strategy can be executed based on this, which can adapt to the complex and variable individual differences among different users.

[0094] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0095] Corresponding to the earphone control method described in the above embodiments, Figure 4 Fig. shows a structural diagram of an embodiment of an earphone control device provided by an embodiment of the present application.

[0096] In the embodiments of the present application, the earphone control device is applied to the earphone, and the earphone includes a sound generating unit and an optical detection sensor; the earphone control device may include:

[0097] An acoustic wave transmitting module 401, configured to transmit a specific acoustic wave to the eardrum through the sound generating unit;

[0098] A vibration state data acquisition module 402, configured to acquire target vibration state data through the optical detection sensor; wherein, the target vibration state data is vibration state data generated by the eardrum excited by the specific acoustic wave;

[0099] A hearing loss condition determination module 403, configured to determine the hearing loss condition of the eardrum according to the target vibration state data;

[0100] A hearing optimization strategy execution module 404, configured to control the earphone to execute a hearing optimization strategy corresponding to the hearing loss condition.

[0101] In a specific implementation manner of the embodiment of the present application, the hearing loss condition determination module may be configured to: input the target vibration state data into a preset hearing loss discrimination model, and obtain the hearing loss condition output by the hearing loss discrimination model; wherein, the hearing loss discrimination model is an artificial intelligence model pre-trained for determining the hearing loss condition.

[0102] In a specific implementation manner of the embodiment of the present application, the earphone control device may further include:

[0103] A training data set construction module, configured to construct a training data set for training the hearing loss discrimination model; wherein, the training data set includes a plurality of training samples, and each training sample includes a set of vibration state data and a corresponding hearing loss condition;

[0104] A hearing loss discrimination model training module, configured to train an initial artificial intelligence model with the vibration state data of the training sample as the input and the corresponding hearing loss condition as the expected output, to obtain the trained hearing loss discrimination model.

[0105] In a specific implementation manner of the embodiment of the present application, the hearing loss discrimination model training module may be configured to: use an artificial intelligence model to process the vibration state data of the training sample to obtain the actual output of the training sample; use a preset loss function to determine a training loss value according to the expected output and the actual output in the training sample; adjust the model parameters of the artificial intelligence model according to the training loss value until a preset training condition is met, to obtain the trained hearing loss discrimination model.

[0106] In a specific implementation manner of the embodiment of the present application, the hearing loss situation determination module may be configured to: determine the data deviation amount between the target vibration state data and the preset reference vibration state data; based on the preset hearing loss mapping relationship, determine the hearing loss situation corresponding to the data deviation amount; wherein, the hearing loss mapping relationship is a mapping relationship between the preset data deviation amount and the hearing loss situation.

[0107] In a specific implementation manner of the embodiment of the present application, the hearing loss situation determination module may be configured to: respectively determine the reference vibration state data of each different hearing loss level; respectively determine the data similarity between the target vibration state data and each of the reference vibration state data; and determine the hearing loss situation of the eardrum according to the data similarity.

[0108] In a specific implementation manner of the embodiment of the present application, the hearing optimization strategy execution module may be configured to: based on the preset optimization strategy mapping relationship, determine the hearing optimization strategy corresponding to the hearing loss situation; wherein, the optimization strategy mapping relationship is a mapping relationship between the preset hearing loss situation and the hearing optimization strategy; and control the earphone to execute the hearing optimization strategy.

[0109] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the above-described devices, modules, and units can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0110] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed or recorded in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0111] Figure 5 The schematic block diagram of an earphone provided by an embodiment of the present application is shown. For the convenience of description, only parts related to the embodiment of the present application are shown.

[0112] As Figure 5 shown, the earphone 5 of this embodiment includes: a processor 50, a memory 51, and a computer program 52 stored in the memory 51 and executable on the processor 50. When the processor 50 executes the computer program 52, the steps in the foregoing method embodiments of various earphone control methods are implemented, such as Figure 2 the steps S201 to S204 shown. Alternatively, when the processor 50 executes the computer program 52, the functions of each module / unit in the foregoing device embodiments are implemented, such as Figure 4 the functions of the modules 401 to 404 shown.

[0113] Exemplarily, the computer program 52 may be divided into one or more modules / units, which are stored in the memory 51 and executed by the processor 50 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and these instruction segments are used to describe the execution process of the computer program 52 in the earphone 5.

[0114] Those skilled in the art can understand that Figure 5 merely examples of the earphone 5, which do not constitute a limitation on the earphone 5. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, the earphone 5 may further include input / output devices, network access devices, a bus, etc.

[0115] The processor 50 may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0116] The memory 51 may be an internal storage unit of the earphone 5, such as the hard disk or memory of the earphone 5. The memory 51 may also be an external storage device of the earphone 5, such as a plug-in hard disk equipped on the earphone 5, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the memory 51 may also include both the internal storage unit and the external storage device of the earphone 5. The memory 51 is used to store the computer program and other programs and data required by the earphone 5. The memory 51 may also be used to temporarily store data that has been output or is to be output.

[0117] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction and do not limit the protection scope of this application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiment and will not be elaborated here.

[0118] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0119] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0120] In the embodiments provided in this application, it should be understood that the disclosed device / earphone and method can be implemented in other ways. For example, the device / earphone embodiments described above are only illustrative. For example, the division of the above modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0121] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0122] In addition, in each embodiment of the present application, each functional unit may be integrated into one processing unit, may exist physically alone for each unit, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0123] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on such an understanding, all or part of the processes in the above-mentioned embodiment methods of the present application can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device that can carry the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disc, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable storage medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals.

[0124] The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A headset control method, applied to a headset, characterized in that: The earphone includes a sound unit and an optical detection sensor; the earphone control method includes: Sending specific sound waves to the eardrum through the sound generating unit; Acquiring target vibration state data through the optical detection sensor; wherein the target vibration state data is vibration state data generated by the eardrum being excited by the specific sound wave; determining the hearing loss condition of the eardrum according to the target vibration state data; The earphone is controlled to execute a hearing optimization strategy corresponding to the hearing loss condition.

2. The earphone control method according to claim 1, characterized in that: Determining the hearing loss condition of the eardrum according to the target vibration state data includes: Inputting the target vibration state data into a preset hearing loss discrimination model, and obtaining the hearing loss condition output by the hearing loss discrimination model; The hearing loss discrimination model is a pre-trained artificial intelligence model used to determine the hearing loss situation.

3. The earphone control method according to claim 2, characterized in that: Before inputting the target vibration state data into a preset hearing loss discrimination model, the method further includes: Constructing a training data set for training the hearing loss discrimination model; wherein the training data set includes a plurality of training samples, and the training samples include a set of vibration state data and corresponding hearing loss conditions; The initial artificial intelligence model is trained with the vibration state data of the training sample as input and the corresponding hearing loss situation as expected output to obtain the trained hearing loss discrimination model.

4. The earphone control method according to claim 3, characterized in that: The initial artificial intelligence model is trained by taking the vibration state data of the training sample as input and the corresponding hearing loss condition as expected output to obtain the trained hearing loss discrimination model, including: Processing the vibration state data of the training sample using an artificial intelligence model to obtain an actual output of the training sample; Using a preset loss function, determining a training loss value according to the expected output and the actual output in the training sample; The model parameters of the artificial intelligence model are adjusted according to the training loss value until the preset training conditions are met, thereby obtaining the trained hearing loss discrimination model.

5. The earphone control method according to claim 1, characterized in that: Determining the hearing loss condition of the eardrum according to the target vibration state data includes: Determining a data deviation amount between the target vibration state data and preset reference vibration state data; Based on a preset hearing loss mapping relationship, determining the hearing loss situation corresponding to the data deviation; The hearing loss mapping relationship is a preset mapping relationship between the data deviation and the hearing loss condition.

6. The earphone control method according to claim 1, characterized in that: Determining the hearing loss condition of the eardrum according to the target vibration state data includes: Determine reference vibration state data for different hearing loss levels respectively; respectively determining data similarities between the target vibration state data and each of the reference vibration state data; The hearing loss condition of the eardrum is determined according to the data similarity.

7. The earphone control method according to any one of claims 1 to 6, characterized in that: The controlling the earphone to execute a hearing optimization strategy corresponding to the hearing loss condition includes: Based on a preset optimization strategy mapping relationship, determining the hearing optimization strategy corresponding to the hearing loss situation; wherein the optimization strategy mapping relationship is a preset mapping relationship between the hearing loss situation and the hearing optimization strategy; The earphone is controlled to execute the hearing optimization strategy.

8. An earphone control device, applied to an earphone, characterized in that: The earphone comprises a sound-emitting unit and an optical detection sensor; the earphone control device comprises: A sound wave sending module, used for sending specific sound waves to the eardrum through the sound generating unit; A vibration state data acquisition module, used to acquire target vibration state data through the optical detection sensor; wherein the target vibration state data is the vibration state data generated by the eardrum being excited by the specific sound wave; a hearing loss condition determination module, configured to determine the hearing loss condition of the eardrum according to the target vibration state data; The hearing optimization strategy execution module is used to control the earphone to execute the hearing optimization strategy corresponding to the hearing loss situation.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the earphone control method according to any one of claims 1 to 7 are implemented.

10. A headset comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the earphone control method according to any one of claims 1 to 7 are implemented.

Images