Earphone control method, parameter generation method and device, storage medium and earphone

Abstract

Embodiments of the present application disclose a control method and parameter generation method and device for earphones, a storage medium and an earphone. The method comprises: obtaining a residual audio signal; determining whether a target audio signal exists in the residual audio signal; and if the target audio signal exists in the residual audio signal, performing suppression processing on the target audio signal. Through the embodiments of the present application, active detection and suppression processing of the target audio signal can be achieved, without manual adjustment by a user, thereby improving control efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, in particular to a control method and parameter generation method of earphones, an earphone control method and parameter generation method device, a storage medium and earphones. BACKGROUND

[0002] If a user is wearing an in-ear earphone to listen to music or watch a video, some audio signals in specific situations will interfere with the user's listening, for example, when the user is wearing an in-ear earphone to listen to music, the sound of chewing food will be amplified in the user's ear and interfere with the user's listening, and when the chewing sound is too loud, it will even cover the sound of the audio played by the earphone. For another example, when the user is wearing an in-ear earphone to listen to music on a vehicle, the noise signal generated by the vehicle will interfere with the user's listening, and these interference signals are different from general environmental noise and will produce more obvious interference than general environmental noise.

[0003] When the above situations occur, the user can only reduce the interference of these signals by external playing, which is inefficient and interferes with the immersive viewing experience. SUMMARY

[0004] The embodiments of the present application provide a control method and parameter generation method of earphones, an earphone control method and parameter generation method device, a storage medium and earphones, which can realize active detection and suppression processing of specific interference signals.

[0005] In a first aspect, the embodiments of the present application provide a control method of earphones, comprising:

[0006] obtaining a residual audio signal;

[0007] determining whether a target audio signal exists in the residual audio signal;

[0008] if the target audio signal exists in the residual audio signal, performing suppression processing on the target audio signal.

[0009] In a second aspect, the embodiments of the present application also provide a parameter generation method of earphones, an in-ear end of the earphones is provided with an audio acquisition component and an audio output component, and the method comprises:

[0010] playing a test audio signal through the audio output component, and collecting an in-ear audio signal through the audio acquisition component;

[0011] obtaining an initial time domain response parameter, and generating a second cancellation signal of the test audio signal according to the initial time domain response parameter and the test audio signal;

[0012] adjusting the initial time domain response parameter according to an error between the second cancellation signal and the in-ear audio signal until a preset stop condition is met, to obtain a target time domain response parameter of the earphones.

[0013] In a third aspect, the embodiments of the present application further provide a control device of an earphone, comprising:

[0014] a signal acquisition module, configured to acquire a residual audio signal;

[0015] a target detection module, configured to determine whether the residual audio signal contains a target audio signal;

[0016] a target suppression module, configured to perform suppression processing on the target audio signal if the residual audio signal contains the target audio signal.

[0017] In a fourth aspect, the embodiments of the present application further provide a parameter generation device of an earphone, an ear-in end of the earphone is provided with an audio acquisition component and an audio output component, and the device comprises:

[0018] a second control module, configured to play a test audio signal through the audio output component and acquire an in-ear audio signal through the audio acquisition component;

[0019] acquire an initial time-domain response parameter, and generate a second cancellation signal of the test audio signal according to the initial time-domain response parameter and the test audio signal;

[0020] adjust the initial time-domain response parameter according to an error between the second cancellation signal and the in-ear audio signal until a preset stop condition is met, and obtain a target time-domain response parameter of the earphone.

[0021] In a fifth aspect, the embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and when the computer program runs on a computer, the computer is caused to execute the control method of the earphone provided by any of the embodiments of the present application, or the parameter generation method of the earphone provided by any of the embodiments of the present application.

[0022] In a sixth aspect, the embodiments of the present application further provide an earphone, comprising an audio acquisition component, an audio output component, a processor and a memory, the memory has a computer program, and the processor is configured to execute the control method of the earphone provided by any of the embodiments of the present application or the parameter generation method of the earphone provided by any of the embodiments of the present application by calling the computer program.

[0023] The technical scheme provided by the embodiments of the present application acquires a residual audio signal, detects whether the residual audio signal contains a target audio signal, and performs suppression processing on the target audio signal if the residual audio signal contains the target audio signal. Through the scheme of the embodiments of the present application, active detection and suppression processing of a specific interference signal can be realized, without manual adjustment by a user, thereby improving control efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0025] Figure 1 The flowchart of the control method of the earphone provided by the embodiments of the present application.

[0026] Figure 2 The structural diagram of an ANC earphone according to an embodiment of the present application.

[0027] Figure 3 The schematic diagram of the calculation principle of the time-domain response parameter in the embodiments of the present application.

[0028] Figure 4 The schematic diagram of obtaining the residual audio signal in the embodiments of the present application.

[0029] Figure 5 The schematic diagram of the comparison of the time-domain signals of the chewing sounds emitted by different users.

[0030] Figure 6 The schematic diagram of the comparison of the spectrums of the chewing sounds emitted by different users.

[0031] Figure 7 The schematic diagram of the adjustment of the feedback noise reduction amount in the control method of the earphone provided by the embodiments of the present application.

[0032] Figure 8 The schematic diagram of the increasing flow of the playing volume of the audio output component in the embodiments of the present application.

[0033] Figure 9 The schematic diagram of one scenario of the chewing sound suppression in the embodiments of the present application.

[0034] Figure 10 The flowchart of the parameter generation method of the earphone provided by the embodiments of the present application.

[0035] Figure 11 The structural diagram of the control device of the earphone provided by the embodiments of the present application.

[0036] Figure 12 The structural diagram of the earphone provided by the embodiments of the present application. DETAILED DESCRIPTION

[0037] With reference to the drawings and embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative effort are within the protection scope of the present application.

[0038] Reference to "embodiments" herein means that the specific features, structures or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears at various places in the specification does not necessarily all refer to the same embodiments, nor is it necessary that every embodiment include the features described in connection with other embodiments. It is explicitly and implicitly understood that the embodiments described herein can be combined with other embodiments.

[0039] The control method of the earphone provided in the embodiments of the present application can be implemented in the form of hardware or software by the control device of the earphone provided in the embodiments of the present application or the earphone integrated with the control device of the earphone.

[0040] Please refer to Figure 1 , Figure 1 A flowchart of the control method of the earphone provided in the embodiments of the present application is shown in FIG. 1. The specific flow of the control method of the earphone provided in the embodiments of the present application can be as follows:

[0041] 101, obtain a residual audio signal.

[0042] The earphone in the embodiments of the present application can be an earphone with a noise reduction function, such as an ANC (Active Noise Cancellation) earphone. It can also be a common earphone without a noise reduction function. As shown in FIG. 2, Figure 2 Figure 2 A structure diagram of an earphone in the embodiments of the present application is shown in FIG. 3, which is an in-ear earphone. In other embodiments, the earphone in the embodiments of the present application can also be a headset. The earphone is provided with an audio acquisition component and an audio output component. The audio output component is used to play a first audio signal, and the audio acquisition component is used to collect the sound in the user's ear. For example, the audio output component is a built-in loudspeaker of the earphone, and the audio acquisition component is a microphone arranged on the side of the earphone close to the ear canal.

[0043] The residual audio signal is an audio signal leaked into the ear from the sound in the external environment, or an audio signal obtained by processing the audio signal collected by the in-ear microphone. For example, the in-ear audio signal is obtained, and the audio signal played by the earphone is eliminated from the in-ear audio signal to obtain the corresponding residual audio signal. ​

[0044] 102. Determine whether the target audio signal exists in the residual audio signal.

[0045] After obtaining the residual audio signal, it is detected whether the target audio signal exists in the residual audio signal. The target audio signal includes at least one of the chewing sound signal, the rubbing sound signal, and the vehicle noise signal.

[0046] For example, in an embodiment, determining whether the target audio signal exists in the residual audio signal includes: extracting the acoustic feature of the residual audio signal; and performing classification detection on the acoustic feature according to an audio recognition model to detect whether the target audio signal exists in the residual audio signal.

[0047] Generally, different types of audio signals have different characteristics. In this embodiment, the target audio signal is identified based on the acoustic feature of the residual audio signal. If the target audio signal exists in the residual audio signal, the acoustic feature will also have acoustic characteristics consistent with the target audio signal. Based on this principle, whether the target audio signal exists in the residual audio signal is detected by a pre-trained audio recognition model, which can be trained using pre-recorded target audio signals. Taking the target audio signal as an example of chewing sound, a plurality of chewing sound signals of different people are pre-collected as positive samples, and ordinary noise signals without chewing sound are collected as negative samples. The corresponding labels are added to the positive samples and the negative samples, and the pre-constructed chewing sound recognition model based on the convolutional neural network is trained using the positive samples and the negative samples to determine the model parameters. The chewing sound recognition model with the determined model parameters is used for online detection of chewing sound signals.

[0048] 103. If the target audio signal exists in the residual audio signal, the target audio signal is suppressed.

[0049] When it is detected according to the above detection method that the target audio signal exists in the residual audio signal, the target audio signal is suppressed. For example, the playback volume of the current first audio signal is increased to mask the target audio signal and avoid the target audio signal from interfering with the user's listening.

[0050] In specific implementation, the present application is not limited by the execution order of the various steps, and certain steps can be performed in other orders or simultaneously without conflict.

[0051] It can be learned from the above that the control method of the earphone provided in the embodiment of the present application acquires a residual audio signal. It is detected whether the target audio signal exists in the residual audio signal, and if so, the target audio signal is subjected to suppression processing. Through the scheme of the embodiment of the present application, active detection and suppression processing of a specific interference signal can be realized, without manual adjustment by the user, thereby improving the control efficiency.

[0052] In an embodiment, the earphone is an active noise reduction earphone. The suppression processing of the target audio signal includes reducing the noise reduction amount of the earphone according to the target amplitude or a first preset proportion, or turning off the noise reduction mode of the earphone.

[0053] In this embodiment, the earphone is an active noise reduction earphone. For the noise reduction earphone provided with the audio acquisition component, the signal acquired by the audio acquisition component can be used for feedback noise reduction. In the process of feedback noise reduction, the chewing sound signal can be amplified. For details, please refer to the description in the foregoing. In this case, when it is detected that the chewing sound signal exists in the in-ear audio signal, the target amplitude or the first preset proportion is determined, and the noise reduction amount of the earphone is reduced according to the target adjustment amount. For example, the first preset proportion can be 50%, and the noise reduction amount of the earphone is reduced to 50% of the current noise reduction amount.

[0054] Alternatively, the feedback noise reduction amount of the earphone can be reduced by adjusting the parameters of the feedback noise reduction filter, so as to prevent the chewing sound from being further amplified after being picked up by the audio acquisition component and played out from the loudspeaker.

[0055] In the following embodiments, the target audio signal is taken as the chewing sound signal for the purpose of facilitating the reader to understand the scheme, and the present application is described in detail.

[0056] In an embodiment, the in-ear end of the earphone is provided with the audio acquisition component and the audio output component. The residual audio signal is acquired by playing the first audio signal through the audio output component and acquiring the in-ear audio signal through the audio acquisition component. The second audio signal in the in-ear audio signal is eliminated to obtain the residual audio signal. The second audio signal is the audio signal of the first audio signal after being transmitted to the audio acquisition component through the audio output component.

[0057] For the noise reduction earphone, a feedforward microphone and / or a feedback microphone are generally provided. The feedforward microphone is arranged on the outside of the earphone and is used to detect the environmental noise outside. The feedforward microphone realizes feedforward noise reduction through a feedforward filter. The feedback microphone is used to detect the noise residual in the ear after the user wears the earphone, and realizes feedback noise reduction through a feedback filter. The built-in loudspeaker of the earphone realizes the purpose of noise reduction by playing an inverted noise signal. The specific noise reduction principle is not described here. The feedback microphone of the present application can directly reuse the in-ear audio signal acquired by the feedback microphone, without the need to add new hardware.

[0058] For ordinary earphones without noise reduction function, an audio acquisition component can be added near the ear canal to acquire the in-ear audio signal. Compared with earphones without noise reduction function, when the user is chewing food while wearing noise reduction earphones to watch videos or listen to music, the impact of chewing sound may be greater. Because the audio acquisition component of the noise reduction earphones acquires the in-ear audio signal as input data for the feedback noise reduction algorithm, if there is chewing sound, the chewing sound will also be acquired by the audio acquisition component and become part of the in-ear audio signal. When the gain of the feedback noise reduction filter is large, the mid-high frequency signal in the amplified chewing sound signal cannot be offset by the noise reduction algorithm and will be played through the audio output component, thereby amplifying the chewing sound.

[0059] The scheme of the embodiments of the present application can be used in any scenario using the earphones, such as a scenario of using the earphones for voice communication, a scenario of wearing the earphones to play music, or a scenario of wearing the earphones to watch videos, etc.

[0060] Next, in order to facilitate the reader's understanding of the present scheme, the earphones are taken as noise reduction earphones, and the scenario of a user wearing the noise reduction earphones to play music is taken as an example to describe the present scheme in detail. For example, the user plays a first audio signal through the earphones, and the first audio signal can be music, etc. The earphones acquire the in-ear sound signal through the audio acquisition component while playing the music through the audio output component.

[0061] Since the audio output component outputs the first audio signal, such as the music signal, at this time, the sound signal in the ear canal acquired by the audio acquisition component contains the music signal (the signal acquired after being played). In order to accurately determine whether there is a chewing sound signal in the in-ear audio signal, the music signal in the in-ear audio signal needs to be eliminated first.

[0062] It should be noted that the first audio signal becomes a second audio signal after passing through the transmission path between the audio output component and the audio acquisition component. The second audio signal is the actual detected music signal of the audio acquisition component. The second audio signal can be calculated based on the first audio signal and the time domain response parameter of the transmission path between the audio output component and the audio acquisition component. The transfer function between the audio output component and the audio acquisition component can be obtained by testing and set in the memory of the earphones before the earphones are shipped.

[0063] After obtaining the first audio signal, the second audio signal is calculated based on the transfer function and the first audio signal, the second audio signal is eliminated from the in-ear audio signal, and the remaining audio signal after elimination is determined as the residual in-ear audio signal.

[0064] When the music signal in the in-ear audio signal is eliminated, the residual audio signal is detected to determine whether the chewing sound signal exists in the residual audio signal. For example, the amplitude of the residual audio signal is detected, and when the amplitude is greater than a preset threshold, it is determined that the chewing sound signal exists in the residual audio signal. For another example, a pre-trained binary classification model is used to detect whether the chewing sound signal exists in the residual audio signal, and the binary classification model can be trained by using a pre-recorded chewing sound signal. For another example, the residual audio signal can be pre-processed by one or more of pre-emphasis, framing, windowing, and FFT (Fast Fourier Transform), and then the spectral energy of the processed signal is calculated to determine whether the spectral energy is greater than a preset energy threshold. If yes, it is determined that the chewing sound signal exists in the residual audio signal. For another example, a feed-forward microphone can be arranged on the earphone, the feed-forward microphone is used to collect external environmental noise, and the residual audio signal is denoised based on the environmental noise. The intensity, spectral energy, or time energy of the denoised residual audio signal is detected to determine whether it is greater than a preset threshold. If yes, it is determined that the chewing sound signal exists in the residual audio signal.

[0065] It can be understood that in addition to the above-mentioned several detection methods, other detection methods based on the residual audio signal can also be used, which are all included in the scheme of the embodiments of the present application. Here, it will not be described one by one.

[0066] When the chewing sound signal exists in the residual audio signal is detected according to the above-mentioned detection methods, the chewing sound is suppressed. The implementation of the suppression of the chewing sound can be various, for example, the playback volume of the audio output component is increased to shield the chewing sound. Or, when the earphone is a noise reduction earphone, the gain of the feedback noise reduction filter of the earphone is reduced to reduce the size of the residual audio signal input to the filter, and then to prevent the chewing sound from being amplified by the audio output component.

[0067] It can be understood that the first audio signal played by the user is real-time changing, and the chewing sound signal is also dynamically changing. Therefore, the scheme of the present application is to continuously collect the in-ear audio signal according to the unit time during the playing process of the first audio signal, and to judge the chewing sound. This process is dynamic until the user terminates the playing of the audio. The specific length of the unit time can be pre-set as needed.

[0068] In addition, if the chewing sound signal does not exist in the residual audio signal, no other processing is needed, and the playing of the first audio signal continues, and the step of playing the first audio signal through the audio output component and collecting the in-ear audio signal through the audio collection component is returned to be executed.

[0069] In some embodiments, the eliminating the second audio signal in the in-ear audio signal to obtain the residual audio signal comprises: obtaining a current time-domain response parameter; generating a first cancellation signal corresponding to the first audio signal according to the time-domain response parameter and the first audio signal; and eliminating the second audio signal in the in-ear audio signal based on the first cancellation signal to obtain the residual audio signal.

[0070] In this embodiment, after the first audio signal and the in-ear audio signal are obtained, the time-domain response parameter w T (n) of the transmission path between the audio output component and the audio collection component is obtained.

[0071] y(n)=w T (n)x(n) Formula (1)

[0072] The time-domain response parameter can be obtained by testing before the earphone is manufactured and stored in the memory of the earphone. Alternatively, the user can actively trigger the calculation of the parameter in a quiet environment, so that the time-domain response parameter calculated is a parameter personalized adapted to the user's ear canal. The calculation principle of the parameter is as follows. In a quiet environment, the input test audio signal x1(n) is played through the audio output component, and the signal collected by the audio collection component is d(n). The above test audio signal x1(n) is taken as the input of the adaptive filter, and the output signal of the filter processing is y1(n).

[0073] The filter processing process is represented as: y1(n)=w T (n)x1(n), w T (n) is the filter coefficient, which represents the time-domain response of the transmission path between the audio output component and the audio collection component. Since there is no external noise in a quiet environment, the signal collected by the audio collection component is the signal after x1(n) is transmitted through the transmission path. The error between the two is as follows:

[0074] e(n)=d(n)-y1(n)=d(n)-w T (n)x1(n) Formula (2)

[0075] The adaptive filter includes N filter coefficients, the initial value of which is 0, and the filter coefficients w T (n) are updated through iterative calculation, so that the error signal e(n) between the output signal y1(n) of the filter after the signal x1(n) is input and the signal d(n) collected by the audio collection component reaches a minimum. Please refer to Figure 3 , Figure 3FIG. 1 is a schematic diagram of a calculation principle of a time-domain response parameter in an embodiment of the present application. Specifically, the least mean square error can be used to iteratively calculate w T (n) and store the calculated w T (n) as the time-domain response parameter of the transfer path between the audio output component and the audio collection component.

[0076] The above process can be performed before the earphone is shipped and the calculated time-domain response parameter can be saved in the memory. Alternatively, the user can set the time-domain response parameter in a quiet environment during the use stage. For example, the user triggers an update instruction of the time-domain response parameter through a preset operation and plays an arbitrary audio signal as a test audio signal. The earphone collects the signal d(n) through the audio collection component and iteratively calculates w T (n) when the error is minimum according to the least mean square error. The w T (n) is stored as the time-domain response parameter corresponding to the current user.

[0077] After the time-domain response parameter w T (n) of the transfer path is obtained, the first cancellation signal is calculated. For example, in an embodiment, a preset filter is set, the time-domain response parameter is updated as the filter coefficients of the preset filter, and then the first audio signal is taken as the input data of the preset filter. The first cancellation signal corresponding to the first audio signal is calculated according to the input data and the filter coefficients. The calculation method is the same as formula (1) and the first audio signal is taken as x(n).

[0078] The scheme of this embodiment adopts an adaptive filtering manner. According to the time-domain response parameter of the transfer path between the audio output component and the audio collection component, a first cancellation signal that can cancel the first audio signal is calculated. The first cancellation signal has the same amplitude as the first audio signal and the opposite phase. The first cancellation signal can eliminate the music signal in the in-ear audio signal collected by the audio collection component. The remaining part is the residual audio signal which can be used for the subsequent detection of the chewing sound signal. Please refer to Figure 4 , Figure 4 FIG. 2 is a schematic diagram of obtaining a residual audio signal in an embodiment of the present application.

[0079] In some embodiments, determining whether the target audio signal exists in the residual audio signal includes calculating the energy value of the residual audio signal in all frequency bands or part of the frequency bands. If the energy value is greater than a first preset threshold, it is determined that the target audio signal exists in the residual audio signal.

[0080] In this embodiment, the target audio signal is still taken as the chewing sound signal as an example, and whether the chewing sound signal exists in the residual audio signal is determined by calculating the spectral energy value of the residual audio signal. The first preset threshold value can be set in advance, for example, the residual audio signal in an environment without chewing sound signal is obtained, and the spectral energy value of the residual audio signal in the environment is calculated, which is taken as the first preset threshold value. It can be understood that the size of noise is different in different environments, and the spectral energy values of the residual audio signals in multiple different environments can be obtained, and the average value of the spectral energy values of the residual audio signals is calculated as the first preset threshold value.

[0081] Alternatively, different first preset threshold values are set for different degrees of environmental noise. For example, when the spectral energy value is greater than the first preset threshold value, the step of determining that the residual audio signal contains the chewing sound signal can include: collecting the environmental noise through the feed-forward microphone, calculating the amplitude of the environmental noise; obtaining a preset threshold value corresponding to the amplitude as the first preset threshold value; and when the spectral energy value is greater than the first preset threshold value, determining that the residual audio signal contains the chewing sound signal.

[0082] The above introduces the way of obtaining the first preset threshold value. After obtaining the residual audio signal, the spectral energy value of the residual audio signal is calculated. In some embodiments, the spectral energy can be calculated after the residual audio signal is pre-emphasized, framed, windowed and FFT processed. The spectral energy is the square of the modulus of each frequency point signal in its frequency domain, and the result of the FFT calculation of the residual audio signal Se is Sef. The spectral energy E sef is calculated in the following way:

[0083] Wherein, j is the total number of frequency point signals, and k∈(1, j).

[0084] After the spectral energy is calculated, it is determined whether the spectral energy is greater than the first preset threshold value Sthd. If yes, it is determined that the residual audio signal contains the chewing sound signal.

[0085] Alternatively, in another embodiment, whether the target audio signal exists in the residual audio signal is determined by: extracting the acoustic feature of the residual audio signal; and classifying and detecting the acoustic feature according to an audio recognition model to detect whether the target audio signal exists in the residual audio signal.

[0086] Generally, the chewing sound emitted by different people chewing different foods is different, and the chewing frequency is also different. As shown in Figure 5 and Figure 6 , and Figure 5 is a comparison diagram of time domain signals of chewing sounds emitted by different users, Figure 6Spectrogram comparison of chewing sounds emitted by different users. It can be seen that there are differences in the time domain signals and spectra of chewing sound signals of different people. Based on this, in this embodiment, a deep learning artificial neural network is used to accurately identify chewing sound signals.

[0087] For example, a convolutional neural network-based audio recognition model is pre-trained, which can be a binary classification model to determine whether there is a chewing sound signal in the residual audio signal. For example, a plurality of chewing sound signals of different people are pre-collected as positive samples, and ordinary noise signals without chewing sound are collected as negative samples. The corresponding labels are added to the positive samples and negative samples, and the pre-constructed convolutional neural network-based audio recognition model is trained using the positive samples and negative samples to determine the model parameters. The audio recognition model with determined model parameters is used for online detection of chewing sound signals.

[0088] In an embodiment, to improve detection accuracy, the step of extracting acoustic features of the residual audio signal can include: endpoint detection of the residual audio signal to remove silent portions in the signal, noise reduction processing of the residual audio signal after removing the silent portions, and extracting features from the noise-reduced residual audio signal to obtain acoustic features. The acoustic features can be MFCC (Mel-Frequency Cepstral Coefficients, Mel-Frequency Cepstral Coefficients).

[0089] After obtaining the acoustic features, the acoustic features are input into the above-mentioned audio recognition model for detection. Since the model is a binary classification model, it can directly determine whether there is a chewing sound signal in the residual audio signal according to the output result. For example, if the output result is "1", it is determined that there is a chewing sound signal in the residual audio signal, and if the output result is "0", it is determined that there is no chewing sound signal in the residual audio signal.

[0090] For example, in another embodiment, the above two methods can be used for double detection of chewing sound signals to improve detection accuracy. Before extracting acoustic features of the residual audio signal, the method further includes: calculating the energy value of the residual audio signal in all frequency bands or part of the frequency bands; and if the energy value is greater than a first preset threshold, extracting acoustic features of the residual audio signal. The specific implementation of each step is described above and will not be repeated here.

[0091] In this embodiment, the residual audio signal is first detected by the spectral energy value, and when there is a large residual noise, the trained convolutional neural network-based audio recognition model is used to determine whether there is a chewing sound, so as to save the amount of calculation and reduce the power consumption of the related chip.

[0092] In some embodiments, if the residual audio signal contains the chewing sound signal, the chewing sound suppression processing is performed, including: if the residual audio signal contains the chewing sound signal, reducing the feedback noise reduction amount of the earphone by adjusting the parameter of the feedback noise reduction filter used for performing feedback noise reduction on the earphone by the in-ear audio signal.

[0093] For the noise reduction earphone provided with the audio acquisition component, feedback noise reduction can be performed by the signal acquired by the audio acquisition component. In the process of feedback noise reduction, the chewing sound signal can be amplified. For details, please refer to the description above. In this case, when it is detected that the in-ear audio signal contains the chewing sound signal, the feedback noise reduction amount of the earphone can be reduced by adjusting the parameter of the feedback noise reduction filter, so as to prevent the chewing sound from being further amplified after being picked up by the audio acquisition component and played out from the loudspeaker. Figure 7 As shown in Figure 7 The adjustment diagram of the feedback noise reduction amount in the control method of the earphone provided by the embodiments of the present application.

[0094] The feedback noise reduction amount of the feedback noise reduction filter is mainly affected by the gain value and the filter coefficient. The greater the gain value, the greater the feedback noise reduction amount. The greater the filter coefficient, the greater the feedback noise reduction amount. Based on this, when it is detected that the in-ear audio signal contains the chewing sound signal, the gain value and / or the filter coefficient of the feedback noise reduction filter can be reduced. In an embodiment, even when it is detected that the in-ear audio signal contains the chewing sound signal, the feedback noise reduction function of the earphone can be directly turned off, so as to prevent the chewing sound from being further amplified after being picked up by the audio acquisition component and played out from the loudspeaker.

[0095] For example, in another embodiment, adjusting the noise reduction amount of the earphone includes: determining the amplitude of the residual audio signal; determining the target adjustment amount corresponding to the amplitude, wherein the amplitude is positively correlated with the target adjustment amount; and adjusting the noise reduction amount of the earphone according to the target adjustment amount.

[0096] In this embodiment, in order to more accurately adjust the feedback noise reduction amount and balance the chewing sound suppression and the feedback noise reduction function, a mapping relationship between different residual audio signal amplitudes and different preset adjustment amounts is set in advance, and the amplitude is positively correlated with the preset adjustment amount. When it is detected that the residual audio signal contains the chewing sound signal, the amplitude of the residual audio signal is determined, and then the preset adjustment amount corresponding to the current amplitude is determined according to the mapping relationship, and the noise reduction amount of the earphone is adjusted according to the target adjustment amount.

[0097] For example, in an embodiment, adjusting the noise reduction amount of the earphone according to the target adjustment amount includes: reducing the parameter of the feedback noise reduction filter according to the target adjustment amount, so as to reduce the noise reduction amount of the earphone, wherein the parameter of the feedback noise reduction filter includes at least one of the filter gain value and the filter coefficient.

[0098] Alternatively, in some embodiments, the suppression processing on the target audio signal comprises: increasing the volume of the first audio signal played by the earphone by a second preset ratio or a preset gain value.

[0099] In addition to the above-mentioned manner of reducing the feedback adjustment amount, this embodiment also provides a manner of masking the chewing sound by increasing the playing volume of the first audio signal.

[0100] In some embodiments, the value of the second preset ratio can be set according to actual needs, such as 30%.

[0101] In some embodiments, if the residual audio signal contains the chewing sound signal, after calculating the time domain energy value of the first audio signal, the method further comprises: when the time domain energy value is greater than or equal to a second preset threshold, obtaining a preset volume reduction factor, and reducing the playing volume of the first audio signal according to the preset volume reduction factor.

[0102] In this embodiment, before adjusting the playing volume of the audio output component, the time domain energy value of the first audio signal is calculated first. When the time domain energy value is less than a second preset threshold, the playing volume is increased. Otherwise, when the time domain energy value is already large, that is, a value greater than the second preset threshold, the chewing sound can be masked even without increasing the volume. Therefore, the volume is not increased to avoid damaging the user's hearing due to too large volume.

[0103] For example, if the long-time energy t(n) of the first audio signal is less than Th0, the volume is increased to improve the signal-to-noise ratio. See the following formula (3) for details:

[0104] t(n) = (1-a) * x(n-1) + a * x(n)

[0105] T(n) = 20*log10(t(n))

[0106] T1(n) = G * T(n)

[0107] z(n) = 10^(T1(n) / 20)

[0108] wherein G is a gain value, a preset value, G > 1; x(n) is the first audio signal of the nth time unit, x(n-1) is the first audio signal of the (n-1)th time unit; a is a smoothing factor, and the value range is (0, 1). Since the audio playing circuit adjusts the volume in a linear adjustment manner, and the gain G is used to amplify the signal, which is to adjust the logarithmic value, therefore, before calculating T1(n), the linear value t(n) is first converted into the logarithmic value T(n), and after T1(n) is calculated, T1(n) is converted from the logarithmic value to the linear value z(n). The specific conversion manner can be referred to the above formula. Z(n) is the target volume to be adjusted finally. Please refer to Figure 8 , Figure 8 FIG. 2 is a schematic diagram of a process of increasing the playing volume of the audio output component in the embodiment of the present application.

[0109] In some embodiments, the preset gain value is obtained by determining the amplitude of the residual audio signal, and determining the candidate gain value corresponding to the amplitude as the preset gain value, wherein the preset gain value is positively correlated with the amplitude.

[0110] In this embodiment, the gain value G can be a value dynamically adjusted according to the amplitude of the current residual audio signal. The mapping relationship between different residual audio signal amplitudes and different candidate gain values is preset, and the amplitude is positively correlated with the candidate gain value. When the chewing sound signal is detected in the residual audio signal, the amplitude of the residual audio signal is determined, and the candidate gain value corresponding to the current amplitude is determined as the preset gain value according to the above mapping relationship, and the playing volume of the audio output component is increased according to the formula (3) in the above text based on the preset gain value. Through the scheme of this embodiment, the playing volume can be reasonably increased according to the residual audio signal amplitude, so as to avoid damage to the user's hearing caused by too large volume.

[0111] In some embodiments, when the chewing sound signal is detected in the residual audio signal, after the time domain energy value of the first audio signal is calculated, the method further includes: when the time domain energy value is less than or equal to a second preset threshold, obtaining a preset volume reduction factor, and reducing the playing volume of the first audio signal according to the preset volume reduction factor.

[0112] In this embodiment, in the case that the chewing sound signal exists in the residual audio signal, if the calculated time domain energy value of the first audio signal, the volume can also be reduced to protect the user's hearing. For example, the part exceeding the second preset threshold can be reduced based on the preset volume reduction factor R according to the following formula.

[0113]

[0114] It can be understood that, since the first audio signal is dynamically changing. Even if the volume of the device does not change, the sound in the process of playing a song is also fluctuating, through the scheme of the embodiment, in the case of detecting chewing sound, if the time domain energy value of the music in the current time unit is small, the music sound heard by the user at this time is also small, the volume can be amplified according to the gain value G to mask the chewing sound; on the contrary, if the time domain energy value of the music in the current time unit is large, the music sound heard by the user at this time is large itself, at this time, in order to protect the user's hearing, the volume can be appropriately reduced. From the entire time span of music playing, the balance between chewing sound suppression and hearing protection is achieved, and the user does not need to manually adjust the earphone volume in the case of listening to music while eating food, reducing user operation and interference, while intelligently adjusting the volume according to the current volume, reducing the listening interference of chewing sound on the user, and preventing the volume from being too large to cause damage to the user's hearing, improving the user experience.

[0115] Among them, in an embodiment, when it is detected that there is chewing sound signal in the residual audio signal, the above two ways can be used at the same time to suppress chewing sound, while reducing the feedback noise reduction amount, increasing the playing volume of the first audio, reducing the listening interference of chewing sound on the user, and improving the user experience.

[0116] Next, a specific application scenario is used to illustrate the scheme. Please refer to Figure 9 , Figure 9 is a scene diagram for chewing sound suppression in the embodiment of the application. The earphone in the scene is a noise reduction earphone provided with a feed-forward microphone and an audio acquisition component, wherein the feed-forward microphone collects environmental sound as the input of the feed-forward filter for feed-forward noise reduction, and the audio acquisition component collects in-ear sound to input the audio acquisition component for feedback noise reduction. The earphone receives the first audio signal sent by the electronic device through a communication module such as Bluetooth. On this basis, the scheme adds a preset filter, and divides the in-ear audio signal collected by the audio acquisition component into two paths, one of which is used for feedback noise reduction, and the other of which is used for detecting chewing sound. The first audio signal is used as the input data of the preset filter, and the preset filter calculates the first cancellation signal corresponding to the first audio signal through the filter coefficient, uses the first cancellation signal to cancel the second audio signal in the in-ear audio signal, obtains the residual audio signal, detects the chewing sound in the residual audio signal, and according to the detection result, when there is chewing sound in the residual audio signal, reduces the feedback noise reduction amount of the feedback filter, to prevent the chewing sound from being further amplified after being picked up by the audio acquisition component and played out from the loudspeaker. In addition, the playing volume of the audio output component is dynamically adjusted according to the detection result to mask the chewing sound in the ear, so that the user can clearly hear the music sound. The specific implementation of the volume adjustment is described in the above embodiment, which is not repeated here.

[0117] Further, the application also provides a parameter generation method of an earphone, please refer to Figure 10 , Figure 10 The flowchart of the parameter generation method of the earphone provided by the application. The method comprises:

[0118] 201, playing a test audio signal through an audio output component, and collecting an in-ear audio signal through an audio collection component;

[0119] 202, obtaining an initial time domain response parameter, and generating a second cancellation signal of the test audio signal according to the initial time domain response parameter and the test audio signal;

[0120] 203, adjusting the initial time domain response parameter according to the error between the second cancellation signal and the in-ear audio signal, until a preset stop condition is met, to obtain a target time domain response parameter of the earphone.

[0121] In the embodiment, the in-ear end of the earphone is provided with the audio collection component and the audio output component. The user can actively trigger the calculation of the time domain response parameter in a quiet scene. The time domain response parameter calculated in this way is a parameter that is personalized adapted to the ear canal of the user. The calculation principle of the parameter is as follows:

[0122] In a quiet environment, the input test audio signal x1(n) is played through the audio output component, and the signal collected through the audio collection component is d(n). The above test audio signal x1(n) is taken as the input of the adaptive filter, and the output signal of the filter processing is y1(n).

[0123] For the adaptive filter, the initial time domain response parameter is set, and the initial value can be a random value, for example, the initial value is 0. According to the initial time domain response parameter and the test audio signal, the second cancellation signal of the test audio signal is generated.

[0124] Among them, the filter processing process is represented as: y1(n) = w T (n)x1(n), w T (n) is the filter coefficient, representing the time domain response of the transmission path between the audio output component and the audio collection component. Since there is no external noise in the quiet environment, the signal collected by the audio collection component is the signal after x1(n) is transmitted through the transmission path. The error between the two is as follows:

[0125] e(n) = d(n) - y1(n) = d(n) - w T (n)x1(n) formula (2)

[0126] Based on the error between the second cancellation signal and the in-ear audio signal, the initial time-domain response parameters are adjusted until a preset stopping condition is met, thereby obtaining the target time-domain response parameters of the headphones.

[0127] For example, an adaptive filter consists of N filter coefficients, initially set to 0, and the filter coefficients w are updated iteratively. T (n), such that after the signal x1(n) is input into the filter, the error signal e(n) between the output signal y1(n) and the signal d(n) acquired by the audio acquisition component satisfies the preset stopping condition.

[0128] For example, as one implementation, adjusting the initial time-domain response parameters based on the error between the second cancellation signal and the in-ear audio signal includes: obtaining the mean square error between the second cancellation signal and the in-ear audio signal; and adjusting the initial time-domain response parameters with the constraint of reducing the mean square error.

[0129] In this embodiment, iterative calculations are performed with the reduction of mean square error as a constraint to obtain w when the preset stopping condition is met. T (n), the calculated w T (n) Stores the time-domain response parameters of the transmission path between the audio output component and the audio acquisition component. The preset stopping condition can be that the number of adjustments to the initial time-domain response parameters reaches a preset number of adjustments; or the mean square error is less than or equal to an error threshold.

[0130] In one embodiment, after obtaining the target time-domain response parameters of the headphones, the method further includes: playing a first audio signal through an audio output component and acquiring an in-ear audio signal through an audio acquisition component; generating a third cancellation signal corresponding to the first audio signal based on the target time-domain response parameters and the first audio signal; eliminating a second audio signal in the in-ear audio signal based on the third cancellation signal to obtain a residual audio signal, wherein the second audio signal is the audio signal after the first audio signal is transmitted to the audio acquisition component through the audio output component.

[0131] In this embodiment, after obtaining the target time domain response parameters, the first audio signal played by the headphones is processed according to the target time domain response parameters to obtain the residual audio signal in the ear.

[0132] After obtaining the target time-domain response parameters, the third cancellation signal is calculated. For example, a preset filter is set, the target time-domain response parameters are updated to the filter coefficients of the preset filter, and then the first audio signal is used as the input data of the preset filter. The third cancellation signal corresponding to the first audio signal is calculated based on the input data and the filter coefficients, and the calculation method is the same as formula (1).

[0133] The scheme of the embodiment adopts an adaptive filtering manner, and a third cancellation signal that can cancel the first audio signal is calculated according to a target time domain response parameter. The third cancellation signal has the same amplitude and opposite phase as the first audio signal. The third cancellation signal can eliminate the second audio signal in the in-ear audio signal collected by the audio collection component. For example, the first audio signal is a music signal, and the second audio signal is the music signal played by the audio output component and then collected by the audio collection component. After the cancellation processing, the remaining part is the residual audio signal.

[0134] By the parameter generation method of the embodiment, a test audio signal is input to the earphone in a quiet environment, and a time domain response parameter that is personalized and adapted to the ear canal of the user is generated, thereby improving the accuracy of the time domain response parameter.

[0135] In an embodiment, a control device of an earphone is also provided. Please refer to Figure 11 , Figure 11 A structural schematic diagram of the control device 300 of the earphone provided in the embodiment of the present application is shown. The control device 300 of the earphone is applied to an earphone, and the earphone includes an audio collection component and an audio output component. The control device 300 of the earphone includes:

[0136] A signal acquisition module 301 is configured to acquire a residual audio signal.

[0137] A target detection module 302 is configured to determine whether a target audio signal exists in the residual audio signal.

[0138] A target suppression module 303 is configured to perform suppression processing on the target audio signal if the target audio signal exists in the residual audio signal.

[0139] It should be noted that the control device of the earphone provided in the embodiments of the present application and the control method of the earphone in the above embodiments belong to the same concept. Any method provided in the control method of the earphone can be implemented by the control device of the earphone. For details, please refer to the control method of the earphone. Here, no further description is given.

[0140] As can be seen from the above, the control device of the earphone provided in the embodiments of the present application acquires a residual audio signal. It is determined whether a target audio signal exists in the residual audio signal. If yes, the target audio signal is suppressed. Through the scheme of the embodiments of the present application, active detection and suppression processing of a specific interference signal can be implemented without manual adjustment by the user, thereby improving the control efficiency.

[0141] The embodiments of the present application also provide an earphone. The earphone can be a smart phone, a tablet computer, or the like. Please refer to Figure 12 , Figure 12A structural schematic diagram of an earphone is provided in the embodiments of the present application. The earphone 400 comprises a front speaker 401 and an audio acquisition component 402, and further comprises a processor 403 and a memory 404. The processor 403 is electrically connected to the memory 404.

[0142] The processor 403 is the control center of the earphone 400, and connects various parts of the earphone through various interfaces and lines. The processor 403 executes various functions of the earphone and processes data by running or calling computer programs stored in the memory 404 and calling data stored in the memory 404, thereby monitoring the earphone as a whole.

[0143] The memory 404 can be used to store computer programs and data. The computer programs stored in the memory 404 contain instructions executable in the processor. The computer programs can constitute various functional modules. The processor 403 executes various functional applications and data processing by calling the computer programs stored in the memory 404.

[0144] In the embodiments, the processor 403 in the earphone 400 loads the instructions corresponding to the processes of one or more computer programs into the memory 404, and runs the computer programs stored in the memory 404 by the processor 403, thereby realizing various functions according to the following steps:

[0145] Obtaining a residual audio signal;

[0146] Determining whether the target audio signal exists in the residual audio signal;

[0147] If the target audio signal exists in the residual audio signal, performing suppression processing on the target audio signal.

[0148] Alternatively, in another embodiment, the processor 403 in the earphone 400 loads the instructions corresponding to the processes of one or more computer programs into the memory 404, and runs the computer programs stored in the memory 404 by the processor 403, thereby realizing various functions according to the following steps:

[0149] Playing a test audio signal through an audio output component, and collecting an in-ear audio signal through an audio acquisition component;

[0150] Obtaining an initial time domain response parameter, and generating a second cancellation signal of the test audio signal according to the initial time domain response parameter and the test audio signal;

[0151] Adjusting the initial time domain response parameter according to the error between the second cancellation signal and the in-ear audio signal until a preset stop condition is met, to obtain a target time domain response parameter of the earphone.

[0152] From the above, the embodiment of the present application provides an earphone, acquires a residual audio signal. It is detected whether the target audio signal exists in the residual audio signal, if yes, the target audio signal is suppressed. Through the scheme of the embodiment of the present application, the active detection and suppression of the specific interference signal can be realized, without manual adjustment of the user, and the control efficiency is improved.

[0153] The embodiment of the present application further provides a computer readable storage medium, and the computer readable storage medium stores a computer program. When the computer program runs on the computer, the computer executes the method of any one of the above embodiments.

[0154] It should be noted that all or part of the steps of the various methods of the above embodiments can be completed by a computer program instructing the related hardware, and the computer program can be stored in a computer readable storage medium, which can include but is not limited to a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0155] In addition, the terms "first" and "second" in the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or modules is not limited to the listed steps or modules, but some embodiments also include steps or modules not listed, or some embodiments also include other steps or modules inherent to the process, method, product or device.

[0156] The control method of the earphone, the parameter generation method, the device, the storage medium and the earphone provided by the embodiments of the present application are described in detail. The principles and implementation modes of the present application are described by applying specific examples in this paper, and the above embodiment is only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed, and the above description should not be understood as the limitation of the present application.

Claims

1. A control method of an earphone, an in-ear end of the earphone being provided with an audio collection component and an audio output component, characterized in that, The method comprises: playing a test audio signal through the audio output component and collecting an in-ear audio signal through the audio collection component to obtain an initial time domain response parameter, and generating a second cancellation signal of the test audio signal according to the initial time domain response parameter and the test audio signal, adjusting the initial time domain response parameter according to the error between the second cancellation signal and the in-ear audio signal until a preset stop condition is met to obtain a target time domain response parameter of the earphone; playing a first audio signal through the audio output component and collecting an in-ear audio signal through the audio collection component, generating a third cancellation signal corresponding to the first audio signal according to the target time domain response parameter and the first audio signal, eliminating a second audio signal in the in-ear audio signal based on the third cancellation signal to obtain a residual audio signal, the second audio signal being an audio signal of the first audio signal after being transmitted to the audio collection component through the audio output component; determining whether the target audio signal exists in the residual audio signal; if the target audio signal exists in the residual audio signal, performing suppression processing on the target audio signal, wherein the noise reduction amount of the earphone is reduced according to a target amplitude or a first preset proportion; or the noise reduction mode of the earphone is closed.

2. The method of claim 1, wherein, The method further comprises: extracting the acoustic feature of the residual audio signal; performing classification detection on the acoustic feature according to an audio recognition model to detect whether the target audio signal exists in the residual audio signal.

3. The method of claim 2, wherein, The method further comprises: calculating the energy value of the residual audio signal in all frequency bands or part of the frequency bands; in the case that the energy value is greater than a first preset threshold, performing the step of extracting the acoustic feature of the residual audio signal.

4. The method according to any one of claims 1 to 3, characterized in that, The target audio signal comprises at least one of a chewing sound signal, a rubbing sound signal, and a vehicle noise signal.

5. The method of claim 1, wherein, The suppression processing on the target audio signal comprises: increasing the volume of the first audio signal played by the earphone according to a preset gain value or a second preset proportion.

6. The method according to any one of claims 1 to 5, characterized in that, The earphone comprises an audio collection component and an audio output component arranged in an ear-in end, and the residual audio signal is obtained by: playing the first audio signal through the audio output component and collecting an in-ear audio signal through the audio collection component; eliminating a second audio signal in the in-ear audio signal to obtain a residual audio signal, the second audio signal being an audio signal of the first audio signal after being transmitted to the audio collection component through the audio output component.

7. The method of claim 6, wherein, The elimination of the second audio signal in the in-ear audio signal to obtain a residual audio signal comprises: obtaining a current time domain response parameter; generating a first cancellation signal corresponding to the first audio signal according to the time domain response parameter and the first audio signal; eliminating a second audio signal in the in-ear audio signal based on the first cancellation signal to obtain a residual audio signal.

8. The method of claim 7, wherein, The generating the first cancellation signal corresponding to the first audio signal according to the time domain response parameter and the first audio signal comprises: taking the time domain response parameter as filter coefficients of a preset filter; taking the first audio signal as input data of the preset filter, and calculating the first cancellation signal corresponding to the first audio signal according to the input data and the filter coefficients.

9. The method of claim 1, wherein, The adjusting the initial time domain response parameter according to the error between the second cancellation signal and the in-ear audio signal comprises: obtaining a mean square error between the second cancellation signal and the in-ear audio signal; adjusting the initial time domain response parameter with the constraint of reducing the mean square error.

10. The method of claim 9, wherein, The preset stop condition comprises: the adjustment times of the initial time domain response parameter reaching a preset adjustment times; or the mean square error being less than or equal to an error threshold.

11. The method of claim 10, wherein, The generating the third cancellation signal corresponding to the first audio signal according to the target time domain response parameter and the first audio signal comprises: taking the target time domain response parameter as filter coefficients of a preset filter; taking the first audio signal as input data of the preset filter, and calculating the third cancellation signal corresponding to the first audio signal according to the input data and the filter coefficients.

12. A control device of an earphone, an in-ear end of the earphone is provided with an audio collection component and an audio output component, characterized in that, The method comprises: a signal acquisition module is configured to: play a test audio signal through the audio output component, collect an in-ear audio signal through the audio collection component, obtain an initial time domain response parameter, generate a second cancellation signal of the test audio signal according to the initial time domain response parameter and the test audio signal, adjust the initial time domain response parameter according to the error between the second cancellation signal and the in-ear audio signal, until a preset stop condition is met, and obtain a target time domain response parameter of the earphone; play a first audio signal through the audio output component, collect an in-ear audio signal through the audio collection component, generate a third cancellation signal corresponding to the first audio signal according to the target time domain response parameter and the first audio signal, eliminate a second audio signal in the in-ear audio signal based on the third cancellation signal, and obtain a residual audio signal, the second audio signal being an audio signal of the first audio signal after being transmitted to the audio collection component through the audio output component; a target detection module is configured to determine whether a target audio signal exists in the residual audio signal; a target suppression module is configured to, if the target audio signal exists in the residual audio signal, reduce a noise reduction amount of the earphone according to a target amplitude or a first preset proportion, or close a noise reduction mode of the earphone.

13. A computer readable storage medium having stored thereon a computer program, characterized in that The computer program, when running on a computer, causes the computer to execute the control method of the earphone according to any one of claims 1 to 11.

14. An earphone, characterized by The earphone comprises an audio collection component, an audio output component, a memory and a processor, the memory stores a computer program, and the processor is configured to execute the control method of the earphone according to any one of claims 1 to 11 by invoking the computer program.

15. A computer program product comprising computer programs or instructions, characterized in that, The computer program or instructions implement the steps of the method according to any one of claims 1-11 when executed by a processor.

Images