Noise elimination method, storage medium and intelligent electric musical instrument

Abstract

The invention discloses a noise elimination method, a storage medium and an intelligent electric musical instrument. The noise elimination method comprises the steps of determining whether an audio output interface has an output audio signal; if yes, determining real-time states of all strings; determining whether the real-time state conditions of all strings meet a preset standard or not; under the condition that the real-time state conditions of all strings meet a preset standard, the audio output interface outputs a noise audio signal; if the real-time state conditions of all the strings meet a preset standard, acquiring an environment acquisition audio, and extracting an environment playing audio based on the environment acquisition audio; determining whether the probability that the output audio signal has a negative impact on the environmental playing audio is large or not; and if the negative influence exists, generating a corrected audio signal and outputting the corrected audio signal to the audio output interface, the corrected audio signal being used for eliminating at least part of the output audio signal. According to the technical scheme, under the condition that the training cost of a player is not increased, the noise caused by slight tremor of strings due to too strong playing sound of the electric musical instrument can be reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of noise reduction of electric musical instruments, and particularly relates to a noise elimination method, a storage medium and an intelligent electric musical instrument. BACKGROUND

[0002] The intelligent electric musical instrument retains the playing method of traditional musical instruments and realizes sound pickup and amplification through internal electronic transformation. The core principle is to place a pickup (for example, a piezoelectric ceramic or electromagnetic pickup) in the traditional resonance box (such as the Erhu tube or guitar body) to convert string vibration into an electrical signal, which is preliminarily processed by a preamplifier and then output through an external speaker or earphone.

[0003] The performer still uses the original string pressing, string plucking and bowing techniques, but the sound propagation path changes from physical resonance to an electronic link of "vibration -> electrical signal -> audio amplification", which maintains the value of muscle memory training and solves the problems of limited volume and environmental noise interference of traditional musical instruments.

[0004] However, the sound played by the current intelligent electric musical instrument is prone to noise, which affects the sound quality of the performance. SUMMARY

[0005] The main purpose of the present application is to provide a noise elimination method, which aims to reduce the noise caused by the slight trembling of the strings due to the over-strong playing sound of the electric musical instrument without increasing the training cost of the performer.

[0006] To achieve the above purpose, the noise elimination method proposed by the present application is applied to an intelligent electric musical instrument, which includes a plurality of strings, an audio output interface and a pickup. The noise elimination method comprises the following steps: determining whether the audio output interface exists an output audio signal; if the signal output exists, determining the real-time state of all strings; determining whether the real-time state of all strings meets a preset standard; wherein, in the case that the real-time state of all strings meets the preset standard, the audio output interface outputs a noise audio signal; if the real-time state of all strings meets the preset standard, acquiring an environment collection audio and extracting an environment performance audio based on the environment collection audio; determining whether the probability that the output audio signal has a negative impact on the environment performance audio is large; if the probability is large, generating a correction audio signal and outputting it to the audio output interface, the correction audio signal being used to eliminate at least part of the output audio signal.

[0007] Optionally, the smart electronic musical instrument further comprises an electronic musical instrument body, the electronic musical instrument body is provided with a contact portion, the contact portion is used for contacting the non-end portion of each string, and the contact portion is provided with a piezoelectric sensor corresponding to each string. The determining of the real-time state of all the strings comprises: acquiring a detection electric signal output by the piezoelectric sensor corresponding to each string; calculating a fluctuation of each detection electric signal; determining the real-time state of the corresponding string according to the fluctuation of the electric signal.

[0008] Optionally, the fluctuation of the electric signal comprises an amplitude fluctuation range and an amplitude change frequency of the electric signal. The determining of the real-time state of the corresponding string according to the fluctuation of the electric signal comprises: determining whether the amplitude fluctuation range of the electric signal is in a preset amplitude range; if not, determining that the string is in a first normal trigger state or a static state; if yes, determining whether the amplitude change frequency is less than a preset frequency threshold; if yes, determining that the string is in a second normal trigger state; if not, determining that the string is in an abnormal trigger state.

[0009] Optionally, the determining of whether the real-time state of all the strings meets a preset standard comprises: determining whether there is a string in the first normal trigger state; if yes, determining that the real-time state of all the strings does not meet the preset standard; if not, determining, according to the strings in the second normal trigger state and the strings in the abnormal trigger state, whether the real-time state of all the strings meets the preset standard.

[0010] Optionally, the determining, according to the strings in the second normal trigger state and the strings in the abnormal trigger state, of whether the real-time state of all the strings meets the preset standard comprises: if there is only a string in the second normal trigger state, determining that the real-time state of all the strings does not meet the preset standard; if there is only a string in the abnormal trigger state, determining that the real-time state of all the strings meets the preset standard.

[0011] If the string in the abnormal triggering state and the string in the second normal triggering state exist simultaneously, it is determined whether the string in the abnormal triggering state has an impact on the string in the second normal triggering state; If the impact exists, it is determined that the real-time state of all the strings meets the preset standard; If the impact does not exist, it is determined that the real-time state of all the strings does not meet the preset standard.

[0012] Optionally, the determination of whether the probability that the output audio signal has a negative impact on the environmental performance audio is large includes: It is determined whether a noise audio component corresponding to the output audio signal exists in the environmental performance audio; If the noise audio component exists, a musical instrument audio component corresponding to a performance musical instrument in the environmental performance audio and the noise audio component corresponding to the output audio signal are separated; According to the amplitude of each musical instrument audio component and the amplitude of the noise audio component, it is determined whether the probability that the output audio signal has a negative impact on the environmental performance audio is large.

[0013] Optionally, the determination of whether the probability that the output audio signal has a negative impact on the environmental performance audio is large according to the amplitude of each musical instrument audio component and the amplitude of the noise audio component includes: The musical instrument audio component with the smallest amplitude in all the musical instrument audio components is determined, and a difference value is calculated by subtracting the amplitude of the noise audio component from the amplitude of the musical instrument audio component to obtain an amplitude difference value; It is determined whether the amplitude difference value is less than a first preset threshold value; If the amplitude difference value is less than the first preset threshold value, it is determined that the probability that the output audio signal has a negative impact on the environmental performance audio is large; If the amplitude difference value is not less than the first preset threshold value, it is determined that the probability that the output audio signal has a negative impact on the environmental performance audio is not large.

[0014] Optionally, the generation of the correction audio signal includes: An initial audio signal is generated according to the amplitude and the phase of the separated noise audio component, the phase of the initial audio signal is opposite to the phase of the noise audio component, and the amplitude of the initial audio signal is the same as the amplitude of the noise audio component; It is determined whether the amplitude of the initial audio signal is less than the amplitude of the output audio signal; If the amplitude of the initial audio signal is less than the amplitude of the output audio signal, the amplitude of the initial audio signal is adjusted to the amplitude of the output audio signal, and the adjusted initial audio signal is taken as the correction audio signal; If the amplitude of the initial audio signal is not less than the amplitude of the output audio signal, the initial audio signal is taken as the correction audio signal.

[0015] The application further provides an intelligent electronic musical instrument, which includes: a memory; a processor; and a noise elimination program stored on the memory and executed by the processor, the noise elimination program, when executed by the processor, implements the noise elimination method as described above.

[0016] The present application also provides a storage medium for executing the steps of the noise elimination method as described above.

[0017] The technical scheme of the present application determines whether the audio output interface exists an output audio signal; if the signal output exists, the real-time state of all the strings is determined; it is determined whether the real-time state of all the strings meets the preset standard; wherein, in the case that the real-time state of all the strings meets the preset standard, the audio output interface outputs the noise audio signal; if the real-time state of all the strings meets the preset standard, the environmental collection audio is acquired through the environmental pickup, and the environmental performance audio is extracted based on the environmental collection audio; it is determined whether the probability that the output audio signal has a negative impact on the environmental performance audio is large; if the probability is large, the correction audio signal is generated and output to the audio output interface, and the correction audio signal is used to eliminate at least part of the output audio signal.

[0018] The present application reduces at least part of the output audio signal or eliminates all the output audio signal, so that the noise sound component corresponding to the noise audio signal (i.e. the output audio signal) in the environmental performance audio can also be reduced or eliminated synchronously, thereby reducing the noise caused by the string micro-vibration due to the over-strong performance sound of the electric musical instrument without increasing the training cost of the performer. In addition, compared with the scheme of turning off the audio output in the prior art, since there is no "turn-off-recovery" process of the audio output, the performance effect of the intelligent electric musical instrument can be better ensured. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from the structures shown in the drawings without creative labor.

[0020] Figure 1 Structure diagram of an embodiment of the noise elimination method of the present application; Figure 2 Structure diagram of another embodiment of the noise elimination method of the present application; Figure 3 Structure diagram of still another embodiment of the noise elimination method of the present application; Figure 4The figure is a structural schematic diagram of an embodiment of the intelligent electronic musical instrument.

[0021] Brief Description of the Drawings

[0022] The implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0023] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0024] In addition, the description such as "first", "second" and the like in the present application is only for the purpose of description, and cannot be understood as indicating or implying the relative importance of the indicated technical features or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In addition, the technical solutions of various embodiments can be combined with each other, but it must be based on the fact that a person of ordinary skill in the art can realize it. When the combination of technical solutions contradicts each other or cannot be realized, it should be considered that the combination of technical solutions does not exist and is not within the protection scope required by the present application.

[0025] Currently, the electric musical instrument realizes its playing function by placing a pickup (referred to as a playing pickup) in a resonance box to pick up the sound generated by the vibration of the strings, and in order to ensure the pickup effect, a high-sensitivity pickup is usually used. Therefore, in a large multi-player playing scene, once the external environment sound is strong (for example, the overall playing sound is large or the electric musical instrument is close to the sound box) and the electric musical instrument has no playing task, due to the strong energy of the external environment sound, it is very easy to cause the strings to vibrate slightly and trigger the playing pickup to produce noise. The current traditional technology usually increases a mute pedal specially used to control the audio output of the electric musical instrument. The mute pedal is stepped down to cut off the audio output of the electric musical instrument, and the audio output of the electric musical instrument is restored by canceling the stepping down. Although the above noise problem can be solved well, the increase of the mute pedal undoubtedly increases the pre-training cost of the player. Therefore, how to reduce the noise of the electric musical instrument caused by the slight vibration of the strings due to the too strong playing sound without increasing the training cost of the player is a technical problem to be solved by the person skilled in the art.

[0026] In view of the above problems, with reference to Figure 1The application provides a noise elimination method applied to an intelligent electronic musical instrument, the intelligent electronic musical instrument comprising a plurality of strings, an audio output interface and an ambient sound pickup device, and the noise elimination method comprising the following steps: Step S100, determining whether the audio output interface outputs an audio signal; In this embodiment, the audio output interface is usually connected with an external sound box, and is used for transmitting the output audio signal to the external sound box for loudspeaker playback. Whether the audio output interface outputs the audio signal can be determined by detecting whether the audio output interface outputs a voltage, specifically: if the audio output interface outputs the voltage, it is determined that the audio output interface outputs the audio signal; if the audio output interface does not output the voltage, it is determined that the audio output interface does not output the audio signal.

[0027] It can be understood that the output audio signal also represents different audio signals at different stages. For example, when the electronic musical instrument is normally played, the output audio signal corresponds to the playing audio signal of the electronic musical instrument when it is normally played, and when the overall playing sound is large or the electronic musical instrument is close to the playing sound box, and the electronic musical instrument has no playing task, the output audio signal is a noisy audio signal.

[0028] Step S200, if the signal output exists, determining the real-time state of all the strings; In this embodiment, the real-time state of the string includes a working state and a static state, wherein the working state includes a normal trigger state and an abnormal trigger state. The normal trigger state is a state in which the string is triggered by a normal player, and the abnormal trigger state is a state in which the string is triggered by a strong external environmental sound.

[0029] Since the normal trigger state of the string is triggered by the player, it usually has the characteristics of stable vibration and regularity, and the string in the abnormal trigger state usually has the characteristics of chaotic vibration and irregularity because the energy of the external environmental sound is unstable. Based on the vibration characteristics of the strings in the above two trigger states, the vibration-related parameters of each string can be detected, and then it is determined whether the detected vibration-related parameters match the vibration characteristics of the string in the abnormal trigger state. If the match is matched, it is determined that the string is in the abnormal trigger state, and if the match is not matched, it is determined that the string is not in the abnormal trigger state.

[0030] Step S300, determining whether the real-time state of all the strings meets a preset standard; If the number of strings in the normal trigger state is large, the performance pickup collects the performance audio signal instead of the noise audio signal. If the number of strings in the normal trigger state and the number of strings in the static state are small, and the number of strings in the abnormal trigger state is large, the performance pickup collects the noise audio signal. In this embodiment, the preset standard corresponds to the case, that is, the audio output interface outputs the noise audio signal when the real-time state of all the strings meets the preset standard.

[0031] In this embodiment, the real-time state of all the strings can be determined by comparing the number of strings in the normal trigger state, the number of strings in the abnormal trigger state, and the number of strings in the static state. The noise audio signal output by the smart electronic musical instrument can be ensured through step S300.

[0032] Step S400, if the real-time state of all the strings meets the preset standard, the environment pickup is used to obtain the environment collected audio, and the environment performance audio is extracted based on the environment collected audio.

[0033] The smart electronic musical instrument can also be provided with a pickup (i.e. an environment pickup) specially used for collecting environmental sound. The environment pickup can collect the sound signal in the environment of the smart electronic musical instrument to obtain the environment collected audio, and the environment performance audio corresponding to the overall performance sound in the environment can be obtained by filtering the environmental noise through corresponding processing (e.g. filtering processing) of the environment collected audio.

[0034] Step S500, determine whether the probability that the output audio signal has a negative impact on the environment performance audio is large. It should be noted that the noise audio component corresponding to the noise audio signal will remain in the extracted environment performance audio and will not be filtered out at the same time by the filtering of the environmental noise. Therefore, the correlation between the noise audio component and the environment performance audio can be determined to determine whether the probability that the output audio signal has a negative impact on the environment performance audio is large. For example, when it is determined that the noise audio component is obviously high in the environment performance audio, it is determined that the output audio signal has a negative impact.

[0035] Step S500, if the probability is large, a correction audio signal is generated and output to the audio output interface, and the correction audio signal is used to eliminate at least part of the output audio signal.

[0036] If the correlation between the noise sound component and the environmental performance audio meets the corresponding condition, it can be considered that the probability of negative influence is relatively large, at this time, a correction audio signal with the same amplitude as the output audio signal and opposite phase to the output audio signal can be generated to reduce at least part of the output audio signal or eliminate all the output audio signal, so that the noise sound component corresponding to the noise audio signal (that is, the output audio signal) in the environmental performance audio can also be reduced or eliminated synchronously, thereby reducing the noise caused by the string micro-vibration of the electronic musical instrument due to the too strong performance sound without increasing the training cost of the performer.

[0037] In addition, there is also a technical solution in the prior art that identifies the performance behavior of the performer to automatically turn off the audio output of the intelligent electronic musical instrument when the performer does not perform, but this solution has high hysteresis and cannot well identify the first few performance actions after the performer suddenly resumes performance, so that the performance effect of the intelligent electronic musical instrument is poor. Based on this, the present application eliminates the output audio signal by generating a correction audio signal, which is better than the solution of turning off the audio output in the prior art, because there is no “turn off-recovery” process of the audio output, so the performance effect of the intelligent electronic musical instrument can be better ensured.

[0038] Reference Figure 2 The intelligent electronic musical instrument further comprises an electronic musical instrument body, and the electronic musical instrument body is provided with a contact portion for contacting the non-end portion of each string, and the contact portion is provided with a piezoelectric sensor corresponding to each string. In step S200, the real-time state of all strings is determined, including: In step S210, a detection electric signal output by the piezoelectric sensor corresponding to each string is acquired. In step S220, the fluctuation of each detection electric signal is calculated. In step S230, the real-time state of the corresponding string is determined according to the fluctuation of the electric signal.

[0039] In the embodiment, the contact portion can be a portion in contact with the middle portion of the string, rather than a fixed portion at both ends of the string. In common electronic musical instruments, the contact portion can be a bridge (also known as a saddle), and of course, with the difference of types of electronic musical instruments, the contact portion can also be other structures in some other electronic musical instruments, for example, in an electric guitar, the contact portion can be a Y-shaped pivot arm structure.

[0040] Since the string is always in close contact with the contact portion, the string in different states will make the detection electric signal output by the corresponding piezoelectric sensor present different fluctuation conditions. For example, the detection electric signal corresponding to the string in the static state presents the characteristics of stable and unchanged value (i.e. no fluctuation), the detection electric signal corresponding to the string in the normal trigger state presents the characteristics of stable change in value (i.e. stable fluctuation), and the detection electric signal corresponding to the string in the abnormal trigger state presents the characteristics of unstable and irregular change in value (i.e. unstable fluctuation). Therefore, the real-time state of the corresponding string can be determined by calculating the value fluctuation condition of each detection electric signal.

[0041] The piezoelectric sensor is arranged on the contact portion, which does not affect the playing effect due to the addition of the abutting part of the string, and compared with the detection scheme of arranging the piezoelectric sensor on other parts (such as the fixed part at both ends of the string), the fluctuation amplitude of the string at the contact portion is relatively large, which can make the detection electric signal more accurately represent the real-time state of the string, thereby improving the judgment accuracy of the real-time state of the string.

[0042] Optionally, the fluctuation condition of the electric signal includes an amplitude fluctuation interval and an amplitude change frequency of the electric signal. In step S210, the real-time state of the corresponding string is determined according to the fluctuation condition of the electric signal, including: In step S211, it is determined whether the amplitude fluctuation interval of the electric signal is in a preset amplitude interval. In step S212, if the amplitude fluctuation interval is not in the preset amplitude interval, it is determined that the string is in the first normal trigger state or the static state. In step S213, if the amplitude fluctuation interval is in the preset amplitude interval, it is determined whether the amplitude change frequency is less than a preset frequency threshold. In step S214, if the amplitude change frequency is less than the preset frequency threshold, it is determined that the string is in the second normal trigger state. In step S215, if the amplitude change frequency is not less than the preset frequency threshold, it is determined that the string is in the abnormal trigger state.

[0043] In this embodiment, the electric signal output by the piezoelectric sensor can be continuously obtained within a preset sampling time, the amplitude of the electric signal can be obtained after the electric signal is recognized after analog-to-digital conversion, the maximum amplitude and the minimum amplitude obtained within the preset sampling time are taken as the amplitude fluctuation interval of the electric signal. The amplitude change frequency can be obtained by calculating the number of times of change of the amplitude of the electric signal per unit time. The preset amplitude interval is an interval with a small amplitude obtained by a large number of pre-experiments and tests, the preset amplitude interval corresponds to the amplitude interval range of the piezoelectric sensor electric signal in the abnormal trigger state of the string, and the minimum amplitude in the preset amplitude interval is greater than 0.

[0044] If the amplitude fluctuation interval of the electric signal does not exceed the preset amplitude interval, it can be determined that the corresponding string is in a static state; if the amplitude fluctuation interval of the electric signal has an interval part exceeding the preset amplitude interval, it can be determined that the corresponding string is in a first normal trigger state. In other words, the first normal trigger state means that the string is normally played or has a larger sound after being triggered by the player. It should be noted that due to the particularity of some music pieces, special playing techniques can also make the amplitude fluctuation interval of the electric signal not exceed the preset amplitude interval. Therefore, if only the amplitude fluctuation interval of the electric signal and the preset amplitude interval are judged, there may be a case of misjudging the normal trigger state as an abnormal trigger state. In view of this phenomenon, the present application sets steps S213 to S215 to determine the trigger state of the string by further judging whether the amplitude frequency change rate of the electric signal is less than a preset frequency threshold. The preset frequency threshold corresponds to a higher change frequency. If the amplitude frequency change rate of the electric signal is less than the preset frequency threshold, it means that the string is in a second normal trigger state, that is, the string has a smaller sound after being triggered by the player; if the amplitude frequency change rate of the electric signal is not less than (greater than or equal to) the preset frequency threshold, it means that the string is in an abnormal trigger state, that is, the string is triggered by the energy of the external environment sound.

[0045] Further, step S300, determining whether the real-time state of all strings meets the preset standard, comprises: Step S310, determining whether there is a string in the first normal trigger state; Step S320, if there is a string in the first normal trigger state, determining that the real-time state of all strings does not meet the preset standard; Step S330, if there is no string in the first normal trigger state, determining whether the real-time state of all strings meets the preset standard according to the strings in the second normal trigger state and the strings in the abnormal trigger state.

[0046] In steps S310 to S320, due to the principle of sound masking, the sound of the string in the first normal trigger state or the second normal trigger state will be much larger than the sound of the string in the abnormal trigger state, so that the sound of the string in the abnormal trigger state will not be picked up by the playing pickup, so the intelligent electric musical instrument is in a state of normally playing the playing sound of the string. Therefore, the present application preferentially judges whether there is a string in the first normal trigger state, and only when it is determined that there is no string in the first normal trigger state, it will further judge whether the preset standard is met, so as to improve the judgment efficiency.

[0047] In step S330, the strings can be in the second normal triggering state, the rest state or the abnormal triggering state. The playing sound of the string in the second normal triggering state is the sound expected to be picked up by the playing pickup. The string in the rest state does not have a negative impact on the pickup of the playing pickup. Only the string in the abnormal triggering state has a negative impact on the pickup of the playing pickup. That is, in step S330, there are three cases in which all the strings can be in the second normal triggering state. The first case is that only the string in the second normal triggering state exists. The second case is that only the string in the abnormal triggering state exists. The third case is that the string in the second normal triggering state and the string in the abnormal triggering state exist simultaneously. Based on this, step S330 in the present application includes: In step S331, if only the string in the second normal triggering state exists, it is determined that the real-time state of all the strings does not meet the preset standard. In step S332, if only the string in the abnormal triggering state exists, it is determined that the real-time state of all the strings meets the preset standard. In step S333, if the string in the second normal triggering state and the string in the abnormal triggering state exist, it is determined whether the string in the abnormal triggering state has an impact on the string in the second normal triggering state. In step S334, if the impact exists, it is determined that the real-time state of all the strings meets the preset standard. In step S335, if the impact does not exist, it is determined that the real-time state of all the strings does not meet the preset standard.

[0048] In step S331, it is indicated that the string in the abnormal triggering state does not exist in this case, and the playing pickup can collect the playing sound of the string in the second normal triggering state. In step S332, it is indicated that the string in the second normal triggering state does not exist in this case, and the playing pickup can only collect the playing sound of the string in the abnormal triggering state at this time, that is, it is indicated that the audio signal needs to be corrected to eliminate the output audio signal. In steps S333 to S334, since the strings in two states (the second normal triggering state and the abnormal triggering state) exist simultaneously, it is further determined whether the noise generated by the string in the abnormal triggering state has a significant impact on the playing sound generated by the string in the second normal triggering state.

[0049] In this embodiment, step S333 specifically includes: determining the number of strings in the abnormal triggering state and recording it as the first string number, determining the number of strings in the second normal triggering state and recording it as the second string number, and determining whether the difference between the first string number and the second string number is greater than the second preset threshold. If the determination result is greater than or equal to the second preset threshold, it means that the number of strings in the abnormal triggering state is large, and it can be determined that the performance sound of the string in the second normal triggering state is affected, and step S334 is performed. If the determination result is less than the second preset threshold, it means that the number of strings in the abnormal triggering state is small, and it can be determined that the performance sound of the string in the second normal triggering state is not affected, and step S335 is performed.

[0050] With reference to Figure 3 Step S500 includes: determining whether the probability that the output audio signal has a negative impact on the environmental performance audio is large, including: Step S510 includes: determining whether there is a noise audio component corresponding to the output audio signal in the environmental performance audio. Step S520 includes: if there is, separating the instrument audio component corresponding to the performance instrument in the environmental performance audio and the noise audio component corresponding to the output audio signal. Step S530 includes: according to the amplitude of each instrument audio component and the amplitude of the noise audio component, determining whether the probability that the output audio signal has a negative impact on the environmental performance audio is large.

[0051] In this embodiment, the output audio signal and the environmental performance audio signal can be compared to determine whether there is a corresponding audio component, and if the determination result is that there is, the audio component corresponding to the output audio signal can be separated from the environmental performance audio first, and then the remaining part of the environmental performance audio is input into the well-trained neural network model (such as the MSST model) as input to separate the instrument audio components corresponding to each instrument currently participating in the performance. In other embodiments, the neural performance audio can also be directly input into the neural network model to simultaneously implement S510 and S520.

[0052] Since the current environment is a collective performance environment of multiple musical instruments, the performance sound of each musical instrument directly determines the overall performance effect, and the distance between the current smart electronic musical instrument and the audience cannot be controlled (some types of smart electronic musical instruments will move with the movement of the performer), therefore, in order to avoid the noise generated by the smart electronic musical instrument affecting the audio component of the small amplitude musical instrument, and further affecting the overall performance effect (for example, causing the audio component of the small amplitude musical instrument to be less obvious, and even distorted). Based on this, the present application is provided with step S530 to determine whether the noise audio component may affect other musical instrument audio components according to the amplitude of each musical instrument audio component and the amplitude of the noise audio component, and further to determine whether there is a negative impact on the environmental performance audio.

[0053] Further, step S530 determines whether the probability of the output audio signal having a negative impact on the environmental performance audio is large according to the amplitude of each musical instrument audio component and the amplitude of the noise audio component, including: Step S531, determine the musical instrument audio component with the smallest amplitude in all musical instrument audio components, and calculate the amplitude difference by difference with the amplitude of the noise audio component; Step S532, determine whether the amplitude difference is less than a first preset threshold; Step S533, if less than the first preset threshold, determine that the probability of the output audio signal having a negative impact on the environmental performance audio is large; Step S534, if not less than the first preset threshold, determine that the probability of the output audio signal having a negative impact on the environmental performance audio is not large.

[0054] In this embodiment, the amplitude minimum musical instrument audio component can be determined by comparing the amplitudes of all musical instrument audio components two by two. The difference value is calculated by subtracting the amplitude of the noise audio component from the amplitude of the amplitude minimum musical instrument audio component. The first preset threshold is a number greater than zero, and its specific value can be determined according to a large number of pre-experiments, which is not limited here. In the case where the amplitude difference is less than the first preset threshold, for example, the amplitude difference is negative or a positive value less than the first preset threshold, it indicates that the amplitude of the amplitude minimum musical instrument audio component is much smaller than that of the noise audio component. If the smart electronic musical instrument is close to the musical instrument corresponding to the amplitude minimum musical instrument audio component at this time, the amplitude minimum musical instrument audio component will be affected and thus the overall performance will be affected, so it can be determined that the output audio signal has a greater probability of having a negative impact on the environmental performance audio. In the case where the amplitude difference is not less than (greater than or equal to) the first preset threshold, it indicates that the amplitude of the amplitude minimum musical instrument audio component is much greater than that of the noise audio component. If the smart electronic musical instrument is close to the musical instrument corresponding to the amplitude minimum musical instrument audio component at this time, the amplitude minimum musical instrument audio component will not be affected, that is, the overall performance will not be affected, so it can be determined that the output audio signal has a smaller probability of having a negative impact on the environmental performance audio. The present application selects the amplitude minimum musical instrument audio component as the judgment standard, avoids the excessive number of comparisons caused by comparing each musical instrument audio component with the noise audio component separately, and can improve the judgment efficiency while ensuring the accuracy of steps S533 and S534.

[0055] Further, the correction audio signal is generated in step S500, comprising: generating an initial audio signal according to the amplitude and phase of the separated noise audio component, the phase of the initial audio signal being opposite to the phase of the noise audio component, and the amplitude of the initial audio signal being the same as the amplitude of the noise audio component; judging whether the amplitude of the initial audio signal is less than the amplitude of the output audio signal; if yes, adjusting the amplitude of the initial audio signal to the amplitude of the output audio signal, and taking the adjusted initial audio signal as the correction audio signal; if no, taking the initial audio signal as the correction audio signal.

[0056] In the embodiment, since the audio environment in a large performance site is usually complex, the noise generated by the smart electronic musical instrument is mostly from the string vibration of the smart electronic musical instrument, but there is also a part of the component from the environmental audio, which is directly coupled to the audio output of the smart electronic musical instrument. That is, in addition to the output audio signal caused by the string vibration, there is also a part of the environmental noise audio directly coupled to the audio output interface. It is found through actual measurement that if a signal with the same amplitude and opposite phase as the output audio signal is directly generated as a correction audio signal, it can only have a good elimination effect on the output audio signal, but it cannot have an effect on the coupled environmental noise audio. In view of this, the application uses the separated noise audio component as the generation source of the audio correction signal, and adjusts the amplitude based on the output audio signal amplitude. If there is environmental noise audio, the noise audio component will also have a corresponding signal component, so that the finally generated correction audio signal can have a good elimination effect on the output audio signal and the environmental noise audio, which is beneficial to improve the audio performance effect of the smart electronic musical instrument in the case of not being normally triggered.

[0057] The application further provides a smart electronic musical instrument. Figure 4 The smart electronic musical instrument comprises: a memory 11; and a processor 12, a noise elimination program stored on the memory 11 and executed by the processor 12, wherein the noise elimination program, when executed by the processor 12, implements the noise elimination method as described above.

[0058] The specific steps of the noise elimination method are referred to the above embodiments. Since the smart electronic musical instrument adopts all the technical solutions of the above embodiments, it at least has all the beneficial effects brought by the technical solutions of the above embodiments, which will not be repeated here. The memory 11 can be a high-speed RAM memory, or a stable memory (non-volatile memory) such as a disk memory. The memory 11 can also be a storage device independent of the aforementioned smart electronic musical instrument. The processor 12 can be a CPU. The memory 11 and the processor 12 are connected through a communication bus 13, which can be a UART bus or an I2C bus.

[0059] The application further provides a storage medium for executing the above noise elimination method. The specific structure of the noise elimination method is referred to the above embodiments. Since the storage medium can implement all the technical solutions of the above embodiments, it at least has all the beneficial effects brought by the technical solutions of the above embodiments, which will not be repeated here.

[0060] The above merely describes optional embodiments of the present application, and does not limit the patent scope of the present application, and any equivalent structural transformation made under the inventive concept of the present application, or direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. A noise elimination method, characterized in that: Applied to an intelligent electric musical instrument, the intelligent electric musical instrument includes multiple strings, an audio output interface, and an ambient sound pickup, and the noise elimination method includes: Determine whether the audio output interface has an output audio signal; If there is a signal output, the real-time status of all strings is determined; Determining whether the real-time status of all strings meets a preset standard; wherein, if the real-time status of all strings meets the preset standard, the audio output interface outputs a noise audio signal; If the real-time status of all strings meets the preset standard, the ambient audio is obtained through the ambient pickup, and the ambient performance audio is extracted based on the ambient audio. determining whether the output audio signal has a high probability of negatively impacting the ambient performance audio; If the probability is greater, a correction audio signal is generated and output to the audio output interface, where the correction audio signal is used to eliminate at least part of the output audio signal.

2. A noise elimination method according to claim 1, characterized in that: The intelligent electric musical instrument further comprises an electric musical instrument body, the electric musical instrument body is provided with a contact portion, the contact portion is used to contact the non-end portion of each string, and the contact portion is provided with a piezoelectric sensor corresponding to each string; Determining the real-time status of all strings includes: Obtaining a detection electrical signal output by a piezoelectric sensor corresponding to each string; Calculate the fluctuation of each detected electrical signal; According to the fluctuation of the electrical signal, the real-time status of the corresponding string is determined.

3. A noise elimination method according to claim 2, characterized in that: The fluctuation of the electrical signal includes the amplitude fluctuation range and amplitude change frequency of the electrical signal; According to the fluctuation of the electrical signal, the real-time status of the corresponding string is determined, including: Determining whether the amplitude fluctuation range of the electrical signal is within a preset amplitude range; If the amplitude is not within the preset value, it is determined that the string is in the first normal triggering state or the static state; If it is within the preset amplitude range, determine whether the amplitude change frequency is less than the preset frequency threshold; If it is less than the preset frequency threshold, it is determined that the string is in the second normal triggering state; If it is not less than the preset frequency threshold, it is determined that the string is in an abnormal triggering state.

4. A noise elimination method according to claim 3, characterized in that: Determine whether the real-time status of all strings meets the preset standards, including: determining whether there is a string in a first normal triggering state; If there is a string in the first normal trigger state, determining that the real-time status of all strings does not meet the preset standard; If no string is in the first normal trigger state, it is determined whether the real-time status of all strings meets a preset standard based on the existing strings in the second normal trigger state and the strings in the abnormal trigger state.

5. A noise elimination method according to claim 4, characterized in that: Determining whether the real-time status of all strings meets a preset standard based on the strings in the second normal trigger state and the strings in the abnormal trigger state includes: If there is only a string in the second normal trigger state, determining that the real-time status of all strings does not meet the preset standard; If there is only a string in an abnormal trigger state, it is determined that the real-time status of all strings meets the preset standard. If there are strings in the second normal trigger state and strings in the abnormal trigger state at the same time, determining whether the strings in the abnormal trigger state affect the strings in the second normal trigger state; If an impact is caused, it is determined that the real-time status of all strings meets the preset standard; If no impact is caused, it is determined that the real-time status of all strings does not meet the preset standard.

6. A noise elimination method according to claim 1, characterized in that: Determine whether the output audio signal is likely to negatively impact the ambient performance audio, including: determining whether there is a noise audio component corresponding to the output audio signal in the ambient performance audio; If so, separating the instrument audio component corresponding to the instrument in the ambient performance audio and the noise audio component corresponding to the output audio signal; According to the amplitudes of the respective instrument audio components and the amplitudes of the noise audio components, it is determined whether the probability that the output audio signal has a negative impact on the ambient performance audio is relatively high.

7. A noise elimination method according to claim 6, characterized in that: Determining whether the probability of the output audio signal negatively impacting the ambient performance audio is high based on the amplitudes of the respective instrument audio components and the noise audio component, including: Determine the instrument audio component with the smallest amplitude among all instrument audio components, and perform a difference calculation between the amplitude of the instrument audio component and the noise audio component to obtain an amplitude difference; Determining whether the amplitude difference is less than a first preset threshold; If the value is less than the first preset threshold, it is determined that the output audio signal has a high probability of negatively impacting the ambient performance audio; If it is not less than the first preset threshold, it is determined that the probability that the output audio signal has a negative impact on the ambient performance audio is not high.

8. A noise elimination method according to claim 7, characterized in that: Generate a corrected audio signal, including: generating an initial audio signal according to the amplitude and phase of the separated noise audio component, wherein the phase of the initial audio signal is opposite to the phase of the noise audio component, and the amplitude of the initial audio signal is the same as the amplitude of the noise audio component; Determining whether the amplitude of the initial audio signal is less than the amplitude of the output audio signal; If it is less than, adjusting the amplitude of the initial audio signal to the amplitude of the output audio signal, and using the adjusted initial audio signal as the corrected audio signal; If it is not less than, the initial audio signal is used as the corrected audio signal.

9. An intelligent electric musical instrument, characterized in that: include: Memory; processor; as well as, A noise cancellation program stored in the memory and executed by the processor, wherein when the noise cancellation program is executed by the processor, the noise cancellation method according to any one of claims 1 to 8 is implemented.

10. A storage medium, characterized in that: Used to perform the steps of the noise elimination method according to any one of claims 1 to 8.

Images