Audio playback device, audio playback method, and storage medium
By acquiring the audio resonance table of the audio playback device and dynamically adjusting the audio gain, the resonance noise problem of the laptop during playback was solved, improving audio quality and user experience.
Patent Information
- Application Number
- CN202211057463.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-31
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2042-08-31
AI Technical Summary
Laptops often produce a buzzing noise when playing music or videos through their speakers, which affects the user experience. Existing methods such as using silicone pads or adjusting the equalizer are insufficient.
By acquiring the audio resonance table of the audio playback device, key frequency points and gains are determined, audio processing is performed to suppress the gain of harmonic signals, a comprehensive signal gain table is generated, and fundamental and harmonic signals are recorded and analyzed using a microphone sensor to dynamically adjust the audio gain to eliminate resonance.
It effectively reduces resonance noise, improves audio playback quality, enhances the user's listening experience, and increases production yield and bass effect.
Smart Images

Figure CN115437599B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to, but is not limited to, the field of audio technology, and in particular to an audio playback device, an audio playback method thereon, and a storage medium. Background Technology
[0002] Laptops, with their portability and powerful processing capabilities, have become essential everyday office tools. However, when using laptops to play music or videos through their speakers, they often produce a buzzing or crackling noise, which negatively impacts the user experience. Summary of the Invention
[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.
[0004] This disclosure provides an audio playback method for an audio playback device, including:
[0005] Obtain the audio resonance table of the audio playback device. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to the first frequency point. When the audio playback device outputs audio using the first audio gain at the first frequency point, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold.
[0006] The audio to be output is processed based on the first frequency point and the first audio gain in the audio resonance table.
[0007] Output the processed audio.
[0008] In some exemplary embodiments, the method further includes, prior to:
[0009] Determine the list of scanning frequency points;
[0010] Perform one or more single-frequency audio tests on each scan frequency point in the scan frequency point list to determine the first audio gain corresponding to each scan frequency point. The single-frequency audio test includes: playing single-frequency audio, which generates a fundamental frequency band signal and a harmonic band signal; determining the signal gain of the harmonic band signal; and when the signal gain of the harmonic band signal is lower than a preset harmonic gain threshold, recording the audio gain corresponding to the current single-frequency audio as the first audio gain corresponding to the single frequency point.
[0011] Generate the audio resonance table of the audio playback device.
[0012] In some exemplary embodiments, performing one or more single-frequency audio tests on each scan frequency point in the scan frequency point list includes:
[0013] Initialize the audio gain of the current scan frequency point;
[0014] Output the single-frequency audio of the current scanning frequency point. The single-frequency audio propagates through the air and the vibration of the structural components of the audio playback device to generate a fundamental frequency band signal and a harmonic band signal.
[0015] Determine the signal gain of the harmonic band signal, and determine whether the signal gain of the harmonic band signal is less than or equal to a preset harmonic gain threshold;
[0016] When the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold, the audio gain of the currently output single-frequency audio is recorded as the first audio gain corresponding to the current scanning frequency.
[0017] When the signal gain of the harmonic band signal is greater than the preset harmonic gain threshold, the audio gain of the current single-frequency audio is reduced, and the step of outputting the single-frequency audio of the current scanning frequency is returned to continue to be executed in a loop.
[0018] In some exemplary embodiments, when reducing the audio gain of the currently output single-frequency audio, the change is z dB each time, with z ranging from -1 to -3.
[0019] In some exemplary embodiments, determining the list of scanning frequency points includes:
[0020] Determine the minimum scanning frequency, the maximum scanning frequency, and the frequency scanning step size. The minimum scanning frequency is between 20Hz and 30Hz, and the maximum scanning frequency is between 450Hz and 650Hz.
[0021] In some exemplary implementations, the preset harmonic gain threshold is less than -1dB.
[0022] In some exemplary embodiments, the method further includes:
[0023] Obtain the equalizer data table of the audio playback device;
[0024] Based on the audio resonance table and the equalizer data table, a comprehensive signal gain table is generated.
[0025] The audio to be output is processed according to the comprehensive signal gain table.
[0026] In some exemplary embodiments, generating a comprehensive signal gain table based on the audio resonance table and the equalizer data table includes:
[0027] Generate an initial signal gain table based on the equalizer data table;
[0028] Extract all first frequency points in the audio resonance table where the first audio gain is less than the maximum audio gain;
[0029] The first frequency points where the extracted first audio gain is less than the maximum audio gain, along with their corresponding first audio gains, are inserted into the initial signal gain table to obtain the comprehensive signal gain table.
[0030] This disclosure also provides an audio playback device, including a memory; and a processor coupled to the memory, the processor being configured to perform steps of the audio playback method as described in any embodiment of this disclosure based on instructions stored in the memory.
[0031] This disclosure also provides a storage medium storing a computer program that, when executed by a processor, implements the audio playback method as described in any embodiment of this disclosure.
[0032] This disclosure also provides an audio playback device, including an audio output unit and a processing unit, wherein:
[0033] The processing unit is configured to acquire an audio resonance table of the audio playback device, the audio resonance table including one or more first frequency points and a first audio gain corresponding to the first frequency point, wherein when the audio playback device outputs audio at the first frequency point using the first audio gain, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold; process the audio to be output according to the first frequency point and the first audio gain in the audio resonance table; and output the processed audio to the audio output unit.
[0034] The audio output unit is configured to play the processed audio.
[0035] In some exemplary embodiments, the audio playback device further includes an audio recording unit, wherein:
[0036] The audio recording unit includes a microphone sensor and a recording processing module connected to the microphone sensor. The recording processing module is configured to convert the analog signal recorded by the microphone sensor into a digital signal.
[0037] The audio output unit includes a speaker.
[0038] In some exemplary embodiments, the audio playback device further includes a keyboard comprising a plurality of keys, the plurality of keys including at least one first key, the area of the first key being greater than or equal to a preset area threshold, wherein:
[0039] The microphone sensor includes one or more, and at least one of the microphone sensors is located in the area where the first button is located.
[0040] After reading and understanding the accompanying diagrams and detailed descriptions, other aspects can be understood. Attached Figure Description
[0041] The accompanying drawings are used to provide an understanding of the technical solutions of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the technical solutions of this disclosure and do not constitute a limitation on the technical solutions of this disclosure.
[0042] Figure 1 This is a flowchart illustrating an exemplary embodiment of an audio playback method disclosed herein.
[0043] Figure 2 This is a schematic diagram of the time domain signals of a fundamental frequency band signal and a harmonic band signal, which is an exemplary embodiment of the present disclosure.
[0044] Figure 3 This is a schematic diagram of the frequency domain signals of a fundamental frequency band signal and a harmonic band signal, as an exemplary embodiment of the present disclosure.
[0045] Figure 4 This is a schematic diagram of a microphone sensor setting area as an exemplary embodiment of the present disclosure;
[0046] Figure 5 This is a schematic diagram of sound waves generated by keyboard vibration, which is an exemplary embodiment of the present disclosure.
[0047] Figure 6 This is a schematic diagram of the signal gain of an equalizer.
[0048] Figure 7 This is a flowchart illustrating another audio playback method as an exemplary embodiment of the present disclosure;
[0049] Figure 8 This is a schematic diagram of the structure of an audio playback device as an exemplary embodiment of the present disclosure;
[0050] Figure 9 This is a schematic diagram of the structure of another audio playback device as an exemplary embodiment of the present disclosure. Detailed Implementation
[0051] To make the objectives, technical solutions, and advantages of this disclosure clearer, the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The implementation can be carried out in many different forms. Those skilled in the art will readily understand that the methods and content can be varied in various forms without departing from the spirit and scope of this disclosure. Therefore, this disclosure should not be construed as limited to the contents described in the following embodiments. Without conflict, the embodiments and features in the embodiments of this disclosure can be arbitrarily combined with each other.
[0052] The scale of the accompanying drawings in this disclosure can be used as a reference in actual manufacturing processes, but is not limited thereto. For example, the aspect ratio of the channel, the thickness and spacing of each film layer, and the width and spacing of each signal line can be adjusted according to actual needs. The number of pixels in the display panel and the number of sub-pixels in each pixel are not limited to the quantities shown in the figures. The accompanying drawings described in this disclosure are merely structural schematic diagrams, and one aspect of this disclosure is not limited to the shapes or values shown in the figures.
[0053] The ordinal numbers “first,” “second,” and “third” used in this specification are used to avoid confusion among the constituent elements, not to limit their quantity.
[0054] Through actual testing and analysis, the "buzzing" noise produced by a laptop when playing music or video through its speakers is due to the resonance between the keycaps of the laptop keyboard and the sound emitted by the speakers. This resonance frequency is usually in the low frequency range of 20Hz to 500Hz. For different models, this resonance frequency range may be different. For example, for some models, this resonance frequency range may be in the low frequency range of 20Hz to 600Hz.
[0055] Using soft silicone feet on the speakers can reduce the vibration transmitted from the speakers to the keyboard through the mounting bracket or adhesive surface to some extent. This method is equivalent to suppressing the propagation path of noise vibration. However, the vibration transmitted from the speakers to the keyboard is not fundamentally eliminated. Once it encounters certain audio output streams with built-in gain, keyboard resonance will still occur. Therefore, this method cannot fundamentally reduce the probability of keyboard resonance.
[0056] Low-frequency vibrations can be suppressed by adjusting the speaker's equalizer (EQ) to reduce the low-frequency gain. However, this method of suppressing low frequencies can result in weak bass, weak bass output, weak vibration, and poor user experience.
[0057] like Figure 1 As shown in the figure, this disclosure provides an audio playback method for an audio playback device, including the following steps:
[0058] Step 101: Obtain the audio resonance table of the audio playback device. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to the first frequency point. When the audio playback device outputs audio at the first frequency point using the first audio gain, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold.
[0059] Step 102: Process the audio to be output based on the first frequency point and the first audio gain in the audio resonance table;
[0060] Step 103: Output the processed audio.
[0061] The audio playback method of this disclosure improves the resonance noise of the audio playback device by processing the audio to be output according to the first frequency point and the first audio gain in the audio resonance table, reduces the rework and rework of the machine, improves the yield of production line production, improves factory quality, enhances the user's listening experience when playing bass audio, and reduces the impact of low frequency suppression on bass listening effect.
[0062] In some exemplary embodiments, the method further includes, prior to:
[0063] Determine the list of scanning frequency points;
[0064] Perform one or more single-frequency audio tests on each scan frequency point in the scan frequency point list to determine the first audio gain corresponding to each scan frequency point. The single-frequency audio test includes: playing single-frequency audio that generates a fundamental band signal and a harmonic band signal, and determining the signal gain of the harmonic band signal.
[0065] Generate an audio resonance table for the audio playback device.
[0066] In some exemplary embodiments, the generated fundamental frequency band signal and harmonic band signal can be recorded by the audio recording unit built into the audio playback device, and Fourier transform (FFT) and harmonic analysis can be performed on the fundamental frequency band signal and harmonic band signal by the signal processing unit built into the audio playback device to determine the signal gain of the harmonic band signal. In other exemplary embodiments, the generated fundamental frequency band signal and harmonic band signal can also be subjected to FFT and harmonic analysis by an external signal processing device to determine the signal gain of the harmonic band signal. In the embodiments of this disclosure, the signal gain of the harmonic band signal can be represented by a dB value.
[0067] In some exemplary embodiments, performing one or more single-frequency audio tests on each scan frequency point in the scan frequency point list includes:
[0068] Initialize the audio gain of the current scan frequency to its maximum value;
[0069] Output the single-frequency audio of the current scanning frequency. The single-frequency audio propagates through the air and the vibration of the structural components of the audio playback device, generating fundamental frequency band signals and harmonic band signals.
[0070] Determine the signal gain of the harmonic band signal and determine whether the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold.
[0071] When the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold, the audio gain of the single-frequency audio output by the current audio output unit is recorded as the first audio gain corresponding to the current scanning frequency point in the audio resonance table.
[0072] When the signal gain of the harmonic band signal is greater than the preset harmonic gain threshold, the audio gain of the currently output single-frequency audio is reduced, and the step of returning to outputting the single-frequency audio of the current scan frequency point continues to be executed in a loop.
[0073] Through research, the inventors of this application have discovered that as long as the signal gain of the harmonic band signal generated by the audio playback device when outputting audio at the first frequency point using the first audio gain is less than or equal to the preset harmonic gain threshold, then when the audio playback device outputs audio at the first frequency point using any audio gain lower than the first audio gain, the signal gain of the harmonic band signal generated will also be less than or equal to the preset harmonic gain threshold. In other words, as long as the audio playback device outputs audio at the first frequency point using an audio gain less than or equal to the first audio gain, no resonance will occur, i.e., no "buzzing" noise will be generated.
[0074] This disclosure embodiment analyzes the vibration spectrum of each audio playback device to accurately find the resonance point of the audio playback device, and suppresses it at that point to obtain an audio resonance table. An exemplary audio resonance table is shown in Table 1.
[0075] Table 1. An exemplary audio resonance table
[0076]
[0077]
[0078] In some exemplary embodiments, determining the list of scanning frequencies includes determining the lowest scanning frequency, the highest scanning frequency, and the frequency scanning step size.
[0079] In some exemplary embodiments, the lowest scanning frequency is between 20 Hz and 30 Hz, and the highest scanning frequency is between 450 Hz and 650 Hz.
[0080] In some exemplary embodiments, the frequency scan step size can be 1 Hz. However, this disclosure does not limit this, and the frequency scan step size can also be other values, such as 0.5 Hz. However, when the frequency scan step size is greater than 1 Hz, some resonant frequency points may be missed; when the frequency scan step size is less than 1 Hz, the scan time will increase.
[0081] For example, the lowest scanning frequency is 20Hz, the highest scanning frequency is 500Hz, and the frequency scanning step size is 1Hz; however, this disclosure does not limit the scope of the embodiments.
[0082] In some exemplary embodiments, when initializing the audio gain of the current scanning frequency, the audio gain of the current scanning frequency can be initialized to 0dB. In this embodiment, 0dB corresponds to the maximum output capability of the audio playback device (i.e., the maximum audio gain; when the audio gain is higher than 0dB, the audio playback device will produce distortion or damage). The maximum output capability of different audio playback devices may be different, but it can be considered that when the audio gain is set to 0dB, the maximum output capability of the audio playback device is used for output.
[0083] In some exemplary embodiments, after the step of reducing the audio gain of the currently output single-frequency audio and before the step of returning to the single-frequency audio of the currently scanned frequency point and continuing to loop, the method further includes:
[0084] Detect whether the audio gain of the currently output single-frequency audio is less than or equal to the preset minimum audio gain;
[0085] When the audio gain of the currently output single-frequency audio is greater than the preset minimum audio gain, the step of returning to the output of the single-frequency audio of the current scanned frequency point continues to be executed in a loop.
[0086] When the audio gain of the currently output single-frequency audio point is less than or equal to the preset minimum audio gain, the loop exits. At this time, the first audio gain of the currently scanned frequency point can be set to a preset low negative value (e.g., -100dB). For example, the preset minimum audio gain can be -60dB; however, this embodiment of the present disclosure does not limit this, for example, it can also be -50dB or -40dB.
[0087] In some exemplary embodiments, prior to determining the signal gain of the harmonic band signal, the method may further include: amplifying the generated fundamental frequency band signal and harmonic band signal, wherein the amplification factor of the fundamental frequency band signal and the harmonic band signal is the same. Due to energy loss, the signal gain of the fundamental frequency band signal and harmonic band signal may be relatively small when playing single-frequency audio. Amplifying the fundamental frequency band signal and harmonic band signal by the same factor using a power amplifier (in practice, the sound signal generated by the vibration of the output single-frequency audio is converted into a real-time analog signal, and then the analog signal is amplified) facilitates subsequent FFT and harmonic analysis.
[0088] In some exemplary embodiments, the structural components of the audio playback device include a keyboard; however, this disclosure is not limiting. This disclosure can also eliminate noise caused by resonance between structural components other than the keyboard and the sound emitted by the speaker.
[0089] In some exemplary implementations, single-frequency audio at each scan frequency point can be played for 1 millisecond; however, this disclosure does not limit this.
[0090] In some exemplary embodiments, when reducing the audio gain of the current single-frequency audio, the gain can be fixed by z dB (z < 0) each time, or it can be dynamically adjusted according to the magnitude of the harmonic gain. The larger the harmonic gain, the greater the reduction.
[0091] For example, z can be between -1 and -3; however, this disclosure does not limit this. For instance, z can be -3 or -2. For the audio resonance table shown in Table 1, the suppression step size z can be -0.01.
[0092] In some exemplary implementations, the preset harmonic gain threshold is less than -1dB.
[0093] For example, the preset harmonic gain threshold can be -3dB or -2dB, etc.; however, this disclosure does not limit this. In actual use, the preset harmonic gain threshold can be determined based on the test results of the actual audio playback device. When the preset harmonic gain threshold is set to -3dB, it means that the signal energy of the generated harmonic band signal is less than or equal to half of the signal energy of the generated fundamental frequency band signal.
[0094] In some exemplary embodiments, the first audio gain can be 0 dB or y dB, where y < 0.
[0095] In some exemplary embodiments, the signal gain of the harmonic band signal is determined by performing Fourier transform (FFT) and harmonic analysis on the fundamental band signal and the harmonic band signal. Figure 2 This is a schematic diagram of the time domain signals of a fundamental frequency band signal and a harmonic band signal, which is an exemplary embodiment of the present disclosure. Figure 3 This is a schematic diagram of the frequency domain signals of a fundamental frequency band signal and a harmonic band signal, as an exemplary embodiment of this disclosure. Figure 3 In this context, the fundamental frequency is 50Hz, and the harmonic frequencies are 100Hz, 150Hz, and so on.
[0096] In some exemplary embodiments, the signal gain of the harmonic band signal includes the signal gain from the first octave to the signal gain at the nth octave, where n is a natural number greater than 1.
[0097] In some exemplary embodiments, the audio recording unit in the audio playback device may include a microphone sensor and a recording processing module connected to the microphone sensor, the recording processing module being configured to convert analog signals recorded by the microphone sensor into digital signals.
[0098] In some exemplary embodiments, the audio output unit in the audio playback device may include a speaker.
[0099] In some exemplary embodiments, the audio playback device may be a laptop computer or the like.
[0100] In some exemplary embodiments, the microphone sensor can be placed anywhere on the audio playback device. For example, the microphone sensor can be placed above the screen, below the screen, on the upper left side of the keyboard, on the upper right side of the keyboard, below the keyboard, etc.
[0101] In this embodiment of the disclosure, since larger keyboard keycaps increase the probability of low-frequency resonance, placing the microphone sensor below the keyboard results in better quality recorded fundamental and harmonic signals. For example, as... Figure 4 As shown, it can be found in the area where the space bar is located ( Figure 4 Position A) and / or the area where the left Shift key and Caps Lock key are located ( Figure 4 Place 1 to 2 microphone sensors at position B. Figure 5 This is a schematic diagram illustrating the sound waves generated by keyboard vibration, an exemplary embodiment of this disclosure. When the signal gain of the harmonic band signal exceeds a preset harmonic gain threshold, the sound emitted by the keycaps of the laptop keyboard and the speaker resonates, producing a "buzzing" noise. This embodiment actively triggers keyboard resonance by playing a series of sounds at various single-frequency points through the speaker. The generated fundamental frequency and harmonic band signals are recorded by a microphone sensor, and the fundamental frequency and harmonic band signals are analyzed to find the resonant frequency points. The audio signals at the resonant frequency points are suppressed, thereby fundamentally eliminating the keyboard resonance problem.
[0102] In some exemplary embodiments, the method further includes:
[0103] Obtain the equalizer data table of the audio playback device;
[0104] Generate a comprehensive signal gain table based on the audio resonance table and the equalizer data table;
[0105] The output audio is processed according to the comprehensive signal gain table.
[0106] An example equalizer data table is as follows: Figure 6 As shown, an equalizer is an electronic device that can adjust the amplification of electrical signals of various frequencies separately. It compensates for the defects of loudspeakers and sound fields by adjusting electrical signals of different frequencies, and compensates for and modifies various sound sources and has other special functions. Generally, equalizers can only adjust electrical signals of multiple frequency bands such as high frequency, mid frequency, and low frequency separately.
[0107] In some exemplary embodiments, a comprehensive signal gain table is generated based on the audio resonance table and the equalizer data table, including:
[0108] Generate an initial signal gain table based on the equalizer data table;
[0109] Extract all first frequency points in the audio resonance table where the first audio gain is less than 0dB;
[0110] Insert all extracted first frequency points with first audio gain less than 0dB and their corresponding first audio gains into the initial signal gain table to obtain the comprehensive signal gain table.
[0111] Figure 6 This is a schematic diagram of the signal gain of an equalizer. For example... Figure 6 As shown, early Windows system applications' equalizers offered sound scene settings such as Jazz, Classical, Rock, and Electronic. These different modes corresponded to increased or decreased audio gain in certain frequency bands to compensate for the lack of non-linearity in the audio range due to factors like speakers, sound field environment, or human hearing perception. For example, assuming the system's original signal gain at 32Hz (the audio playback device's driver subsystem has a default equalization setting at each frequency point, i.e., a default original signal gain at each frequency point) is -35dB, such as... Figure 6As shown, the equalizer's signal gain increment in the 32Hz frequency band is approximately 5dB. After equalizer adjustment, the signal gain in the 32Hz frequency band becomes -30dB. At 100% volume (in this embodiment, volume and audio gain can be considered to have the same meaning; volume is typically for general users, while audio gain is typically for professionals; 100% volume means 0dB audio gain), the human ear hears a completely different sound volume when listening to a 1kHz sound and when listening to a 32Hz sound. Therefore, some applications are set to exceed the speaker's rated power output (e.g., output +2dB to +12dB) to compensate for this auditory difference. This setting itself carries a significant risk (leading to speaker distortion or damage). Newer operating systems are designed to limit this output. When applying equalizer gain, if the difference in the increment from the original signal gain to 0dB at a certain frequency point is greater than or equal to... Figure 6 The equalizer signal gain adjustment increment at the indicated frequency point is directly added to the original signal gain at that frequency point. If the original signal gain at that frequency point is already 0dB, or the difference between the original signal gain at that frequency point and 0dB is less than... Figure 6 The equalizer signal gain adjustment increment at the indicated frequency point will at most adjust the signal gain at that frequency point to 0dB; this is a software-level protection method. Another protection method is applicable to intelligent power amplifiers, which directly output the maximum 0dB for excessive audio signals. The audio playback method of this embodiment suppresses the amplitude of sound at certain resonant frequency points. Regardless of whether the previous equalizer setting at a specific frequency point was +6dB or -2dB, after scanning the frequency points, the audio gain at the resonant frequency points is set according to the audio resonance table.
[0112] In one exemplary embodiment, such as Figure 7 As shown, the audio playback method may include the following steps:
[0113] (1) Initialize the scan frequency. For example, the initial scan frequency can be set to 20Hz.
[0114] (2) Output single-frequency audio: drive the speaker to produce sound, the single-frequency audio data stream (single-tone fundamental frequency signal) is converted into the sound output of the speaker, and propagates through the vibration of air and structural components.
[0115] (3) Keyboard Resonance Data Sampling: Sound signals propagating through the air and structural components are monitored in real-time using a microphone sensor and converted into real-time analog signals. The signal gain of the analog signal can be adjusted as needed; for example, the analog signal can be amplified. The sampled data is as follows: Figure 2 As shown.
[0116] (4) Perform Fourier Transform (FFT) and harmonic analysis on the sampled data. For example, such as... Figure 3 As shown, taking a fundamental frequency of 50Hz as an example, its harmonics are 100Hz, 150Hz, etc., with different amplitudes for each harmonic. Since the playback is a single-tone fundamental frequency signal, the recorded signal, after FFT analysis, is considered to contain harmonic components other than the fundamental frequency component, all of which are attributed to harmonics generated by the resonance of the keyboard and the entire machine. The spectrum obtained after FFT and harmonic analysis is shown below. Figure 3 As shown, from Figure 3 It can be seen that, in addition to the 50Hz fundamental frequency signal, there are harmonics at 100Hz and 150Hz. These harmonics are caused by resonance. Based on the results of the spectrum analysis, the gain data of the fundamental frequency band and each harmonic frequency band can be obtained, as shown in Table 2 or Table 3, which gives the harmonic matrix of the sampled data.
[0117] Table 2. An exemplary harmonic matrix
[0118] index frequency size Gain baseband 1 50Hz 1 0.00dB 1 2 100Hz 0.604 -4.38dB 0 3 150Hz 0.321 -9.87dB 0 4 200Hz 0.054 -25.35dB 0 5 250Hz 0.013 -37.72dB 0 6 ... ... ... ...
[0119] Table 3. Another exemplary harmonic matrix
[0120] index frequency size Gain baseband 1 50Hz 1 0.00dB 1 2 100Hz 0.928 -0.65dB 0 3 150Hz 0.774 -2.23dB 0 4 200Hz 0.653 -3.70dB 0 5 250Hz 0.013 -37.72dB 0 6 ... ... ... ...
[0121] (5) Analyze the gain of the harmonic frequency band to determine whether the gain at all fundamental harmonic frequencies in the harmonic matrix is less than or equal to a preset harmonic gain threshold, i.e., whether resonance occurs. For example, the preset harmonic gain threshold can be -3dB, which means determining whether the harmonic energy is less than or equal to half the fundamental frequency energy. If it is less than or equal to -3dB, the harmonic energy is within a reasonable range; if it is greater than -3dB, the harmonic energy is too strong. Different keyboards paired with different structural components will produce resonances of varying intensities, which will affect the standard for judging harmonic gain. This embodiment of the disclosure determines whether resonance occurs at the fundamental frequency by comparing the harmonic gain with a preset harmonic gain threshold. In other exemplary embodiments, the harmonic gain threshold can also be -2.5dB or any other value less than 0.
[0122] When at least one harmonic gain is greater than -3dB, it indicates that the harmonic energy is too strong. We consider this to be causing resonance noise in the keyboard. For example, in the harmonic matrix of Table 3, the gains of the 100Hz harmonic (second harmonic) and the 150Hz harmonic (third harmonic) are both greater than -3dB, indicating that the energy at this fundamental frequency (50Hz) is too high, causing resonance in the keyboard and structural components. It is necessary to limit the energy of this fundamental frequency. When the fundamental frequency energy is suppressed, the harmonic energy will also decrease. The audio gain of this single-tone fundamental frequency signal is suppressed, with a suppression step size of z dB each time. For example, z can be -3. Then, it is re-output through the speaker until the harmonics at this frequency sampled by the microphone no longer exceed the half-power point, i.e., -3dB. This embodiment of the disclosure finds the most suitable gain at the resonance frequency point more accurately and quickly by using a suppression step size. In some other exemplary embodiments, the suppression step size can also be -2dB or other arbitrary values. In some other exemplary embodiments, the suppression step size may not be a fixed value (i.e., the size of the suppression step size can be dynamically adjusted). The size of the suppression step size is adjusted according to the size of the harmonic gain. When the harmonic gain is greater than a preset harmonic gain threshold and the harmonic gain is larger, the absolute value of the suppression step size is larger and the suppression step size is smaller. When the harmonic gain is greater than a preset harmonic gain threshold and the harmonic gain is smaller, the absolute value of the suppression step size is smaller and the suppression step size is larger (since the suppression step size is negative, the audio gain of the single-frequency audio output by the current audio output unit + the suppression step size = the audio gain of the single-frequency audio output by the next audio output unit).
[0123] When all harmonic gains are less than or equal to -3dB, it indicates that the harmonic energy is within a reasonable range. At this time, the keyboard will not generate resonance noise. As shown in Table 2, the fundamental frequency (Base) is 50Hz, the amplitude (Magnitude) is 1, and the corresponding gain (Gain) is 0dB. The harmonics are 100Hz, 150Hz, etc., and the amplitudes are all less than 1. The corresponding gains are calculated by FFT analysis. As can be seen from Table 2, the harmonic parts in this harmonic table are all less than -3dB. At this time, the audio resonance table can be updated, and the first audio gain corresponding to the current scanning frequency point can be recorded through the audio resonance table.
[0124] (6) After updating the audio resonance table, determine whether the frequency of the single-tone fundamental frequency signal output by the speaker is less than 500Hz; if it is less than 500Hz, adjust the scanning frequency to the next frequency point and return to step (2) to continue execution; if it is equal to 500Hz, the scanning ends and an audio resonance table within 20Hz to 500Hz is obtained.
[0125] If the output frequency is less than 500Hz, it indicates that the low-frequency band scan has not been completed. Reset the output gain to 0dB. Setting the output gain to 0dB here is to reset the set output audio gain to the normal value, neither increasing nor decreasing, which is equivalent to resetting the system volume, in order to prevent the output audio gain at the previous frequency point from being reduced and affecting the scanning and analysis results of subsequent frequency points.
[0126] If the output frequency equals 500Hz, the scan is complete. At this point, an audio resonance table within the range of 20Hz to 500Hz will be obtained, as shown in Table 1. This table records one or more frequency points that cause keyboard resonance, along with the maximum gain that can be set at each frequency point. For frequency points where resonance does not occur, the gain is 0dB, neither increasing nor decreasing. This provides the keyboard's resonant frequency scan data. The data in this audio resonance table will vary depending on the combination of different keyboards and structural components.
[0127] In this embodiment of the disclosure, when adjusting the scanning frequency, the adjustment direction can be either positive or negative, depending on the initial scanning frequency setting. For example, the initial scanning frequency can be set to 20Hz, in which case a positive adjustment is used, gradually increasing the scanning frequency from 20Hz to 500Hz. In some other exemplary embodiments, the initial scanning frequency can also be set to 500Hz, in which case a negative adjustment is used, gradually decreasing the scanning frequency from 500Hz to 20Hz.
[0128] (7) Update the corresponding audio resonance table data to the equalizer data table. At this time, the equalizer data table contains the keyboard resonance data of the current audio playback device. When playing music again, keyboard resonance will no longer occur.
[0129] The audio playback method of this disclosure actively triggers keyboard resonance at each scanned frequency point by frequency sweeping. After finding the frequency point that triggers resonance, the audio gain of that frequency point is suppressed, and the suppressed gain is used to re-trigger keyboard resonance until the frequency point no longer resonates under a certain audio gain. After all possible frequency points that may cause resonance are found, the first audio gain of the obtained audio resonance table is used to correct the low-frequency gain characteristics of the equalizer for precise positioning, thereby effectively improving the keyboard resonance problem while also taking into account the user's bass experience.
[0130] In actual use, you can add a "Keyboard Noise Suppression" mode to the system settings. "Keyboard Noise Suppression" is a system usage scenario setting; every mass-produced audio playback device undergoes keyboard resonance noise calibration before leaving the factory. This mode can also be provided to end users. Enabling this mode significantly reduces keyboard noise while minimizing the impact on the user's bass response.
[0131] like Figure 8 As shown, this disclosure also provides an audio playback device, including a processing unit 801 and an audio output unit 802, wherein:
[0132] The processing unit 801 is configured to acquire an audio resonance table of an audio playback device. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to each first frequency point. When the audio playback device outputs audio at a first frequency point using the first audio gain, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold. The processing unit 801 processes the audio to be output based on the first frequency points and the first audio gain in the audio resonance table and outputs the processed audio to the audio output unit 802.
[0133] The audio output unit 802 is configured to play the processed audio.
[0134] In some exemplary embodiments, the audio playback device further includes an audio recording unit 803, wherein:
[0135] The audio recording unit 803 includes a microphone sensor and a recording processing module connected to the microphone sensor. The recording processing module is configured to convert the analog signal recorded by the microphone sensor into a digital signal.
[0136] In some other exemplary embodiments, the audio playback device may not include the audio recording unit 803. In this case, an external signal processing device can be used to perform FFT and harmonic analysis on the generated fundamental frequency band signal and harmonic band signal to determine the signal gain of the harmonic band signal.
[0137] In some exemplary embodiments, the audio output unit 802 includes a speaker.
[0138] In some exemplary embodiments, the audio playback device further includes a keyboard (not shown), the keyboard including a plurality of keys, the plurality of keys including at least one first key, the area of the first key being greater than or equal to a preset area threshold, wherein:
[0139] The microphone sensor includes one or more, with at least one microphone sensor located in the area where the first button is located.
[0140] In some exemplary embodiments, the processing unit 801 is further configured to: determine a list of scanning frequency points; perform one or more single-frequency audio tests on each scanning frequency point in the list of scanning frequency points to determine a first audio gain corresponding to each scanning frequency point, wherein the single-frequency audio test includes: playing single-frequency audio through an audio output unit, wherein the single-frequency audio generates a fundamental frequency band signal and a harmonic band signal, determining the signal gain of the harmonic band signal; and generating an audio resonance table for the audio playback device.
[0141] In some exemplary embodiments, the processing unit 801 is further configured to: determine a list of scanning frequency points; and perform the following operations for each scanning frequency point in the list of scanning frequency points to obtain an audio resonance table of the audio playback device:
[0142] Initialize the audio gain of the current scan frequency point;
[0143] The audio output unit 802 outputs the single-frequency audio of the current scanning frequency point. The single-frequency audio propagates through the air and the vibration of the structural components of the audio playback device, generating a fundamental frequency band signal and a harmonic band signal.
[0144] Determine the signal gain of the harmonic band signal and determine whether the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold.
[0145] When the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold, the audio gain of the single-frequency audio output by the current audio output unit 802 is recorded as the first audio gain corresponding to the current scanning frequency.
[0146] When the signal gain of the harmonic band signal is greater than the preset harmonic gain threshold, the audio gain of the single-frequency audio output by the current audio output unit 802 is reduced, and the step of outputting the single-frequency audio of the current scanning frequency through the audio output unit 802 continues to be executed in a loop.
[0147] In some exemplary embodiments, determining the list of scanning frequency points includes:
[0148] Determine the minimum scan frequency, the maximum scan frequency, and the frequency scan step size. The minimum scan frequency is between 20Hz and 30Hz, the maximum scan frequency is between 450Hz and 650Hz, and the frequency scan step size is between 1Hz and 3Hz.
[0149] In some exemplary embodiments, when reducing the audio gain of the single-frequency audio output by the audio output unit 802, the change is z dB each time, with z ranging from -1 to -3.
[0150] In some exemplary implementations, the preset harmonic gain threshold is less than -1dB.
[0151] In some exemplary embodiments, the first audio gain is 0 dB or y dB, where y < 0.
[0152] In some exemplary embodiments, the processing unit 801 is further configured to: acquire an equalizer data table of an audio playback device; generate a comprehensive signal gain table based on an audio resonance table and the equalizer data table; and process the audio to be output based on the comprehensive signal gain table.
[0153] In some exemplary embodiments, generating a comprehensive signal gain table based on the audio resonance table and the equalizer data table includes: generating an initial signal gain table based on the equalizer data table; extracting all first frequency points in the audio resonance table whose first audio gain is less than 0dB; and inserting all the extracted first frequency points whose first audio gain is less than 0dB and their corresponding first audio gains into the initial signal gain table to obtain the comprehensive signal gain table.
[0154] This disclosure also provides an audio playback device, including a memory; and a processor coupled to the memory, the processor being configured to perform steps of the audio playback method as described in any embodiment of this disclosure based on instructions stored in the memory.
[0155] like Figure 9 As shown, in one example, the audio playback device may include: a processor 910, a memory 920, and a bus system 930, wherein the processor 910 and the memory 920 are connected via the bus system 930, the memory 920 is used to store instructions, and the processor 910 is used to execute the instructions stored in the memory 920 to obtain the audio resonance table of the audio playback device. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to the first frequency point. When the audio playback device outputs audio at the first frequency point using the first audio gain, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold. The audio to be output is processed according to the first frequency point and the first audio gain in the audio resonance table, and the processed audio is output.
[0156] It should be understood that processor 910 can be a Central Processing Unit (CPU), or it can be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.
[0157] Memory 920 may include read-only memory and random access memory, and provides instructions and data to processor 910. A portion of memory 920 may also include non-volatile random access memory. For example, memory 920 may also store device type information.
[0158] In addition to a data bus, the bus system 930 may also include a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 9 The general labeled all buses as Bus System 930.
[0159] In implementation, the processing performed by the processing device can be accomplished through integrated logic circuits in the hardware of the processor 910 or through software instructions. That is, the method steps of this embodiment can be executed by a hardware processor, or by a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other storage media. This storage medium is located in memory 920, and the processor 910 reads information from memory 920 and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, further details are omitted here.
[0160] This disclosure also provides a storage medium storing a computer program that, when executed by a processor, implements the audio playback method as described in any embodiment of this disclosure.
[0161] In some possible implementations, various aspects of the audio playback method provided in this application can also be implemented as a program product, which includes program code. When the program product is run on a computer device, the program code is used to cause the computer device to perform the steps in the audio playback method according to various exemplary embodiments of this application described above. For example, the computer device can execute the audio playback method described in the embodiments of this application.
[0162] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0163] The accompanying drawings in this disclosure only illustrate the structures relevant to this disclosure; other structures can be referenced to common designs. Unless otherwise specified, embodiments of this disclosure and features thereof can be combined to obtain new embodiments.
[0164] Those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions disclosed herein without departing from the spirit and scope of the technical solutions disclosed herein, and all such modifications and substitutions should be covered within the scope of the claims of this disclosure.
Claims
1. An audio playback method for an audio playback device, characterized in that, The audio playback device includes a structural noise suppression mode, and in the structural noise suppression mode, the method includes: The audio resonance table and equalizer data table of the audio playback device are obtained. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to each first frequency point. When the audio playback device outputs audio using the corresponding first audio gain at each first frequency point, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold, so that when the audio playback device outputs audio, the sound emitted by the structural components and speakers of the audio playback device does not resonate. The first audio gain is 0 dB or y dB, where y < 0. Generate an initial signal gain table based on the equalizer data table; Extract all first frequency points in the audio resonance table where the first audio gain is less than 0 dB; insert all extracted first frequency points where the first audio gain is less than 0 dB and the corresponding first audio gain into the initial signal gain table to obtain the comprehensive signal gain table; The audio to be output is processed according to the comprehensive signal gain table, and the gain of the processed audio at the first frequency point is the first audio gain corresponding to the first frequency point. Output the processed audio; The method further includes, prior to obtaining the audio resonance table and equalizer data table of the audio playback device: Determine the list of scanning frequency points; Perform one or more single-frequency audio tests on each scan frequency point in the scan frequency point list to determine the first audio gain corresponding to each scan frequency point; wherein, performing one or more single-frequency audio tests on each scan frequency point in the scan frequency point list includes: initializing the audio gain of the current scan frequency point; outputting the single-frequency audio of the current scan frequency point, wherein the single-frequency audio propagates through the air and the vibration of the structural components of the audio playback device, generating a fundamental frequency band signal and harmonic band signals; determining the signal gain of the harmonic band signal by performing Fourier transform and harmonic analysis on the fundamental frequency band signal and the harmonic band signal, wherein... The signal gain of the harmonic band signal includes the signal gain from the first octave to the nth octave, where n is a natural number greater than 1. The system determines whether the signal gain of the harmonic band signal is less than or equal to a preset harmonic gain threshold. When the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold, the audio gain of the currently output single-frequency audio is recorded as the first audio gain corresponding to the current scan frequency. When the signal gain of the harmonic band signal is greater than the preset harmonic gain threshold, the audio gain of the current single-frequency audio is reduced, and the process returns to the step of outputting the single-frequency audio of the current scan frequency, continuing the loop. Generate the audio resonance table of the audio playback device.
2. The audio playback method according to claim 1, characterized in that, When reducing the audio gain of the current single-frequency audio, each change is z dB, with z ranging from -1 to -3.
3. The audio playback method according to claim 1, characterized in that, The list of determined scanning frequency points includes: Determine the minimum scanning frequency, the maximum scanning frequency, and the frequency scanning step size. The minimum scanning frequency is between 20Hz and 30Hz, and the maximum scanning frequency is between 450Hz and 650Hz.
4. The audio playback method according to claim 1, characterized in that, The preset harmonic gain threshold is less than -1dB.
5. An audio playback device, characterized in that, It includes a memory; and a processor coupled to the memory, the processor being configured to perform the steps of the audio playback method as described in any one of claims 1 to 4 based on instructions stored in the memory.
6. A storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the audio playback method as described in any one of claims 1 to 4.
7. An audio playback device, characterized in that, Includes an audio output unit and a processing unit, wherein: The audio playback device includes a component noise suppression mode. In this mode, the processing unit is configured to acquire an audio resonance table and an equalizer data table of the audio playback device. The audio resonance table includes one or more first frequency points and a first audio gain corresponding to each first frequency point. When the audio playback device outputs audio at each first frequency point using the corresponding first audio gain, the signal gain of the generated harmonic band signal is less than or equal to a preset harmonic gain threshold, so that the sound emitted by the structural components and speakers of the audio playback device does not resonate when the audio playback device outputs audio. The first audio gain is 0 dB or y dB, where y < 0. An initial signal gain table is generated based on the equalizer data table. All first frequency points with a first audio gain less than 0 dB in the audio resonance table are extracted. All extracted first frequency points with a first audio gain less than 0 dB and their corresponding first audio gains are inserted into the initial signal gain table to obtain a comprehensive signal gain table. The audio to be output is processed according to the comprehensive signal gain table, and the gain of the processed audio at the first frequency point is the first audio gain corresponding to the first frequency point. The processed audio is then output to the audio output unit. The audio output unit is configured to play the processed audio; The processing unit is further configured to: determine a list of scanning frequency points; and perform the following operations on each scanning frequency point in the list to obtain an audio resonance table of the audio playback device: Initialize the audio gain of the current scan frequency point; The audio output unit outputs a single-frequency audio signal of the current scanning frequency. The single-frequency audio signal propagates through the air and the vibration of the structural components of the audio playback device, generating a fundamental frequency band signal and a harmonic band signal. By performing Fourier transform and harmonic analysis on the fundamental frequency band signal and the harmonic band signal, the signal gain of the harmonic band signal is determined, wherein the signal gain of the harmonic band signal includes the signal gain from the first octave point to the signal gain of the nth octave point, where n is a natural number greater than 1; it is then determined whether the signal gain of the harmonic band signal is less than or equal to a preset harmonic gain threshold. When the signal gain of the harmonic band signal is less than or equal to the preset harmonic gain threshold, the audio gain of the single-frequency audio output by the current audio output unit is recorded as the first audio gain corresponding to the current scanning frequency. When the signal gain of the harmonic band signal is greater than the preset harmonic gain threshold, the audio gain of the single-frequency audio output by the current audio output unit is reduced, and the process of outputting the single-frequency audio of the current scanning frequency through the audio output unit continues to be executed in a loop.
8. The audio playback device according to claim 7, characterized in that, It also includes an audio recording unit, in which: The audio recording unit includes a microphone sensor and a recording processing module connected to the microphone sensor. The recording processing module is configured to convert the analog signal recorded by the microphone sensor into a digital signal. The audio output unit includes a speaker.
9. The audio playback device according to claim 8, characterized in that, It also includes a keyboard, which includes multiple keys, including at least one first key, wherein the area of the first key is greater than or equal to a preset area threshold, wherein: The microphone sensor includes one or more, with at least one microphone sensor located in the area where the first button is located.
Citation Information
Patent Citations
Sound distortion control method and device, television and storage medium
CN110933486A
Far-field voice awakening method and device, electronic product and storage medium
CN111128167A
Method and arrangement for automatically limiting distortion in audio devices
US6154550A
