Intelligent compensation control method and related device for audio signal

Abstract

The present invention discloses an intelligent compensation control method for audio signals and related devices, wherein the method comprises: when a Bluetooth headset device is started, a playback calibration process is performed based on a preset calibration audio signal to obtain a calibration compensation parameter signal; a microphone device is started to collect and process the ambient audio signal of the environment in real time to obtain an ambient real-time audio signal; an audio feature extraction process is performed on the ambient real-time audio signal to generate a real-time ambient compensation parameter signal based on the extracted ambient audio feature signal; after receiving an audio signal to be played, a compensation process is performed on the audio signal to be played based on the calibration compensation parameter signal and the real-time ambient compensation parameter signal to form a compensated audio signal to be played; the compensated audio signal to be played is loaded into a first speaker device and a second speaker device for playback control. In the embodiment of the present invention, compensation of the audio signal to be played is achieved, and a better compensation effect is achieved, and a better experience is provided.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to an intelligent compensation control method for audio signals and related devices. Background Art

[0002] Bluetooth headsets are hands-free headsets that use Bluetooth technology, allowing users to avoid the hassle of annoying wires and make calls in a variety of ways. Since the advent of Bluetooth headsets, they have been a good tool for mobile business people to improve their efficiency.

[0003] However, since Bluetooth headsets communicate wirelessly, the audio signal may be weakened or partially lost when the terminal is wirelessly transmitted to the Bluetooth headset, which may cause hearing problems to the user. At the same time, since existing Bluetooth headsets generally adopt active noise reduction, the existing active noise reduction method cannot meet the noise reduction needs of users, so there is an urgent need for an audio intelligent compensation control method to meet user needs. Summary of the invention

[0004] The purpose of the present invention is to overcome the deficiencies of the prior art. The present invention provides an intelligent compensation control method for an audio signal and a related device to achieve compensation for an audio signal to be played, and has a better compensation effect and a better experience.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides an intelligent compensation control method for an audio signal, which is applied to a Bluetooth headset device, wherein the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device, and a Bluetooth control device, and the method includes:

[0006] When the Bluetooth headset device and the terminal are established, the Bluetooth control device performs a playback calibration process based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal;

[0007] The microphone device is started to collect and process the ambient audio signal of the environment in real time to obtain the real-time ambient audio signal;

[0008] The Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal;

[0009] After receiving the audio signal to be played, the Bluetooth control device performs compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played;

[0010] The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control.

[0011] Optionally, the Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal, including:

[0012] The Bluetooth control device communicates with the terminal, and receives a preset calibration audio signal sent by the terminal based on the communication, wherein the preset calibration audio signal is marked with a signal amplitude value;

[0013] The Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal is a white noise audio signal;

[0014] Before the first speaker device and the second speaker device play the preset calibration audio signal, sampling the preset calibration audio signal received by the first speaker device and the second speaker device to obtain a sampled preset calibration audio signal;

[0015] The sampled preset calibration audio signal is compared with the preset calibration audio signal, and a calibration compensation parameter signal is obtained according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal.

[0016] Optionally, starting the microphone device to collect and process the ambient audio signal of the environment in real time to obtain the ambient real-time audio signal includes:

[0017] The Bluetooth control device starts the microphone device and controls the microphone device to collect and process the ambient audio signal in real time to obtain the collected real-time audio signal;

[0018] The microphone device marks the collected real-time audio signal with a time sequence to form an environmental real-time audio signal.

[0019] Optionally, the Bluetooth control device performs audio feature extraction processing on the real-time ambient audio signal, and generates a real-time ambient compensation parameter signal based on the extracted ambient audio feature signal, including:

[0020] The Bluetooth control device performs pre-emphasis processing on the ambient real-time audio signal to obtain a pre-emphasized ambient real-time audio signal;

[0021] Performing short-time frame splitting processing on the pre-emphasized ambient real-time audio signal to obtain a short-time audio frame sequence corresponding to the ambient real-time audio signal, wherein there is partial audio overlap between adjacent audio frames in the short-time audio frame sequence;

[0022] Performing windowing processing on each audio frame in the short-time audio frame sequence based on a window function to form a processed short-time audio frame sequence;

[0023] Performing a transformation process on the processed short-time audio frame sequence based on Fourier transform to obtain a transformed audio frame sequence;

[0024] Performing audio feature extraction processing on the transformed audio frame sequence to obtain an extracted environmental audio feature signal;

[0025] A real-time environment compensation parameter signal is generated based on the extracted environment audio feature signal, wherein the real-time environment compensation parameter signal is an environment noise compensation parameter signal.

[0026] Optionally, before performing compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal, the method further includes:

[0027] Performing frame processing on the received audio signal to be played to form a frame sequence of the audio signal to be played;

[0028] Performing frame loss confirmation processing based on the to-be-played audio signal frame sequence, and when confirming the frame loss, obtaining a frame compensation parameter of the lost audio signal frame based on a number of audio signal frames before and after the lost audio signal frame;

[0029] The lost audio signal frame is subjected to waveform adjustment processing based on the frame compensation parameter, and a time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

[0030] Optionally, the compensating the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played, comprising:

[0031] Inputting the audio signal to be played into an active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, wherein the active noise reduction model is a model that uses a real-time environment compensation parameter signal as an active noise reduction compensation parameter;

[0032] The initial compensated audio signal to be played is calibrated and compensated based on the calibration compensation parameter signal to form a compensated audio signal to be played.

[0033] Optionally, the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control, including:

[0034] The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device in a clock synchronization manner for playback control.

[0035] In addition, an embodiment of the present invention further provides an intelligent compensation control device for an audio signal, which is applied to a Bluetooth headset device, wherein the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device, and a Bluetooth control device, and the device includes:

[0036] Playback correction module: used for, when the Bluetooth headset device is started, the Bluetooth control device performs playback calibration processing based on a preset calibration audio signal to obtain a calibration compensation parameter signal;

[0037] Real-time acquisition module: used to start the microphone device to collect and process the ambient audio signal of the environment in real time, and obtain the real-time audio signal of the environment;

[0038] Compensation signal generation module: used for the Bluetooth control device to perform audio feature extraction processing on the environmental real-time audio signal, and generate a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal;

[0039] Compensation control module: used for the Bluetooth control device to receive the audio signal to be played, and to perform compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played;

[0040] Playback control module: used for the Bluetooth control device to load the compensated audio signal to be played to the first speaker device and the second speaker device for playback control.

[0041] In addition, an embodiment of the present invention further provides a Bluetooth headset device, including a processor and a memory, wherein the processor runs a computer program or code stored in the memory to implement the intelligent compensation control method as described in any one of the above.

[0042] In addition, an embodiment of the present invention further provides a computer-readable storage medium for storing a computer program or code. When the computer program or code is executed by a processor, the intelligent compensation control method as described in any one of the above is implemented.

[0043] In an embodiment of the present invention, the Bluetooth headset device obtains a calibration compensation parameter signal by means of playback calibration, and then obtains a real-time environment compensation parameter signal by processing the real-time environment audio signal. Finally, the received audio signal to be played is compensated by means of the calibration compensation parameter signal and the real-time environment compensation parameter signal, and playback control is then performed, thereby achieving compensation for the audio signal to be played, and having a better compensation effect and a better experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 is a flow chart of an intelligent compensation control method for audio signals in an embodiment of the present invention;

[0046] Figure 2 is a flow chart of an intelligent compensation control method for audio signals in another embodiment of the present invention;

[0047] Figure 3 Schematic diagram of the structure of the intelligent compensation control device for audio signals in an embodiment of the present invention;

[0048] Figure 4 It is a schematic diagram of the structure of a Bluetooth headset device in an embodiment of the present invention. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] For example, see Figure 1 , Figure 1 It is a flow chart of the intelligent compensation control method of the audio signal in the embodiment of the present invention.

[0051] like Figure 1 As shown, an intelligent compensation control method for an audio signal is applied to a Bluetooth headset device, wherein the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device, and a Bluetooth control device, and the method includes:

[0052] S101: After the Bluetooth headset device and the terminal are established, the Bluetooth control device performs a playback calibration process based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal;

[0053] In the specific implementation process of the present invention, the Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal, including: the Bluetooth control device communicates with the terminal, and receives a preset calibration audio signal sent by the terminal based on the communication, and the preset calibration audio signal is marked with a signal amplitude value; the Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal is a white noise audio signal; before the first speaker device and the second speaker device play the preset calibration audio signal, the preset calibration audio signal received by the first speaker device and the second speaker device is sampled to obtain a sampled preset calibration audio signal; the sampled preset calibration audio signal is compared with the preset calibration audio signal, and a calibration compensation parameter signal is obtained according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal.

[0054] Specifically, the Bluetooth headset device involved in the present application includes a first speaker device, a second speaker device, a microphone device and a Bluetooth control device; and after the Bluetooth headset device is started, Bluetooth wireless communication is established with a terminal by Bluetooth pairing. At this time, the Bluetooth control device in the Bluetooth smart headset will communicate with the terminal, and request the terminal to send a preset calibration audio signal, and receive the preset calibration audio signal sent by the terminal according to the request, and the preset calibration audio signal is marked with a signal amplitude value; in this way, the Bluetooth control device will obtain the preset calibration audio signal and the signal amplitude value of the preset calibration audio signal; at this time, the Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal can be a white noise audio signal, which can be set according to actual conditions; Then, before the first speaker device and the second speaker device play the preset calibration audio signal, the preset calibration audio signal received by the first speaker device and the second speaker device is sampled and processed by the signal sampling sensor to obtain the sampled preset calibration audio signal; then, the amplitude value in the sampled preset calibration audio signal is extracted and processed to obtain the extracted amplitude value, and then the extracted amplitude value is compared with the amplitude value marked in the preset calibration audio signal to obtain the corresponding calibration compensation parameter signal according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal; through the technical means of this step, the attenuation of the audio signal that may be caused by wireless Bluetooth data transmission can be solved, and the subsequent emphasis compensation is performed through the signal emphasis compensation parameter signal, which can effectively solve this technical problem.

[0055] S102: Start the microphone device to collect and process the ambient audio signal of the environment in real time to obtain the real-time ambient audio signal;

[0056] In the specific implementation process of the present invention, the microphone device is started to collect and process the ambient audio signal of the environment in real time to obtain the ambient real-time audio signal, including: the Bluetooth control device starts the microphone device, and controls the microphone device to collect and process the ambient audio signal in real time to obtain the collected real-time audio signal; the microphone device marks the collected real-time audio signal with a time sequence to form the ambient real-time audio signal.

[0057] Specifically, in the application environment of the Bluetooth headset device, there may be more complex background noise, so it is necessary to collect the real-time audio signal of the environment for subsequent noise reduction compensation processing. Therefore, the Bluetooth control device will start the microphone device carried by the Bluetooth smart headset, and control the microphone device to collect the ambient audio signal in real time, thereby obtaining the collected real-time audio signal; finally, the collected real-time audio signal will be marked with a timing through the microphone device to form an environmental real-time audio signal.

[0058] S103: the Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal;

[0059] In the specific implementation process of the present invention, the Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal, including: the Bluetooth control device performs pre-emphasis processing on the environmental real-time audio signal to obtain a pre-emphasized environmental real-time audio signal; performs short-time frame splitting processing on the pre-emphasized environmental real-time audio signal to obtain a short-time audio frame sequence corresponding to the environmental real-time audio signal, and there is partial audio overlap between adjacent audio frames and audio frames in the short-time audio frame sequence; performs windowing processing on each audio frame in the short-time audio frame sequence based on a window function to form a processed short-time audio frame sequence; performs transform processing on the processed short-time audio frame sequence based on Fourier transform to obtain a transformed audio frame sequence; performs audio feature extraction processing on the transformed audio frame sequence to obtain an extracted environmental audio feature signal; generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal, wherein the real-time environmental compensation parameter signal is an environmental noise compensation parameter signal.

[0060] Specifically, after the Bluetooth control device obtains the environmental real-time audio signal, audio feature extraction is immediately performed, that is, the Bluetooth control device needs to perform pre-emphasis processing on the environmental real-time audio signal to obtain the pre-emphasized environmental real-time audio signal; then, the pre-emphasized environmental real-time audio signal is split into short-time frames to obtain a short-time audio frame sequence corresponding to the environmental real-time audio signal, and when the short-time frame is split, there is partial audio overlap between adjacent audio frames and audio frames in the split short-time audio sequence frames; then, each audio frame in the short-time audio frame sequence is windowed by a window function to form a processed short-time audio frame sequence, where the window function can be a Hamming window function, etc., and the spectrum leakage at the edge of the audio frame can be reduced by the window function processing; then, the audio frame is processed by Fourier transform The processed short-time audio frame sequence is transformed to obtain a transformed audio frame sequence, that is, through Fourier transform processing, the audio signal can be converted from time domain to frequency domain; then the transformed audio frame sequence is subjected to audio feature extraction processing to obtain an extracted environmental audio feature signal. In this scheme, the transformed audio frame sequence is input into a Mel filter for filtering processing to obtain a filtering result, and the human ear's perception of frequency can be simulated through filtering processing; then the filtering result is calculated The logarithmic energy of the Mel filter output; then the discrete cosine function is used for transformation processing to extract the corresponding extracted environmental audio feature signal; then the real-time environmental compensation parameter signal is generated according to the noise reduction principle by extracting the environmental audio feature signal, wherein the real-time environmental compensation parameter signal is an environmental noise compensation parameter signal.

[0061] S104: After receiving the audio signal to be played, the Bluetooth control device performs compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played;

[0062] In the specific implementation process of the present invention, before the compensation processing of the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal, it also includes: frame processing of the received audio signal to be played to form a frame sequence of the audio signal to be played; based on the frame sequence of the audio signal to be played, whether a frame is lost is confirmed, and when the frame loss is confirmed, the frame compensation parameters of the lost audio signal frame are obtained based on several audio signal frames before and after the lost audio signal frame; based on the frame compensation parameters, the waveform adjustment processing of the lost audio signal frame is performed, and the time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

[0063] Furthermore, the compensating process for the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played includes: inputting the audio signal to be played into an active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, wherein the active noise reduction model is a model that uses the real-time environment compensation parameter signal as an active noise reduction compensation parameter; and performing calibration compensation processing on the initial compensated audio signal to be played based on the calibration compensation parameter signal to form a compensated audio signal to be played.

[0064] Specifically, after the Bluetooth control device receives the audio signal to be played sent by the terminal, the Bluetooth control device first caches the audio signal to be played in the flash memory in sequence, and then extracts the corresponding audio signal to be played in the flash memory in sequence for frame processing to form a frame sequence of the audio signal to be played; then, a frame loss confirmation process is performed through the frame sequence of the audio signal to be played, and if there is no frame loss, a compensation process step is entered; and when the frame loss is confirmed, a frame compensation parameter of the lost audio signal frame is obtained through several audio signal frames before and after the lost audio signal frame; and a waveform adjustment process is performed on the lost audio signal frame according to the frame compensation parameter, and the time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

[0065] When performing compensation processing, first, the audio signal to be played is input into the active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, and the active noise reduction model is a model that uses the real-time environment compensation parameter signal as the active noise reduction compensation parameter; that is, the input audio signal to be played is actively noise reduced in the active noise reduction model according to the latest real-time environment compensation parameter signal. The compensation processing is then performed on the initial compensated audio signal to be played by calibrating the compensation parameter signal to form a compensated audio signal to be played.

[0066] S105: The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control.

[0067] In the specific implementation process of the present invention, the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control, including: the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control using clock synchronization.

[0068] Specifically, the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device in a clock synchronization manner for playback control, thereby achieving compensation processing for the audio signal to be played before playback, so that when the first speaker device and the second speaker device of the Bluetooth headset device play, the active noise reduction function is achieved, and it has a good signal compensation effect, so that the user has a better experience effect.

[0069] In an embodiment of the present invention, the Bluetooth headset device obtains a calibration compensation parameter signal by means of playback calibration, and then obtains a real-time environment compensation parameter signal by processing the real-time environment audio signal. Finally, the received audio signal to be played is compensated by means of the calibration compensation parameter signal and the real-time environment compensation parameter signal, and playback control is then performed, thereby achieving compensation for the audio signal to be played, and having a better compensation effect and a better experience.

[0070] For example 2, please refer to Figure 2 , Figure 2 It is a flowchart of an intelligent compensation control method for audio signals in another embodiment of the present invention.

[0071] like Figure 2 As shown, an intelligent compensation control method for an audio signal is applied to a Bluetooth headset device, wherein the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device, and a Bluetooth control device, and the method includes:

[0072] S201: After the Bluetooth headset device and the terminal are established, the Bluetooth control device performs a playback calibration process based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal;

[0073] S202: Start the microphone device to collect and process the ambient audio signal of the environment in real time to obtain the real-time ambient audio signal;

[0074] S203: the Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal;

[0075] S204: After receiving the audio signal to be played, the Bluetooth control device performs frame processing on the received audio signal to be played to form a frame sequence of the audio signal to be played;

[0076] S205: performing frame loss confirmation processing based on the to-be-played audio signal frame sequence, and when confirming frame loss, obtaining a frame compensation parameter of the lost audio signal frame based on a number of audio signal frames before and after the lost audio signal frame;

[0077] S206: performing waveform adjustment processing on the lost audio signal frame based on the frame compensation parameter, and using a time domain signal obtained after the waveform adjustment as a time domain signal of the lost audio signal frame;

[0078] S207: performing compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played;

[0079] S208: The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control.

[0080] In an embodiment of the present invention, the Bluetooth headset device obtains a calibration compensation parameter signal by means of playback calibration, and then obtains a real-time environment compensation parameter signal by processing the real-time environment audio signal. Finally, the received audio signal to be played is compensated by means of the calibration compensation parameter signal and the real-time environment compensation parameter signal, and playback control is then performed, thereby achieving compensation for the audio signal to be played, and having a better compensation effect and a better experience.

[0081] For example 3, please refer to Figure 3 , Figure 3 It is a schematic diagram of the structure of the intelligent compensation control device for audio signals in an embodiment of the present invention.

[0082] like Figure 3 As shown, an intelligent compensation control device for audio signals is applied to a Bluetooth headset device, wherein the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device and a Bluetooth control device, and the device includes:

[0083] Playback correction module 301: used for, when the Bluetooth headset device is started, the Bluetooth control device to perform playback calibration processing based on a preset calibration audio signal to obtain a calibration compensation parameter signal;

[0084] In the specific implementation process of the present invention, the Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal, including: the Bluetooth control device communicates with the terminal, and receives a preset calibration audio signal sent by the terminal based on the communication, and the preset calibration audio signal is marked with a signal amplitude value; the Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal is a white noise audio signal; before the first speaker device and the second speaker device play the preset calibration audio signal, the preset calibration audio signal received by the first speaker device and the second speaker device is sampled to obtain a sampled preset calibration audio signal; the sampled preset calibration audio signal is compared with the preset calibration audio signal, and a calibration compensation parameter signal is obtained according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal.

[0085] Specifically, the Bluetooth headset device involved in the present application includes a first speaker device, a second speaker device, a microphone device and a Bluetooth control device; and after the Bluetooth headset device is started, Bluetooth wireless communication is established with a terminal by Bluetooth pairing. At this time, the Bluetooth control device in the Bluetooth smart headset will communicate with the terminal, and request the terminal to send a preset calibration audio signal, and receive the preset calibration audio signal sent by the terminal according to the request, and the preset calibration audio signal is marked with a signal amplitude value; in this way, the Bluetooth control device will obtain the preset calibration audio signal and the signal amplitude value of the preset calibration audio signal; at this time, the Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal can be a white noise audio signal, which can be set according to actual conditions; Then, before the first speaker device and the second speaker device play the preset calibration audio signal, the preset calibration audio signal received by the first speaker device and the second speaker device is sampled and processed by the signal sampling sensor to obtain the sampled preset calibration audio signal; then, the amplitude value in the sampled preset calibration audio signal is extracted and processed to obtain the extracted amplitude value, and then the extracted amplitude value is compared with the amplitude value marked in the preset calibration audio signal to obtain the corresponding calibration compensation parameter signal according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal; through the technical means of this step, the attenuation of the audio signal that may be caused by wireless Bluetooth data transmission can be solved, and the subsequent emphasis compensation is performed through the signal emphasis compensation parameter signal, which can effectively solve this technical problem.

[0086] Real-time acquisition module 302: used to start the microphone device to collect and process the ambient audio signal of the environment in real time, and obtain the real-time audio signal of the environment;

[0087] In the specific implementation process of the present invention, the microphone device is started to collect and process the ambient audio signal of the environment in real time to obtain the ambient real-time audio signal, including: the Bluetooth control device starts the microphone device, and controls the microphone device to collect and process the ambient audio signal in real time to obtain the collected real-time audio signal; the microphone device marks the collected real-time audio signal with a time sequence to form the ambient real-time audio signal.

[0088] Specifically, in the application environment of the Bluetooth headset device, there may be more complex background noise, so it is necessary to collect the real-time audio signal of the environment for subsequent noise reduction compensation processing. Therefore, the Bluetooth control device will start the microphone device carried by the Bluetooth smart headset, and control the microphone device to collect the ambient audio signal in real time, thereby obtaining the collected real-time audio signal; finally, the collected real-time audio signal will be marked with a timing through the microphone device to form an environmental real-time audio signal.

[0089] The compensation signal generating module 303 is used for the Bluetooth control device to perform audio feature extraction processing on the real-time ambient audio signal, and generate a real-time ambient compensation parameter signal based on the extracted ambient audio feature signal;

[0090] In the specific implementation process of the present invention, the Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal, including: the Bluetooth control device performs pre-emphasis processing on the environmental real-time audio signal to obtain a pre-emphasized environmental real-time audio signal; performs short-time frame splitting processing on the pre-emphasized environmental real-time audio signal to obtain a short-time audio frame sequence corresponding to the environmental real-time audio signal, and there is partial audio overlap between adjacent audio frames and audio frames in the short-time audio frame sequence; performs windowing processing on each audio frame in the short-time audio frame sequence based on a window function to form a processed short-time audio frame sequence; performs transform processing on the processed short-time audio frame sequence based on Fourier transform to obtain a transformed audio frame sequence; performs audio feature extraction processing on the transformed audio frame sequence to obtain an extracted environmental audio feature signal; generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal, wherein the real-time environmental compensation parameter signal is an environmental noise compensation parameter signal.

[0091] Specifically, after the Bluetooth control device obtains the environmental real-time audio signal, audio feature extraction is immediately performed, that is, the Bluetooth control device needs to perform pre-emphasis processing on the environmental real-time audio signal to obtain the pre-emphasized environmental real-time audio signal; then, the pre-emphasized environmental real-time audio signal is split into short-time frames to obtain a short-time audio frame sequence corresponding to the environmental real-time audio signal, and when the short-time frame is split, there is partial audio overlap between adjacent audio frames and audio frames in the split short-time audio sequence frames; then, each audio frame in the short-time audio frame sequence is windowed by a window function to form a processed short-time audio frame sequence, where the window function can be a Hamming window function, etc., and the spectrum leakage at the edge of the audio frame can be reduced by the window function processing; then, the audio frame is processed by Fourier transform The processed short-time audio frame sequence is transformed to obtain a transformed audio frame sequence, that is, through Fourier transform processing, the audio signal can be converted from time domain to frequency domain; then the transformed audio frame sequence is subjected to audio feature extraction processing to obtain an extracted environmental audio feature signal. In this scheme, the transformed audio frame sequence is input into a Mel filter for filtering processing to obtain a filtering result, and the human ear's perception of frequency can be simulated through filtering processing; then the filtering result is calculated The logarithmic energy of the Mel filter output; then the discrete cosine function is used for transformation processing to extract the corresponding extracted environmental audio feature signal; then the real-time environmental compensation parameter signal is generated according to the noise reduction principle by extracting the environmental audio feature signal, wherein the real-time environmental compensation parameter signal is an environmental noise compensation parameter signal.

[0092] The compensation control module 304 is used for the Bluetooth control device to receive the audio signal to be played, and to perform compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played;

[0093] In the specific implementation process of the present invention, before the compensation processing of the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal, it also includes: frame processing of the received audio signal to be played to form a frame sequence of the audio signal to be played; based on the frame sequence of the audio signal to be played, whether a frame is lost is confirmed, and when the frame loss is confirmed, the frame compensation parameters of the lost audio signal frame are obtained based on several audio signal frames before and after the lost audio signal frame; based on the frame compensation parameters, the waveform adjustment processing of the lost audio signal frame is performed, and the time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

[0094] Furthermore, the compensating process for the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played includes: inputting the audio signal to be played into an active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, wherein the active noise reduction model is a model that uses the real-time environment compensation parameter signal as an active noise reduction compensation parameter; and performing calibration compensation processing on the initial compensated audio signal to be played based on the calibration compensation parameter signal to form a compensated audio signal to be played.

[0095] Specifically, after the Bluetooth control device receives the audio signal to be played sent by the terminal, the Bluetooth control device first caches the audio signal to be played in the flash memory in sequence, and then extracts the corresponding audio signal to be played in the flash memory in sequence for frame processing to form a frame sequence of the audio signal to be played; then, a frame loss confirmation process is performed through the frame sequence of the audio signal to be played, and if there is no frame loss, a compensation process step is entered; and when the frame loss is confirmed, a frame compensation parameter of the lost audio signal frame is obtained through several audio signal frames before and after the lost audio signal frame; and a waveform adjustment process is performed on the lost audio signal frame according to the frame compensation parameter, and the time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

[0096] When performing compensation processing, first, the audio signal to be played is input into the active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, and the active noise reduction model is a model that uses the real-time environment compensation parameter signal as the active noise reduction compensation parameter; that is, the input audio signal to be played is actively noise reduced in the active noise reduction model according to the latest real-time environment compensation parameter signal. The compensation processing is then performed on the initial compensated audio signal to be played by calibrating the compensation parameter signal to form a compensated audio signal to be played.

[0097] The playback control module 305 is used for the Bluetooth control device to load the compensated audio signal to be played to the first speaker device and the second speaker device for playback control.

[0098] In the specific implementation process of the present invention, the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control, including: the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control using clock synchronization.

[0099] Specifically, the Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device in a clock synchronization manner for playback control, thereby achieving compensation processing for the audio signal to be played before playback, so that when the first speaker device and the second speaker device of the Bluetooth headset device play, the active noise reduction function is achieved, and it has a good signal compensation effect, so that the user has a better experience effect.

[0100] In an embodiment of the present invention, the Bluetooth headset device obtains a calibration compensation parameter signal by means of playback calibration, and then obtains a real-time environment compensation parameter signal by processing the real-time environment audio signal. Finally, the received audio signal to be played is compensated by means of the calibration compensation parameter signal and the real-time environment compensation parameter signal, and playback control is then performed, thereby achieving compensation for the audio signal to be played, and having a better compensation effect and a better experience.

[0101] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the intelligent compensation control method of any one of the above embodiments is implemented. Wherein, the computer-readable storage medium includes but is not limited to any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (EraSable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or optical card. That is, the storage device includes any medium that can store or transmit information in a readable form by a device (for example, a computer, a mobile phone), which can be a read-only memory, a disk or an optical disk, etc.

[0102] An embodiment of the present invention further provides a computer application program, which runs on a computer and is used to execute the intelligent compensation control method of any one of the above embodiments.

[0103] also, Figure 4 It is a schematic diagram of the structure of a Bluetooth headset device in an embodiment of the present invention.

[0104] The embodiment of the present invention also provides a Bluetooth headset device, such as Figure 4The Bluetooth headset device includes a processor 402, a memory 403, an input unit 404, a display unit 405 and other devices. Those skilled in the art will understand that Figure 4 The structural components of the Bluetooth headset device shown do not constitute a limitation on all devices, and may include more or fewer components than shown, or combine certain components. The memory 403 can be used to store the application 401 and various functional modules, and the processor 402 runs the application 401 stored in the memory 403, thereby executing various functional applications and data processing of the device. The memory can be an internal memory or an external memory, or include both internal and external memories. The internal memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, or a random access memory. The external memory may include a hard disk, a floppy disk, a ZIP disk, a U disk, a magnetic tape, etc. The memory disclosed in the present invention includes but is not limited to these types of memories. The memory disclosed in the present invention is only used as an example and not as a limitation.

[0105] The input unit 404 is used to receive the input of signals and keywords input by the user. The input unit 404 may include a touch panel and other input devices. The touch panel can collect the user's touch operations on or near it (such as the user's operation on or near the touch panel using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a pre-set program; other input devices may include but are not limited to one or more of a physical keyboard, a function key (such as a play control key, a switch key, etc.), a trackball, a mouse, a joystick, etc. The display unit 405 can be used to display the information input by the user or the information provided to the user and various menus of the terminal device. The display unit 405 can be in the form of a liquid crystal display, an organic light emitting diode, etc. The processor 402 is the control center of the terminal device, which uses various interfaces and lines to connect various parts of the entire device, and executes various functions and processes data by running or executing software programs and / or modules stored in the memory 403, and calling data stored in the memory.

[0106] As an embodiment, the Bluetooth headset device includes: one or more processors 402, a memory 403, and one or more applications 401, wherein the one or more applications 401 are stored in the memory 403 and are configured to be executed by the one or more processors 402, and the one or more applications 401 are configured to execute the intelligent compensation control method in any one of the above-mentioned embodiments.

[0107] In an embodiment of the present invention, the Bluetooth headset device obtains a calibration compensation parameter signal by means of playback calibration, and then obtains a real-time environment compensation parameter signal by processing the real-time environment audio signal. Finally, the received audio signal to be played is compensated by means of the calibration compensation parameter signal and the real-time environment compensation parameter signal, and playback control is then performed, thereby achieving compensation for the audio signal to be played, and having a better compensation effect and a better experience.

[0108] In addition, the above is a detailed introduction to an intelligent compensation control method for an audio signal and a related device provided in an embodiment of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An intelligent compensation control method for audio signals, characterized in that: Applied to a Bluetooth headset device, the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device and a Bluetooth control device, and the intelligent compensation control method includes: After the Bluetooth headset device establishes Bluetooth wireless communication with the terminal, the Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal; The microphone device is started to collect and process the ambient audio signal of the environment in real time to obtain the real-time ambient audio signal; The Bluetooth control device performs audio feature extraction processing on the environmental real-time audio signal, and generates a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal; After receiving the audio signal to be played, the Bluetooth control device performs compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played; The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playback control; The Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal, including: The Bluetooth control device communicates with the terminal, and receives a preset calibration audio signal sent by the terminal based on the communication, wherein the preset calibration audio signal is marked with a signal amplitude value; The Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal is a white noise audio signal; Before the first speaker device and the second speaker device play the preset calibration audio signal, sampling the preset calibration audio signal received by the first speaker device and the second speaker device to obtain a sampled preset calibration audio signal; The sampled preset calibration audio signal is compared with the preset calibration audio signal, and a calibration compensation parameter signal is obtained according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal.

2. The intelligent compensation control method according to claim 1, characterized in that: The step of starting the microphone device to collect and process the ambient audio signal of the environment in real time to obtain the ambient real-time audio signal includes: The Bluetooth control device starts the microphone device and controls the microphone device to collect and process the ambient audio signal in real time to obtain the collected real-time audio signal; The microphone device marks the collected real-time audio signal with a time sequence to form an environmental real-time audio signal.

3. The intelligent compensation control method according to claim 1, characterized in that: The Bluetooth control device performs audio feature extraction processing on the real-time ambient audio signal, and generates a real-time ambient compensation parameter signal based on the extracted ambient audio feature signal, including: The Bluetooth control device performs pre-emphasis processing on the ambient real-time audio signal to obtain a pre-emphasized ambient real-time audio signal; Performing short-time frame splitting processing on the pre-emphasized ambient real-time audio signal to obtain a short-time audio frame sequence corresponding to the ambient real-time audio signal, wherein there is partial audio overlap between adjacent audio frames in the short-time audio frame sequence; Performing windowing processing on each audio frame in the short-time audio frame sequence based on a window function to form a processed short-time audio frame sequence; Performing a transformation process on the processed short-time audio frame sequence based on Fourier transform to obtain a transformed audio frame sequence; Performing audio feature extraction processing on the transformed audio frame sequence to obtain an extracted environmental audio feature signal; A real-time environment compensation parameter signal is generated based on the extracted environment audio feature signal, wherein the real-time environment compensation parameter signal is an environment noise compensation parameter signal.

4. The intelligent compensation control method according to claim 1, characterized in that: Before the compensation processing is performed on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal, the method further includes: Performing frame processing on the received audio signal to be played to form a frame sequence of the audio signal to be played; Performing frame loss confirmation processing based on the to-be-played audio signal frame sequence, and when confirming the frame loss, obtaining a frame compensation parameter of the lost audio signal frame based on a number of audio signal frames before and after the lost audio signal frame; The lost audio signal frame is subjected to waveform adjustment processing based on the frame compensation parameter, and a time domain signal obtained after the waveform adjustment is used as the time domain signal of the lost audio signal frame.

5. The intelligent compensation control method according to claim 1, characterized in that: The compensating the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played, comprising: Inputting the audio signal to be played into an active noise reduction model for active noise reduction compensation processing to obtain an initial compensated audio signal to be played, wherein the active noise reduction model is a model that uses a real-time environment compensation parameter signal as an active noise reduction compensation parameter; The initial compensated audio signal to be played is calibrated and compensated based on the calibration compensation parameter signal to form a compensated audio signal to be played.

6. The intelligent compensation control method according to claim 1, characterized in that: The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device for playing control, including: The Bluetooth control device loads the compensated audio signal to be played to the first speaker device and the second speaker device in a clock synchronization manner for playback control.

7. An intelligent compensation control device for audio signals, characterized in that: Applied to a Bluetooth headset device, the Bluetooth headset device includes a first speaker device, a second speaker device, a microphone device and a Bluetooth control device, and the intelligent compensation control device includes: Playback correction module: used for, after the Bluetooth headset device establishes Bluetooth wireless communication with the terminal, the Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal; Real-time acquisition module: used to start the microphone device to collect and process the ambient audio signal of the environment in real time, and obtain the real-time audio signal of the environment; Compensation signal generation module: used for the Bluetooth control device to perform audio feature extraction processing on the environmental real-time audio signal, and generate a real-time environmental compensation parameter signal based on the extracted environmental audio feature signal; Compensation control module: used for the Bluetooth control device to receive the audio signal to be played, and to perform compensation processing on the audio signal to be played based on the calibration compensation parameter signal and the real-time environment compensation parameter signal to form a compensated audio signal to be played; Playback control module: used for the Bluetooth control device to load the compensated audio signal to be played to the first speaker device and the second speaker device for playback control; The Bluetooth control device performs playback calibration processing based on obtaining a preset calibration audio signal on the terminal to obtain a calibration compensation parameter signal, including: The Bluetooth control device communicates with the terminal, and receives a preset calibration audio signal sent by the terminal based on the communication, wherein the preset calibration audio signal is marked with a signal amplitude value; The Bluetooth control device loads the preset calibration audio signal to the first speaker device and the second speaker device for playback processing, wherein the preset calibration audio signal is a white noise audio signal; Before the first speaker device and the second speaker device play the preset calibration audio signal, sampling the preset calibration audio signal received by the first speaker device and the second speaker device to obtain a sampled preset calibration audio signal; The sampled preset calibration audio signal is compared with the preset calibration audio signal, and a calibration compensation parameter signal is obtained according to the comparison result, wherein the calibration compensation parameter signal is a signal emphasis compensation parameter signal.

8. A Bluetooth headset device, comprising a processor and a memory, characterized in that: The processor runs a computer program or code stored in the memory to implement the intelligent compensation control method according to any one of claims 1 to 6.

9. A computer-readable storage medium for storing a computer program or code, characterized in that: When the computer program or code is executed by a processor, the intelligent compensation control method according to any one of claims 1 to 6 is implemented.

Images