Automatic microphone and speaker sound calibration system and method for a recorder device
Through the microphone and speaker sound automatic calibration system of the recorder equipment, multi-frequency calibration tone and Kalman filtering technology, the problem of sound recognition and playback deviation during the aging process of the recorder equipment is solved, achieving higher calibration accuracy and anti-interference ability.
Patent Information
- Application Number
- CN202210865608.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-21
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2042-07-21
AI Technical Summary
The microphone and speakers of the recorder equipment are prone to deviations during the aging process, resulting in the sound recognition and playback working status that does not meet the requirements.
The microphone and speaker sound automatic calibration system of a recorder device is adopted. Through a system composed of a recorder charging detection module, a static detection module, a microphone calibration module, a multi-frequency calibration sound generation module, a speaker module, etc., the microphone and speaker are calibrated using multi-frequency calibration tones, and energy balance calibration is performed using Kalman filtering and FFT Fourier transform.
It improves the calibration accuracy of the microphone and speakers of the recorder equipment, ensures that its working state in external sound recognition and playback meets the requirements, and improves the anti-interference ability.
Smart Images

Figure CN115278466B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an automatic calibration system and method for the sounds of a microphone and a speaker of a recorder device. Background Art
[0002] The recorder device has requirements for the sound recognition sensitivity of the microphone and the loudness of the speaker. During actual use, the device will age and decay, resulting in deviations and unable to ensure that the recorder always accurately operates in a sound recognition and playback state that meets the requirements. Summary of the Invention
[0003] The present invention provides an automatic calibration system and method for the sounds of a microphone and a speaker of a recorder device to solve the above-mentioned technical problems, and specifically adopts the following technical solutions:
[0004] An automatic calibration system for the sounds of a microphone and a speaker of a recorder device includes: a recorder charging detection module, a recorder static detection module, a recorder microphone calibration module, a collection station charging communication module, a collection station multi-frequency calibration tone generation module, a collection station speaker module, a recorder microphone module, a recorder multi-frequency separation module, a recorder speaker calibration module, a recorder multi-frequency calibration tone generation module, and a recorder speaker module;
[0005] When the recorder charging detection module detects that the recorder is connected to the collection station, it sends a notification message to the recorder static detection module;
[0006] The recorder static detection module performs static detection and sends a notification message to the recorder microphone calibration module when it detects that the recorder is in a static state;
[0007] The recorder microphone calibration module randomly selects a high-frequency frequency and a low-frequency frequency, and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module and the recorder speaker calibration module;
[0008] The recorder charging detection module sends the high-frequency frequency and the low-frequency frequency to the collection station charging communication module;
[0009] After receiving the high-frequency frequency and the low-frequency frequency, the collection station charging communication module sends them to the collection station multi-frequency calibration tone generation module;
[0010] After receiving the high-frequency frequency and the low-frequency frequency, the collection station multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone, and sends it to the collection station speaker module;
[0011] The acquisition station speaker module receives the multi-frequency calibration tone, performs digital-to-analog conversion on it, and plays the sound of the multi-frequency calibration tone;
[0012] The recorder microphone module receives the sound played by the acquisition station speaker module, performs analog-to-digital conversion on it using the microphone gain reference value, obtains the PCM data of the multi-frequency calibration tone of the microphone, and sends it to the recorder multi-frequency separation module;
[0013] The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration tone of the microphone from the recorder microphone module, performs slicing, and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder microphone calibration module;
[0014] The recorder microphone calibration module continuously receives the energy values of each frequency of the slices from the recorder multi-frequency separation module. The recorder microphone calibration module determines whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency of the slice and the preset threshold B. If it is greater, the energy value of the high-frequency frequency is subtracted from the energy value of the low-frequency frequency to obtain the energy balance difference. The recorder microphone calibration module performs Kalman filtering on the energy balance difference to obtain the predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, the microphone is considered effective, and sound calibration is performed. The recorder microphone calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain the adjustment multiple and sends it to the recorder microphone module;
[0015] The recorder microphone module receives the adjustment multiple from the recorder microphone calibration module, multiplies the microphone gain reference value by the adjustment multiple to obtain the microphone gain calibration value, and completes the calibration of the microphone;
[0016] The recorder speaker calibration module sends the high-frequency frequency and the low-frequency frequency to the recorder multi-frequency calibration tone generation module;
[0017] After receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration tone generation module generates the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate the multi-frequency calibration tone, and sends it to the recorder speaker module;
[0018] The recorder speaker module receives the multi-frequency calibration tone, performs digital-to-analog conversion on it, and plays the sound of the multi-frequency calibration tone;
[0019] The recorder microphone module receives the sound played by the recorder speaker module, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker, and sends it to the recorder multi-frequency separation module;
[0020] The multi-frequency separation module of the recorder receives the PCM data of the multi-frequency calibration sound of the speaker of the recorder speaker module, slices it, performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder speaker calibration module;
[0021] The recorder speaker calibration module continuously receives the energy values of each frequency of the slices from the multi-frequency separation module of the recorder. The recorder speaker calibration module judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency of the slice and a preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder speaker calibration module performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than a preset threshold C, it is considered that the speaker is effective and sound calibration is performed. The recorder speaker calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder speaker module;
[0022] The recorder speaker module receives the adjustment multiple sent by the recorder speaker calibration module, multiplies the speaker gain reference value by the adjustment multiple to obtain the speaker gain calibration value, and completes the speaker calibration.
[0023] Further, the recorder static detection module obtains the acceleration values in three directions of the acceleration sensor, calculates the modulus of the vector of the acceleration of the acceleration sensor, performs Kalman filtering on the modulus of the vector of the acceleration to obtain a predicted value of the modulus of the vector of the acceleration, and judges whether the predicted value of the modulus of the vector of the acceleration is less than a preset threshold A. If it is less than the preset threshold A, it is determined that it is in a static state.
[0024] Further, the recorder microphone calibration module selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and 500HZ to 900HZ respectively through a random algorithm.
[0025] Further, after receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration sound generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds;
[0026] After receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration sound generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds.
[0027] Further, after receiving the PCM data of the multi-frequency calibration sound of the microphone of the recorder microphone module, the recorder multi-frequency separation module slices it at 8 milliseconds;
[0028] After receiving the PCM data of the multi-frequency calibration sound of the speaker of the recorder speaker module, the recorder multi-frequency separation module slices it every 8 milliseconds.
[0029] A method for automatically calibrating the sound of a microphone and a speaker of a recorder device includes the following steps:
[0030] When the recorder charging detection module detects that the recorder is connected to the acquisition station, it sends a notification message to the recorder static detection module;
[0031] The recorder static detection module performs a static detection and sends a notification message to the recorder microphone calibration module when it detects that the recorder is in a static state;
[0032] The recorder microphone calibration module randomly selects a high-frequency frequency and a low-frequency frequency, and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module and the recorder speaker calibration module;
[0033] The recorder charging detection module sends the high-frequency frequency and the low-frequency frequency to the acquisition station charging communication module;
[0034] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station charging communication module sends them to the acquisition station multi-frequency calibration sound generation module;
[0035] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration sound generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration sound and sends it to the acquisition station speaker module;
[0036] After receiving the multi-frequency calibration sound, the acquisition station speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration sound;
[0037] The recorder microphone module receives the sound played by the acquisition station speaker module, performs analog-to-digital conversion on it using the microphone gain reference value, obtains the PCM data of the multi-frequency calibration sound of the microphone and sends it to the recorder multi-frequency separation module;
[0038] The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration sound of the microphone of the recorder microphone module, slices it and then performs FFT Fourier transform to obtain the energy values of each frequency of the slice, and continuously sends them to the recorder microphone calibration module;
[0039] The recorder microphone calibration module continuously receives the energy values of each frequency of the fragmented frequencies from the recorder multi-frequency separation module. The recorder microphone calibration module determines whether the energy value of the high-frequency frequency of the fragment is greater than the energy value of the low-frequency frequency by a preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder microphone calibration module performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than a preset threshold C, the microphone is considered effective and sound calibration is performed. The recorder microphone calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder microphone module;
[0040] The recorder microphone module receives the adjustment multiple from the recorder microphone calibration module, multiplies the microphone gain reference value by the adjustment multiple to obtain a microphone gain calibration value, and completes the calibration of the microphone;
[0041] The recorder speaker calibration module sends the high-frequency frequency and the low-frequency frequency to the recorder multi-frequency calibration tone generation module;
[0042] After receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration tone generation module generates PCM audio data for the high-frequency frequency and PCM audio data for the low-frequency frequency, adds and combines the PCM audio data for the high-frequency frequency and the PCM audio data for the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the recorder speaker module;
[0043] After receiving the multi-frequency calibration tone, the recorder speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone;
[0044] The recorder microphone module receives the sound played by the recorder speaker module, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker, and sends it to the recorder multi-frequency separation module;
[0045] The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration tone of the speaker from the recorder speaker module, fragments it and then performs FFT Fourier transform to obtain the energy values of each frequency of the fragment, and continuously sends them to the recorder speaker calibration module;
[0046] The recorder speaker calibration module continuously receives the energy values of each frequency of the fragmented frequencies from the recorder multi-frequency separation module. The recorder speaker calibration module determines whether the energy value of the high-frequency frequency of the fragment is greater than the energy value of the low-frequency frequency and the preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain the energy balance difference. The recorder speaker calibration module performs Kalman filtering on the energy balance difference to obtain the predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, the speaker is considered effective and sound calibration is performed. The recorder speaker calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain the adjustment multiple and sends it to the recorder speaker module;
[0047] The recorder speaker module receives the adjustment multiple sent by the recorder speaker calibration module, multiplies the speaker gain reference value by the adjustment multiple to obtain the speaker gain calibration value, and completes the speaker calibration.
[0048] Furthermore, the specific method for the recorder static detection module to perform static detection is as follows:
[0049] The recorder static detection module obtains the acceleration values in three directions of the acceleration sensor, calculates the modulus of the vector of the acceleration of the acceleration sensor, performs Kalman filtering on the modulus of the vector of the acceleration to obtain the predicted value of the modulus of the vector of the acceleration, and determines whether the predicted value of the modulus of the vector of the acceleration is less than the preset threshold A. If it is less than the preset threshold A, it is determined that the device is in a static state.
[0050] Furthermore, the specific method for the recorder microphone calibration module to randomly select a high-frequency frequency and a low-frequency frequency is as follows:
[0051] The recorder microphone calibration module selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and 500HZ to 900HZ respectively through a random algorithm.
[0052] Furthermore, the specific method for the acquisition station multi-frequency calibration tone generation module to generate the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency is as follows:
[0053] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration tone generation module generates the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds;
[0054] The specific method for the recorder multi-frequency calibration tone generation module to generate the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency is as follows:
[0055] After receiving the high-frequency frequency and the low-frequency frequency, the multi-frequency calibration tone generation module of the recorder generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value for 200 milliseconds.
[0056] Furthermore, the specific method for the multi-frequency separation module of the recorder to perform fragmentation is as follows:
[0057] After receiving the PCM data of the multi-frequency calibration tone of the microphone of the recorder microphone module, the multi-frequency separation module of the recorder performs fragmentation every 8 milliseconds;
[0058] After receiving the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module, the multi-frequency separation module of the recorder performs fragmentation every 8 milliseconds.
[0059] The beneficial effect of the present invention lies in a microphone and speaker sound automatic calibration system and method for a recorder device. The speaker of the acquisition station supporting the recorder is used to calibrate the microphone of the recorder, and the calibrated microphone is used to calibrate the speaker of the recorder. The multi-frequency calibration tone is used for sound calibration to improve the anti-interference of the multi-frequency calibration tone to external sounds and improve the accuracy of calibration. Through calibration, the recorder is in a sound recognition and playback working state that meets the requirements. Description of the Drawings
[0060] Figure 1 It is a schematic diagram of a microphone and speaker sound automatic calibration system for a recorder device of the present invention. Detailed Embodiment
[0061] The following specifically introduces the present invention in combination with the drawings and specific embodiments.
[0062] As Figure 1 shown is a microphone and speaker sound automatic calibration system for a recorder device of the present application. The speaker of the acquisition station supporting the recorder is used to calibrate the microphone of the recorder, and the calibrated microphone is used to calibrate the speaker of the recorder. The multi-frequency calibration tone is used for sound calibration to improve the anti-interference of the multi-frequency calibration tone to external sounds and improve the accuracy of calibration. Through calibration, the recorder is in a sound recognition and playback working state that meets the requirements. Specifically, a microphone and speaker sound automatic calibration system for a recorder device includes: a recorder charging detection module 1, a recorder static detection module 2, a recorder microphone calibration module 3, an acquisition station charging communication module 4, an acquisition station multi-frequency calibration tone generation module 5, an acquisition station speaker module 6, a recorder microphone module 7, a recorder multi-frequency separation module 8, a recorder speaker calibration module 9, a recorder multi-frequency calibration tone generation module 10, and a recorder speaker module 11.
[0063] Among them, the recorder charging detection module 1 sends a notification message to the recorder static detection module 2 when it detects that the recorder is connected to the acquisition station. The recorder charging detection module 1 is used to detect the connection status and trigger subsequent steps when it detects that the recorder is connected to the acquisition station.
[0064] The recorder static detection module 2 performs static detection and sends a notification message to the recorder microphone calibration module 3 when it detects that the recorder is in a static state.
[0065] Specifically, in order to avoid the impact of various collision sounds when the recorder is placed in the acquisition station on the accuracy of calibration, after receiving the notification message, the recorder static detection module 2 starts to perform static detection using the acceleration sensor. The recorder static detection module 2 obtains the acceleration values (x, y, z) of the three directions of the acceleration sensor and calculates the modulus of the vector of the acceleration of the acceleration sensor. Perform Kalman filtering on the modulus of the vector of the acceleration to obtain the predicted value of the modulus of the vector of the acceleration, and use Kalman filtering to filter the jitter error of the acceleration sensor. Determine whether the predicted value of the modulus of the vector of the acceleration is less than the preset threshold A. If it is less than the preset threshold A, it is determined that the recorder is in a static state.
[0066] The recorder microphone calibration module 3 calibrates the microphone of the recorder. Specifically, the recorder microphone calibration module 3 randomly selects a high-frequency frequency and a low-frequency frequency and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module 1 and the recorder speaker calibration module 9.
[0067] Among them, the recorder microphone calibration module 3 selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and 500HZ to 900HZ respectively through a random algorithm.
[0068] The recorder charging detection module 1 sends the high-frequency frequency and the low-frequency frequency to the acquisition station charging communication module 4.
[0069] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station charging communication module 4 sends them to the acquisition station multi-frequency calibration tone generation module 5.
[0070] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration tone generation module 5 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, and adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and send it to the acquisition station speaker module 6.
[0071] Specifically, after receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration tone generation module 5 generates PCM audio data of the high-frequency frequency with a fixed energy value size of 200 milliseconds and PCM audio data of the low-frequency frequency.
[0072] The acquisition station speaker module 6 receives the multi-frequency calibration tone, performs digital-to-analog conversion on it, and plays the sound of the multi-frequency calibration tone.
[0073] The recorder microphone module 7 receives the sound played by the acquisition station speaker module 6, performs analog-to-digital conversion on it using the microphone gain reference value, obtains the PCM data of the multi-frequency calibration tone of the microphone, and sends it to the recorder multi-frequency separation module 8.
[0074] The recorder multi-frequency separation module 8 receives the PCM data of the multi-frequency calibration tone of the microphone from the recorder microphone module 7, performs slicing and then FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder microphone calibration module 3. Specifically, after receiving the PCM data of the multi-frequency calibration tone of the microphone from the recorder microphone module 7, the recorder multi-frequency separation module 8 slices it every 8 milliseconds.
[0075] The recorder microphone calibration module 3 continuously receives the energy values of each frequency of the slices from the recorder multi-frequency separation module 8. The recorder microphone calibration module 3 determines whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and a preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain the energy balance difference. The recorder microphone calibration module 3 performs Kalman filtering on the energy balance difference to obtain the predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, the microphone is considered effective, and sound calibration is performed. The recorder microphone calibration module 3 divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain the adjustment multiple and sends it to the recorder microphone module 7.
[0076] The recorder microphone module 7 receives the adjustment multiple from the recorder microphone calibration module 3, multiplies the microphone gain reference value by the adjustment multiple to obtain the microphone gain calibration value, and completes the calibration of the microphone.
[0077] The recorder speaker calibration module 9 sends the high-frequency frequency and the low-frequency frequency to the recorder multi-frequency calibration tone generation module 10.
[0078] After receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration tone generation module 10 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone, and sends it to the recorder speaker module 11.
[0079] Specifically, after receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration tone generation module 10 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds.
[0080] The recorder speaker module 11 receives the multi-frequency calibration tone, performs digital-to-analog conversion on it, and plays the sound of the multi-frequency calibration tone.
[0081] The recorder microphone module 7 receives the sound played by the recorder speaker module 11, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker, and sends it to the recorder multi-frequency separation module 8.
[0082] The recorder multi-frequency separation module 8 receives the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module 11, performs slicing and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder speaker calibration module 9. Specifically, after receiving the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module 11, the recorder multi-frequency separation module 8 slices it every 8 milliseconds.
[0083] The recorder speaker calibration module 9 continuously receives the energy values of each frequency of the slices from the recorder multi-frequency separation module 8. The recorder speaker calibration module 9 determines whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and a preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain the energy balance difference. The recorder speaker calibration module 9 performs Kalman filtering on the energy balance difference to obtain the predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, it is considered that the speaker is effective, and sound calibration is performed. The recorder speaker calibration module 9 divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain the adjustment multiple and sends it to the recorder speaker module 11.
[0084] The recorder speaker module 11 receives the adjustment multiple sent by the recorder speaker calibration module 9, multiplies the speaker gain reference value by the adjustment multiple to obtain the speaker gain calibration value, and completes the speaker calibration.
[0085] This application also discloses an automatic calibration method for the microphone and speaker sounds of a recorder device, which is used for the automatic calibration system of the microphone and speaker sounds of a recorder device as described above, and specifically includes the following steps:
[0086] The recorder charging detection module 1 sends a notification message to the recorder static detection module 2 when it detects that the recorder is connected to the acquisition station.
[0087] The recorder static detection module 2 performs static detection and sends a notification message to the recorder microphone calibration module 3 when it detects that the recorder is in a static state.
[0088] The recorder microphone calibration module 3 randomly selects a high-frequency frequency and a low-frequency frequency, and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module 1 and the recorder speaker calibration module 9.
[0089] The recorder charging detection module 1 sends the high-frequency frequency and the low-frequency frequency to the acquisition station charging communication module 4.
[0090] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station charging communication module 4 sends them to the acquisition station multi-frequency calibration tone generation module 5.
[0091] After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration tone generation module 5 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the acquisition station speaker module 6.
[0092] After receiving the multi-frequency calibration tone, the acquisition station speaker module 6 performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone.
[0093] The recorder microphone module 7 receives the sound played by the acquisition station speaker module 6, and performs analog-to-digital conversion on it using the microphone gain reference value to obtain the PCM data of the multi-frequency calibration tone of the microphone and sends it to the recorder multi-frequency separation module 8.
[0094] The recorder multi-frequency separation module 8 receives the PCM data of the multi-frequency calibration tone of the microphone from the recorder microphone module 7, performs slicing and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder microphone calibration module 3.
[0095] The recorder microphone calibration module 3 continuously receives the energy values of each frequency of the slices from the recorder multi-frequency separation module 8. The recorder microphone calibration module 3 judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and the preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder microphone calibration module 3 performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, it is considered that the microphone is effective and sound calibration is performed. The recorder microphone calibration module 3 divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder microphone module 7.
[0096] The recorder microphone module 7 receives the adjustment multiple from the recorder microphone calibration module 3, multiplies the microphone gain reference value by the adjustment multiple to obtain a microphone gain calibration value, and completes the calibration of the microphone.
[0097] The recorder speaker calibration module 9 sends the high-frequency frequency and low-frequency frequency to the recorder multi-frequency calibration tone generation module 10.
[0098] After receiving the high-frequency frequency and low-frequency frequency, the recorder multi-frequency calibration tone generation module 10 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the recorder speaker module 11.
[0099] After receiving the multi-frequency calibration tone, the recorder speaker module 11 performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone.
[0100] The recorder microphone module 7 receives the sound played by the recorder speaker module 11, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker and sends it to the recorder multi-frequency separation module 8.
[0101] The recorder multi-frequency separation module 8 receives the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module 11, performs segmentation and then performs FFT Fourier transform to obtain the energy values of each frequency of the segmentation, and continuously sends them to the recorder speaker calibration module 9.
[0102] The recorder speaker calibration module 9 continuously receives the energy values of each frequency of the segmentation from the recorder multi-frequency separation module 8. The recorder speaker calibration module 9 determines whether the energy value of the high-frequency frequency of the segmentation is greater than the energy value of the low-frequency frequency and a preset threshold B. If it is greater, the energy value of the high-frequency frequency is subtracted from the energy value of the low-frequency frequency to obtain an energy balance difference. The recorder speaker calibration module 9 performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than a preset threshold C, the speaker is considered effective and sound calibration is performed. The recorder speaker calibration module 9 divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder speaker module 11.
[0103] The recorder speaker module 11 receives the adjustment multiple sent by the recorder speaker calibration module 9, multiplies the speaker gain reference value by the adjustment multiple to obtain a speaker gain calibration value, and completes the speaker calibration.
[0104] As a preferred implementation manner, the specific method for the recorder static detection module 2 to perform static detection is:
[0105] The recorder static detection module 2 obtains the acceleration values in three directions of the acceleration sensor, calculates the modulus of the vector of the acceleration of the acceleration sensor, performs Kalman filtering on the modulus of the vector of the acceleration to obtain the predicted value of the modulus of the vector of the acceleration, and determines whether the predicted value of the modulus of the vector of the acceleration is less than the preset threshold A. If it is less than the preset threshold A, it is determined that the recorder is in a static state.
[0106] As a preferred implementation manner, the specific method for the recorder microphone calibration module 3 to randomly select a high-frequency frequency and a low-frequency frequency is as follows:
[0107] The recorder microphone calibration module 3 selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and 500HZ to 900HZ respectively through a random algorithm.
[0108] As a preferred implementation manner, the specific method for the acquisition station multi-frequency calibration tone generation module 5 to generate PCM audio data of a high-frequency frequency and PCM audio data of a low-frequency frequency is as follows: After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration tone generation module 5 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size for 200 milliseconds.
[0109] The specific method for the recorder multi-frequency calibration tone generation module 10 to generate PCM audio data of a high-frequency frequency and PCM audio data of a low-frequency frequency is as follows: After receiving the high-frequency frequency and the low-frequency frequency, the recorder multi-frequency calibration tone generation module 10 generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size for 200 milliseconds.
[0110] As a preferred implementation manner, the specific method for the recorder multi-frequency separation module 8 to perform fragmentation is as follows:
[0111] After receiving the PCM data of the multi-frequency calibration tone of the microphone of the recorder microphone module 7, the recorder multi-frequency separation module 8 performs fragmentation every 8 milliseconds. After receiving the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module 11, the recorder multi-frequency separation module 8 performs fragmentation every 8 milliseconds.
[0112] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art of this industry should understand that the above embodiments do not limit the present invention in any form. Any technical solutions obtained by using equivalent replacements or equivalent transformations fall within the protection scope of the present invention.
Claims
1. An automatic calibration system for the microphone and speaker sounds of a recorder device, characterized in that, Including: a recorder charging detection module, a recorder static detection module, a recorder microphone calibration module, a collection station charging communication module, a collection station multi-frequency calibration tone generation module, a collection station speaker module, a recorder microphone module, a recorder multi-frequency separation module, a recorder speaker calibration module, a recorder multi-frequency calibration tone generation module, and a recorder speaker module; When the recorder charging detection module detects that the recorder is connected to the collection station, it sends a notification message to the recorder static detection module; The recorder static detection module performs static detection and sends a notification message to the recorder microphone calibration module when it detects that the recorder is in a static state; The recorder microphone calibration module randomly selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and from 500HZ to 900HZ respectively through a random algorithm, and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module and the recorder speaker calibration module; The recorder charging detection module sends the high-frequency frequency and the low-frequency frequency to the collection station charging communication module; After receiving the high-frequency frequency and the low-frequency frequency, the collection station charging communication module sends them to the collection station multi-frequency calibration tone generation module; After receiving the high-frequency frequency and the low-frequency frequency, the collection station multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the collection station speaker module; After receiving the multi-frequency calibration tone, the collection station speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone; The recorder microphone module receives the sound played by the collection station speaker module, performs analog-to-digital conversion on it using the microphone gain reference value, obtains the PCM data of the multi-frequency calibration tone of the microphone and sends it to the recorder multi-frequency separation module; The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration tone of the microphone of the recorder microphone module, performs slicing and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder microphone calibration module; The recorder microphone calibration module continuously receives the energy values of each frequency of the slices of the recorder multi-frequency separation module. The recorder microphone calibration module judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and the preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder microphone calibration module performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, it is considered that the microphone is effective and sound calibration is performed. The recorder microphone calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder microphone module; The recorder microphone module receives the adjustment multiple of the recorder microphone calibration module, multiplies the microphone gain reference value by the adjustment multiple to obtain a microphone gain calibration value, and completes the calibration of the microphone; The recorder speaker calibration module sends the high-frequency frequency and low-frequency frequency to the recorder multi-frequency calibration tone generation module; After receiving the high-frequency frequency and low-frequency frequency, the recorder multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the recorder speaker module; After receiving the multi-frequency calibration tone, the recorder speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone; The recorder microphone module receives the sound played by the recorder speaker module, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker and sends it to the recorder multi-frequency separation module; The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module, performs slicing and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder speaker calibration module; The recorder speaker calibration module continuously receives the energy values of each frequency of the slices from the recorder multi-frequency separation module. The recorder speaker calibration module judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and the preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain the energy balance difference. The recorder speaker calibration module performs Kalman filtering on the energy balance difference to obtain the predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, it is considered that the speaker is effective and sound calibration is performed. The recorder speaker calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain the adjustment multiple and sends it to the recorder speaker module; The recorder speaker module receives the adjustment multiple sent by the recorder speaker calibration module, multiplies the speaker gain reference value by the adjustment multiple to obtain the speaker gain calibration value, and completes the speaker calibration.
2. The microphone and speaker sound automatic calibration system of a recorder device according to claim 1, wherein The recorder static detection module obtains the acceleration values in three directions of the acceleration sensor, calculates the modulus of the vector of the acceleration of the acceleration sensor, performs Kalman filtering on the modulus of the vector of the acceleration to obtain the predicted value of the modulus of the vector of the acceleration, and judges whether the predicted value of the modulus of the vector of the acceleration is less than the preset threshold A. If it is less than the preset threshold A, it is determined that it is in a static state.
3. The microphone and speaker sound automatic calibration system of a recorder device according to claim 1, wherein After receiving the high-frequency frequency and low-frequency frequency, the acquisition station multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds; After receiving the high-frequency frequency and low-frequency frequency, the recorder multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds.
4. The automatic calibration system for the microphone and speaker sounds of a recorder device according to claim 1, wherein After receiving the PCM data of the multi-frequency calibration sound of the microphone of the recorder microphone module, the recorder multi-frequency separation module slices it every 8 milliseconds; After receiving the PCM data of the multi-frequency calibration sound of the speaker of the recorder speaker module, the recorder multi-frequency separation module slices it every 8 milliseconds.
5. A method for automatically calibrating the sounds of a microphone and a speaker of a recorder device, characterized in that, It includes the following steps: When the recorder charging detection module detects that the recorder is connected to the acquisition station, it sends a notification message to the recorder static detection module; The recorder static detection module performs static detection and sends a notification message to the recorder microphone calibration module when it detects that the recorder is in a static state; The recorder microphone calibration module randomly selects a high-frequency frequency and a low-frequency frequency from 1100HZ to 1800HZ and 500HZ to 900HZ respectively through a random algorithm, and sends the high-frequency frequency and the low-frequency frequency to the recorder charging detection module and the recorder speaker calibration module; The recorder charging detection module sends the high-frequency frequency and the low-frequency frequency to the acquisition station charging communication module; After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station charging communication module sends them to the acquisition station multi-frequency calibration sound generation module; After receiving the high-frequency frequency and the low-frequency frequency, the acquisition station multi-frequency calibration sound generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration sound and sends it to the acquisition station speaker module; After receiving the multi-frequency calibration sound, the acquisition station speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration sound; The recorder microphone module receives the sound played by the acquisition station speaker module, performs analog-to-digital conversion on it using the microphone gain reference value, obtains the PCM data of the multi-frequency calibration sound of the microphone and sends it to the recorder multi-frequency separation module; The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration sound of the microphone of the recorder microphone module, slices it and then performs FFT Fourier transform to obtain the energy values of each frequency of the slice, and continuously sends them to the recorder microphone calibration module; The recorder microphone calibration module continuously receives the energy values of each frequency of the slice of the recorder multi-frequency separation module. The recorder microphone calibration module judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency of the slice and a preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder microphone calibration module performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than a preset threshold C, it is considered that the microphone is effective and sound calibration is performed. The recorder microphone calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder microphone module; The recorder microphone module receives the adjustment multiple of the recorder microphone calibration module, multiplies the microphone gain reference value by the adjustment multiple to obtain a microphone gain calibration value, and completes the calibration of the microphone; The recorder speaker calibration module sends the high-frequency frequency and low-frequency frequency to the recorder multi-frequency calibration tone generation module; After receiving the high-frequency frequency and low-frequency frequency, the recorder multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency, adds and combines the PCM audio data of the high-frequency frequency and the PCM audio data of the low-frequency frequency according to the sampling points to generate a multi-frequency calibration tone and sends it to the recorder speaker module; After receiving the multi-frequency calibration tone, the recorder speaker module performs digital-to-analog conversion on it and plays the sound of the multi-frequency calibration tone; The recorder microphone module receives the sound played by the recorder speaker module, performs analog-to-digital conversion on it using the microphone gain calibration value, obtains the PCM data of the multi-frequency calibration tone of the speaker and sends it to the recorder multi-frequency separation module; The recorder multi-frequency separation module receives the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module, performs slicing and then performs FFT Fourier transform to obtain the energy values of each frequency of the slices, and continuously sends them to the recorder speaker calibration module; The recorder speaker calibration module continuously receives the energy values of each frequency of the slices of the recorder multi-frequency separation module. The recorder speaker calibration module judges whether the energy value of the high-frequency frequency of the slice is greater than the energy value of the low-frequency frequency and the preset threshold B. If it is greater, it subtracts the energy value of the low-frequency frequency from the energy value of the high-frequency frequency to obtain an energy balance difference. The recorder speaker calibration module performs Kalman filtering on the energy balance difference to obtain a predicted value of the energy balance difference. If the predicted value of the energy balance difference is less than the preset threshold C, it is considered that the speaker is effective and sound calibration is performed. The recorder speaker calibration module divides the energy value of the high-frequency frequency by the preset high-frequency energy value to obtain an adjustment multiple and sends it to the recorder speaker module; The recorder speaker module receives the adjustment multiple sent by the recorder speaker calibration module, multiplies the speaker gain reference value by the adjustment multiple to obtain the speaker gain calibration value, and completes the speaker calibration.
6. The automatic microphone and speaker sound calibration method for a recorder device according to claim 5, wherein The specific method for the recorder static detection module to perform static detection is: The recorder static detection module obtains the acceleration values in three directions of the acceleration sensor, calculates the modulus of the acceleration vector of the acceleration sensor, performs Kalman filtering on the modulus of the acceleration vector to obtain a predicted value of the modulus of the acceleration vector, and judges whether the predicted value of the modulus of the acceleration vector is less than the preset threshold A. If it is less than the preset threshold A, it is determined that it is in a static state.
7. The automatic microphone and speaker sound calibration method for a recorder device according to claim 5, wherein The specific method for the acquisition station multi-frequency calibration tone generation module to generate PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency is: After receiving the high-frequency frequency and low-frequency frequency, the acquisition station multi-frequency calibration tone generation module generates PCM audio data of the high-frequency frequency and PCM audio data of the low-frequency frequency with a fixed energy value size of 200 milliseconds; The specific method for the recorder multi-frequency calibration tone generation module to generate PCM audio data of high-frequency and low-frequency frequencies is as follows: After receiving the high-frequency and low-frequency frequencies, the recorder multi-frequency calibration tone generation module generates PCM audio data of high-frequency and low-frequency frequencies with a fixed energy value for 200 milliseconds.
8. The automatic calibration method for the microphone and speaker sounds of a recorder device according to claim 5, characterized in that The specific method for the recorder multi-frequency separation module to perform fragmentation is as follows: After receiving the PCM data of the multi-frequency calibration tone of the microphone of the recorder microphone module, the recorder multi-frequency separation module performs fragmentation every 8 milliseconds; After receiving the PCM data of the multi-frequency calibration tone of the speaker of the recorder speaker module, the recorder multi-frequency separation module performs fragmentation every 8 milliseconds.
Citation Information
Patent Citations
Microphone calibration method, device and system for audio equipment as well as readable storage medium
CN109309896A
Recording device for vehicle, signal processing device, and signal recording method
JP2020086852A