Room sound school method, apparatus, device and storage medium of audio device

Abstract

The present application relates to the technical field of audio signal processing, and discloses a room acoustic correction method, device and equipment of an audio device and a storage medium, which are used for improving the correction parameter accuracy and correction effect and effectively improving the acoustic effect of the audio device in a room. The room acoustic correction method of the audio device comprises the following steps: acquiring response data of a room to a multi-frequency band preset test signal, and extracting room acoustic data by using a time-frequency joint analysis method, wherein the room acoustic data comprises frequency attenuation, reflection path, phase offset and reverberation time information of different frequency bands; based on the room acoustic data, compensation processing is performed by using preset microphone calibration data to obtain a calibrated frequency response curve; fitting calculation is performed on the preset ideal frequency curve and the calibrated frequency response curve according to an optimization algorithm, so as to obtain room-specific correction parameters; and the output of the audio device is adjusted correspondingly according to the correction parameters.

Description

Technical Field

[0001] This invention relates to the field of audio signal processing technology, and in particular to a method, apparatus, device, and storage medium for room acoustic correction of audio equipment. Background Technology

[0002] Existing room acoustic calibration techniques for audio equipment typically begin by collecting room response data to a test signal. They then extract the room's frequency response data using simple frequency domain analysis methods, generally focusing only on frequency attenuation information. A frequency response curve is generated based on this attenuation information, and then a matching calculation is performed between the preset ideal frequency curve and the frequency response curve to obtain calibration parameters. These parameters are then used to adjust the audio equipment. However, this existing technology focuses solely on frequency attenuation information, neglecting other important acoustic parameters. This results in an inaccurate frequency response curve, and the use of fixed empirical formulas or simple algorithms for matching cannot well adapt to the acoustic characteristics of different rooms. Consequently, the obtained calibration parameters are not accurate enough, and the audio equipment's acoustic performance within the room cannot be effectively improved. Summary of the Invention

[0003] This invention provides a method, apparatus, device, and storage medium for room acoustic calibration of audio equipment, in order to solve the technical problem that the calibration parameters generated in the prior art are not accurate enough.

[0004] The first aspect of this invention provides a room acoustic calibration method for an audio device, comprising: acquiring room response data to a multi-band preset test signal, and extracting room acoustic data using a time-frequency joint analysis method, wherein the room acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands; performing compensation processing based on the room acoustic data using preset microphone calibration data to obtain a calibrated frequency response curve; performing fitting calculations on a preset ideal frequency curve and the calibrated frequency response curve using an optimization algorithm to obtain room-specific calibration parameters; and adjusting the output of the audio device accordingly based on the calibration parameters.

[0005] In one feasible implementation, obtaining room acoustic data by acquiring room response data to multi-band preset test signals includes: generating multi-band preset test signals covering low, mid, and high frequencies using an audio device and playing the test signals in the room; collecting signal response data at multiple listening positions using multiple microphones; and analyzing the response data using a time-frequency joint analysis method combining short-time Fourier transform and continuous wavelet transform to extract frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands, thereby obtaining room acoustic data.

[0006] In one feasible implementation, the step of generating a multi-band preset test signal covering low, mid, and high frequencies using an audio device and playing the test signal in a room includes: determining the low-frequency band as the first frequency band, the mid-frequency band as the second frequency band, and the high-frequency band as the third frequency band based on the commonly used operating frequency range of the audio device; uniformly selecting multiple frequency points at logarithmic intervals within each frequency band to generate a sine wave signal; superimposing the sine wave signals of different frequency bands according to a preset amplitude ratio and phase relationship to form a multi-band preset test signal covering low, mid, and high frequencies, and playing the test signal in a room.

[0007] In one feasible implementation, the step of performing compensation processing based on the room acoustic data using preset microphone calibration data to obtain a calibrated frequency response curve includes: for different frequency bands, performing preliminary attenuation compensation on the frequency response in the room response data according to the frequency attenuation information in the room acoustic data and the corresponding frequency response characteristics in the preset microphone calibration data; based on the reflection path information in the room acoustic data, analyzing the interference degree of different reflection paths on signals in each frequency band, and combining the calibration parameters regarding the influence of reflection paths in the microphone calibration data, performing reflection interference correction on the frequency response of the preliminary attenuation compensation; based on the phase shift information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data, performing phase calibration on the frequency response after reflection interference correction; based on the reverberation time information in the room acoustic data and the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, performing reverberation time compensation on the frequency response after phase calibration to obtain a calibrated frequency response curve.

[0008] In one feasible implementation, the step of performing preliminary attenuation compensation on the frequency response in the room response data based on the frequency attenuation information in the room acoustic data and the corresponding frequency response characteristics in the preset microphone calibration data for different frequency bands includes: dividing different frequency bands into multiple sub-bands; calculating the sum of the frequency attenuation value of each sub-band and the frequency response attenuation compensation value of the corresponding sub-band in the preset microphone calibration data as the preliminary attenuation compensation value for the corresponding sub-band; using the preliminary attenuation compensation value to compensate the frequency response of the corresponding sub-band extracted from the room response data; and integrating the compensated frequency responses of each sub-band according to their respective frequency bands to obtain the frequency response of the corresponding frequency band.

[0009] In one feasible implementation, the step of analyzing the interference level of different reflection paths on signals of each frequency band based on the reflection path information in the room acoustic data, and correcting the frequency response of the initial attenuation compensation by reflection interference in conjunction with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, includes: determining the primary and secondary reflection paths of each frequency band signal based on the reflection path information; calculating the interference coefficient of the primary and secondary reflection paths for each frequency band signal, wherein the interference coefficient is determined based on the length of the reflection path, the material characteristics of the reflective surface, and the room layout; and correcting the frequency response of the corresponding frequency band after initial attenuation compensation by reflection interference in conjunction with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, wherein the calibration parameters include frequency response correction factors under different reflection path interferences.

[0010] In one feasible implementation, the step of performing phase calibration on the frequency response after reflection interference correction based on the phase offset information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data includes: decomposing the phase offset information according to frequency bands to obtain the phase offset amount of each frequency band; for each frequency band, adding the phase offset amount of each frequency band to the phase calibration value of the corresponding frequency band in the microphone calibration data to obtain the phase calibration compensation value of that frequency band; and using the phase calibration compensation value to perform phase calibration on the frequency response of the corresponding frequency band after reflection interference correction.

[0011] In one feasible implementation, the step of performing reverberation time compensation on the phase-calibrated frequency response based on the reverberation time information in the room acoustic data and the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data to obtain the calibrated frequency response curve includes: determining the reverberation time length of different frequency bands based on the reverberation time information; for each frequency band, using the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, and based on its reverberation time length and corresponding compensation coefficient, performing reverberation time compensation on the frequency response of that frequency band after phase calibration, wherein the calibration rules define the compensation coefficients for the frequency response of each frequency band under different reverberation time lengths.

[0012] In one feasible implementation, the step of fitting and calculating the preset ideal frequency curve and the calibrated frequency response curve according to the optimization algorithm to obtain room-specific correction parameters includes: discretizing the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain a discretized ideal frequency point set and a calibration frequency point set; selecting a preset optimization algorithm, using the discretized ideal frequency point set as the target and the calibration frequency point set as the initial value, to construct an objective function, which is used to measure the error between the calibration frequency point set and the ideal frequency point set; iteratively optimizing the objective function using the optimization algorithm, continuously adjusting the parameters corresponding to the calibration frequency point set during the iteration process until a preset convergence condition is met; when the convergence condition is met, the finally adjusted parameters are determined as room-specific correction parameters.

[0013] In one feasible implementation, the step of discretizing the preset ideal frequency curve and the calibrated frequency response curve on the same frequency band to obtain a discretized ideal frequency point set and a calibration frequency point set includes: determining the discretized frequency band interval, wherein the frequency band interval is determined according to the frequency resolution of the audio device and the room acoustic characteristics; according to the frequency band interval, starting from the starting frequency of the preset ideal frequency curve and the calibrated frequency response curve, sequentially selecting the frequency values ​​corresponding to the center frequency of each frequency band as discretized frequency points; forming an ideal frequency point set by combining the frequency values ​​corresponding to each discretized frequency point of the ideal frequency curve, and forming a calibration frequency point set by combining the frequency values ​​corresponding to each discretized frequency point of the calibrated frequency response curve.

[0014] In one feasible implementation, the step of iteratively optimizing the objective function using the optimization algorithm, and continuously adjusting the parameters corresponding to the calibration frequency point set during the iteration until a preset convergence condition is met, includes: in each iteration, calculating the gradient of the objective function with respect to the parameters according to the selected optimization algorithm or directly solving the least squares problem to obtain the adjustment amount of the parameters; updating the parameters corresponding to the calibration frequency point set according to the adjustment amount; calculating the objective function value after updating the parameters, and comparing it with the objective function value of the previous iteration; If the difference between the objective function values ​​of two iterations is less than a preset threshold, or the number of iterations reaches the preset maximum number of iterations, then the convergence condition is met and the iteration stops; otherwise, the next iteration continues.

[0015] In one feasible implementation, the room acoustic calibration method for the audio device further includes: real-time monitoring of changes in room environmental parameters; when changes in environmental parameters exceed a preset threshold, automatically re-acquiring room response data to multi-band preset test signals; and re-executing subsequent acoustic calibration processes based on the new response data to generate room-specific calibration parameters adapted to the new environment, thereby readjusting the output of the audio device.

[0016] A second aspect of the present invention provides a room acoustic calibration device for an audio device, comprising: an acquisition module for acquiring room response data to a multi-band preset test signal and extracting room acoustic data using a time-frequency joint analysis method, wherein the room acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands; a processing module for performing compensation processing based on the room acoustic data using preset microphone calibration data to obtain a calibrated frequency response curve; a fitting module for performing fitting calculations on a preset ideal frequency curve and the calibrated frequency response curve according to an optimization algorithm to obtain room-specific calibration parameters; and an adjustment module for adjusting the output of the audio device accordingly based on the calibration parameters.

[0017] In one feasible implementation, the acquisition module includes: a playback unit, used to generate multiple preset test signals covering low, mid, and high frequencies through an audio device, and play the test signals in the room; an acquisition unit, used to acquire response data of the signals at multiple listening positions using multiple microphones; and an extraction unit, used to analyze the response data using a time-frequency joint analysis method combining short-time Fourier transform and continuous wavelet transform, and extract frequency attenuation, reflection path, phase shift, and reverberation time information of different frequency bands to obtain room acoustic data.

[0018] In one feasible implementation, the playback unit is specifically used to: determine the low-frequency band as the first frequency band range, the mid-frequency band as the second frequency band range, and the high-frequency band as the third frequency band range according to the commonly used operating frequency range of the audio device; within each frequency band range, uniformly select multiple frequency points at logarithmic intervals to generate a sine wave signal; superimpose the sine wave signals of different frequency bands according to a preset amplitude ratio and phase relationship to form a multi-band preset test signal covering low frequency, mid frequency, and high frequency, and play the test signal in the room.

[0019] In one feasible implementation, the processing module includes: a first compensation unit, configured to perform preliminary attenuation compensation on the frequency response in the room response data based on the frequency attenuation information in the room acoustic data and the corresponding frequency response characteristics in the preset microphone calibration data for different frequency bands; a correction unit, configured to analyze the interference degree of different reflection paths on signals of each frequency band based on the reflection path information in the room acoustic data, and perform reflection interference correction on the frequency response of the preliminary attenuation compensation based on the calibration parameters of the microphone calibration data regarding the influence of reflection paths; a calibration unit, configured to perform phase calibration on the frequency response after reflection interference correction based on the phase offset information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data; and a second compensation unit, configured to perform reverberation time compensation on the frequency response after phase calibration based on the reverberation time information in the room acoustic data and the calibration rules of the microphone calibration data regarding the influence of reverberation time on frequency response, to obtain a calibrated frequency response curve.

[0020] In one feasible implementation, the first compensation unit is specifically used to: divide different frequency bands into multiple sub-frequency bands; calculate the sum of the frequency attenuation value of each sub-frequency band and the frequency response attenuation compensation value of the corresponding sub-frequency band in the preset microphone calibration data, as the preliminary attenuation compensation value of the corresponding sub-frequency band; use the preliminary attenuation compensation value to compensate the frequency response of the corresponding sub-frequency band extracted from the room response data; and integrate the frequency responses of each sub-frequency band after compensation according to their respective frequency bands to obtain the frequency response of the corresponding frequency band.

[0021] In one feasible implementation, the correction unit is specifically used to: determine the primary and secondary reflection paths of each frequency band signal based on the reflection path information; for each frequency band, calculate the interference coefficient of the primary and secondary reflection paths on the signal of that frequency band, the interference coefficient being determined based on the length of the reflection path, the material characteristics of the reflective surface, and the room layout; and, in conjunction with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, the calibration parameters including frequency response correction factors under different reflection path interference, perform reflection interference correction on the frequency response of the corresponding frequency band after preliminary attenuation compensation based on the interference coefficient and the correction factor.

[0022] In one feasible implementation, the calibration unit is specifically used to: decompose the phase offset information according to frequency bands to obtain the phase offset amount of each frequency band; for each frequency band, add the phase offset amount of each frequency band to the phase calibration value of the corresponding frequency band in the microphone calibration data to obtain the phase calibration compensation value of that frequency band; and use the phase calibration compensation value to perform phase calibration on the frequency response of the corresponding frequency band after reflection interference correction.

[0023] In one feasible implementation, the second compensation unit is specifically used to: determine the reverberation time length of different frequency bands based on the reverberation time information; for each frequency band, using the calibration rules in the microphone calibration data regarding the influence of reverberation time on frequency response, and based on its reverberation time length and corresponding compensation coefficient, perform reverberation time compensation on the frequency response of the frequency band after phase calibration, wherein the calibration rules define the compensation coefficients for the frequency response of each frequency band under different reverberation time lengths.

[0024] In one feasible implementation, the fitting module includes: a processing unit, used to discretize the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain a discretized ideal frequency point set and a calibrated frequency point set; a construction unit, used to select a preset optimization algorithm, using the discretized ideal frequency point set as the target and the calibrated frequency point set as the initial value, to construct an objective function, the objective function being used to measure the error between the calibrated frequency point set and the ideal frequency point set; an iteration unit, used to iteratively optimize the objective function using the optimization algorithm, continuously adjusting the parameters corresponding to the calibrated frequency point set during the iteration process until a preset convergence condition is met; and a determination unit, used to determine the finally adjusted parameters as room-specific correction parameters when the convergence condition is met.

[0025] In one feasible implementation, the processing unit is specifically used to: determine the discretized frequency band interval, the frequency band interval being determined based on the frequency resolution of the audio device and the room acoustic characteristics; according to the frequency band interval, starting from the starting frequency of the preset ideal frequency curve and the calibrated frequency response curve, sequentially select the frequency values ​​corresponding to the center frequencies of each frequency band as discretized frequency points; form an ideal frequency point set by combining the frequency values ​​corresponding to each discretized frequency point of the ideal frequency curve, and form a calibration frequency point set by combining the frequency values ​​corresponding to each discretized frequency point of the calibrated frequency response curve.

[0026] In one feasible implementation, the iterative unit is specifically used to: calculate the gradient of the objective function with respect to the parameters according to the selected optimization algorithm or directly solve the least squares problem to obtain the adjustment amount of the parameters during each iteration; update the parameters corresponding to the calibration frequency point set according to the adjustment amount; calculate the objective function value after updating the parameters and compare it with the objective function value of the previous iteration; if the difference between the objective function values ​​of the two iterations is less than a preset threshold, or the number of iterations reaches the preset maximum number of iterations, then it is determined that the convergence condition is met and the iteration is stopped; otherwise, the next iteration continues.

[0027] In one feasible implementation, the room acoustic correction method for the audio device further includes: The environment adaptive module is used to monitor changes in room environmental parameters in real time. When the detected changes in environmental parameters exceed a preset threshold, it automatically reacquires the room's response data to preset multi-band test signals and re-executes the subsequent acoustic correction process based on the new response data to generate room-specific correction parameters adapted to the new environment, thereby readjusting the output of the audio device.

[0028] A third aspect of the present invention provides an electronic device, comprising: a memory and at least one processor, wherein the memory stores instructions; the at least one processor invokes the instructions in the memory to cause the electronic device to perform the above-described room acoustic correction method for an audio device.

[0029] A fourth aspect of the present invention provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the above-described room acoustic correction method for an audio device.

[0030] The technical solution provided by this invention involves acquiring room response data to multi-band preset test signals and extracting room acoustic data using a time-frequency joint analysis method. The room acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. Based on the room acoustic data, compensation processing is performed using preset microphone calibration data to obtain a calibrated frequency response curve. An optimization algorithm is used to fit and calculate the preset ideal frequency curve and the calibrated frequency response curve to obtain room-specific correction parameters. The output of the audio device is adjusted accordingly based on the correction parameters. In this embodiment of the invention, by acquiring the room's response data to multi-band preset test signals and using a time-frequency joint analysis method to extract the room's acoustic data, the method comprehensively covers frequency attenuation, reflection path, phase shift, and reverberation time information of different frequency bands. This allows for a more accurate understanding of the room's acoustic characteristics. Based on the comprehensive and accurate room acoustic data, the method uses preset microphone calibration data for compensation processing. By fitting the preset ideal frequency curve and the calibrated frequency response curve according to an optimization algorithm, the method obtains room-specific correction parameters, significantly improving the accuracy of the correction parameters. Consequently, the output of the audio equipment is adjusted accordingly based on the correction parameters, effectively improving the acoustic performance of the audio equipment in the room. Attached Figure Description

[0031] Figure 1 This is a schematic diagram of an embodiment of the room acoustic correction method for audio devices in this invention; Figure 2 This is a schematic diagram of another embodiment of the room acoustic correction method for audio devices in this invention; Figure 3This is a schematic diagram of another embodiment of the room acoustic correction method for audio devices in this invention; Figure 4 This is a schematic diagram of one embodiment of the room acoustic correction device for audio equipment in this invention; Figure 5 This is a schematic diagram of another embodiment of the room acoustic correction device for audio equipment in this invention; Figure 6 This is a schematic diagram of one embodiment of the electronic device in this invention. Detailed Implementation

[0032] This invention provides a method, apparatus, device, and storage medium for room acoustic correction of audio equipment, which improves the accuracy of correction parameters and correction effect, and effectively mitigates the impact of room acoustic environment.

[0033] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" or "having" and any variations thereof are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0034] It is understood that the executing entity of this invention can be a room acoustic correction device for an audio device, or it can be a terminal or a server; no specific limitation is made here. This embodiment of the invention will be described using a server as an example.

[0035] For ease of understanding, the specific process of the embodiments of the present invention is described below. Please refer to [link / reference]. Figure 1 One embodiment of the room acoustic correction method for audio devices in this invention includes: 101. Obtain the room's response data to multi-band preset test signals, and use the time-frequency joint analysis method to extract the room's acoustic data. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. The audio equipment plays multi-band test signals, covering frequency sweeps and pulse signals from low to high frequencies, and uses microphones to collect room reflection data. This can be done using a single mobile microphone or multiple microphones. Short-time Fourier transform is used to analyze frequency domain attenuation characteristics, while wavelet transform is combined to detect transient reflection components, extracting energy attenuation curves, early reflection path delays and directions, phase shifts, and reverberation times for each frequency band.

[0036] 102. Based on room acoustic data, compensation processing is performed using preset microphone calibration data to obtain the calibrated frequency response curve; Due to the characteristics of the microphone itself and the factors of the acquisition environment, the acquired room acoustic data may have certain deviations. The preset microphone calibration data contains correction information for factors such as microphone characteristics. By combining the microphone calibration data with the room acoustic data, the frequency response-related part of the room acoustic data is adjusted to obtain the calibrated frequency response curve. The calibrated frequency response curve can more accurately reflect the influence of the room's true acoustic characteristics on the audio frequency response.

[0037] When using preset microphone calibration data for compensation processing based on room acoustic data, the characteristics of each frequency band are first clarified. For frequency attenuation in different frequency bands, the frequency attenuation value in the room acoustic data is corrected by combining the gain deviation of that frequency band in the microphone calibration data. For the reflection path, the reflection path delay and direction data are adjusted according to the microphone's signal reception characteristics in different directions. Regarding phase shift, the phase information in the room acoustic data is corrected by referring to the phase response of the microphone calibration. The reverberation time is also optimized by combining the calibration parameters of the microphone for reverberation signal acquisition. Finally, by combining these corrections, a more accurate calibrated frequency response curve is obtained.

[0038] 103. The room-specific correction parameters are obtained by fitting the preset ideal frequency curve and the calibrated frequency response curve using the optimization algorithm. The preset ideal frequency response curve represents the frequency response state that the audio device is expected to achieve in an ideal acoustic environment, while the calibrated frequency response curve is the result of the actual room acoustic environment affecting the frequency response of the audio device. Through optimization algorithms, various parameters are continuously adjusted to make the calibrated frequency response curve as close as possible to the ideal frequency response curve. Finally, a set of room-specific correction parameters that can accurately describe the degree of influence of room acoustic characteristics on audio devices is obtained. The correction parameters include information on frequency adjustment, phase correction, and reverberation control, among other aspects.

[0039] Using the frequency data of each frequency point on the preset ideal frequency curve as the target value, and the corresponding frequency data on the calibrated frequency response curve as the observation value, the squared error between each pair of frequency data points is calculated and accumulated to obtain the total error. By iteratively adjusting the correction parameters, such as frequency gain and phase offset, the shape of the calibrated frequency response curve is continuously changed, so that the total error gradually decreases. When the total error reaches the preset minimum threshold or the number of iterations reaches the upper limit, the process stops. The correction parameters obtained at this time can make the calibrated frequency response curve fit the ideal frequency curve to the greatest extent. These parameters are the room-specific correction parameters.

[0040] 104. Adjust the output of the audio device accordingly based on the calibration parameters.

[0041] Based on the frequency adjustment information in the calibration parameters, the amplitude gain or attenuation of different frequency bands of the audio signal is adjusted by a filter to compensate for frequency response deviations caused by room acoustic characteristics. Based on the phase correction data in the calibration parameters, the phase of the audio signal is corrected using a phase adjustment circuit to eliminate phase distortion caused by factors such as room reflections. At the same time, according to the reverberation control instructions in the calibration parameters, a reverberation algorithm is used to dynamically adjust the reverberation effect of the audio signal, making the audio playback effect in the room clearer and more natural, thereby achieving accurate adjustment of the audio device output according to the calibration parameters.

[0042] In this embodiment of the invention, by acquiring the room's response data to multi-band preset test signals and using a time-frequency joint analysis method to extract the room's acoustic data, the method comprehensively covers frequency attenuation, reflection path, phase shift, and reverberation time information of different frequency bands. This allows for a more accurate understanding of the room's acoustic characteristics. Based on the comprehensive and accurate room acoustic data, the method uses preset microphone calibration data for compensation processing. By fitting the preset ideal frequency curve and the calibrated frequency response curve according to an optimization algorithm, the method obtains room-specific correction parameters, significantly improving the accuracy of the correction parameters. Consequently, the output of the audio equipment is adjusted accordingly based on the correction parameters, effectively improving the acoustic performance of the audio equipment in the room.

[0043] Please see Figure 2 Another embodiment of the room acoustic correction method for audio devices in this invention includes: 201. Generate multiple preset test signals covering low, mid and high frequencies using audio equipment, and play the test signals in the room; Based on the commonly used operating frequency range of audio equipment, the low-frequency band is determined as the first frequency band, the mid-frequency band as the second frequency band, and the high-frequency band as the third frequency band. Within each frequency band, multiple frequency points are selected evenly at logarithmic intervals to generate sine wave signals. The sine wave signals of different frequency bands are superimposed according to the preset amplitude ratio and phase relationship to form a multi-band preset test signal covering low, mid, and high frequencies. The test signal is then played in the room.

[0044] For example, for the low-frequency band, the first frequency band is defined as 20Hz - 200Hz. Within this band, 10 frequency points can be selected evenly at logarithmic intervals. For example, starting from 20Hz, the subsequent frequency points are 25.12Hz, 31.62Hz, 39.81Hz, 50.12Hz, 63.10Hz, 79.43Hz, 100Hz, 125.89Hz, and 158.49Hz, and then sinusoidal signals are generated for these frequency points.

[0045] The mid-frequency band, serving as the second frequency range, is set to 200Hz - 2000Hz. Similarly, 20 frequency points can be selected evenly at logarithmic intervals, such as 251.19Hz, 316.23Hz, 398.11Hz, etc., up to 2000Hz, and corresponding sine wave signals can be generated for these frequency points.

[0046] The high-frequency band, or the third frequency band, is defined as 2000Hz - 20000Hz. Within this relatively wide frequency band, 30 frequency points can be selected evenly at logarithmic intervals, starting from 2000Hz, with subsequent frequency points such as 2511.89Hz, 3162.28Hz, etc., up to 20000Hz, to generate corresponding sine wave signals.

[0047] After generating sinusoidal signals of different frequency bands, they are superimposed according to preset amplitude ratios and phase relationships. For example, the amplitude of the low-frequency signal can be set to 0.8 times that of the mid-frequency signal, and the amplitude of the high-frequency signal can be 0.6 times that of the mid-frequency signal; in terms of phase relationship, the phase difference between the low-frequency signal and the mid-frequency signal can be 0, and the phase difference between the high-frequency signal and the mid-frequency signal can be π / 4; through such settings, sinusoidal signals of different frequency bands are superimposed to form a multi-band preset test signal covering low, mid, and high frequencies.

[0048] 202. Collect signal response data at multiple listening positions using multiple microphones; Multiple listening positions are set up in the room, with a microphone placed at each position. When a multi-band preset test signal is played in the room, these microphones start working simultaneously to collect the response data generated by the signal at different positions in the room.

[0049] 203. The response data is analyzed by combining short-time Fourier transform and continuous wavelet transform, and the frequency attenuation, reflection path, phase shift and reverberation time information of different frequency bands are extracted to obtain room acoustic data. By performing frequency domain analysis on the acquired response data using short-time Fourier transform, the frequency attenuation characteristics of different frequency bands can be clearly observed. Simultaneously, by combining continuous wavelet transform to detect transient reflection components, reflection path information can be effectively extracted. Phase shift is obtained through phase information analysis, and reverberation time is calculated using relevant algorithms. Integrating these extracted information from different aspects yields room acoustic data that includes information on frequency attenuation, reflection path, phase shift, and reverberation time in different frequency bands.

[0050] 204. For different frequency bands, based on the frequency attenuation information in the room acoustic data and combined with the corresponding frequency response characteristics in the preset microphone calibration data, perform preliminary attenuation compensation on the frequency response in the room response data. The different frequency bands are divided into multiple sub-bands; the frequency attenuation value of each sub-band is calculated and the sum of the frequency response attenuation compensation value of the corresponding sub-band in the preset microphone calibration data is used as the initial attenuation compensation value of the corresponding sub-band; the initial attenuation compensation value is used to compensate the frequency response of the corresponding sub-band extracted from the room response data; the frequency response of each sub-band after compensation is integrated according to its frequency band to obtain the frequency response of the corresponding frequency band.

[0051] The different frequency bands, such as low frequency, mid frequency, and high frequency, are further subdivided into multiple sub-bands. For example, the low frequency band can be divided into 20-50Hz, 50-100Hz, and 100-200Hz. The frequency bands are divided into sub-bands, with mid-frequency and high-frequency bands also separated by appropriate intervals. Frequency attenuation values ​​for each sub-band are extracted from room acoustic data; these attenuation values ​​reflect the degree of attenuation caused by the room acoustic environment. Frequency response attenuation compensation values ​​for the corresponding sub-bands are obtained from preset microphone calibration data, based on the microphone's characteristics and standard testing environment. The frequency attenuation value for each sub-band is added to the corresponding frequency response attenuation compensation value from the preset microphone calibration data to obtain the initial attenuation compensation value for the corresponding sub-band. Using this initial attenuation compensation value, a linear or nonlinear compensation algorithm is employed to compensate the frequency response of the corresponding sub-band extracted from the room response data, correcting frequency response deviations caused by the room acoustic environment and microphone characteristics. The compensated frequency responses of each sub-band are then systematically integrated according to their respective frequency bands, and a weighted average or other integration algorithm is used to obtain a more accurate frequency response for the corresponding frequency band.

[0052] Where the frequency attenuation value in the room acoustic data of the i-th sub-band is A r,i The frequency response attenuation compensation value for the corresponding sub-band in the microphone calibration data is A. m,i Then the initial attenuation compensation value A for this sub-frequency band c,i The calculation formula is: A c,i =A r,i +A m,i If the original frequency response amplitude of the i-th sub-band extracted from the room response data is M r,i The frequency response amplitude M after initial attenuation compensation c-r,i It can be calculated using the linear compensation formula:

[0053] Here we use This is because frequency response is usually measured in decibels (dB), and the conversion relationship between amplitude and decibels is A = 20log 10 (M), so this formula is used when converting from the decibel compensation value back to the amplitude compensation factor.

[0054] If the j-th frequency band is divided into n sub-bands, the frequency response amplitude of the k-th sub-band after compensation is: The corresponding weight is The frequency response amplitude after integration of this frequency band The calculation formula is:

[0055] 205. Based on the reflection path information in the room acoustic data, analyze the interference degree of different reflection paths on signals of each frequency band, and combine the calibration parameters of the microphone calibration data on the influence of reflection paths to correct the reflection interference of the frequency response of the initial attenuation compensation. Based on the reflection path information, the primary and secondary reflection paths of signals in each frequency band are determined. For each frequency band, the interference coefficients of the primary and secondary reflection paths are calculated. The interference coefficients are determined based on the length of the reflection path, the material properties of the reflective surface, and the room layout. Combined with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, which include frequency response correction factors under different reflection path interference, the frequency response of the corresponding frequency band after preliminary attenuation compensation is corrected for reflection interference based on the interference coefficients and correction factors.

[0056] Based on the reflection path information, the signal energy percentage of each path is statistically analyzed. Paths with a high percentage and significant impact on sound quality are designated as primary reflection paths; those with a lower percentage and less impact are designated as secondary reflection paths.

[0057] For each frequency band, when calculating the interference coefficients of the primary and secondary reflection paths, a basic interference factor is first set based on the length of the reflection path. Generally, the longer the path, the smaller the basic interference factor. The influence of length on interference can be quantified by following the inverse law of path length. Next, based on the material characteristics of the reflecting surface, the sound absorption coefficient is used to determine the material influence factor. The larger the sound absorption coefficient, the more sound energy the material absorbs, the less sound energy is reflected, and the less interference to the signal. The material influence factor can be set to 1 minus the sound absorption coefficient. Then, the distribution density of obstacles in the room layout is combined to construct the layout influence factor. The denser the distribution of obstacles, the more complex the reflection and scattering of the signal, and the greater the interference. Finally, these three factors are weighted and summed according to certain weights to obtain the interference coefficient of the reflection path for the frequency band signal.

[0058] Let the length of the reflection path be... Its basic interference factor is , ,in The constant coefficient is length-dependent and used to adjust the order of magnitude of the fundamental interference factor; the sound absorption coefficient of the reflecting surface is... Material influencing factor is The density of obstacles in the room layout is The layout influence factor is ,in, ,in Let the constant coefficients be those related to the layout; and let the weights of the three factors be respectively... , and ,and The formula for calculating the interference coefficient I of the reflected path to the signal in this frequency band is:

[0059] 206. Based on the phase offset information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data, perform phase calibration on the frequency response after reflection interference correction. The phase offset information is decomposed according to frequency bands to obtain the phase offset of each frequency band. For each frequency band, the phase offset of each frequency band is added to the phase calibration value of the corresponding frequency band in the microphone calibration data to obtain the phase calibration compensation value of that frequency band. The phase calibration compensation value is used to perform phase calibration on the frequency response of the corresponding frequency band after the reflection interference correction.

[0060] During phase calibration, the phase offset information is first precisely extracted from the room acoustic data. This phase offset information reflects the phase changes caused by the acoustic environment during signal propagation within the room. Next, according to frequency band division rules, the extracted phase offset information is divided into different frequency bands such as low frequency, mid frequency, and high frequency, thus obtaining the phase offset amount corresponding to each frequency band. Then, the phase calibration value corresponding to each frequency band is obtained from the microphone calibration data. These calibration values ​​are derived from test data of the microphone under standard conditions and are used to compensate for the influence of the microphone's own characteristics on the phase. For each frequency band, the phase offset amount of that band is added to the corresponding phase calibration value in the microphone calibration data to obtain the phase calibration compensation value for that band. Finally, the calculated phase calibration compensation value is used to perform phase calibration processing on the frequency response of the corresponding frequency band after reflection interference correction.

[0061] Let the phase offset of the i-th frequency band be... The phase calibration value of the i-th frequency band in the microphone calibration data is Then the phase calibration compensation value of the i-th frequency band The calculation formula is:

[0062] After obtaining the phase calibration compensation value, phase calibration is performed on the frequency response of the i-th frequency band after reflection interference correction. Assume the frequency response signal of the i-th frequency band after reflection interference correction is... ,in For amplitude function, This is the center frequency of the frequency band. The original phase function, the signal after phase calibration. It can be represented as:

[0063] 207. Based on the reverberation time information in the room acoustic data and the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, reverberation time compensation is performed on the frequency response after phase calibration to obtain the calibrated frequency response curve. Based on the reverberation time information, the reverberation time length of different frequency bands is determined. For each frequency band, the reverberation time compensation is performed on the frequency response of the phase-calibrated frequency band according to the calibration rules on the influence of reverberation time on frequency response in the microphone calibration data, based on its reverberation time length and the corresponding compensation coefficient. The calibration rules define the compensation coefficients for the frequency response of each frequency band under different reverberation time lengths.

[0064] The reverberation time lengths for different frequency bands, such as low-frequency, mid-frequency, and high-frequency, are determined. Reverberation time reflects the time it takes for sound to decay to a certain value within a room from the cessation of sound source emission. Different frequency bands have different propagation characteristics within a room, resulting in varying reverberation times. Next, calibration rules regarding the impact of reverberation time on frequency response are obtained from microphone calibration data. These rules are derived from extensive experimental data and theoretical analysis, clarifying the compensation coefficients required for the frequency response of each frequency band under different reverberation time lengths. For each frequency band, the corresponding compensation coefficient is found in the calibration rules based on its determined reverberation time length. This compensation coefficient is then used to compensate for the reverberation time of the frequency response after phase calibration. The compensation method typically involves adjusting the amplitude or phase of the frequency response to offset deviations caused by excessively long or short reverberation times, ultimately yielding the calibrated frequency response curve.

[0065] 208. Based on the optimization algorithm, fit and calculate the preset ideal frequency curve and the calibrated frequency response curve to obtain the room-specific correction parameters; 209. Adjust the output of the audio device accordingly based on the calibration parameters.

[0066] In this embodiment of the invention, multiple preset test signals are generated by an audio device and played in a room. Response data is collected using multiple microphones, and room acoustic data is extracted using a time-frequency joint analysis method. Then, combined with preset microphone calibration data, the frequency response of the room response data is sequentially subjected to preliminary attenuation compensation, reflection interference correction, phase calibration, and reverberation time compensation to obtain a calibrated frequency response curve. Finally, based on an optimization algorithm, the ideal frequency curve and the calibrated curve are fitted to obtain specific room correction parameters, and the audio device output is adjusted. This method can accurately adapt to the room's acoustic characteristics, improve the accuracy of the correction parameters, and significantly enhance the audio output quality of the audio device in a specific room.

[0067] Please see Figure 3 Another embodiment of the room acoustic correction method for audio devices in this invention includes: 301. Obtain the room's response data to multi-band preset test signals, and use the time-frequency joint analysis method to extract the room's acoustic data. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. 302. Based on room acoustic data, compensation processing is performed using preset microphone calibration data to obtain the calibrated frequency response curve; 303. Discretize the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain the discretized ideal frequency point set and calibration frequency point set. The frequency band spacing for discretization is determined based on the frequency resolution of the audio equipment and the acoustic characteristics of the room. According to the frequency band spacing, starting from the starting frequency of the preset ideal frequency curve and the calibrated frequency response curve, the frequency values ​​corresponding to the center frequency of each frequency band are selected sequentially as discretized frequency points. The frequency values ​​corresponding to each discretized frequency point of the ideal frequency curve are used to form the ideal frequency point set, and the frequency values ​​corresponding to each discretized frequency point of the calibrated frequency response curve are used to form the calibration frequency point set.

[0068] Using a predetermined frequency band interval as a reference, starting from the common starting frequency position of the preset ideal frequency curve and the calibrated frequency response curve, the first frequency band range is defined, the center frequency value of the frequency band is calculated, and it is selected as the first discretized frequency point. Starting from the end frequency of the frequency band, the next frequency band is determined by moving backward according to the frequency band interval, and the center frequency value of this frequency band is calculated again as the second discretized frequency point. This process is repeated along the frequency axis, continuously dividing the frequency bands, calculating the center frequency, and selecting the frequency point until the entire frequency range to be analyzed is covered, thus obtaining a series of discretized frequency points.

[0069] 304. Select a preset optimization algorithm, take the discretized ideal frequency point set as the target and the calibration frequency point set as the initial value, and construct an objective function. The objective function is used to measure the error between the calibration frequency point set and the ideal frequency point set. If the gradient descent method is used, the desired target state corresponding to the frequency values ​​of each point in the discretized ideal frequency point set is taken as the benchmark. The calibration frequency point set is used as the initial input value of the algorithm iteration. The objective function is constructed by calculating the sum of squares of the differences between the calibration frequency point set and the ideal frequency point set at corresponding frequency points. This objective function can intuitively reflect the degree of error between the two. If the least squares method is used, the ideal frequency point set is also taken as the objective and the calibration frequency point set is taken as the initial value. The objective function constructed is the sum of squares of the errors between the calibration frequency point set and the ideal frequency point set at each discrete frequency point, which measures the error between the two.

[0070] 305. Use optimization algorithms to iteratively optimize the objective function, continuously adjusting the parameters corresponding to the calibration frequency point set during the iteration process until the preset convergence condition is met. In each iteration, the gradient of the objective function with respect to the parameters is calculated according to the selected optimization algorithm or the least squares problem is solved directly to obtain the parameter adjustment amount; the parameters corresponding to the calibration frequency point set are updated according to the adjustment amount; the objective function value after updating the parameters is calculated and compared with the objective function value of the previous iteration; if the difference between the objective function values ​​of the two iterations is less than the preset threshold, or the number of iterations reaches the preset maximum number of iterations, the convergence condition is satisfied and the iteration stops; otherwise, the next iteration continues.

[0071] In each iteration, if gradient descent is chosen as the optimization algorithm, the partial derivatives of the objective function with respect to the parameters corresponding to the calibration frequency point set are calculated based on the gradient descent principle. This yields the gradient of the objective function on these parameters, and the direction of this gradient indicates the parameter adjustment direction that causes the objective function value to decrease the fastest. The parameter adjustment is obtained by multiplying the gradient value by a preset learning rate. If least squares is chosen, the normal equations related to the least squares problem are directly constructed and solved to obtain the parameter adjustment. Next, the calculated parameter adjustment is added to or subtracted from the parameters corresponding to the current calibration frequency point set to update the parameters. Then, the objective function value is recalculated using the updated calibration frequency point set, and compared with the objective function value obtained in the previous iteration. The absolute value of the difference between the two iterations is calculated. If this absolute value is less than a preset convergence threshold, or if the current iteration count has reached the preset maximum iteration count, the convergence condition is met, and the iteration process stops. If the above conditions are not met, the updated calibration frequency point set is used as the new initial value, and the next iteration continues.

[0072] 306. When the convergence condition is met, the parameters obtained from the final adjustment are determined as the room-specific correction parameters; 307. Adjust the output of the audio device accordingly based on the calibration parameters; 308. Real-time monitoring of changes in room environmental parameters. When changes in environmental parameters exceed preset thresholds, the system automatically reacquires the room's response data to preset multi-band test signals and re-executes the subsequent acoustic calibration process based on the new response data to generate room-specific calibration parameters adapted to the new environment, thereby readjusting the output of the audio equipment.

[0073] The system monitors changes in room environmental parameters in real time. If changes in environmental parameters such as temperature, humidity, and noise levels exceed preset thresholds, it will automatically trigger the reacquisition of room response data to multi-band preset test signals. Subsequently, based on the newly acquired response data, the system re-executes each step of the acoustic calibration process, including determining matching results, calculating reference parameters and adjustment ranges, interpolation processing, and parameter optimization, to generate room-specific calibration parameters adapted to the new environment. Finally, these new calibration parameters are used to readjust the output of the audio equipment to ensure that the audio equipment can output high-quality audio under different environmental conditions.

[0074] In this embodiment of the invention, by acquiring the room's response data to multi-band preset test signals and extracting the room's acoustic data, and combining it with microphone calibration data to obtain the calibrated frequency response curve, and then through discretization processing, constructing an objective function, and iteratively optimizing using an optimization algorithm, room-specific correction parameters can be accurately generated. This effectively improves the acoustic performance of audio equipment in a specific room and enhances the audio output quality. At the same time, changes in room environmental parameters are monitored in real time. When the changes exceed a threshold, the response data is automatically reacquired and the acoustic calibration process is re-executed to generate correction parameters adapted to the new environment. The audio equipment output is then readjusted to ensure that the audio equipment can continuously output high-quality audio under different environmental conditions, thereby enhancing the adaptability and stability of the equipment.

[0075] The room acoustic correction method for audio devices in embodiments of the present invention has been described above. The room acoustic correction device for audio devices in embodiments of the present invention will be described below. Please refer to [link / reference]. Figure 4 One embodiment of the room acoustic correction device for audio equipment in this invention includes: The acquisition module 401 is used to acquire the room's response data to multi-band preset test signals and to extract the room's acoustic data using a time-frequency joint analysis method. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. The processing module 402 is used to perform compensation processing based on room acoustic data and preset microphone calibration data to obtain the calibrated frequency response curve. The fitting module 403 is used to perform fitting calculations on the preset ideal frequency curve and the calibrated frequency response curve according to the optimization algorithm to obtain room-specific correction parameters. The adjustment module 404 is used to adjust the output of the audio device according to the calibration parameters.

[0076] In this embodiment of the invention, by acquiring the room's response data to multi-band preset test signals and using a time-frequency joint analysis method to extract the room's acoustic data, the method comprehensively covers frequency attenuation, reflection path, phase shift, and reverberation time information of different frequency bands. This allows for a more accurate understanding of the room's acoustic characteristics. Based on the comprehensive and accurate room acoustic data, the method uses preset microphone calibration data for compensation processing. By fitting the preset ideal frequency curve and the calibrated frequency response curve according to an optimization algorithm, the method obtains room-specific correction parameters, significantly improving the accuracy of the correction parameters. Consequently, the output of the audio equipment is adjusted accordingly based on the correction parameters, effectively improving the acoustic performance of the audio equipment in the room.

[0077] Please see Figure 5 Another embodiment of the room acoustic correction device for audio equipment in this invention includes: The acquisition module 401 is used to acquire the room's response data to multi-band preset test signals and to extract the room's acoustic data using a time-frequency joint analysis method. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. The processing module 402 is used to perform compensation processing based on room acoustic data and preset microphone calibration data to obtain the calibrated frequency response curve. The fitting module 403 is used to perform fitting calculations on the preset ideal frequency curve and the calibrated frequency response curve according to the optimization algorithm to obtain room-specific correction parameters. The adjustment module 404 is used to adjust the output of the audio device according to the calibration parameters.

[0078] Optionally, the acquisition module 401 includes: The playback unit 4011 is used to generate multiple preset test signals covering low frequency, mid frequency and high frequency through an audio device, and play the test signals in the room; The acquisition unit 4012 is used to acquire response data of signals from multiple microphones at multiple listening positions; Extraction unit 4013 is used to analyze the response data using a time-frequency joint analysis method that combines short-time Fourier transform and continuous wavelet transform, and extract frequency attenuation, reflection path, phase shift and reverberation time information of different frequency bands to obtain room acoustic data.

[0079] Optionally, the playback unit 4011 can be specifically used for: Based on the commonly used operating frequency range of audio equipment, the low-frequency band is determined as the first frequency band, the mid-frequency band as the second frequency band, and the high-frequency band as the third frequency band. Within each frequency band, multiple frequency points are selected evenly at logarithmic intervals to generate sine wave signals. The sine wave signals of different frequency bands are superimposed according to the preset amplitude ratio and phase relationship to form a multi-band preset test signal covering low, mid, and high frequencies. The test signal is then played in the room.

[0080] Optionally, the processing module 402 includes: The first compensation unit 4021 is used to perform preliminary attenuation compensation on the frequency response in the room response data based on the frequency attenuation information in the room acoustic data and the corresponding frequency response characteristics in the preset microphone calibration data for different frequency bands. The correction unit 4022 is used to analyze the degree of interference of different reflection paths to signals of each frequency band based on the reflection path information in the room acoustic data, and to correct the reflection interference of the frequency response of the initial attenuation compensation by combining the calibration parameters of the microphone calibration data regarding the influence of the reflection path. The calibration unit 4023 is used to perform phase calibration on the frequency response after reflection interference correction based on the phase offset information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data. The second compensation unit 4024 is used to compensate for the reverberation time of the frequency response after phase calibration based on the reverberation time information in the room acoustic data and the calibration rules on the influence of reverberation time on frequency response in the microphone calibration data, so as to obtain the calibrated frequency response curve.

[0081] Optionally, the first compensation unit 4021 can be specifically used for: The different frequency bands are divided into multiple sub-bands; the frequency attenuation value of each sub-band is calculated and the sum of the frequency response attenuation compensation value of the corresponding sub-band in the preset microphone calibration data is used as the initial attenuation compensation value of the corresponding sub-band; the initial attenuation compensation value is used to compensate the frequency response of the corresponding sub-band extracted from the room response data; the frequency response of each sub-band after compensation is integrated according to its frequency band to obtain the frequency response of the corresponding frequency band.

[0082] Optionally, the correction unit 4022 can be specifically used for: Based on the reflection path information, the primary and secondary reflection paths of signals in each frequency band are determined. For each frequency band, the interference coefficients of the primary and secondary reflection paths are calculated. The interference coefficients are determined based on the length of the reflection path, the material properties of the reflective surface, and the room layout. Combined with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, which include frequency response correction factors under different reflection path interference, the frequency response of the corresponding frequency band after preliminary attenuation compensation is corrected for reflection interference based on the interference coefficients and correction factors.

[0083] Optionally, the calibration unit 4023 can be specifically used for: The phase offset information is decomposed according to frequency bands to obtain the phase offset of each frequency band. For each frequency band, the phase offset of each frequency band is added to the phase calibration value of the corresponding frequency band in the microphone calibration data to obtain the phase calibration compensation value of that frequency band. The phase calibration compensation value is used to perform phase calibration on the frequency response of the corresponding frequency band after the reflection interference correction.

[0084] Optionally, the second compensation unit 4024 can be used for: Based on the reverberation time information, the reverberation time length of different frequency bands is determined. For each frequency band, the reverberation time compensation is performed on the frequency response of the phase-calibrated frequency band according to the calibration rules on the influence of reverberation time on frequency response in the microphone calibration data, based on its reverberation time length and the corresponding compensation coefficient. The calibration rules define the compensation coefficients for the frequency response of each frequency band under different reverberation time lengths.

[0085] Optionally, the fitting module 403 includes: Processing unit 4031 is used to discretize the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain a discretized ideal frequency point set and a calibrated frequency point set. The construction unit 4032 is used to select a preset optimization algorithm, with the discretized ideal frequency point set as the target and the calibration frequency point set as the initial value, to construct an objective function. The objective function is used to measure the error between the calibration frequency point set and the ideal frequency point set. The iteration unit 4033 is used to iteratively optimize the objective function using an optimization algorithm. During the iteration process, the parameters corresponding to the calibration frequency point set are continuously adjusted until the preset convergence condition is met. The determination unit 4034 is used to determine the final adjusted parameters as room-specific correction parameters when the convergence condition is met.

[0086] Optionally, the processing unit 4031 may be specifically used for: The frequency band spacing for discretization is determined based on the frequency resolution of the audio equipment and the acoustic characteristics of the room. According to the frequency band spacing, starting from the starting frequency of the preset ideal frequency curve and the calibrated frequency response curve, the frequency values ​​corresponding to the center frequency of each frequency band are selected sequentially as discretized frequency points. The frequency values ​​corresponding to each discretized frequency point of the ideal frequency curve are used to form the ideal frequency point set, and the frequency values ​​corresponding to each discretized frequency point of the calibrated frequency response curve are used to form the calibration frequency point set.

[0087] Optionally, the iteration unit 4033 can be specifically used for: In each iteration, the gradient of the objective function with respect to the parameters is calculated according to the selected optimization algorithm or the least squares problem is solved directly to obtain the parameter adjustment amount; the parameters corresponding to the calibration frequency point set are updated according to the adjustment amount; the objective function value after updating the parameters is calculated and compared with the objective function value of the previous iteration; if the difference between the objective function values ​​of the two iterations is less than the preset threshold, or the number of iterations reaches the preset maximum number of iterations, the convergence condition is satisfied and the iteration stops; otherwise, the next iteration continues.

[0088] Optionally, the device also includes: The environmental adaptive module 405 is used to monitor changes in room environmental parameters in real time. When the detected changes in environmental parameters exceed the preset threshold, it automatically reacquires the room's response data to the preset multi-band test signals and re-executes the subsequent acoustic correction process based on the new response data to generate room-specific correction parameters that adapt to the new environment, thereby readjusting the output of the audio equipment.

[0089] In this embodiment of the invention, by acquiring the room's response data to multi-band preset test signals and extracting the room's acoustic data, and combining it with microphone calibration data to obtain the calibrated frequency response curve, and then through discretization processing, constructing an objective function, and iteratively optimizing using an optimization algorithm, room-specific correction parameters can be accurately generated. This effectively improves the acoustic performance of audio equipment in a specific room and enhances the audio output quality. At the same time, changes in room environmental parameters are monitored in real time. When the changes exceed a threshold, the response data is automatically reacquired and the acoustic calibration process is re-executed to generate correction parameters adapted to the new environment. The audio equipment output is then readjusted to ensure that the audio equipment can continuously output high-quality audio under different environmental conditions, thereby enhancing the adaptability and stability of the equipment.

[0090] above Figure 4 and Figure 5 The room acoustic correction device of the audio equipment in the embodiments of the present invention will be described in detail from the perspective of modular functional entities. The electronic equipment in the embodiments of the present invention will be described in detail from the perspective of hardware processing.

[0091] See Figure 6 As shown, the electronic device includes a processor 600 and a memory 601. The memory 601 stores machine-executable instructions that can be executed by the processor 600. The processor 600 executes the machine-executable instructions to implement the room acoustic correction method of the audio device described above.

[0092] Furthermore, Figure 6 The electronic device shown also includes a bus 602 and a communication interface 603. The processor 600, the communication interface 603, and the memory 601 are connected via the bus 602.

[0093] The memory 601 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 603 (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc. The bus 602 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 6 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0094] The processor 600 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 600 or by instructions in software form. The processor 600 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this disclosure can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 601. Processor 600 reads the information in memory 601 and, in conjunction with its hardware, completes the method steps of the aforementioned embodiment.

[0095] The present invention also provides an electronic device, the computer device including a memory and a processor, the memory storing computer-readable instructions, which, when executed by the processor, cause the processor to perform the steps of the room acoustic correction method for the audio device in the above embodiments. The present invention also provides a computer-readable storage medium, which can be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium, storing instructions that, when executed on a computer, cause the computer to perform the steps of the room acoustic correction method for the audio device.

[0096] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0097] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0098] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for room acoustic correction of an audio device, characterized in that, The room acoustic correction method for the audio device includes: The room's response data to multi-band preset test signals is acquired, and the room's acoustic data is extracted using a time-frequency joint analysis method. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. Based on the room acoustic data, compensation processing is performed using preset microphone calibration data to obtain a calibrated frequency response curve. This includes: dividing different frequency bands into multiple sub-bands; extracting the frequency attenuation value of each sub-band from the room acoustic data, where the frequency attenuation value reflects the degree of attenuation by the room acoustic environment; obtaining the frequency response attenuation compensation value for the corresponding sub-band from the preset microphone calibration data, where the frequency response attenuation compensation value is derived based on the microphone's own characteristics and a standard testing environment; adding the frequency attenuation value of each sub-band to the corresponding frequency response attenuation compensation value in the preset microphone calibration data to obtain a preliminary attenuation compensation value for the corresponding sub-band; and using this preliminary attenuation compensation value, employing a linear compensation algorithm or a nonlinear compensation algorithm to compensate the frequency response of the corresponding sub-band extracted from the room acoustic data, thereby correcting the room acoustics. Frequency response deviations caused by environmental and microphone characteristics are analyzed. The compensated frequency responses of each sub-band are then systematically integrated according to their respective frequency bands to obtain the corresponding frequency response. Based on the reflection path information in the room acoustic data, the interference level of different reflection paths on each frequency band signal is analyzed. Combined with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, the frequency response of the initial attenuation compensation is corrected for reflection interference. Based on the phase shift information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data, the frequency response after reflection interference correction is phase-calibrated. Based on the reverberation time information in the room acoustic data and the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, the frequency response after phase calibration is reverberated for reverberation time compensation to obtain the calibrated frequency response curve. The room-specific correction parameters are obtained by fitting the preset ideal frequency curve and the calibrated frequency response curve using an optimization algorithm. The output of the audio device is adjusted accordingly based on the correction parameters.

2. The room acoustic correction method for audio equipment according to claim 1, characterized in that, The process of acquiring room acoustic data by obtaining room response data to multi-band preset test signals includes: The audio equipment generates multiple preset test signals covering low, mid, and high frequencies, and plays the test signals in the room. Response data of signals are collected using multiple microphones at multiple listening positions; The response data is analyzed using a time-frequency joint analysis method that combines short-time Fourier transform and continuous wavelet transform to extract information on frequency attenuation, reflection path, phase shift, and reverberation time in different frequency bands, thereby obtaining room acoustic data.

3. The room acoustic correction method for audio equipment according to claim 2, characterized in that, The step of generating multiple preset test signals covering low, mid, and high frequencies using an audio device and playing these test signals in a room includes: Based on the commonly used operating frequency range of audio equipment, the low frequency band is determined as the first frequency band, the mid frequency band as the second frequency band, and the high frequency band as the third frequency band. Within each frequency band, multiple frequency points are selected evenly at logarithmic intervals to generate a sinusoidal signal. Sine wave signals of different frequency bands are superimposed according to a preset amplitude ratio and phase relationship to form a multi-band preset test signal covering low frequency, mid frequency and high frequency, and the test signal is played in the room.

4. The room acoustic correction method for an audio device according to claim 1, characterized in that, Based on the reflection path information in the room acoustic data, the interference level of different reflection paths on signals in each frequency band is analyzed. Combined with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, reflection interference correction is applied to the frequency response of the initial attenuation compensation, including: Based on the reflection path information, the primary and secondary reflection paths of signals in each frequency band are determined; For each frequency band, the interference coefficients of the primary and secondary reflection paths for that frequency band signal are calculated, and the interference coefficients are determined based on the length of the reflection path, the material properties of the reflecting surface, and the room layout. The calibration parameters regarding the influence of reflection paths in the microphone calibration data are combined. These calibration parameters include frequency response correction factors under different reflection path interferences. The frequency response of the corresponding frequency band after preliminary attenuation compensation is corrected for reflection interference based on the interference coefficient and the correction factors.

5. The room acoustic correction method for an audio device according to claim 1, characterized in that, The step of performing phase calibration on the frequency response after reflection interference correction based on the phase shift information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data includes: The phase offset information is decomposed according to frequency bands to obtain the phase offset amount of each frequency band; For each frequency band, the phase offset of each frequency band is added to the phase calibration value of the corresponding frequency band in the microphone calibration data to obtain the phase calibration compensation value of that frequency band. The phase calibration compensation value is used to perform phase calibration on the frequency response of the corresponding frequency band after the reflection interference correction.

6. The room acoustic correction method for an audio device according to claim 1, characterized in that, Based on the reverberation time information in the room acoustic data, and combined with the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, reverberation time compensation is performed on the frequency response after phase calibration to obtain the calibrated frequency response curve, including: Based on the reverberation time information, the reverberation time length of different frequency bands is determined; For each frequency band, using the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, reverberation time compensation is performed on the frequency response of the frequency band after phase calibration based on its reverberation time length and the corresponding compensation coefficient. The calibration rules define the compensation coefficients for the frequency response of each frequency band under different reverberation time lengths.

7. The room acoustic correction method for an audio device according to claim 1, characterized in that, The step of fitting and calculating the preset ideal frequency curve and the calibrated frequency response curve using an optimization algorithm to obtain room-specific correction parameters includes: Discretize the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain the discretized ideal frequency point set and the calibrated frequency point set. A preset optimization algorithm is selected, with the discretized ideal frequency point set as the target and the calibration frequency point set as the initial value, to construct an objective function. The objective function is used to measure the error between the calibration frequency point set and the ideal frequency point set. The objective function is iteratively optimized using the aforementioned optimization algorithm, and the parameters corresponding to the calibration frequency point set are continuously adjusted during the iteration process until the preset convergence condition is met. When the convergence condition is met, the final adjusted parameters will be determined as room-specific correction parameters.

8. The room acoustic correction method for an audio device according to claim 7, characterized in that, The step of discretizing the preset ideal frequency curve and the calibrated frequency response curve in the same frequency band to obtain the discretized ideal frequency point set and the calibrated frequency point set includes: Determine the discrete frequency band spacing, which is determined based on the frequency resolution of the audio device and the room acoustic characteristics; According to the frequency band interval, starting from the starting frequency of the preset ideal frequency curve and the calibrated frequency response curve, the frequency values ​​corresponding to the center frequency of each frequency band are selected sequentially as the discretized frequency points. The frequency values ​​corresponding to each discretized frequency point of the ideal frequency curve are used to form the ideal frequency point set, and the frequency values ​​corresponding to each discretized frequency point of the calibrated frequency response curve are used to form the calibration frequency point set.

9. The room acoustic correction method for an audio device according to claim 7, characterized in that, The step of iteratively optimizing the objective function using the optimization algorithm, and continuously adjusting the parameters corresponding to the calibration frequency point set during the iteration process until the preset convergence condition is met, includes: In each iteration, the gradient of the objective function with respect to the parameters is calculated according to the selected optimization algorithm, or the least squares problem is solved directly to obtain the adjustment amount of the parameters; Update the parameters corresponding to the calibration frequency point set according to the adjustment amount; Calculate the objective function value after updating the parameters and compare it with the objective function value of the previous iteration. If the difference between the objective function values ​​of the two iterations is less than a preset threshold, or the number of iterations reaches the preset maximum number of iterations, then the convergence condition is met and the iteration stops; otherwise, continue to the next iteration.

10. The room acoustic correction method for an audio device according to any one of claims 1-9, characterized in that, The room acoustic correction method for the audio device also includes: The system monitors changes in room environmental parameters in real time. When the changes exceed a preset threshold, it automatically reacquires the room's response data to preset multi-band test signals and re-executes the subsequent acoustic calibration process based on the new response data to generate room-specific calibration parameters adapted to the new environment, thereby readjusting the output of the audio device.

11. A room acoustic correction device for an audio device, characterized in that, The room acoustic correction device of the audio equipment includes: The acquisition module is used to acquire the room's response data to multi-band preset test signals and to extract the room's acoustic data using a time-frequency joint analysis method. The room's acoustic data includes frequency attenuation, reflection path, phase shift, and reverberation time information for different frequency bands. The processing module is used to perform compensation processing based on the room acoustic data and preset microphone calibration data to obtain a calibrated frequency response curve. This includes: dividing different frequency bands into multiple sub-bands; extracting the frequency attenuation value of each sub-band from the room acoustic data, where the frequency attenuation value reflects the degree of attenuation by the room acoustic environment; obtaining the frequency response attenuation compensation value of the corresponding sub-band from the preset microphone calibration data, where the frequency response attenuation compensation value is derived based on the microphone's own characteristics and a standard testing environment; adding the frequency attenuation value of each sub-band to the frequency response attenuation compensation value of the corresponding sub-band from the preset microphone calibration data to obtain a preliminary attenuation compensation value for the corresponding sub-band; and using this preliminary attenuation compensation value, employing a linear compensation algorithm or a nonlinear compensation algorithm to compensate the frequency response of the corresponding sub-band extracted from the room acoustic data to correct... Frequency response deviations caused by room acoustic environment and microphone characteristics are analyzed. The compensated frequency responses of each sub-band are then systematically integrated according to their respective frequency bands to obtain the corresponding frequency response. Based on the reflection path information in the room acoustic data, the interference level of different reflection paths on each frequency band signal is analyzed. Combined with the calibration parameters regarding the influence of reflection paths in the microphone calibration data, reflection interference correction is applied to the frequency response after initial attenuation compensation. Based on the phase shift information in the room acoustic data and the phase calibration value of the corresponding frequency band in the microphone calibration data, phase calibration is performed on the frequency response after reflection interference correction. Based on the reverberation time information in the room acoustic data and the calibration rules regarding the influence of reverberation time on frequency response in the microphone calibration data, reverberation time compensation is applied to the phase-calibrated frequency response to obtain the calibrated frequency response curve. The fitting module is used to perform fitting calculations on the preset ideal frequency curve and the calibrated frequency response curve according to the optimization algorithm to obtain room-specific correction parameters. The adjustment module is used to adjust the output of the audio device according to the correction parameters.

12. An electronic device, characterized in that, The electronic device includes: a memory and at least one processor, wherein the memory stores instructions; The at least one processor invokes the instructions in the memory to cause the electronic device to perform the room acoustic correction method for an audio device as described in any one of claims 1-10.

13. A computer-readable storage medium storing instructions thereon, characterized in that, When the instructions are executed by the processor, they implement the room acoustic correction method for the audio device as described in any one of claims 1-10.

Images