A multi-channel audio data processing and analysis system
By constructing a three-dimensional coordinate system and a multi-channel audio data processing and analysis system for separated channel signals within the speaker, the accuracy and objectivity issues of speaker audio playback quality testing are solved, and detailed evaluation of each channel and screening of low-quality channels are achieved.
Patent Information
- Application Number
- CN202211462825.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-22
- Publication Date
- 2025-09-19
- Estimated Expiration
- 2042-11-22
AI Technical Summary
The existing speaker audio playback quality test and evaluation has the problem that the overall evaluation cannot reflect the audio quality of each channel, the evaluation dimension is single and highly subjective, resulting in low evaluation accuracy and one-sided results, making it difficult to discover defects in the audio signal's propagation ability.
A multi-channel audio data processing and analysis system is used. By constructing a three-dimensional rectangular coordinate system in the target room, setting up a sound collector, separating the channel audio signals, and using an audio analyzer to analyze the audio playback distortion and attenuation index, the playback quality of each channel is evaluated and low-quality channels are screened out.
It achieves detailed evaluation of the audio playback quality of each channel of the speaker, reduces evaluation deviation, improves accuracy and objectivity, provides targeted improvement directions, and reduces testing costs and time.
Smart Images

Figure CN115802269B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of audio data processing, and in particular to a multi-channel audio data processing and analysis system. Background Art
[0002] With the development of artificial intelligence and wireless network technologies, smart homes are gradually becoming part of people's lives. Smart speakers, due to their compact size and attractive appearance, are gaining popularity in smart home applications. The speaker market continues to mature, expanding not only the variety of speakers but also the number of playback channels, evolving from traditional monophonic playback to multi-channel surround sound. This provides people with a multi-dimensional, three-dimensional listening experience, greatly satisfying people's pursuit of the ultimate in sound quality. This pursuit is reflected in the production of speakers, requiring speaker manufacturers to test and evaluate the audio playback quality of their finished speakers.
[0003] In the process of implementing this application, the inventors found that the existing audio playback quality test and evaluation of speakers has at least the following problems: First, the evaluation subject is aimed at the overall audio signal played by the speaker, but the overall audio signal is a mixture of audio signals from different channels. This overall evaluation method cannot reflect the audio quality of each channel and is too general. When the sound quality is evaluated to be poor, it cannot provide targeted direction for improving the sound quality and is not very practical. At the same time, the overall audio signal is not pure enough due to the interlaced interference of audio signals from different channels, and is prone to evaluation deviation, resulting in low evaluation accuracy.
[0004] The second aspect: The evaluation dimension is simply based on the loudness, pitch, and timbre of the audio signal to evaluate the distortion. The evaluation dimension is too single and does not take into account the impact of the audio signal playback attenuation on the audio playback quality. Not only does it lead to one-sided defects in the evaluation results, but it is also difficult to discover the defects in the audio signal's propagation ability, which in turn affects the user experience.
[0005] Third aspect: Currently, when testing the audio playback distortion of speakers, most of the methods used are manual listening by sound quality testers. Due to the strong subjectivity of this testing method, the test results are prone to contrast, which greatly affects the usable value of the test results, making it difficult to objectively and truly reflect the distortion status of the audio signal.
[0006] In summary, the technical problems existing in the relevant technologies need to be solved urgently. Summary of the Invention
[0007] The purpose of this application is to solve one of the technical problems existing in the related art to at least a certain extent.
[0008] The present invention is achieved through the following technical solutions: a multi-channel audio data processing and analysis system, including: a target room speaker layout position positioning module, which is used to construct a three-dimensional rectangular coordinate system in the target room according to a preset three-dimensional rectangular coordinate system construction method, and locate the layout position coordinates of the speakers in the target room accordingly.
[0009] The target room monitoring equipment setting module is used to divide the edge blocking area corresponding to the target room into areas according to a plane grid division method, and take the center position of each sub-area as the monitoring point, and then set a sound collector at each monitoring point, and at the same time set a sound collector at the layout position of the speaker.
[0010] The target room sound source audio signal acquisition module is used to collect the audio emitted by the speaker using the sound collector at the speaker layout position in the target room to obtain the sound source audio signal.
[0011] The target room receiving audio signal acquisition module is used to use the sound collector set at each monitoring point to collect the audio signal played by the speaker to obtain the receiving audio signal of each monitoring point.
[0012] The target room audio data extraction module is used to obtain the number of channels supported by the speaker, and to perform channel separation on the collected sound source audio signal and the received audio signal corresponding to each monitoring point, thereby obtaining the sound source audio signal corresponding to each channel of the sound source audio signal separation and the received audio signal corresponding to each channel of the received audio information separation at each monitoring point, and then importing them into the audio analyzer to extract audio data from them.
[0013] The target room audio playback quality assessment module is used to analyze the audio data of each channel corresponding to the sound source audio signal and the audio data of each channel corresponding to the audio signal received at each monitoring point, thereby evaluating the audio playback quality coefficient corresponding to each channel built into the speaker.
[0014] The target room speaker low-quality channel analysis module is used to analyze the low-quality channels corresponding to the speakers based on the audio playback quality coefficients corresponding to the built-in channels of the speakers.
[0015] The display terminal is used to display the audio playback quality coefficient corresponding to each channel built into the speaker and the low-quality channel in the background.
[0016] Based on the above scheme, the preset three-dimensional rectangular coordinate system is constructed by taking the center point in the target room space as the coordinate origin, the length direction of the target room as the x-axis, the width direction of the target room as the y-axis, and the height direction of the target room as the z-axis.
[0017] Based on the above solution, the edge blocking area includes four walls, the ground and the roof.
[0018] Based on the above solution, the audio data includes frequency component signals and sound intensity.
[0019] Based on the above solution, the target room audio playback quality assessment module includes an audio signal playback distortion analysis unit, an audio signal playback attenuation analysis unit and an audio signal playback quality assessment unit.
[0020] Based on the above scheme, the audio signal playback distortion analysis unit is used to analyze the playback distortion index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is as follows: (1) The audio signals of each channel sound source obtained by separating the sound source audio signal are subjected to Fourier transformation to obtain various frequency component signals, and the number of the frequency component signals obtained by the transformation is counted.
[0021] (2) Extract the amplitude spectrum and phase spectrum corresponding to various frequency component signals from the audio analyzer, and extract the amplitude curve and phase curve from the amplitude spectrum and phase spectrum respectively.
[0022] (3) The amplitude curves of the various frequency component signals corresponding to the audio signals of each channel sound source are overlapped and compared to obtain the overlap length of the amplitude curves corresponding to the audio signals of each channel sound source, and the amplitude fidelity corresponding to the audio signals of each channel sound source is calculated based on this. The calculation formula is: , It is expressed as the amplitude fidelity corresponding to the audio signal of the k-th channel sound source, where k is the channel number, k=1, 2, ..., u, It is represented by the overlap length of the amplitude curve corresponding to the audio signal of the k-th sound source. It is represented by the length of the amplitude curve of the jth frequency component signal corresponding to the kth channel sound source audio signal, and j is represented by the frequency component signal number, j=1, 2, ..., m.
[0023] (4) The phase curves of the various frequency component signals corresponding to the audio signals of each channel sound source are overlapped and compared to obtain the overlap length of the phase curves corresponding to the audio signals of each channel sound source, and the delay fidelity corresponding to the audio signals of each channel sound source is calculated based on this. The calculation formula is: , It is expressed as the delay fidelity corresponding to the audio signal of the k-th channel sound source, It is expressed as the overlap length of the phase curve corresponding to the audio signal of the k-th channel sound source, It is expressed as the length of the phase curve of the k-th channel sound source audio signal corresponding to the j-th frequency component signal.
[0024] (5) Import the amplitude fidelity and delay fidelity corresponding to the audio signal of each channel into the calculation formula of the original fidelity of the sound source audio , calculate the original fidelity of the sound source audio corresponding to each channel , e is represented as a natural constant, a and b are proportional coefficients corresponding to the predefined amplitude fidelity and delay fidelity, respectively.
[0025] (6) The received audio signals of each channel obtained by separating the received audio signals of each monitoring point are subjected to Fourier transformation to obtain various frequency component signals, and the number of frequency component signals obtained by the transformation is counted, and then the received audio fidelity corresponding to each channel in each monitoring point is calculated according to the methods (2)-(5). , where i represents the number of the monitoring point, i=1, 2, ..., n.
[0026] (7) Compare the received audio fidelity corresponding to each channel at each monitoring point with the original sound source audio fidelity corresponding to each channel, and calculate the audio playback distortion index corresponding to each channel at each monitoring point, which is recorded as ,in , It is expressed as the number of frequency component signals obtained by transforming the kth channel in the i-th monitoring point, It represents the number of frequency component signals obtained by transforming the audio signal of the k-th channel sound source.
[0027] Based on the above scheme, the audio signal playback attenuation analysis unit is used to analyze the playback attenuation index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is: compare the sound intensity of each channel of the sound source audio signal with the sound intensity of each channel of the audio signal received at each monitoring point, and calculate the audio playback attenuation index corresponding to each channel at each monitoring point, which is recorded as ,in , It is expressed as the sound intensity of the sound source audio signal corresponding to the kth channel, It is represented by the sound intensity of the kth channel of the audio signal received by the i-th monitoring point.
[0028] On the basis of the above scheme, the audio signal playback quality evaluation unit is used to evaluate the audio playback quality coefficient corresponding to each channel in the speaker based on the audio playback distortion index and audio playback attenuation index corresponding to each channel in each monitoring point. Specifically, refer to the following steps: Step 1: The audio playback distortion index and audio playback attenuation index corresponding to each channel in each monitoring point are calculated by the audio playback quality coefficient analysis formula , get the audio playback quality coefficient corresponding to each channel in each monitoring point , where A and B represent the weight factors corresponding to the set audio playback distortion index and audio playback attenuation index respectively, and A+B=1.
[0029] Step 2: Calculate the average of the audio playback quality coefficients corresponding to each monitoring point in the same channel , get the audio playback quality coefficient corresponding to each channel in the speaker , respectively representing the maximum audio playback quality coefficient and the minimum audio playback quality coefficient in the kth channel.
[0030] Based on the above scheme, the analysis of the low-quality channels corresponding to the speakers based on the audio playback quality coefficients corresponding to the built-in channels of the speakers is specifically performed as follows: S1: The audio playback quality coefficients corresponding to the monitoring points in the same channel are compared with each other, and the monitoring point with the smallest audio playback quality coefficient is selected as the specific monitoring point corresponding to each channel.
[0031] S2: Locate the coordinates of the specific monitoring points corresponding to each channel based on the three-dimensional rectangular coordinate system constructed in the target room.
[0032] S3: Calculate the playback decay distance corresponding to each channel based on the coordinates of the specific monitoring point corresponding to each channel and the layout coordinates of the speakers in the target room.
[0033] S4: Based on the audio playback quality coefficient and playback decay distance corresponding to each channel of the speaker, the low-quality corresponding to each channel of the speaker is counted. ,in , It is expressed as the playback decay distance corresponding to the k-th channel, It is expressed as the farthest distance from the speaker layout among the monitoring points in the target room. They are respectively represented as the preset audio playback quality coefficient and the proportional factor corresponding to the playback decay distance.
[0034] S5: The low-quality sound corresponding to each built-in channel of the speaker is compared with each other, and the channel with the lowest quality is extracted as the low-quality channel corresponding to the speaker.
[0035] Based on the above scheme, the system also includes a speaker channel preferred playback direction analysis module, which is used to analyze the preferred playback direction angle corresponding to each channel built into the speaker, specifically as follows: the audio playback quality coefficients corresponding to each monitoring point in the same channel are compared with each other, and the monitoring point with the largest audio playback quality coefficient is selected as the preferred monitoring point corresponding to each channel.
[0036] The coordinates of the preferred monitoring points corresponding to each channel are located according to the three-dimensional rectangular coordinate system constructed in the target room.
[0037] Draw an auxiliary line parallel to the z-axis along the layout of the speakers in the target room. At the same time, project the optimal monitoring point corresponding to each channel onto the auxiliary line to obtain the projection point of the optimal monitoring point corresponding to each channel.
[0038] The layout positions of the speakers in the target room, the optimal monitoring points corresponding to each channel, and the projection points of the optimal monitoring points corresponding to each channel are connected in pairs to form the optimal playback triangle corresponding to each channel.
[0039] Based on the layout coordinates of the speakers in the target room, the coordinates of the preferred monitoring points corresponding to each channel, and the projection point coordinates of the preferred monitoring points corresponding to each channel, the preferred playback distance of the preferred playback triangle corresponding to each channel is obtained. and projection distance , and substitute it into the preferred playback direction angle calculation formula , get the optimal playback direction angle corresponding to each channel .
[0040] Compared with the prior art, the present invention has the following advantages: 1. When performing playback quality testing and evaluation on the audio signal played by the speaker, the present invention separates the audio signal played by the speaker into channels to obtain the audio signal of each channel, thereby performing playback quality testing and evaluation on the audio signal of each channel, thereby realizing classified and independent evaluation of the audio quality played by the speaker, and being able to reflect the audio playback quality of each channel in detail, effectively avoiding the problem of current audio playback quality evaluation that uses the overall audio signal as the evaluation subject, not only reducing the evaluation deviation and improving the accuracy of the evaluation results, but also being able to analyze the channels with poor playback quality through the audio playback quality evaluation results of each channel, providing a targeted direction for improving the sound quality of the speaker, and having strong practical value.
[0041] 2. When testing and evaluating the playback quality of the audio signals of each channel, the present invention fully considers the impact of the distortion and attenuation of audio playback on the playback quality, and combines the audio playback distortion index and the audio playback attenuation index to perform a comprehensive evaluation of the playback quality, enriching the evaluation dimensions of audio playback quality, and to a certain extent avoiding the defect of overly one-sided evaluation results caused by a single evaluation dimension. At the same time, it can also promptly discover the defects of the audio signal in terms of propagation power, providing a reliable basis for subsequent improvements, thereby reducing the hidden dangers of speaker playback quality.
[0042] 3. When testing and analyzing the audio playback distortion of a speaker, the present invention uses an audio analyzer as the testing tool and the audio data extracted by the audio analyzer as the main analysis subject. This makes the analysis results more objective and reliable, and overcomes the current subjectivity of audio playback distortion testing of speakers to the greatest extent possible. Firstly, it reduces the probability of discrepancies in the analysis results, enhances the authenticity and reliability of the analysis results, and makes them more valuable. Secondly, it greatly reduces the testing costs incurred by manual listening methods and can also improve testing efficiency, achieving three goals at once.
[0043] 4. Before testing and evaluating the playback quality of the audio signals from each speaker channel, the present invention arranges several monitoring points on the surrounding walls, roof, and floor of the target room based on the propagation characteristics of sound in space. The audio playback quality coefficient of each channel is then evaluated based on the playback quality evaluation results of each monitoring point corresponding to each channel. Compared with evaluation at a fixed location within the target room, this method can minimize evaluation errors and facilitate the accurate and reliable screening of low-quality channels. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] The present invention is further described with reference to the accompanying drawings. However, the embodiments in the accompanying drawings do not constitute any limitation to the present invention. A person skilled in the art can obtain other drawings based on the following drawings without creative effort.
[0045] Figure 1 Schematic diagram of the connection of the system of the present invention.
[0046] Figure 2 FIG. 4 is a connection diagram of the target room audio playback quality assessment module of the present invention.
[0047] Figure 3 Schematic diagram of the preferred playback triangle structure of the present invention. DETAILED DESCRIPTION
[0048] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.
[0049] Reference Figure 1 As shown, a multi-channel audio data processing and analysis system includes a target room speaker layout position positioning module, a target room monitoring equipment setting module, a target room sound source audio signal acquisition module, a target room received audio signal acquisition module, a target room audio data extraction module, a target room audio playback quality assessment module, a target room speaker low-quality channel analysis module, a speaker channel optimal playback direction analysis module, and a display terminal.
[0050] The target room speaker layout position positioning module mentioned above is connected to the target room monitoring equipment setting module, the target room monitoring equipment setting module is respectively connected to the target room sound source audio signal acquisition module and the target room receiving audio signal acquisition module, the target room sound source audio signal acquisition module and the target room receiving audio signal acquisition module are both connected to the target room audio data extraction module, the target room audio data extraction module is connected to the target room audio playback quality evaluation module, the target room audio playback quality evaluation module is respectively connected to the target room speaker low-quality channel analysis module and the speaker channel preferred playback direction analysis module, the target room monitoring equipment setting module is respectively connected to the target room speaker low-quality channel analysis module and the speaker channel preferred playback direction analysis module, the target room audio playback quality evaluation module and the target room speaker low-quality channel analysis module are both connected to the display terminal.
[0051] The target room speaker layout position positioning module is used to construct a three-dimensional rectangular coordinate system in the target room according to a preset three-dimensional rectangular coordinate system construction method, and locate the layout position coordinates of the speakers in the target room accordingly.
[0052] Based on the above scheme, the preset three-dimensional rectangular coordinate system is constructed by taking the center point in the target room space as the coordinate origin, the length direction of the target room as the x-axis, the width direction of the target room as the y-axis, and the height direction of the target room as the z-axis.
[0053] The target room monitoring device setting module is used to divide the edge blocking area corresponding to the target room into areas according to a plane grid division method, where the edge blocking area includes four walls, the ground and the roof, and the center position of each sub-area is taken as the monitoring point, and then a sound collector is set at each monitoring point, and a sound collector is also set at the layout position of the speaker.
[0054] Before testing and evaluating the playback quality of the audio signals of each channel of the speaker, the present invention arranges several monitoring points on the surrounding walls, roof and floor of the target room according to the propagation characteristics of sound in space. Then, the audio playback quality coefficient of each channel is evaluated based on the playback quality evaluation results of each monitoring point corresponding to each channel. Compared with evaluating at a fixed position in the target room, this method can minimize evaluation errors and is conducive to accurately and reliably screening out low-quality channels.
[0055] The target room sound source audio signal acquisition module is used to collect the audio emitted by the speaker using the sound collector at the speaker layout position in the target room to obtain the sound source audio signal.
[0056] The target room received audio signal acquisition module is used to use the sound collector set at each monitoring point to collect the audio signal played by the speaker to obtain the received audio signal of each monitoring point.
[0057] The target room audio data extraction module is used to obtain the number of channels supported by the speaker, and perform channel separation on the collected sound source audio signal and the received audio signal corresponding to each monitoring point, to obtain the sound source audio signal corresponding to each channel of the sound source audio signal separation and the received audio signal corresponding to each channel of the received audio information separation at each monitoring point, and then import them into the audio analyzer to extract audio data therefrom, where the audio data includes frequency component signals and sound intensity.
[0058] When performing audio playback distortion test and analysis on a speaker, the embodiment of the present invention uses an audio analyzer as a test tool and audio data extracted by the audio analyzer as the main analysis subject, making the analysis result more objective and reliable. This overcomes the current deficiency of excessive subjectivity in audio playback distortion test on speakers to the greatest extent possible. Firstly, it reduces the probability of discrepancies in the analysis results, enhances the authenticity and reliability of the analysis results, and makes them more valuable. Secondly, it greatly reduces the test costs generated by manual listening methods and can also improve test efficiency, achieving three goals at one stroke.
[0059] The target room audio playback quality evaluation module is used to analyze the audio data of each channel corresponding to the sound source audio signal and the audio data of each channel corresponding to the audio signal received at each monitoring point, thereby evaluating the audio playback quality coefficient corresponding to each channel built into the speaker.
[0060] In a specific embodiment of the present invention, referring to Figure 2 As shown, the target room audio playback quality assessment module includes an audio signal playback distortion analysis unit, an audio signal playback attenuation analysis unit and an audio signal playback quality assessment unit.
[0061] The audio signal playback distortion analysis unit is used to analyze the playback distortion index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is as follows: (1) the audio signal of each channel sound source obtained by separating the sound source audio signal is subjected to Fourier transformation to obtain various frequency component signals, and the number of the frequency component signals obtained by the transformation is counted.
[0062] (2) Extract the amplitude spectrum and phase spectrum corresponding to various frequency component signals from the audio analyzer, and extract the amplitude curve and phase curve from the amplitude spectrum and phase spectrum respectively.
[0063] (3) The amplitude curves of the various frequency component signals corresponding to the audio signals of each channel sound source are overlapped and compared to obtain the overlap length of the amplitude curves corresponding to the audio signals of each channel sound source, and the amplitude fidelity corresponding to the audio signals of each channel sound source is calculated based on this. The calculation formula is: , It is expressed as the amplitude fidelity corresponding to the audio signal of the k-th channel sound source, where k is the channel number, k=1, 2, ..., u, It is represented by the overlap length of the amplitude curve corresponding to the audio signal of the k-th sound source. It is represented by the length of the amplitude curve of the jth frequency component signal corresponding to the kth channel sound source audio signal, and j is represented by the frequency component signal number, j=1, 2, ..., m.
[0064] It should be noted that the aforementioned overlapping length of the amplitude curves corresponding to the audio signals of the sound sources of the various channels refers to a state in which the amplitude curves of the various frequency component signals overlap.
[0065] (4) The phase curves of the various frequency component signals corresponding to the audio signals of each channel sound source are overlapped and compared to obtain the overlap length of the phase curves corresponding to the audio signals of each channel sound source, and the delay fidelity corresponding to the audio signals of each channel sound source is calculated based on this. The calculation formula is: , It is expressed as the delay fidelity corresponding to the audio signal of the k-th channel sound source, It is expressed as the overlap length of the phase curve corresponding to the audio signal of the k-th channel sound source, It is expressed as the length of the phase curve of the k-th channel sound source audio signal corresponding to the j-th frequency component signal.
[0066] (5) Import the amplitude fidelity and delay fidelity corresponding to the audio signal of each channel into the calculation formula of the original fidelity of the sound source audio , calculate the original fidelity of the sound source audio corresponding to each channel , e is represented as a natural constant, a and b are the proportional coefficients corresponding to the amplitude fidelity and delay fidelity respectively.
[0067] (6) The received audio signals of each channel obtained by separating the received audio signals of each monitoring point are subjected to Fourier transformation to obtain various frequency component signals, and the number of frequency component signals obtained by the transformation is counted, and then the received audio fidelity corresponding to each channel in each monitoring point is calculated according to the methods (2)-(5). , where i represents the number of the monitoring point, i=1, 2, ..., n.
[0068] (7) Compare the received audio fidelity corresponding to each channel at each monitoring point with the original sound source audio fidelity corresponding to each channel, and calculate the audio playback distortion index corresponding to each channel at each monitoring point, which is recorded as ,in , It is expressed as the number of frequency component signals obtained by transforming the kth channel in the i-th monitoring point, It represents the number of frequency component signals obtained by transforming the audio signal of the k-th channel sound source.
[0069] In a specific embodiment, the calculation of the above-mentioned audio playback distortion index not only takes into account the difference between the fidelity of the received audio of each channel and the original fidelity of the sound source audio of each channel, but also takes into account the number of frequency component signals corresponding to the transformation of the sound source audio signal of each channel and the number of frequency component signals obtained by transforming the received audio signal of the channel. The reason is that the audio signal is interfered with by other surrounding signals during the transmission process, and the number of frequency component signals obtained by its transformation will increase. Compared with the sound source audio signal, the more frequency components the received audio signal is transformed, the greater the interference it is subjected to, and thus the higher the degree of distortion.
[0070] It should be noted that the above analysis of the audio playback distortion index is based on the assumption that a signal is composed of signals with different frequency components. If the signals of different frequency components have consistent attenuation and delay, no distortion will occur. However, if the attenuation or delay are inconsistent, deformation will occur. This is reflected in the amplitude spectrum and phase spectrum diagrams to determine whether the shapes of the amplitude curves and phase curves corresponding to the various frequency component signals overlap.
[0071] The audio signal playback attenuation analysis unit is used to analyze the playback attenuation index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is: compare the sound intensity of each channel of the sound source audio signal with the sound intensity of each channel of the audio signal received at each monitoring point, and calculate the audio playback attenuation index corresponding to each channel at each monitoring point, which is recorded as ,in , It is expressed as the sound intensity of the sound source audio signal corresponding to the kth channel, It is represented as the sound intensity of the kth channel of the audio signal received at the i-th monitoring point. The greater the difference between the sound intensity of the source audio signal corresponding to a certain channel and the sound intensity of the received audio signal corresponding to the same channel, the greater the audio playback attenuation index corresponding to the channel, indicating a higher degree of audio playback attenuation.
[0072] The audio signal playback quality evaluation unit is used to evaluate the audio playback quality coefficient corresponding to each channel in the speaker based on the audio playback distortion index and audio playback attenuation index corresponding to each channel in each monitoring point, specifically referring to the following steps: Step 1: The audio playback distortion index and audio playback attenuation index corresponding to each channel in each monitoring point are calculated by the audio playback quality coefficient analysis formula , get the audio playback quality coefficient corresponding to each channel in each monitoring point , where A and B represent the weight factors corresponding to the audio playback distortion index and the audio playback attenuation index respectively, and A+B=1. The audio playback distortion index and the audio playback attenuation index both have a negative impact on the audio playback quality coefficient.
[0073] Step 2: Calculate the average of the audio playback quality coefficients corresponding to each monitoring point in the same channel , get the audio playback quality coefficient corresponding to each channel in the speaker They are respectively represented as the maximum audio playback quality coefficient and the minimum audio playback quality coefficient in the kth channel.
[0074] It should be noted that the above-mentioned method of removing the maximum and minimum values to calculate the mean of the audio playback quality coefficient can greatly weaken the influence of the maximum value on the calculation result and improve the accuracy of the calculation result.
[0075] When performing playback quality testing and evaluation on the audio signals of each channel, the embodiment of the present invention fully considers the impact of the distortion and attenuation of audio playback on the playback quality, and combines the audio playback distortion index and the audio playback attenuation index to perform a comprehensive evaluation of the playback quality, thereby enriching the evaluation dimensions of audio playback quality and, to a certain extent, avoiding the defect of overly one-sided evaluation results caused by a single evaluation dimension. At the same time, it can also promptly discover defects in the propagation power of audio signals, providing a reliable basis for subsequent improvements, thereby reducing the hidden dangers of speaker playback quality.
[0076] The target room speaker low-quality channel analysis module is used to analyze the low-quality channels corresponding to the speakers based on the audio playback quality coefficients corresponding to the built-in channels of the speakers. The specific implementation is as follows:
[0077] S1: Compare the audio playback quality coefficients corresponding to the monitoring points in the same channel, and select the monitoring point with the smallest audio playback quality coefficient as the specific monitoring point corresponding to each channel.
[0078] S2: Locate the coordinates of the specific monitoring points corresponding to each channel based on the three-dimensional rectangular coordinate system constructed in the target room.
[0079] S3: Calculate the playback decay distance corresponding to each channel based on the coordinates of the specific monitoring point corresponding to each channel and the layout coordinates of the speakers in the target room.
[0080] S4: Based on the audio playback quality coefficient and playback decay distance corresponding to each channel of the speaker, the low-quality corresponding to each channel of the speaker is counted. ,in , It is expressed as the playback decay distance corresponding to the k-th channel, It is expressed as the farthest distance from the speaker layout among the monitoring points in the target room. They are respectively represented by the preset audio playback quality coefficient and the proportion factor corresponding to the playback decay distance, where the audio playback quality coefficient and the playback decay distance both have a negative impact on low channel quality.
[0081] S5: The low-quality sound corresponding to each built-in channel of the speaker is compared with each other, and the channel with the lowest quality is extracted as the low-quality channel corresponding to the speaker.
[0082] When performing playback quality testing and evaluation on the audio signal played by the speaker, the present invention separates the audio signal played by the speaker into channels to obtain the audio signal of each channel, thereby performing playback quality testing and evaluation on the audio signal of each channel, thereby realizing classified independent evaluation of the audio quality played by the speaker, and being able to reflect the audio playback quality of each channel in detail, effectively avoiding the problem of current audio playback quality evaluation that takes the overall audio signal as the evaluation subject, not only reducing the evaluation deviation and improving the accuracy of the evaluation results, but also being able to analyze the channels with poor playback quality through the audio playback quality evaluation results of each channel, providing a targeted direction for improving the sound quality of the speaker, and having strong practical value.
[0083] The speaker channel preferred playback direction analysis module is used to analyze the preferred playback direction angle corresponding to each built-in channel of the speaker, specifically as follows: the audio playback quality coefficients corresponding to each monitoring point in the same channel are compared with each other, and the monitoring point with the largest audio playback quality coefficient is selected as the preferred monitoring point corresponding to each channel.
[0084] The coordinates of the preferred monitoring points corresponding to each channel are located according to the three-dimensional rectangular coordinate system constructed in the target room.
[0085] Draw an auxiliary line parallel to the z-axis along the layout of the speakers in the target room. At the same time, project the optimal monitoring point corresponding to each channel onto the auxiliary line to obtain the projection point of the optimal monitoring point corresponding to each channel.
[0086] The layout positions of the speakers in the target room, the optimal monitoring points corresponding to each channel, and the projection points of the optimal monitoring points corresponding to each channel are connected in pairs to form the optimal playback triangle corresponding to each channel.
[0087] Reference Figure 3 As shown, based on the layout coordinates of the speakers in the target room, the coordinates of the preferred monitoring points corresponding to each channel, and the coordinates of the projection points of the preferred monitoring points corresponding to each channel, the preferred playback distance of the preferred playback triangle corresponding to each channel is obtained. and projection distance , and substitute it into the preferred playback direction angle calculation formula , get the optimal playback direction angle corresponding to each channel .
[0088] The distance between the layout position of the speakers in the target room and the preferred monitoring point corresponding to each channel is the preferred playback distance corresponding to each channel, and the distance between the preferred monitoring point corresponding to each channel and the projection point of the preferred monitoring point corresponding to each channel is the projection distance corresponding to each channel.
[0089] By analyzing the preferred playback direction angle corresponding to each channel, the embodiment of the present invention can intuitively display the optimal playback direction position corresponding to each channel, providing a strong reference basis for locating the optimal listening position, making it more convenient for users to listen and providing a better listening experience.
[0090] The display terminal shown is used to display the audio playback quality coefficient corresponding to each channel built into the speaker and the low-quality channel in the background, so that the speaker manufacturer can understand the test results in a timely and intuitive manner.
[0091] The above content is merely an example and explanation of the structure of the present invention. Those skilled in the art may make various modifications or additions to the described specific embodiments or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the claims, they should all fall within the scope of protection of the present invention.
Claims
1. A multi-channel audio data processing and analysis system, characterized in that: include: The target room speaker layout position positioning module is used to construct a three-dimensional rectangular coordinate system in the target room according to a preset three-dimensional rectangular coordinate system construction method, and locate the layout position coordinates of the speakers in the target room accordingly; The target room monitoring device setting module is used to divide the edge blocking area corresponding to the target room into regions according to the plane grid division method, and take the center position of each sub-region as the monitoring point, and then set a sound collector at each monitoring point, and also set a sound collector at the layout position of the speaker; The target room sound source audio signal acquisition module is used to collect the audio emitted by the speaker using the sound collector at the speaker layout position in the target room to obtain the sound source audio signal; The target room receiving audio signal acquisition module is used to use the sound collector set at each monitoring point to collect the audio signal played by the speaker to obtain the receiving audio signal of each monitoring point; The target room audio data extraction module is used to obtain the number of channels supported by the speaker and perform channel separation on the collected source audio signal and the received audio signal corresponding to each monitoring point, thereby obtaining the source audio signal corresponding to each channel of the separated source audio signal and the received audio signal corresponding to each channel of the separated received audio information at each monitoring point, and then importing them into the audio analyzer to extract audio data from them; The target room audio playback quality assessment module is used to analyze the audio data corresponding to each channel of the sound source audio signal and the audio data corresponding to each channel of the audio signal received at each monitoring point, thereby evaluating the audio playback quality coefficient corresponding to each channel built into the speaker; The target room audio playback quality assessment module includes an audio signal playback distortion analysis unit, an audio signal playback attenuation analysis unit, and an audio signal playback quality assessment unit; The audio signal playback distortion analysis unit is used to analyze the playback distortion index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is as follows: (1) The sound source audio signals of each channel obtained by separating the sound source audio signal are subjected to Fourier transform to obtain various frequency component signals, and the number of the frequency component signals obtained by the transformation is counted; (2) extracting the amplitude spectrum and phase spectrum corresponding to various frequency component signals from the audio analyzer, and extracting the amplitude curve and phase curve from the amplitude spectrum and phase spectrum respectively; (3) The amplitude curves of the various frequency component signals corresponding to the audio signals of the sound sources of each channel are overlapped and compared to obtain the overlap length of the amplitude curves corresponding to the audio signals of the sound sources of each channel, and the amplitude fidelity corresponding to the audio signals of the sound sources of each channel is calculated based on this. The calculation formula is: AD 声源 k represents the amplitude fidelity corresponding to the audio signal of the k-th channel sound source, and k represents the channel number, k = 1, 2, ..., u, l k It is represented by the overlap length of the amplitude curve corresponding to the audio signal of the k-th sound source, L k j represents the length of the amplitude curve of the jth frequency component signal corresponding to the kth channel sound source audio signal, and j represents the frequency component signal number, j=1, 2, ..., m; (4) The phase curves of the various frequency component signals corresponding to the audio signals of each channel sound source are overlapped and compared to obtain the overlap length of the phase curves corresponding to the audio signals of each channel sound source, and the delay fidelity corresponding to the audio signals of each channel sound source is calculated based on this. The calculation formula is: DY 声源 k represents the delay fidelity corresponding to the audio signal of the k-th channel sound source, f k It is expressed as the overlap length of the phase curve corresponding to the audio signal of the k-th channel sound source, F k j represents the length of the phase curve of the k-th channel sound source audio signal corresponding to the j-th frequency component signal; (5) Import the amplitude fidelity and delay fidelity corresponding to the audio signal of each channel into the calculation formula of the original fidelity of the sound source audio Calculate the original fidelity of the sound source audio corresponding to each channel e is a natural constant, a and b are proportional coefficients corresponding to the predefined amplitude fidelity and delay fidelity, respectively; (6) The received audio signals of each channel obtained by separating the received audio signals of each monitoring point are subjected to Fourier transformation to obtain various frequency component signals, and the number of frequency component signals obtained by the transformation is counted, and then the received audio fidelity η corresponding to each channel in each monitoring point is calculated according to the methods (2)-(5) 接收 k i , where i represents the number of the monitoring point, i = 1, 2, ..., n; (7) Compare the received audio fidelity corresponding to each channel at each monitoring point with the original audio fidelity of the sound source corresponding to each channel, and calculate the audio playback distortion index corresponding to each channel at each monitoring point, which is recorded as φ k i, where m k i It is expressed as the number of frequency component signals obtained by transforming the kth channel in the ith monitoring point, m k ' represents the number of frequency component signals obtained by transforming the audio signal of the k-th channel sound source; A low-quality sound channel analysis module for the target room speakers, used to analyze the low-quality sound channels corresponding to the speakers based on the audio playback quality coefficients corresponding to the built-in sound channels of the speakers; The display terminal is used to display the audio playback quality coefficient corresponding to each channel built into the speaker and the low-quality channel in the background.
2. A multi-channel audio data processing and analysis system according to claim 1, characterized in that: The preset three-dimensional rectangular coordinate system is constructed by taking the center point in the target room space as the coordinate origin, the length direction of the target room as the x-axis, the width direction of the target room as the y-axis, and the height direction of the target room as the z-axis.
3. The multi-channel audio data processing and analysis system according to claim 1, characterized in that: The edge blocking area includes four walls, the ground and the roof.
4. The multi-channel audio data processing and analysis system according to claim 1, wherein: The audio data includes frequency component signals and sound intensity.
5. The multi-channel audio data processing and analysis system according to claim 1, characterized in that: The audio signal playback attenuation analysis unit is used to analyze the playback attenuation index corresponding to the audio signal emitted by the speaker in the target room. The specific analysis method is as follows: Compare the sound intensity of each channel of the sound source audio signal with the sound intensity of each channel of the audio signal received at each monitoring point, and calculate the audio playback attenuation index corresponding to each channel at each monitoring point, which is recorded as in V 声源 k represents the sound intensity of the sound source audio signal corresponding to the kth channel, V 接收 k i It is represented by the sound intensity of the kth channel of the audio signal received by the i-th monitoring point.
6. The multi-channel audio data processing and analysis system according to claim 5, characterized in that: The audio signal playback quality evaluation unit is used to evaluate the audio playback quality coefficient corresponding to each channel in the speaker based on the audio playback distortion index and audio playback attenuation index corresponding to each channel at each monitoring point, specifically referring to the following steps: Step 1: The audio playback distortion index and audio playback attenuation index corresponding to each channel at each monitoring point are analyzed using the audio playback quality coefficient formula Get the audio playback quality coefficient ψ corresponding to each channel in each monitoring point k i, where A and B represent the weighting factors corresponding to the set audio playback distortion index and audio playback attenuation index, respectively, and A + B = 1; Step 2: Calculate the average of the audio playback quality coefficients corresponding to each monitoring point in the same channel Get the audio playback quality coefficient corresponding to each channel in the speaker ψ k max、ψ k min represents the maximum audio playback quality coefficient and the minimum audio playback quality coefficient in the kth channel respectively.
7. The multi-channel audio data processing and analysis system according to claim 6, characterized in that: The specific implementation of analyzing the low-quality channels corresponding to the speakers based on the audio playback quality coefficients corresponding to the built-in channels of the speakers is as follows: S1: Compare the audio playback quality coefficients corresponding to the monitoring points in the same channel, and select the monitoring point with the smallest audio playback quality coefficient as the specific monitoring point corresponding to each channel; S2: Locate the coordinates of the specific monitoring points corresponding to each channel based on the three-dimensional rectangular coordinate system constructed in the target room; S3: Calculate the playback decay distance corresponding to each channel based on the coordinates of the specific monitoring point corresponding to each channel and the coordinates of the speaker layout in the target room; S4: Statistics of low-quality audio channels in the speakers based on the audio playback quality coefficient and playback decay distance of each channel in the speakers k ,in d k Expressed as the playback decay distance corresponding to the kth channel, d max It is represented by the farthest distance from the speaker layout among the monitoring points in the target room. α and β represent the preset audio playback quality coefficient and the proportion factor corresponding to the playback decay distance, respectively. S5: The low-quality sound corresponding to each built-in channel of the speaker is compared with each other, and the channel with the lowest quality is extracted as the low-quality channel corresponding to the speaker.
8. The multi-channel audio data processing and analysis system according to claim 6, characterized in that: The system also includes a speaker channel preferred playback direction analysis module, which is used to analyze the preferred playback direction angle corresponding to each built-in speaker channel, as follows: Comparing the audio playback quality coefficients corresponding to the monitoring points in the same channel, and selecting the monitoring point with the largest audio playback quality coefficient as the preferred monitoring point corresponding to each channel; Locate the coordinates of the optimal monitoring points corresponding to each channel based on the three-dimensional rectangular coordinate system constructed in the target room; Draw an auxiliary line parallel to the z-axis for the layout of the speakers in the target room. At the same time, project the optimal monitoring point corresponding to each channel onto the auxiliary line to obtain the projection point of the optimal monitoring point corresponding to each channel. Connect the layout of the speakers in the target room, the optimal monitoring points corresponding to each channel, and the projection points of the optimal monitoring points corresponding to each channel in pairs to form the optimal playback triangle corresponding to each channel; Based on the layout coordinates of the speakers in the target room, the coordinates of the preferred monitoring points corresponding to each channel, and the projection point coordinates of the preferred monitoring points corresponding to each channel, the preferred playback distance g of the preferred playback triangle corresponding to each channel is obtained. k and projection distance q k , and substitute it into the preferred playback direction angle calculation formula Get the optimal playback direction angle θ corresponding to each channel k .
Citation Information
Patent Citations
Voice quality assessment method and device based on voice activation detection
CN108010539A
Audio data processing method, system and device and readable storage medium
CN109545242A