Method and apparatus for analyzing audio collections

Abstract

This application proposes a method and apparatus for analyzing audio collection, which relates to the field of data processing technology. The method includes first acquiring a stereo audio signal collected by a terminal device, then analyzing the stereo audio signal to acquire audio data corresponding to each of a plurality of channels, determining stereo parameter information based on the audio data corresponding to each of the plurality of channels, and analyzing indicator information of the stereo audio collection capability of the terminal device based on the stereo parameter information. By applying the technical solution of this application, the stereo collection performance of the terminal device can be analyzed in combination with the stereo parameters obtained by actual measurement, thereby enabling accurate analysis of the stereo audio collection capability of the terminal device and improving the accuracy of the stereo audio collection analysis.

Description

[Technical Field]

[0001] This application relates to the field of data processing technology, and more particularly to a method and apparatus for analyzing audio recordings. [Background technology]

[0002] With the development of audio technology, stereo audio is becoming more and more popular. Furthermore, with the development of current audio devices, many integrated stereo audio acquisition devices have appeared on the market. Stereo audio acquisition methods are no longer limited to combining multiple microphones, but can be achieved with a complete solution. Traditional stereo technology can only reproduce flat sound. As audio expression capabilities improve, the performance requirements for terminal devices are becoming more complex.

[0003] Currently, performance analysis of stereo audio collection by a terminal device is typically a theory-based analysis derived based on ideal acoustic parameters determined based on hardware information of the device. However, since there are many influencing factors in an actual terminal device, it is difficult to make the performance of the terminal device ideal, and therefore existing analysis methods for stereo audio collection affect the accuracy of the analysis results. Summary of the Invention

[0004] The present application proposes a method and apparatus for analyzing audio pickup that can improve the accuracy of stereo audio pickup analysis.

[0005] An embodiment of a first aspect of the present application provides a method for analyzing audio collection, including the steps of acquiring a stereo audio signal collected by a terminal device; analyzing the stereo audio signal to acquire audio data respectively corresponding to a plurality of channels; determining parameter information of the stereo based on the audio data respectively corresponding to the plurality of channels; and analyzing indicator information of audio collection capability for the stereo by the terminal device based on the stereo parameter information.

[0006] In some embodiments of the present application, the step of determining parameter information of the stereo based on audio data corresponding to each of the multiple channels includes determining a signal delay difference and an amplitude difference between each channel based on the audio data corresponding to each of the multiple channels, and the step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the stereo parameter information includes determining sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between the channels.

[0007] In some embodiments of the present application, the step of determining sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between each channel includes the step of performing calculations using a predetermined human ear auditory positioning model based on the signal delay difference and amplitude difference between each channel to obtain the sound source positioning information.

[0008] In some embodiments of the present application, after the step of determining sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between the channels, the method further includes a step of determining sound pickup angle information for audio collection by the terminal device for the stereo based on the sound source positioning information.

[0009] In some embodiments of the present application, after the step of determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between each channel, the method further includes a step of determining sound source positioning deviation information for audio collection for the stereo by the terminal device based on the sound source positioning information and actual sound source position information of the stereo.

[0010] In some embodiments of the present application, after the step of determining sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between each channel, the method further includes a step of determining positioning deviation information for audio and video collection by the terminal device for the stereo based on the sound source positioning information and video collection positioning information for video collection by the terminal device corresponding to the stereo.

[0011] In some embodiments of the present application, the step of determining stereo parameter information based on audio data corresponding to each of the multiple channels includes a step of determining a signal delay of a target channel based on audio data corresponding to each of the multiple channels, the target channel being the channel with the smallest delay among the channels, and the step of analyzing indicator information of the audio collection capability of the stereo by the terminal device based on the stereo parameter information includes a step of determining a delay difference between audio and video collection by the terminal device for the stereo based on the signal delay of the target channel and a delay at which the terminal device collects a video signal.

[0012] In some embodiments of the present application, the step of determining stereo parameter information based on audio data corresponding to each of the multiple channels includes a step of determining frequency response difference information between each channel and a delay difference on a device internal link based on the audio data corresponding to each of the multiple channels, and the step of analyzing indicator information of the audio collection capability of the terminal device for the stereo based on the stereo parameter information includes a step of determining channel consistency for audio collection for the stereo by the terminal device based on the frequency response difference information between each channel and a delay difference on a device internal link.

[0013] In some embodiments of the present application, the step of determining stereo parameter information based on audio data corresponding to each of the multiple channels includes a step of determining frequency response information for each channel based on audio data corresponding to each of the multiple channels, and the step of analyzing indicator information of the audio collection capability of the terminal device for the stereo based on the stereo parameter information includes a step of determining a frequency range in which audio is collected by the terminal device for the stereo and crossover point information at low frequencies based on the frequency response information of each channel.

[0014] In some embodiments of the present application, the step of obtaining audio data corresponding to each of a plurality of channels by analyzing the stereo audio signal includes, if the terminal device is a device requiring decoding, obtaining audio data corresponding to each of a plurality of channels by analyzing the decoded stereo audio signal.

[0015] In some embodiments of the present application, the step of analyzing indicator information of the audio collection capability of the stereo by the terminal device based on the stereo parameter information includes a step of analyzing indicator information of the audio collection capability of the stereo by the terminal device based on the stereo parameter information determined after each sound source position update, wherein the interval between two adjacent sound source positions is determined based on positioning accuracy information of the terminal device.

[0016] A second aspect of the present application provides an audio collection analysis apparatus, including: an acquisition module configured to acquire a stereo audio signal collected by a terminal device; an analysis module configured to acquire audio data corresponding to each of a plurality of channels by analyzing the stereo audio signal; a determination module configured to determine parameter information of the stereo based on the audio data corresponding to each of the plurality of channels; and an analysis module configured to analyze indicator information of audio collection capability for the stereo by the terminal device based on the stereo parameter information.

[0017] An embodiment of a third aspect of the present application provides an electronic device, comprising: a storage medium; a processor; and a computer program stored on the storage medium and executable by the processor, wherein when the processor executes the computer program, a method according to the embodiment of the first aspect is implemented.

[0018] An embodiment of a fourth aspect of the present application provides a computer storage medium having stored thereon a computer program, which, when executed by a processor, implements the method according to the embodiment of the first aspect.

[0019] The embodiments of the present application provide a method and apparatus for analyzing audio collection. Compared with the existing method of performing derivation analysis based on ideal acoustic parameters, the embodiments of the present application can perform actual test analysis on a terminal device to obtain an accurate analysis proposal for the stereo audio collection capability of the terminal device. Specifically, the method first obtains the stereo audio signals collected by the terminal device, analyzes the stereo audio signals to obtain audio data corresponding to each of the multiple channels, determines stereo parameter information based on the audio data corresponding to each of the multiple channels, and then analyzes indicator information of the stereo audio collection capability of the terminal device based on the stereo parameter information. By applying the technical solution of the embodiments of the present application, the stereo collection performance of the terminal device can be analyzed in combination with the stereo parameters obtained by actual measurement, thereby enabling an accurate analysis of the stereo audio collection capability of the terminal device and improving the accuracy of the stereo audio collection analysis.

[0020] Additional aspects and advantages of the present application will be set forth in part in the description that follows, or will be apparent from the description, or may be learned by practice of the disclosure. [Brief explanation of the drawings]

[0021] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following detailed description of the embodiments taken in conjunction with the following drawings. [Figure 1] 1 is a schematic flow chart of a method for analyzing an audio collection according to an embodiment of the present application; [Figure 2] 1 is a schematic flow chart of a method for analyzing an audio collection according to an embodiment of the present application; [Figure 3] 1 is a schematic flow chart of a method for analyzing an audio collection according to an embodiment of the present application; [Figure 4] 1 is a schematic flow chart of a method for analyzing an audio collection according to an embodiment of the present application; [Figure 5]1 is a schematic flow chart of a method for analyzing an audio collection according to an embodiment of the present application; [Figure 6] 1 is a block diagram of an apparatus for analyzing audio collection according to an embodiment of the present application; [Figure 7] 1 is a schematic configuration diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0022] The following describes in detail the embodiments of the present application, and examples of the embodiments are shown in the drawings. Here, the same or similar reference numerals throughout indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are illustrative and are intended to explain the present application, and should not be understood as limiting the present application. Furthermore, if there is no conflict, the embodiments and features in the embodiments of the present application can be combined with each other.

[0023] The terms used in the embodiments of the present disclosure are for the purpose of describing particular embodiments and are not intended to limit the embodiments of the present disclosure. Unless the context clearly indicates otherwise, the singular forms "a," "an," and "the" used in the embodiments of the present disclosure and the appended claims also include the plural forms. Furthermore, the term "and / or" as used herein refers to and includes any and all possible combinations of one or more associated and listed items.

[0024] It should be understood that, although various pieces of information may be described using terms such as first, second, and third in the embodiments of the present disclosure, these pieces of information should not be limited to these terms. These terms are used only to distinguish between pieces of information of the same type. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information, without departing from the scope of the embodiments of the present disclosure. Depending on the context, the term "when" as used herein can be interpreted as "when," "when," or "in response to determining."

[0025] Currently, analysis methods for audio collection are typically performance test analysis of mono audio collection by terminal devices, and stereo audio collection capabilities are theoretically analyzed and derived based on ideal acoustic parameters determined based on device hardware information. However, there are many influencing factors in actual terminal devices, making it difficult to idealize the performance of terminal devices, so existing analysis methods for stereo audio collection affect the accuracy of the analysis results.

[0026] Therefore, this embodiment proposes an audio collection analysis method and apparatus, which can improve the accuracy of stereo audio collection analysis.

[0027] The audio collection analysis method and apparatus provided by the present application will be described in detail below in conjunction with the drawings.

[0028] 1 is a schematic flowchart of a method for analyzing audio collection according to an embodiment of the present application. As shown in FIG. 1, the method may include the following steps:

[0029] Step 101: Obtain a stereo audio signal collected by a terminal device.

[0030] The terminal device may be a collection device capable of collecting stereo audio, such as a smartphone, tablet, or smartwatch. The terminal device may collect stereo audio from a sound source through a microphone, and the stereo audio may include data of at least two channels (e.g., a left channel, a right channel, and a bass channel). In this embodiment, the acquired audio signal may be a standard stereo signal that the terminal device outputs to a playback system. A specific analysis of the audio collection may be performed based on the standard stereo signal, specifically, the steps shown in steps 102 to 104.

[0031] Step 102: Analyze the stereo audio signal to obtain audio data corresponding to each of the multiple channels.

[0032] The audio data may include relevant information such as impulse responses and frequency responses corresponding to multiple channels.

[0033] For example, by analyzing a stereo audio signal, audio data corresponding to the left channel, audio data corresponding to the right channel, audio data corresponding to the bass channel, and the like can be obtained.

[0034] Step 103: Determine stereo parameter information based on the audio data corresponding to each of the multiple channels.

[0035] The stereo parameter information may include intensity differences between each channel, frequency response differences between each channel, time differences between each channel, internal delay differences between each channel, and the like.

[0036] Step 104: Analyze the indicator information of the audio collection capability of the terminal device for the stereo based on the stereo parameter information.

[0037] The indicator information of the stereo audio collection capability of the terminal device may include information such as the consistency of the left and right channels of the device, the positioning capability of the sound source (including, for example, the sound source positioning angle, the sound collection angle, and the positioning deviation angle), the frequency range satisfied by the frequency response, low frequency management, etc. Furthermore, these indicator information can accurately analyze the stereo audio collection capability of the terminal device.

[0038] By applying the audio collection analysis method provided by this embodiment, compared to existing methods that perform derivation analysis based on ideal acoustic parameters, the embodiment of the present application can analyze the stereo collection performance of a terminal device in combination with stereo parameters obtained by actual measurement, thereby enabling accurate analysis of the stereo audio collection capability of the terminal device and improving the accuracy of stereo audio collection analysis.

[0039] Current technology cannot analyze the positioning accuracy of stereo audio. Furthermore, as an alternative embodiment of the embodiment of Fig. 1, this embodiment provides a specific method shown in Fig. 2, which can be used to analyze the positioning accuracy of a stereo audio collection device, and the method includes the following steps:

[0040] Step 201: Obtain a stereo audio signal collected by a terminal device.

[0041] Stereo audio usually outputs audio data in at least two channels (including a bass channel). Because the playback effect varies depending on the playback method, audio format playback requires detailed descriptions of the number of channels, channel correspondence, playback speaker positioning, and related acoustic environment requirements.

[0042] To accurately analyze the positioning accuracy of the stereo audio of the terminal device, the test environment selected in this embodiment may be a quiet free field with no sound source other than the test sound source, which may be a standard coaxial speaker, with its main axis aligned with the reference point.

[0043] The reference point, main axis direction, and orientation of the terminal device (device under test) may be predefined by the manufacturer or selected based on actual usage. For devices that include video acquisition, the reference point and main axis direction must coincide with the video acquisition element. To facilitate analysis, the reference point of the terminal device must be set. For example, a spherical coordinate system may be created with the reference point of the terminal device as the center of the circle, with the main axis direction as the positive x-axis, the horizontal leftward direction as the positive y-axis, and the vertical upward direction as the positive z-axis. The reference point of each channel may be the center of the theoretical transducer for each channel. The main axis direction coincides with the terminal device. The positional relationship between the reference point of the channel and the reference point of the terminal device must be based on the explanation. Specific coordinates are described using a spherical coordinate system with the reference point of the device as the origin. In this embodiment, the stereo audio signal (output signal) acquired by the terminal device can be analyzed by selecting the standard stereo signal (including the bass channel) ultimately output to the playback system within the terminal device.

[0044] The test sound source can be positioned at a horizontal angle of φ, a vertical angle of θ, and a distance of r on the device under test. In this embodiment, the test sound source can be positioned at different positions (φ, θ, r) to perform test analysis. For example, index information on the stereo audio collection capability of the terminal device is analyzed based on stereo parameter information determined after each sound source position update. Here, the interval between two adjacent sound source positions (test sound source placement position) is determined based on positioning accuracy information of the terminal device. This enables accurate analysis of the stereo audio collection capability of the terminal device.

[0045] The test position range can cover the spatial range that the terminal device needs to collect. For devices that collect audio and video synchronously, the test position range must be larger than the range that the video can collect. Here, the distance between two adjacent sound source positions (test sound source placement positions) must meet the test requirements for device accuracy, for example, the distance between positions < positioning accuracy / 2. Positioning accuracy is the resolution in the device's direction (unit: degrees) and is defined by the manufacturer or selected according to the actual situation. It can also be determined based on the direction of the horizontal plane of the human ear. As the sound source direction moves laterally, the positioning accuracy can gradually increase according to the angle.

[0046] The test sound source can play a sweep signal and full-band noise. Based on the audio data of the channel finally output by the terminal device, the impulse response and frequency response at each position can be calculated and measured, specifically, the following steps 202 to 203 can be performed. Meanwhile, in a terminal device that collects audio and video synchronously, every time the test sound source starts to play a stereo audio test signal, the test sound source needs to simultaneously emit an optical signal to the video collecting element as mark A to mark the video time.

[0047] Step 202: Analyze the stereo audio signal to obtain audio data corresponding to each of the multiple channels.

[0048] Optionally, if the terminal device is a device requiring decoding, the decoded stereo audio signal is analyzed to obtain audio data corresponding to each of the multiple channels.

[0049] For devices that require decoding, the test analysis is performed by selecting the decoded stereo signal to ensure accurate analysis of the stereo audio acquisition capabilities of the terminal device. For mid / side (M / S) recording devices, the test analysis is performed based on the decoded left channel (L) and right channel (R) signals.

[0050] Step 203: determining the signal delay difference and amplitude difference between the channels based on the audio data corresponding to each of the multiple channels.

[0051] In this embodiment, the terminal device can calculate the collected audio signal to obtain impulse responses I at different horizontal angles, different vertical angles, and different distances.

[0052] The time when the impulse response reaches its maximum value is the delay T of the audio signal. Delay of each frequency band: The impulse response passes through the corresponding filtering to retain the necessary components for the frequency band, and the time when the maximum value after filtering is reached is the delay of the corresponding frequency band. This delay is the delay T that it takes for the sound source to propagate through the air to the corresponding microphone. air , and the delay T on the link inside the device int (including microphone oscillation, internal signal delay, analog-to-digital conversion, related signal processing delay, etc.), and the specific calculation formula can be shown in Equation 1 below. T=T air +T int (Formula 1)

[0053] Here, the delay Tair caused by the sound source propagating through the air to the corresponding microphone can be estimated from the distance d from the microphone to the sound source and the speed of sound c. The specific calculation formula can be shown in Equation 2 below.

number

[0054] In this embodiment, the signal delay difference between each channel can be the difference in signal delay between each channel at the sound source position. For example, based on Equation 1 and Equation 2, the left channel delay T L , right channel delay T R , the time difference between the left and right channels △T=T L -T R is calculated. The time difference between channels is affected by the difference in propagation distance of the sound source and the delay difference inside the device. Generally, the closer the channel to the sound source position, the shorter the delay. The time difference between channels should satisfy the time difference relationship required to construct a correct acoustic image.

[0055] The output signal amplitude calculated from the impulse response is the signal amplitude L. Amplitude of each frequency band: The impulse response is filtered to retain the necessary components for the frequency band, and the output signal amplitude calculated by filtering is the amplitude of the corresponding frequency band. This amplitude is the amplitude change L caused by the sound source propagating through the air to the corresponding microphone. air , and the amplitude change L due to the device itself int The specific calculation formula can be shown in the following formula 3. L=L air +L int (Formula 3)

[0056] In this embodiment, the signal delay difference between each channel can be the intensity difference between each channel, for example, the left channel amplitude L L , right channel amplitude L R , the amplitude difference between the left and right channels △L=L L -L R is calculated. The intensity difference between channels is affected by the difference in channel directivity and the attenuation in sound source propagation. In general, the channel closer to the sound source position has stronger intensity. The intensity difference between channels should satisfy the intensity difference relationship required to construct a correct acoustic image.

[0057] Step 204: Determine sound source positioning information for audio collection for stereo by the terminal device based on the signal delay difference and amplitude difference between each channel.

[0058] The method of this embodiment can realize accurate evaluation and analysis of the positioning accuracy of a stereo audio collection device, and the positioning accuracy of the stereo audio collection can be analyzed according to the sound source positioning information of the stereo audio collection performed by the terminal device.

[0059] Optionally, step 204 may specifically include performing calculations based on the signal delay difference and amplitude difference between each channel using a preset human ear auditory positioning model to obtain sound source positioning information.

[0060] For example, stereo audio can reproduce the difference in horizontal angle of the sound well, but its positioning ability in distance and height is weak. Therefore, in this embodiment, only the horizontal positioning ability can be tested and analyzed. Based on the obtained signal and corresponding parameters, the corresponding human ear auditory positioning model f(x) is used to obtain the acoustic image positioning angle A after the sounds picked up by the terminal device at different positions have been played back. The specific calculation formula can be shown in Equation 4 below. A(φ)=f(△T(φ,θ,r))+f(△L(φ,θ,r)) (Equation 4)

[0061] The acoustic image positioning A(φ) represents the horizontal angle of the actual perception of the human ear at different test positions (φ, θ, r). The calculation process of ΔT and ΔL can be referred to the example shown in step 203 above, so the explanation is omitted here.

[0062] Optionally, after step 204, the method of this embodiment may further include determining sound collection angle information for audio collection for the stereo by the terminal device based on the sound source positioning information obtained above. For example, the sound collection angle may be an angle at which the terminal device can accurately record an acoustic image, and specifically may be a discrete angle interval. According to the requirements of the terminal device, it can be divided into an optimal sound collection angle and a maximum sound collection angle. The optimal sound collection angle: the position change angle and the acoustic image change angle (A(φ)) maintain a linear relationship. Meanwhile, the maximum sound collection angle: the position change angle and the acoustic image change angle (A(φ)) are in the same direction.

[0063] Optionally, after step 204, the method of this embodiment may further include determining sound source positioning deviation information for the stereo audio collection by the terminal device based on the sound source positioning information and the stereo actual sound source position information, which can better analyze the stereo audio collection capability of the terminal device. For example, positioning deviation angle = positioning angle - actual sound source angle, and specifically, the sound source positioning deviation can be determined by calculating the difference between A(φ) and φ.

[0064] For a terminal device capable of simultaneously collecting audio and video, this embodiment also proposes a method for analyzing the synchronization of audio and video. Accordingly, optionally, after step 204, the method of this embodiment can further include a step of determining positioning deviation information for audio and video collection by the terminal device relative to the stereo based on the sound source positioning information and video collection positioning information of the video collection by the terminal device corresponding to the stereo.

[0065] The video angle of view is the angle range that the camera can receive images in a general environment. As shown in the example in step 201, the position where mark A appears on the video screen is the video positioning of the test position. When the video positioning is converted into a horizontal angle B (φ), the audio and video positioning deviation A is B (φ) can be expressed as the following equation 5 A B (φ)=A(φ)-B(φ) (Equation 5)

[0066] In this embodiment, the stereo collection performance of a terminal device is evaluated using actual device parameters obtained through actual measurement in combination with a stereo model. Through the impulse responses of the terminal device to different positions of the sound source, the time difference between the corresponding channels of the terminal device and the intensity difference between the channels can be obtained, thereby analyzing the positioning performance of the terminal device for stereo audio collection. Most current terminal devices have both video and audio collection capabilities, and there is a lack of solutions for measuring and analyzing the combined audio and video situation. For terminal devices that synchronously collect audio and video, this embodiment can analyze the combination of audio and video signals from the perspective of positioning performance through comparison of audio and video signals, and further realize measurement and analysis of the combination effect with video. Applying the technical solution of this embodiment enables accurate analysis of the stereo audio collection capability of the terminal device, improving the accuracy of stereo audio collection analysis.

[0067] In addition to analyzing the positioning performance for stereo audio collection by a terminal device, the analysis method of this embodiment can also be used to analyze the delay difference between collected audio and video. Accordingly, as another alternative embodiment of the embodiment of Fig. 1, this embodiment provides a specific method as shown in Fig. 3, which includes the following steps:

[0068] Step 301: Obtain a stereo audio signal collected by a terminal device.

[0069] The pre-setting process of the test environment, test sound source, etc. can refer to the corresponding description of step 201, and will not be described here. In this embodiment, the test sound source can be positioned at a horizontal angle φ, a vertical angle θ, and a distance r of the device under test. In this embodiment, the test sound source can be positioned at different positions (φ, θ, r) to perform test analysis. For example, the indicator information of the stereo audio collection capability of the terminal device is analyzed based on the stereo parameter information determined after each sound source position update, where the interval between two adjacent sound source positions (test sound source placement position) is determined based on the positioning accuracy information of the terminal device. This enables accurate analysis of the stereo audio collection capability of the terminal device.

[0070] Step 302: Analyze the stereo audio signal to obtain audio data corresponding to each of the multiple channels.

[0071] Optionally, if the terminal device is a device requiring decoding, the decoded stereo audio signal is analyzed to obtain audio data corresponding to each of the multiple channels. For devices requiring decoding, the decoded stereo signal is selected for test analysis to ensure that the stereo audio collection capability of the terminal device can be accurately analyzed.

[0072] Step 303: determining a signal delay of a target channel based on audio data corresponding to each of the multiple channels;

[0073] The target channel is the channel with the smallest delay among the channels.

[0074] Step 304: Determine a delay difference for audio and video acquisition for stereo by the terminal device based on the signal delay of the target channel and the delay at which the terminal device acquires the video signal.

[0075] For a terminal device that can simultaneously collect audio and video, this embodiment proposes a method for analyzing the synchronization of audio and video. For example, the delay difference between audio and video can be analyzed, and the data with the smallest delay between the left and right channels can be selected and compared with the video delay. The calculation process can be shown in Equation 6 below. Audio and video delay difference ΔT a / v =min{T L ,T R}-T v (Formula 6)

[0076] ΔT a / v represents the differential delay of audio and video acquisition for stereo by the terminal device, and T L represents the delay of the left channel, and T R represents the delay of the right channel, and T v is the time from the start of the test until mark A appears, i.e., the delay T of the video signal v Represents.

[0077] By applying the audio collection analysis method provided by this embodiment, it is possible to accurately analyze the delay difference between audio and video collected by a terminal device, which enables accurate analysis of the stereo audio collection capability of the terminal device and improves the accuracy of the stereo audio collection analysis.

[0078] Furthermore, the analysis method of this embodiment can also be used to analyze channel consistency of stereo audio collection by a terminal device. Accordingly, as another alternative embodiment of the embodiment of Fig. 1, this embodiment provides a specific method as shown in Fig. 4, which includes the following steps:

[0079] Step 401: Obtain a stereo audio signal collected by a terminal device.

[0080] The pre-setting process for the test environment, test sound source, etc. can refer to the corresponding description of step 201, and will not be described here. In this embodiment, the test sound source can be positioned at a horizontal angle φ, a vertical angle θ, and a distance r of the device under test. In this embodiment, the test sound source can be positioned at different positions (φ, θ, r) for test analysis. For example, the indicator information of the stereo audio collection capability of the terminal device is analyzed based on the stereo parameter information determined after each sound source position update, where the interval between two adjacent sound source positions (test sound source placement position) is determined based on the positioning accuracy information of the terminal device. This enables accurate analysis of the stereo audio collection capability of the terminal device.

[0081] In this embodiment, stereo audio is measured separately for multiple channels, and the performance of each channel is measured separately. While conventional mono audio is primarily collected along the primary axis, stereo audio requires collecting audio from multiple angles from each microphone direction, so measurement analysis must be performed for each direction. All measurement data uses the reference point for each channel, and the reference coordinate direction is consistent with the device's reference coordinate. Channel parameters must be adjusted to eliminate the effects of test signals propagating through the air.

[0082] Based on the measurement and analysis method of mono devices, audio measurements are performed separately for each direction of each channel. Parameters for each direction of each channel are calculated. These include related parameters such as frequency response, phase response, signal-to-noise ratio (SNR), acoustic overload point (AOP), and total harmonic distortion (THD). The directivity of each channel can be the sensitivity of the channel in different directions, including amplitude response in different directions and at different frequencies. All frequencies in the operating frequency band and angles that the device needs to collect must be covered. The internal delay of each channel, for example, the delay T on the link inside the left and right channel device, is also calculated.int In this embodiment, the internal delay of each channel device can be calculated using Equation 7. T int =TT air (Formula 7)

[0083] T represents the audio signal delay of the channel, and T air represents the delay that a sound source takes to travel through the air to the corresponding microphone.

[0084] The directivity type of each channel is divided into directional and omnidirectional based on the directivity of the channel, where omnidirectional: there is no difference in the amplitude response in each direction. Directional: there is a difference in the amplitude response in each direction. The directional channel maximum response angle is the angle of the maximum response obtained for the channel. If multiple maximum response angles (e.g., bipolar) occur, all maximum response angles must be specified. The channel phase response is the phase response at each angle and each frequency of the channel output signal.

[0085] Step 402: Analyze the stereo audio signal to obtain audio data corresponding to each of the multiple channels.

[0086] Optionally, if the terminal device is a device requiring decoding, the decoded stereo audio signal is analyzed to obtain audio data corresponding to each of the multiple channels. For devices requiring decoding, the decoded stereo signal is selected for test analysis to ensure that the stereo audio collection capability of the terminal device can be accurately analyzed.

[0087] Step 403: Determine frequency response difference information between each channel and delay difference on the device's internal link based on the audio data respectively corresponding to the multiple channels.

[0088] For example, in the process of determining the frequency response difference information between each channel, the frequency response at the test point (current position of the test sound source) in the left channel is calculated as F LThen, F L The response at 1 kHz of the right channel can be set to 0 dB. R Then, F R The response at 1 kHz is set to 0 dB. The frequency response difference ΔF between the left and right channels can be calculated using the following equation 8. △F=F L -F R (Formula 8)

[0089] The frequency response difference between channels is affected only by the difference between the left and right channels of the device, regardless of the effect of the test signal propagating through the air. The response of each channel itself at 1 kHz is set to 0 dB. At that test point, the difference in frequency variation between the left and right channels is compared.

[0090] To determine the delay difference on the device's internal link between each channel, the internal delay difference between each channel is the difference in internal signal delay between each channel at the corresponding sound source position. For example, the left channel internal delay is T Lint and the right channel internal delay is T Rint The internal delay time difference between the left and right channels can be calculated using the following equation 9. △T int =T Lint -T Rint (Formula 9)

[0091] The internal time difference between channels is affected only by the device internal delay differences.

[0092] Step 404: Determine channel consistency for audio collection for stereo by the terminal device based on frequency response difference information between each channel and delay difference on the device inter-link.

[0093] The internal delay difference △T between channels at the test position (e.g., the current position of the sound source) int The consistency of the left and right channels of a device is analyzed using two parameters: the frequency response difference △F between the left and right channels, and the frequency response difference △T. intFor and ΔF, each has a corresponding standard parameter, and the two are compared with the corresponding standard parameters, and the channel consistency of audio collection for stereo by the terminal device is further analyzed.

[0094] By applying the audio collection analysis method provided by this embodiment, it is possible to accurately analyze the channel consistency of stereo audio collection by a terminal device, which enables accurate analysis of the stereo audio collection capability of the terminal device, thereby improving the accuracy of stereo audio collection analysis.

[0095] Furthermore, the analysis method of this embodiment can also be used to analyze the frequency range and low-frequency crossover point information for audio collection by a terminal device for stereo. Accordingly, as another alternative embodiment of the embodiment of Fig. 1, this embodiment provides a specific method as shown in Fig. 5, which includes the following steps:

[0096] Step 501: Obtain a stereo audio signal collected by a terminal device.

[0097] The pre-setting process for the test environment, test sound source, etc. can be referred to in the corresponding descriptions of steps 201 and 401, and therefore will not be described here. In this embodiment, the test sound source can be positioned at a horizontal angle φ, a vertical angle θ, and a distance r of the device under test. In this embodiment, the test sound source can be positioned at different positions (φ, θ, r) for test analysis. For example, index information of the stereo audio collection capability of the terminal device is analyzed based on the stereo parameter information determined after each sound source position update, where the interval between two adjacent sound source positions (test sound source placement position) is determined based on the positioning accuracy information of the terminal device. This enables accurate analysis of the stereo audio collection capability of the terminal device.

[0098] Step 502: Analyze the stereo audio signal to obtain audio data corresponding to each of the multiple channels.

[0099] Optionally, if the terminal device is a device requiring decoding, the decoded stereo audio signal is analyzed to obtain audio data corresponding to each of the multiple channels. For devices requiring decoding, the decoded stereo signal is selected for test analysis to ensure that the stereo audio collection capability of the terminal device can be accurately analyzed.

[0100] Step 503: Determine frequency response information for each channel based on audio data corresponding to each of the multiple channels.

[0101] Step 504: Determine the frequency range and low frequency crossover point information for audio collection for stereo by the terminal device based on the frequency response information of each channel.

[0102] For example, the frequency response of a terminal device may be the frequency response of the left channel, right channel, and bass channel at a test position (e.g., different placement positions of a test sound source). The amplitude of 1 kHz in the direction of the main axis (horizontal angle 0°) is taken as 0 dB of the frequency response. The frequency response at different test positions is plotted. The frequency response at each test position meets the required frequency range (e.g., -3 dB < frequency response < 3 dB). For low-frequency management, stereo systems that include a low-frequency channel generally have low-frequency left and right channels, so the frequency response increases from low to high frequencies. The low-frequency channel is low-frequency, so the frequency response decreases from low to high frequencies. Therefore, to evaluate the effectiveness of the device's low-frequency management, it is necessary to detect the device's low-frequency crossover point. Left and right channel crossover point: The frequency point at which the low frequencies of the left and right channels drop to -3 dB. Low-frequency channel crossover point: The frequency point at which the bass channel drops to -3 dB.

[0103] By applying the audio collection analysis method provided by this embodiment, it is possible to accurately analyze the frequency range in which stereo audio is collected by the terminal device and the crossover point information at low frequencies, thereby enabling accurate analysis of the stereo audio collection capability of the terminal device and improving the accuracy of the stereo audio collection analysis.

[0104] Corresponding to the audio collection analysis method provided by each of the above embodiments, the present application further provides an audio collection analysis device, and the audio collection analysis device provided by the embodiments of the present application corresponds to the audio collection analysis method provided by some of the above embodiments, so the embodiments of the audio collection analysis method also apply to the audio collection analysis device provided by the embodiments, and will not be described in detail in this embodiment.

[0105] FIG. 6 is a schematic structural diagram of an audio collection analysis apparatus provided by an embodiment of the present application, which may include: an acquisition module 61 configured to acquire a stereo audio signal collected by a terminal device; an analysis module 62 configured to analyze the stereo audio signal to acquire audio data corresponding to each of a plurality of channels; a determination module 63 configured to determine parameter information of the stereo based on the audio data corresponding to each of the plurality of channels; and an analysis module 64 configured to analyze indicator information of the audio collection capability of the terminal device for the stereo based on the stereo parameter information.

[0106] In some embodiments, the determination module 63 is specifically configured to determine a signal delay difference and an amplitude difference between each channel based on audio data respectively corresponding to the plurality of channels, and the analysis module 64 is specifically configured to determine sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and the amplitude difference between each channel.

[0107] In some embodiments, the analysis module 64 is further specifically configured to perform calculations using a pre-defined human ear auditory positioning model based on the signal delay difference and amplitude difference between the channels to obtain the sound source positioning information.

[0108] In some embodiments, the determination module 63 is further configured to: determine, based on the signal delay difference and amplitude difference between the channels, sound source positioning information for audio collection by the terminal device for the stereo; and then, based on the sound source positioning information, determine sound collection angle information for audio collection by the terminal device for the stereo.

[0109] In some embodiments, the determination module 63 is further configured to determine sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between the channels, and then determine sound source positioning deviation information for audio collection by the terminal device for the stereo based on the sound source positioning information and actual sound source position information of the stereo.

[0110] In some embodiments, the determination module 63 is further configured to determine sound source positioning information for audio collection by the terminal device for the stereo based on the signal delay difference and amplitude difference between the channels, and then determine positioning deviation information for audio and video collection by the terminal device for the stereo based on the sound source positioning information and video collection positioning information for video collection by the terminal device corresponding to the stereo.

[0111] In some embodiments, the determination module 63 is further specifically configured to determine a signal delay of a target channel based on audio data corresponding to each of the plurality of channels, the target channel being the channel with the smallest delay among the channels, and the analysis module 64 is further specifically configured to determine a delay difference for audio and video collection by the terminal device for the stereo based on the signal delay of the target channel and the delay at which the terminal device collects a video signal.

[0112] In some embodiments, the determination module 63 is further specifically configured to determine frequency response difference information between each channel and a delay difference on a device internal link based on audio data respectively corresponding to the plurality of channels, and the analysis module 64 is further specifically configured to determine channel consistency for audio collection by the terminal device for the stereo based on the frequency response difference information between each channel and a delay difference on a device internal link.

[0113] In some embodiments, the determination module 63 is further specifically configured to determine frequency response information for each channel based on audio data corresponding to each of the multiple channels, and the analysis module 64 is further specifically configured to determine a frequency range for audio collection by the terminal device for the stereo and crossover point information at low frequencies based on the frequency response information for each channel.

[0114] In some embodiments, the analysis module 62 is specifically configured to, if the terminal device is a device requiring decoding, analyze the decoded stereo audio signal to obtain audio data corresponding to each of a plurality of channels.

[0115] In some embodiments, the analysis module 64 is further specifically configured to analyze indicator information of the audio collection capability of the terminal device for the stereo based on parameter information of the stereo determined after each sound source position update, where the interval between two adjacent sound source positions is determined based on positioning accuracy information of the terminal device.

[0116] The analytical device may be a chip, an assembly, or a module, and includes a processor and a memory, and the acquisition module 61, the analysis module 62, the determination module 63, and the analysis module 64 are all stored in the memory as program units, and the corresponding functions are realized by the processor executing the program units stored in the memory.

[0117] The processor may include a kernel that calls an appropriate program unit from the memory. One or more kernels may be configured to analyze the stereo collection performance of the terminal device in combination with stereo parameters obtained by actual measurement, thereby enabling accurate analysis of the stereo audio collection capability of the terminal device and improving the accuracy of the stereo audio collection analysis.

[0118] The memory may include forms of non-volatile memory, such as random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash memory (flash RAM) in a computer-readable medium, and the memory includes at least one memory chip.

[0119] 7, there is shown a schematic diagram of an electronic device 700 suitable for implementing some embodiments of the present application. The electronic device shown in FIG. 7 is merely an example and does not pose any limitation on the functionality and scope of use of the embodiments of the present application.

[0120] 7, an electronic device 700 may include a processor 701, a memory 702, a communication interface 703, an input unit 704, an output unit 705, and a communication bus 706. Here, the processor 701 and the memory 702 are connected to each other via the communication bus 706. The communication interface 703, the input unit 704, and the output unit 705 are also connected to the communication bus 706.

[0121] Here, the communication interface 703 may be an interface of a communication module, such as an interface of a GSM module. In an embodiment of the present application, the processor 701 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic device, etc.

[0122] In one possible implementation, the memory 702 may include a program storage area capable of storing an operating system and applications necessary for at least one function (e.g., a user authentication function), and a data storage area capable of storing data created during use of the computer.

[0123] It should be noted that memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage device.

[0124] The processor 701 can call a program stored in the memory 702, and specifically, the processor 701 can execute the method shown in any of the embodiments of FIGS. 1 to 5 above.

[0125] One or more programs are stored in the memory 702. The programs may include program code including computer operation instructions, and in the embodiment of the present application, the memory 702 stores programs for realizing at least the following functions: A stereo audio signal collected by a terminal device is acquired, and audio data corresponding to each of a plurality of channels is acquired by analyzing the stereo audio signal. Parameter information of the stereo is determined based on the audio data corresponding to each of the plurality of channels. Based on the stereo parameter information, indicator information of the audio collection capability of the terminal device for the stereo is analyzed.

[0126] The present application may also include an input unit 705, which may include at least one of a touch sensor unit for detecting touch events on a touch display panel, a keyboard, a mouse, a camera, a pickup, or other device.

[0127] The output unit 704 may include at least one of a display, a speaker, a vibration mechanism, a lamp, and the like. The display may include a display panel such as a touch panel. The display panel may be configured as a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. The vibration mechanism may displace the electronic device 700 when activated. In one possible implementation, the vibration mechanism includes a motor and an eccentric vibrator, and the motor rotates the eccentric vibrator to generate vibrations. The brightness and / or color of the lamp may be adjusted. In one possible implementation, different information may be expressed by at least one of the flashing, brightness, and color of the lamp. For example, a red light may be emitted from the lamp to express alarm information.

[0128] Of course, the configuration of the electronic device 700 shown in FIG. 7 does not limit the electronic device in the embodiments of the present application, and in actual applications, the electronic device may include more components than those shown in FIG. 7 or may combine some components.

[0129] An embodiment of the present application further provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, realizes the analysis method described in each of the above method embodiments.

[0130] An embodiment of the present application further provides a processor for executing a program, which, when executed, implements the analysis method described in each of the method embodiments above.

[0131] An embodiment of the present application further provides a computer program product, which, when executed on a data processing device, causes the data processing device to implement the analysis methods described in each of the method embodiments above.

[0132] Here, since the electronic device, processor, computer-readable medium or computer program product provided by the above-described embodiments of the present application can be used to perform the corresponding methods described above, the beneficial effects obtained can refer to the beneficial effects of the corresponding methods described above, and the description thereof will be omitted here.

[0133] The present application will be described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine such that the instructions, executed by the processor of the computer or other programmable data processing device, generate means for performing the functions specified in one or more flows in the flowcharts or one or more blocks in the block diagrams.

[0134] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer-readable memory can produce an article of manufacture that includes an instruction device that performs the functions specified in one or more flows of the flowcharts or one or more blocks of the block diagrams.

[0135] These computer program instructions may be loaded into a computer or other programmable data processing device to cause the computer or other programmable device to execute a series of operational steps to achieve computer-implemented processing, whereby the instructions executed on the computer or other programmable device provide steps to perform the functions specified in one or more flows of the flowcharts or one or more blocks of the block diagrams.

[0136] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0137] Memory may include forms of non-volatile memory, random access memory (RAM), and / or non-volatile memory such as read only memory (ROM) or flash memory (flash RAM) in a computer readable medium. Memory is an example of a computer readable medium.

[0138] Computer-readable media include persistent and non-persistent media, removable and non-removable media, and may store information using any method or technology. Information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media for storing information accessible by a computing device include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only optical disks (CD-ROMs), digital versatile disks (DVDs) or other optical storage devices, magnetic cartridges, magnetic disk storage devices or other magnetic storage devices, or other non-transferable media. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals or carrier waves.

[0139] Those skilled in the art will appreciate that the embodiments herein may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0140] The above description is merely a description of preferred embodiments and the technical principles employed in the present application, and is not intended to limit the present application. Various modifications and variations of the present application are possible for those skilled in the art. Those skilled in the art will understand that the scope of the present application is not limited to technical solutions consisting of specific combinations of the above-described technical features, but should also encompass other technical solutions consisting of any combination of the above-described technical features or their equivalent features without departing from the spirit of the above-described disclosure. For example, a technical solution formed by replacing the above features with technical features having similar functions (including, but not limited to, those disclosed in the present application).

Claims

1. 1. A method for analyzing an audio collection, comprising: obtaining a stereo audio signal collected by a terminal device; analyzing the stereo audio signal to obtain audio data corresponding to each of a plurality of channels; determining stereo parameter information based on audio data corresponding to each of the plurality of channels; and analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo.

10. A method for analyzing an audio collection, comprising:

2. The step of determining stereo parameter information based on audio data respectively corresponding to the plurality of channels includes: determining a signal delay difference and an amplitude difference between the channels based on audio data corresponding to each of the plurality of channels; The step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo includes: determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between the channels; 2. The method of claim 1, wherein the audio collection is analyzed.

3. determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between the channels, and performing calculations using a predetermined human ear auditory positioning model based on the signal delay difference and amplitude difference between the channels to obtain the sound source positioning information.

3. The method of claim 2, wherein the audio collection is analyzed.

4. After determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between the channels, and determining, based on the sound source positioning information, sound collection angle information for collecting audio from the stereo by the terminal device.

3. The method of claim 2, wherein the audio collection is analyzed.

5. After determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between the channels, and determining sound source positioning deviation information for audio collection by the terminal device for the stereo based on the sound source positioning information and actual sound source position information of the stereo.

3. The method of claim 2, wherein the audio collection is analyzed.

6. After determining sound source positioning information for audio collection for the stereo by the terminal device based on the signal delay difference and amplitude difference between the channels, The method further includes determining positioning deviation information for audio and video collection by the terminal device for the stereo based on the sound source positioning information and video collection positioning information of video collection by the terminal device corresponding to the stereo; 3. The method of claim 2, wherein the audio collection is analyzed.

7. The step of determining stereo parameter information based on audio data respectively corresponding to the plurality of channels includes: determining a signal delay of a target channel based on audio data corresponding to each of the plurality of channels, the target channel being a channel having the smallest delay among the plurality of channels; The step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo includes: determining a differential delay for audio and video collection by the terminal device relative to the stereo based on a signal delay of the target channel and a delay at which the terminal device collects a video signal; 2. The method of claim 1, wherein the audio collection is analyzed.

8. The step of determining stereo parameter information based on audio data respectively corresponding to the plurality of channels includes: determining frequency response difference information between each channel and a delay difference on an inter-device link based on audio data corresponding to each of the plurality of channels; The step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo includes: determining channel consistency for audio collection for the stereo by the terminal device based on frequency response difference information between the channels and delay differences on device inter-links; 2. The method of claim 1, wherein the audio collection is analyzed.

9. The step of determining stereo parameter information based on audio data respectively corresponding to the plurality of channels includes: determining frequency response information for each channel based on audio data corresponding to each of the plurality of channels; The step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo includes: determining a frequency range in which audio is collected for the stereo by the terminal device and crossover point information at low frequencies based on the frequency response information of each channel; 2. The method of claim 1, wherein the audio collection is analyzed.

10. The step of acquiring audio data corresponding to each of a plurality of channels by analyzing the stereo audio signal includes: If the terminal device is a device requiring decoding, analyzing the decoded stereo audio signal to obtain audio data corresponding to each of a plurality of channels; 2. The method of claim 1, wherein the audio collection is analyzed.

11. The step of analyzing indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo includes: analyzing indicator information of the audio collection capability of the terminal device for the stereo based on the parameter information of the stereo determined after each sound source position update, wherein the interval between two adjacent sound source positions is determined based on positioning accuracy information of the terminal device; Method for analyzing an audio collection according to any one of claims 1 to 10.

12. 1. An apparatus for analyzing an audio collection, comprising: an acquisition module configured to acquire a stereo audio signal collected by a terminal device; an analysis module configured to analyze the stereo audio signal to obtain audio data corresponding to each of a plurality of channels; a determination module configured to determine the stereo parameter information based on audio data corresponding to each of the plurality of channels; an analysis module configured to analyze indicator information of an audio collection capability of the terminal device for the stereo based on the parameter information of the stereo; 1. An apparatus for analyzing audio collection, comprising:

13. 1. An electronic device comprising: a storage medium; a processor; and a computer program stored on the storage medium and executable by the processor; When the processor executes the computer program, the method according to any one of claims 1 to 11 is realized. An electronic device characterized by:

14. A computer storage medium on which a computer program is stored, When the computer program is executed by a processor, the method according to any one of claims 1 to 11 is realized. A computer storage medium comprising:

Images