Audio testing method and device, electronic equipment and storage medium

By playing test audio to simulate user output and combining it with audio detection technology, the system automatically analyzes the start time of background audio and test audio, thus solving the subjective error problem caused by live singing and achieving objective accuracy in audio synchronization testing.

CN117558302BActive Publication Date: 2026-03-27BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-11
Publication Date
2026-03-27

AI Technical Summary

Technical Problem

In existing technologies, audio synchronization testing relies on live singing, which is greatly affected by the singer's skill level and the tester's hearing level, resulting in subjective and inaccurate test results.

Method used

By playing test audio to simulate user output, audio from each recording end is recorded. Combined with audio detection technology, the start time of background audio and test audio is automatically analyzed to determine the synchronous test results and avoid the influence of human factors.

Benefits of technology

It achieves objectivity and accuracy in audio synchronization testing, and can automatically process audio synchronization tests of multiple devices, reducing human error.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117558302B_ABST
    Figure CN117558302B_ABST
Patent Text Reader

Abstract

The present disclosure relates to the technical field of computers, and discloses an audio testing method and device, electronic equipment and a storage medium. The method comprises obtaining first recording audio of each recording end and second recording audio of a playing end. The first recording audio and the second recording audio both comprise background audio played simultaneously, and the first recording audio further comprises test audio corresponding to the recording end one by one. Audio detection is performed on each first recording audio to obtain a starting time of the background audio in each first recording audio. Audio detection is performed on the second recording audio to obtain a starting time of the background audio in the second recording audio and a detection time of each test audio. Based on the starting time of the background audio in the second recording audio and the detection time of each test audio, and the starting time of the background audio in each first recording audio, a synchronous test result of the second recording audio is determined. The method objectively ensures the accuracy of the synchronous test result.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, in particular to an audio testing method and device, electronic equipment and storage medium. BACKGROUND

[0002] In some audio scenes, singing or reciting on the basis of the same background audio online is involved, that is, the audio of the user is added to the background audio and then output to a playing end for playing, which requires analyzing the synchronization of the background audio and the audio of the user. For example, in a real-time chorus scene, the audience end hopes to hear the effect of the alignment of the progress of the multiple voices and the accompaniment, that is, the voices of all singers are synchronized with the accompaniment. Therefore, in order to achieve this effect, it is necessary to test the synchronization degree of the voices and the accompaniment in the chorus scene to meet the demand of voice-accompaniment synchronization. SUMMARY

[0003] Therefore, the present disclosure provides an audio testing method and device, electronic equipment and storage medium to solve the problem of synchronization testing in audio.

[0004] In a first aspect, the present disclosure provides an audio testing method, which comprises:

[0005] obtaining first recording audio of each recording end and second recording audio of a playing end, wherein the first recording audio and the second recording audio both comprise background audio played simultaneously, the first recording audio further comprises test audio corresponding to the recording end one by one, the second recording audio is playing audio of the playing end, and the playing audio comprises the background audio and test audio played by all playing ends;

[0006] performing audio detection on each first recording audio to obtain a starting time of the background audio in each first recording audio;

[0007] performing audio detection on the second recording audio to obtain a starting time of the background audio in the second recording audio and a detection time of each test audio;

[0008] determining a synchronization test result of the second recording audio based on the starting time of the background audio in the second recording audio and the detection time of each test audio, and the starting time of the background audio in each first recording audio.

[0009] In a second aspect, the present disclosure provides an audio testing device, which comprises:

[0010] The recording audio acquisition module is configured to acquire first recording audios of each recording terminal and a second recording audio of a playing terminal, the first recording audios and the second recording audio each include a background audio played simultaneously, the first recording audios further include a test audio corresponding to each recording terminal, and the second recording audio is a playing audio of the playing terminal, the playing audio includes the background audio and test audios played by all the playing terminals;

[0011] The first audio detection module is configured to perform audio detection on each first recording audio to obtain a starting time of the background audio in each first recording audio.

[0012] The second audio detection module is configured to perform audio detection on the second recording audio to obtain a starting time of the background audio in the second recording audio and a detection time of each test audio.

[0013] The synchronization test module is configured to determine a synchronization test result of the second recording audio based on the starting time of the background audio in the second recording audio and the detection time of each test audio, and the starting time of the background audio in each first recording audio.

[0014] In a third aspect, the present disclosure provides an electronic device, including a memory and a processor, the memory and the processor are communicatively connected with each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the audio test method of the first aspect or any of the corresponding embodiments thereof.

[0015] In a fourth aspect, the present disclosure provides a computer readable storage medium, the computer readable storage medium stores computer instructions, and the computer instructions are used to make a computer execute the audio test method of the first aspect or any of the corresponding embodiments thereof.

[0016] In a fifth aspect, the present disclosure provides an audio test system, the system includes:

[0017] A plurality of recording terminals, each of the recording terminals includes a first playing device, a third playing device and a first recording device, all the first playing devices are configured to play a background audio simultaneously, the third playing devices are configured to play test audios corresponding to the recording terminals simultaneously, and the first recording devices are configured to record the background audio and the test audios to obtain first recording audios;

[0018] A playing terminal including a second playing device and a second recording device, the second playing device is configured to play the test audios played by all the third playing devices and play the background audio simultaneously with all the first playing devices, and the second recording device is configured to record a playing audio of the second playing device to obtain a second recording audio.

[0019] The electronic device of the third aspect is connected to the recording end and the playing end respectively.

[0020] The audio testing method provided by the embodiments of the present disclosure can ensure the objectivity of the testing result, because the same background audio and the test audio corresponding to each recording end are played for each recording end, and the test audio is automatically played rather than manually output. Meanwhile, the first recording audio includes the background audio and the test audio corresponding to the recording end, and the second recording audio includes the same background audio and the test audio played by the playing device of each recording end. The situation of playing audio by the playing end is simulated by the second recording audio, and the starting time of the background audio in each first recording audio, the starting time of the background audio in the second recording audio, and the detection time of each test audio are obtained by testing the first recording audio and the second recording audio, so that the synchronization test result corresponding to each recording end can be represented in the second recording audio. The whole testing process is automatically implemented, and the audio is not manually output, so that the accuracy of the synchronization test result is ensured in an objective way. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the specific embodiments of the present disclosure or the prior art, the drawings needed to be used in the specific embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative effort.

[0022] Figure 1 is a structural schematic diagram of an audio testing system according to an embodiment of the present disclosure;

[0023] Figure 2 is a structural schematic diagram of another audio testing system according to an embodiment of the present disclosure;

[0024] Figure 3 is a flow schematic diagram of an audio testing method according to an embodiment of the present disclosure;

[0025] Figure 4 is a flow schematic diagram of another audio testing method according to an embodiment of the present disclosure;

[0026] Figure 5 is a schematic diagram of a first recording audio and a second recording audio according to an embodiment of the present disclosure;

[0027] Figure 6 is a flow schematic diagram of another audio testing method according to an embodiment of the present disclosure;

[0028] Figure 7 is a structural block diagram of an audio test device according to an embodiment of the present disclosure;

[0029] Figure 8 is a hardware structure schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be described below in a clear and complete manner with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only some of the embodiments of the present disclosure but not all the embodiments. Based on the embodiments in the present disclosure, any other embodiments obtained by those skilled in the art without creative work fall within the scope of the present disclosure.

[0031] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type, use range, use scenario and the like of the personal information involved in the present disclosure should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0032] For example, in response to receiving an active request of a user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will need to obtain and use the personal information of the user. Thus, the user can autonomously select whether to provide the personal information to the software or hardware such as an electronic device, an application program, a server or a storage medium performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0033] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information may, for example, be presented in the form of text in the pop-up window. In addition, the pop-up window may, for example, carry a selection control for the user to select “agree” or “disagree” to provide the personal information to the electronic device.

[0034] It can be understood that the above notification and obtaining of user authorization process is only illustrative, and does not limit the implementation manners of the present disclosure, and other manners meeting relevant laws and regulations can also be applied to the implementation manners of the present disclosure.

[0035] It can be understood that the data (including but not limited to the data itself, the acquisition or use of the data) involved in the present technical solution should comply with the requirements of relevant laws and regulations and relevant provisions.

[0036] In the related art, the synchronization test of the audio of the user and the background audio is performed by playing the background audio at the recording end and outputting the audio by a real person, recording the background audio and the audio output by the real person and sending them to the playing end for playing, and a test personnel analyzes the synchronization degree of the audio heard according to his own experience at the playing end to obtain a synchronization analysis result. However, this process needs to rely on a real person to output the audio, and the synchronization analysis result is obtained according to the experience of the test personnel, so that the test result is relatively subjective and cannot be reproduced.

[0037] Taking a chorus scene as an example, in addition to some functional effects and sound quality effects such as the synchronization of music and lyrics progress, ear return sound quality, device switching experience, and volume balance and the like, which affect the user experience in the chorus scene, the most important one is the synchronization of the voice and the accompaniment, that is, the voice accompaniment synchronization. For the audience end, the effect of the multi-path voice and the accompaniment progress expected to be heard is that the voices of all the singers can be synchronized with the accompaniment, and the offline chorus is restored as much as possible. However, due to the inconsistent delay introduced by the audio processing link when processing the voice and the accompaniment, the voice and the accompaniment cannot be accurately synchronized during mixing, so in the actual scene, the singers sing along with the accompaniment, but the audience hears that the voice of the singer is out of sync with the accompaniment, that is, the voice is ahead of the accompaniment or the voice lags behind the accompaniment. For this scene, the voice accompaniment synchronization test in the related art is implemented based on active testing, that is, multiple people act as singers, sing a song online with different devices, and the audience end subjectively tests the synchronization of the voice of each singer and the accompaniment.

[0038] However, in the above scheme, the chorus voice accompaniment synchronization test is a subjective test of real singing by real people, which is greatly affected by the singing level of the singers themselves, and the hearing level of the sound listening test personnel is required to be high, so that the test result is greatly affected by the subjectivity.

[0039] Therefore, based on this, the embodiment of the present disclosure provides an audio test method, which plays test audio for simulating the audio output by a user, records corresponding first recording audio for each recording end; then plays the background audio and the test audio played by each recording end at the playing end to simulate the audio heard by the user at the playing end, and records the audio played at the playing end to obtain second recording audio. The first recording audio and the second recording audio are subjected to audio detection to obtain the starting time of the background audio of each recording end and the detection time of the test audio of each recording end in the second recording audio, and through time comparison and analysis, the synchronization test result of the second recording audio can be obtained. The synchronization test result includes but is not limited to the synchronization of the test audio of each recording end and the background audio, the background audio delay of each recording end, and the synchronization between each recording end, and the like.

[0040] This audio testing method simulates user audio by playing test audio, eliminating the use of actual user audio and thus avoiding errors caused by subjective factors leading to discrepancies between user audio and background audio. Furthermore, this method can perform device coverage testing, simultaneously testing the audio synchronization of multiple devices.

[0041] If this audio testing method is applied to a choral setting where there is no live singer, the test audio is played using a playback device to replace the singer's performance, thus avoiding errors caused by the live singer's performance not being in sync with the accompaniment.

[0042] This disclosure also provides an audio testing system, such as... Figure 1 As shown, this system can simultaneously test n recording devices. Each recording device includes a first playback device, a first recording device, and a third playback device. The first playback device plays background audio, and the third playback device plays the corresponding test audio from each recording device. The test audio corresponds one-to-one with the recording device. The first recording device records both the background audio and the test audio to obtain the first recorded audio. Specifically, the test audio played by the third playback device can be single-frequency tones of different frequencies, or it can be replaced by other different tapping sounds or signals of different lengths. The specific form of the test audio is not limited here and can be set according to actual needs.

[0043] The first recording device is used to record audio played by the first playback device and the third playback device to obtain a first recorded audio. The first recorded audio includes background audio and test audio from the recording device. The playback device is used to simulate audio output by n users based on the same background audio, and includes a second playback device and a second recording device. The second playback device is used to play the background audio and the test audio played by the n recording devices. The test audio played by the recording devices is sent to the recording device, played by the second playback device of the playback device, and thus recorded by the second recording device to obtain the second recorded audio.

[0044] During testing, background audio is played simultaneously on the first playback device of all recording terminals and the second playback device of all playback terminals. Recording begins simultaneously on the first recording device of all recording terminals and the second recording device of the playback terminals. The recording start time can be at the same time as the background audio is playing, or after the background audio has been playing for a period of time, etc. There are no restrictions on the timing of the recording; it can be set according to the actual needs.

[0045] Electronic devices are used to control the devices at each recording end and the devices at the playback end. For example, they can control the playback of background audio at the recording end and the playback end, control the playback of test audio at the recording end, and control the recording of the first recording device and the second recording device, etc.

[0046] In the test process, in order to avoid the influence of other audio on the test results, each recording end and the playing end need to be tested in a quiet environment. For example, the recording end is set in an anechoic box, or each recording end is set in an independent test room, etc. The first playing device to the third playing device can adopt a manual mouth or other devices with audio playing function, and the first recording device and the second recording device can adopt a standard microphone or other devices with audio recording function. The electronic device can adopt a sound card, or can be replaced by other devices that can control multiple recording or playing devices to record or play simultaneously.

[0047] In some optional embodiments, taking the synchronous test in a chorus scene as an example, Figure 2 A specific application example of the audio test system is shown. In the recording studio, four anechoic boxes are used to test the synchronization performance of four singing devices, respectively. In each anechoic box, a singing device, a player and a recorder are arranged. Among them, the singing device 1 to the singing device 4 correspond to the first playing device in Figure 1 , the player 1 to the player 4 correspond to the third playing device in Figure 1 , the recorder 1 to the recorder 4 correspond to the first recording device in Figure 1 ; for the playing end, the audience device corresponds to the second playing device in Figure 1 , and the audience end recording device corresponds to the second recording device in Figure 1 .

[0048] Specifically, four independent and mutually independent anechoic boxes are placed in the same recording studio, and each anechoic box is placed with a singing device, a recorder for audio recording, and a player for playing test audio to act as a singer. The playing & recording triggering device corresponds to the electronic device in Figure 1 , generally adopts a sound card, and is used for the player in each anechoic box to play sound. The recording triggering device is used for the recorder in each anechoic box to record sound synchronously, and the singing device in the anechoic box sends the test audio played by the player to the audience end device for playing. Correspondingly, the audience end recorder can collect the background audio and the test audio played by the player of each recording end.

[0049] In a multi-person chorus scenario, user A selects a song as accompaniment in a chorus application, allowing users B, C, and D to join the chorus. Users A through D sing the song together, sometimes in turn, sometimes in unison, while other listeners hear the multi-dimensional chorus effect. Based on this chorus method, test scenarios include real-time chorus-round and real-time chorus-unison. In round, users A through D sing in turn without overlapping; in unison, users A through D sing together with overlapping vocals.

[0050] The real-time chorus scenario is divided into round singing and chorus singing. In the round singing scenario, the player is triggered to play audio in turn according to the number, and at the same time, the recorder with the corresponding number and the audience recorder are triggered to record audio, thereby obtaining the first recorded audio from each singer and the second recorded audio from the audience. The first and second recorded audio are used to obtain the round singing related indicators. In the chorus singing scenario, all players are triggered to play audio simultaneously, and the recorder with the corresponding number and the audience recorder are triggered to record audio, so that the first and second recorded audio are used to obtain the chorus-related indicators.

[0051] by Figure 2 For example, singing devices 1 through 4 play accompaniment simultaneously. During a round, players 1 through 4 are triggered in turn to play test audio. Recorders 1 through 4, as well as the audience-end recorder, are also triggered to record audio. During a chorus, players 1 through 4 play their corresponding test audio simultaneously, and recorders 1 through 4 record audio simultaneously. During a round, the players play the test audio sequentially, with only one person singing at a time; during a chorus, all players play the test audio simultaneously, and all singers sing together. Regardless of whether it's a round or a chorus, the corresponding numbered recorders are triggered simultaneously. Combining the audio testing method provided in this embodiment, the vocal accompaniment synchronization degree of each singer can be calculated in both round and chorus scenarios. Furthermore, in the chorus scenario, the synchronization degree of all singers' local players and the alignment degree of all singers' voices heard by the audience can be output simultaneously.

[0052] According to an embodiment of this disclosure, an audio testing method embodiment is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0053] This embodiment provides an audio testing method that can be used in electronic devices, such as computers, mobile terminals, etc. Figure 3 This is a flowchart of an audio testing method according to an embodiment of the present disclosure, such as... Figure 3As shown, the flow includes the following steps:

[0054] In step S301, the first recording audio of each recording terminal and the second recording audio of the playing terminal are acquired.

[0055] The first recording audio and the second recording audio both include the background audio played simultaneously, and the first recording audio further includes the test audio corresponding to the recording terminal and played by the playing device of the recording terminal. The second recording audio is the playing audio of the playing terminal, which includes the background audio and the test audio played by all the playing terminals.

[0056] It should be noted that the number of recording terminals in the embodiment can be one, two or more, which is set according to actual test requirements, and is not limited herein. The first recording audio corresponds to the recording terminal, and includes the background audio and the test audio played by the playing device of the recording terminal. As shown above, all the playing devices of the recording terminals and the playing terminal play the background audio simultaneously. Since each playing device can have different playing delays, the starting time of the background audio recorded by the recording device of each recording terminal has a delay. For all the recording devices, the starting time of recording can be before, at the same time or after playing the background audio, which is not limited.

[0057] The first recording audio further includes the test audio corresponding to the recording terminal, which is used to simulate the user audio. For example, the test audio is a single-frequency audio with different frequencies. In combination with the above description of the playing terminal, the test audio played by the third playing device can be received by the first playing device and sent to the second playing device. Accordingly, the audio played by the second playing device includes the background audio and the test audio of each recording terminal. Figure 1 As shown, all the first playing devices and the second playing device play the background audio simultaneously, the third playing device plays the test audio, and all the first recording devices and the second recording device start recording simultaneously. Since the test audio played by the third playing device can be received by the first playing device and sent to the second playing device, accordingly, the audio played by the second playing device includes the background audio and the test audio of each recording terminal. The playing terminal records the audio played by the second playing device to obtain the second recording audio.

[0058] In step S302, the audio of each first recording audio is detected to obtain the starting time of the background audio in each first recording audio.

[0059] If there are multiple recording ends, multiple first recorded audios corresponding to the recording ends are obtained. The processing of the multiple first recorded audios can be parallel processing, or sequential processing, etc. The audio detection is performed on the first recorded audio to obtain the starting time of the background audio. The detection manner can be that the feature of the background audio is obtained, the feature of the first recorded audio is extracted, and the two features are compared to obtain the starting time of the background audio. Alternatively, the background audio and the first recorded audio can be converted into the frequency domain, and alignment processing is performed in the frequency domain to obtain the starting time of the background audio.

[0060] As shown above, although all the first playing devices are playing the background audio at the same time, the starting time of the background audio recorded by each first recording device is different due to the different playing delays of the first recording devices. Through the above processing manner, the starting time of the background audio in each first recorded audio can be obtained. If the recording end 1 to the recording end n are involved in the test manner, the first recorded audio 1 to the first recorded audio n are obtained accordingly, and the starting time of the background audio in the first recorded audio 1 to the first recorded audio n is t1 to tn respectively.

[0061] In step S303, audio detection is performed on the second recorded audio to obtain the starting time of the background audio in the second recorded audio and the detection time of each test audio.

[0062] The second recorded audio includes the background audio and the test audio of each recording end. The detection manner of the background audio is similar to that of step S302, and the starting time t of the background audio in the second recorded audio is obtained. The test audio is one-to-one corresponding to the recording end, and accordingly, different test audios have different features. Based on this, each test audio is detected from the second recorded audio through audio feature detection, so that the detection time of each test audio can be obtained. The detection time of the test audio is the time when the playing end plays the test audio, which can also be regarded as the starting time of the test audio in the second recorded audio. For the convenience of description, the detection time of the test audio of the recording end 1 to the recording end n in the second recorded audio is marked as T1 to Tn.

[0063] Due to the different collection delays of each first playing device, the starting time of the test audio received by the playing end and the background audio are not aligned. Alternatively, in the scenario where the test audio is played at the same time, due to the different collection delays of each first playing device, the test audio of each recording end received by the playing end is not aligned, and the delay introduced by the audio processing link when processing the test audio and the background audio is inconsistent, which can cause the test audio and the background audio to be not accurately aligned when mixing. Therefore, in the second recorded audio, each test audio has a corresponding detection time.

[0064] It should be noted that the implementation of the audio detection is not limited here, and can be set according to actual needs.

[0065] In step S304, the starting time of the background audio in the second recorded audio and the detection time of each test audio are compared with the starting time of the background audio in each first recorded audio to determine the synchronization test result of the second recorded audio.

[0066] If there is only one recording end, the starting time of the background audio in the first recorded audio can be compared with the starting time of the background audio in the second recorded audio to obtain the delay of the starting time of the background audio. The time when the test audio is played by the recording end can be compared with the detection time of the test audio in the second recorded audio to obtain the delay of the test audio. The difference between the detection time of the test audio in the second recorded audio and the playing time of the test audio, and the difference between the delay of the starting time of the background audio, are used to obtain the sound partner asynchronization degree, which is used to represent the asynchronization degree of the test audio and the background audio.

[0067] If there are multiple recording ends, the synchronization of the test audio between each recording end and the alignment of all test audios in the actual scene can be calculated. Of course, in the case of multiple recording ends, the synchronization of a single recording end can also be tested. The specific determination of the test index in the synchronization test result of the second recorded audio is set according to actual needs, and is not limited here.

[0068] The audio test method provided in the embodiment can ensure the objectivity of the test result for each recording end, because the same background audio and the test audio corresponding to the recording end are played, and the test audio is automatically played rather than manually output. Meanwhile, the first recorded audio includes the background audio and the test audio corresponding to the recording end, and the second recorded audio includes the same background audio and the test audio played by the playing device of all recording ends. The playing of the audio by the playing end is simulated through the second recorded audio, and the starting time of the background audio in each first recorded audio, the starting time of the background audio in the second recorded audio, and the detection time of each test audio are obtained through the audio detection of the first recorded audio and the second recorded audio. Therefore, the synchronization test result corresponding to each recording end can be represented in the second recorded audio, the entire test process is automatically implemented, the audio does not need to be manually output, the test result is not affected by subjective factors, and the accuracy of the synchronization test result is ensured in an objective manner.

[0069] In the embodiment, an audio test method is provided, which can be used in electronic devices such as computers, mobile terminals, and the like. Figure 4 The flowchart of the audio test method according to the embodiment of the present disclosure is shown in FIG. 1, which includes the following steps: Figure 4 ​

[0070] Step S401, obtaining the first recording audio of each recording end and the second recording audio of the playing end.

[0071] The first recording audio and the second recording audio both include background audio played simultaneously, the first recording audio further includes test audio corresponding to the recording end one by one and played by the playing device of the recording end, and the second recording audio is the playing audio of the playing end, which includes the background audio and the test audio played by all the playing ends. For details, please refer to Figure 3 Step S301 of the embodiment shown, which will not be repeated here.

[0072] Step S402, audio detection is performed on each first recording audio to obtain the starting time of the background audio in each first recording audio. For details, please refer to Figure 3 Step S302 of the embodiment shown, which will not be repeated here.

[0073] Step S403, audio detection is performed on the second recording audio to obtain the starting time of the background audio in the second recording audio and the detection time of each test audio. For details, please refer to Figure 3 Step S303 of the embodiment shown, which will not be repeated here.

[0074] Step S404, based on the starting time of the background audio in the second recording audio and the detection time of each test audio, and the starting time of the background audio in each first recording audio, the synchronization test result of the second recording audio is determined.

[0075] Specifically, the above step S404 includes:

[0076] Step S4041, obtaining the starting time of the background audio in the first recording audio of the reference recording end to obtain a reference starting time.

[0077] In the above step S402, the starting time of the background audio in each first recording audio is obtained, one of the recording ends is selected as a reference recording end, and the starting time of the background audio in the first recording audio of the reference recording end is taken as a reference starting time. For example, the first recording end is taken as the reference recording end. Of course, the reference recording end is set according to actual needs, which is not limited here.

[0078] In the chorus scene, different recording ends correspond to different singers. If there are n singers, there are n recording ends, and each recording end obtains the first recording audio. The background audio in the first recording audio is the accompaniment recorded.

[0079] For example, in Figure 5The n singers correspond to the accompaniment shown in the middle, which is recorded. From the above description, it can be known that due to the playing delay of the playing device of each recording end, the recorded accompaniment has a delay. In Figure 5 In the middle, the starting time of the recorded accompaniment corresponding to the singer 1-singer n is 0, t1-t n. Among them, the recording end of the singer 1 is determined as the reference recording end, and correspondingly, the starting time of the background audio thereof is determined as the 0 time.

[0080] Step S4042, based on the difference between the starting time of the background audio in the second recording audio and the reference starting time, the starting delay of the background audio in the second recording audio is determined.

[0081] The starting time t of the background audio in the second recording audio is obtained by the above step S403, which is used to represent the starting time of the background audio heard at the playing end. Among them, the difference between the starting time of the background audio in the second recording audio and the reference starting time is determined as the starting delay of the background audio in the second recording audio. If the reference starting time is determined as 0 time, the starting delay of the background audio in the second recording audio is t.

[0082] Step S4043, the time of simultaneously playing the test audio is obtained, and the test audio playing time is obtained.

[0083] The time of simultaneously playing the test audio is recorded as T, for example, after playing the background audio for 5s, the test audio is played, and 5s is determined as the test audio playing time. Among them, the playing time of the test audio is set according to the actual demand, which is not limited here. In the test process, the test audio of each recording end can be played only once, or played multiple times according to the demand, and the interval of each time of playing the test audio can be the same or different, etc.

[0084] Step S4044, based on the detection time of each test audio in the second recording audio, the starting delay of the background audio in the second recording audio and the starting time of the background audio in each first recording audio, the synchronization test result of the second recording audio is determined.

[0085] The synchronization test result includes the different step degree of the test audio and the background audio of each recording end heard at the playing end, which is called the sound accompaniment different step degree, recorded as list A. In the chorus scene, it refers to the different step degree of the voice and the accompaniment of each singer heard at the audience end when multiple people start singing at the same time.

[0086] The synchronization test result can also include the playing device different step degree, which is used to represent the delay difference between the background audio recorded by different recording ends, recorded as list B. In the chorus scene, it refers to the delay difference between the local playing accompaniment of multiple people.

[0087] The synchronization test result can further include alignment of all the test audio heard by the playback end from the recording end, denoted as list C. In the chorus scenario, it refers to the alignment of all the singer voices heard by the audience end, which means that all the singers start singing at the same time, and the time difference between the starting time of each singer received by the audience end and the starting time of the reference singer.

[0088] The synchronization test result can further include alignment of all the test audio heard by the playback end from the recording end, denoted as list C. In the chorus scenario, it refers to the alignment of all the singer voices heard by the audience end, which means that all the singers start singing at the same time, and the time difference between the starting time of each singer received by the audience end and the starting time of the reference singer.

[0089] The synchronization test result can further include the difference between the maximum value and the minimum value of the above-mentioned list D, denoted as delay_align. In the chorus scenario, the actual alignment of the audience end is defined as the maximum relative time difference of all the singers received by the audience end, denoted as alignment (i.e., the time difference between the earliest singing and the latest singing heard by the audience end).

[0090] It should be noted that, taking the chorus scenario as an example, if the voice-accompaniment synchronization degree calculation result is positive, it means that the accompaniment leads the voice; if it is negative, it means that the voice leads the accompaniment; if the alignment calculation result is positive, it means that the current singer voice lags behind the reference singer voice; if it is negative, it means that the current singer voice leads the reference singer voice.

[0091] In some optional embodiments, the above step S4044 includes:

[0092] Step a1, obtaining the test audio time difference corresponding to each recording end based on the difference between the detection time of the test audio corresponding to the recording end in the second recording audio and the playback time of the test audio.

[0093] Step a2, obtaining the background audio time difference corresponding to each recording end based on the difference between the starting time of the background audio in each first recording audio and the starting time of the background audio.

[0094] Step a3, for each recording terminal, based on the difference between the test audio time difference and the background audio time difference, obtain the different synchronization degree of the test audio and the background audio, and the synchronization test result includes the background audio time difference corresponding to each recording terminal and the different synchronization degree of the test audio and the background audio.

[0095] The detection time of the test audio corresponding to the recording terminal in the second recording audio is represented as T1-Tn when the test audio playing time T is played, and the test audio time difference corresponding to the recording terminal 1-recording terminal n is represented as [T1-T, T2-T, …, Tn-T].

[0096] If the reference starting time is determined as 0 time, the starting delay of the background audio in the second recording audio is t, and the starting time of the background audio in each first recording audio is represented as 0, t2-tn, that is, list B=[0, t2, …, tn]. Based on this, the background audio time difference corresponding to each recording terminal is represented as [t, t-t2, t-t3, …, t-tn].

[0097] For each recording terminal, the difference between the test audio time difference and the background audio time difference in the second recording audio obtains the different synchronization degree of the test audio and the background audio list A, which is represented as list A=[(T1-T)-t, (T2-T)-(t-t2), …, (Tn-T)-(t-tn)]. Wherein, the elements of list A correspond to the recording terminals one by one, the first element corresponds to the first recording terminal, the second element corresponds to the second recording terminal, and so on, the nth element corresponds to the nth recording terminal.

[0098] Due to the influence of the playing performance of each playing device, it will cause playing delay. Based on this, through the starting time of the background audio in the first recording audio of each recording terminal, the corresponding background audio time difference is obtained, and the synchronization analysis result of the playing device can be obtained. At the same time, by using the test audio time difference and the background audio time difference, the sound accompaniment synchronization degree of each recording terminal can be obtained.

[0099] In some optional embodiments, the above step S4044 includes:

[0100] Step b1, obtaining the detection time of the test audio corresponding to the reference recording terminal in the second recording audio, and obtaining the reference starting time of the test audio.

[0101] Step b2, based on the difference between the detection time of each test audio in the second recording audio and the reference starting time of the test audio, obtain the test audio first synchronization test result corresponding to each recording terminal.

[0102] The detection time of the test audio corresponding to the reference recording end in the second recording audio is represented as T1-Tn. If the first recording end is recorded as the reference recording end, the reference starting time of the test audio is T1. By calculating the difference between the detection time of each test audio in the second recording audio and the reference starting time of the test audio, the first synchronization test result of the test audio corresponding to each recording end is obtained, that is, list C, list C = [0, T2-T1, …, Tn-T1]. The elements in the list C correspond to the recording ends one by one.

[0103] The first synchronization test result of the test audio is used to represent the delay difference of the test audio of the remaining recording end relative to the reference recording end, and is used to represent the synchronization of the test audio of each recording end.

[0104] In some optional embodiments, the step S4044 comprises: obtaining the second synchronization test result of the test audio corresponding to each recording end based on the sum of the starting time of the background audio in each first recording audio and the first synchronization test result of the test audio corresponding to each recording end.

[0105] The starting time of the background audio in each first recording audio is list B = [0, t2, …, tn], and the first synchronization result of the test audio corresponding to each test end is list C = [0, T2-T1, …, Tn-T1]. The sum of the two is used to represent the second synchronization test result of the test audio corresponding to each recording end: list D = list B + list C = [0, T2-T1+t2, …, Tn-T1+tn].

[0106] In actual scenarios, due to different device playback delays of each participant, the local playback of the background audio is not synchronized, and each participant performs card shooting according to the local playback of the background audio. The second synchronization test result of the test audio can represent the alignment degree of the sound of all participants that the playback end can hear in the actual scenario.

[0107] In some optional embodiments, the step S4044 comprises:

[0108] Step c1, comparing the size of the second synchronization test result of the test audio corresponding to each recording end, obtaining the maximum value and the minimum value of the second synchronization test result of the test audio.

[0109] Step c2, obtaining the maximum relative delay difference of the test audio based on the difference between the maximum value and the minimum value.

[0110] Compare the magnitudes of the second synchronization test results for each test audio to obtain the maximum value (max(list D)) and minimum value (min(list D)) of the second synchronization test results for the test audio. By calculating the difference between the maximum and minimum values, the maximum relative delay difference (delay_align) of the test audio is obtained, expressed as: delay_align = max(list D) - min(list D).

[0111] By comparing the maximum and minimum values ​​of the second synchronization test results of the test audio, the difference between the two values ​​is used to represent the time difference between the earliest and latest sounds that can be heard at the playback end.

[0112] The audio testing method provided in this embodiment determines a reference recording end among all recording ends and uses the start time of the background audio in the first recorded audio as the reference start time, thereby obtaining the start delay of the background audio corresponding to each recording end; then, it obtains the time when the test audio is played simultaneously and uses it as the reference for the test audio. After obtaining the reference start time of the background audio and the reference of the test audio, it performs synchronous test analysis on the second recorded audio based on this, and can obtain accurate synchronous test results.

[0113] This embodiment provides an audio testing method that can be used in electronic devices, such as computers, mobile terminals, etc. Figure 6 This is a flowchart of an audio testing method according to an embodiment of the present disclosure, such as... Figure 6 As shown, the process includes the following steps:

[0114] Step S601: Obtain the first recorded audio from each recording end and the second recorded audio from the playback end.

[0115] The first and second recorded audios both include background audio played simultaneously. The first recorded audio also includes test audio that corresponds one-to-one with the recording end and is played by the playback device of the recording end. The second recorded audio is the playback audio of the playback end, which includes background audio and all test audio played by the playback end.

[0116] Specifically, step S601 includes:

[0117] Step S6011: Control the first playback device of each recording end and the second playback device of each playback end to play background audio simultaneously.

[0118] like Figure 1 As shown, the first playback device in each recording end and the second playback device in the playback end play background audio simultaneously. For example, playback commands are sent to the first playback device and the second playback device at the same time to trigger the simultaneous playback of background audio.

[0119] Step S6012, control the first recording device of each recording end and the second recording device of the playing end to start recording at the same time.

[0120] The starting recording time of the first recording device and the second recording device can be before, at the same time or after playing the background audio, which is not limited herein. For example, the recording instruction is issued to the first recording device and the second recording device at the same time to trigger the simultaneous recording of the audio.

[0121] Step S6013, control the third playing device of each recording end to play the corresponding test audio at the same time, and the test audio played by all the third playing devices is sent to the second playing device for playing.

[0122] Each test audio is played at the same time. Therefore, the test audio playing instruction is issued to each third playing device at the same time to trigger the simultaneous playing of the test audio. The test audio played by the third playing device is collected by the first playing device and sent to the second playing device for playing. At this time, the audio played by the second playing device includes the background audio and the test audio played by each recording end.

[0123] Step S6014, obtain the recording result of the first recording device of each recording end to obtain the first recording audio of each recording end.

[0124] Step S6015, obtain the recording result of the second recording device to obtain the second recording audio.

[0125] The first recording device records the audio of the recording end to obtain the first recording audio, and the first recording audio is one-to-one corresponding to the recording end. The second recording device records the audio of the playing end to obtain the second recording audio.

[0126] Step S602, perform audio detection on each first recording audio to obtain the starting time of the background audio in each first recording audio. For details, please refer to step S302 of the embodiment shown in Figure 1 The step S302 of the embodiment shown in

[0127] Step S603, perform audio detection on the second recording audio to obtain the starting time of the background audio in the second recording audio and the detection time of each test audio. For details, please refer to step S303 of the embodiment shown in Figure 1 The step S303 of the embodiment shown in

[0128] Step S604, based on the starting time of the background audio in the second recording audio and the detection time of each test audio, and the starting time of the background audio in each first recording audio, determine the synchronization test result of the second recording audio. For details, please refer to step S404 of the embodiment shown in Figure 4 The step S404 of the embodiment shown in

[0129] The audio test method provided by the embodiment can automatically control the background audio, play the test audio and record the recording device without human intervention, that is, the playing device and the recording device are used to perform objective test, so that the method can efficiently obtain the synchronous test result and has strong reproducibility.

[0130] As a specific application embodiment of the present disclosure, the audio test method is combined with Figure 2 As shown in the figure, in the chorus scene, four sound-absorbing boxes are used to represent four recording ends, the players in each sound-absorbing box are used to represent each singer, and the singing device is used to play the accompaniment and collect the single-frequency sound played by the player and then send it to the audience device. Correspondingly, the audio played by the audience device includes the accompaniment and the single-frequency sound played by each player. Corresponding to the four recording ends, there are four test audios, respectively, and different frequencies, same energy and same length of single-frequency sound are generated at the fixed positions of the test audios, which are used to simulate the sound of different singers. For example, single-frequency sound with a frequency of 0.25KHz, 0.5KHz, 0.75KHz and 1KHz and a length of 100ms is generated at the 6th second and the 7th second, respectively, so that the test audio corresponding to each singer can be obtained. The frequency and length of the single-frequency sound in the test audio are set according to actual needs, and are not limited herein. The recorder 1 to the recorder 4 are used to record four first recording audios, and the audience end recorder is used to record a second recording audio. After obtaining the first recording audio and the second recording audio, the audio test method introduced above is used for processing to obtain the synchronous test result of the second recording audio.

[0131] The above-mentioned indexes list A, list B, list C and list D can describe the alignment effect of the multi-channel voice and accompaniment heard by the audience in the real-time chorus scene, the synchronization degree of all local players of the singers, and the synchronization degree of the sound heard by the audience in the valley. The calculation result of list D can also be calculated by list A, list A measures the delay difference between the voice of each singer and the accompaniment heard by the audience, and list D measures the delay difference between the voices of all singers heard by the audience. For list A and list D, the difference between adjacent elements is equal, so list D can be calculated by list A.

[0132] An audio testing apparatus is also provided in the embodiments, which is configured to implement the above-described embodiments and preferred embodiments, and will not be described again. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.

[0133] The embodiments provide an audio testing apparatus, as shown in Figure 7 The apparatus comprises:

[0134] A recording audio obtaining module 701 is configured to obtain first recording audios of each recording terminal and a second recording audio of a playing terminal. The first recording audios and the second recording audio each comprise a background audio played simultaneously. The first recording audios further comprise a test audio corresponding to each recording terminal, which is played by a playing device of the recording terminal. The second recording audio is a playing audio of the playing terminal, which comprises the background audio and the test audio played by all the playing terminals.

[0135] A first audio detecting module 702 is configured to perform audio detection on each first recording audio to obtain a start time of the background audio in each first recording audio.

[0136] A second audio detecting module 703 is configured to perform audio detection on the second recording audio to obtain a start time of the background audio in the second recording audio and a detection time of each test audio.

[0137] A synchronization testing module 704 is configured to determine a synchronization testing result of the second recording audio based on the start time of the background audio in the second recording audio and the detection time of each test audio, and the start time of the background audio in each first recording audio.

[0138] In some optional embodiments, the test audios are played simultaneously, and the synchronization testing module 704 comprises:

[0139] A start time obtaining unit is configured to obtain the start time of the background audio in the first recording audio of a reference recording terminal to obtain a reference start time.

[0140] A start delay determining unit is configured to determine a start delay of the background audio in the second recording audio based on a difference between the start time of the background audio in the second recording audio and the reference start time.

[0141] A playing time obtaining unit is configured to obtain a time at which the test audios are played simultaneously to obtain a test audio playing time.

[0142] The synchronization test unit is configured to determine a synchronization test result of the second recorded audio based on the detection time of each test audio in the second recorded audio, the start delay of the background audio in the second recorded audio, and the start time of the background audio in each first recorded audio.

[0143] In some optional embodiments, the synchronization test unit comprises:

[0144] The test audio time difference determination sub-unit is configured to obtain a test audio time difference corresponding to each recording terminal based on a difference between the detection time of the test audio corresponding to the recording terminal in the second recorded audio and the test audio playing time.

[0145] The background audio time difference determination sub-unit is configured to obtain a background audio time difference corresponding to each recording terminal based on a difference between the start delay of the background audio and the start time of the background audio in each first recorded audio.

[0146] The audio asynchronization degree determination sub-unit is configured to obtain, for each recording terminal, an asynchronization degree of the test audio and the background audio based on a difference between the test audio time difference and the background audio time difference, and the synchronization test result comprises the background audio time difference corresponding to each recording terminal and the asynchronization degree of the test audio and the background audio.

[0147] In some optional embodiments, the synchronization test unit further comprises:

[0148] The reference start time acquisition sub-unit is configured to obtain the detection time of the test audio corresponding to the reference recording terminal in the second recorded audio to obtain a reference start time of the test audio.

[0149] The test audio first synchronization test result determination sub-unit is configured to obtain a test audio first synchronization test result corresponding to each recording terminal based on a difference between the detection time of each test audio in the second recorded audio and the reference start time of the test audio.

[0150] In some optional embodiments, the synchronization test unit further comprises:

[0151] The test audio second synchronization test result determination sub-unit is configured to obtain a test audio second synchronization test result corresponding to each recording terminal based on a sum of the start time of the background audio in each first recorded audio and the test audio first synchronization test result corresponding to each recording terminal.

[0152] In some optional embodiments, the synchronization test unit further comprises:

[0153] The comparison sub-unit is configured to compare the test audio second synchronization test result corresponding to each recording terminal to obtain a maximum value and a minimum value of the test audio second synchronization test result.

[0154] The maximum relative delay difference determination sub-unit is configured to obtain the maximum relative delay difference of the test audio based on the difference between the maximum value and the minimum value.

[0155] In some optional embodiments, the recorded audio acquisition module 701 comprises:

[0156] The first control unit is configured to control the first playing device of each recording end and the second playing device of the playing end to simultaneously play the background audio.

[0157] The second control unit is configured to control the first recording device of each recording end and the second recording device of the playing end to simultaneously start recording.

[0158] The third control unit is configured to control the third playing device of each recording end to simultaneously play the corresponding test audio, and the test audio played by all the third playing devices is sent to the second playing device for playing.

[0159] The first recording result acquisition unit is configured to acquire the recording result of the first recording device of each recording end, and obtain the first recorded audio of each recording end.

[0160] The second recording result acquisition unit is configured to acquire the recording result of the second recording device, and obtain the second recorded audio.

[0161] The audio test device in the embodiment is presented in the form of functional units. Here, the units refer to ASIC (Application Specific Integrated Circuit) circuits, processors and memories executing one or more software or fixed programs, and / or other devices that can provide the above functions.

[0162] Further function descriptions of the above-mentioned modules and units are the same as those of the corresponding embodiments, and will not be repeated here.

[0163] The embodiments of the present disclosure further provide an electronic device having the above-described Figure 7 audio test device.

[0164] Please refer to Figure 8 , Figure 8 is a structural schematic diagram of an electronic device provided by an optional embodiment of the present disclosure, as shown in Figure 8As shown, the electronic device includes one or more processors 10, memory 20, and interfaces 30 for communicating with other devices and for coupling various parts of the electronic device, including high-speed interfaces and low-speed interfaces. Various parts are communicatively coupled using different busses, and can be mounted on a common motherboard or in other manners as appropriate. The processor(s) can process instructions for execution within the electronic device, including instructions stored in the memory or on storage to implement routines, methods, or programs, for displaying graphical information for a GUI on an external input / output device, such as a display device coupled to the high-speed interface. In some alternative implementations, multiple processors and / or multiple buses can be employed as appropriate, as well as memory storage devices incident thereto. Also, various communication interfaces can be included, as well as keep-alive signals transmitted between devices to maintain connection of the devices. Figure 8 The processor 10 is taken as an example in the embodiments.

[0165] The processor 10 can be a central processing unit, a network processor, or a combination thereof. The processor 10 can further include a hardware chip. The hardware chip can be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device can be a complex programmable logic device, a field programmable logic device, a general array logic, or any combination thereof.

[0166] The memory 20 stores instructions executable by the at least one processor 10 to cause the at least one processor 10 to perform the methods illustrated in the embodiments.

[0167] The memory 20 can include a program storage area and a data storage area. The program storage area can store an operating system, application programs required by at least one function, and the like. The data storage area can store data created according to the use of the electronic device, and the like. In addition, the memory 20 can include a high-speed random access memory, and can further include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid state memory device. In some alternative implementations, the memory 20 can optionally include a memory that is remotely located with respect to the processor 10, and these remote memories can be connected to the electronic device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0168] The memory 20 can include a volatile memory, such as a random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid state memory device. The memory 20 can also include a combination of the above-mentioned types of memories.

[0169] The electronic device further includes a communication interface 30 for communicating with other devices or a communication network.

[0170] The embodiments of the present disclosure further provide a computer readable storage medium, and the method according to the embodiments of the present disclosure can be implemented in hardware, firmware, or recorded in a storage medium, or be implemented as computer code originally stored in a remote storage medium or a non-transitory machine readable storage medium downloaded through a network and stored in a local storage medium, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor, or programmable or special hardware. Wherein, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk or a solid state disk, etc. Further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that the computer, processor, microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, processor or hardware, the method shown in the above embodiments is implemented.

[0171] Although the embodiments of the present disclosure are described in conjunction with the accompanying drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present disclosure, and such modifications and changes fall within the scope defined by the appended claims.

Claims

1. An audio testing method, characterized in that, The method includes: The system acquires first recorded audio from each recording terminal and second recorded audio from each playback terminal. Both the first and second recorded audio include background audio played simultaneously. The first recorded audio also includes test audio corresponding to each recording terminal, and the test audio is played by the playback device of the recording terminal. The second recorded audio is the playback audio from the playback terminal, which includes the background audio and the test audio played by all playback terminals. The test audio is used to simulate user audio. Perform audio detection on each of the first recorded audio files to obtain the start time of the background audio in each of the first recorded audio files; Audio detection is performed on the second recorded audio to obtain the start time of the background audio in the second recorded audio and the detection time of each of the test audios; Based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios, the synchronization test result of the second recorded audio is determined. The acquisition of the first recorded audio from each recording end and the second recorded audio from the playback end includes: Control the first playback device of each of the recording ends and the second playback device of each playback end to play the background audio simultaneously; The first recording device of each of the recording ends and the second recording device of the playback end are controlled to start recording simultaneously; The third playback device of each of the recording ends is controlled to play the corresponding test audio simultaneously, and the test audio played by all the third playback devices is sent to the second playback device for playback; Obtain the recording results of the first recording device of each of the recording ends, and obtain the first recorded audio of each recording end; Obtain the recording result from the second recording device to obtain the second recorded audio.

2. The method according to claim 1, characterized in that, The test audios are played simultaneously. The determination of the synchronization test result for the second recorded audio, based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios, includes: Obtain the start time of the background audio in the first recorded audio from the reference recording end to get the reference start time; The start delay of the background audio in the second recorded audio is determined based on the difference between the start time of the background audio in the second recorded audio and the reference start time. Obtain the moment when the test audio is played simultaneously to get the test audio playback time; Based on the detection time of each test audio in the second recorded audio, the start delay of the background audio in the second recorded audio, and the start time of the background audio in each of the first recorded audio, the synchronization test result of the second recorded audio is determined.

3. The method according to claim 2, characterized in that, The step of determining the synchronization test result of the second recorded audio based on the detection time of each test audio in the second recorded audio, the start delay of the background audio in the second recorded audio, and the start time of the background audio in each of the first recorded audios includes: Based on the difference between the detection time of the test audio corresponding to the recording end and the playback time of the test audio in the second recorded audio, the test audio time difference corresponding to each recording end is obtained; Based on the difference between the start delay of the background audio and the start time of the background audio in each of the first recorded audios, the background audio time difference corresponding to each of the recording ends is obtained. For each recording end, the asynchrony between the test audio and the background audio is obtained based on the difference between the test audio time difference and the background audio time difference. The synchronization test result includes the background audio time difference corresponding to each recording end and the asynchrony between the test audio and the background audio.

4. The method according to claim 2, characterized in that, The step of determining the synchronization test result of the second recorded audio based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios, further includes: Obtain the detection time of the test audio corresponding to the reference recording end in the second recorded audio, and obtain the reference start time of the test audio; Based on the difference between the detection time of each test audio in the second recorded audio and the reference start time of the test audio, the first synchronization test result of the test audio corresponding to each recording end is obtained.

5. The method according to claim 4, characterized in that, The step of determining the synchronization test result of the second recorded audio based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios, further includes: Based on the sum of the start time of the background audio in each of the first recorded audio segments and the first synchronization test result of the test audio corresponding to each of the recording ends, the second synchronization test result of the test audio corresponding to each of the recording ends is obtained.

6. The method according to claim 5, characterized in that, The step of determining the synchronization test result of the second recorded audio based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios, further includes: Compare the magnitudes of the second synchronization test results of the test audio corresponding to each of the recording ends to obtain the maximum and minimum values ​​of the second synchronization test results of the test audio. The maximum relative delay difference of the test audio is obtained based on the difference between the maximum value and the minimum value.

7. An audio testing device, characterized in that, The device includes: The audio recording acquisition module is used to acquire first recorded audio from each recording end and second recorded audio from each playback end. Both the first and second recorded audio include background audio played simultaneously. The first recorded audio also includes test audio corresponding to each recording end, and the test audio is played by the playback device of the recording end. The second recorded audio is the playback audio from the playback end, and the playback audio includes the background audio and the test audio played by all playback ends. The test audio is used to simulate user audio. The first audio detection module is used to perform audio detection on each of the first recorded audio files to obtain the start time of the background audio in each of the first recorded audio files. The second audio detection module is used to perform audio detection on the second recorded audio to obtain the start time of the background audio in the second recorded audio and the detection time of each of the test audios. The synchronization test module is used to determine the synchronization test result of the second recorded audio based on the start time of the background audio in the second recorded audio and the detection time of each of the test audios, and the start time of the background audio in each of the first recorded audios. The audio recording acquisition module includes: The first control unit is used to control the first playback device of each of the recording ends and the second playback device of the playback ends to play the background audio simultaneously. The second control unit is used to control the first recording device of each of the recording ends and the second recording device of the playback end to start recording simultaneously. The third control unit is used to control the third playback devices of each of the recording ends to play the corresponding test audio at the same time, and all the test audio played by the third playback devices are sent to the second playback device for playback; The first recording result acquisition unit is used to acquire the recording result of the first recording device of each of the recording ends, and to obtain the first recorded audio of each recording end; The second recording result acquisition unit is used to acquire the recording result of the second recording device and obtain the second recorded audio.

8. An electronic device, characterized in that, include: A memory and a processor are communicatively connected, the memory storing computer instructions, and the processor executing the computer instructions to perform the audio testing method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to perform the audio testing method according to any one of claims 1 to 6.

10. An audio testing system, characterized in that, The system includes: Multiple recording terminals are provided, each of which includes a first playback device, a third playback device, and a first recording device. All first playback devices are used to simultaneously play background audio, and the third playback devices are used to simultaneously play test audio corresponding to the recording terminal. The first recording device is used to record the background audio and the test audio to obtain a first recorded audio. The test audio is used to simulate user audio. The playback end includes a second playback device and a second recording device. The second playback device is used to play the test audio played by all the third playback devices and simultaneously play the background audio by all the first playback devices. The second recording device is used to record the audio played by the second playback device to obtain a second recorded audio. The electronic device of claim 8 is connected to both the recording end and the playback end.

Citation Information

Patent Citations

  • Real-time chorus synchronization method and device based on network live broadcast and network live broadcast system

    CN116962747A