Real-time audio delay test method and test system

Abstract

The invention discloses a real-time audio delay test method and system, and the method comprises the steps: a first test machine and a second test machine are respectively configured for a first terminal and a second terminal which are in communication connection, and both the first test machine and the second test machine have a millisecond world time display function; audio data are generated close to the first terminal, video recording is performed on the first terminal and the second terminal through a third testing machine and a fourth testing machine, and video recording content comprises the audio data of the first terminal and the second terminal and world time displayed by the first testing machine and the second testing machine. And finally obtaining a first video file and a second video file. The audio data in the first video file and the audio data in the second video file are analyzed through an audio analysis tool, two different world times of the same audio waveform are obtained, and the two different world times are subjected to difference comparison, so that a real-time audio delay value can be obtained. The method provided by the invention improves the accuracy of the test delay.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a real-time audio delay test method and a test system. Background Art

[0002] In audio transmission, audio is collected and encoded from one end and then transmitted to the other end through the network for decoding and playback. However, the exact time taken for the entire audio collection and playback process is still unknown. Existing testing methods generally use artificial timing methods. For example, to test the audio delay from end A to end B, the tester needs to press the timer twice at end B, the first time when hearing the input from end A and the second time when playing at end B. Since there is a reaction time from the tester hearing the sound signal to pressing the timer, and the reaction time varies from tester to tester and at different test times, this testing method has a large error. In addition, using two testers to record time on both sides, for example, to test the audio delay from end A to end B, the testers agree to record the time at the number '5', and then compare the difference in time recorded at both ends to calculate the delay, the result is still not accurate enough.

[0003] Patent CN103532821A discloses a method and device for comparing audio transmission delay of instant messaging software, which is applied to the process of comparing audio transmission delay of different instant messaging software by using at least two groups of test terminals in the test device. Each group of test terminals includes a first terminal and a second terminal that use the same instant messaging software. The instant messaging software used by at least one group of test terminals is different from that used by other groups of test terminals. The method includes: the test device sends an audio signal to the first terminal at the same time, records the sending time, and receives the audio signal returned by the second terminal, and records the receiving time for each group of test terminals; the received audio signal is sent by the first terminal to the second terminal of the group through the instant messaging software used, and then sent to the test device by the second terminal; the test device obtains the comparative test results of audio transmission delay of each instant messaging software according to the sending time and the receiving time of each group. This method involves transmission delay comparison, and does not consider how to accurately test the delay.

[0004] Patent CN114915892A discloses a method, device and terminal device for testing audio delay of audio equipment, wherein a test file with sound action recorded is played through a first terminal, video data of the test file is extracted, and audio data is obtained through a second terminal, the second terminal being a wireless audio device; image recognition is performed on the video data to obtain the audio start time in the test file; audio track recognition is performed on the audio data using audio track separation software to obtain the audio start time in the second terminal; the audio delay of the second terminal is calculated according to the audio start time in the test file and the audio start time in the second terminal; wherein when the test file includes multiple sound actions, the sound actions and the contents of the audio data and video data are repetitive. This method requires that the audio and video are synchronized, which does not conform to the real audio and video call scenario, because the scenario in the real audio and video real-time transmission process is too complicated, for example, in the case of poor network conditions, audio priority needs to be guaranteed, so they cannot be coupled together for delay testing.

[0005] Patent CN117615294A discloses a delay detection method, device, electronic device and computer-readable storage medium. The method includes obtaining a first test audio and a second test audio, wherein the first test audio is a test audio collected when the Bluetooth device is not connected, and the second test audio is a test audio collected when the Bluetooth device is connected; determining a first trigger time and a first play time according to the first test audio, and determining a second trigger time and a second play time according to the second test audio; determining a first audio delay according to the first trigger time and the first play time, and determining a second audio delay according to the second trigger time and the second play time; determining a Bluetooth audio delay according to the first audio delay and the second audio delay. This method is to test Bluetooth audio delay, which has a range distance limitation.

[0006] In summary, there is currently no method that can accurately test real-time audio latency, which is crucial for developing instant messaging products to provide rigorous test conclusions, so as to more accurately evaluate the impact of the product on users and make product improvements. Summary of the invention

[0007] In view of the above problems, the present invention provides a real-time audio delay test method and a test system, aiming to improve the accuracy of the test delay.

[0008] According to a first aspect of an embodiment of the present disclosure, a real-time audio delay test method is provided, the method comprising: A first test machine and a second test machine are respectively configured for the first terminal and the second terminal that have established a communication connection, and the first test machine and the second test machine both have a millisecond-level world time display function; Generate audio data near the first terminal, use a third test machine and a fourth test machine to respectively record video of the first terminal and the second terminal, the video recording content includes the audio data of the first terminal and the second terminal, and the world time displayed by the first test machine and the second test machine, and finally obtain a first video file and a second video file; The audio data in the first video file and the second video file are analyzed respectively by using an audio analysis tool to obtain two different world times of the same audio waveform. The real-time audio delay value can be obtained by comparing the difference between the two different world times.

[0009] A further technical solution of the present invention is that the first test machine, the second test machine, the third test machine and the fourth test machine are movable intelligent devices.

[0010] A further technical solution of the present invention is: the communication connection established between the first terminal and the second terminal is a voice call connection or a voice and video call connection.

[0011] A further technical solution of the present invention is: the audio data generated close to the first terminal is digital sound 1~10, and the corresponding same audio waveform obtained is any audio waveform between digital 1 and digital 10.

[0012] According to a second aspect of an embodiment of the present disclosure, a real-time audio delay test system is provided, the system comprising a first terminal, a second terminal, a first test machine, a second test machine, a third test machine, a fourth test machine and a processing terminal, wherein: A first test machine and a second test machine are respectively configured for the first terminal and the second terminal that have established a communication connection, and the first test machine and the second test machine both have a millisecond-level world time display function; Generate audio data at the first terminal, use a third test machine and a fourth test machine to record video of the first terminal and the second terminal respectively, the video recording content includes the audio data of the first terminal and the second terminal, and the world time displayed by the first test machine and the second test machine, and finally obtain a first video file and a second video file; The processing terminal is used to use an audio analysis tool to analyze the audio data in the first video file and the second video file respectively, obtain two different world times of the same audio waveform, and compare the difference between the two different world times to obtain a real-time audio delay value.

[0013] A further technical solution of the present invention is that the first test machine, the second test machine, the third test machine and the fourth test machine are movable intelligent devices.

[0014] A further technical solution of the present invention is that the communication connection established between the first terminal and the second terminal is a voice call connection or a voice and video call connection.

[0015] A further technical solution of the present invention is: the audio data generated by the first terminal is digital sound 1~10, and the corresponding same audio waveform obtained is any audio waveform between number 1 and number 10.

[0016] A real-time audio delay test method and test system provided by the embodiments of the present disclosure can be tested at both ends of any connected communication network. The same audio sound wave graph and the same method can be used to accurately test the delay of real-time communication. Based on this precise value, a more rigorous test conclusion can be given for product research and development, thereby more accurately evaluating the impact of the product on users. At the same time, the test conclusions of research and development are clearer and the room for improvement can be quantified.

[0017] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0019] Figure 1 is a flow chart of a real-time audio delay testing method according to an embodiment of the present invention; Figure 2 is a specific schematic diagram of a real-time audio delay test method in an embodiment of the present invention; Figure 3 It is a structural schematic diagram of a real-time audio delay test system in an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0021] It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the steps as sequential processes, many of the steps therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the steps can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0022] In addition, the terms "first", "second", "third", etc. may be used in this document to describe various directions, actions, steps or elements, but these directions, actions, steps or elements are not limited by these terms. These terms are only used to distinguish a first direction, action, step or element from another direction, action, step or element. For example, without departing from the scope of the present application, a first test machine may be referred to as a second test machine, and similarly, a second test machine may be referred to as a first test machine. Both the first test machine and the second test machine are test machines, but they are not the same test machine. The terms "first", "second", etc. should not be understood to indicate or imply relative importance or to implicitly indicate the number of technical features indicated. Thus, features defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0023] The present invention provides a real-time audio delay test method and a test system, and provides the following embodiments: Example 1 is used to illustrate a real-time audio delay test method. Figure 1 As shown, the method includes: S1. A first test machine and a second test machine are respectively configured for a first terminal and a second terminal that have established a communication connection. Both the first test machine and the second test machine have a millisecond-level world time display function. S2, generating audio data near the first terminal, using the third test machine and the fourth test machine to respectively record the first terminal and the second terminal, the video recording content includes the audio data of the first terminal and the second terminal, and the world time displayed by the first test machine and the second test machine, and finally obtaining the first video file and the second video file; S3. Analyze the audio data in the first video file and the second video file respectively using an audio analysis tool to obtain two different world times of the same audio waveform, and compare the difference between the two different world times to obtain a real-time audio delay value.

[0024] The first test machine, the second test machine, the third test machine and the fourth test machine are movable intelligent devices.

[0025] The communication connection established between the first terminal and the second terminal is a voice call connection or a voice and video call connection.

[0026] The audio data generated close to the first terminal is digital sound 1~10, and the corresponding audio waveform obtained is any audio waveform between digital 1 and digital 10.

[0027] In a specific implementation process, Figure 2 As shown, including: Step 1: Smart device T1 establishes a sound and video connection with mobile phone P1. Mobile phone P2 and mobile phone P3 are placed near smart device T1 and mobile phone P1 respectively. The mobile phone browsers pop up the world time with milliseconds. A tester is assigned to both ends. It is agreed that mobile phone P4 and mobile phone P5 will be used to record the screen at time S1, and the tester will orally say numbers 1 to 10 near smart device T1. Step 2: After reaching time S1, the testers on both sides use mobile phones P4 and P5 to start the pre-opened screen recording software. The video recording includes the world time of mobile phones P2 and P3, and the complete audio content of numbers 1 to 10 of smart device T1 and mobile phone P1; Step 3. Download the video saved by mobile phone P4 and P5 to the computer, open the video through professional audio analysis software such as "Jianying", and you can see the audio sound waves and the corresponding sound wave display with millisecond time; Step 4: Get the world time images of the same sound wave U1 of mobile phone P4 and mobile phone P5 respectively, and subtract the world time image corresponding to the sound wave U1 of mobile phone P5 from the world time image corresponding to the sound wave U1 of mobile phone P4 to get an accurate audio delay value.

[0028] In a specific embodiment, the entire test process uses 6 devices, including 1 smart device and 5 mobile phones. Smart device T1 and mobile phone P1 establish audio and video calls; mobile phones P2 and P3 call out the time with milliseconds through the browser, and open the time of the same website to ensure the uniformity of time data; mobile phones P4 and P5 are used for recording, and the recorded content includes the world time of mobile phones P2 and P3 and the agreed 1~10 digital audio content; the core principle is that according to the difference between the sound waves of numbers 1~10, the middle number '5' is preferably taken to obtain 2 sound wave graphs, and the world time corresponding to the sound wave graph of mobile phone P5 is subtracted from the time corresponding to the sound wave graph of mobile phone P4, and the difference obtained is the completion time of the audio in the entire real-time communication. Of course, this method can also obtain units smaller than milliseconds. Since the test scenario is in milliseconds, other precision test schemes are the same; further preferably, the professional audio analysis software uses "Jianying", which can directly import video files to see the waveform trend of the entire audio.

[0029] Another embodiment is used to illustrate a real-time audio delay test system. Figure 3 As shown, the system 300 includes a first terminal 310, a second terminal 320, a first test machine 330, a second test machine 340, a third test machine 350, a fourth test machine 360 ​​and a processing terminal 370, wherein: A first test machine 330 and a second test machine 340 are respectively configured for the first terminal 310 and the second terminal 320 that have established communication connection. The first test machine 330 and the second test machine 340 both have a millisecond-level world time display function. Generate audio data near the first terminal 310, use the third test machine 350 and the fourth test machine 360 ​​to respectively record the first terminal 310 and the second terminal 320, the video recording content includes the audio data of the first terminal 310 and the second terminal 320, and the world time displayed by the first test machine 330 and the second test machine 340, and finally obtain the first video file and the second video file; The processing terminal 370 is used to use an audio analysis tool to analyze the audio data in the first video file and the second video file respectively, obtain two different world times of the same audio waveform, and compare the difference between the two different world times to obtain a real-time audio delay value.

[0030] The first test machine 330 , the second test machine 340 , the third test machine 350 , and the fourth test machine 360 ​​are mobile smart devices.

[0031] The communication connection established between the first terminal 310 and the second terminal 320 is a voice call connection or a voice and video call connection.

[0032] The audio data generated near the first terminal 310 is digital sound 1-10, and the corresponding audio waveform obtained is any audio waveform between digital 1 and digital 10.

[0033] In addition to the above-mentioned devices, the real-time audio delay testing system 300 may also include other components. However, since these components are irrelevant to the content of the embodiment of the present disclosure, their illustration and description are omitted here.

[0034] The other specific working processes of the real-time audio delay test system 300 refer to the description of the above-mentioned real-time audio delay test method embodiment, which will not be repeated here.

[0035] Based on the technical solutions provided by the above embodiments, a real-time audio delay test method and test system can be tested at both ends of any connected communication network. The same audio sound wave graph and the same method can be used to accurately test the delay of real-time communication. Based on this precise value, a more rigorous test conclusion can be given for product research and development, thereby more accurately evaluating the impact of the product on users. At the same time, the test conclusions of research and development are clearer and the room for improvement can be quantified.

[0036] In this document, the terms "comprises," "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, such that a step or method that includes a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such step or method.

[0037] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. A real-time audio delay test method, characterized in that: include: A first test machine and a second test machine are respectively configured for the first terminal and the second terminal that have established a communication connection, and the first test machine and the second test machine both have a millisecond-level world time display function; Generate audio data near the first terminal, use a third test machine and a fourth test machine to respectively record video of the first terminal and the second terminal, the video recording content includes the audio data of the first terminal and the second terminal, and the world time displayed by the first test machine and the second test machine, and finally obtain a first video file and a second video file; The audio data in the first video file and the second video file are analyzed respectively by using an audio analysis tool to obtain two different world times of the same audio waveform. The real-time audio delay value can be obtained by comparing the difference between the two different world times.

2. A real-time audio delay testing method according to claim 1, characterized in that: The first test machine, the second test machine, the third test machine and the fourth test machine are mobile intelligent devices.

3. A real-time audio delay testing method according to claim 1, characterized in that: The communication connection established between the first terminal and the second terminal is a voice call connection or a voice and video call connection.

4. A real-time audio delay testing method according to any one of claims 1 or 3, characterized in that: The audio data generated near the first terminal is digital sound 1~10, and the corresponding same audio waveform obtained is any audio waveform between digital 1 and digital 10.

5. A real-time audio delay test system, characterized in that: The system includes a first terminal, a second terminal, a first test machine, a second test machine, a third test machine, a fourth test machine and a processing terminal, wherein: A first test machine and a second test machine are respectively configured for the first terminal and the second terminal that have established a communication connection, and the first test machine and the second test machine both have a millisecond-level world time display function; Generate audio data near the first terminal, use a third test machine and a fourth test machine to respectively record video of the first terminal and the second terminal, the video recording content includes the audio data of the first terminal and the second terminal, and the world time displayed by the first test machine and the second test machine, and finally obtain a first video file and a second video file; The processing terminal is used to use an audio analysis tool to analyze the audio data in the first video file and the second video file respectively, obtain two different world times of the same audio waveform, and compare the difference between the two different world times to obtain a real-time audio delay value.

6. A real-time audio delay test system according to claim 5, characterized in that: The first test machine, the second test machine, the third test machine and the fourth test machine are mobile intelligent devices.

7. A real-time audio delay test system according to claim 5, characterized in that: The communication connection established between the first terminal and the second terminal is a voice call connection or a voice and video call connection.

8. A real-time audio delay test system according to any one of claims 5 or 7, characterized in that: The audio data generated near the first terminal is digital sound 1~10, and the corresponding same audio waveform obtained is any audio waveform between digital 1 and digital 10.

Images