Audio transmission delay measurement method, device, equipment and storage medium

Abstract

The present disclosure relates to a method, device, equipment and storage medium for measuring audio transmission delay. The present disclosure determines the audio transmission delay by sending first audio data to an audio conference terminal through a computer device and receiving second audio data from the audio conference terminal through the computer device. The audio transmission delay includes the transmission delay between the computer device and the audio conference terminal, the processing delay of the audio conference terminal, the transmission delay between the audio conference terminal and the audio player, the air propagation delay, and the transmission delay between the audio conference terminal and the audio collector. Among them, the processing delay of the audio conference terminal may fluctuate, and the processing delay of the audio conference terminal can be measured separately according to the audio transmission delay. And according to the audio transmission delay, the program (such as a driver) running in the audio conference terminal can be optimized so that the processing delay of the audio conference terminal is as small as possible.

Description

Technical Field

[0001] The present disclosure relates to the field of information technology, and in particular to a method, device, equipment and storage medium for measuring audio transmission delay. Background Art

[0002] With the continuous development of science and technology, the application of audio and video conferencing systems is becoming more and more widespread. Audio and video conferencing systems refer to system equipment that allows two or more individuals or groups in different places to exchange audio, video and file data through transmission lines and multimedia equipment to achieve instant and interactive communication and to conduct meetings at the same time.

[0003] Currently, there is a problem of audio transmission delay in audio and video conferencing systems. However, the inventors of the present application have found that the existing method for measuring audio transmission delay can measure the delay of the audio communication link, but cannot measure the delay of a certain hardware device alone. Summary of the invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a method, device, equipment and storage medium for measuring audio transmission delay, according to which the processing delay of the audio conference terminal can be measured separately. And according to the audio transmission delay, the program (such as a driver) running in the audio conference terminal can be optimized to minimize the processing delay of the audio conference terminal.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for measuring audio transmission delay, the method being applied to a computer device, the method comprising:

[0006] Sending first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0007] receiving second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector;

[0008] An audio transmission delay is determined according to the first audio data and the second audio data.

[0009] In a second aspect, an embodiment of the present disclosure provides a method for measuring audio transmission delay, the method being applied to an audio conferencing terminal, the method comprising:

[0010] Receiving first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector;

[0011] Sending an audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0012] Receiving the audio signal collected by the audio collector;

[0013] Generating second audio data according to the audio signal collected by the audio collector;

[0014] The second audio data is sent to the computer device, so that the computer device determines the audio transmission delay according to the first audio data and the second audio data.

[0015] In a third aspect, an embodiment of the present disclosure provides a method for measuring audio transmission delay, the method being applied to an audio conferencing terminal, the audio conferencing terminal being connected to an audio player and an audio collector; the method comprising:

[0016] Sending an audio signal to the audio player so that the audio player plays the audio signal, wherein the audio collector is used to collect the audio signal played by the audio player;

[0017] Receiving the audio signal collected by the audio collector;

[0018] An audio transmission delay is determined according to a sending time of the audio signal and a receiving time of the audio signal.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a device for measuring audio transmission delay, wherein the device is provided in a computer device, and the device includes:

[0020] A sending module, used to send first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0021] A receiving module, configured to receive second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector;

[0022] A determination module is used to determine an audio transmission delay according to the first audio data and the second audio data.

[0023] In a fifth aspect, an embodiment of the present disclosure provides a device for measuring audio transmission delay, the device being arranged in an audio conferencing terminal, the device comprising:

[0024] A receiving module, used for receiving first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector;

[0025] A sending module, used for sending the audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used for collecting the audio signal played by the audio player;

[0026] The receiving module is also used to: receive the audio signal collected by the audio collector;

[0027] A generating module, used for generating second audio data according to the audio signal collected by the audio collector;

[0028] The sending module is further used to send the second audio data to the computer device, so that the computer device determines the audio transmission delay according to the first audio data and the second audio data.

[0029] In a sixth aspect, an embodiment of the present disclosure provides an electronic device, including:

[0030] Memory;

[0031] Processor; and

[0032] Computer programs;

[0033] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect or the second aspect.

[0034] In a seventh aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method described in the first aspect or the second aspect.

[0035] In an eighth aspect, an embodiment of the present disclosure provides a system for measuring audio transmission delay, the system comprising a computer device, an audio conferencing terminal, an audio player and an audio collector, audio data is transmitted between the computer device and the audio conferencing terminal, and the audio conferencing terminal is connected to the audio player and the audio collector respectively;

[0036] The computer device is used to execute the method according to the first aspect;

[0037] The audio conferencing terminal is used to execute the method described in the second aspect.

[0038] The audio transmission delay measurement method, device, equipment and storage medium provided by the embodiment of the present disclosure send first audio data to the audio conference terminal through a computer device, the audio conference terminal is connected to an audio player and an audio collector, the audio player is used to play the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player. In addition, the computer device can receive second audio data from the audio conference terminal, and the second audio data is generated by the audio conference terminal according to the audio signal collected by the audio collector. Further, the computer device determines the audio transmission delay according to the first audio data and the second audio data. The audio transmission delay includes the transmission delay between the computer device and the audio conference terminal, the processing delay of the audio conference terminal, the transmission delay between the audio conference terminal and the audio player, the air propagation delay, and the transmission delay between the audio conference terminal and the audio collector. When the relative position relationship between the audio player and the audio collector is determined, the air propagation delay is fixed. In addition, when the transmission distance and transmission mode between the computer device and the audio conference terminal are determined, the transmission delay between the computer device and the audio conference terminal is also fixed. When the transmission distance and transmission mode between the audio conferencing terminal and the audio player are determined, the transmission delay between the audio conferencing terminal and the audio player is also fixed. When the transmission distance and transmission mode between the audio conferencing terminal and the audio collector are determined, the transmission delay between the audio conferencing terminal and the audio collector is also fixed. The processing delay of the audio conferencing terminal may fluctuate, so the fluctuation of the audio transmission delay can represent the fluctuation of the processing delay of the audio conferencing terminal, that is, the processing delay of the audio conferencing terminal can be measured separately according to the audio transmission delay. And according to the audio transmission delay, the program (such as the driver) running in the audio conferencing terminal can be optimized to make the processing delay of the audio conferencing terminal as small as possible. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 A flow chart of a method for measuring audio transmission delay provided in an embodiment of the present disclosure;

[0042] Figure 2A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0043] Figure 3 A flow chart of a method for measuring audio transmission delay provided by another embodiment of the present disclosure;

[0044] Figure 4 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0045] Figure 5 A flow chart of a method for measuring audio transmission delay provided by another embodiment of the present disclosure;

[0046] Figure 6 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0047] Figure 7 A schematic diagram of the structure of an audio transmission delay measurement device provided in an embodiment of the present disclosure;

[0048] Figure 8 A schematic diagram of the structure of an audio transmission delay measurement device provided in an embodiment of the present disclosure;

[0049] Fig. 9 A schematic diagram of the structure of an audio transmission delay measurement device provided in an embodiment of the present disclosure;

[0050] Fig.10 A schematic diagram of the structure of an electronic device embodiment provided by the present disclosure;

[0051] Fig.11 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0052] Fig.12 A schematic diagram of an application scenario provided for an embodiment of the present disclosure. DETAILED DESCRIPTION

[0053] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0054] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0055] Generally, there is a problem of audio transmission delay in audio and video conferencing systems. However, the inventor of the present application has found that the existing method for measuring audio transmission delay can measure the delay of the audio communication link, but cannot measure the delay of a hardware device alone. To address this problem, the present disclosure provides a method for measuring audio transmission delay, which is described below in conjunction with specific embodiments.

[0056] Figure 1 The flowchart of the method for measuring the audio transmission delay provided in the embodiment of the present disclosure is as follows. The method can be applied to Figure 2 The application scenario shown in Figure 1. Figure 2 As shown, the application scenario includes a computer device 21, an audio conferencing terminal 22, an audio player 23 and an audio collector 24. Among them, the computer device 21 can be a personal computer (PC), and the computer device 21 and the audio conferencing terminal 22 can be connected via a universal serial bus (USB). The audio conferencing terminal 22 can be connected to the audio player 23 via a network cable, and the signal carried in the network cable can be an analog signal. The audio player 23 can specifically be a speaker. In addition, the audio conferencing terminal 22 can be connected to the audio collector 24 via an audio cable (for example, a 3.5 mm audio cable), and the signal carried in the audio cable can be an analog signal, and the audio collector 24 can specifically be a microphone. Specifically, Figure 1 The method shown can be executed by a computer device 21, that is, Figure 1 The method shown can be applied to a computer device 21. Figure 1 As shown, the specific steps of this method are as follows:

[0057] S101. Send first audio data to an audio conferencing terminal, wherein the audio conferencing terminal is connected to an audio player and an audio collector, wherein the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player.

[0058] For example, an audio loopback program may be run in the computer device 21, and the audio loopback program includes an audio playback thread and an audio capture thread, wherein the audio playback thread may be recorded as audio play, and the audio capture thread may be recorded as audio capture. Specifically, the audio playback thread and the audio capture thread may be started at the same time, or the start time difference between the two threads may be 2 ms.

[0059] Specifically, after the audio playback thread is started, the audio playback thread can read an audio file pre-stored in the computer device 21, which can be recorded as Play.wav or Play.pcm. The audio file may include one or more audio data, which are recorded as first audio data. Further, the audio playback thread can send one or more first audio data to the universal serial bus one by one through the Windows Audio Session Application Programming Interface (WASAPI), thereby sending one or more first audio data to the audio conferencing terminal 22 one by one through the universal serial bus. Specifically, each first audio data can be a digital signal, that is, the signal carried on the universal serial bus can be a digital signal. In addition, the protocol for transmitting audio data on the universal serial bus can specifically be (USB Audio Class, UAC).

[0060] Optionally, the audio conferencing terminal is used to convert the first audio data into an analog audio signal, and the audio player is used to play the analog audio signal.

[0061] For example, when the audio conferencing terminal 22 receives each first audio data, each first audio data can be converted into an analog audio signal one by one. Further, the audio conferencing terminal 22 can send the analog audio signal to the audio player 23 via the network cable, so that the audio player 23 can play the analog audio signal. Specifically, the audio player 23 can play the analog audio signal into the air, so that the audio collector 24 can collect the analog audio signal played by the audio player 23. Specifically, the audio signal collected by the audio collector 24 is also an analog audio signal. Further, the audio collector 24 can send the collected audio signal to the audio conferencing terminal 22 via the audio line.

[0062] S102: Receive second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector.

[0063] When the audio conference terminal 22 receives the audio signal collected by the audio collector 24, the audio conference terminal 22 can convert the analog audio signal collected by the audio collector 24 into a digital signal, which can be recorded as the second audio data. Further, the audio conference terminal 22 can send the second audio data to the computer device 21.

[0064] S103: Determine an audio transmission delay according to the first audio data and the second audio data.

[0065] When the computer device 21 receives the second audio data, the audio acquisition thread in the computer device 21 can store the second audio data in another audio file, which is recorded as Capture.wav or Capture.pcm. It can be understood that each first audio data can correspond to one second audio data, that is, the first audio data and the second audio data are one-to-one corresponding. Further, the computer device 21 can determine the audio transmission delay based on the first audio data and the second audio data.

[0066] Optionally, determining an audio transmission delay based on the first audio data and the second audio data includes: determining the audio transmission delay based on a sending time of the first audio data and a receiving time of the second audio data.

[0067] For example, Play.wav includes 10 first audio data, and Capture.wav includes 10 second audio data. The computer device 21 can determine the audio transmission delay according to the sending time of each first audio data in the 10 first audio data and the receiving time of each second audio data in the 10 second audio data. Specifically, the computer device 21 can use the generalized cross correlation phase transformation (Generalized Cross Correlation Phase Transformation, GCC-PHAT) algorithm to calculate the audio transmission delay, and the audio transmission delay can be the delay of the above-mentioned loopback. Among them, the GCC-PHAT algorithm can be implemented by a batch script of the computer programming language Python. Specifically, the sending time of each first audio data in the 10 first audio data can constitute a first array, that is, the first array includes 10 sending times. The receiving time of each second audio data in the 10 second audio data can constitute a second array, that is, the second array includes 10 receiving times. The first delay can be calculated based on the first sending time in the first array and the first receiving time in the second array, the second delay can be calculated based on the second sending time in the first array and the second receiving time in the second array, and so on, the tenth delay can be calculated based on the tenth sending time in the first array and the tenth receiving time in the second array. Further, the audio transmission delay can be obtained based on the first delay, the second delay, ..., the tenth delay. For example, the audio transmission delay can be the average of the first delay, the second delay, ..., the tenth delay. Further, the audio transmission delay can be saved in a CSV file.

[0068] In the embodiment of the present disclosure, a computer device sends first audio data to an audio conference terminal, wherein the audio conference terminal is connected to an audio player and an audio collector, wherein the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player. In addition, the computer device can receive second audio data from the audio conference terminal, wherein the second audio data is generated by the audio conference terminal according to the audio signal collected by the audio collector. Further, the computer device determines the audio transmission delay according to the first audio data and the second audio data. The audio transmission delay includes the transmission delay between the computer device and the audio conference terminal, the processing delay of the audio conference terminal, the transmission delay between the audio conference terminal and the audio player, the air propagation delay, and the transmission delay between the audio conference terminal and the audio collector. When the relative positional relationship between the audio player and the audio collector is determined, the air propagation delay is fixed. In addition, when the transmission distance and the transmission mode between the computer device and the audio conference terminal are determined, the transmission delay between the computer device and the audio conference terminal is also fixed. When the transmission distance and the transmission mode between the audio conference terminal and the audio player are determined, the transmission delay between the audio conference terminal and the audio player is also fixed. When the transmission distance and transmission mode between the audio conference terminal and the audio collector are determined, the transmission delay between the audio conference terminal and the audio collector is also fixed. However, the processing delay of the audio conference terminal may fluctuate. Therefore, the fluctuation of the audio transmission delay can represent the fluctuation of the processing delay of the audio conference terminal, that is, the processing delay of the audio conference terminal can be measured separately according to the audio transmission delay. And according to the audio transmission delay, the program (such as the driver) running in the audio conference terminal can be optimized to make the processing delay of the audio conference terminal as small as possible.

[0069] It can be understood that the above steps S101-S103 constitute one measurement process, that is, one measurement process can obtain an audio transmission delay.

[0070] On the basis of the above embodiment, in order to improve the measurement accuracy of the audio transmission delay, the above steps S101-S103 may be repeated. For example, the above steps S101-S103 may be repeated 100 times to obtain 100 audio transmission delays. Further, the mean, variance or other mathematical statistics of the 100 audio transmission delays are calculated to form an objective and reliable estimation of the overall delay.

[0071] In addition, the audio transmission delay described above can be understood as the delay between the computer device 21 sending the first audio data and the computer device 21 receiving the second audio data, that is, the audio transmission delay can be calculated through S101-S103 described above. Compared with the method of calculating the delay of each link in segments and then adding the delay of each link to obtain the audio transmission delay, the method provided by the embodiment of the present disclosure has the advantages of simple measurement process and low error rate. Among them, the various links described above can specifically be the transmission delay from the computer device to the audio conference terminal, the processing delay of the audio conference terminal, the transmission delay from the audio conference terminal to the audio player, the air propagation delay, and the transmission delay from the audio collector to the audio conference terminal, etc.

[0072] In addition, the method provided by the embodiment of the present disclosure does not need to place the audio conference terminal in a system including a communication network for delay measurement, because the communication network may be uncertain, resulting in the transmission delay of audio data or audio signals in the communication network being uncertain, so that the method provided by the embodiment of the present disclosure can avoid the impact of the uncertainty of the communication network on the audio transmission delay, that is, the measurement of the audio transmission delay does not rely on the communication network. In addition, the method provided by the embodiment of the present disclosure does not require expensive special equipment for loopback acquisition and is simple to operate.

[0073] Figure 3 A flow chart of a method for measuring audio transmission delay provided by another embodiment of the present disclosure. The method is applied to an audio conferencing terminal, and the specific steps of the method are as follows:

[0074] S301: Receive first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector.

[0075] For example, the computer device 21 may send one or more first audio data to the universal serial bus one by one, thereby sending one or more first audio data to the audio conference terminal 22 through the universal serial bus. The audio conference terminal 22 may receive the one or more first audio data. Figure 2 As shown, the audio conference terminal 22 can be connected to the audio player 23 via a network cable, the signal carried in the network cable can be an analog signal, and the audio player 23 can be a speaker. In addition, the audio conference terminal 22 can be connected to the audio collector 24 via an audio cable (for example, a 3.5 mm audio cable), the signal carried in the audio cable can be an analog signal, and the audio collector 24 can be a microphone.

[0076] S302: Send an audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player.

[0077] Optionally, the audio signal corresponding to the first audio data is an analog audio signal converted by the audio conferencing terminal from the first audio data.

[0078] When the audio conference terminal 22 receives each first audio data, each first audio data can be converted into an analog audio signal one by one. Further, the audio conference terminal 22 can send the analog audio signal to the audio player 23 through the network cable, so that the audio player 23 can play the analog audio signal. Specifically, the audio player 23 can play the analog audio signal into the air, so that the audio collector 24 can collect the analog audio signal played by the audio player 23. Specifically, the audio signal collected by the audio collector 24 is also an analog audio signal.

[0079] S303: Receive the audio signal collected by the audio collector.

[0080] Furthermore, the audio collector 24 can send the collected audio signal to the audio conference terminal 22 via the audio line. That is, the audio conference terminal 22 receives the audio signal collected by the audio collector 24.

[0081] S304: Generate second audio data according to the audio signal collected by the audio collector.

[0082] When the audio conference terminal 22 receives the audio signal collected by the audio collector 24, the audio conference terminal 22 may convert the analog audio signal collected by the audio collector 24 into a digital signal, which may be recorded as the second audio data.

[0083] S305: Send the second audio data to the computer device, so that the computer device determines an audio transmission delay according to the first audio data and the second audio data.

[0084] Further, the audio conference terminal 22 can send the second audio data to the computer device 21. When the computer device 21 receives the second audio data, the audio acquisition thread in the computer device 21 can store the second audio data in another audio file, which is recorded as Capture.wav or Capture.pcm. It can be understood that each first audio data can correspond to a second audio data, that is, the first audio data and the second audio data are one-to-one corresponding. Further, the computer device 21 can determine the audio transmission delay based on the first audio data and the second audio data.

[0085] In this embodiment, a computer device sends first audio data to an audio conference terminal, and the audio conference terminal is connected to an audio player and an audio collector, the audio player is used to play the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player. In addition, the computer device can receive second audio data from the audio conference terminal, and the second audio data is generated by the audio conference terminal according to the audio signal collected by the audio collector. Further, the computer device determines the audio transmission delay according to the first audio data and the second audio data. The audio transmission delay includes the transmission delay between the computer device and the audio conference terminal, the processing delay of the audio conference terminal, the transmission delay between the audio conference terminal and the audio player, the air propagation delay, and the transmission delay between the audio conference terminal and the audio collector. When the relative position relationship between the audio player and the audio collector is determined, the air propagation delay is fixed. In addition, when the transmission distance and transmission mode between the computer device and the audio conference terminal are determined, the transmission delay between the computer device and the audio conference terminal is also fixed. When the transmission distance and transmission mode between the audio conference terminal and the audio player are determined, the transmission delay between the audio conference terminal and the audio player is also fixed. When the transmission distance and transmission mode between the audio conference terminal and the audio collector are determined, the transmission delay between the audio conference terminal and the audio collector is also fixed. However, the processing delay of the audio conference terminal may fluctuate. Therefore, the fluctuation of the audio transmission delay can represent the fluctuation of the processing delay of the audio conference terminal, that is, the processing delay of the audio conference terminal can be measured separately according to the audio transmission delay. And according to the audio transmission delay, the program (such as the driver) running in the audio conference terminal can be optimized to make the processing delay of the audio conference terminal as small as possible.

[0086] On the basis of the above embodiments, when the program running in the audio conferencing terminal is optimized, the computer device, the optimized audio conferencing terminal, the audio player, and the audio collector can constitute a communication system, and a set of communication systems can be deployed in different physical spaces. Figure 4As shown, conference room 1 and conference room 2 can be two different physical spaces, for example, conference room 1 and conference room 2 are two physical spaces far apart. A communication system can be deployed in conference room 1, and the communication system includes computer equipment 41, optimized audio conference terminal 42, audio player 43, and audio collector 44. Another communication system can be deployed in conference room 2, and the communication system includes computer equipment 51, optimized audio conference terminal 52, audio player 53, and audio collector 54. In addition, computer equipment 41 and computer equipment 51 can communicate through a communication network. In this way, user A in conference room 1 can conduct an audio conference with user B in conference room 2. For example, audio collector 44 can collect the voice of user A, and after the voice of user A is transmitted in sequence through optimized audio conference terminal 42, computer equipment 41, computer equipment 51 and optimized audio conference terminal 52, the audio player 53 can play the voice of user A, so that user B in conference room 2 can hear the voice of user A. Similarly, the voice of user B collected by audio collector 54 can be played by audio player 43.

[0087] Figure 5 A flow chart of a method for measuring audio transmission delay provided by another embodiment of the present disclosure. The method is applied to an audio conferencing terminal, such as Figure 6 As shown, the audio conference terminal 62 is connected to an audio player 63 and an audio collector 64. Specifically, the audio conference terminal 62 can be connected to the audio player 63 via a network cable or wireless communication. The signal carried in the network cable can be an analog signal, and the audio player 63 can be a speaker. In addition, the audio conference terminal 62 can be connected to the audio collector 64 via an audio cable (for example, a 3.5 mm audio cable) or wireless communication. The signal carried in the audio cable can be an analog signal, and the audio collector 64 can be a microphone. Specifically, Figure 5 The method shown can be performed by the audio conference terminal 62, such as Figure 5 As shown, the specific steps of this method are as follows:

[0088] S51. Send an audio signal to the audio player so that the audio player plays the audio signal. The audio collector is used to collect the audio signal played by the audio player.

[0089] For example, the audio conference terminal 62 can send an audio signal to the audio player 63, and the audio signal can be an analog audio signal. The audio player 63 can play the analog audio signal. Specifically, the audio player 63 can play the analog audio signal into the air, so that the audio collector 64 can collect the analog audio signal played by the audio player 63. Specifically, the audio signal collected by the audio collector 64 is also an analog audio signal. Further, the audio collector 64 can send the collected audio signal to the audio conference terminal 62 via an audio line.

[0090] S52: Receive the audio signal collected by the audio collector.

[0091] For example, the audio conference terminal 62 may receive the audio signal collected by the audio collector 64 .

[0092] S53: Determine an audio transmission delay according to a sending time of the audio signal and a receiving time of the audio signal.

[0093] Specifically, the audio conference terminal 62 may determine the audio transmission delay according to the sending time of the audio signal and the receiving time of the audio signal.

[0094] It is understandable that in some other embodiments, the audio player 63 and the audio collector 64 may also be integrated into the audio conferencing terminal 62 .

[0095] In the disclosed embodiment, an audio signal is sent to the audio player through an audio conference terminal, so that the audio player plays the audio signal. The audio collector is used to collect the audio signal played by the audio player. In addition, the audio conference terminal can also receive the audio signal collected by the audio collector, and determine the audio transmission delay according to the sending time of the audio signal and the receiving time of the audio signal. The audio transmission delay includes the processing delay of the audio conference terminal, the transmission delay between the audio conference terminal and the audio player, the air propagation delay, and the transmission delay between the audio conference terminal and the audio collector. When the relative position relationship between the audio player and the audio collector is determined, the air propagation delay is fixed. In addition, when the transmission distance and transmission mode between the audio conference terminal and the audio player are determined, the transmission delay between the audio conference terminal and the audio player is also fixed. When the transmission distance and transmission mode between the audio conference terminal and the audio collector are determined, the transmission delay between the audio conference terminal and the audio collector is also fixed. The processing delay of the audio conference terminal may fluctuate, so the fluctuation of the audio transmission delay can represent the fluctuation of the processing delay of the audio conference terminal, that is, the processing delay of the audio conference terminal can be measured separately according to the audio transmission delay. And according to the audio transmission delay, the program (such as the driver) running in the audio conference terminal can be optimized to minimize the processing delay of the audio conference terminal.

[0096] Figure 7 The structure diagram of the audio transmission delay measurement device provided in the embodiment of the present disclosure is as follows. The audio transmission delay measurement device provided in the embodiment of the present disclosure can execute the processing flow provided in the audio transmission delay measurement method embodiment, and the device is set in a computer device. Figure 7 As shown, the audio transmission delay measuring device 70 includes:

[0097] A sending module 701 is used to send first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0098] The receiving module 702 is used to receive second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector;

[0099] The determination module 703 is used to determine the audio transmission delay according to the first audio data and the second audio data.

[0100] Optionally, the audio conferencing terminal is used to convert the first audio data into an analog audio signal, and the audio player is used to play the analog audio signal.

[0101] Optionally, the determination module 703 determines the audio transmission delay according to the first audio data and the second audio data, and is specifically used to determine the audio transmission delay according to the sending time of the first audio data and the receiving time of the second audio data.

[0102] Optionally, the computer device is connected to the audio conferencing terminal via a universal serial bus.

[0103] Figure 7 The audio transmission delay measurement device of the illustrated embodiment can be used to implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar and will not be repeated here.

[0104] Figure 8 The structure diagram of the audio transmission delay measurement device provided in the embodiment of the present disclosure is as follows. The audio transmission delay measurement device provided in the embodiment of the present disclosure can execute the processing flow provided in the audio transmission delay measurement method embodiment, and the device is arranged in the audio conference terminal. Figure 8 As shown, the audio transmission delay measuring device 80 includes:

[0105] The receiving module 801 is used to receive the first audio data sent by the computer device, and the audio conference terminal is connected to an audio player and an audio collector;

[0106] The sending module 802 is used to send the audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0107] The receiving module 801 is also used to: receive the audio signal collected by the audio collector;

[0108] A generating module 803, configured to generate second audio data according to the audio signal collected by the audio collector;

[0109] The sending module 802 is further used to send the second audio data to the computer device, so that the computer device determines the audio transmission delay according to the first audio data and the second audio data.

[0110] Optionally, the audio signal corresponding to the first audio data is an analog audio signal converted by the audio conferencing terminal from the first audio data.

[0111] Figure 8The audio transmission delay measurement device of the illustrated embodiment can be used to implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar and will not be repeated here.

[0112] Fig. 9 The structure diagram of the audio transmission delay measurement device provided in the embodiment of the present disclosure is as follows. The audio transmission delay measurement device provided in the embodiment of the present disclosure can execute the processing flow provided in the audio transmission delay measurement method embodiment, and the device is arranged in the audio conference terminal. Fig. 9 As shown, the audio transmission delay measuring device 90 includes:

[0113] The sending module 901 is used to send an audio signal to the audio player so that the audio player plays the audio signal, and the audio collector is used to collect the audio signal played by the audio player;

[0114] The receiving module 902 is used to receive the audio signal collected by the audio collector;

[0115] The determination module 903 is used to determine the audio transmission time according to the sending time of the audio signal and the receiving time of the audio signal.

[0116] Fig. 9 The audio transmission delay measurement device of the illustrated embodiment can be used to implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar and will not be repeated here.

[0117] The internal functions and structure of the device for measuring audio transmission delay are described above. The device can be implemented as an electronic device. Fig.10 This is a schematic diagram of the structure of an electronic device embodiment provided by the present disclosure. Fig.10 As shown, the electronic device includes a memory 101 and a processor 102. The electronic device may be a computer device or an audio conference terminal as described above.

[0118] The memory 101 is used to store programs. In addition to the above programs, the memory 101 can also be configured to store various other data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phone book data, messages, pictures, videos, etc.

[0119] The memory 101 may be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0120] The processor 102 is coupled to the memory 101 and executes the program stored in the memory 101 to:

[0121] Sending first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0122] receiving second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector;

[0123] An audio transmission delay is determined according to the first audio data and the second audio data.

[0124] Alternatively, the processor 102 is further configured to:

[0125] Receiving first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector;

[0126] Sending an audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player;

[0127] Receiving the audio signal collected by the audio collector;

[0128] Generating second audio data according to the audio signal collected by the audio collector;

[0129] The second audio data is sent to the computer device, so that the computer device determines the audio transmission delay according to the first audio data and the second audio data.

[0130] Further, if Fig.10 As shown, the electronic device may further include: a communication component 103, a power component 104, an audio component 105, a display 106 and other components. Fig.10 Only some components are shown schematically, which does not mean that the electronic device only includes Fig.10 Components shown.

[0131] The communication component 103 is configured to facilitate wired or wireless communication between the electronic device and other devices. The electronic device can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 103 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 103 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0132] The power supply assembly 104 provides power to various components of the electronic device. The power supply assembly 104 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device.

[0133] The audio component 105 is configured to output and / or input audio signals. For example, the audio component 105 includes a microphone (MIC), and when the electronic device is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 101 or sent via the communication component 103. In some embodiments, the audio component 105 also includes a speaker for outputting audio signals.

[0134] The display 106 includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0135] In addition, the embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to implement the audio transmission delay measurement method described in the above embodiment. Fig.11As shown, the computer-readable storage medium 111 may be an external pluggable medium in the form of a USB flash drive, or may be a pluggable small computing device or mobile device, and the mobile device may specifically be a mobile phone, a mobile weak computing device, etc. For example, the computer device 21 is provided with an interface for externally connecting the computer-readable storage medium 111. When the computer-readable storage medium 111 is externally connected to the computer device 21 through the interface, the processor in the computer device 21 may read the computer program stored on the computer-readable storage medium 111. Further, when the processor executes the computer program, the audio transmission delay measurement method described in the above embodiment may be implemented.

[0136] Or, if Fig.12 As shown, the audio conferencing terminal 62 is provided with an interface for an external computer-readable storage medium 111. When the computer-readable storage medium 111 is connected to the audio conferencing terminal 62 through the interface, the processor in the audio conferencing terminal 62 can read the computer program stored on the computer-readable storage medium 111. Further, when the processor executes the computer program, the audio transmission delay measurement method described in the above embodiment can be implemented.

[0137] In addition, the embodiment of the present disclosure also provides a system for measuring audio transmission delay, which includes a computer device, an audio conferencing terminal, an audio player and an audio collector, wherein audio data is transmitted between the computer device and the audio conferencing terminal, and the audio conferencing terminal is connected to the audio player and the audio collector respectively. Figure 2 As shown, the computer device 21 can execute the following Figure 1 The audio transmission delay measurement method shown in FIG. 1 may be performed by the audio conferencing terminal 22 as follows: Figure 3 The measurement method of audio transmission delay is shown.

[0138] Alternatively, the system includes an audio conference terminal, an audio player and an audio collector, wherein the audio conference terminal is connected to the audio player and the audio collector respectively. Figure 6 As shown, the audio conference terminal 62 can execute the following Figure 5 The measurement method of audio transmission delay is shown.

[0139] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0140] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for measuring audio transmission delay, wherein: The method is applied to a computer device, and the method comprises: Sending first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player; receiving second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector; The audio transmission delay is determined according to the time when the computer device sends the first audio data and the time when the computer device receives the second audio data, wherein the audio transmission delay includes a fixed transmission delay between the computer device and the audio conferencing terminal, a fluctuating processing delay of the audio conferencing terminal, a fixed transmission delay between the audio conferencing terminal and the audio player, a fixed air propagation delay, and a fixed transmission delay between the audio conferencing terminal and the audio collector, the fluctuation of the audio transmission delay represents the fluctuation of the processing delay of the audio conferencing terminal, and the audio transmission delay is used to separately measure the processing delay of the audio conferencing terminal.

2. The method according to claim 1, wherein: The audio conferencing terminal is used to convert the first audio data into an analog audio signal, and the audio player is used to play the analog audio signal.

3. The method according to claim 2, wherein: Determining an audio transmission delay according to the first audio data and the second audio data includes: An audio transmission delay is determined according to a sending time of the first audio data and a receiving time of the second audio data.

4. The method according to claim 1, wherein: The computer device is connected to the audio conference terminal via a universal serial bus.

5. A method for measuring audio transmission delay, wherein: The method is applied to an audio conference terminal, and the method comprises: Receiving first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector; Sending an audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player; Receiving the audio signal collected by the audio collector; Generating second audio data according to the audio signal collected by the audio collector; The second audio data is sent to the computer device, so that the computer device determines the audio transmission delay according to the time when the computer device sends the first audio data and the time when the computer device receives the second audio data, wherein the audio transmission delay includes a fixed transmission delay between the computer device and the audio conferencing terminal, a fluctuating processing delay of the audio conferencing terminal, a fixed transmission delay between the audio conferencing terminal and the audio player, a fixed air propagation delay, and a fixed transmission delay between the audio conferencing terminal and the audio collector, the fluctuation of the audio transmission delay represents the fluctuation of the processing delay of the audio conferencing terminal, and the audio transmission delay is used to separately measure the processing delay of the audio conferencing terminal.

6. The method according to claim 5, wherein: The audio signal corresponding to the first audio data is an analog audio signal converted by the audio conferencing terminal from the first audio data.

7. A device for measuring audio transmission delay, wherein: The device is arranged in a computer device, and comprises: A sending module, used to send first audio data to an audio conferencing terminal, the audio conferencing terminal is connected to an audio player and an audio collector, the audio player is used to play an audio signal corresponding to the first audio data, and the audio collector is used to collect the audio signal played by the audio player; A receiving module, configured to receive second audio data from the audio conferencing terminal, where the second audio data is generated by the audio conferencing terminal according to the audio signal collected by the audio collector; A determination module is used to determine the audio transmission delay according to the time when the computer device sends the first audio data and the time when the computer device receives the second audio data, wherein the audio transmission delay includes a fixed transmission delay between the computer device and the audio conferencing terminal, a fluctuating processing delay of the audio conferencing terminal, a fixed transmission delay between the audio conferencing terminal and the audio player, a fixed air propagation delay, and a fixed transmission delay between the audio conferencing terminal and the audio collector, the fluctuation of the audio transmission delay represents the fluctuation of the processing delay of the audio conferencing terminal, and the audio transmission delay is used to separately measure the processing delay of the audio conferencing terminal.

8. A device for measuring audio transmission delay, wherein: The device is arranged in an audio conference terminal, and comprises: A receiving module, used for receiving first audio data sent by a computer device, wherein the audio conferencing terminal is connected to an audio player and an audio collector; A sending module, used for sending the audio signal corresponding to the first audio data to the audio player, so that the audio player plays the audio signal corresponding to the first audio data, and the audio collector is used for collecting the audio signal played by the audio player; The receiving module is also used to: receive the audio signal collected by the audio collector; A generating module, used for generating second audio data according to the audio signal collected by the audio collector; The sending module is also used to: send the second audio data to the computer device, so that the computer device determines the audio transmission delay according to the time when the computer device sends the first audio data and the time when the computer device receives the second audio data, wherein the audio transmission delay includes a fixed transmission delay between the computer device and the audio conferencing terminal, a fluctuating processing delay of the audio conferencing terminal, a fixed transmission delay between the audio conferencing terminal and the audio player, a fixed air propagation delay, and a fixed transmission delay between the audio conferencing terminal and the audio collector, the fluctuation of the audio transmission delay represents the fluctuation of the processing delay of the audio conferencing terminal, and the audio transmission delay is used to separately measure the processing delay of the audio conferencing terminal.

9. An electronic device, wherein: include: Memory; processor; and computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 6.

10. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

11. A system for measuring audio transmission delay, wherein: The system comprises a computer device, an audio conference terminal, an audio player and an audio collector, wherein audio data is transmitted between the computer device and the audio conference terminal, and the audio conference terminal is connected to the audio player and the audio collector respectively; The computer device is used to perform the method according to any one of claims 1 to 4; The audio conferencing terminal is used to execute the method as claimed in claim 5 or 6.

Images