Method for Dynamically Reporting Latency Information and Its Playback Device

Abstract

The present application discloses a method for dynamically reporting delay information and a playback device thereof, wherein the method for dynamically reporting delay information includes: obtaining device information of a video playback end; matching from a video end delay calibration parameter record table according to the video end manufacturer number and the video end product model, and obtaining the video end delay calibration parameter corresponding to the video playback end; combining the audio end delay calibration parameter, the reference playback delay parameter and the video end delay calibration parameter to form a video playback delay parameter; returning a delay report to the video playback end based on the video playback delay parameter; obtaining audio information sent by the video playback end, performing audio decoding on the audio information, and the audio playback end obtaining the decoded audio information and playing the decoded audio information. The method of the present application dynamically sends delay reports according to different video playback ends through a playback device that dynamically reports delay information, so as to ensure the synchronization of audio and video between the audio playback end and the video playback end.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video playback, and in particular to a method for dynamically reporting delay information and a playback device thereof. Background Art

[0002] With the development of technology, the application of audio equipment is becoming more and more popular, and consumers' performance requirements for audio equipment are gradually increasing. Audio data has gradually evolved from wired transmission from the host to the audio player to wireless transmission to the Bluetooth audio player.

[0003] When connecting a Bluetooth audio player to a video player, the audio and video may become out of sync (known as audio / video async). Manufacturers often attribute this async to latency inherent in the audio player itself. However, latency is caused by multiple factors. Simply considering the audio player's latency to delay video playback often fails to adapt to different video players, and the async issue persists. Summary of the Invention

[0004] The embodiments of the present invention provide a method for dynamically reporting delay information and a playback device thereof to solve the problem of delayed playback of video considering only the delay time of the audio playback end, which is often unable to adapt to different video playback ends and still causes audio and video asynchrony.

[0005] A method for dynamically reporting delay information, comprising:

[0006] Obtain device information for the video player, including the manufacturer number and model number of the video player.

[0007] According to the video end product model and video end manufacturer number, match from the video end delay calibration parameter record table to obtain the video end delay calibration parameters corresponding to the video playback end;

[0008] Combining the baseline playback delay parameter, the video end delay calibration parameter, and the audio end delay calibration parameter to form a video playback delay parameter;

[0009] Based on the video playback delay parameters, a delay report is returned to the video playback end so that the video playback end can adjust the delay time of the video playback;

[0010] The audio information sent by the video player is obtained, the audio information is decoded, and the audio player obtains the decoded audio information and plays the decoded audio information.

[0011] A method for dynamically reporting delay information, before obtaining device information of a video playback end, further comprising:

[0012] Use a benchmark video player and a benchmark audio player to perform tests and obtain benchmark playback delay parameters.

[0013] The target video player and the reference audio player are used for testing to obtain the video player delay calibration parameters corresponding to the target video player.

[0014] A benchmark video player and a target audio player are used for testing to obtain audio player delay calibration parameters corresponding to the target audio player.

[0015] A method for dynamically reporting delay information, using a benchmark video player and a benchmark audio player for testing to obtain benchmark playback delay parameters, includes:

[0016] Pair the reference video player and the reference audio player, and set the delay reporting parameter of the reference audio player to zero;

[0017] Playing a specific test video on a reference video playback end includes: obtaining a start time difference between a test video having a synchronization start signal and an audio corresponding to the test video, or obtaining an end time difference between a test video having a synchronization end signal and an audio corresponding to the test video;

[0018] By using a specific video and audio detection method, a start time difference or an end time difference between a video signal played by a reference video player and an audio signal played by a reference audio player is detected as a reference playback delay parameter.

[0019] A method for dynamically reporting delay information, using a target video player and a reference audio player for testing, to obtain a video player delay calibration parameter corresponding to the target video player, including:

[0020] Pair the target video player with the reference audio player, and set the delay reporting parameter of the reference audio player to zero.

[0021] Playing a specific test video on a target video playback end includes: obtaining a start time difference between a test video having a synchronization start signal and an audio corresponding to the test video, or obtaining an end time difference between a test video having a synchronization end signal and an audio corresponding to the test video;

[0022] Using a specific video and audio detection method, the start time difference or the end time difference between the video signal played by the target video player and the audio signal played by the reference audio player is detected as a playback delay parameter of the target video player;

[0023] Based on the target video playback end playback delay parameter and the reference playback end delay parameter, a video end delay calibration parameter is formed.

[0024] A method for dynamically reporting delay information, using a reference video player and a target audio player for testing, to obtain audio player delay calibration parameters corresponding to the target audio player, including:

[0025] Pair the baseline video player with the target audio player, and set the delay reporting parameter of the target audio player to zero;

[0026] Playing a specific test video on a reference video playback end includes: obtaining a start time difference between a test video having a synchronization start signal and an audio corresponding to the test video, or obtaining an end time difference between a test video having a synchronization end signal and an audio corresponding to the test video;

[0027] Using a specific video and audio detection method, the start time difference or end time difference between the video signal played by the reference video player and the audio signal played by the target audio player is detected as the playback delay parameter of the target audio player device;

[0028] Based on the target audio playback end delay parameter and the reference playback end delay parameter, an audio end delay calibration parameter is formed.

[0029] A method for dynamically reporting delay information, further comprising:

[0030] Obtain the device information of the target video player and the video end delay calibration parameters corresponding to the target video player, and form a video end delay calibration parameter record table;

[0031] The memory of the target audio playback end pre-stores a video end delay calibration parameter record table, a reference playback delay parameter, and an audio end delay calibration parameter.

[0032] A method for dynamically reporting delay information, further comprising:

[0033] Obtain a video device delay calibration parameter record table from a network server;

[0034] Based on the video end delay calibration parameters in the video device delay calibration parameter record table, the video end delay calibration parameters in the video end delay calibration parameter record table are updated.

[0035] A method for dynamically reporting delay information, further comprising:

[0036] Based on the video terminal delay calibration record table, scan the market product database to obtain the video test terminal to be added that does not exist in the video terminal delay calibration record table;

[0037] Set the video test end to be added as the target video playback end;

[0038] The target video player and the reference audio player are used for testing to obtain the video terminal delay calibration parameters corresponding to the target video player and add them to the video device delay calibration parameter record table of the network server.

[0039] A method for dynamically reporting delay information, further comprising:

[0040] Testing the candidate target audio player and the reference video player to obtain a delay calibration parameter for the candidate audio player;

[0041] The alternative audio playback terminal device pre-stores a record table of alternative audio terminal delay calibration parameters, reference playback delay parameters, and video terminal delay calibration parameters;

[0042] Based on the candidate audio end delay calibration parameter, the reference playback delay parameter and the video end delay calibration parameter record table, playback delay information of the candidate target audio playback end device is formed and reported to the target video playback end.

[0043] A playback device that dynamically reports delay information includes: an audio playback end, a memory, a processor, and a computer program stored in the memory and runnable on the processor, characterized in that when the processor executes the computer program, it implements the method for dynamically reporting delay information as claimed in any one of claims 1 to 9, the audio playback end is used to connect to the video playback end, and is used to play the audio information sent by the video playback end; the memory stores a video end delay calibration information record table, and the video end delay calibration information record table records the video end delay calibration parameters corresponding to the target video playback end.

[0044] The above-mentioned method for dynamically reporting delay information and its playback device obtains the device information of the video playback end and matches it in the video end delay calibration parameter record table. The audio playback end obtains the generated dynamic DR report and reports it to the video playback end. The video playback end receives the information in the dynamic DR report and waits for the delay time. The video playback delay parameter DR is obtained based on the sum of the audio end delay calibration parameter, the baseline playback delay parameter, and the video end delay calibration parameter. Therefore, the delay report can be dynamically sent based on different video playback ends and audio playback ends to ensure the synchronization of audio and video between the audio playback end and the video playback end. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments of the present invention. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0046] Figure 1A first flow chart illustrating a method for dynamically reporting delay information according to a first embodiment of the present invention is shown;

[0047] Figure 2 A schematic diagram illustrating the pairing process of a video player and an audio player in the method for dynamically reporting delay information in the first embodiment of the present invention is shown;

[0048] Figure 3 A schematic diagram illustrating a method for dynamically reporting delay information according to a first embodiment of the present invention, wherein a target player generates a dynamic report by calculating the dynamic report;

[0049] Figure 4 A schematic diagram illustrating audio and video signal delay in a method for dynamically reporting delay information according to a fourth embodiment of the present invention;

[0050] Figure 5 A second flow chart illustrating a method for dynamically reporting delay information according to a second embodiment of the present invention is shown;

[0051] Figure 6 A third flow chart illustrating a method for dynamically reporting delay information according to a third embodiment of the present invention is shown;

[0052] Figure 7 A schematic diagram illustrating the derivation process of a method for dynamically reporting delay information according to a third embodiment of the present invention is provided;

[0053] Figure 8 A fifth flow chart illustrating a method for dynamically reporting delay information according to a fourth embodiment of the present invention is shown;

[0054] Figure 9 A sixth flow chart illustrating a method for dynamically reporting delay information according to a fifth embodiment of the present invention is shown; Figure 10 A seventh flow chart illustrating a method for dynamically reporting delay information according to a seventh embodiment of the present invention is shown;

[0055] Figure 11 An eighth flow chart illustrating a method for dynamically reporting delay information according to an eighth embodiment of the present invention is shown;

[0056] Figure 12 A ninth flow chart of the method for dynamically reporting delay information according to the eighth embodiment of the present invention is shown. DETAILED DESCRIPTION

[0057] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0058] In one embodiment, if Figure 1As shown, a method for dynamically reporting delay information and a playback device thereof are provided, and the method is applied in Figure 1 The server in the example is used as an example. The specific steps include the following:

[0059] S10. Obtain device information of the video player, including the manufacturer number and product model of the video player.

[0060] Among them, the video end manufacturer number VID (Vendor Identification) is the manufacturer identification information reported by the DID (Device Identification) protocol, the video end product model PID (Product Identification) is the product model identification information reported by the DID protocol, and the video playback end is a mobile phone, tablet, TV, etc.

[0061] Specifically, if Figure 2 As shown in the figure, the video player and audio player are paired and connected, and a Bluetooth basic link is established between the two. The video player reports the VID and PID information to the audio player through the DID protocol.

[0062] The function of step S10 is to obtain the VID and PID information of the video player.

[0063] S20. According to the video end model and the video end manufacturer model, match from the video end delay calibration parameter record table to obtain the video end delay calibration parameters corresponding to the video playback end.

[0064] The video-side delay calibration parameter ΔDAV1 (Delay between Audio and Video) is the difference between the synchronization delay time when the reference audio playback device in the original playback-side database is paired with the target video playback device and the synchronization delay time between the reference playback devices.

[0065] Specifically, the audio playback end stores a video end delay calibration parameter record table, which records the video end model VID, the video end manufacturer model PID and the video end delay calibration parameter ΔDAV1. After the audio playback end receives the VID and PID information of the video playback end through the Bluetooth basic link, it queries the video end delay calibration parameter record table and finds the video end delay calibration parameter ΔDAV1 corresponding to the VID and PID information in the video playback end.

[0066] The function of step S20 is to obtain the video end delay calibration parameter corresponding to the video playback end.

[0067] S30. Combine the reference playback delay parameter, the video end delay calibration parameter, and the audio end delay calibration parameter to form a video playback delay parameter.

[0068] The video playback delay parameter DR (Delay Report) is calculated by the audio player. The video playback delay parameter is the delay time that the video player needs to wait for the audio player when the video player and the audio player are paired and connected.

[0069] Specifically, in the actual process, there will be a delay time when the video player plays the audio and video, and there will also be a delay time when the audio player connected to the video player receives and plays the audio, but the delay time of the two is mostly different. The delay time of the audio on the audio player will be longer than the delay time of the video on the video player, resulting in the phenomenon of audio being out of sync. In this embodiment, the audio player is a Bluetooth audio player device, such as Figure 3 As shown in the figure, the video playback delay parameter DR is the sum of the audio side delay calibration parameter, the reference playback delay parameter, and the video side delay calibration parameter. In this case, the video playback delay time plus the video playback delay parameter DR equals the audio playback delay time, ensuring that the video playback end of the video player is synchronized with the audio playback end.

[0070] The function of step S30 is that the video playback delay parameter DR is dynamic, which is obtained based on the sum of the audio end delay calibration parameter, the benchmark playback delay parameter and the video end delay calibration parameter. It is obtained and generated at the audio playback end. The video playback delay parameter DR is used to dynamically adjust the audio and video synchronization phenomenon at the video playback end, so that it can be adjusted from the asynchronous phenomenon to the synchronized phenomenon. At the same time, it can also prevent the occurrence of audio and video synchronization phenomenon to the greatest extent. It is suitable for different video playback devices.

[0071] S40. Based on the video playback delay parameter, return a delay report to the video playback end so that the video playback end adjusts the delay time of the video playback.

[0072] The delay report is the dynamic delay information of the video playback delay parameter DR.

[0073] Specifically, if Figure 3 As shown, when the Bluetooth audio and video transmission protocol connection is established, the audio playback end generates a dynamic DR report to the video playback end by obtaining the audio end delay calibration parameters, the baseline playback delay parameters and the video end delay calibration parameters. The video playback end receives the information in the dynamic DR report and waits for the delay time that needs to be delayed.

[0074] The function of step S40 is to synchronize the video playback end of the video playback end and the audio playback end of the audio playback end through the delayed reporting information of the dynamic DR.

[0075] S50. Obtain the audio information sent by the video player, perform audio decoding on the audio information, and the audio player obtains the decoded audio information and plays the decoded audio information.

[0076] The audio information is transmitted from the video player to the audio player.

[0077] Specifically, if Figure 4 As shown in the figure, audio information is transmitted from the video player to the audio player. During the transmission process, the video player needs to decode the audio information and transmit it. The audio player receives the decoded audio information and plays it. The video information needs to be decoded and played by the video player. The above process may cause audio and video to be out of sync. Dynamic DR reports can dynamically adjust this.

[0078] The function of step S50 is that the video player transmits audio information to the audio player.

[0079] The method for dynamically reporting delay information provided in this embodiment obtains device information of the video playback end and matches it in the video end delay calibration parameter record table. The audio playback end obtains the generated dynamic DR report and reports it to the video playback end. The video playback end receives the information in the dynamic DR report and waits for the delay time. The video playback delay parameter DR is obtained based on the sum of the audio end delay calibration parameter, the baseline playback delay parameter, and the video end delay calibration parameter. Therefore, the delay report can be dynamically sent based on different video playback ends and audio playback ends to ensure the synchronization of audio and video between the audio playback end and the video playback end.

[0080] In one embodiment, if Figure 5 As shown, in step S10, that is, before obtaining the device information of the video playback end, the following steps are specifically included:

[0081] S101. Perform a test using a benchmark video player and a benchmark audio player to obtain benchmark playback delay parameters.

[0082] S102. Perform a test using a target video player and a reference audio player to obtain a video player delay calibration parameter corresponding to the target video player.

[0083] S103. Perform a test using a reference video player and a target audio player to obtain an audio player delay calibration parameter corresponding to the target audio player.

[0084] Among them, the benchmark playback delay parameter DAV0 is the audio and video synchronization delay time of the benchmark video playback end and the benchmark audio playback end; the video end delay calibration parameter ΔDAV1 is the change in the audio and video synchronization delay time of the target video playback end and the benchmark audio playback end and the audio and video synchronization delay time of the benchmark video playback end and the benchmark audio playback end; the audio end delay calibration parameter ΔDAV2 is the change in the audio and video synchronization delay time of the benchmark video playback end and the target audio playback end and the audio and video synchronization delay time of the benchmark video playback end and the benchmark audio playback end.

[0085] Specifically, the reference video playback end and the reference audio playback end are paired and connected, and the reference playback delay parameter DAV0, that is, the time of the audio and video synchronization delay between the reference video playback end and the reference audio playback end, is measured; when other conditions remain unchanged, the target video playback end replaces the reference video playback end, and the video end delay calibration parameter ΔDAV1 is measured; also when other conditions remain unchanged, the target audio playback end replaces the reference audio playback end, and the audio end delay calibration parameter ΔDAV2 is measured. Based on DAV0, ΔDAV1 and ΔDAV2, the three are calculated to generate the corresponding video playback delay parameter DR, and the video end delay calibration parameter ΔDAV1 and the corresponding VID and PID information are recorded in the video end delay calibration parameter record table. In addition, through this replacement test method, when the industry produces a new Bluetooth audio playback device, it is not necessary to test it with all the video playback terminals on the market to obtain a new video terminal delay calibration parameter record table, that is, there is no need to test the target audio playback terminal and the target video playback terminal to obtain the video terminal delay calibration parameter record table. It is only necessary to test the target audio playback terminal with the benchmark video playback terminal to obtain the audio terminal delay calibration parameters, and reuse the original benchmark playback delay parameters DAV0 and the video terminal delay calibration parameter record table. The video terminal delay calibration parameter record table contains a database of most video playback terminals on the market, so that the target audio playback terminal can adapt to many different target video playback terminals, which is conducive to cost saving.

[0086] At the same time, the benchmark video player can be freely selected based on industrial production conditions. Different benchmark video players correspond to different device information in the video player delay calibration parameter record table. In other words, after selecting a different benchmark video player, it is necessary to replace the benchmark video player in the delay information table under the same test conditions, retest, and generate a new video player delay calibration parameter record table. The audio player also needs to be retested under the same conditions to obtain the audio player's delay information.

[0087] The purpose of steps S101, S102, S103 and S104 is to use the specific delay information testing method of the present application to test the delay calibration parameters of different video playback ends and audio playback ends.

[0088] In one embodiment, if Figure 6 As shown, in step S101, a benchmark video player and a benchmark audio player are used to perform a test to obtain a benchmark playback delay parameter, which specifically includes the following steps:

[0089] S1011. Pair the reference video player and the reference audio player, and set the delay reporting parameter of the reference audio player to zero.

[0090] S1012. When playing a specific test video on the reference video playback end, obtain the start time difference of the test video with a synchronous start signal and the audio corresponding to the test video, or obtain the end time difference of the test video with a synchronous end signal and the audio corresponding to the test video.

[0091] S1013. Detect a start time difference or an end time difference between a video signal played by a reference video player and an audio signal played by a reference audio player, and use the difference as a reference playback delay parameter.

[0092] Among them, such as Figure 4 As shown in the figure, DAV (Delay between Audio and Video) is the audio and video synchronization delay, which is the difference between the start time of the test video with a synchronization start signal and the corresponding audio of the test video, or the difference between the end time of the test video with a synchronization end signal and the corresponding audio of the test video. The video playback buffer delay parameter DV (Delay of Video) is the original delay time from decoding to playback of the video signal on the video player. The initial audio playback delay parameter DA (Delay of Audio) is the delay time from the video player to the audio player. DR is the delay parameter reported by the audio player. The video player adjusts the video signal playback delay time based on DR.

[0093] Then we can get DAV=DA-(DV+DR). (Formula 1)

[0094] The audio playback delay parameter of the benchmark video playback end is represented by DAsrc0, which is the delay time from the decoding to the transmission of the audio signal at the video playback end. The audio playback delay parameter of the benchmark audio playback end is represented by DAsink0, which is the delay time from the audio playback end receiving the audio signal from the video playback end and playing it out. Then DA0=DAsrc0+DAsink0.

[0095] Specifically, the reference video player plays a specific test video. The signal in the test video is synchronized, but after it is actually broadcast, there will be a delay in the signal transmission process from the test video to the audio. There will be a difference between the start (or end) time of the video and the start (or end) time of the audio. This difference is the audio and video synchronization delay time parameter DAV we want. How to choose the start time or the end time depends on the original file of the test video. The test videos may start together but not end together, so the start time of the video is detected. The test videos may also not start and end together, so the end time of the video is detected. If the start and end of the test video are not the same, either of the start and end times of the video can be detected. For example, at a specific time in the test video, the video will turn from black to white, and a 1k sound will come out at the same time. During the test, the 1k sound will be detected later than the video turns from black to white. The time difference of the signal can be measured on the oscilloscope. By detecting the start time difference or the end time difference of the video signal played by the reference video player and the audio signal played by the reference audio player, it can be used as the reference playback delay parameter DAV0. As Figure 4 and Figure 7 As shown, the benchmark video player and the benchmark audio player are paired, the video playback buffer delay parameter of the benchmark video player is DV0 and the initial audio playback delay parameter is DA0, and the delay report parameter of the benchmark audio player is set to zero. At this time, the delay time DR that the video player needs to wait for the audio player is zero, and the video signal of the video player has only the buffer delay parameter of the video player itself. The audio and video of the video player and the audio player are not synchronized.

[0096] Base playback delay parameter DAV0 = DAsrc0 + DAsink0 - DV0, (Formula 2)

[0097] The reference playback delay parameter DAV0 is used to reflect the audio-visual synchronization delay time of the reference video playback end and the reference audio playback end, that is, the start time difference or end time difference between the video signal played by the reference video playback end and the audio signal played by the reference audio playback end.

[0098] Steps S1011 , S1012 and S1013 are used to obtain a reference playback delay parameter DAV0 through the video playback buffer delay parameter DV0 , the initial audio playback delay parameter DA0 and the delay report parameter DR=0 of the reference audio playback end.

[0099] In one embodiment, if Figure 8 As shown, in step S102, a target video player and a reference audio player are used to perform a test to obtain a video player delay calibration parameter corresponding to the target video player, specifically including the following steps:

[0100] S1021. Pair the target video player and the reference audio player, and set the delay reporting parameter of the reference audio player to zero.

[0101] S1022. When a specific test video is played on the target video playback end, the start time difference between the test video with a synchronous start signal and the audio corresponding to the test video is obtained, or the end time difference between the test video with a synchronous end signal and the audio corresponding to the test video is obtained.

[0102] S1023. Detect the start time difference or the end time difference between the video signal played by the target video playback end and the audio signal played by the reference audio playback end, and use the difference as a target video playback end playback delay parameter.

[0103] S1024. Based on the target video playback end playback delay parameter and the reference playback end delay parameter, form the video end delay calibration parameter.

[0104] Among them, such as Figure 7 As shown, the target video player's video playback buffer delay parameter is represented by DV1, the first audio playback delay parameter is DA1, and the target video player's audio playback delay parameter is represented by DAsrc1, which is the delay time from the audio signal being decoded to being transmitted at the audio player. The reference audio player's audio playback delay parameter is represented by DAsink0, where DA1 = DAsrc1 + DAsink0. The reference audio player's delay reporting parameter is set to zero, that is, DR = 0.

[0105] Specifically, the delay time DR that the video player needs to wait for the audio player is zero. The video signal at the video player only has the buffering delay parameter of the video player itself, and the audio and video at the video player and audio player are out of sync. Based on DA1 = DAsrc1 + DAsink0 and formula 1, the target video player playback delay parameter DAV1 = DAsrc1 + DAsink0 - DV1 can be obtained (formula 3).

[0106] The target video player end playback delay parameter DAV1 is the start time difference or the end time difference between the video signal played by the target video player end and the audio signal played by the reference audio player end. According to Formula 2 and Formula 3, the target video player end playback delay parameter DAV1 and the reference player end delay parameter DAV0 are subtracted to obtain the change caused by the target video player end replacing the reference video player end, i.e., the video end delay calibration parameter

[0107] ΔDAV1 = DV0-DV1 + DAsrc1-DAsrc0, (Formula 4)

[0108] The reference playback delay parameter ΔDAV1 is used to reflect the change in the audio / video synchronization delay between the target video playback end and the reference audio playback end and the audio / video synchronization delay between the reference video playback end and the reference audio playback end after replacement.

[0109] Steps S1021 , S1022 , S1023 and S1024 are used to calculate the video end delay calibration parameter ΔDAV1 .

[0110] In one embodiment, if Figure 9 As shown, in step S103, a test is performed using a reference video player and a target audio player to obtain an audio player delay calibration parameter corresponding to the target audio player, specifically including the following steps:

[0111] S1031. Pair the reference video player and the target audio player, and set the delay reporting parameter of the target audio player to zero.

[0112] S1032. When playing a specific test video on the reference video playback end, obtain the start time difference of the test video with a synchronous start signal and the audio corresponding to the test video, or obtain the end time difference of the test video with a synchronous end signal and the audio corresponding to the test video.

[0113] S1033. Detect the start time difference or the end time difference between the video signal played by the reference video player and the audio signal played by the target audio player, and use it as a playback delay parameter of the target audio player.

[0114] S1034 forms an audio end delay calibration parameter based on the target audio player end delay parameter and the reference player end delay parameter.

[0115] Among them, such as Figure 7 As shown in the figure, the video playback buffer delay parameter of the reference video player is represented by DV0, the second audio playback delay parameter is DA2, and the audio playback delay parameter of the reference video player is represented by DAsrc0, which is the delay time from the audio signal being decoded to being transmitted at the audio player. The audio playback delay parameter of the target audio player is represented by DAsink1, where DA2 = DAsrc0 + DAsink1. The delay reporting parameter of the target audio player is set to zero, that is, DR = 0.

[0116] Specifically, the delay time DR that the video player needs to wait for the audio player is zero. The video signal at the video player only has the buffering delay parameter of the video player itself, and the audio and video at the video player and audio player are out of sync. Based on DA2 = DAsrc0 + DAsink1 and formula 1, the target audio player device playback delay parameter DAV2 = DAsrc0 + DAsink1 - DV0 can be obtained (formula 5).

[0117] The target audio player device playback delay parameter is the start time difference or end time difference between the video signal played by the reference video player and the audio signal played by the target audio player. According to Formula 2 and Formula 5, the target audio player device playback delay parameter DAV2 is subtracted from the reference player delay parameter DAV0 to obtain the change in synchronization delay time caused by the target audio player replacing the reference audio player, i.e., the audio player delay calibration parameter.

[0118] ΔDAV2 = DAsink1 - DAsink0, (Equation 6)

[0119] The audio delay calibration parameter ΔDAV2 reflects the difference between the audio and video synchronization delay between the reference video player and the target audio player after the replacement, and the audio and video synchronization delay between the reference video player and the reference audio player. The video playback delay parameter DR is calculated as DAV0 + ΔDAV1 + ΔDAV2.

[0120] The above test method can be proved by the following method:

[0121] When the current video player and the target audio player are paired and connected, set the video playback delay parameter DR

[0122] DR=DAV0+∆DAV1+∆DAV2, (Formula 7)

[0123] Substituting the right side of equation 7 into equations 2, 4, and 6, we can get

[0124] DR = DAsrc1 + DAsink1 - DV1, (Equation 8)

[0125] At this time, the delay synchronization time DAV3 corresponding to the current video player and the target audio player is substituted into formula 8 to obtain

[0126] DAV3= (DAsrc1 + DAsink1) -(DV1+ DR)=(DAsrc1 + DAsink1) -(DV1+ DAsrc1+

[0127] DAsink1-DV1) = 0,

[0128] By replacing the test method, the dynamic DR report DR = DAV0 + ∆DAV1 + ∆DAV2 is calculated to be the delay time that the video player needs to wait for the audio player, which is correct. Adjusting the value of the dynamic DR report can keep the video player and audio player synchronized.

[0129] Steps S1031 , S1032 , S1033 and S1034 are used to calculate the audio-end delay calibration parameter ΔDAV2 .

[0130] In one embodiment, the method specifically includes the following steps:

[0131] S1041. Obtain device information of the target video playback end and the video end delay calibration parameters corresponding to the target video playback end, and form a video end delay calibration parameter record table.

[0132] S1042. The memory of the target audio playback end pre-stores a video end delay calibration parameter record table, a reference playback delay parameter, and an audio end delay calibration parameter.

[0133] The video end delay calibration parameter record table includes the VID and PID information corresponding to the target video playback end and the video end delay calibration parameter ΔDAV1.

[0134] The video end delay calibration parameter record table includes the VID and PID information of the target video playback end and the video end delay calibration parameter ΔDAV1. The VID and PID information and the video end delay calibration parameter ΔDAV1 correspond one to one.

[0135] Specifically, the memory of the target audio playback end stores a video end delay calibration parameter record table, a reference playback delay parameter ∆DAV0, and an audio end delay calibration parameter ∆DAV2. The video end delay calibration parameter record table records the VID, PID information of the target video playback end, and the video end delay calibration parameter ΔDAV1.

[0136] Steps S1041 and S1042 are used to enable the target audio playback end to store the video end delay calibration parameter record table, the reference playback delay parameters, and the audio end delay calibration parameters.

[0137] In one embodiment, if Figure 10 As shown, the specific steps include:

[0138] S1043. Obtain the video device delay calibration parameter record table from the network server.

[0139] S1044. Based on the video end delay calibration parameters in the video device delay calibration parameter record table, update the video end delay calibration parameters in the video end delay calibration parameter record table.

[0140] The audio player has a video delay calibration parameter record table in the audio player, and the audio player can update the video delay calibration parameters in the video delay calibration parameter record table and store them in its own memory.

[0141] Specifically, when the audio playback end is connected to the network, it can periodically obtain the video end delay calibration parameter ∆DAV1 of the video device delay calibration parameter record table of the network server from a fixed server, and update the video end delay calibration parameter ∆DAV1 in the video end delay calibration parameter record table to adapt to the video playback end on the market; when the audio playback end is not connected to the network, it can be equipped with a mobile phone app or an app on a video playback end such as a PC to update the video end delay calibration parameter ∆DAV1 in the video end delay calibration parameter record table.

[0142] The purpose of steps S1042 and S1043 is to update the video terminal delay calibration parameter record table to adapt to different video playback terminals on the market.

[0143] In one embodiment, if Figure 11 As shown, the following steps are included:

[0144] S104. Based on the video terminal delay calibration record table, scan the market product database to obtain the video test terminal to be added that does not exist in the video terminal delay calibration record table.

[0145] S105. Use the video test terminal to be added as the target video playback terminal.

[0146] S106. Perform a test using the target video player and the reference audio player to obtain the video device delay calibration parameters corresponding to the target video player, and add them to the video device delay calibration parameter record table of the network server.

[0147] Among them, the video test terminals to be added are most of the target video playback terminals on the market, which can be paired with the audio playback terminals.

[0148] Specifically, a database of products on the market is scanned, and the device information of the video test terminal to be added is queried through the device information in the video terminal delay calibration record table, and the device information of the video test terminal to be added that does not exist in the video terminal delay calibration record table is obtained. The video test terminal to be added is tested as the target video playback terminal and the reference audio playback terminal, and the video terminal delay calibration parameter ∆DAV1 corresponding to the target video playback terminal is obtained. The corresponding video terminal delay calibration parameter ∆DAV1 is added to the video device delay calibration parameter record table of the network server. Then, the network server is connected through the target audio playback terminal to update the video terminal delay calibration parameter ∆DAV1 of the video test to be added to the video terminal delay calibration record table in the target audio playback terminal, so that the target audio playback terminal keeps recording the information of most target video playback terminals on the market, so that the target audio playback terminal can synchronize the audio and video with most target video playback terminals on the market.

[0149] The function of steps S104, S105 and S106 is to scan the market product database of the target video player end, so that the target audio player end can record the information of most target video player ends on the market.

[0150] In one embodiment, if Figure 12 As shown, the target video player and the reference audio player are used for testing. After obtaining the video player delay calibration parameters corresponding to the target video player, the following steps are included:

[0151] S107. Test the candidate target audio player and the reference video player to obtain a delay calibration parameter for the candidate audio player.

[0152] S108. The candidate audio playback terminal device pre-stores a record table of candidate audio terminal delay calibration parameters, reference playback delay parameters, and video terminal delay calibration parameters.

[0153] S109. Based on the candidate audio terminal delay calibration parameter, the reference playback delay parameter and the video terminal delay calibration parameter record table, the playback delay information of the candidate target audio playback terminal device is generated and reported to the target video playback terminal.

[0154] The alternative target audio player is the work that the second audio player needs to do.

[0155] Specifically, the alternative target audio player and the reference video player are tested to obtain the alternative audio player delay calibration parameter ∆DAV2. The video player delay calibration parameter record table of the alternative target audio player records the video player delay calibration parameter ∆DAV1 of most target video players. The alternative target audio player calculates and generates the playback delay information DR by itself. When paired with the target video player, it reports it to the target video player corresponding to the video player delay calibration parameter ∆DAV1.

[0156] The function of step S107 is that different audio playback terminals can calculate and generate playback delay information by replacing the test method, and report it to different video playback terminals. Different audio playback terminals can adapt to different video playback terminals.

[0157] The method for dynamically reporting delay information provided in this embodiment obtains device information of the video playback end and matches it in the video end delay calibration parameter record table. The audio playback end obtains the generated dynamic DR report and reports it to the video playback end. The video playback end receives the information in the dynamic DR report and waits for the delay time. The video playback delay parameter DR is obtained based on the sum of the audio end delay calibration parameter, the baseline playback delay parameter, and the video end delay calibration parameter. Therefore, the delay report can be dynamically sent based on different video playback ends and audio playback ends to ensure the synchronization of audio and video between the audio playback end and the video playback end.

[0158] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0159] In one embodiment, a playback device for dynamically reporting delay information is provided, including: an audio playback end, a memory, a processor, and a computer program stored in the memory and runnable on the processor, characterized in that the processor executes any of the above-mentioned methods for dynamically reporting delay information, the audio playback end is used to connect to the video playback end, and to play the audio information sent by the video playback end; the memory stores a video end delay calibration parameter record table, and the video end delay calibration parameter record table records the video end delay calibration parameters corresponding to the target audio playback end.

[0160] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. A method for dynamically reporting delay information, characterized in that: include: Obtain device information of the video player, including the manufacturer number and product model of the video player; According to the video end product model and the video end manufacturer number, matching is performed from the video end delay calibration parameter record table to obtain the video end delay calibration parameter corresponding to the video playback end; Combining the reference playback delay parameter, the video end delay calibration parameter, and the audio end delay calibration parameter to form a video playback delay parameter; Based on the video playback delay parameter, returning a delay report to the video playback end so that the video playback end adjusts the delay time of the video playback; Acquiring audio information sent by the video player, performing audio decoding on the audio information, and the audio player acquiring the decoded audio information and playing the decoded audio information; Before obtaining the device information of the video player, the method further includes: Use a benchmark video player and a benchmark audio player to perform tests and obtain benchmark playback delay parameters. A target video player and the reference audio player are used to perform a test to obtain a video player delay calibration parameter corresponding to the target video player; The reference video player and the target audio player are used to perform a test to obtain an audio player delay calibration parameter corresponding to the target audio player.

2. The method for dynamically reporting delay information according to claim 1, wherein: The test is performed using a reference video player and a reference audio player to obtain a reference playback delay parameter, including: Pair the reference video player and the reference audio player, and set the delay reporting parameter of the reference audio player to zero; When a specific test video is played on a reference video playback end, obtaining a start time difference between the test video having a synchronization start signal and an audio corresponding to the test video, or obtaining an end time difference between the test video having a synchronization end signal and an audio corresponding to the test video; The start time difference or the end time difference between the video signal played by the reference video playback end and the audio signal played by the reference audio playback end is detected as a reference playback delay parameter.

3. The method for dynamically reporting delay information according to claim 1, wherein: The test is performed using the target video player and the reference audio player to obtain a video player delay calibration parameter corresponding to the target video player, including: Pair the target video player with the reference audio player, and set the delay reporting parameter of the reference audio player to zero. When a specific test video is played on a target video playback end, obtaining a start time difference between the test video having a synchronization start signal and the audio corresponding to the test video, or obtaining an end time difference between the test video having a synchronization end signal and the audio corresponding to the test video; Detecting the start time difference or the end time difference between the video signal played by the target video player and the audio signal played by the reference audio player as the target video player playback delay parameter; The video end delay calibration parameter is formed based on the target video player end playback delay parameter and the reference player end delay parameter.

4. The method for dynamically reporting delay information according to claim 1, wherein: The test is performed using the reference video player and the target audio player to obtain an audio player delay calibration parameter corresponding to the target audio player, including: Pair the baseline video player with the target audio player, and set the delay reporting parameter of the target audio player to zero; When a specific test video is played on a reference video playback end, obtaining a start time difference between the test video having a synchronization start signal and an audio corresponding to the test video, or obtaining an end time difference between the test video having a synchronization end signal and an audio corresponding to the test video; Detecting the start time difference or the end time difference between the video signal played by the reference video player and the audio signal played by the target audio player as a playback delay parameter of the target audio player device; Based on the target audio playback end delay parameter and the reference playback end delay parameter, an audio end delay calibration parameter is formed.

5. The method for dynamically reporting delay information according to claim 1, wherein: Also includes: Obtaining device information of the target video playback end and a video end delay calibration parameter corresponding to the target video playback end, and forming a video end delay calibration parameter record table; The memory of the target audio playback end pre-stores a video end delay calibration parameter record table, a reference playback delay parameter, and an audio end delay calibration parameter.

6. The method for dynamically reporting delay information according to claim 1, wherein: Also includes: Obtain a video device delay calibration parameter record table from a network server; Based on the video end delay calibration parameters in the video device delay calibration parameter record table, the video end delay calibration parameters in the video end delay calibration parameter record table are updated.

7. The method for dynamically reporting delay information according to claim 1, wherein: Also includes: Based on the video terminal delay calibration record table, scan the market product database to obtain the video test terminal to be added that does not exist in the video terminal delay calibration record table; The video test end to be added is used as the target video playback end; The target video player and the reference audio player are used for testing to obtain the video terminal delay calibration parameters corresponding to the target video player, and add the parameters to the video device delay calibration parameter record table of the network server.

8. The method for dynamically reporting delay information according to claim 1, wherein: Also includes: Testing the candidate target audio player and the reference video player to obtain a delay calibration parameter for the candidate audio player; The alternative audio player pre-stores a record table of alternative audio player delay calibration parameters, reference playback delay parameters, and video player delay calibration parameters; Based on the audio end delay calibration parameter, the reference playback delay parameter and the video end delay calibration parameter record table, playback delay information of the candidate target audio playback end is formed and reported to the target video playback end.

9. A playback device for dynamically reporting delay information, characterized in that: include: An audio playback end, a memory, a processor, and a computer program stored in the memory and runnable on the processor, characterized in that when the processor executes the computer program, the method for dynamically reporting delay information according to any one of claims 1 to 8 is implemented, the audio playback end is used to connect to the video playback end, and to play the audio information sent by the video playback end; the memory stores a video end delay calibration information record table, and the video end delay calibration information record table records the video end delay calibration parameters corresponding to the target video playback end.

Images