Time delay measurement method and device, computer device and storage medium

Abstract

The application discloses a time delay measurement method and device, computer equipment and a storage medium. The method can be applied to the technical field of remote control, and specifically can include: a near-end device transmits a test video to a far-end device while starting to play the test video, so as to instruct the far-end device to play the test video; when a preset sampling time is reached at the far-end device, a far-end playing time of a far-end playing image frame of the test video is acquired, and the far-end playing time is fed back to the near-end device; when the preset sampling time is reached at the near-end device, a near-end playing time of a near-end playing image frame of the test video is also acquired by the near-end device; and according to the far-end playing time and the near-end playing time, a remote control time delay between the near-end device and the far-end device is determined. The method can not only accurately determine the remote control time delay between the near-end device and the far-end device, but also greatly improves the measurement efficiency of the remote control time delay and reduces the time delay measurement cost.

Description

Technical Field

[0001] This application relates to the field of remote control technology, specifically to a time delay measurement method, apparatus, computer equipment, and storage medium. Background Technology

[0002] With the rapid development of mobile communication technology, especially the gradual popularization of 5G communication technology, a low-latency communication foundation has been provided for the innovation of service models in many industries. Against this background, remote control-related work has been greatly promoted.

[0003] In some remote control applications, latency requirements are quite high. For example, in telemedicine surgery, the local doctor uses local equipment (i.e., the proximal device) to remotely control a remote device to perform surgical procedures on a patient at a distance. This type of work has very high latency requirements between the proximal and remote devices. If the latency between the two devices is high, it will seriously affect the success and outcome of the surgery. However, currently, there is a lack of methods for measuring the latency between the proximal and remote devices. Summary of the Invention

[0004] Therefore, it is necessary to provide a delay measurement method, apparatus, computer equipment, and storage medium that can accurately measure the remote control delay of near-end devices and far-end devices, in order to address the above-mentioned technical problems.

[0005] In a first aspect, this application provides a time delay measurement method applied to a near-end device, the method comprising:

[0006] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0007] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0008] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0009] In one embodiment, when the near-end device reaches a preset sampling time, the near-end playback time of the near-end playback image frame of the test video is acquired, including:

[0010] If the test video is a timed video, then when the near-end device reaches the preset sampling time, the near-end playback image frame of the timed video is captured;

[0011] Identify the timing in the near-end playback image frame and use it as the near-end playback time of the near-end playback image frame.

[0012] In one embodiment, determining the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time includes:

[0013] If there are at least two preset sampling times, then the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time.

[0014] The remote control delay between the near-end device and the far-end device is determined based on the remote control delay corresponding to each preset sampling time.

[0015] In one embodiment, the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time, including:

[0016] Based on the far-end playback time and near-end playback time corresponding to each preset sampling time, determine the playback delay for each sampling time;

[0017] Based on the near-end device time and far-end device time corresponding to each sampling time, determine the device time delay corresponding to each sampling time;

[0018] Based on the playback delay and device time delay corresponding to each sampling moment, the remote control delay corresponding to each preset sampling moment is determined.

[0019] In one embodiment, the remote device and the near device synchronize time based on a time synchronization device.

[0020] In one embodiment, the near-end device and the far-end device communicate based on a target application.

[0021] Secondly, this application provides another delay measurement method for use in remote devices, the method comprising:

[0022] Receive test videos transmitted from nearby devices and play the test videos;

[0023] When the remote device reaches the preset sampling time, the remote playback time of the test video's remote playback image frame is obtained.

[0024] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0025] In one embodiment, when the remote device reaches a preset sampling time, the remote playback time of the remote playback image frame of the test video is acquired, including:

[0026] If the test video is a timed video, then when the remote device reaches the preset sampling time, capture the remote playback image frame of the timed video;

[0027] Identify the timing in the remote playback image frame and use it as the remote playback time of the remote playback image frame.

[0028] In one embodiment, the remote device and the near device synchronize time based on a time synchronization device.

[0029] In one embodiment, the near-end device and the far-end device communicate based on a target application.

[0030] Thirdly, this application also provides a time delay measurement device for use in near-end equipment, the device comprising:

[0031] The first acquisition module is used to transmit the test video to the remote device while starting the playback of the test video, to instruct the remote device to play the test video, and to acquire the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time, and to feed back the remote playback time to the near device.

[0032] The second acquisition module is used to acquire the near-end playback time of the near-end playback image frame of the test video when the near-end device reaches the preset sampling time.

[0033] The first delay measurement module is used to determine the remote control delay between the near-end device and the far-end device based on the remote playback time and the near-end playback time.

[0034] Fourthly, this application also provides another time delay measurement device for use in remote equipment, the device comprising:

[0035] The receiving module is used to receive test videos transmitted from nearby devices and play the test videos.

[0036] The third acquisition module is used to acquire the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time.

[0037] The second delay measurement module is used to feed back the remote playback time to the near-end device, and to instruct the near-end device to determine the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video obtained by the near-end device when the near-end device time reaches the preset sampling time.

[0038] Fifthly, this application also provides a computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0039] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0040] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0041] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0042] Sixthly, this application also provides another computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0043] Receive test videos transmitted from nearby devices and play the test videos;

[0044] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0045] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0046] In a seventh aspect, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the following steps:

[0047] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0048] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0049] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0050] Eighthly, this application also provides another computer-readable storage medium on which a computer program is stored, which, when executed by a processor, performs the following steps:

[0051] Receive test videos transmitted from nearby devices and play the test videos;

[0052] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0053] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0054] Ninthly, this application also provides a computer program product comprising a computer program that, when executed by a processor, performs the following steps:

[0055] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0056] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0057] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0058] In a tenth aspect, this application also provides another computer program product, which includes a computer program that, when executed by a processor, performs the following steps:

[0059] Receive test videos transmitted from nearby devices and play the test videos;

[0060] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0061] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0062] The aforementioned delay measurement method, apparatus, computer equipment, and storage medium, in this method, the near-end device transmits the test video to the far-end device simultaneously with initiating playback of the test video, instructing the far-end device to play the test video. When the far-end device reaches a preset sampling time, it acquires the far-end playback time of the far-end playback image frame of the test video and feeds it back to the near-end device. Similarly, when the near-end device reaches its preset sampling time, it also acquires the near-end playback time of the near-end playback image frame of the test video. Based on the far-end playback time and the near-end playback time, the remote control delay between the near-end device and the far-end device is determined. This method not only accurately determines the remote control delay between the near-end device and the far-end device but also significantly improves the measurement efficiency of remote control delay and reduces the delay measurement cost. Attached Figure Description

[0063] Figure 1 This is an application environment diagram of a time delay measurement method provided in this embodiment;

[0064] Figure 2 This is a flowchart illustrating the first time delay measurement method provided in this embodiment;

[0065] Figure 3 This embodiment provides a flowchart illustrating the process of determining the remote control delay between the near-end device and the far-end device when there are at least two sampling times.

[0066] Figure 4 This is a flowchart illustrating the second time delay measurement method provided in this embodiment;

[0067] Figure 5 A flowchart illustrating the third time delay measurement method provided in this embodiment;

[0068] Figure 6 This is a structural block diagram of the first time delay measurement device provided in this embodiment;

[0069] Figure 7 This is a structural block diagram of the second time delay measurement device provided in this embodiment;

[0070] Figure 8 This is an internal structural diagram of the computer device provided in this embodiment. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0072] The time delay measurement method provided in this application embodiment can be applied to, for example... Figure 1 In the application environment shown, while the near-end device 102 starts playing the test video, it also transmits the test video to the remote device 104. The remote device 104 receives and plays the test video. When the remote device reaches the preset sampling time, the remote device 104 obtains the remote playback time of the remote playback image frame of the test video and feeds back the remote playback time to the near-end device 102. When the near-end device 102 reaches the preset sampling time, it obtains the near-end playback time of the near-end playback image frame of the test video. Based on the remote playback time and the near-end playback time, the near-end device 102 determines the remote control delay between the near-end device 102 and the remote device 104.

[0073] In this context, near-end device 102 refers to the device controlling the remote control operation, while far-end device 104 refers to the device being controlled during the remote control process. For example, in remote medical surgery, near-end device 102 is a near-end control device, such as a near-end surgical console. Far-end device 104 is a far-end controlled device, such as a remote medical robot. The communication environment during remote medical surgery can be determined based on the remote control latency. If the remote control latency exceeds a set latency threshold, the communication environment is considered unsuitable, and remote surgery will not be performed. If the remote control latency does not exceed the set latency threshold, the communication environment is considered suitable, and remote surgery can be performed.

[0074] In one embodiment, Figure 2 This is a flowchart illustrating a time delay measurement method according to an embodiment of this application, applied to... Figure 1 Taking a near-end device as an example, the method includes the following steps:

[0075] S201, while starting to play the test video, transmit the test video to the remote device to instruct the remote device to play the test video, and when the remote device reaches the preset sampling time, obtain the remote playback time of the remote playback image frame of the test video, and feed back the remote playback time to the near device.

[0076] The test video refers to the video used to test the remote control latency between the near-end and far-end devices. It can be a time-indicating video, such as a stopwatch video. The preset sampling time refers to the pre-set time for acquiring the near-end and far-end playback image frames of the test video. The far-end playback time refers to the time indicated by the far-end playback image frame acquired at the preset sampling time. The far-end device time is used to indicate the current time of the far-end device.

[0077] An optional implementation of this embodiment is as follows: Simultaneously with initiating test video playback, the test video is transmitted to a remote device. The remote device is instructed to play the test video according to preset rules. When the remote device reaches a preset sampling time, the remote playback time of the remote playback image frame of the test video is acquired and fed back to the near-end device. The preset rules are rules pre-set for the remote device, ensuring that the remote device executes the corresponding method steps according to the preset rules after receiving the test video.

[0078] Another optional implementation of this embodiment is as follows: While initiating playback of the test video, the near-end device transmits the test video to the far-end device. Simultaneously, a test requirement is sent, instructing the far-end device to play the test video. When the far-end device reaches a preset sampling time, it acquires the far-end playback time of the far-end playback image frame of the test video and feeds it back to the near-end device. The test requirement may include a playback instruction, a preset sampling time, and a feedback instruction. The playback instruction instructs the far-end device to play the test video; the preset sampling time instructs the far-end device to acquire the far-end playback time of the far-end playback image frame of the test video at that time; and the feedback instruction controls the far-end device to feed back the far-end playback time to the near-end device.

[0079] S202, when the near-end device reaches the preset sampling time, acquire the near-end playback time of the near-end playback image frame of the test video.

[0080] The near-end device time indicates the current time of the near-end device. The near-end playback time refers to the time indicated by the near-end playback image frame acquired at the preset sampling time.

[0081] An optional implementation of this embodiment is as follows: when the near-end device reaches the preset sampling time, the near-end playback image frame of the test video is acquired, and the image frame time of the near-end playback image frame in the test video is taken as the near-end playback time.

[0082] If the test video is a time-based video (e.g., a stopwatch video), one possible implementation of this embodiment is as follows: when the near-end device reaches the preset sampling time, capture the near-end playback image frame of the time-based video, identify the timing time in the near-end playback image frame (e.g., identify the time indicated by the stopwatch in the near-end playback image frame), and use it as the near-end playback time of the near-end playback image frame.

[0083] One possible implementation for identifying timing in a near-end playback image frame is to use an image recognition algorithm to identify timing in the near-end playback image frame.

[0084] S203, determine the remote control delay between the near-end device and the far-end device based on the far-end playback time and the near-end playback time.

[0085] Optionally, in this embodiment, the time difference between the near-end playback time and the far-end playback time can be used as the remote control delay between the near-end device and the far-end device.

[0086] Optionally, in this embodiment, the remote device and the near-end device are synchronized based on a time synchronization device. The time synchronization device refers to a device used to synchronize the time between the near-end device and the remote device, such as a communication base station.

[0087] In this embodiment, one optional implementation method for providing time synchronization for both near and far devices based on a time synchronization device is as follows: A target time synchronization device whose service range simultaneously covers both the near and far devices is selected based on their location. This target time synchronization device is then used to synchronize the time of both the near and far devices, ensuring time synchronization. The time synchronization device can be a 5G communication base station.

[0088] Another optional implementation method for time synchronization between remote and near-end devices in this embodiment is as follows: Based on the location of the remote device, a corresponding remote time synchronization device is selected to provide time synchronization for the remote device. Similarly, based on the location of the near-end device, a corresponding near-end time synchronization device is selected to provide time synchronization for the near-end device, ensuring time synchronization between the near-end and remote devices. Both the remote and near-end time synchronization devices are 5G communication base stations, and the time of each base station in the 5G network remains synchronized.

[0089] It should be noted that in this embodiment, the air interface of the 5G communication base station is used to provide accurate time synchronization for near-end and far-end devices.

[0090] Optionally, in this embodiment, the near-end device and the far-end device communicate based on a target application. Specifically, the near-end device is associated with a near-end target application, and the far-end device is associated with a far-end target application. The near-end device and the far-end device communicate based on the corresponding target application. The target application can be installed on a mobile phone, computer, or other smart device, or it can be installed in the operating system of the near-end device and the far-end device.

[0091] In this embodiment, while initiating the playback of the test video, the near-end device transmits the test video to the far-end device to instruct the far-end device to play the test video. When the far-end device reaches a preset sampling time, it acquires the far-end playback time of the far-end playback image frame of the test video and feeds it back to the near-end device. Similarly, when the near-end device reaches a preset sampling time, it also acquires the near-end playback time of the near-end playback image frame of the test video. Based on the far-end playback time and the near-end playback time, the remote control delay between the near-end device and the far-end device is determined. This method can not only accurately determine the remote control delay between the near-end device and the far-end device, but also significantly improve the measurement efficiency of the remote control delay and reduce the delay measurement cost.

[0092] In one embodiment, if the preset sampling time is at least two times, such as Figure 3 As shown, one optional implementation of S203 includes:

[0093] S301, if there are at least two preset sampling times, then the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time.

[0094] If the time of the near-end device and the far-end device are kept synchronized, one optional implementation of this embodiment is to determine the remote control delay corresponding to each preset sampling time based on the time difference between the near-end playback time and the far-end playback time corresponding to each preset sampling time.

[0095] If the near-end device time and the far-end device time are inaccurate, i.e., the near-end device and the far-end device are out of sync, another optional implementation method in this embodiment is: determine the playback delay for each sampling time based on the far-end playback time and the near-end playback time corresponding to each preset sampling time; determine the device time delay for each sampling time based on the near-end device time and the far-end device time corresponding to each sampling time; and determine the remote control delay for each preset sampling time based on the playback delay and the device time delay. In this embodiment, the playback delay for each sampling time can be determined based on the time difference between the far-end playback time and the near-end playback time corresponding to each preset sampling time. In this embodiment, the device time delay for each sampling time can be determined based on the time difference between the near-end device time and the far-end device time corresponding to each sampling time. When the near-end device time of the near-end device is faster than the far-end device time of the far-end device, the remote control delay for each preset sampling time can be obtained by summing the playback delay and the device time delay for each sampling time. When the near-end device's time is slower than the far-end device's time, the remote control delay corresponding to each preset sampling time can be obtained by calculating the difference between the playback delay and the device time delay corresponding to each sampling time.

[0096] S302, determine the remote control delay between the near-end device and the far-end device based on the remote control delay corresponding to each preset sampling time.

[0097] Optionally, this embodiment can determine the average delay of the remote control delay corresponding to each preset sampling time based on the remote control delay corresponding to each preset sampling time, and use the average delay as the remote control delay between the near-end device and the far-end device.

[0098] In this embodiment, if there are at least two preset sampling times, the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time. Based on the remote control delay corresponding to each preset sampling time, the remote control delay between the near device and the remote device can be determined more accurately.

[0099] In one embodiment, Figure 4 This is a flowchart illustrating a time delay measurement method according to an embodiment of this application, applied to... Figure 1 Taking a remote device as an example, the method includes the following steps:

[0100] S401 receives test videos transmitted from nearby devices and plays the test videos.

[0101] S402: When the remote device reaches the preset sampling time, acquire the remote playback time of the remote playback image frame of the test video.

[0102] An optional implementation of this embodiment is as follows: when the remote device reaches the preset sampling time, the remote playback image frame of the test video is acquired, and the image frame time of the remote playback image frame in the test video is taken as the remote playback time.

[0103] If the test video is a time-based video (e.g., a stopwatch video), another optional implementation of this embodiment is: when the time of the remote device reaches the preset sampling time, capture the remote playback image frame of the time-based video, identify the timing time in the remote playback image frame (e.g., identify the time indicated by the stopwatch in the near playback image frame), and use it as the remote playback time of the remote playback image frame.

[0104] In this embodiment, an optional implementation method for identifying the timing in the remote playback image frame is: using an image recognition algorithm to identify the timing in the remote playback image frame.

[0105] S403 feeds back the remote playback time to the near-end device, instructing the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0106] Optionally, in this embodiment, the remote device and the near device are synchronized based on a time synchronization device.

[0107] It should be noted that the method for providing time synchronization between remote and near devices based on the time synchronization device is described in detail in the above embodiments, and will not be repeated here.

[0108] Optionally, in this embodiment, the near-end device and the far-end device communicate based on a target application.

[0109] It should be noted that the specific implementation of the communication between the near-end device and the far-end device based on the target application is described in detail in the above embodiments and will not be repeated here.

[0110] In this embodiment, the remote device receives the test video transmitted by the near-end device and plays the test video. When the remote device reaches the preset sampling time, it obtains the remote playback time of the remote playback image frame of the test video and feeds back the remote playback time to the near-end device. This is used to instruct the near-end device to quickly and accurately determine the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time.

[0111] Receiving test video transmitted from a near-end device. In one embodiment, such as... Figure 5 As shown, an optional implementation of a time delay measurement method includes:

[0112] S501: While the near-end device starts playing the time-tracking video, it also transmits the time-tracking video to the far-end device. The near-end and far-end devices synchronize their time based on a time synchronization device; they communicate based on the target application.

[0113] S502: The remote device receives the timing video transmitted from the near-end device and plays the timing video.

[0114] S503: When the remote device reaches the preset sampling time, the remote device captures the remote playback image frame of the time-counting video.

[0115] S504, the remote device identifies the timing in the remote playback image frame and uses it as the remote playback time of the remote playback image frame.

[0116] S505: The remote device sends the playback time from the remote device back to the near device.

[0117] S506, when the near-end device reaches the preset sampling time, the near-end device captures the near-end playback image frame of the time-counting video.

[0118] S507, the near-end device identifies the timing in the near-end playback image frame and uses it as the near-end playback time of the near-end playback image frame.

[0119] S508, if the preset sampling time is at least two times, the near-end device determines the remote control delay corresponding to each preset sampling time based on the remote playback time and the near-end playback time corresponding to each preset sampling time;

[0120] S509 determines the remote control delay between the near-end device and the far-end device based on the remote control delay corresponding to each preset sampling time.

[0121] In this embodiment, while initiating the playback of the test video, the near-end device transmits the test video to the far-end device to instruct the far-end device to play the test video. When the far-end device reaches a preset sampling time, it acquires the far-end playback time of the far-end playback image frame of the test video and feeds it back to the near-end device. Similarly, when the near-end device reaches a preset sampling time, it also acquires the near-end playback time of the near-end playback image frame of the test video. Based on the far-end playback time and the near-end playback time, the remote control delay between the near-end device and the far-end device is determined. This method can not only accurately determine the remote control delay between the near-end device and the far-end device, but also significantly improve the measurement efficiency of the remote control delay and reduce the delay measurement cost.

[0122] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0123] Based on the same inventive concept, this application also provides a time delay measurement device for implementing the time delay measurement method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more time delay measurement device embodiments provided below can be found in the limitations of the time delay measurement method described above, and will not be repeated here.

[0124] In one embodiment, by Figure 6 A structural block diagram of a time delay measurement device in one embodiment is shown. Figure 6 As shown, a time delay measurement device 1 is provided, which includes: a first acquisition module 11, a second acquisition module 12, and a first time delay measurement module 13, wherein:

[0125] The first acquisition module 11 is used to transmit the test video to the remote device while starting the playback of the test video, to instruct the remote device to play the test video, and to acquire the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time, and to feed back the remote playback time to the near device.

[0126] The second acquisition module 12 is used to acquire the near-end playback time of the near-end playback image frame of the test video when the near-end device reaches the preset sampling time.

[0127] The first delay measurement module 13 is used to determine the remote control delay between the near-end device and the far-end device based on the far-end playback time and the near-end playback time.

[0128] In one embodiment, the upper Figure 6 The second acquisition module 12 further includes:

[0129] The first segmentation unit is used to segment the near-end playback image frame of the time-time video when the near-end device reaches the preset sampling time if the test video is a time-time video.

[0130] The first recognition unit is used to recognize the timing in the near-end playback image frame as the near-end playback time of the near-end playback image frame.

[0131] In one embodiment, the upper Figure 6 The first delay measurement module 13 further includes:

[0132] The first determining unit is used to determine the remote control delay corresponding to each preset sampling time based on the remote playback time and the near playback time corresponding to each preset sampling time if there are at least two preset sampling times.

[0133] The second determining unit is used to determine the remote control delay between the near-end device and the far-end device based on the remote control delay corresponding to each preset sampling time.

[0134] In one embodiment, the first determining unit in the above embodiment is further specifically used to: determine the playback delay of each sampling time based on the remote playback time and the near playback time corresponding to each preset sampling time; determine the device time delay corresponding to each sampling time based on the near device time and the remote device time corresponding to each sampling time; and determine the remote control delay corresponding to each preset sampling time based on the playback delay and the device time delay corresponding to each sampling time.

[0135] In one embodiment, the upper Figure 6 The time delay measurement device in the middle also includes:

[0136] The first time synchronization module synchronizes remote and near devices based on time synchronization equipment.

[0137] In one embodiment, the upper Figure 6 The time delay measurement device in the middle also includes:

[0138] The first communication module is used for communication between near-end devices and remote devices based on a target application.

[0139] In one embodiment, by Figure 7 A structural block diagram of a time delay measurement device in one embodiment is shown. Figure 7 As shown, a time delay measurement device 2 is provided, which includes: a first acquisition module 21, a second acquisition module 22, and a first time delay measurement module 23, wherein:

[0140] The receiving module 21 is used to receive test videos transmitted from the near-end device and play the test videos.

[0141] The third acquisition module 22 is used to acquire the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time.

[0142] The second delay measurement module 23 is used to feed back the remote playback time to the near-end device, and to instruct the near-end device to determine the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time; wherein, the near-end playback time is obtained by the near-end device when the near-end device time reaches the preset sampling time.

[0143] In one embodiment, the upper Figure 7 The third acquisition module 22 further includes:

[0144] The second capture unit is used to capture the remote playback image frame of the time-time video when the remote device reaches the preset sampling time if the test video is a time-time video.

[0145] The second recognition unit is used to recognize the timing in the remote playback image frame as the remote playback time of the remote playback image frame.

[0146] In one embodiment, the upper Figure 7 The time delay measurement device in the middle also includes:

[0147] The second time synchronization module is used to enable remote and near devices to synchronize time based on time synchronization devices.

[0148] In one embodiment, the upper Figure 7 The time delay measurement device in the middle also includes:

[0149] The second communication module is used for communication between near-end devices and remote devices based on the target application.

[0150] Each module in the aforementioned time delay measurement device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0151] In one embodiment, a computer device is provided, which may be a platform-side device, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database stores device compartment information. The network interface communicates with an external user via a network connection. When executed by the processor, the computer program implements a latency measurement method.

[0152] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specifically, the computer device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0153] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0154] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0155] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0156] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0157] In one embodiment, when the processor executes the computer program, it further performs the following steps: when the near-end device time reaches a preset sampling time, acquiring the near-end playback time of the near-end playback image frame of the test video, including:

[0158] If the test video is a timed video, then when the near-end device reaches the preset sampling time, the near-end playback image frame of the timed video is captured;

[0159] Identify the timing in the near-end playback image frame and use it as the near-end playback time of the near-end playback image frame.

[0160] In one embodiment, when the processor executes the computer program, it further performs the following steps: determining the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time, including:

[0161] If there are at least two preset sampling times, then the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time.

[0162] The remote control delay between the near-end device and the far-end device is determined based on the remote control delay corresponding to each preset sampling time.

[0163] In one embodiment, when the processor executes the computer program, it further performs the following steps: determining the remote control delay corresponding to each preset sampling time based on the far-end playback time and the near-end playback time corresponding to each preset sampling time, including:

[0164] Based on the far-end playback time and near-end playback time corresponding to each preset sampling time, determine the playback delay for each sampling time;

[0165] Based on the near-end device time and far-end device time corresponding to each sampling time, determine the device time delay corresponding to each sampling time;

[0166] Based on the playback delay and device time delay corresponding to each sampling moment, the remote control delay corresponding to each preset sampling moment is determined.

[0167] In one embodiment, when the processor executes the computer program, it also performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0168] In one embodiment, when the processor executes a computer program, it also performs the following steps: the near-end device and the far-end device communicate based on a target application.

[0169] In one embodiment, another computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0170] Receive test videos transmitted from nearby devices and play the test videos;

[0171] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0172] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0173] In one embodiment, when the processor executes the computer program, it further performs the following steps: when the remote device reaches a preset sampling time, acquiring the remote playback time of the remote playback image frame of the test video, including:

[0174] If the test video is a timed video, then when the remote device reaches the preset sampling time, capture the remote playback image frame of the timed video;

[0175] Identify the timing in the remote playback image frame and use it as the remote playback time of the remote playback image frame.

[0176] In one embodiment, when the processor executes the computer program, it also performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0177] In one embodiment, when the processor executes a computer program, it also performs the following steps: the near-end device and the far-end device communicate based on a target application.

[0178] The principles and specific processes of the computer equipment provided above in implementing the various embodiments can be found in the description of the time delay measurement method in the foregoing embodiments, and will not be repeated here.

[0179] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0180] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0181] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0182] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0183] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: when the near-end device time reaches a preset sampling time, acquiring the near-end playback time of the near-end playback image frame of the test video, including:

[0184] If the test video is a timed video, then when the near-end device reaches the preset sampling time, the near-end playback image frame of the timed video is captured;

[0185] Identify the timing in the near-end playback image frame and use it as the near-end playback time of the near-end playback image frame.

[0186] In one embodiment, when the computer program is executed by a processor, it further performs the following steps: determining the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time, including:

[0187] If there are at least two preset sampling times, then the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time.

[0188] The remote control delay between the near-end device and the far-end device is determined based on the remote control delay corresponding to each preset sampling time.

[0189] In one embodiment, when the computer program is executed by a processor, it further performs the following steps: determining the remote control delay corresponding to each preset sampling time based on the far-end playback time and the near-end playback time corresponding to each preset sampling time, including:

[0190] Based on the far-end playback time and near-end playback time corresponding to each preset sampling time, determine the playback delay for each sampling time;

[0191] Based on the near-end device time and far-end device time corresponding to each sampling time, determine the device time delay corresponding to each sampling time;

[0192] Based on the playback delay and device time delay corresponding to each sampling moment, the remote control delay corresponding to each preset sampling moment is determined.

[0193] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0194] In one embodiment, when the computer program is executed by the processor, it also performs the following steps: the near-end device and the far-end device communicate based on the target application.

[0195] In one embodiment, another computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, performs the following steps:

[0196] Receive test videos transmitted from nearby devices and play the test videos;

[0197] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0198] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0199] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: when the remote device reaches a preset sampling time, acquiring the remote playback time of the remote playback image frame of the test video, including:

[0200] If the test video is a timed video, then when the remote device reaches the preset sampling time, capture the remote playback image frame of the timed video;

[0201] Identify the timing in the remote playback image frame and use it as the remote playback time of the remote playback image frame.

[0202] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0203] In one embodiment, when the computer program is executed by the processor, it also performs the following steps: the near-end device and the far-end device communicate based on the target application.

[0204] The principles and specific processes of the computer-readable storage medium provided above in implementing the various embodiments can be found in the description of the time delay measurement method embodiments in the foregoing embodiments, and will not be repeated here.

[0205] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0206] While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device.

[0207] When the near-end device reaches the preset sampling time, the near-end playback time of the test video's near-end playback image frame is obtained;

[0208] The remote control latency between the near-end device and the far-end device is determined based on the remote playback time and the near-end playback time.

[0209] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: when the near-end device time reaches a preset sampling time, acquiring the near-end playback time of the near-end playback image frame of the test video, including:

[0210] If the test video is a timed video, then when the near-end device reaches the preset sampling time, the near-end playback image frame of the timed video is captured;

[0211] Identify the timing in the near-end playback image frame and use it as the near-end playback time of the near-end playback image frame.

[0212] In one embodiment, when the computer program is executed by a processor, it further performs the following steps: determining the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time, including:

[0213] If there are at least two preset sampling times, then the remote control delay corresponding to each preset sampling time is determined based on the remote playback time and the near playback time corresponding to each preset sampling time.

[0214] The remote control delay between the near-end device and the far-end device is determined based on the remote control delay corresponding to each preset sampling time.

[0215] In one embodiment, when the computer program is executed by a processor, it further performs the following steps: determining the remote control delay corresponding to each preset sampling time based on the far-end playback time and the near-end playback time corresponding to each preset sampling time, including:

[0216] Based on the far-end playback time and near-end playback time corresponding to each preset sampling time, determine the playback delay for each sampling time;

[0217] Based on the near-end device time and far-end device time corresponding to each sampling time, determine the device time delay corresponding to each sampling time;

[0218] Based on the playback delay and device time delay corresponding to each sampling moment, the remote control delay corresponding to each preset sampling moment is determined.

[0219] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0220] In one embodiment, when the computer program is executed by the processor, it also performs the following steps: the near-end device and the far-end device communicate based on the target application.

[0221] In one embodiment, another computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0222] Receive test videos transmitted from nearby devices and play the test videos;

[0223] When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained.

[0224] The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control latency between the near-end device and the remote device based on the remote playback time and the near-end playback time. The near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches the preset sampling time.

[0225] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: when the remote device reaches a preset sampling time, acquiring the remote playback time of the remote playback image frame of the test video, including:

[0226] If the test video is a timed video, then when the remote device reaches the preset sampling time, capture the remote playback image frame of the timed video;

[0227] Identify the timing in the remote playback image frame and use it as the remote playback time of the remote playback image frame.

[0228] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: the remote device and the near device synchronize time based on the time synchronization device.

[0229] In one embodiment, when the computer program is executed by the processor, it also performs the following steps: the near-end device and the far-end device communicate based on the target application.

[0230] The principles and specific processes of implementing the computer program products provided above can be found in the description of the time delay measurement method in the foregoing embodiments, and will not be repeated here.

[0231] It should be noted that the data involved in this application (including but not limited to data in the time delay measurement process) are all data that have been fully authorized by all parties, and the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0232] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0233] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0234] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A time delay measurement method, characterized in that, Applied to near-end devices, the method includes: While starting to play the test video, the test video is transmitted to the remote device to instruct the remote device to play the test video. When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained and the remote playback time is fed back to the near device. When the near-end device reaches the preset sampling time, the near-end playback time of the near-end playback image frame of the test video is obtained; If the preset sampling time is at least two times, and the near-end device and the far-end device do not perform time synchronization, then the playback delay for each sampling time is determined based on the far-end playback time and the near-end playback time corresponding to each preset sampling time; the device time delay for each sampling time is determined based on the near-end device time and the far-end device time corresponding to each sampling time; and the remote control delay for each preset sampling time is determined based on the playback delay and the device time delay corresponding to each sampling time. The remote control delay between the near-end device and the far-end device is determined based on the remote control delay corresponding to each preset sampling time.

2. The method according to claim 1, characterized in that, The step of acquiring the near-end playback time of the near-end playback image frame of the test video when the near-end device reaches the preset sampling time includes: If the test video is a time-based video, then when the near-end device reaches the preset sampling time, the near-end playback image frame of the time-based video is captured; The timing in the near-end playback image frame is identified and used as the near-end playback time of the near-end playback image frame.

3. The method according to claim 1, characterized in that, The step of determining the playback delay for each sampling moment based on the far-end playback moment and the near-end playback moment corresponding to each preset sampling moment includes: The playback delay for each sampling moment is determined based on the time difference between the far-end playback moment and the near-end playback moment corresponding to each preset sampling moment.

4. The method according to claim 1, characterized in that, The step of determining the remote control delay corresponding to each preset sampling time based on the playback delay and the device time delay corresponding to each sampling time includes: When the near-end device time is faster than the far-end device time, the playback delay and device time delay corresponding to each sampling time are summed to obtain the remote control delay corresponding to each preset sampling time.

5. The method according to claim 1, characterized in that: The remote and near devices synchronize time based on a time synchronization device.

6. The method according to any one of claims 1-5, characterized in that, The near-end device and the far-end device communicate based on the target application.

7. A time delay measurement method, characterized in that, Applied to remote devices, the method includes: Receive test videos transmitted from near-end devices and play the test videos; When the remote device reaches the preset sampling time, the remote playback time of the remote playback image frame of the test video is obtained; The remote playback time is fed back to the near-end device to instruct the near-end device to determine the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time; wherein, the near-end playback time is the playback time corresponding to the near-end playback image frame of the test video acquired by the near-end device when the near-end device time reaches a preset sampling time; the step of determining the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time includes: if the preset sampling time is at least two times, and at the near-end device... If the device and the remote device do not perform time synchronization, then the playback delay for each sampling moment is determined based on the remote playback moment and the near-end playback moment corresponding to each preset sampling moment; the device time delay for each sampling moment is determined based on the near-end device moment and the remote device moment corresponding to each sampling moment; the remote control delay for each preset sampling moment is determined based on the playback delay and the device time delay corresponding to each sampling moment; and the remote control delay between the near-end device and the remote device is determined based on the remote control delay for each preset sampling moment.

8. The method according to claim 7, characterized in that, The step of acquiring the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time includes: If the test video is a time-based video, then when the remote device reaches the preset sampling time, the remote playback image frame of the time-based video is captured. Identify the timing in the remote playback image frame and use it as the remote playback time of the remote playback image frame.

9. The method according to claim 7, characterized in that: The remote and near devices synchronize time based on a time synchronization device.

10. The method according to any one of claims 7-9, characterized in that, The near-end device and the far-end device communicate based on the target application.

11. A time delay measurement device, characterized in that, Applied to near-end devices, including: The first acquisition module is used to transmit the test video to a remote device while starting the playback of the test video, and to instruct the remote device to play the test video. When the remote device reaches a preset sampling time, the module acquires the remote playback time of the remote playback image frame of the test video and feeds back the remote playback time to the near device. The second acquisition module is used to acquire the near-end playback time of the near-end playback image frame of the test video when the near-end device reaches the preset sampling time. The first delay measurement module is configured to, if the preset sampling time is at least two times and the near-end device and the far-end device have not performed time synchronization, determine the playback delay of each sampling time based on the far-end playback time and the near-end playback time corresponding to each preset sampling time; determine the device time delay corresponding to each sampling time based on the near-end device time and the far-end device time corresponding to each sampling time; determine the remote control delay corresponding to each preset sampling time based on the playback delay and the device time delay corresponding to each sampling time; and determine the remote control delay between the near-end device and the far-end device based on the remote control delay corresponding to each preset sampling time.

12. A time delay measurement device, characterized in that, Applied to remote devices, including: A receiving module is used to receive test videos transmitted from near-end devices and play the test videos; The third acquisition module is used to acquire the remote playback time of the remote playback image frame of the test video when the remote device reaches the preset sampling time. The second delay measurement module is used to feed back the remote playback time to the near-end device, and to instruct the near-end device to determine the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time; wherein, the near-end playback time is obtained by the near-end device when the near-end device time reaches a preset sampling time; determining the remote control delay between the near-end device and the remote device based on the remote playback time and the near-end playback time includes: if the preset sampling time is at least two times, and the near-end device and the remote device do not perform time synchronization, then determining the playback delay of each sampling time based on the remote playback time and the near-end playback time corresponding to each preset sampling time; determining the device time delay corresponding to each sampling time based on the near-end device time and the remote device time corresponding to each sampling time; determining the remote control delay corresponding to each preset sampling time based on the playback delay and the device time delay corresponding to each sampling time; and determining the remote control delay between the near-end device and the remote device based on the remote control delay corresponding to each preset sampling time.

13. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 10.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 10.

15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 10.

Images