Delay testing method and apparatus, computer device and storage medium

By automatically screenshotting and processing of preset clock video screenshot data sets between the master and slave devices, and performing delay calculations, the problem of manual measurement delay in the prior art is solved, and the delay of MR service is improved Test accuracy.

WO2025035859A1PCT designated stage expired Publication Date: 2025-02-20CHINA TELECOM CORP LTD TECHNOLOGY INNOVATION CENTER +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/093101
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-08-11
Filing Date
2024-05-14
Publication Date
2025-02-20

AI Technical Summary

Technical Problem

In the prior art, the method of manually performing delay test by testers has low accuracy, resulting in low accuracy of MR service delay test.

Method used

Provide a delay test method to automatically and accurately measure the MR service by processing screenshot data sets of preset clock videos according to preset time periods between the master and slave devices and performing delay calculations. Delay.

Benefits of technology

It improves the accuracy of MR service delay testing, reduces the error caused by manual measurement, and achieves higher test accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024093101_20022025_PF_FP_ABST
    Figure CN2024093101_20022025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to a delay testing method and apparatus, a computer device, a storage medium and a computer program product. The method comprises: performing screenshot processing on a preset clock video according to a first preset time period, so as to obtain a first screenshot data set; receiving a second screenshot data set sent by a slave control device, wherein the second screenshot data set comprises screenshot data of the preset clock video that is captured by the slave control device according to a second preset time period; and performing delay calculation on the basis of the first screenshot data set and the second screenshot data set, so as to obtain a target delay result. The present method can improve the accuracy of delay testing.
Need to check novelty before this filing date? Find Prior Art

Description

Delay testing method, device, computer equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 11, 2023, with application number 202311014045X, and application name “Time Delay Testing Method, Device, Computer Equipment and Storage Medium”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of mobile communication technology, and in particular to a delay testing method, apparatus, computer equipment, storage medium, and computer program product. Background Art

[0003] With the development of 5G networks and communications technologies, MR (Mixed Reality) technology has emerged. MR technology can seamlessly integrate the virtual and real worlds. Before MR technology is applied, latency testing of MR services is required.

[0004] Traditionally, latency calculations are performed manually by testers. Specifically, for end-to-end (master-to-slave) MR services, an MR camera alignment clock is established. Then, the master and slave devices are placed in the same location, and a third-party device captures the video footage of the master and slave devices. The time difference between the clocks in the video footage is manually calculated to determine the MR service latency.

[0005] However, the current method of manually performing delay testing by testers has a low accuracy in manual measurement, resulting in a low error in the delay test of the MR service and a low accuracy in the obtained MR service delay.

[0006] Summary of the Invention

[0007] Based on this, it is necessary to provide a delay testing method, apparatus, computer equipment, computer-readable storage medium and computer program product to address the above technical issues.

[0008] In a first aspect, the present application provides a method for delay testing. The method comprises:

[0009] Taking screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0010] receiving a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0011] A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0012] In one embodiment, before taking screenshots of the preset clock video according to the preset time period to obtain the first screenshot data set, the method further includes:

[0013] Starting a master control test program, and instructing a slave control device to start a slave control test program through the master control test program;

[0014] Performing a status detection on the running status of the master control test program, and when the status detection result indicates that the master control test program is running normally, performing a synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result;

[0015] When the synchronization detection result does not meet the test condition, time calibration is performed on the master control test program and the slave control test program.

[0016] In one embodiment, performing synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result includes:

[0017] Acquire a first current time of the local master control test program, and send a synchronization instruction to the slave control test program in the slave control device;

[0018] receiving a confirmation instruction fed back by the slave control device, the confirmation instruction carrying a second current time of the slave control test program obtained in response to the synchronization instruction;

[0019] The synchronization detection result is determined according to the first current time and the second current time of the slave control test program in the confirmation instruction.

[0020] In one embodiment, the first screenshot data set includes a first screenshot time and a first image recognition result, and the screenshot processing of the preset clock video according to the first preset time period to obtain the first screenshot data set includes:

[0021] In a first preset time period, a screenshot is performed on the preset clock video to obtain a first screenshot image and the first screenshot time;

[0022] Perform image recognition on the first screenshot image to obtain the first image recognition result.

[0023] In one embodiment, performing image recognition on the first screenshot image to obtain the first image recognition result includes:

[0024] Performing image recognition on the first screenshot image, and obtaining the first image recognition result when the image recognition is successful;

[0025] When image recognition fails, the current number of failures is counted, and when the current number of failures meets the preset failure threshold, an alarm prompt message is sent.

[0026] In one embodiment, the second screenshot dataset includes a second screenshot time and a second image recognition result; and performing delay calculation based on the first screenshot dataset and the second screenshot dataset to obtain a target delay result includes:

[0027] For each first image recognition result in the first image data set, determining, among the second image recognition results, a second image recognition result that matches the first image recognition result;

[0028] Determining the first screenshot time of the first image recognition result and the second screenshot time of the second image recognition result corresponding to the first image recognition result;

[0029] Calculating a first time delay result according to the first screenshot time and the second screenshot time;

[0030] A target delay result is determined according to each of the first delay results.

[0031] In a second aspect, the present application further provides a delay testing device. The device comprises:

[0032] A screenshot module, configured to take screenshots of a preset clock video according to a first preset time period to obtain a first screenshot data set;

[0033] a receiving module, configured to receive a second screenshot data set sent by a slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0034] a calculation module, configured to perform delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result;

[0035] In one embodiment, the delay testing device further includes:

[0036] A startup module, configured to start a master test program and instruct a slave device to start a slave test program through the master test program;

[0037] a detection module, configured to perform a status detection on the running status of the master control test program, and when the status detection result indicates that the master control test program is running normally, perform a synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result;

[0038] The calibration module is used to perform time calibration on the master control test program and the slave control test program when the synchronization detection result does not meet the test condition.

[0039] In one embodiment, the detection module is specifically configured to:

[0040] Acquire a first current time of the local master control test program, and send a synchronization instruction to the slave control test program in the slave control device;

[0041] receiving a confirmation instruction fed back by the slave control device, the confirmation instruction carrying a second current time of the slave control test program obtained in response to the synchronization instruction;

[0042] The synchronization detection result is determined according to the first current time and the second current time of the slave control test program in the confirmation instruction.

[0043] In one embodiment, the screenshot module is specifically used to:

[0044] In a first preset time period, a screenshot is performed on the preset clock video to obtain a first screenshot image and the first screenshot time;

[0045] Perform image recognition on the first screenshot image to obtain the first image recognition result.

[0046] In one embodiment, the screenshot module is specifically used to:

[0047] Performing image recognition on the first screenshot image, and obtaining the first image recognition result when the image recognition is successful;

[0048] When image recognition fails, the current number of failures is counted, and when the current number of failures meets the preset failure threshold, an alarm prompt message is sent.

[0049] In one embodiment, the calculation module is specifically configured to:

[0050] For each first image recognition result in the first image data set, determining, among the second image recognition results, a second image recognition result that matches the first image recognition result;

[0051] Determining the first screenshot time of the first image recognition result and the second screenshot time of the second image recognition result corresponding to the first image recognition result;

[0052] Calculating a first time delay result according to the first screenshot time and the second screenshot time;

[0053] A target delay result is determined according to each of the first delay results.

[0054] In a third aspect, the present application also provides a time delay test system. The system includes:

[0055] The master control device is configured to perform screenshot processing on a preset clock video according to a first preset time period to obtain a first screenshot data set; receive a second screenshot data set sent by a slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to the second preset time period; and perform delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result;

[0056] The slave control device is configured to perform screenshot processing on the preset clock video of the slave control device according to a second preset time period to obtain a second screenshot data set, and send the second screenshot data set to the master control device.

[0057] In a fourth aspect, the present application further provides a computer device. The computer device includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0058] Taking screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0059] receiving a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0060] A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0061] In a fifth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the following steps:

[0062] Taking screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0063] receiving a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0064] A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0065] In a sixth aspect, the present application further provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the following steps:

[0066] Taking screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0067] receiving a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0068] A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0069] The above-mentioned delay testing method, apparatus, computer equipment, storage medium and computer program product, through a test program, processes a screenshot of the preset clock video of the master control device according to a preset time period to obtain a first screenshot data set, and performs delay calculation on the first screenshot data set and the second screenshot data set to obtain a target delay result, wherein the second screenshot data set is obtained by processing the screenshot of the preset clock video by the slave control device. Utilizing the first screenshot data set and the second screenshot data set, service perception collection and statistics based on the user plane can be achieved, avoiding the influence of errors in proprietary protocols and manual measurements, thereby improving the accuracy of delay testing in MR services. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] FIG1 is a diagram illustrating an application environment of a delay testing method according to an embodiment;

[0071] FIG2 is a schematic flow chart of a delay testing method according to an embodiment;

[0072] FIG3 is a flow chart showing the steps of detecting and calibrating the master control test program before delay testing in one embodiment;

[0073] FIG4 is a flow chart of a method for synchronizing a master control test program according to one embodiment;

[0074] FIG5 is a schematic flow chart of a method for obtaining a first image recognition result in one embodiment;

[0075] FIG6 is a flow chart illustrating steps for processing different image recognition situations in one embodiment;

[0076] FIG7 is a flow chart of a method for calculating a target delay result according to an embodiment;

[0077] FIG8 is a block diagram of a delay test device according to an embodiment;

[0078] FIG9 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0079] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0080] The delay testing method provided in the embodiment of the present application can be applied to the application environment shown in Figure 1. The master device 102 communicates with the slave device 104 through the network. The data storage system can store the data that the master device 102 needs to process. The data storage system can be integrated on the master device 102, or it can be placed on the cloud or other network servers. The master device 102 takes a screenshot of the preset clock video according to a first preset time period to obtain a first screenshot data set; the master device 102 receives a second screenshot data set sent by the slave device 104; the second screenshot data set includes the screenshot data of the preset clock video captured by the slave device according to the second preset time period; the master device 102 performs delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result. The master device 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices, etc. connected to portable wearable devices. The portable wearable device can be a head-mounted device, etc. The slave device 104 may be, but is not limited to, any personal computer, laptop, smart phone, tablet computer, IoT device, etc. that establishes an MR service connection with the master device 102. In addition, the slave device 104 may also be an application associated with the master device 102.

[0081] In one embodiment, as shown in FIG2 , a method for delay testing is provided. The method is described by taking the application of the method to the master control device in FIG1 as an example, including the following steps:

[0082] Step 202 : performing screenshot processing on the preset clock video according to a first preset time period to obtain a first screenshot data set.

[0083] In an embodiment of the present application, a master device includes a viewing device and a capture device. Both the master device and the slave device include a test app (application) for testing latency. The test app includes a preset clock video that can be captured by the master device. Specifically, the master device's viewing device is aligned with the preset clock video to capture a sufficiently clear clock screenshot that can display the clock reading during recording. The clock in the test app is a millisecond-level clock that meets accuracy requirements, for example, a millisecond-level stopwatch that can display Greenwich Mean Time or a millisecond-level clock that can display Beijing Time.

[0084] During the implementation of this embodiment, the master device establishes an end-to-end MR service connection with the slave device and sets a first preset time period. Then, the master device loads the preset clock video in the test APP and, based on the timer in the test APP, takes a screenshot of the dynamic preset clock video according to the set first preset time period. That is, after the first preset time period, the timer triggers the screenshot tool in the test APP to take a screenshot of the preset clock video of the current first preset time period and save the screenshot image to a designated location of the master device. A first screenshot data set is then formed using the screenshot images taken during multiple first preset time periods. When the screenshot images are saved, information about each screenshot image is recorded, such as the screenshot image's sequence number, the screenshot image's timestamp, and the screenshot image's path address.

[0085] Step 204: Receive a second screenshot data set sent by the slave control device.

[0086] The second screenshot data set includes screenshot data of a preset clock video captured by the control device according to a second preset time period.

[0087] In this embodiment of the present application, the second preset time period can be significantly less than the MR latency, thereby ensuring that the slave device collects the second screenshot dataset at a sufficiently high frequency. In one embodiment, the second preset time period can be less than the first preset time period to ensure that the second screenshot dataset contains screenshot images that match each screenshot image in the first screenshot dataset.

[0088] During the implementation of this embodiment, the slave device collects the preset clock video in the test APP through the test APP and the second preset time period according to the same principle as the master device collects the first screenshot data set, obtains the second screenshot data set collected in the slave device, and sends the second screenshot data set to the master device. Then, the master device receives the second screenshot data set sent by the slave device to perform a delay test on the MR service based on the second screenshot data set and the first screenshot data set.

[0089] Step 206 : performing delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0090] In an embodiment of the present application, the master control device obtains the target delay result by calculating the end-to-end delay of the MR service between the matching screenshot images based on the first screenshot data set collected by the test APP and the matching screenshot images in the second screenshot data set collected by the test APP in the slave control device.

[0091] In the above-mentioned delay test method, the clock video of the master device is screenshoted and processed according to a preset time period through the test program to obtain a first screenshot data set, and the first screenshot data set and the second screenshot data set are used for delay calculation to obtain the target delay result, wherein the second screenshot data set is obtained by the slave device taking a screenshot of the preset clock video. The delay calculation is performed using the test program and the slave test program, which can be based on the collection and statistics of service perception on the user side, avoiding the influence of errors in private protocols and manual measurements, thereby improving the accuracy of delay testing in MR services.

[0092] In one embodiment, as shown in FIG3 , in step 202 , before taking screenshots of a preset clock video according to a preset time period to obtain a first screenshot data set, the method further includes:

[0093] Step 302: Start the master control test program, and instruct the slave control device to start the slave control test program through the master control test program.

[0094] In an embodiment of the present application, the master device and the slave device are paired, and the test configuration in the master device includes configuration information of the test app in the slave device. Therefore, when the master device starts the master test program, the master device can simultaneously send an instruction to start the slave test program to the test app in the slave device, thereby instructing the slave device to start the slave test program. The master device and the test app in the slave device can be connected via a network, and the master and slave devices can simultaneously start the master test program and the slave test program through the test app.

[0095] Step 304 , performing a status detection on the running status of the master test program. If the status detection result indicates that the master test program is running normally, performing a synchronization detection on the master test program and the slave test program to obtain a synchronization detection result.

[0096] In an embodiment of the present application, the test APP in the master control device performs a status check on the running status of the master control test program based on the test conditions of the MR delay test, such as checking whether the master control test program is being executed, whether there are any exceptions or errors, and whether the time between the master control device and the slave control device is synchronized. When the status check result can prove that the master control test program is in normal operation, the master control test program and the slave control test program are synchronized. For example, the master control test program sends a synchronization command or request to the slave control test program. After receiving the synchronization command, the slave control test program performs a time synchronization operation and sends a response to the master control test program. After receiving the response, the master control test program determines the synchronization detection result according to the response signal.

[0097] Step 306: When the synchronization detection result does not meet the test condition, time calibration is performed on the master control test program and the slave control test program.

[0098] In an embodiment of the present application, when the test environment does not meet the test conditions, that is, the synchronization detection result shows that the master device and the slave device are not synchronized, the master device performs an abnormal restart, and re-performs time calibration and synchronization operations on the master test program and the slave test program to ensure that the test environment meets the test conditions.

[0099] In this embodiment, by performing synchronization detection on the master test program and the slave test program, a synchronization detection result can be obtained for judging the synchronization performance between the master test program and the slave test program, thereby preventing errors in the MR service delay test caused by the lack of synchronization between the master test program and the slave test program.

[0100] In one embodiment, as shown in FIG4 , step 304 , performing synchronization detection on the master test program and the slave test program to obtain a synchronization detection result includes:

[0101] Step 402: Obtain a first current time of the local master control test program, and send a synchronization instruction to the slave control test program in the slave control device.

[0102] In an embodiment of the present application, the master device obtains a first current time of a local master test program of the master device and creates a synchronization instruction containing synchronization information. The synchronization instruction may include an instruction instructing the slave device to obtain a second current time in the slave test program. The master device then sends the synchronization instruction to the slave test program of the slave device.

[0103] Step 404: Receive a confirmation instruction fed back by the slave control device.

[0104] The confirmation instruction carries the second current time of the slave control test program obtained in response to the synchronization instruction.

[0105] In an embodiment of the present application, when a slave device receives a synchronization instruction containing synchronization information, the slave test program obtains the second current time in the slave test program based on the synchronization information in the synchronization instruction, and creates a confirmation instruction based on the second current time. The slave device then feeds the confirmation instruction back to the master device. The master device receives the confirmation instruction fed back by the slave device and obtains the second current time carried in the confirmation instruction.

[0106] Step 406 : Determine a synchronization detection result based on the first current time and the second current time of the slave control test program in the confirmation instruction.

[0107] In an embodiment of the present application, the master control device determines the synchronization detection result between the master control test program and the slave control test program based on the first current time used in the creation and sending instruction and the second current time included in the confirmation instruction. The master control device includes a master control test program and the slave control test program includes a slave control test program. For example, if the values ​​of the first current time and the second current time are different, or the time difference between the first current time and the second current time is greater than the preset threshold range, it is determined that the synchronization detection result of the master control test program and the slave control test program is out of sync; if the values ​​of the first current time and the second current time are the same, or the time difference between the first current time and the second current time is within the preset threshold range, it is determined that the synchronization detection result of the master control test program and the slave control test program is synchronized.

[0108] In this embodiment, by performing synchronization detection on the master test program and the slave test program, a synchronization detection result can be obtained for judging the synchronization performance between the master test program and the slave test program, thereby preventing errors in the MR service delay test caused by the lack of synchronization between the master test program and the slave test program.

[0109] In one embodiment, the first screenshot dataset includes a first screenshot time and a first image recognition result. As shown in FIG5 , step 202 performs screenshot processing on a preset clock video according to a first preset time period to obtain a first screenshot dataset, including:

[0110] Step 502 : In a first preset time period, a screenshot is performed on the preset clock video to obtain a first screenshot image and a first screenshot time.

[0111] In an embodiment of the present application, the master control device determines a first preset time period. After the master control test program initiates the MR test task, when the preset clock video played in the test app is within the first preset time period, the master control device, through the master control test program, takes a screenshot of the preset clock video at the current moment, obtaining a first screenshot image. When the first screenshot image is taken, the first screenshot time is determined by the system time in the master control test program. Optionally, the master control test program may also record an image sequence number corresponding to the first screenshot image.

[0112] Step 504: perform image recognition on the first screenshot image to obtain a first image recognition result.

[0113] In an embodiment of the present application, the master control device performs image recognition on the first screenshot image using an image recognition algorithm. Based on a clock image from a preset clock video included in the first screenshot image, the master control device identifies the time information represented by the clock image as a first image recognition result. In one embodiment, after performing screenshot processing and image recognition several times within a first preset time period, the master control device can obtain a first screenshot dataset.

[0114] In this embodiment, by taking a screenshot of the preset clock video according to a first preset time period to obtain a first screenshot image, and performing image recognition on the first screenshot image, the time information represented by the clock image in the first screenshot image required for the MR service latency test and the system time for taking a screenshot of the preset clock video can be obtained, thereby realizing the latency test of the MR service. At the same time, taking a screenshot based on the main control test program can also improve the accuracy of recording the first screenshot time of the first screenshot image.

[0115] In one embodiment, as shown in FIG6 , step 504 , performing image recognition on the first screenshot image to obtain a first image recognition result, includes:

[0116] Step 602: Perform image recognition on the first screenshot image. When the image recognition is successful, a first image recognition result is obtained.

[0117] In the embodiment of the present application, the main control test program includes an image recognition tool, such as OpenCV (Open Source Computer Vision Library). After the main control device takes a screenshot of the preset clock image and obtains a first screenshot image, the main control device uses the image recognition tool in the main control test program to perform image recognition on the first screenshot image. If the image recognition operation can obtain a first image recognition result, the image recognition is successful.

[0118] Step 604: When image recognition fails, the current number of failures is counted, and when the current number of failures meets a preset failure threshold, an alarm prompt message is sent.

[0119] In an embodiment of the present application, if the image cannot be recognized N times (configurable) in a row during the image recognition process, an alarm message will be issued in the test APP in the main control device. When this alarm appears in the test APP, the tester is prompted to check the test conditions and environment.

[0120] In this embodiment, by monitoring the image recognition result of the first screenshot image, errors in the latency test results of the MR service caused by abnormalities in the image recognition process are avoided, thereby improving the accuracy of the MR service latency test.

[0121] In one embodiment, the second screenshot dataset includes the second screenshot time and the second image recognition result. As shown in FIG7 , step 206 performs a delay calculation based on the first screenshot dataset and the second screenshot dataset to obtain a target delay result, including:

[0122] Step 702 : for each first image recognition result in the first image data set, determine a second image recognition result that matches the first image recognition result in the second image recognition results.

[0123] In an embodiment of the present application, the master control device determines a second image recognition result in the second image data set that matches the first image recognition result based on each first image recognition result and the second image recognition result in the first image data set. For example, if the first image recognition result of a first screenshot image in the first image data set is Tk0, then the master control device searches the second image data set for a second screenshot image with the same second image recognition result of Tk0. In one embodiment, the master control device records the sequence number and image path of the first screenshot image and the sequence number and image path of the second screenshot image.

[0124] Step 704 : Determine a first screenshot time of the first image recognition result and a second screenshot time of the second image recognition result corresponding to the first image recognition result.

[0125] In the embodiment of the present application, the main control device determines the first screenshot time according to the timestamp of the recorded first screenshot image, and determines the second screenshot time according to the timestamp of the second screenshot image corresponding to the first screenshot image.

[0126] Step 706: Calculate a first delay result according to the first screenshot time and the second screenshot time.

[0127] In the embodiment of the present application, the main control device calculates the time difference between the first screenshot time and the second screenshot time as the first delay result of the delay calculation. For example, the image recognition results of the first screenshot image corresponding to the first screenshot time and the second screenshot image corresponding to the second screenshot time are both T k 0, the time when the first screenshot image is taken in the test APP is T k , that is, the first screenshot time is T k The time when the second screenshot image is taken in the test APP is T′ k , that is, the second screenshot time is T′ k , then the first delay result is T′ k -T k . Further, the main control device determines the second image recognition result that is the same as the first image recognition result in the second image data set, and the second screenshot image corresponding to the second image recognition result based on the first image recognition result corresponding to each first screenshot image in the first screenshot data set, and then obtains the first time delay result corresponding to each first screenshot image in the first image data set.

[0128] Step 708: Determine a target delay result based on each first delay result.

[0129] In an embodiment of the present application, during an MR service test in a test app of a master control device, the master control test program may collect multiple first screenshot images and second screenshot images matching the first screenshot images. The master control device calculates the average delay of the MR service based on the first delay results corresponding to the multiple first screenshot images. The calculation formula for the average delay is as follows:

[0130] Where n is the number of first delay results, T′ k The time when the second screenshot is taken in the test app, T k The time when the first screenshot is taken in the test app.

[0131] In one embodiment, a delay testing system is provided, the system comprising:

[0132] The master control device is configured to take screenshots of a preset clock video according to a first preset time period to obtain a first screenshot data set; receive a second screenshot data set sent by a slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to the second preset time period; and perform delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0133] The slave control device is configured to perform screenshot processing on the preset clock video of the slave control device according to a second preset time period to obtain a second screenshot data set, and send the second screenshot data set to the master control device.

[0134] In an embodiment of the present application, after the master device and the slave device complete status detection and synchronization detection of the test app, the master device performs a screenshot of the preset clock video in the master test program according to the method of step 202. At this time, the slave device responds to the master device's instruction and takes a screenshot of the preset clock video in the slave test program according to a second preset time period. The second preset time period can be less than the first preset time period to ensure that the second screenshot image in the second image data set can contain a screenshot image corresponding to the first screenshot image. The slave device then feeds the second image data set back to the master device, and the master device completes the latency test of the master device and the slave device establishing the MR service according to the method of step 206.

[0135] In this embodiment, the clock video of the master device is screenshoted according to a preset time period through a test program, and the delay is calculated for the first screenshot data set and the second screenshot data set obtained by screenshotting the preset clock video of the slave device. At the same time, the delay calculation is performed using the test program and the slave test program, which can improve the accuracy of the delay test in the MR service.

[0136] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0137] Based on the same inventive concept, embodiments of the present application also provide a latency testing device for implementing the latency testing method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more latency testing device embodiments provided below can be found in the limitations of the latency testing method described above and will not be further elaborated here.

[0138] In one embodiment, as shown in FIG8 , a delay testing device 800 is provided, including: a screenshot module 801 , a receiving module 802 , and a calculation module 803 , wherein:

[0139] The screenshot module 801 is used to take screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0140] The receiving module 802 is configured to receive a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of a preset clock video captured by the slave control device according to a second preset time period;

[0141] The calculation module 803 is configured to perform delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0142] In one embodiment, the delay testing device 800 further includes:

[0143] The startup module is used to start the master test program and instruct the slave device to start the slave test program through the master test program;

[0144] The detection module is used to perform status detection on the running status of the master control test program, and when the status detection result indicates that the master control test program is running normally, perform synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result;

[0145] The calibration module is used to perform time calibration on the master control test program and the slave control test program when the synchronization detection result does not meet the test condition.

[0146] In one embodiment, the detection module is specifically configured to:

[0147] Obtaining the first current time of the local master test program and sending a synchronization instruction to the slave test program in the slave device;

[0148] receiving a confirmation instruction fed back by the slave control device, where the confirmation instruction carries a second current time of the slave control test program obtained in response to the synchronization instruction;

[0149] The synchronization detection result is determined according to the first current time and the second current time of the slave control test program in the confirmation instruction.

[0150] In one embodiment, the screenshot module 801 is specifically configured to:

[0151] In a first preset time period, a screenshot is performed on the preset clock video to obtain a first screenshot image and a first screenshot time;

[0152] Perform image recognition on the first screenshot image to obtain a first image recognition result.

[0153] In one embodiment, the screenshot module 801 is specifically configured to:

[0154] Performing image recognition on the first screenshot image, and obtaining a first image recognition result when the image recognition is successful;

[0155] When image recognition fails, the current number of failures is counted, and an alarm prompt message is sent when the current number of failures meets the preset failure threshold.

[0156] In one embodiment, the calculation module 803 is specifically configured to:

[0157] For each first image recognition result in the first image data set, determining a second image recognition result that matches the first image recognition result in the second image recognition results;

[0158] Determining a first screenshot time of the first image recognition result and a second screenshot time of a second image recognition result corresponding to the first image recognition result;

[0159] Calculate a first time delay result according to the first screenshot time and the second screenshot time;

[0160] A target delay result is determined according to each first delay result.

[0161] Each module in the aforementioned latency testing device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in hardware form, or can be stored in a computer device memory in software form, so that the processor can call and execute the corresponding operations of each module.

[0162] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be shown in Figure 9. The computer device includes a processor, memory, a communication interface, a display screen, and an input device connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner. The wireless manner may be achieved through WiFi, a mobile cellular network, NFC (near field communication), or other technologies. When the computer program is executed by the processor, a delay testing method is implemented. The display screen of the computer device may be a liquid crystal display or an electronic ink display screen. The input device of the computer device may be a touch layer covering the display screen, or may be a key, trackball, or touchpad provided on the computer device housing, or may be an external keyboard, touchpad, or mouse.

[0163] Those skilled in the art will understand that the structure shown in Figure 9 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0164] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0165] Taking screenshots of the preset clock video according to a first preset time period to obtain a first screenshot data set;

[0166] receiving a second screenshot data set sent by the slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period;

[0167] A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

[0168] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0169] Starting a master control test program, and instructing a slave control device to start a slave control test program through the master control test program;

[0170] Performing a status detection on the running status of the master control test program, and when the status detection result indicates that the master control test program is running normally, performing a synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result;

[0171] When the synchronization detection result does not meet the test condition, time calibration is performed on the master control test program and the slave control test program.

[0172] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0173] Acquire a first current time of the local master control test program, and send a synchronization instruction to the slave control test program in the slave control device;

[0174] receiving a confirmation instruction fed back by the slave control device, the confirmation instruction carrying a second current time of the slave control test program obtained in response to the synchronization instruction;

[0175] The synchronization detection result is determined according to the first current time and the second current time of the slave control test program in the confirmation instruction.

[0176] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0177] In a first preset time period, a screenshot is performed on the preset clock video to obtain a first screenshot image and the first screenshot time;

[0178] Perform image recognition on the first screenshot image to obtain the first image recognition result.

[0179] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0180] Performing image recognition on the first screenshot image, and obtaining the first image recognition result when the image recognition is successful;

[0181] When image recognition fails, the current number of failures is counted, and when the current number of failures meets the preset failure threshold, an alarm prompt message is sent.

[0182] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0183] For each first image recognition result in the first image data set, determining, among the second image recognition results, a second image recognition result that matches the first image recognition result;

[0184] Determining the first screenshot time of the first image recognition result and the second screenshot time of the second image recognition result corresponding to the first image recognition result;

[0185] Calculating a first time delay result according to the first screenshot time and the second screenshot time;

[0186] A target delay result is determined according to each of the first delay results.

[0187] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0188] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0189] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0190] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, and the like.

[0191] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0192] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A delay testing method, comprising: According to a first preset time period, taking screenshots of a preset clock video to obtain a first screenshot data set; Receiving a second screenshot data set sent by the slave control device; The second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period; A delay calculation is performed based on the first screenshot data set and the second screenshot data set to obtain a target delay result.

2. The method according to claim 1, further comprising: Before taking screenshots of the preset clock video according to the preset time period to obtain the first screenshot data set, Start a master control test program, and instruct a slave control device to start a slave control test program through the master control test program; Performing a status detection on the running status of the master control test program, and when the status detection result indicates that the master control test program is running normally, performing a synchronization detection on the master control test program and the slave control test program to obtain a synchronization detection result; When the synchronization detection result does not meet the test condition, time calibration is performed on the master control test program and the slave control test program.

3. The method according to claim 2, wherein: The step of performing synchronous detection on the master control test program and the slave control test program to obtain a synchronous detection result includes: Acquire a first current time of the local master control test program, and send a synchronization instruction to the slave control test program in the slave control device; receiving a confirmation instruction fed back by the slave control device, the confirmation instruction carrying a second current time of the slave control test program acquired in response to the synchronization instruction; The synchronization detection result is determined according to the first current time and the second current time of the slave control test program in the confirmation instruction.

4. The method according to claim 1, wherein: The first screenshot data set includes a first screenshot time and a first image recognition result. The screenshot processing is performed on the preset clock video according to the first preset time period to obtain the first screenshot data set, including: In a first preset time period, a screenshot process is performed on a preset clock video to obtain a first screenshot image and the first screenshot time; Perform image recognition on the first screenshot image to obtain the first image recognition result.

5. The method according to claim 4, wherein: The performing image recognition on the first screenshot image to obtain the first image recognition result includes: Performing image recognition on the first screenshot image, and when the image recognition is successful, obtaining the first image recognition result; When image recognition fails, the current number of failures is counted, and when the current number of failures meets the preset failure threshold, an alarm prompt message is sent.

6. The method according to claim 1, wherein: The second screenshot data set includes a second screenshot time and a second image recognition result; The performing delay calculation according to the first screenshot data set and the second screenshot data set to obtain a target delay result includes: For each first image recognition result in the first image data set, determining, in the second image recognition results, a second image recognition result that matches the first image recognition result; Determining the first screenshot time of the first image recognition result and the second screenshot time of the second image recognition result corresponding to the first image recognition result; Calculate a first delay result according to the first screenshot time and the second screenshot time; A target delay result is determined according to each of the first delay results.

7. The method according to claim 1, wherein: The method of performing screenshot processing on the preset clock video according to the preset time period to obtain a first screenshot data set includes: Load preset clock video; After the first preset time period, taking a screenshot of the preset clock video of the current first preset time period; The screenshot image and the information of the screenshot image are saved to obtain the first screenshot data set.

8. The method according to claim 2, wherein: When the synchronization detection result does not meet the test condition, time calibration is performed on the master control test program and the slave control test program, including: When the synchronization detection result shows that the master device and the slave device are out of sync, the master device is abnormally restarted; The master control test program and the slave control test program are re-time-calibrated and synchronized.

9. The method according to claim 3, wherein: The obtaining of the first current time of the local master control test program and sending a synchronization instruction to the slave control test program in the slave control device includes: Acquire a first current time of the master control test program locally in the master control device, and create a synchronization instruction containing synchronization information, wherein the synchronization instruction includes an instruction instructing the slave control device to acquire a second current time in the slave control test program; The synchronization instruction is sent to a slave control test program of the slave control device.

10. A delay test device, comprising: A screenshot module, used to take screenshots of a preset clock video according to a first preset time period to obtain a first screenshot data set; A receiving module, configured to receive a second screenshot data set sent by a slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period; The calculation module is used to perform delay calculation according to the first screenshot data set and the second screenshot data set to obtain a target delay result.

11. A delay test system, comprising: A main control device, used for taking screenshots of a preset clock video according to a first preset time period to obtain a first screenshot data set; receiving a second screenshot data set sent by a slave control device; the second screenshot data set includes screenshot data of the preset clock video captured by the slave control device according to a second preset time period; Performing delay calculation based on the first screenshot data set and the second screenshot data set to obtain a target delay result; The slave control device is used to perform screenshot processing on the preset clock video of the slave control device according to a second preset time period to obtain a second screenshot data set, and send the second screenshot data set to the master control device.

12. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 9 are implemented.

13. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

14. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Citation Information

Patent Citations

  • Method and system for testing virtual reality equipment delay

    CN105807602A

  • Transmission delay measurement system and method

    CN114630107A

  • Time delay measurement method, system, device, equipment and storage medium

    CN115348441A

  • Time delay test method and device, computer equipment and storage medium

    CN116896763A

  • Methods and systems for creating virtual and augmented reality

    US20160026253A1