A cloud real-time interactive entertainment end-to-end delay test method and device

Abstract

The application relates to the technical field of cloud interaction, in particular to an end-to-end delay test method and equipment for cloud real-time interactive entertainment, which can utilize program A to send a test action and simultaneously time on the same terminal, utilize program B to make a response action, program A stops timing when detecting the response action, and a first test time is obtained; program A is placed on a cloud platform, program A and program B are repeatedly executed, and a second test time is obtained; delay data of cloud real-time interactive entertainment is calculated according to the first test time and the second test time. It can be understood that the technical scheme shown by the application can effectively reduce the test cost of end-to-end delay, reduce the invasiveness to a research and development project, and reduce the test time consumption.

Description

Technical Field

[0001] This invention relates to the field of cloud interactive technology, and more specifically to an end-to-end latency testing method and device for real-time cloud interactive entertainment. Background Technology

[0002] Cloud-based real-time interactive entertainment streaming is a technical solution that places the cloud-based real-time interactive entertainment software package on a cloud server for users to play. It involves capturing and encoding the footage from the cloud server into a video stream, transmitting it over the network to the user's client, and then capturing user terminal input responses and transmitting them in real-time to the cloud-based real-time interactive entertainment software. This allows users to remotely use the software. It features strong scalability, low dependence on terminal devices, and cross-terminal device access to software content.

[0003] In cloud-based real-time interactive entertainment, end-to-end latency data significantly impacts the user's real-time interactive entertainment experience. Accurately measuring end-to-end latency is a crucial step in optimizing the experience of cloud-based real-time interactive entertainment products. Currently, end-to-end latency testing is typically conducted using high-speed cameras or code-based tracking.

[0004] Using high-speed cameras to capture users interacting with the software and calculating end-to-end latency by analyzing the frame rate difference between user-triggered screen transitions, is costly, typically requiring two to three hours per test. Performing point-by-point verification at every stage of the streaming service, including user input, network latency, screen capture, encoding, transmission, and caching, is highly invasive and costly for development projects.

[0005] Therefore, current end-to-end latency testing methods for cloud-based real-time interactive entertainment are costly, time-consuming, and highly intrusive to R&D projects. Summary of the Invention

[0006] In view of this, the purpose of this invention is to provide an end-to-end latency testing method and device for cloud real-time interactive entertainment, so as to solve the problems of high testing cost, long testing time, and high intrusion into R&D projects in the current end-to-end latency testing methods for cloud real-time interactive entertainment.

[0007] According to a first aspect of the present invention, an end-to-end latency testing method for cloud real-time interactive entertainment is provided, characterized in that it includes: Perform the following operations on the same terminal: use program A to issue a test action and start timing simultaneously, use program B to make a response action when the test action is detected, and use program A to stop timing when the response action is detected, thus obtaining the first test time; Place program A on the cloud platform, start the cloud platform on the terminal, use the cloud platform to execute program A to issue test actions and start timing, use program B on the terminal to make a response action when the test action is detected, and stop timing when program A detects the response action to obtain the second test time. The latency data for real-time cloud interactive entertainment is calculated based on the first test time and the second test time.

[0008] Preferably, when program A issues a test action and starts timing, it includes: After program A starts, it displays a static, solid red screen. After a preset time, the displayed image will change from a static solid red image to a static solid green image, and the timer will start simultaneously.

[0009] Preferably, the method further includes: Program A obtains random time values ​​through a preset random function; After program A starts, it displays a static solid red screen and starts a timer. When the timer reaches a random time value, the displayed screen will change from a static solid red screen to a static solid green screen, and the timer will start.

[0010] Preferably, when the test action is detected, the program B takes a response action, including: Program B detects the image in a preset area in real time, analyzes the color value of the image, and triggers a mouse click event as a response when the color value is identified as green.

[0011] Preferably, program A stops timing when the response action is detected, including: When program A receives a mouse click event, it stops the timer and uses the timer duration as the first test time or the second test time.

[0012] Preferably, the latency data for real-time cloud interactive entertainment is calculated based on the first test time and the second test time, including: Calculate the difference between the second test time and the first test time; The second test time is used as the end-to-end latency of the cloud real-time interactive entertainment; the difference is used as the latency of the streaming service.

[0013] Preferably, program B detects the image within a preset area in real time and analyzes the color values ​​of the image, including: The Windows system API is used to capture a 20x20 pixel image within a preset area. The color values ​​of the image are analyzed using an image recognition library.

[0014] According to a second aspect of the present invention, an end-to-end latency testing device for cloud real-time interactive entertainment is provided, comprising: The main controller and the memory connected to the main controller; Memory, which stores program instructions; The main controller is used to execute program instructions stored in the memory and perform any of the methods described above.

[0015] The technical solutions provided by the embodiments of the present invention may include the following beneficial effects: It is understood that the technical solution presented in this invention can, on the same terminal, use program A to issue a test action and simultaneously time it, and use program B to make a response action. Program A stops timing when it detects the response action, thus obtaining a first test time. Then, program A is placed on a cloud platform, and program A and program B are executed repeatedly to obtain a second test time. The latency data of real-time cloud interactive entertainment is calculated based on the first and second test times. It is understood that the technical solution presented in this invention can effectively reduce the testing cost of end-to-end latency, reduce intrusion into R&D projects, and shorten testing time.

[0016] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit the invention. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0018] Figure 1 This is a schematic diagram illustrating the steps of an end-to-end latency testing method for cloud real-time interactive entertainment according to an exemplary embodiment. Detailed Implementation

[0019] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the invention as detailed in the appended claims.

[0020] In one embodiment, Figure 1 This is a schematic diagram illustrating the steps of an end-to-end latency testing method for cloud real-time interactive entertainment according to an exemplary embodiment. See also... Figure 1This paper provides an end-to-end latency testing method for cloud-based real-time interactive entertainment, characterized by including: Step S11: Perform the following operations on the same terminal: Use program A to issue a test action and start timing simultaneously; use program B to make a response action when the test action is detected; and use program A to stop timing when the response action is detected, thereby obtaining the first test time. Step S12: Place program A on the cloud platform, turn on the cloud platform on the terminal, use the cloud platform to execute program A to issue test actions and start timing, use program B on the terminal to make a response action when the test action is detected, and program A stops timing when the response action is detected to obtain the second test time. Step S13: Calculate the latency data of cloud real-time interactive entertainment based on the first test time and the second test time.

[0021] It is understood that the technical solution shown in this embodiment can, on the same terminal, use program A to issue a test action and simultaneously time it, and use program B to make a response action. Program A stops timing when it detects the response action, thus obtaining a first test time. Then, program A is placed on a cloud platform, and program A and program B are executed repeatedly to obtain a second test time. The latency data of real-time interactive entertainment in the cloud is calculated based on the first test time and the second test time. It is understood that the technical solution shown in this embodiment can effectively reduce the testing cost of end-to-end latency, reduce intrusion into R&D projects, and shorten testing time.

[0022] In practice, Program A is the program for the reaction tester, and Program B is the program that automatically captures the screen image and responds. These two programs are used to conduct end-to-end latency testing for cloud real-time interactive entertainment.

[0023] Preferably, the execution logic of program A is as follows: After program A starts, it displays a static, solid red screen. A random time value t0 is generated using a system random function, and a timer starts simultaneously. Once t0 is reached, the screen immediately changes to a static solid green screen, and a timer T1 is started. The tester is required to immediately tap the screen upon seeing the change from red to green. Upon receiving the user's tap response, program A immediately stops timer T1, recording the reaction time. This reaction time represents the user's actual reaction time.

[0024] Preferably, the execution logic of program B is as follows: Program B is a program that detects changes in the screen and responds to clicks. It uses the Windows system API to capture a 20x20 image within a fixed area of ​​the screen and analyzes the color values ​​of the image using an image recognition library. If the color value of the target area is detected as green, a mouse click event is immediately triggered using a preset method; after detecting green and triggering a click event, execution stops immediately.

[0025] Applying the above execution logic to this technical solution, the program A issues a test action and starts timing simultaneously, including: After program A starts, it displays a static, solid red screen. After a preset time, the displayed image will change from a static solid red image to a static solid green image, and the timer will start simultaneously.

[0026] In practice, the execution logic of program A is consistent whether it runs on a terminal or a cloud platform. When program A runs on a terminal, it directly displays a solid red image on the screen, and then transitions from a static solid red image to a static solid green image. When program A runs on a cloud platform, it displays a solid red image from the cloud platform, and the terminal obtains the video stream and then displays the corresponding image on its screen.

[0027] Furthermore, the method also includes: Program A obtains random time values ​​through a preset random function; After program A starts, it displays a static solid red screen and starts a timer. When the timer reaches a random time value, the displayed screen will change from a static solid red screen to a static solid green screen, and the timer will start.

[0028] In practice, to ensure the authenticity of the test data, a random time value is set. When the timer reaches the random time value, the screen color is changed. This can maximize the randomness of the screen transition and thus ensure that the reaction time obtained from the test is real and accurate.

[0029] It should be noted that when program B detects the test action, it takes a response action, including: Program B detects the image in a preset area in real time, analyzes the color value of the image, and triggers a mouse click event as a response when the color value is identified as green.

[0030] In practice, program B runs continuously on the terminal.

[0031] When program A receives a mouse click event, it stops the timer and uses the timer duration as the first test time or the second test time.

[0032] It should be noted that the latency data for real-time cloud interactive entertainment, calculated based on the first test time and the second test time, includes: Calculate the difference between the second test time and the first test time; The second test time is used as the end-to-end latency of the cloud real-time interactive entertainment; the difference is used as the latency of the streaming service.

[0033] It should be noted that program B detects the image within a preset area in real time and analyzes the color values ​​of the image, including: The Windows system API is used to capture a 20x20 pixel image within a preset area. The color values ​​of the image are analyzed using an image recognition library.

[0034] According to a second aspect of the present invention, an end-to-end latency testing device for cloud real-time interactive entertainment is provided, comprising: The main controller and the memory connected to the main controller; Memory, which stores program instructions; The main controller is used to execute program instructions stored in the memory and perform any of the methods described above.

[0035] It is understood that the same or similar parts in the above embodiments can be referred to each other, and the contents not described in detail in some embodiments can be referred to the same or similar contents in other embodiments.

[0036] It should be noted that in the description of this invention, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, in the description of this invention, unless otherwise stated, "a plurality of" means at least two.

[0037] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0038] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0039] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0040] Furthermore, the functional units in the various embodiments of the present invention can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0041] The storage media mentioned above can be read-only memory, disk, or optical disk, etc.

[0042] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0043] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An end-to-end latency testing method for cloud-based real-time interactive entertainment, characterized in that, include: The following operations are performed on the same terminal: a test action is issued by program A and a timer is started at the same time; a response action is performed by program B when the test action is detected; and the timer is stopped by program A when the response action is detected, thus obtaining the first test time; program A is the program of the reaction tester, and program B is the program that automatically captures the screen image and responds. Place program A on the cloud platform, start the cloud platform on the terminal, use the cloud platform to execute program A to issue test actions and start timing, use program B on the terminal to make a response action when the test action is detected, and stop timing when program A detects the response action to obtain the second test time. Calculate the difference between the second test time and the first test time; The second test time is used as the end-to-end latency of the cloud real-time interactive entertainment; the difference is used as the latency of the streaming service.

2. The method according to claim 1, characterized in that, The program A issues a test action and starts timing simultaneously, including: After program A starts, it displays a static, solid red screen. After a preset time, the displayed image will change from a static solid red image to a static solid green image, and the timer will start simultaneously.

3. The method according to claim 2, characterized in that, Also includes: Program A obtains random time values ​​through a preset random function; After program A starts, it displays a static solid red screen and starts a timer. When the timer reaches a random time value, the displayed screen will change from a static solid red screen to a static solid green screen, and the timer will start.

4. The method according to claim 2, characterized in that, When program B detects the test action, it takes a response action, including: Program B detects the image in a preset area in real time, analyzes the color value of the image, and triggers a mouse click event as a response when the color value is identified as green.

5. The method according to claim 4, characterized in that, Program A stops timing when it detects the response action, including: When program A receives a mouse click event, it stops the timer and uses the timer duration as the first test time or the second test time.

6. The method according to claim 4, characterized in that, Program B detects the image within a preset area in real time and analyzes the color values ​​of the image, including: Use Windows system API to capture 20 within a preset area. 20 images; The color values ​​of the image are analyzed using an image recognition library.

7. An end-to-end latency testing device for cloud-based real-time interactive entertainment, characterized in that, include: The main controller and the memory connected to the main controller; Memory, which stores program instructions; The main controller is used to execute program instructions stored in the memory to perform the method as described in any one of claims 1 to 6.

Images