Delay calculation method and device, electronic device, and storage medium

Abstract

The present disclosure provides a delay calculation method and device, an electronic device, and a storage medium, and relates to the field of data processing technology. The delay calculation method includes: controlling the movement of a local mouse identifier through a script program, and controlling the movement of a cloud mouse identifier in a cloud server based on a control protocol; receiving a video screen transmitted back by the cloud server to display the movement trajectory of the cloud mouse identifier, and performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video screen; obtaining the delay measurement value corresponding to each delay measurement process, and calculating the two-way link delay between the local terminal and the cloud server based on the delay measurement value. The technical solution of the embodiment of the present disclosure can determine the two-way link delay between the local and cloud servers by performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier, thereby improving the convenience and accuracy of calculating the two-way link delay between the local terminal and the cloud server.

Description

Background Art

[0002] With the rapid development of cloud gaming, the full-link latency in cloud gaming has become an important criterion for measuring the quality of cloud gaming services.

[0003] However, in related cloud gaming full-link delay calculation solutions, either only the delay from client to server can be calculated, or the delay from client to server and server to client can be mechanically calculated by adding timestamps, but the perceived delay of cloud gaming players cannot be determined.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the embodiments of the present disclosure is to provide a delay calculation method, a delay calculation device, an electronic device and a computer-readable storage medium, thereby overcoming the problems of low accuracy and high complexity of delay calculation at least to a certain extent.

[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0007] According to a first aspect of an embodiment of the present disclosure, a delay calculation method is provided, comprising: controlling the movement of a local mouse identifier through a script program, and controlling the movement of a cloud mouse identifier in the cloud server based on a control protocol; receiving a video screen transmitted back by the cloud server for displaying the movement trajectory of the cloud mouse identifier, and performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video screen; obtaining a delay measurement value corresponding to each delay measurement process, and calculating a two-way link delay between a local terminal and the cloud server based on the delay measurement value; the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier.

[0008] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement process includes: in response to an event that triggers the execution of the script program, controlling the local mouse identifier to move in the local terminal, and causing the cloud mouse identifier to simulate the movement of the local mouse identifier in a cloud container created by the cloud server; and acquiring images of the local mouse identifier and the cloud mouse identifier moving in the cloud container.

[0009] In some example embodiments of the present disclosure, based on the aforementioned scheme, the obtaining of the local mouse identifier and the image of the cloud mouse identifier moving in the cloud container includes: reading the screenshot time parameters in the script program, and determining each screenshot timing information corresponding to the screenshot time parameters; and according to the each screenshot timing information, periodically capturing the image of the local mouse identifier and the cloud mouse identifier moving in the cloud container.

[0010] In some example embodiments of the present disclosure, based on the aforementioned scheme, the method further includes: generating image pairs corresponding to the screenshot timing information, and performing pixel-level analysis on the image pairs to determine boundary pixel points of the image pairs; based on the boundary pixel points, calculating the lag distance of the cloud mouse identifier corresponding to the screenshot timing information relative to the local mouse identifier.

[0011] In some example embodiments of the present disclosure, based on the aforementioned scheme, obtaining the delay measurement value corresponding to each delay measurement process includes: reading the moving speed of the local mouse identifier, and determining the instantaneous perceived delay corresponding to each screenshot timing information based on the lag distance and the moving speed; calculating the average value of all the instantaneous perceived delays, and using the average value as the delay measurement value corresponding to each delay measurement process.

[0012] In some example embodiments of the present disclosure, based on the aforementioned scheme, the bidirectional link delay between the local terminal and the cloud server is calculated based on the delay measurement value, including: standardizing the delay measurement value to obtain a standard delay measurement value; and using the standard delay measurement value as the bidirectional link delay between the local terminal and the cloud server.

[0013] In some example embodiments of the present disclosure, based on the aforementioned scheme, the control of the movement of the cloud mouse identifier in the cloud server based on the control protocol includes: establishing a communication connection with the server, and obtaining the control protocol in response to a trigger operation of running the script program; sending the control protocol to the cloud server so that the cloud server creates the cloud container, and controlling the movement of the cloud mouse identifier in the cloud container based on the control protocol.

[0014] According to a second aspect of an embodiment of the present disclosure, a delay calculation device is provided, comprising: a movement control module, used to control the movement of a local mouse identifier through a script program, and to control the movement of a cloud mouse identifier in the cloud server based on a control protocol; a delay measurement module, used to receive a video screen transmitted by the cloud server for displaying the movement trajectory of the cloud mouse identifier, and to perform multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video screen; a delay calculation module, used to obtain a delay measurement value corresponding to each delay measurement process, and to calculate a two-way link delay between a local terminal and the cloud server based on the delay measurement value; the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier.

[0015] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module includes a mobile event triggering unit, and the delay measurement unit is used to control the local mouse identifier to move in the local terminal in response to an event that triggers the execution of the script program, and to make the cloud mouse identifier simulate the movement of the local mouse identifier in a cloud container created by the cloud server; and to obtain images of the local mouse identifier and the cloud mouse identifier moving in the cloud container.

[0016] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module includes an image capture unit, which is used to read the screenshot time parameters in the script program and determine each screenshot timing information corresponding to the screenshot time parameters; according to the each screenshot timing information, the image of the local mouse identifier and the cloud mouse identifier moving in the cloud container is captured at regular intervals.

[0017] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module also includes a lag distance calculation unit, which is used to generate image pairs corresponding to the screenshot timing information, and perform pixel-level analysis on the image pairs to determine boundary pixel points of the image pairs; based on the boundary pixel points, calculate the lag distance corresponding to the screenshot timing information.

[0018] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay calculation module includes a delay measurement value determination unit, which is used to read the moving speed of the local mouse identifier, and determine the instantaneous perceived delay corresponding to each screenshot timing information based on the lag distance and the moving speed; calculate the average value of all the instantaneous perceived delays, and use the average value as the delay measurement value corresponding to each delay measurement process.

[0019] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay calculation module also includes a delay calculation unit, which is used to standardize the delay measurement value to obtain a standard delay measurement value; and use the standard delay measurement value as the bidirectional link delay between the local terminal and the cloud server.

[0020] In some example embodiments of the present disclosure, based on the aforementioned scheme, the mobile control module includes a mobile control unit, which is used to establish a communication connection with a cloud server, and obtain a control protocol in response to a trigger operation of running a script program; send the control protocol to the cloud server so that the cloud server creates the cloud container, and control the cloud mouse marker to move in the cloud container based on the control protocol.

[0021] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, any one of the delay calculation methods described above is implemented.

[0022] According to a fourth aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the delay calculation method according to any one of the above items is implemented.

[0023] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0024] The delay calculation method in the example embodiment of the present disclosure controls the movement of a local mouse identifier through a script program, and controls the movement of a cloud mouse identifier in a cloud server based on a control protocol, while receiving a video screen transmitted back by the cloud server for displaying the movement trajectory of the cloud mouse identifier, and performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video screen; obtaining the delay measurement value corresponding to each delay measurement process, and calculating the two-way link delay between the local and cloud servers based on the delay measurement value; wherein the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier. On the one hand, the movement of the local mouse marker can be controlled by a script program, and the movement of the cloud mouse marker in the cloud server can be controlled based on the control protocol. At the same time, a video image sent back by the cloud server to display the movement trajectory of the cloud mouse marker is received, and multiple delay measurements are performed on the local mouse marker and the cloud mouse marker in the video image, thereby improving the authenticity of the simulation perception delay calculation process and the convenience of calculating the perception delay. On the other hand, by obtaining the delay measurement values ​​corresponding to the local terminal to the cloud server and the cloud server to the local terminal in each delay measurement process, and determining the two-way link delay between the local and cloud servers based on the delay measurement values, it is avoided to calculate only the delay from the local terminal to the cloud server, and also to avoid directly using the single delay measurement values ​​corresponding to the local terminal to the cloud server and the cloud server to the local terminal as the two-way link delay between the local terminal and the cloud server, thereby improving the calculation accuracy of the two-line link delay between the local terminal and the cloud server.

[0025] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0027] Figure 1 A schematic diagram schematically illustrates the process of a delay calculation method according to some embodiments of the present disclosure;

[0028] Figure 2 A schematic diagram schematically illustrates the process of a delay measurement method according to some embodiments of the present disclosure;

[0029] Figure 3A schematic diagram schematically illustrates the process of an image interception method according to some embodiments of the present disclosure;

[0030] Figure 4 A schematic diagram schematically illustrates the process of a method for calculating a hysteresis distance according to some embodiments of the present disclosure;

[0031] Figure 5 A schematic diagram schematically illustrates the process of a delay measurement value calculation method according to some embodiments of the present disclosure;

[0032] Figure 6 A schematic diagram schematically illustrates the process of a method for calculating a standard delay measurement value according to some embodiments of the present disclosure;

[0033] Figure 7 A schematic diagram schematically illustrates the process of a cloud-based mouse marker moving method according to some embodiments of the present disclosure;

[0034] Figure 8 A schematic diagram schematically illustrates a process of another delay calculation method according to some embodiments of the present disclosure;

[0035] Fig. 9 Schematically illustrates a schematic diagram of a delay device according to some embodiments of the present disclosure;

[0036] Fig.10 A schematic diagram schematically shows a structure of a computer system of an electronic device according to some embodiments of the present disclosure;

[0037] Fig.11 A schematic diagram of a computer-readable storage medium according to some embodiments of the present disclosure is schematically shown.

[0038] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION

[0039] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more comprehensive and complete and will fully convey the concept of the example embodiments to those skilled in the art.

[0040] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0041] Furthermore, the drawings are only schematic illustrations and are not necessarily drawn to scale. The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0042] In this example embodiment, a delay calculation method is first provided. The perceived delay calculation method can be applied to terminal devices, such as mobile phones, computers and other electronic devices. Figure 1 The following is a schematic diagram schematically showing the process of the delay calculation method according to some embodiments of the present disclosure. Figure 1 As shown, the delay calculation method may include the following steps:

[0043] In step S110, the local mouse marker is controlled to move by a script program, and the cloud mouse marker in the cloud server is controlled to move based on a control protocol;

[0044] In step S120, a video image transmitted by the cloud server for displaying the movement track of the cloud mouse marker is obtained, and multiple delay measurement processes are performed on the local mouse marker and the cloud mouse marker in the video image;

[0045] In step S130, the delay measurement value corresponding to each delay measurement process is obtained, and the bidirectional link delay between the local terminal and the cloud server is calculated based on the delay measurement value; wherein the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse marker in the video screen relative to the local mouse marker.

[0046] According to the method in this example embodiment, on the one hand, the movement of the local mouse identifier can be controlled by a script program, and the movement of the cloud mouse identifier in the cloud server can be controlled based on a control protocol. At the same time, a video image transmitted back by the cloud server for displaying the movement trajectory of the cloud mouse identifier is received, and multiple delay measurement processes are performed on the local mouse identifier and the cloud mouse identifier in the video image, thereby improving the authenticity of the simulation perception delay calculation process and the convenience of calculating the perception delay; on the other hand, by obtaining the delay measurement values ​​corresponding to the local terminal to the cloud server and the cloud server to the local terminal in each delay measurement process, and determining the two-way link delay between the local terminal and the cloud server based on the delay measurement values, it is avoided to calculate only the delay from the local terminal to the cloud server, and also to avoid directly using the single delay measurement values ​​corresponding to the local terminal to the cloud server and the cloud server to the local terminal as the two-way link delay between the local terminal and the cloud server, thereby improving the calculation accuracy of the two-way link delay between the local and cloud servers.

[0047] Next, the delay calculation method in this exemplary embodiment will be further described.

[0048] In step S110, the movement of the local mouse marker is controlled by a script program, and the movement of the cloud mouse marker in the cloud server is controlled based on a control protocol.

[0049] In some example embodiments of the present disclosure, the local mouse identifier may refer to a mouse identifier displayed on the local terminal and corresponding to the local terminal device. For example, the local mouse identifier may be a mouse identifier in the form of an arrow displayed on the display of the local terminal and corresponding to the local terminal device. The local mouse identifier may also be a mouse identifier in the form of a palm displayed on the display of the local terminal and corresponding to the local terminal device. Of course, the local mouse identifier may also be a mouse identifier in other forms displayed on the display of the local terminal and corresponding to the local terminal device. This example embodiment does not specifically limit this.

[0050] The cloud mouse identifier may refer to a mouse identifier corresponding to the server device and displayed on the video screen. For example, the cloud mouse identifier may be an arrow-shaped mouse identifier corresponding to the server device and displayed on the video screen. The cloud mouse identifier may also be a palm-shaped mouse identifier corresponding to the server device and displayed on the video screen. Of course, the cloud mouse identifier may also be other forms of mouse identifiers corresponding to the server device and displayed on the video screen. This embodiment does not specifically limit this.

[0051] The video screen may refer to a screen recorded by a cloud server of the movement of a cloud mouse marker in a cloud container. For example, the video screen may be a screen generated based on a cloud container for displaying the movement track of a cloud mouse marker, with a pure black background and the cloud mouse marker displayed in white. Of course, the video screen may also be other screens generated based on a cloud container for displaying the movement track of a cloud mouse marker, and this embodiment does not specifically limit this.

[0052] The control protocol may refer to a protocol used to control a cloud mouse identifier to simulate the movement of a local mouse identifier in a cloud container. For example, the control protocol may be a protocol that includes a program for controlling the cloud mouse identifier to simulate the movement of a local mouse identifier in a cloud container. The control protocol may also be a protocol that includes a return instruction corresponding to the trajectory of the cloud mouse identifier simulating the movement of the local mouse identifier in the cloud container. Of course, the control protocol may also be a protocol that includes other information for controlling the cloud mouse identifier to simulate the movement of the local mouse identifier in the cloud container. This embodiment does not specifically limit this.

[0053] The local mouse identifier can be controlled to move in the local terminal through a script program, and a control protocol for controlling the cloud mouse identifier to simulate the movement of the local mouse identifier in the cloud container can be obtained, and the control protocol can be sent to the cloud server. The cloud server controls the cloud mouse identifier in the cloud server to simulate the movement of the local mouse identifier in the cloud container based on the control protocol.

[0054] In step S120, a video image for displaying the movement trajectory of the cloud mouse marker transmitted back by the cloud server is received, and multiple delay measurement processes are performed on the local mouse marker and the cloud mouse marker in the video image.

[0055] The delay measurement process may refer to a key process for calculating the two-way link delay between the local terminal and the cloud server. For example, the delay measurement process may be a process including the movement of the local mouse identifier in the local terminal and the movement of the cloud mouse identifier in the cloud container, as well as a process of taking screenshots of the local mouse identifier and the cloud mouse identifier in the returned video screen. Of course, the delay measurement process also includes other key processes for calculating the two-way delay between the local terminal and the cloud server, such as the lag distance measurement and calculation process of the cloud mouse identifier relative to the local mouse identifier. This embodiment does not specifically limit this.

[0056] The video screen containing the movement trajectory of the cloud mouse identifier transmitted back by the cloud server can be displayed by the local terminal, and the current movement trajectory of the local mouse identifier can also be displayed, which is equivalent to displaying the movement trajectories of the cloud mouse identifier and the local mouse identifier on the same canvas of the local terminal. Then, multiple delay measurement processes can be performed on the local mouse identifier and the cloud mouse identifier in the video screen. For example, screenshots of the cloud mouse identifier and the local mouse identifier are taken at the same time, and the lag distance of the cloud mouse identifier relative to the local mouse identifier is calculated, and the two-way link delay measurement value between the local terminal and the cloud server in a single delay measurement process is determined in combination with the movement speed of the local mouse identifier, thereby determining the two-way link delay between the local terminal and the cloud server based on the delay measurement values ​​in multiple delay measurement processes between the local mouse identifier and the cloud mouse identifier.

[0057] In step S130, the delay measurement value corresponding to each delay measurement process is obtained, and the bidirectional link delay between the local terminal and the cloud server is calculated based on the delay measurement value; wherein the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse marker in the video screen relative to the local mouse marker.

[0058] In some example embodiments of the present disclosure, the delay measurement value may refer to an average delay measurement value calculated based on multiple instantaneous delay measurement values ​​during a single movement of a cloud mouse identifier and a local mouse identifier. For example, the delay measurement value may be the arithmetic mean of multiple instantaneous delay measurement values ​​of a cloud mouse identifier and a local mouse identifier during a single movement. The delay measurement value may also be a weighted average of multiple instantaneous delay measurement values ​​of a cloud mouse identifier and a local mouse identifier during a single movement. Of course, the delay measurement value may be other average delay measurement values ​​calculated based on multiple instantaneous delay measurement values ​​during a single movement of a cloud mouse identifier and a local mouse identifier. This example embodiment does not specifically limit this.

[0059] The two-way link delay may refer to a delay measurement value obtained by standardizing the delay measurement values ​​of the cloud mouse identifier and the local mouse identifier in each movement process. For example, the two-way link delay may be a delay measurement value obtained by performing arithmetic averaging on the delay measurement values ​​of the cloud mouse identifier and the local mouse identifier in each movement process. The two-way link delay may also be a delay measurement value obtained by performing weighted averaging on the delay measurement values ​​of the cloud mouse identifier and the local mouse identifier in each movement process. Of course, the two-way link delay may be a delay measurement value obtained by performing other standardized processing on the delay measurement values ​​of the cloud mouse identifier and the local mouse identifier in each movement process. This embodiment does not make any special limitation to this.

[0060] The lag distance may refer to the instantaneous lag distance of the cloud mouse identifier relative to the local mouse identifier during a delay measurement. For example, the lag distance may be the instantaneous vector distance between the cloud mouse identifier and the local mouse identifier during a delay measurement. The lag distance may also be the instantaneous scalar distance between the cloud mouse identifier and the local mouse identifier during a delay measurement. Of course, the lag distance may also be other instantaneous distances such as the instantaneous relative distance between the cloud mouse identifier and the local mouse identifier during a delay measurement. This embodiment does not specifically limit this.

[0061] The local terminal can be controlled by a script program to capture multiple positioning images of the cloud mouse identifier and the local mouse identifier during a movement process, and the lag distance of the cloud mouse identifier relative to the local mouse identifier data in the positioning images containing the cloud mouse identifier and the local mouse identifier captured at each time is calculated, and the moving speed of the local mouse identifier is read. Then, the instantaneous two-way link delay measurement value between the local terminal and the cloud server is calculated based on the lag distance and the moving speed, and the instantaneous delay measurement values ​​corresponding to each positioning image in the movement process are averaged to obtain the delay measurement value corresponding to the movement process. Similarly, the delay measurement value corresponding to each movement process is obtained in turn, and all the delay measurement values ​​are standardized, such as performing arithmetic averaging on all the delay measurement values ​​to obtain a standard delay measurement value, and the standard delay measurement value is used as the two-way link delay between the local terminal and the cloud server.

[0062] Based on the script program, the local mouse mark is controlled to move in the local terminal, and the control protocol is sent to the cloud server at the same time, so as to control the cloud mouse mark to move in the cloud container through the cloud server, and return the video picture of the cloud mouse mark moving track in the cloud container, and perform multiple delay measurement processes on the local mouse mark and the cloud mouse mark in the video picture, thereby improving the authenticity of the simulation perception delay calculation process and the convenience of calculating the perception delay. At the same time, by obtaining the delay measurement value of each delay measurement process, and calculating the two-way link delay between the local terminal and the cloud server based on the delay measurement value, it is avoided to only calculate the delay between the local terminal and the cloud server, and it is also avoided to directly use the delay measurement value corresponding to the single local terminal to the server cloud server and the server cloud server to the client local terminal as the perception of the two-way link delay between the local terminal and the cloud server, thereby improving the accuracy of calculating the two-way link delay between the local terminal and the cloud server.

[0063] Figure 2 The following is a schematic diagram schematically showing the process of the delay measurement method according to some embodiments of the present disclosure. Figure 2 As shown, the delay measurement method may include the following steps:

[0064] In step S210, in response to the event that triggers the script program to run, the local mouse identifier is controlled to move in the local terminal, and the cloud mouse identifier simulates the movement of the local mouse identifier in the cloud container created by the cloud server;

[0065] In step S220, the local mouse marker and an image of the cloud mouse marker moving in the cloud container are acquired.

[0066] Among them, while the script program is running, the control protocol can be obtained and sent to the cloud server, so that the cloud server controls the cloud mouse marker to simulate the movement of the local mouse marker in the cloud container based on the control protocol, and transmits the video image used to display the movement trajectory of the cloud mouse marker back to the local terminal.

[0067] In response to the user's trigger operation on the script program, the script program can be called to control the movement of the local mouse identifier in the local terminal, and at the same time, the control protocol for controlling the cloud mouse identifier is obtained, and the control protocol is sent to the cloud server, so as to control the cloud mouse identifier through the cloud server to simulate the movement of the local mouse identifier in the cloud container created by the cloud server. In the process of sending the control protocol to the cloud server, the local mouse identifier continues to move in the local terminal. At the same time, when the video picture for showing the movement track of the cloud mouse identifier is received from the cloud server, the local mouse identifier is still moving in the local terminal, that is, this process includes the two-way link delay of sending the control protocol from the local terminal to the cloud server, and the cloud server returning the video picture of the local mouse movement in the cloud container through the cloud mouse identifier to the local terminal. Based on the script program, the movement duration of the local mouse identifier in the local terminal and the screenshot time parameters of the cloud mouse identifier and the local mouse identifier can be set, and the positioning images of the cloud mouse identifier and the local mouse identifier can be captured at regular intervals during the movement of the cloud mouse identifier and the local mouse identifier according to the screenshot time parameters, so as to calculate the delay measurement value of the cloud mouse identifier and the local mouse identifier during a movement process based on the captured positioning images.

[0068] Figure 3 The following is a schematic diagram schematically showing the process of the image capture method according to some embodiments of the present disclosure. Figure 3 As shown, the image interception method may include the following steps:

[0069] In step S310, the screenshot time parameter in the script program is read, and each screenshot timing information corresponding to the screenshot time parameter is determined;

[0070] In step S320, images of the local mouse marker and the cloud mouse marker moving in the cloud container are captured at regular intervals according to the screenshot timing information.

[0071] Among them, the screenshot time parameter may refer to the time parameter used to capture the images of the cloud mouse identifier and the local mouse identifier. For example, the screenshot time parameter may be the time interval data for capturing the images of the cloud mouse identifier and the local mouse identifier based on the movement duration of the local mouse identifier in the local terminal. The screenshot time parameter may also be the timestamp data for capturing the images of the cloud mouse identifier and the local mouse identifier based on the start movement timestamp and the end movement timestamp of the local mouse identifier in the local terminal. Of course, the screenshot time parameter may also be other time parameters used to capture the images of the cloud mouse identifier and the local mouse identifier, such as a timed screenshot timestamp. This embodiment does not specifically limit this.

[0072] The script program can be used to set the movement duration of the local mouse identifier in the local terminal, and set the screenshot time parameter corresponding to the movement duration, to ensure that the screenshot timing is in the middle of the movement process of the cloud mouse identifier and the local mouse identifier, to avoid capturing the local mouse identifier and the cloud mouse identifier in the video screen before the cloud mouse identifier moves. Furthermore, according to the screenshot timing information corresponding to the screenshot time parameter, the moving images of the local mouse identifier and the cloud mouse identifier are captured at regular intervals, and the lag distance of the cloud mouse identifier relative to the local mouse identifier is calculated based on the image, and the delay measurement value is calculated based on the lag distance and the movement speed of the local mouse identifier, thereby improving the effectiveness and accuracy of calculating the delay of the two-way link between the local terminal and the cloud server.

[0073] Figure 4 The following is a schematic diagram schematically showing the process of the method for calculating the hysteresis distance according to some embodiments of the present disclosure. Figure 4 As shown, the hysteresis distance calculation method may include the following steps:

[0074] In step S410, an image pair corresponding to each screenshot timing information is generated, and pixel-level analysis is performed on the image pair to determine boundary pixel points of the image pair;

[0075] In step S420, the lag distance corresponding to each screenshot timing information is calculated based on the boundary pixel points.

[0076] The boundary pixel points may refer to the pixel points constituting the boundary of the image. The timing information may refer to the timing information of capturing the image of the movement of the cloud mouse mark and the local mouse mark.

[0077] The screenshot time parameters corresponding to the cloud mouse identifier and the local mouse identifier can be determined based on the script program, and each screenshot opportunity can be determined based on the screenshot time parameters, so that when the screenshot opportunity arrives, an image pair containing the cloud mouse identifier image and the local mouse identifier image at the same time can be captured. Furthermore, the image pair can be analyzed at the pixel level to determine the boundary pixel points of the cloud mouse identifier and the boundary pixel points of the local mouse identifier in the image pair, and the lag distance of the cloud mouse identifier relative to the local mouse identifier can be calculated based on the boundary pixel points of the cloud mouse identifier and the boundary pixel points of the local mouse identifier, so as to calculate the corresponding instantaneous delay measurement value between the cloud mouse identifier and the local mouse identifier at the screenshot opportunity according to the lag distance and the moving speed of the local mouse identifier.

[0078] Figure 5 The following is a schematic diagram schematically showing the process of the delay measurement value calculation method according to some embodiments of the present disclosure. Figure 5 As shown, the delay measurement value calculation method may include the following steps:

[0079] In step S510, the moving speed of the local mouse identifier is read, and based on the lag distance and the moving speed, the instantaneous perceived delay corresponding to each screenshot timing information is determined;

[0080] In step S520, an average value of all the instantaneous perceived delays is calculated, and the average value is used as the delay measurement value corresponding to each delay measurement process.

[0081] The instantaneous perceived delay may refer to a perceived delay calculated based on an instantaneous lag distance and an instantaneous moving speed of the mouse marker relative to the local mouse marker.

[0082] The moving speed of the local mouse can be read, for example, by obtaining the timing information of intercepting the moving images of the local mouse identifier and the cloud mouse identifier, and reading the moving speed of the local mouse corresponding to the timing information. After obtaining the instantaneous lag distance of the cloud mouse identifier corresponding to the timing information relative to the local mouse identifier, and the instantaneous moving speed of the local mouse identifier corresponding to the timing information, the instantaneous perceived delay between the cloud mouse identifier and the local mouse identifier at the time point corresponding to the timing information can be calculated.

[0083] Since multiple images can be captured during one movement of the cloud mouse identifier and the local mouse identifier, and multiple lag distances of the cloud mouse identifier relative to the local mouse identifier can be calculated, the movement speed of the local mouse identifier corresponding to each lag distance can also be read, and then the instantaneous perceived delay between multiple cloud mouse identifiers and the local mouse identifier can be obtained. After obtaining multiple instantaneous perceived delays during one movement of the cloud mouse identifier and the local mouse identifier, the multiple instantaneous perceived delays can be arithmetic averaged to obtain a delay measurement value during one movement of the cloud mouse identifier and the local mouse identifier.

[0084] Figure 6 The following is a schematic diagram schematically showing the process of the standard delay measurement value calculation method according to some embodiments of the present disclosure. Figure 6 As shown, the standard delay measurement method may include the following steps:

[0085] In step S610, the delay measurement value is standardized to obtain a standard delay measurement value;

[0086] In step S620, the standard delay measurement value is used as the bidirectional link delay between the local terminal and the cloud server.

[0087] Among them, the standard delay measurement value may refer to the delay measurement value obtained by standardizing the delay measurement values ​​corresponding to each delay measurement process. For example, the standard delay measurement value may be the delay measurement value obtained by performing arithmetic averaging on all the delay measurement values ​​in each delay measurement process. The standard delay measurement value may also be the delay measurement value obtained by performing weighted averaging on all the delay measurement values ​​in each delay measurement process. Of course, the standard delay measurement value may also be the delay measurement value obtained by performing other standardized processing on the delay measurement values ​​corresponding to each delay measurement process. This embodiment does not make any special limitation to this.

[0088] The delay measurement value in each delay measurement process can be obtained, and all the delay measurement values ​​are standardized to obtain a standard delay measurement value. For example, all the delay measurement values ​​are arithmetic averaged to obtain a standard delay measurement value, and the standard delay measurement value is used as the two-way link delay between the local terminal and the cloud server, thereby avoiding calculating only the delay between the local terminal and the cloud server, and also avoiding directly using a single delay from the local terminal to the cloud server, and from the cloud server to the local terminal as the two-way link delay between the local terminal and the cloud server. The delay measurement value obtained by performing multiple delay measurement processes on the cloud mouse identifier and the local mouse identifier is standardized to obtain a standard delay measurement value, and the standard delay measurement value is used as the two-way link delay from the local terminal to the cloud server, and from the cloud server to the local terminal, thereby improving the calculation accuracy of the two-way delay between the local terminal and the cloud server.

[0089] Figure 7 The following is a schematic diagram schematically showing the process of the cloud mouse marker moving method according to some embodiments of the present disclosure. Figure 7 As shown, the cloud mouse marker moving method may include the following steps:

[0090] In step S710, a communication connection is established with a cloud server, and a control protocol is acquired in response to a trigger operation of running a script program;

[0091] In step S720, the control protocol is sent to the cloud server, so that the cloud server creates the cloud container, and controls the cloud mouse marker to move in the cloud container based on the control protocol.

[0092] Among them, by establishing a communication connection with the cloud server, when the local terminal detects a trigger operation to run the script program, a pre-configured control protocol can be obtained, and while the script program is running in the local terminal, the control protocol can be sent to the cloud server, so that the cloud server creates a control for controlling the cloud mouse marker to simulate the movement of the local mouse marker in the cloud container.

[0093] A communication connection between a local terminal device and a cloud device can be established through a network transmission protocol, and when a trigger operation for running a script program is detected, a control protocol is obtained and transmitted to a cloud server, so that the cloud server creates a cloud container, and controls the cloud mouse identifier to move in the cloud container based on the control protocol, and transmits the video image back to the local terminal. When receiving the video image transmitted by the cloud server, multiple delay measurement processes can be performed on the cloud mouse identifier and the local mouse identifier based on the script program to simulate the two-way link delay from the local terminal to the cloud server, and from the cloud server to the local terminal during the cloud game by performing multiple delay measurement processes.

[0094] Specifically, in the process of performing multiple delay measurements on the cloud mouse identifier and the local mouse identifier, each delay measurement process not only includes the processes of web page generation, web page encoding transmission, web page decoding, and web page rendering, but also includes the cloud mouse identifier simulating the movement of the local mouse identifier in the cloud container, and transmitting the video screen showing the movement trajectory of the cloud mouse identifier back to the local terminal, etc., so that each delay measurement process is close to the two-way link delay measurement process from the local terminal to the cloud server, and from the cloud server to the local terminal in the cloud game, thereby improving the calculation accuracy of the two-way link delay between the local terminal and the cloud server during the cloud game, and improving the convenience and intuitiveness of calculating the two-way link delay between the local terminal and the cloud server during the cloud game.

[0095] Figure 8 The following is a schematic diagram schematically showing the process of another delay calculation method according to some embodiments of the present disclosure. Figure 8 As shown, the delay calculation method may include the following steps:

[0096] In step S810, in response to a trigger operation of running a script program, a local mouse marker is controlled to move on a local terminal;

[0097] In step S820, a communication connection is established with the server, and a control protocol is obtained, and the control protocol is sent to the cloud server, so that the cloud server creates a cloud container, and controls the cloud mouse identifier to simulate the movement of the local mouse identifier in the cloud container based on the control protocol;

[0098] In step S830, the number of times the cloud mouse identifier simulates the movement of the local terminal identifier in the cloud container is determined based on the script program, and a video image for displaying the movement track of the cloud mouse identifier is received from the cloud server during a single movement;

[0099] In step S840, the screenshot time parameters corresponding to each movement process of the script program are read, and during a single movement process of the cloud mouse identifier and the local mouse identifier, the images of the movement of the cloud mouse identifier and the local mouse identifier are captured in a timely manner according to the screenshot timing information in the screenshot time parameters;

[0100] In step S850, pixel-level analysis is performed on the image corresponding to each screenshot timing information to determine the boundary pixel points of the cloud mouse identifier and the boundary pixel points of the local mouse identifier, and the lag distance of the cloud mouse identifier relative to the local mouse identifier is calculated based on the boundary pixel points of the cloud mouse identifier and the local mouse identifier;

[0101] In step S860, the moving speed of the local mouse identifier corresponding to each screenshot time point is read, and the instantaneous delay measurement value between the local terminal and the cloud server is calculated according to the lag distance of the cloud mouse identifier corresponding to each screenshot time information relative to the local mouse identifier and the moving speed of the local mouse identifier;

[0102] In step S870, the average value of all instantaneous delay measurement values ​​during a single movement of the cloud mouse identifier and the local mouse identifier is calculated, and the average value is used as the delay measurement value corresponding to the single movement of the cloud mouse identifier and the local mouse identifier;

[0103] In step S880, the delay measurement values ​​corresponding to each movement process of the cloud mouse identifier and the local mouse identifier are obtained, and all delay measurements are standardized to obtain standard delay measurement values, so as to use the standard delay measurement values ​​as the bidirectional link delay measurement values ​​between the local terminal and the cloud server.

[0104] After establishing a communication connection between the local terminal device and the server, a trigger operation for running a script program on the local terminal device can be detected; if a trigger operation for running a script program is detected, a control protocol can be obtained and sent to a cloud server, so that the cloud server can create a cloud container, and control the cloud mouse identifier to move in the cloud terminal container based on the control protocol, and transmit a video screen for showing the real-time movement of the cloud mouse identifier back to the local terminal. When the local terminal device receives the video screen, it can take screenshots of the cloud mouse identifier and the local mouse identifier based on the screenshot time parameter in the script program, and perform multiple delay measurement processes, and then calculate the two-way link delay between the local terminal and the cloud server based on the delay measurement values ​​corresponding to each delay measurement process.

[0105] For example, the script program is set to execute 5 delay measurements of the cloud mouse identifier and the local mouse identifier, that is, the movement of the cloud mouse identifier and the local mouse identifier is observed 5 times; at the same time, the screenshot time parameters of each delay measurement process are set in the script program, for example, the movement duration of the local mouse identifier in the first delay measurement process is 2 seconds, and the screenshot time parameters in the first delay measurement process are {200 milliseconds, 500 milliseconds, 800 milliseconds, 1100 milliseconds, 1400 milliseconds}, that is, the screenshot timing information of the local mouse identifier in the first movement process is: the first screenshot when the local mouse identifier moves 200 milliseconds, the second screenshot when the local mouse identifier moves 500 milliseconds, the third screenshot when the local mouse identifier moves 800 milliseconds, the fourth screenshot when the local mouse identifier moves 1100 milliseconds, and the fifth screenshot when the local mouse identifier moves 1400 milliseconds, and an image pair containing the cloud mouse identifier and the local mouse identifier can be obtained in each screenshot process. Similarly, the images of the local mouse identifier and the cloud mouse identifier in the video screen can be captured regularly according to the screenshot time parameters in other delay measurement processes set in the script program and the screenshot timing information in the screenshot time parameters. At the same time, in a single delay measurement process, after obtaining each image pair containing the cloud mouse identifier and the local mouse identifier, the image pair is analyzed at the pixel level to determine the boundary pixel points of the cloud mouse identifier and the boundary pixel points of the local mouse identifier; then, the lag distance of the cloud mouse identifier relative to the local mouse identifier is calculated based on the boundary pixel points, and the moving speed of the local mouse identifier is read, and the instantaneous two-way link delay between the local terminal and the cloud server is calculated based on the lag distance and the moving speed; after obtaining all the instantaneous perceived delays in the single delay measurement process of the cloud mouse identifier and the local mouse identifier, all the instantaneous delay perceptions can be averaged to obtain the average value corresponding to all the instantaneous perceived delays, and the average value is used as the two-way link delay measurement value of the local terminal and the cloud server in this delay measurement process.

[0106] Similarly, five bidirectional link delay measurement values ​​obtained during the five delay measurement processes of the cloud mouse identifier and the local mouse identifier can be obtained. Furthermore, the bidirectional link delay between the local terminal and the cloud server can be calculated based on the five bidirectional link delay measurement values. For example, the five bidirectional link delay measurement values ​​can be standardized, such as performing arithmetic averaging on the five delay measurement values ​​to obtain the arithmetic mean corresponding to the five bidirectional link delay measurement values, and the arithmetic mean is used as the bidirectional link delay between the local terminal and the cloud server obtained after performing five delay measurement processes on the cloud mouse identifier and the local mouse identifier.

[0107] By calling the script program, the local mouse identifier moves on the local terminal, and based on the control protocol, the cloud mouse identifier is controlled to simulate the movement of the local mouse identifier in the cloud container created by the cloud server, and the video screen of the cloud mouse identifier simulating the movement of the local mouse identifier is returned in real time to perform a delay measurement process on the local mouse identifier and the cloud mouse identifier in the video screen, which reduces the complexity of calculating the two-way link delay measurement between the local terminal and the cloud server in the cloud gaming environment, and also reduces the labor cost of measuring the two-way link delay measurement between the local terminal and the cloud server; at the same time, by controlling the cloud mouse identifier to simulate the movement of the local mouse identifier in the cloud container, the cloud gaming environment is restored. The two-way link delay between the local terminal and the cloud server, and between the cloud server and the local terminal, improves the intuitiveness and authenticity of calculating the two-way link delay between the local terminal and the cloud server; in addition, by obtaining the delay measurement value corresponding to each delay measurement process, and standardizing the delay measurement value to obtain a standard delay measurement value, and using the standard delay measurement value as the two-way link delay between the local terminal and the cloud server, it avoids directly using the delay measurement value in a single delay measurement process of the cloud mouse marker and the local mouse marker as the two-way link delay between the local terminal and the cloud server, thereby improving the accuracy of calculating the two-way link delay between the local terminal and the cloud server.

[0108] It should be noted that although the various steps of the method in the present disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc. At the same time, since the delay between the cloud server and the game server is different for different games, the delay between the cloud server and the game server (in-game delay) may not be used as a standard for calculating the two-way link delay between the local terminal and the cloud server in the cloud game in this solution, but the delay calculation method based on the in-game delay and the two-way link delay measurement still falls within the protection scope of the delay calculation method of this solution.

[0109] In addition, in this exemplary embodiment, a delay calculation device is also provided. Fig. 9As shown, the delay calculation device 900 includes: a mobile control module 910, a delay measurement module 920, and a delay calculation module 930. Among them: the mobile control module 910 is used to control the movement of the local mouse identifier through a script program, and control the movement of the cloud mouse identifier in the cloud server based on the control protocol; the delay measurement module 920 is used to receive the video screen sent back by the cloud server for displaying the movement trajectory of the cloud mouse identifier, and perform multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video screen; the perception delay calculation module 930 is used to obtain the delay measurement value corresponding to each delay measurement process, and calculate the two-way link delay between the local terminal and the cloud server based on the delay measurement value; the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier.

[0110] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module 920 includes a mobile event triggering unit, and the delay measurement unit is used to control the local mouse identifier to move in the local terminal in response to an event that triggers the execution of the script program, and to make the cloud mouse identifier simulate the movement of the local mouse identifier in the cloud container created by the cloud server; and obtain the local mouse identifier and the image of the cloud mouse identifier moving in the cloud container.

[0111] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module 920 includes an image capture unit, which is used to read the screenshot time parameters in the script program and determine each screenshot timing information corresponding to the screenshot time parameters; according to the each screenshot timing information, the image of the local mouse identifier and the cloud mouse identifier moving in the cloud container is captured at regular intervals.

[0112] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay measurement module 920 also includes a lag distance calculation unit, which is used to generate image pairs corresponding to the screenshot timing information, and perform pixel-level analysis on the image pairs to determine boundary pixel points of the image pairs; based on the boundary pixel points, calculate the lag distance corresponding to the screenshot timing information.

[0113] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay calculation module 930 includes a delay measurement value determination unit, which is used to read the moving speed of the local mouse identifier, and determine the instantaneous perceived delay corresponding to each screenshot timing information based on the lag distance and the moving speed; calculate the average value of all the instantaneous perceived delays, and use the average value as the delay measurement value corresponding to each delay measurement process.

[0114] In some example embodiments of the present disclosure, based on the aforementioned scheme, the delay calculation module 930 also includes a delay calculation unit, which is used to standardize the delay measurement value to obtain a standard delay measurement value; and use the standard delay measurement value as the bidirectional link delay between the local terminal and the cloud server.

[0115] In some example embodiments of the present disclosure, based on the aforementioned scheme, the mobile control module 910 includes a mobile control unit, which is used to establish a communication connection with the server, and obtain a control protocol in response to a trigger operation of running a script program; send the control protocol to the cloud server so that the cloud server creates the cloud container, and control the cloud mouse marker to move in the cloud container based on the control protocol.

[0116] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, any one of the delay calculation methods described above is implemented.

[0117] The specific details of each module of the delay calculation device mentioned above have been described in detail in the corresponding delay calculation method, so they will not be repeated here.

[0118] It should be noted that although several modules or units of the delay calculation device are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0119] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above delay calculation method is also provided.

[0120] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware embodiments, complete software embodiments (including firmware, microcode, etc.), or embodiments combining hardware and software aspects, which may be collectively referred to herein as "circuits", "modules" or "systems".

[0121] Refer to the following Fig.10 hereinafter describes the electronic device 1000 according to such an embodiment of the present disclosure. Fig.10The electronic device 1000 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0122] like Fig.10 As shown, the electronic device 1000 is in the form of a general computing device. The components of the electronic device 1000 may include but are not limited to: the at least one processing unit 1010, the at least one storage unit 1020, a bus 1030 connecting different system components (including the storage unit 1020 and the processing unit 1010), and a display unit 1040.

[0123] The storage unit stores program codes, which can be executed by the processing unit 1010, so that the processing unit 1010 performs the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 1010 can perform the following steps: Figure 1 In step S110, the movement of the local mouse identifier is controlled by a script program, and the movement of the cloud mouse identifier in the cloud server is controlled based on the control protocol; in step S120, a video screen transmitted by the cloud server for displaying the movement trajectory of the cloud mouse identifier is received, and multiple delay measurement processes are performed on the local mouse identifier and the cloud mouse identifier in the video screen; in step S130, a delay measurement value corresponding to each delay measurement process is obtained, and a two-way link delay between the local terminal and the cloud server is calculated based on the delay measurement value; the delay measurement value is obtained by multiple calculations of the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier.

[0124] The storage unit 1020 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 1021 and / or a cache memory unit 1022 , and may further include a read-only memory unit (ROM) 1023 .

[0125] The storage unit 1020 may also include a program / utility 1024 having a set (at least one) of program modules 1025, such program modules 1025 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0126] Bus 1030 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0127] The electronic device 1000 may also communicate with one or more external devices 1070 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1000, and / or may communicate with any device that enables the electronic device 1000 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1050. In addition, the electronic device 1000 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 1060. As shown, the network adapter 1060 communicates with other modules of the electronic device 1000 via a bus 1030. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0128] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0129] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of the present specification.

[0130] refer to Fig.11 As shown, a program product 1100 for implementing the above-mentioned delay calculation method according to an embodiment of the present disclosure is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0131] The program product may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0132] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0133] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0134] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0135] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0136] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0137] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0138] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A delay calculation method, characterized in that: include: Control the movement of the local mouse marker through the script program, and control the movement of the cloud mouse marker in the cloud server based on the control protocol; Receiving a video image transmitted by the cloud server for displaying the moving track of the cloud mouse identifier, and performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video image; Obtaining delay measurement values ​​corresponding to each delay measurement process, and calculating the bidirectional link delay between the local terminal and the cloud server based on the delay measurement values; the delay measurement values ​​are obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier; The delay measurement process includes: In response to an event that triggers the execution of the script program, controlling the local mouse identifier to move on the local terminal, and causing the cloud mouse identifier to simulate the movement of the local mouse identifier in a cloud container created by the cloud server; Reading the screenshot time parameter in the script program, and determining each screenshot timing information corresponding to the screenshot time parameter; According to the screenshot timing information, the local mouse marker and the image of the cloud mouse marker moving in the cloud container are captured at regular intervals.

2. The delay calculation method according to claim 1, characterized in that: The method further comprises: Generate image pairs corresponding to the timing information of each screenshot, and perform pixel-level analysis on the image pairs to determine boundary pixel points of the image pairs; Based on the boundary pixel points, a lag distance of the cloud mouse identifier corresponding to each screenshot timing information relative to the local mouse identifier is calculated.

3. The delay calculation method according to claim 1 or 2, characterized in that: The obtaining of the delay measurement value corresponding to each delay measurement process includes: Reading the moving speed of the local mouse identifier, and determining the instantaneous perceived delay corresponding to each screenshot timing information based on the lag distance and the moving speed; An average value of all the instantaneous perceived delays is calculated, and the average value is used as the delay measurement value corresponding to each delay measurement process.

4. The delay calculation method according to claim 1, characterized in that: Calculating the bidirectional link delay between the local terminal and the cloud server based on the delay measurement value includes: Standardizing the delay measurement values ​​corresponding to each delay measurement process to obtain a standard delay measurement value; The standard delay measurement value is used as the bidirectional link delay between the local terminal and the cloud server.

5. The delay calculation method according to claim 1, characterized in that: The method of controlling the movement of a cloud mouse marker in a cloud server based on a control protocol includes: Establishing a communication connection with a cloud server and acquiring the control protocol in response to a trigger operation of running the script program; The control protocol is sent to the cloud server, so that the cloud server creates the cloud container, and controls the cloud mouse marker to move in the cloud container based on the control protocol.

6. A delay calculation device, characterized in that: include: A movement control module, used to control the movement of a local mouse marker through a script program, and to control the movement of a cloud mouse marker in a cloud server based on a control protocol; A delay measurement module, used for receiving a video image transmitted by the cloud server for displaying the moving track of the cloud mouse identifier, and performing multiple delay measurement processes on the local mouse identifier and the cloud mouse identifier in the video image; A delay calculation module, used to obtain a delay measurement value corresponding to each delay measurement process, and calculate the bidirectional link delay between the local terminal and the cloud server based on the delay measurement value; the delay measurement value is obtained by repeatedly calculating the lag distance of the cloud mouse identifier in the video screen relative to the local mouse identifier; The delay measurement process includes: In response to an event that triggers the execution of the script program, controlling the local mouse identifier to move on the local terminal, and causing the cloud mouse identifier to simulate the movement of the local mouse identifier in a cloud container created by the cloud server; Reading the screenshot time parameter in the script program, and determining each screenshot timing information corresponding to the screenshot time parameter; According to the screenshot timing information, the local mouse marker and the image of the cloud mouse marker moving in the cloud container are captured at regular intervals.

7. An electronic device comprising: processor; as well as A memory having computer-readable instructions stored thereon, wherein the computer-readable instructions, when executed by the processor, implement the delay calculation method according to any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the delay calculation method according to any one of claims 1 to 5.

Images