Time delay measurement method and device, electronic equipment and computer readable medium

Abstract

The embodiment of the invention provides a time delay measurement method and device, electronic equipment and a computer readable medium. The time delay measurement method comprises the following steps: dividing the total time delay of the cloud mobile phone into client time delay of an entity client side, network transmission time delay and server time delay of a cloud mobile phone side; the client time delay, the network transmission time delay and the server time delay are measured respectively, and the time delay measurement mode comprises at least one of frequency recording measurement, log dotting measurement, analog flow measurement and real flow measurement.

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a method, device, electronic device and computer-readable medium for measuring latency. Background Art

[0002] Cloud phones are virtual phones running in the cloud, which can be controlled through physical phones or computer terminals to achieve many functions such as chatting, games, and video watching. When using cloud phones, cloud phone latency is one of the important factors affecting its user experience.

[0003] The current measurement method for cloud phone latency is mainly used to measure the total latency of cloud phones, such as the time difference from the user clicking on the physical client screen to the physical client screen displaying the response screen. There is a lack of method for segmented measurement of cloud phone latency. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a method, device, electronic device and computer-readable medium for delay measurement, which can overcome the problem of the lack of a method for segmented measurement of cloud phone delay.

[0005] To solve the above technical problems, the embodiments of the present application are implemented through the following aspects.

[0006] In a first aspect, an embodiment of the present application provides a method for delay measurement, including: dividing the total delay of a cloud phone into client delay on the physical client side, network transmission delay, and server delay on the cloud phone side; measuring the client delay, the network transmission delay, and the server delay respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement, and real traffic measurement.

[0007] In the second aspect, an embodiment of the present application provides a device for delay measurement, including: a division module, used to divide the total delay of a cloud phone into client delay on the physical client side, network transmission delay and server delay on the cloud phone side; a measurement module, used to measure the client delay, the network transmission delay and the server delay respectively, wherein the method of measuring the delay includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement and real traffic measurement.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory, a processor, and computer executable instructions stored in the memory and executable on the processor, wherein the computer executable instructions, when executed by the processor, implement the delay measurement method described in the first aspect above.

[0009] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method for measuring the delay described in the first aspect above is implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the delay measurement method described in the first aspect above.

[0011] In an embodiment of the present application, the total latency of the cloud phone is divided into the client latency on the physical client side, the network transmission latency and the server latency on the cloud phone side; the client latency, the network transmission latency and the server latency are measured respectively, wherein the method of measuring the latency includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement and real traffic measurement, thereby enabling segmented measurement of the cloud phone latency. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0013] Figure 1 A schematic diagram showing a flow chart of a delay measurement method provided in an embodiment of the present application;

[0014] Figure 2 Another schematic diagram of a delay measurement method provided in an embodiment of the present application is shown;

[0015] Figure 3 Another schematic diagram of a delay measurement method provided in an embodiment of the present application is shown;

[0016] Figures 4a to 4b A schematic diagram showing a method for measuring delay provided in an embodiment of the present application;

[0017] Figure 5 A schematic diagram showing the structure of a delay measurement device provided in an embodiment of the present application is shown;

[0018] Figure 6 A schematic diagram of the hardware structure of an electronic device for executing a delay measurement method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0020] A method for delay measurement provided in an embodiment of the present application can be performed by an electronic device, such as a terminal device or a server device or a network side device. In other words, the method can be performed by software or hardware installed on the above-mentioned device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The terminal device includes but is not limited to a mobile phone, a tablet computer, a laptop, a notebook computer, a personal digital assistant, a handheld computer, a netbook, a super mobile personal computer, a mobile Internet device, an augmented reality device, a virtual reality device, a robot, a wearable device), an aircraft, a vehicle-mounted device, a ship-mounted device, a pedestrian terminal, a smart home, a game console, a personal computer, a teller machine or a self-service machine and other terminal side devices. The network side device may include an access network device or a core network device, wherein the access network device may also be referred to as a radio access network (Radio Access Network, RAN) device, a radio access network function or a radio access network unit. The access network device may include a base station, a wireless local area network (Wireless Local Area Network, WLAN) access point (Access Point, AS) or a wireless fidelity (Wireless Fidelity, WiFi) node, etc. It should be noted that in the embodiments of the present application, only the base station in the 5G system is introduced as an example, and the specific type of the base station is not limited.The core network equipment may include but is not limited to at least one of the following: core network node, core network function, mobility management entity (Mobility Management Entity, MME), access mobility management function (Access and Mobility Management Function, AMF), session management function (Session Management Function, SMF), user plane function (UserPlane Function, UPF), policy control function (Policy Control Function, PCF), policy and charging rules function unit (Policy and Charging Rules Function, PCRF), edge application service discovery function (Edge Application Server Discovery Function, EASDF), unified data management (Unified Data Management, UDM), unified data storage (Unified Data Repository, UDR), home user server (Home Subscriber Server, HSS), centralized network configuration (CNC), network storage function (Network Repository Function, NRF), network exposure function (Network Exposure Function, NEF), local NEF (Local NEF, or L-NEF), binding support function (Binding Support Function, BSF), application function (Application Function, AF), etc. It should be noted that in the embodiment of the present application, only the core network device in the 5G system is introduced as an example, and the specific type of the core network device is not limited.

[0021] Figure 1 A flow chart of a method for measuring delay provided in an embodiment of the present application is shown. As shown in the figure, the method may include the following steps S110 and S120.

[0022] Step S110: Divide the total latency of the cloud phone into client latency on the physical client side, network transmission latency, and server latency on the cloud phone side.

[0023] The total latency of a cloud phone is the total amount of latency generated during the use of the cloud phone, such as the time difference between the moment a user clicks on the screen of a physical client and the moment the screen of the physical client displays a response screen, where the response screen is the screen that responds to the user's click. During the use of a cloud phone, the client latency is the latency generated on the physical client side, which can be a physical phone, a physical computer, or other types of terminal devices mentioned above; the network transmission latency is the latency generated during the network transmission process; and the server latency is the latency generated on the cloud phone side.

[0024] In this step, the total cloud phone latency is divided into three different types of latency, namely client latency, network transmission latency, and server latency, according to the different locations where latency is generated. This division method can serve as the basis for latency segmentation measurement.

[0025] Step S120: respectively measuring the client delay, the network transmission delay and the server delay, wherein the delay measurement method includes at least one of recording frequency measurement, log dot measurement, simulated flow measurement and real flow measurement.

[0026] Recording measurement refers to a method of measuring latency by recording the screen of a physical client and analyzing the screen recording results frame by frame to obtain the response time; log dot measurement refers to a method of measuring latency by obtaining a log with added markers, where the log with added markers can be an operating system or application log; simulated traffic measurement refers to a method of measuring latency using simulated traffic; real traffic measurement refers to a method of measuring latency using real traffic during the use of a cloud phone.

[0027] This step proposes different measurement methods to measure different types of delays respectively.

[0028] In an embodiment of the present application, the total delay of the cloud phone is divided into the client delay on the physical client side, the network transmission delay and the server delay on the cloud phone side; the client delay, the network transmission delay and the server delay are measured respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement and real traffic measurement, the total delay of the cloud phone can be divided into different types of delays, and different measurement methods are proposed for different types of delays, so that the cloud phone delay can be measured in segments, thereby more specifically dealing with the cloud phone delay problem and optimizing the user experience of the cloud phone service.

[0029] In one possible implementation, reference Figure 2Another flow chart of a delay measurement method provided by an embodiment of the present application is shown, wherein the network transmission delay X includes a first network transmission delay X1 and a second network transmission delay X2, wherein the first network transmission delay X1 is used to represent the delay between the entity client side and the user plane function UPF, and the second network transmission delay X2 is used to represent the delay between the UPF and the cloud phone side. For example, X1 is the frame transmission delay between the entity client side and the UPF; X2 is the network delay between the UPF and the cloud phone side.

[0030] During the uplink transmission process, the network transmission delay X includes the delay from the physical client side to the UPF and the delay from the UPF to the cloud phone side; during the downlink transmission process, the network transmission delay X includes the delay from the cloud phone side to the UPF and the delay from the UPF to the physical client. In other words, X1 includes the delay from the physical client side to the UPF in the uplink transmission and the delay from the UPF to the physical client in the downlink transmission; X2 includes the delay from the UPF to the cloud phone side in the uplink transmission and the delay from the cloud phone side to the UPF in the downlink transmission. Optionally, the uplink transmission process is the process of command uplink transmission; the downlink transmission process is the process of audio and video downlink transmission.

[0031] In a possible implementation manner, measuring the network transmission delay includes: measuring the first network transmission delay X1 in a simulated flow measurement manner and / or a real flow measurement manner.

[0032] The first network transmission delay X1 may be measured by a flow measurement method; the first network transmission delay X1 may be measured by a real flow measurement method; or the first network transmission delay X1 may be measured by a combination of a simulated flow measurement method and a real flow measurement method.

[0033] The first network transmission delay X1 is measured in a simulated traffic measurement method, including: in the case of sending simulated traffic, according to the feedback of the UPF same-city router to the Internet packet explorer ping, the first network transmission delay X1 is determined. The simulated traffic is used to simulate the real traffic of the cloud phone, including uplink instructions, downlink frame video streams, frame rates, bit rates, etc. that simulate real traffic. The simulated traffic is generated by a simulated traffic generator according to actual scenarios, including game traffic, video traffic, or a group of traffic with different frame numbers. In the case of sending simulated traffic generated by a simulated traffic generator, the UDF same-city router can be pinged on the entity client side, and the first network transmission delay X1 can be determined based on the result of ping. In order to measure X1, a simulated traffic generator can be deployed in UPF. Among them, the ping operation can be based on the User Datagram Protocol (UDP). Optionally, the average service single packet delay can be calculated by calculating the service single packet and single frame transmission simulation UDP ping.

[0034] The first network transmission delay X1 is measured in a simulated traffic measurement mode and a real traffic measurement mode, including: measuring the second network transmission delay X2; determining the network transmission delay X according to the feedback of the cloud phone side on ping; determining the first network transmission delay X1 according to the network transmission delay X and the second network transmission delay X2. The real traffic can use the real traffic used by the physical client, or a real traffic generator can be constructed to generate real traffic with reference to the real traffic used by the physical client. An application for measuring real traffic is installed on the physical client and the cloud phone side respectively. Through the above application, combined with the log of the operating system and / or application, the second network transmission delay X2 can be obtained. For example, X2 can be measured by the SpeedCloud tool in a simulated business flow mode. On the physical client side, the network transmission delay X can be obtained by pinging the server on the cloud phone side. According to the network transmission delay X and the second network transmission delay X2, the first network transmission delay X1 can be measured, that is, X1=X-X2. Optionally, based on the operating system and application related logs, evaluation indicators related to jamming, delay, and clarity can also be obtained.

[0035] In an embodiment of the present application, the network transmission delay is further divided, and a measurement method for the divided first network transmission delay and the second network transmission delay is provided, which can measure the delay at different stages of the network transmission process.

[0036] Figure 3 Another flow chart of a method for measuring delay provided by an embodiment of the present application is shown. Figure 3In a possible implementation, the client delay includes a decoding delay T4, and the server delay includes an encoding delay T3. The decoding delay T4 refers to the time delay caused by data decoding; the encoding delay T3 is the time delay caused by data encoding. Optionally, T4 includes the frame waiting time on the client side; T3 includes the sending waiting time on the server side.

[0037] Measuring the client delay includes measuring the decoding delay T4 by log dotting measurement method and / or simulated flow measurement method; measuring the server delay includes measuring the encoding delay T3 by log dotting measurement method and / or simulated flow measurement method. It can be understood that the decoding delay T4 can be measured by log dotting measurement method alone, and the decoding delay T4 can also be measured by simulated flow measurement method alone. Combining the above two methods, for example, using the measurement results of the simulated flow measurement method to verify the measurement results of the log dotting measurement method, can improve the accuracy of the decoding delay measurement. Similarly, the encoding delay T3 can be measured by log dotting measurement method alone, and the encoding delay T3 can also be measured by simulated flow measurement method alone. Combining the above two methods, for example, using the measurement results of the simulated flow measurement method to verify the measurement results of the log dotting measurement method, can improve the accuracy of the encoding delay measurement.

[0038] In a possible implementation, the client delay includes a screen display delay T1, and the screen display delay T1 is used to represent the time between the first moment when the user clicks the physical client screen and the second moment when the physical client screen responds to the click operation. Measuring the client delay includes: measuring the screen display delay T1 by means of a video recording measurement through an external camera. The screen display delay T1 is usually difficult to perceive with the naked eye, and users often think that the first moment and the second moment are the same moment, that is, the screen will respond when the screen is touched. However, by recording the screen at a high frame rate, such as recording the screen at a frame rate of 90fps (frames per second), the difference between the two moments, namely the screen display delay T1, can be found.

[0039] It should be noted that the screen display delay is different from the total delay of the cloud phone in the aforementioned embodiment. On the one hand, the screen display delay is a part of the client delay, while the total delay of the cloud phone is the sum of the client delay, the network transmission delay and the server delay. On the other hand, the start time of both is the first moment when the user clicks on the physical client screen, but the difference is that the end time of the screen display delay is the second moment when the client screen responds to the click operation, and the end time of the total delay of the cloud phone is the moment when the client screen displays the response screen. Taking the user using the cloud phone to operate a role-playing game as an example, the second moment is the moment when a pointer (for example, a crosshair) appears on the screen in response to the user's click operation; the moment when the screen displays the response screen is the moment when the character's attack range (for example, an aperture) appears on the screen.

[0040] In the embodiment of the present application, the client delay is subdivided, so that the client delay problem can be dealt with more specifically.

[0041] In one possible implementation, the method for measuring latency also includes: measuring the total latency of the cloud phone by recording the video through an external camera. The total latency of the cloud phone is also called the screen-to-screen (G2G) latency, which is the time difference between the first moment when the user touches the screen of the physical client and the time when the physical client screen displays a response screen, where the response screen is a screen that responds to the user's click operation. For example, in the example of the aforementioned role-playing game, the screen includes the character's attack range.

[0042] The server-side delay includes rendering delay T2. Measuring the server-side delay includes: determining the rendering delay T2 based on the total cloud phone delay, the client delay, the network transmission delay, and the encoding delay T3 included in the server-side delay. Rendering delay T2 refers to the delay caused by graphics or game rendering, which may include delays caused by instruction processing, rendering, content acquisition, etc. Optionally, T2 = total cloud phone delay - client delay - network transmission delay - T3. Among them, the total cloud phone delay can be expressed as G2G delay.

[0043] In an embodiment of the present application, the total delay of the cloud phone is divided into the client delay on the physical client side, the network transmission delay and the server delay on the cloud phone side; the client delay, the network transmission delay and the server delay are measured respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement and real traffic measurement, the total delay of the cloud phone can be divided into different types of delays, and different measurement methods are proposed for different types of delays, so that the cloud phone delay can be measured in segments, thereby more specifically dealing with the cloud phone delay problem and optimizing the user experience of the cloud phone service.

[0044] In a possible implementation, the server delay also includes the server frame waiting delay Y. When using the simulated traffic measurement method, T1=0; T2=0; T3=0; T4=0 can be set to measure X+Y. According to the above embodiment, X can be measured, so Y can be determined. Based on the determined Y, using the real traffic measurement method, T2=G2G delay-T1-T3-T4-XY.

[0045] Still refer to Figure 3 In a possible implementation, taking the use of a physical mobile phone to operate a role-playing game as an example, a method for measuring latency includes the following steps:

[0046] 1) Measure the total latency of the cloud phone (G2G latency), that is, measure the time difference between clicking the physical phone screen and the physical phone screen displaying the response screen. Clicking the physical phone screen includes touching the screen with a finger or a stylus.

[0047] 2) Use an external camera to measure the time difference T1 between clicking the physical phone screen and the screen displaying the click coordinates.

[0048] 3) Measure the rendering delay T2 and frame waiting delay Y.

[0049] 4) Measure the coding delay T3.

[0050] 5) Measure the decoding delay T4.

[0051] 6) Measure the frame transmission delay X1 between the client and UPF.

[0052] 7) Measure the network delay X2 between UPF and the server.

[0053] Among them, the influencing factors of T1 and G2G delay include terminal performance, that is, the performance of the physical mobile phone, including but not limited to the terminal CPU computing power, terminal running memory, terminal operating system, terminal display refresh rate, etc. Optionally, the terminal performance can be reflected in the terminal model. The influencing factors of T2 include the physical distance of the cloud phone and the number of applications opened simultaneously on the physical phone. The influencing factors of T3 include the resolution and bit rate of the cloud phone. The influencing factors of T4 include the frame rate and decoding cache of the cloud phone. The influencing factors of X2 include the distance between the cloud phone and the physical recipient, mainly the physical distance. The influencing factors of X1 include the fluctuation of the wireless network. Optionally, Y is the frame buffer queue waiting delay set for the stable frame rate; X1+X2 is the delay caused by network fluctuation and transmission distance when the data source is stable. Optionally, T1 can be used to characterize the performance of the physical mobile phone; T1+T2 can be used to characterize the performance of the application used by the physical mobile phone; T1+T2+Y+T3+T4 can be used to characterize the performance of the application directly connected to the cloud phone; T1+T2+Y+T3+T4+X can be used to characterize the performance of the cloud phone application on the wide area network.

[0054] In a possible implementation, a method for delay measurement also includes evaluating and optimizing the cloud phone service using the delay obtained above. The cloud phone service experience can be evaluated through three dimensions: source quality, presentation quality, and interaction quality. The experience of the three dimensions affects each other. When the network conditions cannot meet the optimal conditions of all three dimensions, a certain quality of service (QoS) strategy can be used to ensure the basic experience of users. For example, by reducing the resolution and bit rate, no lag is guaranteed; or by reducing the resolution and bit rate, fast interaction response is guaranteed. In the source quality dimension, indicators that affect the picture quality include picture bit rate, picture frame rate, picture resolution, screen refresh rate, screen resolution, and picture encoding; indicators that affect audio quality include audio bit rate, number of audio channels, and audio encoding of the input layer; picture quality, audio quality, and audio-visual synchronization further affect the audio-visual quality. In the presentation quality dimension, the average lag duration, lag frequency, and data loss rate affect the integrity and continuity of perception. In the interaction quality dimension, the operation response time affects the interaction quality.

[0055] In the embodiment of the present application, the key factors affecting the latency of cloud phones can be determined so that corresponding measures can be taken to reduce the latency of cloud phone operation and improve the end-to-end experience of cloud phones. Improving the end-to-end experience of cloud phones includes being able to observe the end-to-end cloud phone applications and mark the applications to visualize the full experience data; being able to accurately locate problems in the end-to-end process; and being able to optimize the full-link latency in stages.

[0056] In one possible implementation, reference Figure 4a, still taking the use of a physical mobile phone to operate a role-playing game as an example, in a method of delay measurement, t1 represents the moment of touching the screen of the physical mobile phone, t2 represents the moment when the pointer crosshairs appear on the physical mobile phone, t3 represents the moment when the pointer crosshairs appear on the cloud mobile phone, t4 represents the moment when the character attack range aperture appears on the cloud mobile phone, t5 represents the moment when the pointer crosshairs of the physical mobile phone are rendered and photographed on the upper screen, and t6 represents the moment when the character attack range aperture of the cloud mobile phone is rendered and photographed on the upper screen. Among them, the time difference P1 between t2 and t5 can be used to represent the processing delay of the physical mobile phone to perform the game operation; the time difference P2 between t5 and t6 can be used to represent the processing delay of the cloud mobile phone to perform the game operation. The process from the appearance of the pointer crosshairs to the appearance of the character attack range aperture of the physical mobile phone and the cloud mobile phone is recorded by high frame rate screen recording (90fps), wherein the picture of the pointer crosshairs appearing in the physical mobile phone or cloud mobile phone is the starting frame, and the picture of the character attack range aperture appearing in the physical mobile phone or cloud mobile phone is the ending frame. P1 and P2 are calculated using video processing software. The difference between P1 and P2 is the additional delay caused by the cloud mobile phone. Table 1 below shows a set of actual measured values.

[0057] Table 1

[0058] Cloud Phone P2(ms) Physical mobile phone P1(ms) P1-P2(ms) Mean 49.7 18.25 31.45 p90 53.9 23.1 -- p95 57.95 23.55 --

[0059] Referring to the measured values ​​in Table 1, it can be seen that the cloud phone P2 is about 50 milliseconds (ms), and the physical phone P1 is about 18ms. Using TST tools, such as TST Cloud X, simulate the real traffic of the cloud phone to measure the network transmission frame delay X. The current network test X1 is about 65ms@95% at the far point. Among them, the above-mentioned real traffic measurement method includes the server starting to send video frames, where one frame buffer needs to be subtracted from the actual sending distance; the client receives the last data packet of the video frame, and the time is 10ms different from the actual receipt of the last packet by the network layer; the client sends a confirmation message ACK to the server; and the server receives ACK. In the above process, Frame TransLatency is used. The time from the server sending the video frame to receiving the ACK returned by the client is the loop delay of the entire link. X = loop delay-33, where 33 is the time required for the server to cache one frame.

[0060] Figure 4b The figure shows the frame transmission delay X measured in the TST live network. The test environment is a 2.6G network in a certain place. The number of users in the test period is less than 15, and the physical resource block (PRB) utilization rate during the uplink and downlink busy hours is less than 10%. The X1 frame transmission near-point delay p95 is about 30ms; the X1 delay 65ms@95% level is RSRP-105-107dBm.

[0061] In an embodiment of the present application, the total delay of the cloud phone is divided into the client delay on the physical client side, the network transmission delay and the server delay on the cloud phone side; the client delay, the network transmission delay and the server delay are measured respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement and real traffic measurement, the total delay of the cloud phone can be divided into different types of delays, and different measurement methods are proposed for different types of delays, so that the cloud phone delay can be measured in segments, thereby more specifically dealing with the cloud phone delay problem and optimizing the user experience of the cloud phone service.

[0062] Figure 5 A schematic diagram of the structure of a delay measurement device provided in an embodiment of the present application is shown, and the device 500 includes: a division module 510 and a measurement module 520. The division module 510 is used to divide the total delay of the cloud phone into the client delay on the physical client side, the network transmission delay, and the server delay on the cloud phone side; the measurement module 520 is used to measure the client delay, the network transmission delay, and the server delay respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated flow measurement, and real flow measurement.

[0063] In one possible implementation, the network transmission delay includes a first network transmission delay and a second network transmission delay. The first network transmission delay is used to represent the delay between the entity client side and the user plane function UPF, and the second network transmission delay is used to represent the delay between the UPF and the cloud phone side.

[0064] In a possible implementation, the measurement module 520 is used to measure the first network transmission delay in a simulated flow measurement manner and / or a real flow measurement manner.

[0065] In a possible implementation, the measurement module 520 is used to determine the first network transmission delay according to the feedback of the UPF same-city router to the Internet packet explorer ping when sending simulated traffic.

[0066] In one possible implementation, the measurement module 520 is used to measure the second network transmission delay; determine the network transmission delay based on the feedback of the ping from the cloud phone side; and determine the first network transmission delay based on the network transmission delay and the second network transmission delay.

[0067] In a possible implementation, the client delay includes a decoding delay, and the server delay includes an encoding delay.

[0068] In a possible implementation, the measurement module 520 is used to measure the decoding delay by log dot measurement and / or simulated flow measurement; the measurement module 520 is also used to measure the encoding delay by log dot measurement and / or simulated flow measurement.

[0069] In one possible implementation, the client delay includes a screen display delay, and the screen display delay is used to represent the time between a first moment when a user clicks on a physical client screen and a second moment when the physical client screen responds to the click operation; the measurement module 520 is used to measure the screen display delay by means of a video recording measurement through an external camera.

[0070] In a possible implementation, the measurement module 520 is also used to measure the total delay of the cloud phone by using an external camera in a video recording measurement manner.

[0071] In one possible implementation, the server delay includes a rendering delay, and the measurement module 520 is used to determine the rendering delay based on the total delay of the cloud phone, the client delay, the network transmission delay, and the encoding delay included in the server delay.

[0072] The device 500 provided in the embodiment of the present application can execute the various methods described in the foregoing method embodiments, and realize the functions and beneficial effects of the various methods described in the foregoing method embodiments, which will not be repeated here.

[0073] Figure 6 A schematic diagram of the hardware structure of an electronic device that performs a method for delay measurement provided in an embodiment of the present application is shown. Referring to the figure, at the hardware level, the electronic device 600 includes a processor 610, and optionally, an internal bus 620, a network interface 630, and a memory. Among them, the memory may include a memory, such as a high-speed random access memory (Random-Access Memory, RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage, etc. Of course, the electronic device may also include hardware required for other services.

[0074] The processor 610, the network interface 630 and the memory may be connected to each other via an internal bus 620, which may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0075] The memory is used to store programs. Specifically, the program may include program codes, and the program codes include computer operation instructions. The memory may include a memory 640 and a non-volatile memory 650, and provide instructions and data to the processor 610.

[0076] The processor 610 reads the corresponding computer program from the non-volatile memory 650 into the memory 640 and then runs it, forming a device for locating the target user at the logical level. The processor 610 executes the program stored in the memory and is specifically used to perform: dividing the total delay of the cloud phone into the client delay of the physical client side, the network transmission delay and the server delay of the cloud phone side; measuring the client delay, the network transmission delay and the server delay respectively, wherein the delay measurement method includes at least one of recording frequency measurement, log dot measurement, simulated flow measurement, and real flow measurement.

[0077] The above application Figures 1 to 4bThe method disclosed in the illustrated embodiment can be applied to the processor 610 or implemented by the processor 610. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0078] The electronic device 600 can also execute the methods described in the foregoing method embodiments, and realize the functions and beneficial effects of the methods described in the foregoing method embodiments, which will not be described in detail here.

[0079] Of course, in addition to software implementation methods, the electronic device of the present application does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0080] An embodiment of the present application also proposes a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by an electronic device including multiple application programs, the electronic device performs the following operations: divide the total delay of the cloud phone into the client delay on the physical client side, the network transmission delay and the server delay on the cloud phone side; measure the client delay, the network transmission delay and the server delay respectively, wherein the method of measuring the delay includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement, and real traffic measurement.

[0081] The computer-readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0082] Furthermore, an embodiment of the present application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the following process is implemented: the total delay of the cloud phone is divided into the client delay on the physical client side, the network transmission delay and the server delay on the cloud phone side; the client delay, the network transmission delay and the server delay are measured respectively, wherein the method of measuring the delay includes at least one of frequency recording measurement, log dot measurement, simulated traffic measurement, and real traffic measurement.

[0083] In short, the above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0084] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0085] Computer readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change RAM (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0086] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0087] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Claims

1. A method for delay measurement, characterized in that: include: The total latency of the cloud phone is divided into the client latency on the physical client side, the network transmission latency, and the server latency on the cloud phone side; The client delay, the network transmission delay and the server delay are measured respectively, wherein the delay measurement method includes at least one of frequency recording measurement, log dot measurement, simulated flow measurement and real flow measurement.

2. The method according to claim 1, characterized in that The network transmission delay includes a first network transmission delay and a second network transmission delay. The first network transmission delay is used to represent the delay between the entity client side and the user plane function UPF, and the second network transmission delay is used to represent the delay between the UPF and the cloud phone side.

3. The method according to claim 2, characterized in that Measuring the network transmission delay includes: The first network transmission delay is measured by a simulated flow measurement method and / or a real flow measurement method.

4. The method according to claim 3, characterized in that Measuring the first network transmission delay in a simulated traffic measurement manner includes: When sending simulated traffic, the first network transmission delay is determined based on the feedback of the UPF same-city router to the Internet packet explorer ping.

5. The method according to claim 3, characterized in that: Measuring the transmission delay of the first network by using a simulated flow measurement method and a real flow measurement method, including: Measure and obtain the second network transmission delay; Determine the network transmission delay based on the feedback of the ping from the cloud phone side; The first network transmission delay is determined according to the network transmission delay and the second network transmission delay.

6. The method according to claim 1, characterized in that The client delay includes decoding delay, and the server delay includes encoding delay.

7. The method according to claim 6, characterized in that Measuring the client delay, including: Measuring the decoding delay by means of a log dot measurement method and / or a simulated flow measurement method; Measuring the server delay includes: The encoding delay is measured by a log dot measurement method and / or a simulated flow measurement method.

8. The method according to claim 1, characterized in that: The client delay includes a screen display delay, and the screen display delay is used to represent the time between a first moment when a user clicks on the screen of the physical client and a second moment when the screen of the physical client responds to the click operation; Measuring the client delay, including: The screen display delay is measured by an external camera in a video recording measurement manner.

9. The method according to claim 1, characterized in that: Also includes: The total latency of the cloud phone is measured by means of a video recording measurement using an external camera.

10. The method according to claim 9, characterized in that The server delay includes rendering delay, Measuring the server delay includes: The rendering delay is determined according to the total delay of the cloud phone, the client delay, the network transmission delay, and the encoding delay included in the server delay.

Images