Service evaluation method, apparatus and communication device

Abstract

This invention provides a service evaluation method, apparatus, and communication device. The method, executed by the communication device, includes: acquiring first information during the operation of a target cloud game, wherein the first information comprises objective parameters affecting the quality of the cloud game service; evaluating the target cloud game using a cloud game service evaluation model based on the first information, and obtaining a service evaluation result; wherein the cloud game service evaluation model is a pre-established model based on multi-level evaluation indicators, each level of evaluation indicator is related to the objective parameters affecting the quality of the cloud game service, and there is a mapping relationship between evaluation indicators at different levels. Through the above processing, this invention can accurately pinpoint the end-to-end problems in a cloud game service when the user experience deteriorates, thereby improving the accuracy of cloud game service quality evaluation.

Description

Technical Field

[0001] This invention relates to the field of data service technology, and in particular to a service evaluation method, apparatus, and communication equipment. Background Technology

[0002] Cloud gaming is a gaming method based on cloud computing. It involves transferring high-quality games to cloud servers for execution. Commands are transmitted to the cloud server through terminal input devices and networks. The cloud server then runs the game according to the commands and streams audio, video, and other content to terminal devices (including mobile phones, tablets, PCs, and TVs).

[0003] The existing evaluation system for cloud gaming service quality is mainly based on content sources and terminal capabilities. It does not consider all objective parameters affecting the quality of cloud gaming services, making it difficult to accurately pinpoint the end-to-end problems when the user experience deteriorates in cloud gaming services, resulting in low accuracy in the evaluation of cloud gaming service quality. Summary of the Invention

[0004] The purpose of this invention is to provide a service evaluation method, apparatus, and communication device to solve the problem that when using the existing evaluation system for cloud gaming service quality, it is impossible to accurately locate the end-to-end problems in the cloud gaming service when the user experience deteriorates, resulting in low accuracy in the evaluation of cloud gaming service quality.

[0005] To achieve the above objectives, in a first aspect, the present invention provides a service evaluation method, executed by a communication device, comprising:

[0006] Obtain first information during the operation of the target cloud game, wherein the first information is an objective parameter affecting the quality of the cloud game service;

[0007] Based on the first information, the target cloud game is evaluated using a cloud gaming business evaluation model to obtain the business evaluation results.

[0008] The cloud gaming service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between evaluation indicators at different levels.

[0009] The objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scene parameters.

[0010] The step of evaluating the target cloud game using a cloud gaming business evaluation model based on the first information to obtain the business evaluation result includes:

[0011] The first information is input into the cloud gaming business evaluation model to obtain the business evaluation result, which includes the specific values ​​of each level of evaluation indicators in the multi-level evaluation indicators related to the target cloud game.

[0012] The multi-level evaluation indicators include: four levels of evaluation indicators, wherein:

[0013] The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE).

[0014] The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the coherence of cloud game visuals. Interaction quality is used to characterize the real-time interaction during the user's interaction with the cloud game.

[0015] The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission. The lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission.

[0016] The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators.

[0017] The mapping relationships between the evaluation indicators at different levels include:

[0018] The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters;

[0019] The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators.

[0020] The degree of audio-visual impairment in the third-level evaluation index is determined by the audio-visual impairment index in the fourth-level evaluation index, and the lossless audio-visual quality is determined by the lossless audio-visual index in the fourth-level evaluation index.

[0021] The lossless audiovisual index in the fourth-level evaluation index is determined by the audio and video terminal parameters and the audio and video source parameters; the audio-visual impairment index is determined by the audio and video source parameters and the network parameters; the stuttering index is determined by the audio and video source parameters and the network parameters; and the latency index is determined by the network parameters and the computing power parameters.

[0022] The acquisition of the first information during the operation of the target cloud game includes:

[0023] When the communication device is a cloud server, it collects audio and video source parameters related to the target cloud game and computing power parameters of the cloud server, and receives audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal, as well as network parameters related to the target cloud game transmitted by the network-side device; or,

[0024] When the communication device is the terminal, the system collects audio and video terminal parameters, scene parameters, and computing power parameters related to the target cloud game, and receives audio and video source parameters and computing power parameters related to the target cloud game transmitted from the cloud server, as well as network parameters related to the target cloud game transmitted from the network-side device; or,

[0025] When the communication device is a network-side device, it collects network parameters related to the target cloud game, and receives audio and video source parameters related to the target cloud game and computing power parameters of the cloud server transmitted from the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal transmitted from the terminal related to the target cloud game.

[0026] The acquisition of the first information during the operation of the target cloud game includes:

[0027] When the communication device is a cloud server, the system collects audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and a first part of network parameters, and receives a second part of network parameters, as well as audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal. The second part of network parameters is transmitted by the terminal or by the network-side device.

[0028] Alternatively, when the communication device is the terminal, the audio and video terminal parameters, scene parameters, computing power parameters of the terminal and the second part of network parameters related to the target cloud game are collected, and the first part of network parameters and the audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server transmitted by the cloud server are received. The first part of network parameters is transmitted by the cloud server or by the network side device.

[0029] Alternatively, when the communication device is a network-side device, network parameters related to the target cloud game are collected, and audio and video source parameters related to the target cloud game and computing power parameters of the cloud server are received from the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game are received from the terminal.

[0030] The cloud gaming service evaluation model is a set of functions that take as input objective parameters affecting the quality of cloud gaming services and output multi-level evaluation indicators.

[0031] Secondly, embodiments of the present invention also provide a business evaluation device, comprising:

[0032] The acquisition module is used to acquire first information during the operation of the target cloud game, wherein the first information is an objective parameter that affects the quality of the cloud game service;

[0033] The business evaluation module is used to evaluate the target cloud game based on the first information using a cloud gaming business evaluation model, and obtain the business evaluation result.

[0034] Thirdly, embodiments of the present invention also provide a communication device, including a processor and a transceiver, wherein the transceiver receives and transmits data under the control of the processor, and the processor is configured to perform the following operations:

[0035] Obtain first information during the operation of the target cloud game, wherein the first information is an objective parameter affecting the quality of the cloud game service;

[0036] Based on the first information, the target cloud game is evaluated using a cloud gaming business evaluation model to obtain the business evaluation results.

[0037] The cloud gaming service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between evaluation indicators at different levels.

[0038] Fourthly, embodiments of the present invention also provide a communication device, including a memory, a processor, and a program stored in the memory and executable on the processor; when the processor executes the program, it implements the service evaluation method as described in the first aspect above.

[0039] Fifthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the business evaluation method described in the first aspect above.

[0040] The above-described technical solution of the present invention has at least the following beneficial effects:

[0041] In this embodiment of the invention, first information is obtained during the operation of the target cloud game, which is an objective parameter affecting the quality of the cloud game service. Based on the first information, a cloud game service evaluation model is used to evaluate the target cloud game and obtain the service evaluation result. The cloud game service evaluation model is a model pre-established based on multi-level evaluation indicators. Each level of evaluation indicator is related to the objective parameter affecting the quality of the cloud game service, and there is a mapping relationship between the evaluation indicators at different levels. In this way, by using a cloud game service evaluation model pre-established based on multi-level evaluation indicators to evaluate the cloud game service, the end-to-end problem of the cloud game service can be accurately located when the user experience of the cloud game service declines, thereby improving the accuracy of the evaluation of the quality of the cloud game service. Attached Figure Description

[0042] Figure 1 This is a schematic diagram illustrating the structure of the existing cloud gaming user experience evaluation system;

[0043] Figure 2 This is a flowchart illustrating the business evaluation method provided in an embodiment of the present invention;

[0044] Figure 3 A schematic diagram illustrating the hierarchical evaluation indicators of cloud gaming service quality and their hierarchical relationship according to the present invention;

[0045] Figure 4 A schematic diagram illustrating the structure of the cloud gaming service evaluation model according to an embodiment of the present invention.

[0046] Figure 5 This diagram illustrates the deployment of the execution program corresponding to the business evaluation method of the present invention.

[0047] Figure 6 This is a schematic diagram of the modules of the business evaluation device provided in an embodiment of the present invention;

[0048] Figure 7 This is a schematic diagram showing the structure of the communication device provided in an embodiment of the present invention. Detailed Implementation

[0049] To make the technical problems, technical solutions and advantages of the present invention clearer, a detailed description will be given below in conjunction with the accompanying drawings and specific embodiments.

[0050] For existing cloud gaming user experience evaluation systems, please refer to [link / reference]. Figure 1 , Figure 1This document lists various parameters and evaluation metrics related to cloud gaming user experience, and describes the mapping and hierarchical relationships between these parameters and metrics. The ultimate evaluation metric of this cloud gaming user experience evaluation system is the cloud gaming user experience itself, namely the Quality of Experience (QoE). Based on users' needs for the audiovisual and interactive experiences of cloud gaming, it is further subdivided into four secondary metrics: content quality metrics, presentation quality metrics, operation quality metrics, and response quality metrics.

[0051] Content quality metrics specifically include: clarity, smoothness, color fidelity, image 3D effect, and audio 3D effect. Presentation quality metrics specifically include: clarity, smoothness, audio-visual synchronization, screen tearing, stuttering, image 3D effect, and audio 3D effect. Operational quality metrics specifically include: accuracy and comfort. Response quality metrics specifically include: loading time and operational responsiveness.

[0052] Secondary metrics are controlled by objective parameters of cloud gaming services. The model divides these parameters into six categories: image quality, audio, terminal, network, peripherals, and platform. It also shows the relationship between secondary metrics and each type of parameter: content quality metrics are controlled by image quality and audio parameters; presentation quality metrics are controlled by terminal and network parameters; operation quality metrics are controlled by peripheral parameters; and response metrics are controlled by terminal, network, and platform parameters.

[0053] High-quality cloud gaming requires high-performance CPU computing power and graphics processing unit (GPU) rendering capabilities. Given the current trend towards containerization in cloud gaming, the allocation system of computing power remains one of the core concerns in the industry and must be taken into consideration. However, existing solutions primarily rely on content sources and terminal capabilities, failing to establish a relationship between user experience and cloud-edge computing power.

[0054] Furthermore, the boundaries between various indicators in the existing solution are blurred, and the hierarchical structure lacks deep logical coherence. For example, there is a large overlap between the content quality indicators and the presentation quality indicators in the existing solution; frame skipping and frame dropping in network parameters are phenomena caused by network fluctuations, not network parameters, and there is overlap between frame skipping, frame dropping, and stuttering indicators; latency, as a core parameter in the cloud gaming business model, is affected by network parameters and computing power parameters and is a dependent variable, but in this solution it is used as a low-level input parameter.

[0055] Furthermore, the existing solution does not consider all the parameters. Network-side parameters have a significant impact on the quality of cloud gaming services, but this solution only considers jitter, latency, and non-network-related issues such as frame skipping, frame dropping, and throughput. It does not take into account the different sensitivities of different cloud gaming scenarios to the quality of cloud gaming experience. For example, mobile phone scenarios, home large-screen scenarios, and professional e-sports scenarios have different requirements for the quality of cloud gaming services due to differences in devices and player skill levels.

[0056] To address the aforementioned problems, this invention provides a business evaluation method, apparatus, and communication device. The method and apparatus are based on the same application concept. Since the methods and apparatus solve problems in similar principles, their implementations can be mutually referenced, and repeated details will not be elaborated further.

[0057] like Figure 2 The diagram shown is a flowchart of a service evaluation method provided in an embodiment of the present invention. This method is executed by a communication device and specifically includes:

[0058] Step 201: Obtain the first information during the operation of the target cloud game. The first information is the objective parameters that affect the quality of the cloud game service.

[0059] Step 202: Based on the first information, use the cloud gaming business evaluation model to evaluate the target cloud game and obtain the business evaluation results; wherein, the cloud gaming business evaluation model is a model pre-established based on multi-level evaluation indicators, and the evaluation indicators at each level are related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between the evaluation indicators at different levels.

[0060] Optionally, objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters.

[0061] It should be noted that during the operation of cloud gaming, after the cloud server receives the user's operation command, it generates the corresponding audio and video stream and sends it to the terminal, which then plays the audio and video stream for the user. In this process, the objective parameters affecting the quality of cloud gaming services can be divided into five categories: audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scene parameters.

[0062] Among them, audio and video terminal parameters refer to the device parameters of the terminal used to play audio and video streams. Specifically, audio and video terminal parameters include, but are not limited to: screen width, screen height, optimal viewing distance, screen refresh rate, screen horizontal resolution, screen vertical resolution, and number of audio channels.

[0063] It should be noted that when playing the same audio and video streams, differences in audio and video terminal parameters can limit the display effect of the audio and video streams and affect the user experience.

[0064] Audio and video source parameters refer to the parameters of the audio and video streams generated by the cloud server. Without considering network conditions, these parameters directly determine the perceived audio-visual quality for the user. Specifically, audio and video source parameters include, but are not limited to: audio encoding method, audio bitrate, number of source channels, video encoding algorithm, video encoding bitrate, video encoding horizontal resolution, video encoding vertical resolution, and video encoding frame rate.

[0065] Network parameters describe the network conditions traversed during audio and video stream transmission. Specifically, network parameters include, but are not limited to: network transmission protocol, access network type, packet loss rate, uplink transmission latency, downlink transmission latency, downlink transmission bandwidth, and network latency jitter.

[0066] It should be noted that poor network quality can cause screen tearing, stuttering, and audio-visual asynchrony, affecting the user experience.

[0067] Computing power parameters refer to the computing power of cloud servers and terminals. The higher the computing power, the faster the cloud servers and terminals process instructions and audio / video streams, resulting in a better user experience. Specifically, computing power parameters include, but are not limited to: cloud CPU computing power, cloud GPU computing power, terminal CPU computing power, and terminal GPU computing power.

[0068] Scenario parameters include, but are not limited to, the interaction scenario and the degree of interaction requirements. Under different interaction scenarios (such as mobile interaction scenarios, professional competitive scenarios, etc.) and different degrees of interaction requirements (highly interactive games, medium interactive games, and weakly interactive games), even with the same audio and video terminal indicators, audio and video source indicators, network indicators, and computing power indicators, the final quality of cloud gaming services can vary.

[0069] The business evaluation method of this invention obtains first information during the operation of a target cloud game, which is an objective parameter affecting the quality of the cloud game business. Based on the first information, a cloud game business evaluation model is used to evaluate the target cloud game and obtain the business evaluation result. The cloud game business evaluation model is a model pre-established based on multi-level evaluation indicators. Each level of evaluation indicator is related to the objective parameter affecting the quality of the cloud game business, and there is a mapping relationship between the evaluation indicators at different levels. In this way, by using a cloud game business evaluation model pre-established based on multi-level evaluation indicators to evaluate the cloud game business, the end-to-end problems of the cloud game business can be accurately located when the user experience declines in the cloud game business, thereby improving the accuracy of the evaluation of the quality of the cloud game business.

[0070] In one optional embodiment, the multi-level evaluation metrics include: four levels of evaluation metrics, wherein:

[0071] The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE).

[0072] In cloud gaming, QoE refers to a user's subjective perception of the quality and performance of devices, networks and systems, applications, or services. Higher cloud gaming service quality translates to higher user experience quality; conversely, higher user experience quality also implies higher cloud gaming service quality. Therefore, cloud gaming QoE is used to directly evaluate the quality of cloud gaming services.

[0073] The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the continuity of cloud game visuals. Interaction quality is used to characterize the real-time interaction of users with cloud games.

[0074] From a user perception perspective, cloud gaming services can be evaluated from three dimensions: 1) the quality of the cloud game visuals and sound perceived by the user; 2) the continuity of the cloud game visuals; and 3) the real-time appearance of the corresponding cloud game visuals and sound after the user performs an action. This invention proposes three indicators—audiovisual quality, continuity quality, and interaction quality—to evaluate these three dimensions of cloud gaming services.

[0075] The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission, while lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission.

[0076] If an optimal network is considered, the audio-visual quality perceived by the user is only affected by the audio and video streams generated by the cloud server and the terminal display device. However, if the transmission network fluctuates or is insufficient to meet the demands of the audio and video streams sent by the cloud server, it will cause some damage to the cloud game sound and picture displayed on the terminal, affecting the user experience. Based on this, the above two indicators, lossless audio-visual quality and the degree of audio-visual damage, are proposed to evaluate audio-visual quality.

[0077] The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators.

[0078] Specifically, two lossless audiovisual indicators, image quality and audio quality, are identified for more detailed evaluation of lossless audiovisual quality. Since the main manifestations of network effects on cloud gaming sound and image are screen tearing and audiovisual asynchrony, four audiovisual impairment indicators are proposed to evaluate the degree of audiovisual impairment: total number of screen tearing incidents, weighted total screen tearing duration, average screen tearing time interval, and audiovisual synchronization difference.

[0079] Therefore, lossless audiovisual indicators include picture quality and audio quality; audiovisual impairment indicators include the total number of screen flickering events, the weighted total duration of screen flickering events, the average time interval between screen flickering events, and audiovisual synchronization differences.

[0080] If the transmission network experiences fluctuations or is insufficient to meet the network demands of audio and video streams sent from the cloud, stuttering can occur, affecting continuity quality. Therefore, three stuttering metrics are proposed to evaluate continuity quality: total number of stutters, weighted total stuttering duration, and average stuttering interval. Specifically, the stuttering metrics include the total number of stutters, the weighted total stuttering duration, and the average stuttering interval.

[0081] From the moment a user interacts with an input device to the moment the user perceives the corresponding cloud game sound and visuals, the lower the latency throughout the entire process, the higher the interaction quality of the cloud game. However, the computing power parameters of the cloud server and terminal, as well as network conditions, will limit the reduction of latency. Therefore, this invention proposes three latency metrics—transmission latency, terminal latency, and cloud latency—to evaluate interaction quality. These latency metrics include transmission latency, terminal latency, and cloud latency.

[0082] The above analysis shows that the mapping relationships between evaluation indicators at different levels include:

[0083] The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters;

[0084] Here, cloud gaming QoE (the first-level evaluation metric) includes audiovisual quality, continuity quality, and interaction quality (the second-level evaluation metric). In addition, cloud gaming QoE is also affected by scene parameters.

[0085] The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators.

[0086] Here, audiovisual quality includes lossless audiovisual quality and the degree of audiovisual impairment (a third-level evaluation metric), while continuity quality is determined by stuttering. Interaction quality is determined by latency.

[0087] The degree of audiovisual impairment in the third-level evaluation indicators is determined by the audiovisual impairment indicators in the fourth-level evaluation indicators, while the lossless audiovisual quality is determined by the lossless audiovisual indicators in the fourth-level evaluation indicators.

[0088] Here, the degree of audio-visual impairment is determined by the audio-visual impairment index, while the lossless audio-visual quality is determined by the lossless audio-visual index.

[0089] In the fourth level of evaluation indicators, the lossless audio-visual indicators are determined by the audio-visual terminal parameters and the audio-visual source parameters; the audio-visual impairment indicators are determined by the audio-visual source parameters and the network parameters; the stuttering indicators are determined by the audio-visual source parameters and the network parameters; and the latency indicators are determined by the network parameters and the computing power parameters.

[0090] Specifically, the picture quality and audio quality (lossless audio-visual indicators) in lossless audio-visual indicators are controlled by audio-visual terminal parameters and audio-visual source parameters; the sound and picture damage indicators are controlled by audio-visual source parameters and network parameters; the stuttering indicators are controlled by audio-visual source parameters and network parameters; and the latency indicators are controlled by network parameters and computing power parameters.

[0091] Specifically, for the objective parameters affecting the quality of cloud gaming services, evaluation indicators, and the hierarchical relationship between different evaluation indicators, please refer to [link to relevant documentation]. Figure 3 .

[0092] The hierarchical evaluation indicators for cloud gaming service quality of this invention and their specific descriptions are shown in Table 1, and the objective parameters affecting cloud gaming service quality and their specific descriptions are shown in Table 2.

[0093] Table 1: Hierarchical Evaluation Indicators and Their Descriptions

[0094]

[0095]

[0096]

[0097] Table 2: Detailed Description of Objective Parameters Affecting the Quality of Cloud Gaming Services

[0098]

[0099]

[0100]

[0101] Based on the aforementioned multi-level evaluation indicators for cloud gaming service quality, a cloud gaming service evaluation model is pre-established. See the schematic diagram of this cloud gaming service evaluation model. Figure 4 The above-mentioned hierarchical evaluation index construction method for cloud gaming service quality standardizes the composition of the cloud gaming service evaluation model and its inputs and outputs, but does not restrict the specific form of the model function. Optionally, the cloud gaming service evaluation model can be a set of functions that satisfy the following conditions: the input is the objective parameters affecting the quality of cloud gaming services, and the output is a set of multi-level evaluation indicators. The model function of the cloud gaming service evaluation model is f. ij i,j∈{1,2,3,4}, model function f ijIt can be a polynomial function, an exponential function, a power function, a neural network, or other function forms; no specific limitations are made here. The neural network can be a fully connected neural network, a convolutional neural network, a recurrent neural network, or other similar neural networks.

[0102] Refer to Tables 1 and 2 to establish a cloud gaming service evaluation model. Specifically:

[0103] y 11 =f 11 (y 21 ,y 22 ,y 23 (X5)

[0104] y 21 =f 21 (y 31 ,y 32 )

[0105] y 22 =f 22 (k 41 ,k 42 ,k 43 )

[0106] y 23 =f 23 (t 41 ,t 42 ,t 43 )

[0107] y 31 =f 31 (v 41 ,v 42 )

[0108] y 32 =f 32 (h 41 ,h 42 ,h 43 ,h 44 )

[0109] V4 = f 41 (X1,X2)

[0110] H4 = f 42 (X2,X3)

[0111] K4 = f 43 (X2,X3)

[0112] T4 = f 44 (X3,X4)

[0113] Where, V4 = [v 41 ,v 42[H4] is the lossless audiovisual index vector; H4 = [h 41 ,h 42 ,h 43 ,h 44 [k] represents the audio-visual impairment index vector, K4 = [k 41 ,k 42 ,k 43 [t] represents the stuttering index vector; T4 = [t] 41 ,t 42 ,t 43 [x] represents the time delay index vector; X1 = [x] 11 ,x 12 ,x 13 ,x 14 ,x 15 ,x 16 ,x 17 [x] represents the audio / video terminal parameter vector; X2 = [x] 21 ,x 22 ,x 23 ,x 24 ,x 25 ,x 26 ,x 27 ,x 28 [x] represents the audio / video source parameter vector; X3 = [x 31 ,x 32 ,x 33 ,x 34 ,x 35 ,x 36 ,x 37 [x] represents the network parameter vector; X4 = [x 41 ,x 42 ,x 43 ,x 44 [x] represents the computing power parameter vector; X5 = [x 51 ,x 52 [ ] represents the scene parameter vector; the correspondence between the remaining variables and indicators / parameters is shown in Tables 1 and 2.

[0114] The cloud gaming service evaluation model of this invention symbolically represents the objective parameters and evaluation indicators that affect the quality of cloud gaming services, specifies the hierarchical functional relationships between objective parameters and evaluation indicators, and between different evaluation indicators, and clarifies the function inputs required for each evaluation indicator. This cloud gaming service evaluation model incorporates relevant parameters and evaluation indicators of network and cloud-edge computing power, thus making the evaluation of cloud gaming service quality more accurate and comprehensive.

[0115] It should be noted that the execution program corresponding to the above business evaluation method can be deployed on cloud servers, terminals, and network-side devices. Cloud servers include, but are not limited to, cloud server clusters, supercomputers, and edge servers; terminals include, but are not limited to, mobile phones, tablets, computers, and smart TVs; network-side devices include, but are not limited to, macro base stations, micro base stations, and routers. The types of objective parameters that can be collected differ depending on the deployment location. In one optional implementation, step 201 may include:

[0116] Step 2011a: When the communication device is a cloud server, collect audio and video source parameters and computing power parameters of the cloud server related to the target cloud game, and receive audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game transmitted by the terminal, as well as network parameters related to the target cloud game transmitted by the network side device.

[0117] Alternatively, in step 2011b, when the communication device is the terminal, the audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game are collected, and the audio and video source parameters and computing power parameters of the cloud server related to the target cloud game are received from the cloud server, as well as the network parameters related to the target cloud game are received from the network side device.

[0118] Alternatively, in step 2011c, if the communication device is a network-side device, collect network parameters related to the target cloud game, and receive audio and video source parameters and computing power parameters of the cloud server related to the target cloud game transmitted by the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game transmitted by the terminal.

[0119] In other words, the cloud server collects audio and video source parameters related to the target cloud game and computing power parameters of the cloud server; the terminal collects audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game; and the network-side device collects network parameters related to the target cloud game.

[0120] Regardless of whether the communication device acting as the execution entity is a cloud server, a terminal, or a network-side device, all objective parameters affecting the quality of cloud gaming services can be obtained through data transmission between devices.

[0121] Furthermore, cloud servers can collect audio and video source parameters, cloud server computing power parameters, and some network parameters related to the target cloud game; terminals can collect audio and video terminal parameters, scene parameters, terminal computing power parameters, and some network parameters related to the target cloud game; and network-side devices can collect network parameters related to the target cloud game.

[0122] Based on this, as another optional implementation, when the communication device is a cloud server, the audio and video source parameters related to the target cloud game, the computing power parameters of the cloud server, and the first part of the network parameters are collected, and the second part of the network parameters, as well as the audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal are received. The second part of the network parameters is transmitted by the terminal or by the network side device.

[0123] Alternatively, when the communication device is the terminal, the audio and video terminal parameters, scene parameters, terminal computing power parameters and second part of network parameters related to the target cloud game are collected, and the first part of network parameters and the audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server transmitted by the cloud server are received. The first part of network parameters is transmitted by the cloud server or by the network side device.

[0124] It should be noted that the first part of the network parameters and the second part of the network parameters are all the network parameters.

[0125] Alternatively, when the communication device is a network-side device, it collects network parameters related to the target cloud game, and receives audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the cloud server.

[0126] In an alternative implementation, step 202 may include:

[0127] Step 2021: Input the first information into the cloud gaming business evaluation model to obtain the business evaluation results. The business evaluation results include the specific values ​​of each level of evaluation indicators in the multi-level evaluation indicators related to the target cloud game.

[0128] It should be noted that after obtaining the business evaluation results, the cloud server and network-side devices can adjust their computing and communication resources based on the relevant business evaluation results to ensure the continuous quality of cloud gaming services.

[0129] When the execution program corresponding to the above business evaluation method is deployed on a cloud server, terminal, or network-side device, see [link to relevant documentation]. Figure 5 The execution program corresponding to the business evaluation method consists of three modules: parameter acquisition module, parameter sending and receiving module, and cloud gaming business evaluation module.

[0130] Parameter Acquisition Module: Responsible for collecting objective parameters affecting the quality of cloud gaming services, namely audio / video terminal parameters (X1), audio / video source parameters (X2), network parameters (X3), computing power parameters (X4), and scene parameters (X5). The parameter acquisition module includes a first subset of parameter acquisition modules deployed on the cloud server, a second subset of parameter acquisition modules deployed on network-side devices, and a third subset of parameter acquisition modules deployed on the terminal.

[0131] Parameter transceiver module: Responsible for communicating with other cloud gaming endpoints, sending objective parameters collected by this endpoint or receiving objective parameters sent by other endpoints, so that any endpoint that deploys the execution program corresponding to this business evaluation method has the ability to obtain all objective parameters.

[0132] The cloud gaming service evaluation module is responsible for inputting all collected and received objective parameters into the cloud gaming service evaluation model to obtain specific values ​​for each level of indicators, thereby enabling a multi-faceted evaluation of the cloud gaming service.

[0133] The specific operation process can be divided into five steps: 1) The first parameter subset acquisition module of the cloud server, the second parameter subset acquisition module of the network-side device, and the third parameter subset acquisition module of the terminal respectively acquire the objective parameters that can be acquired on their respective ends; 2) The parameter transceiver modules of the cloud server, the network-side device, and the terminal communicate with each other and exchange the objective parameters acquired by each end; 3) The cloud gaming service evaluation module performs a hierarchical evaluation of the quality of the cloud gaming service; 4) The cloud server and the network-side device dynamically adjust computing resources and communication resources according to the hierarchical evaluation results of the quality of the cloud gaming service; 5) Repeat steps 1) to 4) to continuously ensure the quality of the cloud gaming service.

[0134] The service evaluation method of this invention can accurately pinpoint the end-to-end problems in cloud gaming services when user experience deteriorates. It can proactively and flexibly schedule communication and computing resources to maximize resource utilization while ensuring the quality of cloud gaming services.

[0135] The technical solution of this invention comprehensively evaluates the quality of cloud gaming services from three dimensions: user audiovisual experience, continuous experience, and interactive experience. In addition to considering the audio and video terminal parameters related to game display and the audio and video source parameters of game content, it also takes into account network parameters, computing power parameters, and scene parameters, establishing the relationship between user experience quality and cloud-edge computing power and network capabilities, which helps to ensure the effective support of computing power network for cloud gaming services.

[0136] Furthermore, for cloud gaming services, considering cloud-edge computing power and network capabilities from the user's perspective, this solution establishes a comprehensive, clearly defined, and logically structured hierarchical evaluation index method for cloud gaming service quality based on computing power and network. Specifically, in addition to audiovisual parameters and evaluation indicators, this solution also considers network and cloud-edge computing power parameters and evaluation indicators, which better aligns with the operational process of cloud gaming services. This allows the proposed hierarchical evaluation index method to comprehensively, multi-dimensionally, and hierarchically evaluate the quality of cloud gaming services, resulting in a more refined and accurate evaluation.

[0137] like Figure 6 As shown, this embodiment of the invention also provides a business evaluation device, which includes:

[0138] The acquisition module 601 is used to acquire the first information during the operation of the target cloud game, which is an objective parameter that affects the quality of the cloud game service;

[0139] The business evaluation module 602 is used to evaluate the target cloud game based on the first information using the cloud game business evaluation model, and obtain the business evaluation results.

[0140] Optionally, objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters.

[0141] Optionally, the business evaluation module 602 includes:

[0142] The business evaluation unit is used to input the first information into the cloud gaming business evaluation model to obtain the business evaluation results. The business evaluation results include the specific values ​​of each level of evaluation indicators in the multi-level evaluation indicators related to the target cloud game.

[0143] Optionally, the multi-level evaluation indicators include: four levels of evaluation indicators, wherein:

[0144] The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE).

[0145] The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the continuity of cloud game visuals. Interaction quality is used to characterize the real-time interaction of users with cloud games.

[0146] The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission, while lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission.

[0147] The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators.

[0148] Optionally, the mapping relationships between evaluation indicators at different levels include:

[0149] The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters;

[0150] The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators.

[0151] The degree of audiovisual impairment in the third-level evaluation index is determined by the audiovisual impairment index in the fourth-level evaluation index, and the lossless audiovisual quality is determined by the lossless audiovisual index in the fourth-level evaluation index.

[0152] In the fourth level of evaluation indicators, the lossless audio-visual indicators are determined by the audio-visual terminal parameters and the audio-visual source parameters; the audio-visual impairment indicators are determined by the audio-visual source parameters and the network parameters; the stuttering indicators are determined by the audio-visual source parameters and the network parameters; and the latency indicators are determined by the network parameters and the computing power parameters.

[0153] Optionally, the acquisition module 601 includes:

[0154] The first acquisition unit is used to collect audio and video source parameters and computing power parameters of the cloud server related to the target cloud game when the communication device is a cloud server, and to receive audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game transmitted by the terminal, as well as to receive network parameters related to the target cloud game transmitted by the network side device.

[0155] Alternatively, the second acquisition unit is used to collect audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game when the communication device is the terminal, and to receive audio and video source parameters and computing power parameters of the cloud server related to the target cloud game transmitted by the cloud server, as well as network parameters related to the target cloud game transmitted by the network side device.

[0156] Alternatively, the third acquisition unit is used to collect network parameters related to the target cloud game when the communication device is a network-side device, and to receive audio and video source parameters and computing power parameters of the cloud server related to the target cloud game transmitted by the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game transmitted by the terminal.

[0157] Optionally, the acquisition module 601 includes:

[0158] The fourth acquisition unit is used to collect audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and the first part of network parameters when the communication device is a cloud server, and to receive the second part of network parameters as well as audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal. The second part of network parameters is transmitted by the terminal or by the network side device.

[0159] Alternatively, the fifth acquisition unit is used to collect audio and video terminal parameters, scene parameters, terminal computing power parameters and second part of network parameters related to the target cloud game when the communication device is the terminal, and to receive the first part of network parameters as well as the audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server transmitted by the cloud server. The first part of network parameters is transmitted by the cloud server or by the network side device.

[0160] Alternatively, the sixth acquisition unit is used to collect network parameters related to the target cloud game when the communication device is a network-side device, and to receive audio and video source parameters related to the target cloud game and computing power parameters of the cloud server transmitted by the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal transmitted by the terminal related to the target cloud game.

[0161] Optionally, the cloud gaming service evaluation model is a set of functions that take as input objective parameters affecting the quality of cloud gaming services and output multi-level evaluation indicators.

[0162] The business evaluation device of this invention acquires first information during the operation of a target cloud game, where the first information is an objective parameter affecting the quality of the cloud game business. Based on the first information, it uses a cloud game business evaluation model to evaluate the target cloud game and obtain the business evaluation result. The cloud game business evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to the objective parameter affecting the quality of the cloud game business, and there is a mapping relationship between evaluation indicators at different levels. Therefore, by using a pre-established cloud game business evaluation model based on multi-level evaluation indicators to evaluate the cloud game business, it is possible to accurately locate the end-to-end problems in the cloud game business when the user experience declines, thereby improving the accuracy of the evaluation of the cloud game business quality.

[0163] To better achieve the above objectives, such as Figure 7 As shown, this embodiment of the invention also provides a communication device, including a processor 700 and a transceiver 710, wherein the processor 700 is used to perform the following process:

[0164] Obtain the first information during the operation of the target cloud game, which is an objective parameter affecting the quality of the cloud game service;

[0165] Based on the first piece of information, the target cloud game is evaluated using a cloud gaming business evaluation model to obtain the business evaluation results.

[0166] The cloud gaming business evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming business, and there is a mapping relationship between evaluation indicators at different levels.

[0167] Optionally, objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters.

[0168] Optionally, the processor 700 is also used for:

[0169] The first information is input into the cloud gaming business evaluation model to obtain the business evaluation results, which include the specific values ​​of each level of evaluation indicators in the multi-level evaluation indicators related to the target cloud game.

[0170] Optionally, the multi-level evaluation indicators include: four levels of evaluation indicators, wherein:

[0171] The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE).

[0172] The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the continuity of cloud game visuals. Interaction quality is used to characterize the real-time interaction of users with cloud games.

[0173] The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission, while lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission.

[0174] The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators.

[0175] Optionally, the mapping relationships between evaluation indicators at different levels include:

[0176] The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters;

[0177] The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators.

[0178] The degree of audiovisual impairment in the third-level evaluation index is determined by the audiovisual impairment index in the fourth-level evaluation index, and the lossless audiovisual quality is determined by the lossless audiovisual index in the fourth-level evaluation index.

[0179] In the fourth level of evaluation indicators, the lossless audio-visual indicators are determined by the audio-visual terminal parameters and the audio-visual source parameters; the audio-visual impairment indicators are determined by the audio-visual source parameters and the network parameters; the stuttering indicators are determined by the audio-visual source parameters and the network parameters; and the latency indicators are determined by the network parameters and the computing power parameters.

[0180] Optionally, the processor 700 is also used for:

[0181] When the communication device is a cloud server, it collects audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server, and receives audio and video terminal parameters, scene parameters, and computing power parameters related to the target cloud game transmitted by the terminal, as well as network parameters related to the target cloud game transmitted by the network-side device; or,

[0182] When the communication device is the terminal, it collects audio and video terminal parameters, scene parameters, and terminal computing power parameters related to the target cloud game, and receives audio and video source parameters and computing power parameters related to the target cloud game transmitted from the cloud server, as well as network parameters related to the target cloud game transmitted from the network-side device; or,

[0183] When the communication device is a network-side device, it collects network parameters related to the target cloud game, and receives audio and video source parameters and computing power parameters of the cloud server related to the target cloud game transmitted by the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game transmitted by the terminal.

[0184] When the communication device is a terminal, it also includes a user interface 720.

[0185] Optionally, the processor 700 is also used for:

[0186] When the communication device is a cloud server, the system collects audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and the first part of network parameters, and receives the second part of network parameters as well as audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal. The second part of network parameters is transmitted by the terminal or by the network side device.

[0187] Alternatively, when the communication device is the terminal, the audio and video terminal parameters, scene parameters, terminal computing power parameters and second part of network parameters related to the target cloud game are collected, and the first part of network parameters and the audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server transmitted by the cloud server are received. The first part of network parameters is transmitted by the cloud server or by the network side device.

[0188] Alternatively, when the communication device is a network-side device, it collects network parameters related to the target cloud game, and receives audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the cloud server.

[0189] Optionally, the cloud gaming service evaluation model is a set of functions that take as input objective parameters affecting the quality of cloud gaming services and output multi-level evaluation indicators.

[0190] The communication device of this invention acquires first information during the operation of a target cloud game, where the first information is an objective parameter affecting the quality of the cloud game service. Based on the first information, it uses a cloud game service evaluation model to evaluate the target cloud game and obtain the service evaluation result. The cloud game service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to the objective parameter affecting the quality of the cloud game service, and there is a mapping relationship between evaluation indicators at different levels. Therefore, by using a pre-established cloud game service evaluation model based on multi-level evaluation indicators to evaluate the cloud game service, it is possible to accurately locate the end-to-end problem of the cloud game service when the user experience declines, thereby improving the accuracy of the evaluation of the cloud game service quality.

[0191] This invention also provides a communication device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the various processes in the above-described service evaluation method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0192] This invention also provides a computer-readable storage medium storing a computer program. When executed by a processor, this program implements the various processes described above in the business evaluation method embodiments and achieves the same technical effects. To avoid repetition, it will not be described again here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0193] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0194] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 A device for one or more processes and / or the functions specified in one or more boxes.

[0195] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce a paper article including an instruction means, the instruction means being implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0196] These computer program instructions can also be loaded onto a computer or other programmable data processing equipment, causing the computer or other programmable equipment to perform a series of operational steps to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0197] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A service evaluation method executed by a communication device, characterized by, include: Obtain first information during the operation of the target cloud game, wherein the first information is an objective parameter affecting the quality of the cloud game service; Based on the first information, the target cloud game is evaluated using a cloud gaming business evaluation model to obtain the business evaluation results. The cloud gaming service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between evaluation indicators at different levels. The objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters. The multi-level evaluation indicators include: four levels of evaluation indicators, wherein: The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE). The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the coherence of cloud game visuals. Interaction quality is used to characterize the real-time interaction during the user's interaction with the cloud game. The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission. The lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission. The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators; The mapping relationships between the evaluation indicators at different levels include: The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters; The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators. The degree of audio-visual impairment in the third-level evaluation index is determined by the audio-visual impairment index in the fourth-level evaluation index, and the lossless audio-visual quality is determined by the lossless audio-visual index in the fourth-level evaluation index. The lossless audiovisual index in the fourth-level evaluation index is determined by the audio and video terminal parameters and the audio and video source parameters; the audio-visual impairment index is determined by the audio and video source parameters and the network parameters; the stuttering index is determined by the audio and video source parameters and the network parameters; and the latency index is determined by the network parameters and the computing power parameters.

2. The method according to claim 1, characterized in that, The step of evaluating the target cloud game based on the first information using a cloud gaming business evaluation model to obtain a business evaluation result includes: The first information is input into the cloud gaming business evaluation model to obtain the business evaluation result, which includes the specific values ​​of each level of evaluation indicators in the multi-level evaluation indicators related to the target cloud game.

3. The method according to claim 1, characterized in that, The first information obtained during the operation of the target cloud game includes: When the communication device is a cloud server, it collects audio and video source parameters related to the target cloud game and computing power parameters of the cloud server, and receives audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal, as well as network parameters related to the target cloud game transmitted by the network-side device; or, When the communication device is the terminal, the system collects audio and video terminal parameters, scene parameters, and computing power parameters related to the target cloud game, and receives audio and video source parameters and computing power parameters related to the target cloud game transmitted from the cloud server, as well as network parameters related to the target cloud game transmitted from the network-side device; or, When the communication device is a network-side device, it collects network parameters related to the target cloud game, and receives audio and video source parameters related to the target cloud game and computing power parameters of the cloud server transmitted from the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal transmitted from the terminal related to the target cloud game.

4. The method according to claim 1, characterized in that, The first information obtained during the operation of the target cloud game includes: When the communication device is a cloud server, the system collects audio and video source parameters related to the target cloud game, computing power parameters of the cloud server, and a first part of network parameters, and receives a second part of network parameters, as well as audio and video terminal parameters, scene parameters, and computing power parameters of the terminal related to the target cloud game transmitted by the terminal. The second part of network parameters is transmitted by the terminal or by the network-side device. Alternatively, when the communication device is the terminal, the audio and video terminal parameters, scene parameters, computing power parameters of the terminal and the second part of network parameters related to the target cloud game are collected, and the first part of network parameters and the audio and video source parameters related to the target cloud game and the computing power parameters of the cloud server transmitted by the cloud server are received. The first part of network parameters is transmitted by the cloud server or by the network side device. Alternatively, when the communication device is a network-side device, network parameters related to the target cloud game are collected, and audio and video source parameters related to the target cloud game and computing power parameters of the cloud server are received from the cloud server, as well as audio and video terminal parameters, scene parameters and computing power parameters of the terminal related to the target cloud game are received from the terminal.

5. The method according to claim 1, characterized in that, The cloud gaming service evaluation model is a set of functions that take as input objective parameters affecting the quality of cloud gaming services and output as multi-level evaluation indicators.

6. A business evaluation device, characterized in that, include: The acquisition module is used to acquire first information during the operation of the target cloud game, wherein the first information is an objective parameter that affects the quality of the cloud game service; The business evaluation module is used to evaluate the target cloud game based on the first information using a cloud gaming business evaluation model, and obtain the business evaluation result. The cloud gaming service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between evaluation indicators at different levels. The objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters. The multi-level evaluation indicators include: four levels of evaluation indicators, wherein: The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE). The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the coherence of cloud game visuals. Interaction quality is used to characterize the real-time interaction during the user's interaction with the cloud game. The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission. The lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission. The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators; The mapping relationships between the evaluation indicators at different levels include: The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters; The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators. The degree of audio-visual impairment in the third-level evaluation index is determined by the audio-visual impairment index in the fourth-level evaluation index, and the lossless audio-visual quality is determined by the lossless audio-visual index in the fourth-level evaluation index. The lossless audiovisual index in the fourth-level evaluation index is determined by the audio and video terminal parameters and the audio and video source parameters; the audio-visual impairment index is determined by the audio and video source parameters and the network parameters; the stuttering index is determined by the audio and video source parameters and the network parameters; and the latency index is determined by the network parameters and the computing power parameters.

7. A communication device, comprising a processor and a transceiver, wherein the transceiver receives and transmits data under the control of the processor, characterized in that, The processor is used to perform the following operations: Obtain first information during the operation of the target cloud game, wherein the first information is an objective parameter affecting the quality of the cloud game service; Based on the first information, the target cloud game is evaluated using a cloud gaming business evaluation model to obtain the business evaluation results. The cloud gaming service evaluation model is a pre-established model based on multi-level evaluation indicators. Each level of evaluation indicator is related to objective parameters that affect the quality of cloud gaming services, and there is a mapping relationship between evaluation indicators at different levels. The objective parameters affecting the quality of cloud gaming services include audio and video terminal parameters, audio and video source parameters, network parameters, computing power parameters, and scenario parameters. The multi-level evaluation indicators include: four levels of evaluation indicators, wherein: The first-level evaluation metric is the Quality of Cloud Gaming Experience (QoE). The second level of evaluation indicators includes audiovisual quality, continuity quality, and interaction quality. Audiovisual quality is used to characterize the quality of cloud game visuals and sound perceived by users in cloud gaming services. Continuity quality is used to characterize the coherence of cloud game visuals. Interaction quality is used to characterize the real-time interaction during the user's interaction with the cloud game. The third level of evaluation indicators includes the degree of audio-visual impairment and lossless audio-visual quality. The degree of audio-visual impairment is used to characterize the degree of damage to the sound and picture of cloud games during network transmission. The lossless audio-visual quality is used to characterize the quality of cloud game picture and sound perceived by users when the audio and video streams generated by the cloud server are not damaged during transmission. The fourth level of evaluation indicators includes: lossless audiovisual indicators, audio-visual impairment indicators, stuttering indicators, and latency indicators; The mapping relationships between the evaluation indicators at different levels include: The evaluation indicators of the first level are determined by the evaluation indicators of the second level and the scenario parameters; The audiovisual quality in the second-level evaluation indicators is determined by the third-level evaluation indicators, the continuity quality is determined by the stuttering indicator in the fourth-level evaluation indicators, and the interaction quality is determined by the latency indicator in the fourth-level evaluation indicators. The degree of audio-visual impairment in the third-level evaluation index is determined by the audio-visual impairment index in the fourth-level evaluation index, and the lossless audio-visual quality is determined by the lossless audio-visual index in the fourth-level evaluation index. The lossless audiovisual index in the fourth-level evaluation index is determined by the audio and video terminal parameters and the audio and video source parameters; the audio-visual impairment index is determined by the audio and video source parameters and the network parameters; the stuttering index is determined by the audio and video source parameters and the network parameters; and the latency index is determined by the network parameters and the computing power parameters.

8. A communication device, comprising a memory, a processor, and a program stored in the memory and executable on the processor; characterized in that, When the processor executes the program, it implements the business evaluation method as described in any one of claims 1 to 5.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps in the business evaluation method as described in any one of claims 1 to 5.

Images