Video polyphonic ringtone evaluation method and device, medium and program product

Abstract

The invention discloses a video polyphonic ringtone evaluation method and device, a medium and a program product. Comprises: obtaining a state data set; wherein the state data in the state data set is used for representing an audio playing state and a video playing state of a video polyphonic ringtone in a calling process of the terminal equipment, and a display mode of a calling window associated with the calling process; and based on the data in the state data set, evaluating the performance state of the video polyphonic ringtone. According to the scheme, comprehensive and accurate evaluation of the video polyphonic ringtone can be realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of video ringback tone, and particularly relates to a video ringback tone evaluation method, device, medium and program product. BACKGROUND

[0002] With the gradual popularization of the video ringback tone service, a method for evaluating the service level of the video ringback tone according to audio playing states and video playing states of the video ringback tone is provided in the related art. However, the above evaluation method is not comprehensive enough. SUMMARY

[0003] To solve the above technical problems, the present application provides a video ringback tone evaluation method, device, medium and program product.

[0004] The technical scheme provided by the present application is as follows:

[0005] The present application provides a video ringback tone service evaluation method, which comprises the following steps:

[0006] obtaining a state data set, wherein the state data in the state data set is used to represent the audio playing state, the video playing state of the video ringback tone in the calling process of the terminal device, and the display mode of the calling window associated with the calling process;

[0007] evaluating the performance state of the video ringback tone based on the data in the state data set.

[0008] The present application also provides an electronic device, which comprises a processor and a memory; the memory stores a computer program; when the computer program is executed by the processor, the video ringback tone service evaluation method as any one of the preceding embodiments can be realized.

[0009] The present application also provides a computer readable storage medium, which stores a computer program; when the computer program is executed by the processor of the electronic device, the video ringback tone service evaluation method as any one of the preceding embodiments can be realized.

[0010] The present application also provides a computer program product, which comprises a computer program; when the computer program is executed by the processor of the electronic device, the video ringback tone service evaluation method as any one of the preceding embodiments can be realized.

[0011] The method for evaluating the video ringback tone service provided by the embodiments of the present application obtains a state data set, and the state data in the state data set is used to at least represent the audio playing state, the video playing state of the video ringback tone, and the display mode of the call window associated with the call process. In this way, when the video ringback tone is loaded in the call process of the terminal device, the data including the video playing state, the audio playing state and the display mode of the call window of the terminal device can be comprehensively and diversely obtained, so that the comprehensiveness of the data in the state data set can be improved. On this basis, the service performance of the video ringback tone is evaluated based on the data in the state data set, the performance state of the video ringback tone can be comprehensively evaluated from the dimensions of the audio playing state, the video playing state and the display mode of the call window, so that the comprehensiveness and the accuracy of the evaluation of the video ringback tone service can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 A flowchart of the method for evaluating the video ringback tone service provided by the embodiments of the present application is shown in the figure.

[0013] Figure 2 A structure diagram of the evaluation system provided by the embodiments of the present application is shown in the figure.

[0014] Figure 3 A structure diagram of the data collection system provided by the embodiments of the present application is shown in the figure.

[0015] Figure 4 A flowchart of the data collection process provided by the embodiments of the present application is shown in the figure.

[0016] Figure 5 A structure diagram of the evaluation device of the video ringback tone service provided by the embodiments of the present application is shown in the figure.

[0017] Figure 6 A structure diagram of the electronic device provided by the embodiments of the present application is shown in the figure. DETAILED DESCRIPTION

[0018] The technical solutions in the embodiments of the present application will be clearly and completely described in combination with the accompanying drawings in the embodiments of the present application.

[0019] It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0020] With the development of mobile communication technology, the video ringback tone service is gradually popularized. In this case, it is necessary to evaluate the service level of the video ringback tone service.

[0021] In the related art, a horizontal or performance evaluation method for a video ringback tone service is implemented by evaluating audio freezing, video freezing and audio / video synchronization during execution of the service. However, the evaluation method is not comprehensive, so that the evaluation result obtained by the method cannot accurately reflect the actual state or level of the video ringback tone service.

[0022] Based on the above technical problems, the embodiments of the present application provide an evaluation method, a device medium and a program product for a video ringback tone service.

[0023] Figure 1 A flowchart of the evaluation method for the video ringback tone service provided by the embodiments of the present application is shown in FIG. 1, which can include the following steps: Figure 1

[0024] Step 101, obtaining a set of state data.

[0025] The state data in the set of state data is used to represent the audio playing state, the video playing state of the video ringback tone in the calling process of the terminal device, and the display mode of the calling window associated with the calling process.

[0026] In an embodiment, the display mode can include the interactive response state of the calling window during playing of the video ringback tone, and the data switching state of the calling window; wherein the terminal device loads the video ringback tone in the calling process; exemplary, the terminal device can include a mobile device; exemplary, the mobile device can include a smart phone.

[0027] In an embodiment, after the terminal device initiates a voice call or a video call, it can switch to the calling process corresponding to the voice call or the video call; in this case, if the terminal device subscribes to the video ringback tone service, it can receive the video ringback tone sent by the network device and load the video ringback tone in the calling process; exemplary, loading the video ringback tone can include playing the audio data and the video data contained in the video ringback tone.

[0028] In an embodiment, the interactive response state can include the response state of the terminal device in response to the interactive operation in the case of loading the audio data and / or the video data in the video ringback tone; exemplary, the response state can include at least one of the delay in response to the interactive operation, and whether the playing state of the terminal device to the audio data and / or the video data in the video ringback tone is switched after responding to the interactive operation.

[0029] ​Exemplarily, the interactive operation can be triggered by a user of the terminal device; wherein the user-triggered interactive operation can include causing the front sensor of the terminal device to approach the occlusion under the control of the user, and the interactive reaction state at this time can include whether the window of the terminal device is screen-off, and whether the terminal device continues to play audio data after the screen-off; Exemplarily, the user-triggered interactive operation can also include causing the pose of the terminal device to change under the control of the user, such as a rotation operation of the terminal device, and the interactive reaction state at this time can include whether the window display state of the terminal device follows the rotation operation to switch, such as whether the image frame displayed by the window is switched from a first display state to a second display state following the rotation operation, and the window switching duration from the first display state to the second display state, wherein the first display state can include a landscape display state or a portrait display state, and the second display state can include a portrait display state or a landscape display state.

[0030] Exemplarily, the interactive operation can also be triggered by a change in the environment of the terminal device, such as a change in the pose of the terminal device due to tilting or shaking of the support surface on which the terminal device is placed; at this time, the interactive reaction state can include whether the window of the terminal device is screen-off, whether the terminal device continues to play audio data after the screen-off, and whether the window display state of the terminal device follows the change in the pose to produce a following rotation.

[0031] In an embodiment, the data switching state can include a third period between the window switching from a third display state to a fourth display state, and can also include a third ratio associated with the window switching from the third display state to the fourth display state; wherein the third display state can represent a call window displaying "calling", the fourth display state can indicate a playing window displaying a first frame of video data, and the fourth display state can also indicate a call end window indicating a call failure or no answer, and accordingly, the third ratio can include a ratio between the number of call failures of the terminal device and the total number of calls.

[0032] In an embodiment, the audio playing state can include a playing state of the terminal device for audio data contained in a video ringtone; Exemplarily, the playing state can include the time of audio playing, whether the audio playing process is stuck, and the length of a first period between a first time and a second time, etc.; wherein the first time can include a time when the terminal device initiates a voice call or a video call, and the second time can include a time when the terminal device starts playing audio data, so that the first period can represent the time delay of the terminal device from dialing to audio data playing, i.e. the initial audio delay.

[0033] In an embodiment, the video playing status can include at least one of whether the video data in the video ringtone is stuck, whether the audio data and the video data in the video ringtone are in a synchronous playing state, a length of the second time period, whether the image frame in the video data is distorted, the first proportion, and the second proportion.

[0034] Exemplarily, the second time period can be a time period between a time when the terminal device loads a first image frame of the video data and the first time, i.e., a first frame loading duration.

[0035] Exemplarily, the image frame distortion can include that the image frame cannot be displayed completely and clearly, wherein the image frame cannot be displayed completely and clearly can include that at least a partial region of the image frame is displayed in a blur or in small blocks, and the at least partial region displayed in a blur or in small blocks can include that the at least partial region is displayed in a mosaic.

[0036] Exemplarily, the first proportion can include a proportion between a distorted display region in the image frame of the video data and a size of the image frame, and the second proportion can include a proportion between a length of the time period when the video data is stuck and a total playing time period of the video data.

[0037] In an embodiment, the obtaining of the status data set can be implemented in the following manner:

[0038] The actual calling process of the terminal device multiple times is tracked, and the loading time of the terminal device for the audio data and the video data in the video ringtone, the actual audio data playing effect of the terminal device, the actual loading effect of the video data, and the change process of the window display state of the terminal device are tracked and collected in combination with the signaling transmission and the data interaction between the terminal device and the network device, so as to obtain the status data set. Exemplarily, the data interaction can include a process in which the network device sends the video ringtone to the terminal device, and the signaling transmission can include a signaling for realizing the calling state tracking which is interacted between the terminal device and the network device.

[0039] A data collection environment is configured, in which the process in which the terminal device initiates a video call or an audio call is controlled by software, and the signaling transmission and the data interaction process of the terminal device are tracked and collected in the above process, and the loading time of the terminal device for the audio data and the video data in the video ringtone, the actual audio data playing effect of the terminal device, the actual loading effect of the video data, and the change process of the window display state of the terminal device are collected, so as to obtain the status data set. Exemplarily, the data collection environment can be configured by adjusting environmental parameters such as wireless signal strength, humidity, and temperature.

[0040] Step 102, based on the data in the status data set, evaluating the performance status of the video ringtone.

[0041] In an embodiment, the performance state can be used to represent the smoothness of loading the video color ring at one end of the terminal device.

[0042] In an embodiment, the performance state can be evaluated by any of the following ways:

[0043] The data in the state data set is quantized to obtain a quantized data set, and the scores in the quantized data set are statistically averaged to obtain a statistical average result, and the service level is evaluated based on the statistical average result; for example, the performance state can be improved as the statistical average result increases.

[0044] A weight set is obtained, and the data in the quantized data set is weighted and summed based on the weights in the weight set, and the result of the weighted sum is determined as the service level corresponding to the service level, wherein the performance state can be improved as the service level increases.

[0045] In an embodiment, the data in the state data set is quantized to obtain a quantized data set, which can be determined by the following way:

[0046] A mapping relationship set is obtained, and the state data corresponding to the audio loading state in the state data set is quantized based on the audio mapping relationship to obtain an audio state quantization result, the state data corresponding to the video loading state in the state data set is quantized based on the video mapping relationship to obtain a video state quantization result, and the state data corresponding to the display mode in the state data set is quantized based on the interaction mapping relationship to obtain a display state quantization result; wherein the mapping relationship set can include the audio mapping relationship, the video mapping relationship, the interaction mapping relationship and the display mapping relationship, and the mapping relationship in the mapping relationship set can realize the mapping and quantization processing of the state data in the state data set to the corresponding score; for example, the mapping relationship can be established in advance.

[0047] Video-related data Excellent (85-100 points) Pass (60-84 points) Unqualified (less than 60) Second period length ≤2000ms 2000ms-3000ms Greater than 3000ms Data synchronization deviation ≤30ms 30-50ms Greater than 50ms Second proportion ≤5％ 5％-15％ Greater than 15%

[0048] Table 1

[0049] Table 1 is a data quantization diagram of the video mapping relationship provided by the embodiment of the application. As shown in Table 1, the data synchronization deviation can represent the time difference between the timestamp of the audio data played by the terminal device and the timestamp of the video data played by the terminal device when the audio data and the video data are in an asynchronous state. Specifically, the data synchronization deviation can include the audio-visual synchronization deviation.

[0050] In this way, with the help of Table 1, the video-related data in the state data set can be quantized to three intervals of excellent, qualified and unqualified, and can be quantized to a specific video state quantization result.

[0051] From the above, the method for evaluating the video ringback tone service provided by the embodiments of the present application obtains the state data set, and the state data in the state data set is used to at least represent the audio playing state, the video playing state, and the display mode of the call window associated with the call process of the video ringback tone. In this way, when the video ringback tone is loaded in the call process of the terminal device, the data including the video playing state, the audio playing state, and the display mode of the call window of the terminal device can be comprehensively and diversely obtained, so as to improve the comprehensiveness of the data in the state data set. On this basis, the service performance of the video ringback tone is evaluated based on the data in the state data set, the performance state of the video ringback tone can be comprehensively evaluated from the dimensions of the audio playing state, the video playing state, and the display mode of the call window, so as to improve the comprehensiveness and accuracy of the evaluation of the video ringback tone service.

[0052] Based on the foregoing embodiments, in the method for evaluating the video ringback tone service provided by the embodiments of the present application, the performance state of the video ringback tone is evaluated based on the data in the state data set, which can be implemented in the following manner:

[0053] The dynamic weight set is obtained, and the performance state is evaluated based on the dynamic weight in the dynamic weight set and the score set corresponding to the state data set.

[0054] The dynamic weight set is at least associated with the call success rate of the call process.

[0055] In an implementation manner, the number of weights in the dynamic weight set can be the same as the number of state data in the state data set, and the sum of the weights in the dynamic weight set can be 1.

[0056] In an implementation manner, the dynamic weight set can be determined in the following manner:

[0057] The initial weight set is obtained, and the weights in the initial weight set are adjusted based on at least the call success rate to obtain the dynamic weight set; that is, the dynamic weight set can dynamically change with the change of the call success rate of the call process.

[0058] In an implementation manner, the score set corresponding to the state data set can include the audio state quantization result, the video state quantization result, and the display state quantization result in the foregoing embodiments.

[0059] In an implementation manner, the performance state can be evaluated in the following manner:

[0060] Each score in the score set is weighted based on the dynamic weight in the dynamic weight set to obtain a weighted result, and then the performance state is evaluated according to the weighted result.

[0061] Exemplarily, the weighted result Qoe can be calculated by formula (1):

[0062] Qoe = x1xS1 + x2xS2 + x3xS3 + x4xS4xSC_f (1)

[0063] wherein (x1, x2, x3, x4) can be an initial weight set, (S1, S2, S3, S4) can represent a score corresponding to an audio playing state, a score corresponding to a video playing state, a score corresponding to an interactive response state in a window mode, and a score corresponding to a window switching state in the window mode, and x4xSC_f can reflect a dynamic correction to the weight x4, that is, the dynamic weight set can be (S1, S2, S3, x4xSC_f).

[0064] As can be seen from the above, in the evaluation method of the video ringback tone provided by the embodiments of the present application, after obtaining the dynamic weight set, the performance state is evaluated based on the dynamic weight in the dynamic weight set and the service scores corresponding to the state data set, thus realizing a full-range dynamic evaluation of the service scores corresponding to the state data set, so as to improve the accuracy of the performance state; and the dynamic weight set is at least associated with the call success rate of the call process, thus realizing the association between the call success rate of the terminal device and the performance state, so as to further improve the accuracy of the performance state.

[0065] Based on the foregoing embodiments, in the evaluation method of the video ringback tone service provided by the embodiments of the present application, before evaluating the performance state based on the dynamic weight in the dynamic weight set and the score set corresponding to the state data set, the following operation can also be performed:

[0066] determining the score set.

[0067] wherein the score set includes an audio score corresponding to an audio playing state, a video score corresponding to a video playing state, and a display score corresponding to a display mode.

[0068] In an implementation manner, the display score can include an interactive response score corresponding to an interactive response state, and a window switching score corresponding to a window switching state.

[0069] In an implementation manner, the audio score can represent the length of the first time period and the frequency or number of audio playing stutters, etc.; exemplarily, the audio score can decrease with the extension of the first time period and the increase of the frequency or number of audio data playing stutters.

[0070] Correspondingly, the audio score can be obtained by counting the length of the first time period and / or the frequency or number of audio playing stutters.

[0071] In an embodiment, the video score can represent the number of times of video data playing stutters, the length of the second time period, the first proportion, and the second proportion; and the video score can decrease with the increase of the number of times of video data playing stutters, the increase of the length of the second time period, the increase of the first proportion, and the increase of the second proportion.

[0072] Accordingly, the video score can be determined by counting the number of times of first video data playing stutters, the length of the second time period, the first proportion, and the second proportion.

[0073] In an embodiment, the interaction response score can represent the length of the delay of the interaction response state; and the interaction response score can decrease with the increase of the delay of the interaction operation.

[0074] In an embodiment, the window switching score can represent the length of the third time period and the third proportion; and the window switching score can decrease with the increase of the length of the third time period and the increase of the third proportion.

[0075] Accordingly, the display score can be determined by counting and averaging the length of the delay of the interaction operation, the length of the third time period, and the third proportion.

[0076] As can be seen from the above, the evaluation method of the video ringback tone service provided by the embodiments of the present application determines a score set, and the score set includes an audio score corresponding to an audio playing state, a video score corresponding to a video playing state, and a display score corresponding to a display mode, so that comprehensive quantification of data in the state data set is realized, thereby improving the comprehensiveness and accuracy of the scores in the score set.

[0077] Based on the foregoing embodiments, in the evaluation method of the video ringback tone service provided by the embodiments of the present application, the dynamic weights in the dynamic weight set are related to a scene correction factor; and the scene correction factor is used to represent a scene in which the terminal device is located.

[0078] In an embodiment, the scene in which the terminal device is located can be represented by a load condition of the terminal device, a signal interference condition of an environment in which the terminal device is located, and the like; and the load condition can include the number of data processing resources currently available to the terminal device, and the signal interference condition can represent the interference strength of the environment in which the terminal device is located.

[0079] In an embodiment, the scene correction factor can change or adjust with the different load conditions and / or signal interference conditions.

[0080] From the above, the evaluation method of the video ringback tone service provided by the embodiments of the present application, the dynamic weight in the dynamic weight set is related to the scene correction factor, and the scene correction factor is used to represent the scene in which the terminal device is located. In this way, by using the scene correction factor, the association between the dynamic weight in the dynamic weight set and the scene in which the terminal device is located is realized, so that the accuracy of the dynamic weight set can be improved.

[0081] Based on the foregoing embodiments, in the evaluation method of the video ringback tone service provided by the embodiments of the present application,

[0082] The scene correction factor is associated with the network state related to the call process,

[0083] and / or,

[0084] The scene correction factor is associated with the video frame rate of the video ringback tone.

[0085] In an implementation, the network state can include the network quality of the wireless mobile network used to support the call process; for example, the network quality can be represented by the signal strength, the signal-to-noise ratio, and the like.

[0086] Correspondingly, the scene correction factor can be determined in the following manner:

[0087] The scene correction factor is adjusted or determined according to the network quality; for example, the scene correction factor can be increased as the network quality improves, and decreased as the network quality deteriorates.

[0088] In an implementation, the video frame rate can represent the type of the video ringback tone; for example, the video frame rate greater than a frame rate threshold can correspond to a high-frame-rate type.

[0089] In an implementation, the scene correction factor can also be determined in the following manner:

[0090] The type of the video ringback tone is determined based on the video frame rate, and then the scene correction factor is determined according to the type of the video ringback tone; for example, the scene correction factor corresponding to the high-frame-rate type of the video ringback tone can have a value greater than the scene correction factor corresponding to the non-high-frame-rate type of the video ringback tone; for example, if the video frame rate indicates that the video ringback tone is a high-frame-rate video, the scene correction factor can have a value of 1.1, and the weight in the dynamic weight set corresponding to the score corresponding to the video state data can have a value of 0.5.

[0091] From the above, the video ringback tone service evaluation method provided by the embodiment of the application can reflect the influence of the video frame rate on the video loading process of the video ringback tone through the scene correction factor.

[0092] Based on the foregoing embodiment, in the video ringback tone service evaluation method provided by the embodiment of the application,

[0093] The scene correction factor is associated with the call success rate corresponding to the call process.

[0094] In one implementation, the scene correction factor is associated with the call success rate, which can include that the scene correction factor is determined by the network quality of the network in which the call process is executed; for example, if the network quality is less than a quality threshold, the value of the scene correction factor can be 0.9, and the weight corresponding to the window switching score in the dynamic weight set can take a value of 0.3.

[0095] From the above, the video ringback tone service evaluation method provided by the embodiment of the application can reflect the influence of the video frame rate on the video loading process of the video ringback tone through the scene correction factor.

[0096] Based on the foregoing embodiment, in the video ringback tone service evaluation method provided by the embodiment of the application, the state data set can be obtained through the following steps:

[0097] Step A1, based on the evaluation system, determine the to-be-evaluated parameter.

[0098] The to-be-evaluated parameter includes the audio parameter, the video parameter, the reaction parameter, and the switching parameter of the video ringback tone; and the evaluation system includes a hierarchical evaluation system for multi-dimensional parameters of the video ringback tone service.

[0099] In one implementation, the evaluation system can include parameters, indexes, and methods for horizontal evaluation of the video ringback tone service.

[0100] In one implementation, the multi-dimensional parameters included in the evaluation system can include the audio parameter, the video parameter, the interaction parameter, and the switching parameter, so that the multi-dimensional parameters included in the evaluation system can provide parameter basis for horizontal evaluation of the video ringback tone service; the interaction parameter and the switching parameter can correspond to the display mode, the audio parameter can correspond to the audio playing state, and the video parameter can correspond to the video playing state.

[0101] Figure 2A structural diagram of an evaluation system provided by the embodiment of the present application is shown in Figure 2 The evaluation system can include first-level indexes, second-level indexes, and third-level indexes.

[0102] Exemplarily, the first-level indexes can include QoE, which is used to represent the satisfaction experience score of a user for the video ringback tone service; the second-level indexes can include service performance, audio performance, video performance, and interaction performance, wherein the service performance can be represented by a switching parameter, the audio performance can be represented by an audio parameter, the video performance can be represented by a video parameter, and the interaction performance can be represented by an interaction parameter.

[0103] Exemplarily, the third-level indexes can include a call establishment success rate and a first frame loading time length corresponding to the service performance, an initial audio delay and a picture-sound synchronization deviation corresponding to the audio performance, a video freezing time length proportion and a mosaic area proportion corresponding to the video performance, and a screen switching response delay corresponding to the interaction performance; wherein the video freezing time length can correspond to the time period length of the video data playing freezing in the foregoing embodiment, the mosaic area proportion can correspond to the first proportion in the foregoing embodiment, and the screen switching response delay can correspond to the window switching time length in the foregoing embodiment.

[0104] Exemplarily, through the evaluation system, the first-level indexes can be gradually decomposed to the third-level indexes, thereby constructing a causal chain including user experience-index data-and service parameters.

[0105] Exemplarily, the sensor data collection provides a method and a medium for collecting a state data set.

[0106] In an implementation, the to-be-evaluated parameters can include at least part of the parameters corresponding to the second-level indexes included in the evaluation system, and the number and / or type of the parameters in the to-be-evaluated parameters can be adjusted or changed according to the demand for evaluating the video ringback tone service, which is not limited in the embodiment of the present application.

[0107] In step A2, a first index set is determined based on the indexes associated with the to-be-evaluated parameters in the evaluation system.

[0108] In an implementation, the indexes in the first index set can include a set of third-level indexes directly associated with the to-be-evaluated parameters in the evaluation system.

[0109] Exemplarily, the first index set can include all the third-level indexes shown in Figure 2 Accordingly, the first index set can be determined in the following manner:

[0110] A set of second-level indexes associated with the to-be-evaluated parameters in the evaluation system is obtained, and a set of third-level indexes directly associated with the set of earphone indexes in the evaluation system is determined as the first index set.

[0111] Table 2 is a summary of the secondary indicators and tertiary indicators and their measurement methods provided by the embodiments of the present application.

[0112] Step A3, in the call process of the terminal device, performing data collection operation based on the indicators included in the first indicator set to obtain a state data set.

[0113] In an embodiment, the data collection operation can be realized by the following way:

[0114] By evaluating the data collection methods included in the evaluation system corresponding to the indicators in the first indicator set, the data corresponding to the indicators in the first indicator set is collected for multiple times, and the data is integrated to obtain the state data set.

[0115]

[0116] Table 2

[0117] Exemplarily, the data collection operation can be realized by a data collection system. Figure 3 The structure diagram of the data collection system provided by the embodiments of the present application is shown as follows: Figure 3 The data collection system 300 can include a central control platform, a terminal test module, a network monitoring module, and an audio and video analysis module, wherein the terminal test module includes a sensor group and a simulated call unit, the network monitoring module includes a wireless signal analyzer and a media stream packet capturing tool, and the audio and video analysis module includes a video quality evaluation engine and an audio quality analysis engine.

[0118] Exemplarily, the central control platform can be set in the cloud, which is used to coordinate the data interaction between the modules, and is also used to start the service level evaluation and generate the service evaluation report; specifically, it can realize the first data transmission between the terminal test module, the second data transmission between the network monitoring module, and the third data transmission between the audio and video analysis module through the standard communication interface; wherein the first data can include reaction state data, such as the specific data including screen switching delay time, and whether the terminal device is in the screen-off state, etc., the second data can include network state data, such as the network state data specifically including signal to interference plus noise ratio (SINR), reference signal receiving power (RSRP), and packet loss rate, and the third data can include data such as whether the audio playback is stuck, whether the video playback is stuck, and audio-visual synchronization deviation, etc.

[0119] Exemplarily, for the terminal test module, the sensor group contained therein can include a gyroscope and a proximity sensor; wherein the data sent by the gyroscope can monitor whether the posture of the terminal device changes, so as to obtain whether to trigger the interrupt device to perform the screen rotation operation; and by controlling the proximity sensor, the state of the display screen of the terminal device being lighted or turned off can be simulated, so as to realize the collection of the interaction reaction state related data.

[0120] Exemplarily, for the simulation call unit, it can simulate the control of the terminal device to initiate the Voice Over IP Management System (VoIMS) and the video ringtone related call, and can also record the signaling delay and the first frame loading time and the like video loading state.

[0121] Exemplarily, the wireless signal analyzer can measure the network quality of the environment in which the terminal device is located in real time during the data collection process; exemplarily, the network quality can be graded based on the following standards:

[0122] The first level: SINR>20dB, RSRP>-90dBm;

[0123] The second level: SINR 5~10dB, RSRP-100~-90dBm;

[0124] The third level: SINR-3~0dB, RSRP-120~-110dBm.

[0125] Exemplarily, the media stream packet capture tool can analyze the Real-Time Transport Protocol (RTP) stream and calculate the packet loss rate and jitter parameter of the video ringtone, so as to realize the detection of the audio and video stream transmission state of the video ringtone.

[0126] Exemplarily, the video quality evaluation engine can analyze the video stuttering, mosaic and video frame rate and the like data, and by analyzing the mosaic, the first proportion can be determined; wherein the image picture pause greater than or equal to 200ms can be determined as once video sub-stuttering.

[0127] Exemplarily, by the video quality evaluation engine, the first frame loading time can also be determined.

[0128] Exemplarily, by the audio quality analysis engine, the initial audio delay and the audio-visual synchronization deviation can be measured, and the second proportion and the audio-visual synchronization deviation can also be calculated.

[0129] From the above, the evaluation method of the video ringback tone service provided by the embodiment of the present application determines the to-be-evaluated parameters after the audio parameters, the video parameters, the interactive parameters and the switching parameters of the video ringback tone are determined based on the evaluation system, and the evaluation system includes a hierarchical evaluation system for multi-dimensional parameters of the video ringback tone service. In this way, the accuracy of the to-be-evaluated parameters can be improved, and the stability of obtaining the to-be-evaluated parameters can also be improved. Moreover, the first index set associated with the to-be-evaluated parameters in the evaluation system is determined, which can improve the relevance between the first index set and the to-be-evaluated parameters. On this basis, in the calling process of the terminal device, the data collection operation is performed based on the indexes included in the first index set to obtain the state data set, which can not only improve the consistency between the state data set and the to-be-evaluated parameters, but also improve the comprehensiveness of the state data in the state data set.

[0130] Based on the foregoing embodiment, the evaluation method of the video ringback tone service provided by the embodiment of the present application can further perform the following steps:

[0131] Step B1, determining a parameter set associated with the video ringback tone service.

[0132] The parameter set at least includes an audio state parameter, a video state parameter, a display mode parameter including an interactive reaction parameter and a window switching state parameter.

[0133] In an implementation manner, the parameter set can be determined according to a network environment on which the video ringback tone service is implemented, and data processing links involved in the process of receiving and loading the video ringback tone by the terminal device. For example, the data processing links can include playing audio data of the video ringback tone, playing video data of the video ringback tone, and switching state of data displayed by the window of the terminal device in the process of playing the video ringback tone. Correspondingly, the parameter set can include an audio loading parameter corresponding to the audio data, a video loading parameter corresponding to the video data, an interactive reaction parameter corresponding to the switching state, and a window switching parameter corresponding to the network environment.

[0134] Table 3 is a summary result of the parameter set provided by the embodiment of the present application. As shown in Table 3,

[0135] Parameter category Specific parameter Business basic parameter Terminal type (whether to support VoIMS), color ring platform signaling process stability Network performance parameter RSRP, SINR, packet loss rate and network bandwidth Audio performance parameter Initial audio delay, audio stall frequency and audio picture synchronization deviation Video performance parameter First frame loading time, video stall rate, mosaic area proportion and video frame rate Interaction performance parameter Screen switching response delay and screen-off audio persistence

[0136] Table 3

[0137] In Table 3, the terminal type in the service basis parameter can be used to describe whether the terminal device supports VoIMS, and the ringback tone platform signaling flow stability can represent the stability of the signaling transmission between the network device and the terminal device after the terminal device initiates a call, which has a direct impact on the data switching state of the window of the terminal device.

[0138] Exemplarily, the network performance parameters and the service base parameters in Table 3 can correspond to the window switching parameters, the audio performance parameters in Table 3 can correspond to the audio loading parameters, the video performance parameters can correspond to the video loading parameters, and the interaction performance parameters can correspond to the interaction reaction parameters.

[0139] Step B2, determining a second index set associated with the video ringback tone service.

[0140] The index data in the second index set are used to describe the execution process of the video ringback tone service at the terminal device.

[0141] In an implementation, the second index set can include a set of indexes capable of finely characterizing the specific execution process of the video ringback tone service.

[0142] In an implementation, the second index set can be determined in any of the following ways:

[0143] From the perspective of user experience, indexes that can affect user experience in the execution process of the video ringback tone service are traversed and summarized to obtain the second index set.

[0144] The indexes corresponding to the parameters in the parameter set are refined to obtain the second index set.

[0145] Exemplarily, the physical meaning characterized by the indexes in the second index set can be the same as the physical meaning characterized by the corresponding indexes in the first index set in the foregoing embodiments.

[0146] Step B3, determining an association relationship between the parameters in the parameter set and the index data in the second index set, and constructing an evaluation system based on the association relationship.

[0147] In an implementation, the association relationship can include a one-to-one or one-to-many mapping relationship between the parameters in the parameter set and the index data in the second index set; for example, the association relationship can represent a one-to-many mapping relationship between the audio loading parameters in the parameter set and the multiple index data in the second index set.

[0148] Correspondingly, the association relationship can be determined in the following way:

[0149] According to the performance types associated with the data in the second index set, the data in the second index set are mapped to the parameters in the parameter set corresponding to the performance types, so as to obtain the association relationship.

[0150] In an implementation, the evaluation system can be constructed in the following way:

[0151] Based on the association relationship, the index data in the second index set is mapped to the parameters in the parameter set respectively, so as to construct the hierarchical membership structure between the parameters in the parameter set and the index data in the second index set. On the basis of the structure, the data collection method of the index data in the second index set is configured, and the data collection method is set as the child node of the second index set. Meanwhile, the satisfaction experience score of the user for the video ringback tone service can also be configured as the parent node of the parameters in the parameter set. In this way, the hierarchical membership structure configured with the above child node and parent node can be determined as the evaluation system.

[0152] Specifically, the evaluation system can be as shown in Figure 2

[0153] As can be seen from the above, the evaluation method of the video ringback tone service provided by the embodiments of the present application determines the parameter set associated with the video ringback tone service, and the parameter set at least includes the audio loading parameter, the video loading parameter, the interactive response parameter and the window switching state parameter. In this way, through the parameter set, the execution state of the video ringback tone service can be reflected from the audio loading, the video loading, the interactive response and the window switching level. Furthermore, the second index set associated with the video ringback tone service is determined, and the index data in the second index set is used to describe the execution process of the video ringback tone service on the terminal device. In this way, through the second index set, the execution process of the video ringback tone service on the terminal device side can be more finely and comprehensively represented. On this basis, the association relationship between the parameters in the parameter set and the index data in the second index set is determined, and the evaluation system is constructed based on the association relationship. Not only the completeness and comprehensiveness of the parameters and the index data contained in the evaluation system can be improved, but also the precision of the association between the parameters and the index data in the evaluation system can be improved.

[0154] Based on the foregoing embodiments, in the evaluation method of the video ringback tone service provided by the embodiments of the present application, the state data set can be obtained by the following steps:

[0155] Step C1, configure an environment parameter.

[0156] The environment parameter is used to describe the environment state of the data collection environment. The environment state includes the device state of the terminal device, the data state of the video ringback tone and the network state of the network in which the terminal device is located.

[0157] In some embodiments, the device state at least includes the load state and the screen refresh rate; the data state at least includes the frame rate and the resolution; and the network state at least includes the signal strength, the signal-to-noise ratio and the bandwidth.

[0158] In an implementation, the frame rate can include the video frame rate of the video data in the video ringback tone of the video ringback tone service, and the resolution can include the resolution of the video data. ​

[0159] In an implementation, the load status can include the remaining available data processing resources of the terminal device.

[0160] In an implementation, the environmental parameters can be adjusted according to the specific evaluation requirements of the video ringback tone service, which is not limited in the embodiments of the present application.

[0161] In an implementation, the data collection environment can include the sum of the software environment and / or hardware environment for collecting the set of status data; for example, the data collection environment can include the network environment, the device environment of the terminal device, and the data environment of the video ringback tone; wherein the network environment can be configured by adjusting at least one of the signal strength, the signal-to-noise ratio, and the bandwidth, the device environment can be configured by adjusting at least one of the load status and the screen refresh rate, and the data environment can be configured by adjusting at least one of the frame rate and the resolution of the video ringback tone.

[0162] Step C2, configuring the data collection environment based on the environmental parameters.

[0163] In an implementation, the data collection environment can be configured by using the automated software capable of realizing the environmental configuration.

[0164] Step C3, collecting data under the data collection environment to obtain the set of status data.

[0165] Specifically, the set of status data can be collected by using the data collection process shown in Figure 4 Figure 4 The process schematic diagram of the data collection process provided by the embodiments of the present application is shown in Figure 4

[0166] Test preparation; for example, the test preparation stage can include determining the terminal device for testing, the software environment for configuring the test environmental parameters, etc.; for example, the data collection environment can include a constant temperature and humidity laboratory, and the environmental parameters thereof can include the temperature, the humidity, and the noise, etc.; wherein the temperature can be configured at 15℃-35℃, the humidity can be configured at 25%-75%, and the noise intensity can be configured to be less than or equal to 55dB; wherein the noise intensity can be monitored in real time by using a noise meter.

[0167] Environmental parameter initialization; for example, the environmental parameter initialization can include determining the environmental parameters.

[0168] Network condition configuration; for example, the network condition configuration can be configured according to the signal strength, the signal-to-noise ratio, and the bandwidth, for example, the network condition can be configured according to the following data:

[0169] ​​The first level: SINR > 20dB, RSRP >-90dBm;

[0170] The second level: SINR 5~10dB, RSRP-100~-90dBm;

[0171] The third level: SINR-3~0dB, RSRP-120~-110dBm.

[0172] Exemplarily, the frame rate, resolution and encoding type of the video color ring can also be configured in this link; exemplarily, the encoding type can include the encoding format of the video data, such as the above-mentioned encoding format can include H.264 High Profile and H.265 Main Profile, the resolution can include 720P (1280x720) and 1080P (1920x1080), and the frame rate can include 24FPS, 30FPS and 60FPS, etc.

[0173] Terminal working condition setting; exemplarily, the terminal device can be configured according to the load state and the screen refresh rate; specifically, the load state can include a first load state, i.e., the load amount is less than or equal to 20%, a second load state, i.e., the load amount is 20%~60%, and a third load state, i.e., the load amount is greater than or equal to 90%; the screen refresh rate can be configured as 60Hz, 90Hz and 120Hz.

[0174] Exemplarily, the device temperature of the terminal device can also be configured in this link; for example, the device temperature can be configured as-10℃, 25℃ and 40℃.

[0175] Test color ring loading; exemplarily, after the pre-network condition configuration and the terminal working condition setting are completed, the test color ring loading operation can be started.

[0176] Simulate call triggering; exemplarily, the terminal device can be controlled to continuously initiate multiple calls by a software control method; for example, the terminal device can be controlled to continuously initiate 100 calls.

[0177] After simulating the call triggering, the sensor data acquisition, network signaling packet capture and audio / video stream recording operations can be synchronously performed.

[0178] Among them, the sensor data acquisition can include acquiring the data of the gyroscope and the data of the proximity sensor; exemplarily, by acquiring the data of the gyroscope, the pose of the terminal device can be determined, so as to simulate the rapid rotation of the terminal device, and by acquiring the data of the proximity sensor, it can be determined whether the terminal device is controlled to turn off the screen or turn on the screen. In the above process, the picture data displayed on the window of the terminal device can also be synchronously acquired by means of audio / video stream recording.

[0179] Exemplarily, for the interaction data collation, the picture data and the data of the collected gyroscope can be jointly analyzed to determine whether the video data displayed by the terminal device is rotationally followed by the posture of the terminal device, and the picture data and the data collected by the proximity sensor can be jointly analyzed to determine whether the terminal device is rotationally followed by the screen-off or screen-on; then the video data displayed by the terminal device is rotationally followed by the posture of the terminal device, and whether the terminal device is rotationally followed by the screen-off or screen-on are collated to obtain the interaction response state.

[0180] Exemplarily, in the process of whether the terminal device is rotationally followed by the screen-off or screen-on, the data recorded by the audio and video stream can be analyzed to verify whether the audio data is continuously played when the terminal device is screen-off; wherein the time threshold corresponding to the audio data interruption playing when the screen is off can be set to 50ms.

[0181] Exemplarily, for the network signaling packet capture, the signaling interaction between the terminal device and the network device can be collected to determine the call success rate of the terminal device, and the first frame loading time can be determined under the condition that the terminal device calls successfully in combination with the audio and video stream recording; wherein the business index calculation can include calculating the call success rate and the first frame loading time.

[0182] Exemplarily, for the audio and video stream recording, a high frame rate camera can be used to record the data display process of the terminal device from dialing to the first frame image of the video data, and the loading state of the video data and the playing state of the audio data in the call process of the terminal device can also be recorded; Exemplarily, for the first frame loading time in the foregoing embodiment, the first frame loading time corresponding to multiple calls can be statistically determined on average.

[0183] Exemplarily, for the media quality analysis, audio and picture synchronization test, audio data and / or video data stutter test, and video performance test can be implemented.

[0184] Specifically, the audio and picture synchronization test can use frame mark alignment to calculate the time deviation between the audio data and the video data by using the audio and video analyzer, and for the video data stutter test, the second proportion can be counted under the third level of network quality; wherein the packet loss rate threshold corresponding to the second proportion can be set to 10%.

[0185] Exemplarily, the video performance test can include mosaic detection and display frame rate test; wherein the mosaic detection can automatically identify the block distortion area by the video analyzer to calculate the first proportion, and the display frame rate test can analyze the display frame rate of the video data displayed by the terminal device by the video analyzer, and calculate the frame rate difference between the display frame rate and the video frame rate of the video data.

[0186] From the above, the evaluation method of the video ringback tone service provided by the embodiments of the present application configures the environment parameters, and the environment parameters are used to describe the environment state of the data collection environment, and the environment state includes the device state of the terminal device, the data state of the video ringback tone, and the network state of the network in which the terminal device is located. The data collection environment is configured based on the data collection state. In this way, through the environment parameters, the data collection environment can be flexibly configured in all directions and in various ways from the dimensions of the terminal device, the video ringback tone, and the network. Moreover, the device state at least includes the load state and the screen refresh rate, the data state at least includes the frame rate and the resolution, and the network state at least includes the signal strength, the signal-to-noise ratio, and the bandwidth. In this way, the data collection environment can be accurately configured in multiple dimensions and in fine granularity. On this basis, the data is collected in the data collection environment to obtain a state data set, which can improve the comprehensiveness and diversity of the data in the state data set, thereby providing data support for evaluating the video ringback tone service.

[0187] After obtaining the state data set in the above manner, the score set corresponding to the state data set can be determined by the method provided in the foregoing embodiments, and the score set, the corresponding data collection state, and the Qoe score are integrated to obtain a first evaluation data set. At the same time, the scores of a plurality of professional technical personnel on the picture adaptability and the smoothness of the terminal device operation in the loading process of the video ringback tone can be used to obtain a second evaluation data set. Then, the problems to be optimized including the freezing problem and the audio-video synchronization deviation are determined according to the first evaluation data set and the second evaluation data set, and the optimization data including the network state and the hardware upgrade of the terminal device are determined according to the problems to be optimized. The first evaluation data set, the second evaluation data set, and the optimization data are integrated into an evaluation file, and the evaluation file is taken as the final evaluation result of the video ringback tone service.

[0188] In summary, the technical solution provided by the embodiments of the present application can realize accurate evaluation of the video ringback tone service in all directions and in multiple dimensions through data linkage between the central control platform including the cloud, the mobile network, and the terminal device, in combination with the dynamic weight set associated with the scene correction factor.

[0189] Compared with the evaluation method in the related art, which is single in evaluation indexes and only focuses on the basic performance of audio and video, the technical solution provided in the application can also consider network fluctuation, terminal computing power and scene adaptation in the process of evaluating the video ringback tone service, so that accurate evaluation of the video ringback tone service can be realized.

[0190] Based on the foregoing embodiments, the application further provides an evaluation device for a video ringback tone service. Figure 5 A structural schematic diagram of the evaluation device for a video ringback tone service provided by the application is shown in FIG. 5, which can include: Figure 5

[0191] The collection module 501 is configured to acquire a set of state data, wherein the state data in the set of state data is used to represent the audio playing state, the video playing state of the video ringback tone in the calling process of the terminal device, and the display mode of the calling window associated with the calling process.

[0192] The processing module 502 is configured to evaluate the performance state of the video ringback tone service based on the data in the set of state data.

[0193] In some embodiments, the processing module 502 is configured to acquire a set of dynamic weights, and evaluate the performance state based on the dynamic weights in the set of dynamic weights and a set of scores corresponding to the set of state data, wherein the set of dynamic weights is at least associated with the call success rate of the calling process.

[0194] In some embodiments, the processing module 502 is configured to determine the set of scores, wherein the set of scores includes an audio score corresponding to the audio playing state, a video score corresponding to the video playing state, and a display score corresponding to the display mode.

[0195] In some embodiments, the dynamic weights in the set of dynamic weights are related to a scene correction factor, wherein the scene correction factor is used to represent the scene in which the terminal device is located.

[0196] In some embodiments, the scene correction factor is associated with the network state associated with the calling process, and / or the scene correction factor is associated with the video frame rate of the video ringback tone.

[0197] In some embodiments, the scene correction factor is associated with the call success rate corresponding to the calling process.

[0198] In some embodiments, the processing module 502 is configured to configure an environment parameter, wherein the environment parameter is used to describe the environment state of the data collection environment, and the environment state includes the device state of the terminal device, the data state of the video ringback tone, and the network state of the network in which the terminal device is located.

[0199] ​The processing module 502 is further configured to configure a data collection environment based on the environmental parameter configuration, and collect data in the data collection environment to obtain the state data set.

[0200] The embodiment of the present application further provides a video color ring service evaluation device, Figure 6 A structural schematic diagram of an electronic device provided by the embodiment of the present application is shown in the figure. Figure 6 As shown in the figure, the electronic device 600 comprises a processor 601 and a memory 602; the memory 602 stores a computer program; when the computer program is executed by the processor 601, the video color ring state evaluation method as any one of the preceding embodiments can be realized.

[0201] The embodiment of the present application further provides a computer readable storage medium, wherein the storage medium stores a computer program; when the computer program is executed by the processor of the electronic device, the method as any one of the preceding embodiments can be realized.

[0202] The embodiment of the present application further provides a computer program product, wherein the program product comprises a computer program; when the computer program is executed by the processor of the electronic device, the method as any one of the preceding embodiments can be realized.

[0203] The above description of various embodiments tends to emphasize the differences between various embodiments, and the same or similar parts can be mutually referred to, and for the sake of brevity, will not be repeated here.

[0204] The methods disclosed in the various method embodiments provided by the present application can be combined arbitrarily without conflict, to obtain new method embodiments.

[0205] The features disclosed in the various product embodiments provided by the present application can be combined arbitrarily without conflict, to obtain new product embodiments.

[0206] The features disclosed in the various method or device embodiments provided by the present application can be combined arbitrarily without conflict, to obtain new method or device embodiments.

[0207] It should be noted that the computer readable storage medium above can be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Ferromagnetic Random Access Memory (FRAM), a Flash Memory, a magnetic surface memory, an optical disc, or a Compact Disc Read-Only Memory (CD-ROM) memory, etc. It can also be various electronic devices including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, etc.

[0208] It should be noted that in this paper, the term "include", "contain" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0209] The above sequence number of the embodiments of the present application is only for description, not representing the advantages and disadvantages of the embodiments.

[0210] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by software plus necessary general hardware nodes, of course, it can also be realized by hardware, but in many cases the former is a better implementation. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disc, optical disc), and includes a plurality of instructions for making a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) execute the method described in various embodiments of the present application.

[0211] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0212] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0213] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0214] The above merely provides the preferred embodiment of the present application, and is not intended to limit the patent scope of the present application, and any equivalent structure or equivalent flow transformation according to the content of the present application specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for evaluating video ringback tones, characterized in that, The method includes: Obtain a set of status data; wherein, the status data in the set of status data is used to characterize the audio playback status, video playback status, and display mode of the call window associated with the call process during the call process of the terminal device; The performance status of the video ringback tone is evaluated based on the data in the aforementioned status data set.

2. The method according to claim 1, characterized in that, The evaluation of the performance status of the video ringback tone based on the data in the status data set includes: Obtain a dynamic weight set; wherein the dynamic weight set is at least associated with the call success rate of the call process; The performance status is evaluated based on the dynamic weights in the dynamic weight set and the score set corresponding to the state data set.

3. The method according to claim 2, characterized in that, Before evaluating the performance state based on the dynamic weights in the dynamic weight set and the score set corresponding to the state data set, the process further includes: Determine the score set; wherein the score set includes the audio score corresponding to the audio playback state, the video score corresponding to the video playback state, and the display score corresponding to the display mode.

4. The method according to claim 2 or 3, characterized in that, The dynamic weights in the dynamic weight set are related to the scene correction factor; wherein, the scene correction factor is used to characterize the scene in which the terminal device is located.

5. The method according to claim 4, characterized in that, The scene correction factor is associated with the network status of the call process, and / or the scene correction factor is associated with the video frame rate of the video ringback tone.

6. The method according to claim 4 or 5, characterized in that, The scenario correction factor is associated with the call success rate corresponding to the call process.

7. The method according to any one of claims 1 to 6, characterized in that, The acquired status data set includes: Configure environment parameters; wherein, the environment parameters are used to describe the environmental status of the data acquisition environment; the environmental status includes the device status of the terminal device, the data status of the video ringback tone, and the network status of the network where the terminal device is located; Configure the data acquisition environment based on the aforementioned environmental parameters; Data is collected in the data acquisition environment to obtain the status data set.

8. An electronic device, characterized in that, The electronic device includes a processor and a memory; the memory stores a computer program; when the computer program is executed by the processor, it is able to implement the video ringback tone evaluation method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, The storage medium stores a computer program; when the computer program is executed by the processor of the electronic device, it is able to implement the video ringback tone evaluation method as described in any one of claims 1 to 7.

10. A computer program product, characterized in that, The program product includes a computer program; when the computer program is executed by the processor of an electronic device, it is capable of implementing the video ringback tone evaluation method as described in any one of claims 1 to 7.

Images