Mobile application service scoring method, storage medium and electronic device

Abstract

The embodiment of the invention provides a scoring method for a mobile application service, a storage medium and an electronic device, and the method comprises the steps: cutting traffic data generated by the mobile application service into a plurality of traffic data segments according to a preset time interval, and carrying out the feature serialization, so as to determine the serialized numerical feature of each traffic data segment; and inputting the serialized numerical features of the traffic data fragments into a mobile application service scoring model, and outputting the score of the mobile application service. According to the embodiment of the invention, the method solves a problem that the scoring method does not have universality because the traffic data is required to be transmitted in a plaintext mode in a method for scoring a mobile application service in the related technology. Therefore, the flow data generated by the mobile application service is cut and further processed to generate the sequence representing the mobile application service, and the method for analyzing the sequence is wide in application range.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communications, and more specifically, to a scoring method, storage medium, and electronic device for mobile application services. Background Art

[0002] With the development of communication technology, mobile applications have become extremely popular. To timely perceive network quality and provide customers with a better mobile application experience (especially for services that rely heavily on network quality, such as video, VR, and voice), operators need a method that can comprehensively and quantitatively reflect the user experience of specific applications from multiple dimensions, taking into account service characteristics. On the other hand, for security reasons, service providers often use encrypted traffic to transmit interaction data between terminal applications and servers, which also greatly complicates the application experience quality scoring process.

[0003] The application scoring methods used in related technologies rely on the assumption that messages are transmitted in plaintext, in order to obtain the decoded data within them. Furthermore, even in plaintext transmission scenarios, messages do not necessarily carry all the decoded data required for scoring. Furthermore, encrypted transmission is currently an established trend, and in this case, all decoded data cannot be extracted from the message payload, making this method not universally applicable. Summary of the Invention

[0004] The embodiments of the present application provide a scoring method, storage medium, and electronic device for mobile application services, so as to at least solve the problem that the scoring method for mobile application services in the related art is not universal because it requires traffic data to be transmitted in plain text.

[0005] According to one embodiment of the present application, a scoring method for mobile application services is provided, which is characterized in that it includes: cutting the traffic data generated by the mobile application service into multiple traffic data segments according to preset time intervals, and serializing the features to determine the serialized numerical features of each of the traffic data segments; inputting the serialized numerical features of the traffic data segments into a mobile application service scoring model, and outputting the score of the mobile application service.

[0006] According to another embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is configured to execute the steps in the above method embodiment when running.

[0007] According to another embodiment of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in the above method embodiment.

[0008] Through the embodiment of the present application, since the traffic data generated by the mobile application business is cut into multiple traffic data segments, after cutting, in order to be able to use the mobile application business scoring model to score the mobile application business, the traffic data segments are feature serialized, and numerical features of the serialized traffic data segments are generated. The serialized features are input into the mobile application business scoring model, and then the score is output. The scoring method in the embodiment of the present application has no requirements on the transmission method of the traffic data. It can be transmitted in plain text or encrypted. For encrypted transmitted data, the score of the mobile application business can be obtained without decoding. Therefore, it can solve the problem that the scoring method for scoring mobile application services in the related art is not universal due to the requirement that the traffic data is transmitted in plain text, thereby achieving the effect of a wider range of use of the method for analyzing the sequence by cutting the traffic data generated by the mobile application business and further processing it to generate a sequence representing the mobile application business. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 This is a hardware structure block diagram of a computer terminal according to a scoring method for mobile application services according to an embodiment of the present application;

[0010] Figure 2 is a flowchart of a scoring method for a mobile application service according to an embodiment of the present application;

[0011] Figure 3 is a flowchart of a scoring method for a mobile application service according to yet another embodiment of the present application;

[0012] Figure 4 is a flow chart of a data collection method according to an embodiment of the present application;

[0013] Figure 5 is a schematic diagram of the composition of original sample data according to an embodiment of the present application;

[0014] Figure 6 is a flowchart of a scoring formula design method according to an embodiment of the present application;

[0015] Figure 7 is a flowchart of a tag calculation method according to an embodiment of the present application;

[0016] Figure 8 is a flowchart of a method for determining an original vector sequence according to an embodiment of the present application;

[0017] Figure 9is a schematic diagram of feature vector splicing according to an embodiment of the present application;

[0018] Figure 10 This is a schematic diagram of the characteristics of a serialized packet capture file according to an embodiment of the present application;

[0019] Figure 11 is a flowchart of a method for generating a mobile service scoring model according to an embodiment of the present application;

[0020] Figure 12 This is a partial schematic diagram of the network structure according to the embodiment of the present application. Figure 1 ;

[0021] Figure 13 This is a partial schematic diagram of the network structure according to the embodiment of the present application. Figure 2 ;

[0022] Figure 14 4 is a structural block diagram of a scoring device for mobile application services according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] The embodiments of the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0024] It should be noted that the terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0025] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a computer terminal as an example, Figure 1 This is a hardware structure block diagram of a computer terminal for a mobile application service scoring method according to an embodiment of the present application. Figure 1 As shown, the computer terminal may include one or more ( Figure 1 Only one is shown) a processor 102 (the processor 102 may include but is not limited to a microprocessor MCU or a programmable logic device FPGA and other processing devices) and a memory 104 for storing data. The computer terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It will be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above-mentioned computer terminal. For example, the computer terminal may also include Figure 1 More or fewer components than shown, or with Figure 1 Different configurations shown.

[0026] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the scoring method of the mobile application business in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implementing the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories can be connected to the computer terminal via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0027] The transmission device 106 is used to receive or transmit data via a network. A specific example of the aforementioned network may include a wireless network provided by a communications provider of a computer terminal. In one embodiment, the transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0028] The following methods are commonly used in related technologies to score application experience (taking video services as an example):

[0029] The first step is to obtain message decoding data: extract fields such as video bit rate and resolution that are highly relevant to user experience from the payload of the user-plane message.

[0030] The second step is calculating factors influencing user experience: The decoded data extracted in the first step is combined according to business logic to derive various factors influencing the score. For example, the number and duration of video freezes can be calculated using traffic and bitrate information. Certain decoded data, such as video resolution, can also be directly considered as influencing factors. These factors are typically mapped to a numerical range on the same scale to eliminate dimensionality.

[0031] The third step is to calculate the final score based on the impact factors: For each impact factor obtained in the second step, different weights are assigned according to experience or specific needs, and each impact factor is weighted and calculated to obtain the final score for the business.

[0032] Figure 2 is a flow chart of a scoring method for a mobile application service according to an embodiment of the present application. Figure 2 As shown, the process includes the following steps:

[0033] Step S202 : cutting the traffic data generated by the mobile application service into a plurality of traffic data segments according to a preset time interval, and performing feature serialization to determine the serialized numerical features of each traffic data segment.

[0034] In one embodiment, after dividing the traffic data generated by a mobile application service into multiple traffic data segments, the basic characteristics of the traffic within each traffic data segment are determined. The basic characteristics include uplink traffic, downlink traffic, and the number of uplink packets or downlink packets. Each basic feature in each traffic data segment is then represented in vector form. All the basic features in vector form in each traffic data segment are concatenated to determine the original vector of each traffic data segment, thereby determining the original vector sequence corresponding to the traffic data generated by the mobile application service.

[0035] Step S204: inputting the serialized numerical features of the traffic data segments into a mobile application service scoring model, and outputting a score of the mobile application service.

[0036] In one embodiment, the original vector sequence is further encoded through a self-attention model to generate an enhanced vector sequence, and then the enhanced vector sequence is subjected to regression analysis through LSTM to generate a score for the mobile application service.

[0037] In one embodiment, when scoring a mobile application service, regardless of whether the traffic data generated by the mobile application service is encrypted, the traffic data can be segmented and feature serialized, and then the mobile application scoring model can be used to output the score of the mobile application service. Figure 3 FIG. 1 is a flow chart of a scoring method for a mobile application service according to another embodiment of the present application. Figure 3 The process includes the following steps:

[0038] Step S301: Loading a mobile application service scoring model on a network device.

[0039] Step S302: Detect traffic data of the target mobile application service.

[0040] Specifically, the network device detects the traffic data of the target mobile application service, such as the traffic data of a specific video application, through means such as Deep Packet Inspection (DPI).

[0041] Step S303: Process the traffic data into serialized numerical features.

[0042] Specifically, through and Figure 2The feature serialization in step S202 of the mobile application service scoring method shown in the figure is similar to the processing method, which processes the traffic data generated by the application into serialized numerical features.

[0043] Step S304: input the serialized numerical features into the mobile application service rating model, and output the rating of the mobile application service.

[0044] Before step S304 of the embodiment of the present application, it also includes: cutting the captured files in the original sample data according to preset time intervals, and performing feature serialization to determine the serialized numerical features of the original sample data, wherein the original sample data is collected and obtained from mobile application business data; scoring the metadata in the original sample data according to the scoring formula of the mobile application business to determine the label of the original sample data; training a neural network model for processing sequence data according to the serialized numerical features and the label of the original sample data to determine the mobile application business scoring model.

[0045] In one embodiment, the original sample data includes the collected packet capture files and metadata. The packet capture files are essentially the same as the traffic data in the above step S202, both of which are messages generated by mobile application services. The difference is that the traffic data in step S202 is the message generated in real time by the mobile application service when the mobile application service scoring model is actually used for scoring, while the packet capture files are in the stage of determining the mobile application service scoring model. In order to provide samples required for model training, the messages generated by the mobile application service are stored as packet capture files. Figure 4 is a flow chart of a data collection method according to an embodiment of the present application, such as Figure 4 As shown, the process includes the following steps:

[0046] Step S401: Open the packet capture software.

[0047] Specifically, the packet capture software is opened and run to capture the messages generated when the application is running as part of the original sample data. Figure 5 This is a schematic diagram of the original sample data composition according to the embodiment of the present application. Along the timeline of application use, there is a metadata file that stores various metadata generated in the intermediate process, including resolution 720P, bit rate 2Mbit / s, and freeze time 20s; there is also a packet capture file that stores the message data generated during the application operation.

[0048] Step S402: Open a specific mobile application.

[0049] Specifically, open the mobile application that needs to be analyzed and start the operation.

[0050] Step S403: applying different network conditions.

[0051] Specifically, during the use of the application, different network conditions can be imposed on it, such as good and poor signals, heavy or light device loads, etc. The purpose of this is to cover different scenarios as much as possible so that the trained model has better generalization capabilities.

[0052] Step S404: Record various metadata during the operation.

[0053] Specifically, various metadata generated during the use of the application are recorded, such as the bit rate, resolution, and freeze duration of video applications, as basic elements for making labels.

[0054] Step S405: store the captured packet file and the acquired metadata.

[0055] Specifically, after viewing is completed, the packet capture file obtained in step S401 and the annotation file obtained in step S404 are saved as a set of original sample data.

[0056] In one embodiment, there may be multiple types of scoring formulas for mobile application services, including assigning different weights to metadata related to user experience in mobile application services, and designing and generating a weighted quality scoring formula for mobile application services. Taking the weighted quality scoring formula as an example, Figure 6 is a flow chart of a scoring formula design method according to an embodiment of the present application. Figure 6 As shown, the process includes the following steps:

[0057] Step S601: Determine the evaluation dimension for a specific mobile application service.

[0058] Specifically, taking the video service as an example, "clarity" and "smoothness" are selected as evaluation dimensions.

[0059] Step S602: convert the evaluation dimension into metadata.

[0060] Specifically, the evaluation dimension selected in step S501 is converted into metadata that can actually be obtained during sample collection. For example, "clarity" can be mapped to "resolution" and "bitrate," two metadata related to user experience, while "smoothness" can be mapped to "freeze duration," another metadata related to user experience.

[0061] Step S603: Map each metadata to a scoring interval.

[0062] Specifically, each metadata can be considered an independent factor that affects the score. In order to quantify the score, each metadata needs to be mapped to a numerical range in a different way. Taking the percentage system as an example, for the metadata "resolution", the following mapping method can be planned:

[0063] Greater than 1080p, corresponding to 100 points;

[0064] Greater than 720p and less than or equal to 1080p, proportionally corresponding to the 90-100 score range;

[0065] Greater than 480p and less than or equal to 720p, the score is proportionally corresponding to the range of 70-90;

[0066] Greater than 360p and less than or equal to 480p, proportionally correspond to the 50-70 point range;

[0067] Less than 360p, proportionally corresponds to the range of 0-50 points.

[0068] The above is just an example and can be adjusted based on experience and actual needs.

[0069] As for other metadata, they can also be mapped to a numerical range of 0-100 according to their own characteristics.

[0070] Step S604: assign a weight to each metadata.

[0071] Specifically, the score is determined by the comprehensive evaluation of each metadata, but the importance of different metadata varies. Therefore, it is necessary to assign appropriate weights to each metadata according to actual needs. For example, the weight of resolution can be set to 0.3, the weight of bit rate can be set to 0.3, and the weight of the number of freezes can be set to 0.4.

[0072] Step S605: Determine a scoring formula for the mobile application service.

[0073] Specifically, the final formula for calculating the score should be the weighted value of each metadata. The specific process is: first extract the metadata, then obtain the score corresponding to each metadata according to the mapping method in 603, and finally sum these scores with the weights assigned in 604.

[0074] It should be noted that Figure 6 The method shown is applied to the video service. Similar methods are also used to design scoring formulas for other services.

[0075] In one embodiment, after determining the scoring formula for the mobile application service, the metadata in the original sample data is scored according to the determined scoring formula to determine the label of the original sample data. For example, the scoring formula is a weighted quality scoring formula. Figure 7 is a flow chart of a label calculation method according to an embodiment of the present application. Figure 7 As shown, the process includes the following steps:

[0076] Step S701: extract all metadata from a copy of original sample data.

[0077] Specifically, all metadata in a piece of original sample data, such as resolution, bit rate, freeze duration, etc., are extracted. These metadata are the basic units for generating the score value.

[0078] Step S702: Map each metadata into a score.

[0079] Specifically, each raw data is independently mapped to a specific numerical value, and each numerical value is an independent consideration of the final score.

[0080] Step S703: Calculate the label value by weighted summation.

[0081] Specifically, these values ​​are weighted and summed to obtain the final score value of the original sample data, which is also the label value of the original sample data.

[0082] It should be noted that the method in the embodiment of the present application needs to be applied to every piece of data in the original data.

[0083] In an exemplary embodiment, the packet capture file in the original sample data is cut according to a preset time interval and feature serialization is performed, including: cutting the packet capture file in the original sample data into multiple traffic data segments according to the preset time interval, and determining the basic features of the traffic in each traffic data segment; representing each basic feature in each traffic data segment in vector form, splicing all the basic features in vector form in each traffic data segment, determining the original vector of each traffic data segment, and then determining the original vector sequence corresponding to the packet capture file.

[0084] In an exemplary embodiment, determining the basic characteristics of the traffic in each traffic data segment includes calculating the uplink traffic, downlink traffic, the number of uplink packets, or the number of downlink packets of the traffic in each traffic data segment.

[0085] In one embodiment, the process of determining the original vector sequence corresponding to the captured packet file is as follows: Figure 8 As shown, the process includes the following steps:

[0086] Step S801: extract a packet capture file from the original sample data.

[0087] Step S802: Determine the sequence time interval.

[0088] Specifically, since the packet capture file is treated as a sequence, it must first be segmented to map the data to different positions in the sequence. Here, the packets are segmented by time, for example, using a 1-second interval (which can be adjusted based on the final result). The packet capture file can then be viewed as a sequence arranged in chronological order, with 1-second intervals as the basic unit.

[0089] Step S803: quantize each feature in each interval.

[0090] Specifically, each interval contains several basic features, such as the number of uplink packets, the number of downlink packets, uplink traffic, and downlink traffic. To facilitate algorithmic processing, each feature type needs to be represented as a vector. Taking the number of uplink packets as an example, we first need to group the packet lengths based on the overall distribution of the messages. The packet length refers to the length of the data packet, that is, the number of bytes contained in the data message. For example, the packet length can be divided into three intervals: [0, 500], [500, 1200], and [1200, 1500]. Assuming that in a specific interval, the corresponding number of packets in these three intervals is 9, 10, and 15, respectively, then the uplink packet length feature for this interval can be represented by the vector (9, 10, 15). The remaining features can also be converted into specific vectors using this method.

[0091] Step S804: All features in each interval are spliced ​​together.

[0092] Specifically, since each basic unit in a time series algorithm often corresponds to only a single vector, and step S803 obtains a vector representation of each feature in a specific interval, in order to losslessly represent this information with a single vector, the vectors of all features must be concatenated to form the final representation of the interval's features. For example, if only the two features of the uplink and downlink packet counts in an interval are considered, and the vector representations of these two features are (9, 10, 15) and (20, 110, 8, 50), respectively, then the concatenated vector is: (9, 10, 15, 20, 110, 80, 50). Figure 9 is a schematic diagram of feature vector splicing according to an embodiment of the present application, such as Figure 9 As shown, the number of uplink packets, the number of downlink packets, the uplink traffic, and the downlink traffic are concatenated to generate the feature vector t at each moment. Figure 10 This is a characteristic diagram of a serialized packet capture file according to an embodiment of the present application. After processing each interval, the entire packet capture file is converted into a vector sequence, and the basic unit of the sequence is a spliced ​​vector.

[0093] In an exemplary embodiment, a neural network model for processing sequence data is trained based on the serialized numerical features and the labels of the original sample data to determine a mobile application business scoring model, including: determining an enhanced vector sequence by encoding the original vector sequence, inputting the enhanced vector sequence and the labels of the original sample data into the neural network model, training the neural network model, and determining the mobile application business scoring model.

[0094] In an exemplary embodiment, encoding the original vector sequence to determine the enhanced vector sequence includes: encoding the original vector sequence through a self-attention model to determine the enhanced vector sequence.

[0095] In an exemplary embodiment, the enhanced vector sequence and the label of the original sample data are input into the neural network model, and the neural network model is trained, including: inputting the enhanced vector sequence and the label of the original sample data into a long short-term memory network (LSTM), and the LSTM trains the neural network model by performing label regression analysis on the original sample data.

[0096] In one embodiment, Figure 11 As shown, the process of the method for determining the enhanced vector sequence and training the neural network model to generate the mobile service scoring model includes the following steps:

[0097] Step S1101: Generate an enhanced vector sequence.

[0098] It should be noted that since the goal of the embodiment of this application is to use the idea of ​​sequence analysis to solve the problem of mobile application business rating, it is necessary to introduce a network structure that is good at handling sequence problems. Compared with the traditional use of LSTM and other recurrent neural network (RNN) family algorithms to build a network, the network structure described in the embodiment of this application also introduces a self-attention model encoder (Transformer Encoder) as part of the network structure.

[0099] Specifically, if Figure 12 As shown in the figure, each enhanced vector is represented by all other vectors in the sequence (taking r2 as an example in the figure). The Transformer Encoder uses the self-attention mechanism of the self-attention model to further encode the original vector feature t at any time to obtain the corresponding enhanced vector r2, thereby being able to obtain more correlations between elements within the sequence (global attention).

[0100] Step S1102: Send the enhanced vector sequence and the corresponding label to LSTM for training.

[0101] Specifically, after obtaining the enhanced vector sequence, as Figure 13 As shown, the augmented vector sequence r and its corresponding label h are fed into an LSTM network for sequence processing. This network overlays the information from each augmented vector to analyze the label value corresponding to the feature, which is the business score. Once the LSTM is trained, the mobile application business scoring model is established.

[0102] Step S1103: Achieve the expected effect through parameter debugging.

[0103] Specifically, the corresponding parameters are adjusted to improve the model's performance. These parameters can be algorithm hyperparameters, such as the number of Transformer Encoder layers or the number of neurons in an LSTM, or feature-related parameters, such as the size of the interval or the dimension of the vector feature.

[0104] In an exemplary embodiment, after training the neural network model for processing sequence data based on the serialized numerical features and the labels of the original sample data, it also includes at least one of the following: adjusting the number of layers of the encoder of the self-attention model; adjusting the number of neurons of the LSTM.

[0105] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0106] This embodiment also provides a scoring device for mobile application services, which is used to implement the above-mentioned embodiments and preferred implementations. Details that have already been described will not be repeated. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.

[0107] Figure 14 is a structural block diagram of a scoring device for a mobile application service according to an embodiment of the present application. Figure 14As shown, the device includes: a scoring design module, a data acquisition module, a label calculation module, a feature calculation module, a model training module, and an online operation module.

[0108] Scoring Design Module: This module develops scoring criteria. For example, from the perspective of user experience, it is necessary to consider which factors (such as smoothness and clarity) are included in the scoring of an application. These factors need to be mapped to the metadata collected during the collection process (such as resolution, bitrate, and duration of freezes). The scoring criteria are then quantified in the form of formulas to guide the subsequent labeling process.

[0109] Data Collection Module: This module collects raw data generated during application execution to support subsequent training. By running specific applications in different network environments, it generates raw sample data representing a variety of user experiences. Each set of raw data includes a packet capture file and metadata such as resolution, bitrate, and duration of freezes.

[0110] Label Calculation Module: This module calculates a label value for each sample, representing the score corresponding to the application usage. By substituting the metadata acquired by the Data Collection Module into the scoring formula provided by the Scoring Design Module, we can obtain a score for each sample, also known as the label value.

[0111] Feature calculation module: The function of this module is to process the packet capture files in the original samples obtained in the data acquisition module and make them into serialized numerical data as the feature input of the algorithm.

[0112] Model training module: This module uses a Transformer + LSTM network for training. The algorithm inputs are labels generated by the label calculation module and features generated by the feature calculation module. The algorithm is trained using this data, enabling the generated model to score the user experience quality based on the messages generated by the application.

[0113] Online operation module: This module first loads the trained model file on the network device. Then, when the user uses a specific application, it calculates the corresponding serialization features based on the messages generated by the application. Finally, it combines the features with the trained model file to score the application's user experience quality.

[0114] It should be noted that the above modules can be implemented through software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0115] The embodiments of this application address the problem that network application scoring methods in related technologies can only partially address scenarios where traffic is unencrypted, resulting in limited application scope and lack of universal applicability. The embodiments of this application cover a wide range of scenarios and do not require complex feature engineering, resulting in high efficiency and strong versatility. They can be used to quantify the quality of online services, enabling operators to perceive the real user experience when using applications, thereby ensuring network quality.

[0116] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any of the above method embodiments when run.

[0117] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0118] An embodiment of the present application further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0119] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0120] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0121] Obviously, those skilled in the art should understand that the modules or steps of the present application described above can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices, they can be implemented using program code executable by the computing device, and thus, they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0122] The above description is merely a preferred embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A scoring method for mobile application services, characterized in that: include: Cutting the traffic data generated by the mobile application service into a plurality of traffic data segments according to a preset time interval, and performing feature serialization to determine the serialized numerical features of each of the traffic data segments; The serialized numerical features of the traffic data segments are input into a mobile application service scoring model, and a score of the mobile application service is output.

2. The method according to claim 1, characterized in that Before inputting the serialized numerical features of the traffic data segments into the mobile application business scoring model, the method further includes: Slicing the captured packet files in the original sample data according to the preset time intervals and performing feature serialization to determine the serialized numerical features of the original sample data, wherein the original sample data is collected and obtained from mobile application business data; Scoring the metadata in the original sample data according to a scoring formula for the mobile application business to determine a label for the original sample data; A neural network model for processing sequence data is trained according to the serialized numerical features and the labels of the original sample data to determine a mobile application business scoring model.

3. The method according to claim 2, characterized in that The packet capture files in the original sample data are cut according to the preset time intervals and feature serialized, including: Cutting the packet capture file in the original sample data into multiple traffic data segments according to the preset time interval, and determining the basic characteristics of the traffic in each traffic data segment; Each basic feature in each traffic data segment is represented in vector form, all basic features in vector form in each traffic data segment are spliced ​​together, the original vector of each traffic data segment is determined, and then the original vector sequence corresponding to the captured packet file is determined.

4. The method according to claim 3, characterized in that The step of training a neural network model for processing sequence data according to the serialized numerical features and the labels of the original sample data to determine a mobile application business scoring model includes: An enhanced vector sequence is determined by encoding the original vector sequence, the enhanced vector sequence and the label of the original sample data are input into the neural network model, the neural network model is trained, and a mobile application business scoring model is determined.

5. The method according to claim 4, characterized in that The step of determining the enhanced vector sequence by encoding the original vector sequence includes: The enhanced vector sequence is determined by encoding the original vector sequence through a self-attention model.

6. The method according to claim 4, characterized in that Inputting the enhanced vector sequence and the label of the original sample data into the neural network model to train the neural network model includes: The enhanced vector sequence and the label of the original sample data are input into a long short-term memory network LSTM, and the LSTM trains the neural network model by performing label regression analysis on the original sample data.

7. The method according to claim 2, characterized in that After training the neural network model for processing sequence data according to the serialized numerical features and the labels of the original sample data, the method further includes at least one of the following: Adjust the number of layers of the encoder of the self-attention model; Adjust the number of neurons in LSTM.

8. The method according to claim 3, characterized in that Determining the basic characteristics of the traffic in each traffic data segment includes: Calculate the uplink traffic, downlink traffic, number of uplink packets or number of downlink packets of the traffic in each traffic data segment.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 8 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

Images