A network interoperability evaluation method, device and electronic equipment

Abstract

The embodiment of the present application provides a kind of network interoperability evaluation method, device and electronic equipment, the method comprises: according to the first data of interoperability, the interoperability type of the interoperability is determined, and the first data is associated with the first model corresponding to the interoperability type, obtain second data;Second data is associated with the third data of the interoperability and is integrated into fourth data;By preset time sequence modeling method, according to the fourth data, the index time sequence atlas of the interoperability is obtained;According to the index time sequence atlas, by preset evaluation standard, the evaluation result of the interoperability is obtained.By the embodiment of the present application, the interoperability is more simply and reasonably evaluated, and data support is provided for network planning and optimization, so that the quality of cell network and residence ratio can be effectively improved by adjusting the strategy of interoperability.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of mobile communication, and in particular to a network interoperation evaluation method and device and electronic equipment. BACKGROUND

[0002] In the early and middle stages of new network construction, there may be multiple interoperation behaviors between networks in the co-coverage area with the original network. For example, 4 / 5G co-coverage area interoperation behavior is common in the early and middle stages of 5G network construction, and in the case of Standalone (SA) architecture deployment opening N26 interface, 4G / 5G interoperation in the connected state mainly includes redirection and handover. The factors mainly considered in interoperation strategy include coverage, service type, etc.

[0003] In order to be able to optimize network planning and operation in each period in a timely manner, it is necessary to evaluate the interoperation behavior. The current evaluation method is as follows: 1. Analyze the relationship between the decrease in page download rate and the increase in the number of user terminals from a statistical point of view to determine whether the cell has reached the load threshold, and finally send an alarm; 2. A method for determining the interoperation mode currently used by the user according to the interoperation capability of the network and the terminal; a scheme that can support two interoperation modes at the same time is proposed, the network side can inform the terminal when the N26 interface fails, and automatically apply the N26 interface-free interoperation mode, focusing on the interoperation process itself; 3. According to the user perception dimension, determine the KPI index and convergence threshold of the perception dimension through the hierarchical mapping of KQI and KPI indexes, establish a KPI difference portrait model, and comprehensively score the service cell and the target cell. If the total score of the weight of the service cell is higher than that of the neighbor cell, start the emergency handover process.

[0004] The existing evaluation method mainly evaluates the rationality of interoperation from the aspects of network coverage level and wireless signal attenuation characteristics, etc., and cannot comprehensively evaluate the rationality of interoperation, and the obtained evaluation result is not accurate enough. SUMMARY

[0005] The purpose of the embodiments of the present application is to provide a network interoperation evaluation method, device and electronic equipment to solve the problem that the rationality of interoperation cannot be comprehensively evaluated, and the obtained evaluation result is not accurate enough.

[0006] In order to solve the above technical problems, the embodiments of the present application are implemented as follows:

[0007] In a first aspect, the embodiments of the present application provide a network interoperation evaluation method, comprising:

[0008] determine an interoperation type of the interoperation according to first data of the interoperation, and associate the first data with a first model corresponding to the interoperation type to obtain second data; wherein the first data is signaling data of a control plane, and the first model is a signaling dot association model;

[0009] associate the second data with third data of the interoperation to obtain fourth data; wherein the third data is service data of a user plane;

[0010] obtain an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method;

[0011] obtain an evaluation result of the interoperation according to the index time sequence graph through a preset evaluation standard.

[0012] In a second aspect, an embodiment of the present application provides a network interoperation evaluation device, comprising:

[0013] a recognition module configured to determine an interoperation type of the interoperation according to first data of the interoperation, and associate the first data with a first model corresponding to the interoperation type to obtain second data; wherein the first data is signaling data of a control plane, and the first model is a signaling dot association model;

[0014] an association module configured to associate the second data with third data of the interoperation to obtain fourth data; wherein the third data is service data of a user plane;

[0015] an analysis module configured to obtain an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method;

[0016] an evaluation module configured to obtain an evaluation result of the interoperation according to the index time sequence graph through a preset evaluation standard.

[0017] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a communication interface, a memory and a communication bus; wherein the processor, the communication interface and the memory complete mutual communication through the bus; the memory is used for storing a computer program; the processor is used for executing the program stored on the memory to realize the steps of the network interoperation evaluation method according to the first aspect.

[0018] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program; when the computer program is executed by a processor, the steps of the network interoperation evaluation method according to the first aspect are realized.

[0019] From the technical solutions provided by the embodiments of the present application, it can be seen that the embodiments of the present application determine the interoperation type of the interoperation according to the first data of the interoperation, associate the first data with a first model corresponding to the interoperation type to obtain second data, associate the second data with third data of the interoperation to obtain fourth data, obtain an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method, and obtain an evaluation result of the interoperation through a preset evaluation standard according to the index time sequence graph. Through the embodiments of the present application, the interoperation is evaluated more simply and reasonably, data support is provided for network planning and optimization, so that the network quality and the residence ratio of a cell can be effectively improved by adjusting the strategy of the interoperation. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0021] Figure 1 A flowchart of a network interoperation evaluation method provided by the embodiments of the present application;

[0022] Figure 2 A structural diagram of a server for executing a network interoperation evaluation method provided by the embodiments of the present application;

[0023] Figure 3 Another flowchart of a network interoperation evaluation method provided by the embodiments of the present application;

[0024] Figure 4 Another flowchart of a network interoperation evaluation method provided by the embodiments of the present application;

[0025] Figure 5 A diagram of an index time sequence graph provided by the embodiments of the present application;

[0026] Figure 6 Another flowchart of a network interoperation evaluation method provided by the embodiments of the present application;

[0027] Figure 7 A structural diagram of a network interoperation evaluation device provided by the embodiments of the present application;

[0028] Figure 8 A structural diagram of an electronic device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0029] The embodiment of the present application provides a network interoperability evaluation method, device and electronic equipment.

[0030] In order to enable personnel in the technical field to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative labor should belong to the protection scope of the present application.

[0031] As shown in Figure 1 The embodiment of the present application provides a network interoperability evaluation method, and the execution subject of the method can be a server. The server can be an independent server or a server cluster composed of multiple servers, and the server can be a server capable of network operation processing, such as a server for network resource configuration.

[0032] In step S110, the interoperability type of the interoperability is determined according to the first data of the interoperability, and the first data is associated with the first model corresponding to the interoperability type to obtain second data. The first data is signaling data of a control plane, and the first model is a signaling dot association model.

[0033] The interoperability is the interoperability between a first network and a second network. The first network and the second network can be determined according to actual network construction requirements. For example, the first network and the second network can be any two networks in a network such as a 3G network, a 4G network, a 5G network, a 6G network, etc. For the sake of simplicity, the interoperability between a 4G network and a 5G network is taken as an example in the following embodiments. Mobile communication has developed from 4G to 5G, and the network architecture and the service types carried have changed a lot. Therefore, the mobility management of the 5G network should not only adapt to the change of the network architecture, but also meet the service diversity. In the 4G network, the access and mobility management function is realized by the MME, while in the 5G service network architecture, the function is completed by the AMF.

[0034] The interoperability includes reselection, handover, redirection, etc.

[0035] The server synthesizes XDR (xDataRecord) data representing detailed records of the signaling process based on the signaling data of the control plane collected from multiple interfaces as the first data of the interoperability.

[0036] The plurality of network interfaces can include 2, N26, N11, N8, N14, S1-MME, S11, S5-C, S6a, and the like interfaces of a 4G / 5G network.

[0037] According to the first data synthesized, the interoperation type of the interoperation can be determined, which can be classified according to actual needs. In an embodiment, the interoperation type can include 5GS to EPS handover, EPS to 5GS handover, 5GS to EPS redirection / reselection, and EPS to 5GS redirection / reselection, and the like.

[0038] A first model corresponding to each interoperation type is established in advance, and the first model is a full-process signaling point correlation model of the interoperation scenario. According to the determined interoperation type, the corresponding first model is read, and the interoperation start time, end time, cell pair, and interface signaling state information in the first data are associated with the first model to obtain second data, which can be represented as BIGXDR data.

[0039] In step S120, the second data is associated with third data of the interoperation to obtain fourth data, wherein the third data is service data of a user plane.

[0040] The server also collects user plane online log data from a plurality of interfaces, determines a service type by analyzing and identifying the collected online log data, and the service type can include webpage browsing, video, game, instant messaging service, and the like. The collected online log data is synthesized to obtain service data of a user plane, that is, third data, which can be represented as service XDR data.

[0041] In an embodiment, the second data is analyzed to obtain user IMSI information, interoperation start time, end time, and cell pair field information, and then associated with the third data to obtain fourth data.

[0042] In step S130, an index time sequence graph of the interoperation is obtained according to the fourth data by a preset time sequence modeling method.

[0043] According to the fourth data, a preset time sequence modeling is performed to obtain an index time sequence graph of the interoperation, which is used to indicate a change trend of an index value obtained based on the fourth data, such as a signal strength change trend, a data throughput change trend, and the like.

[0044] In step S140, an evaluation result of the interoperation is obtained according to the index time sequence graph and a preset evaluation standard.

[0045] The index time series graph is evaluated according to preset evaluation criteria to obtain an evaluation result of the interoperation. The evaluation result can be that the interoperation has a leading interoperation problem or a slow interoperation problem.

[0046] In an implementation, as shown in Figure 2 The server can include a probe collection service module 201, a big event synthesis service module 202, an XDR correlation synthesis service module 203, and a data analysis service module 204.

[0047] The probe collection service module 201 is configured to collect signaling data of a control plane and online log data of a user plane from each interface, and perform parsing and service identification. The big event synthesis service module 202 synthesizes the signaling data of the control plane and the online log data of the user plane to obtain first data and third data respectively, and sends the first data and the third data to the XDR correlation synthesis service module 203 and the data analysis service module 204. The XDR correlation synthesis service module 203 sends the second data obtained after step S110 back to the big event synthesis service module 202. The big event synthesis service module 202 performs step S120, and the data analysis service module 204 performs steps S130-S140. The data analysis service module 204 stores the evaluation result obtained into a database 205 to facilitate a front-end interface 206 to call.

[0048] As can be seen from the technical solutions provided by the embodiments of the present application, the embodiments of the present application determine an interoperation type of the interoperation according to first data of the interoperation, correlate the first data with a first model corresponding to the interoperation type to obtain second data, correlate the second data with third data of the interoperation to obtain fourth data, obtain an index time series graph of the interoperation according to the fourth data by using a preset time series modeling method, and obtain an evaluation result of the interoperation according to the index time series graph by using a preset evaluation criteria. Through the embodiments of the present application, the interoperation is evaluated more simply and reasonably, data support is provided for network planning and optimization, and thus the network quality and the residence ratio of a cell can be effectively improved by adjusting the strategy of the interoperation.

[0049] Based on the above embodiments, further, as shown in Figure 3 The specific processing mode of step S110 can be various, and an optional processing mode is provided below. For details, refer to the following steps.

[0050] Step S111, obtaining first data of the interoperation.

[0051] Step S112, matching the first data with preset key signaling, and determining an interoperation type of the interoperation according to a matching result, the type including an interoperation scenario and / or a trigger cause.

[0052] The key signaling corresponding to each interoperation type is determined in advance. The following gives an example of the correspondence between several interoperation scenarios and key signaling:

[0053] The key signaling corresponding to the "5GS to EPS handover" scenario includes: N2 Handover Out, ForwardRelocation (N26 interface), and S1 handover in.

[0054] The key signaling corresponding to the "EPS to 5GS handover" scenario includes: S1 handover out, ForwardRelocation (N26 interface), and N2 Handover IN.

[0055] The key signaling corresponding to the "5GS to EPS redirection / reselection" scenario includes: UE Context Release (N2 interface), Tracking Area Update (S1-MME interface), and Update Location (S6a interface).

[0056] The key signaling corresponding to the "EPS to 5GS redirection / reselection" scenario includes: EPS bearer context deactivation (S1-MME interface), E-RAB release (S1-MME interface), and Registration Request (N2 interface).

[0057] Among them, the trigger cause needs to be further determined for some interoperation scenarios. For example, for the trigger cause of "5GS to EPS handover" and "5GS to EPS redirection", the trigger cause is mainly determined according to the PDU SESSION RESOURCE MODIFY and N2 Handover Out event cause. The trigger cause of the "5GS to EPS handover" scenario can be subdivided into "based on EPS FB traffic", "based on wireless coverage", "based on load balancing", "based on time criticality", and "other". The trigger cause of the "5GS to EPS redirection" scenario can be subdivided into: "EPS FB direct redirection", "data traffic direct redirection", "redirection after EPS FB handover failure", "handover failure triggered by wireless coverage", "other handover failure", and "other".

[0058] Step S113, reading a first model corresponding to the interoperation type, and associating the first data to obtain second data. The interoperation start time, end time, cell pair, and each interface signaling state in the first data are associated with the first model to obtain the second data.

[0059] The XDR association service module can filter unnecessary information before sending the second data to the large event synthesis service module. For example, the IMSI information of the switching / redirection interoperation user triggered by a non-EPS FB, the interoperation start time, the end time, and the cell pair can be filtered. The filtered second data is encapsulated into a specific format, such as a ZTP real-time stream, and is fed back to the large event synthesis service module.

[0060] As can be seen from the technical solutions provided by the embodiments of the present application, the first data is matched with each key signaling, and the interoperation type of the interoperation is determined according to the matching result. A first model corresponding to the interoperation type is read, and the first data is associated to obtain second data. Through the embodiments of the present application, the needed information can be extracted from the signaling data more quickly, and the rationality of the interoperation evaluation is improved.

[0061] Based on the above embodiments, further, as shown in Figure 4 The specific processing mode of the above step S130 can be various, and the following provides an optional processing mode, which can be seen from the following steps.

[0062] Step S131, slicing the fourth data according to a preset time slicing method to obtain each slice data.

[0063] After synthesizing the third data according to the collected online log data, and associating the second data with the third data according to the user IMSI information, the interoperation start time, the end time, and the cell pair field information to obtain fourth data, the fourth data can be sliced according to a preset time slicing method.

[0064] Further, the time slicing method can be various, and the present application only gives an example. In an embodiment, the preset time slicing method includes:

[0065] According to the interoperation start time and the end time, the fourth data is divided into three segments, including: before the interoperation starts, during the interoperation is executed, and after the interoperation ends. The segment before the interoperation starts includes a first number of slice data; the segment during the interoperation is executed includes a second number of slice data; and the segment after the interoperation ends includes a third number of slice data.

[0066] The first number, the second number and the third number can be set according to actual needs. In an embodiment, the fourth data is divided into 6 slice data before the interoperation starts, one slice data during the interoperation, and 6 slice data after the interoperation result. The time length of the slice data before the interoperation starts and after the interoperation result can also be set according to actual needs, for example, 5 seconds.

[0067] In an embodiment, each slice data can also be cleaned and the cell pair parameters of the interoperation are backfilled, which can specifically include station type, latitude, longitude, height, azimuth angle, coverage scenario, etc.

[0068] Step S132, determining the index value of each slice data, and obtaining the index time sequence atlas of the interoperation.

[0069] The required service index is extracted from each slice data as the index value of each slice data, for example, webpage loading rate, video download rate, instant messaging picture / audio / video message sending and receiving rate, etc.

[0070] Further, the determination of the index value of each slice data includes:

[0071] According to the interoperation type, the service type of the third data and the mobile mode of the user terminal, the index value of each slice data is determined.

[0072] The mobile mode of the user terminal is determined by a preset mobile mode recognition method according to each slice data, the second data and the cell information of the corresponding cell of the interoperation.

[0073] The classification of the mobile mode of the user terminal can be set according to actual needs. In an embodiment, the mobile mode of the user terminal can include indoor mode, outdoor walking mode and outdoor driving mode, etc.

[0074] The mobile mode of the user terminal can be determined by the data analysis service module according to the received each slice data and second data through a preset mobile mode recognition method. In an embodiment, the mobile mode recognition method includes:

[0075] 1. Reading the target cell type of the interoperation from the slice data and the second data;

[0076] 2. When the target cell station type is room division / room division station, the mobile mode of the user terminal is marked as indoor mode;

[0077] 3. When the target cell station type is not a room split / room split station, count and analyze the number of cells passed by the user within 5 minutes after the interoperation and the secondary interoperation behavior again;

[0078] 4. Analyze whether there is a ping-pong interoperation behavior within 30 seconds after the interoperation;

[0079] 5. When there is a ping-pong interoperation behavior within 30 seconds after the interoperation or the number of cells calculated in step 6 is < the cell quantity threshold, mark the mobile mode of the user terminal as an outdoor walking mode; wherein the cell quantity threshold can be obtained according to the average walking speed of people and the average radius of cell coverage, and through a large amount of field test data analysis, for example, 2;

[0080] 6. When there is no ping-pong interoperation behavior within 30 seconds after the interoperation, count the number of cells passed by the user within 5 minutes after the interoperation again, and the counting process needs to be de-duplicated and not count the original cell;

[0081] 7. When the number of cells >= the cell quantity threshold, mark the mobile mode of the user terminal as an outdoor driving mode.

[0082] After determining the terminal mobile mode, determine the service indicators of each slice data according to the interoperation type, the service type of the third data, and the mobile mode of the user terminal, as the indicator value of the slice data, and obtain the index time sequence atlas of the interoperation. As shown in Figure 5 , the index time sequence atlas is established with the rate of each slice data as the indicator value, wherein the slice data before the interoperation includes the slice data corresponding to slice 1-slice 6, and the slice data after the interoperation includes the slice data corresponding to slice 7-slice 12.

[0083] According to the distribution state of the indicator value of the slice data in the index time sequence atlas, and the change trend of the indicator value before and after the interoperation, the evaluation result of the interoperation is obtained.

[0084] As can be seen from the technical solutions provided by the above embodiments of the present application, the embodiments of the present application slice the fourth data according to the preset time slicing method to obtain each slice data; determine the indicator value of each slice data, and obtain the index time sequence atlas of the interoperation. Through the embodiments of the present application, the needed information is extracted from the signaling data more quickly, which is used to improve the rationality of interoperation evaluation.

[0085] Based on the above embodiments, further, as shown in Figure 6 , the specific processing mode of the above step S140 can be various, and the following provides an optional processing mode, which can be specifically referred to the following steps.

[0086] Step S141: Based on the first and second reference lines preset in the index time series graph, determine the number of high-quality slices bHn and the number of low-quality slices bLn in the slice data before the start of interoperation, and the number of high-quality slices aHn and the number of low-quality slices aLn in the slice data after the end of interoperation; wherein, high-quality slices are slice data with index values ​​higher than the first reference line, and low-quality slices are slice data with index values ​​lower than the second reference line, and the first reference line is higher than the second reference line.

[0087] The first reference line and the second reference line can be set according to actual needs. Different first reference lines and second reference lines can be set according to different business types.

[0088] like Figure 5 As shown, a first reference line a and a second reference line b are preset in the time series graph of this indicator. The first reference line a is used to indicate a rate of 1000 kbps, and the second reference line b is used to indicate a rate of 600 kbps. Based on the first reference line a and the second reference line b, the number of high-quality slices bHn = 4 and the number of low-quality slices bLn = 1 in the slice data before the interoperation begins, and the number of high-quality slices aHn = 1 and the number of low-quality slices aLn = 2 in the slice data after the interoperation ends.

[0089] Step S142: Based on the number of high-quality slices bHn and the number of low-quality slices bLn in the slice data before the interoperation begins, and the number of high-quality slices aHn and the number of low-quality slices aLn in the slice data after the interoperation ends, the evaluation result of the interoperation is obtained through a preset evaluation standard.

[0090] Furthermore, obtaining the interoperability evaluation result through preset evaluation criteria includes:

[0091] The interoperability evaluation results are obtained by using the evaluation criteria corresponding to each mobile mode.

[0092] It can predict and set corresponding evaluation criteria based on different mobile modes.

[0093] In one implementation, the evaluation criteria include:

[0094] When the user terminal's mobile mode is indoor mode, if bLn = 0 and aHn >= 2, or aLn >= 3, the evaluation result of this interoperation is a leading interoperation problem; if bLn >= 2, aLn <= 1 and aHn >= 1, the evaluation result of this interoperation is a slow interoperation problem.

[0095] When the mobile mode of the user terminal is the outdoor walking mode, if bLn<=1 and bHn>=2, the evaluation result of the current interoperation is the advanced interoperation problem; if bLn>=2, aLn<=1 and aHn>=2, the evaluation result of the current interoperation is the slow interoperation problem.

[0096] When the mobile mode of the user terminal is the outdoor driving mode, if bLn<=0 and bHn>=3, the evaluation result of the current interoperation is the advanced interoperation problem; if bLn>=2 and aHn>=2, the evaluation result of the current interoperation is the slow interoperation problem.

[0097] As can be seen from the technical solutions provided by the embodiments of the present application, the number of high-quality slices and the number of poor-quality slices in the slice data before the start of the interoperation and the number of high-quality slices and the number of poor-quality slices in the slice data after the end of the interoperation are determined according to the first reference line and the second reference line pre-set in the index time sequence map; and the evaluation result of the interoperation is obtained through the pre-set evaluation standard according to the number of high-quality slices and the number of poor-quality slices in the slice data before the start of the interoperation and the number of high-quality slices and the number of poor-quality slices in the slice data after the end of the interoperation. Through the embodiments of the present application, the interoperation is more reasonably evaluated.

[0098] Corresponding to the network interoperation evaluation method provided by the above embodiments, based on the same technical concept, the embodiments of the present application also provide a network interoperation evaluation device, Figure 7 The module composition diagram of the network interoperation evaluation device provided by the embodiments of the present application is shown in the figure, and the network interoperation evaluation device is used for executing Figures 1 to 6 The network interoperation evaluation method described above, as Figure 7 shown, the network interoperation evaluation device includes an identification module 701, an association module 702, an analysis module 703 and an evaluation module 704.

[0099] The identification module 701 is used for determining the interoperation type of the interoperation according to the first data of the interoperation, and associating the first data with the first model corresponding to the interoperation type to obtain second data; wherein the first data is the signaling data of the control plane, and the first model is the signaling dot association model; the association module 702 is used for associating the second data with the third data of the interoperation to obtain fourth data; wherein the third data is the service data of the user plane; the analysis module 703 is used for obtaining the index time sequence map of the interoperation according to the fourth data through a pre-set time sequence modeling method; and the evaluation module 704 is used for obtaining the evaluation result of the interoperation through a pre-set evaluation standard according to the index time sequence map.

[0100] From the technical solutions provided by the embodiments of the present application, it can be seen that the embodiments of the present application determine the interoperation type of the interoperation according to the first data of the interoperation, associate the first data with a first model corresponding to the interoperation type to obtain second data, associate the second data with third data of the interoperation to obtain fourth data, obtain an index time sequence graph of the interoperation according to the fourth data by using a preset time sequence modeling method, and obtain an evaluation result of the interoperation according to the index time sequence graph and by using a preset evaluation standard. Through the embodiments of the present application, the interoperation is evaluated more simply and reasonably, data support is provided for network planning and optimization, and thus the network quality and the residence ratio of a cell can be effectively improved by adjusting the strategy of the interoperation.

[0101] Based on the above embodiments, further, the identification module is configured to:

[0102] obtain first data of the interoperation;

[0103] match the first data with preset key signaling, and determine an interoperation type of the interoperation according to a matching result, the interoperation type including an interoperation scenario and / or a trigger cause;

[0104] read a first model corresponding to the interoperation type, and associate the first data to obtain second data.

[0105] From the technical solutions provided by the embodiments of the present application, it can be seen that the embodiments of the present application match the first data with preset key signaling, and determine an interoperation type of the interoperation according to a matching result; read a first model corresponding to the interoperation type, and associate the first data to obtain second data. Through the embodiments of the present application, the information required is extracted from signaling data more quickly, and the rationality of interoperation evaluation is improved.

[0106] Based on the above embodiments, further, the analysis module is configured to:

[0107] slice the fourth data according to a preset time slicing method to obtain each slice data;

[0108] determine an index value of each slice data, and obtain an index time sequence graph of the interoperation.

[0109] Further, the preset time slicing method includes:

[0110] According to a start time and an end time of the interoperation, the fourth data is divided into a first number of slice data before the interoperation starts, a second number of slice data during the execution of the interoperation, and a third number of slice data after the interoperation ends.

[0111] Further, the analysis module is configured to:

[0112] determine an index value of each slice data according to the interoperation type, a service type of the third data, and a moving mode of the user terminal.

[0113] The moving mode of the user terminal is determined according to each slice data, the second data, and cell information of a cell corresponding to the interoperation, by using a preset moving mode recognition method.

[0114] According to the technical solutions provided by the embodiments of the present application, each slice data is obtained by slicing the fourth data according to a preset time slicing method, and an index value of each slice data is determined to obtain an index time sequence graph of the interoperation. The embodiments of the present application can extract the required information from the signaling data more quickly, and improve the rationality of the interoperation evaluation.

[0115] Based on the above embodiments, further, the evaluation module is configured to:

[0116] determine a number of good slice data and a number of poor slice data in the slice data before the interoperation starts, and a number of good slice data and a number of poor slice data in the slice data after the interoperation ends according to a first reference line and a second reference line in the index time sequence graph, wherein the good slice data is slice data with an index value higher than the first reference line, the poor slice data is slice data with an index value lower than the second reference line, and the first reference line is higher than the second reference line.

[0117] obtain an evaluation result of the interoperation by using a preset evaluation standard according to the number of good slice data and the number of poor slice data in the slice data before the interoperation starts, and the number of good slice data and the number of poor slice data in the slice data after the interoperation ends.

[0118] Further, the evaluation module is configured to obtain the evaluation result of the interoperation by using an evaluation standard corresponding to each moving mode.

[0119] From the technical solutions provided by the embodiments of the present application, it can be seen that the embodiments of the present application determine the number of high-quality slices and the number of poor-quality slices in the slice data before the start of the interoperation and the number of high-quality slices and the number of poor-quality slices in the slice data after the end of the interoperation according to the first reference line and the second reference line preset in the index time sequence map; and obtain the evaluation result of the interoperation according to the number of high-quality slices and the number of poor-quality slices in the slice data before the start of the interoperation and the number of high-quality slices and the number of poor-quality slices in the slice data after the end of the interoperation by using the preset evaluation standard. Through the embodiments of the present application, the interoperation is more reasonably evaluated.

[0120] The network interoperation evaluation device provided by the embodiments of the present application can implement each process in the embodiments of the network interoperation evaluation method described above, and thus details are not repeated here.

[0121] It should be noted that the network interoperation evaluation device provided by the embodiments of the present application is based on the same inventive concept as the network interoperation evaluation method provided by the embodiments of the present application, and thus the specific implementation of this embodiment can be referred to the implementation of the network interoperation evaluation method described above, and details are not repeated.

[0122] Corresponding to the network interoperation evaluation method provided by the embodiments described above, based on the same technical concept, the embodiments of the present application also provide an electronic device for executing the network interoperation evaluation method described above, Figure 8 To implement the structure of an electronic device of each embodiment of the present application, as Figure 8 shown. The electronic device can have great differences due to different configurations or performances, and can include one or more processors 801 and memories 802, and the memories 802 can store one or more storage application programs or data. The memory 802 can be temporary storage or persistent storage. The application programs stored in the memory 802 can include one or more modules (not shown in the figure), and each module can include a series of computer executable instructions in the electronic device. Further, the processor 801 can be configured to communicate with the memory 802 and execute a series of computer executable instructions in the memory 802 on the electronic device. The electronic device can also include one or more power supplies 803, one or more wired or wireless network interfaces 804, one or more input and output interfaces 805, and one or more keyboards 806.

[0123] Specifically in this embodiment, the electronic device includes a processor, a communication interface, a memory and a communication bus; wherein the processor, the communication interface and the memory complete mutual communication through the bus; the memory is used for storing a computer program; the processor is used for executing the program stored on the memory to realize the following method steps:

[0124] determining an interoperation type of the interoperation according to first data of the interoperation, and associating the first data with a first model corresponding to the interoperation type to obtain second data; wherein the first data is signaling data of a control plane, and the first model is a signaling dotting association model;

[0125] associating the second data with third data of the interoperation to obtain fourth data; wherein the third data is service data of a user plane;

[0126] obtaining an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method;

[0127] obtaining an evaluation result of the interoperation according to the index time sequence graph through a preset evaluation standard.

[0128] The embodiment of the application further provides a computer readable storage medium, wherein the storage medium stores a computer program, and the computer program is executed by a processor to realize the following method steps:

[0129] determining an interoperation type of the interoperation according to first data of the interoperation, and associating the first data with a first model corresponding to the interoperation type to obtain second data; wherein the first data is signaling data of a control plane, and the first model is a signaling dotting association model;

[0130] associating the second data with third data of the interoperation to obtain fourth data; wherein the third data is service data of a user plane;

[0131] obtaining an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method;

[0132] obtaining an evaluation result of the interoperation according to the index time sequence graph through a preset evaluation standard.

[0133] Those skilled in the art will appreciate that embodiments of the present application can be readily used as a method, apparatus, or computer program product. Accordingly, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer readable storage media (including, but not limited to, disk memory, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0134] The present application is described in reference to the flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart illustrations and / or block diagrams block or blocks. Figure 1 Figure 1

[0135] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the flowchart illustrations and / or block diagrams block or blocks. Figure 1 Figure 1

[0136] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the flowchart illustrations and / or block diagrams block or blocks. Figure 1 Figure 1

[0137] In one typical arrangement, an electronic device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0138] The memory can include non-persistent memory, random access memory (RAM), and / or non-volatile memory, such as read only memory (ROM) or flash memory, among others. The memory is an example of computer readable media. ​​​​​​

[0139] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0140] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article or apparatus that includes a list of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0141] Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, apparatus or computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0142] The above only describes the embodiments of the present application and is not intended to limit the present application. Those skilled in the art can make various modifications and changes to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included in the scope of the claims of the present application.

Claims

1. A network interoperability assessment method, characterized by, The method comprises: determining an interoperation type of the interoperation according to first data of the interoperation, and associating the first data with a first model corresponding to the interoperation type to obtain second data; wherein the first data is signaling data of a control plane, and the first model is a signaling dot association model; associating the second data with third data of the interoperation to obtain fourth data; wherein the third data is service data of a user plane; obtaining an index time sequence graph of the interoperation according to the fourth data by a preset time sequence modeling method; obtaining an evaluation result of the interoperation according to the index time sequence graph by a preset evaluation standard; the method of obtaining the index time sequence graph of the interoperation according to the fourth data by the preset time sequence modeling method comprises: slicing the fourth data according to a preset time slicing method to obtain each slice data; determining an index value of each slice data and obtaining the index time sequence graph of the interoperation; the method of determining the index value of each slice data comprises: determining the index value of each slice data according to the interoperation type, a service type of the third data and a mobile mode of a user terminal; wherein the mobile mode of the user terminal is determined according to each slice data, the second data and cell information of a cell corresponding to the interoperation by a preset mobile mode recognition method.

2. The method of claim 1, wherein, the method of determining the interoperation type of the interoperation according to the first data of the interoperation, and associating the first data with the first model corresponding to the interoperation type to obtain the second data comprises: obtaining the first data of the interoperation; matching the first data with each key signaling and determining the interoperation type of the interoperation according to a matching result, wherein the interoperation type comprises an interoperation scenario and / or a trigger cause; reading the first model corresponding to the interoperation type and associating the first data to obtain the second data.

3. The method of claim 1, wherein, the preset time slicing method comprises: dividing the fourth data into a first number of slice data before the interoperation starts, a second number of slice data during the interoperation and a third number of slice data after the interoperation ends according to a start time and an end time of the interoperation.

4. The method of claim 1, wherein, the method of obtaining the evaluation result of the interoperation according to the index time sequence graph by the preset evaluation standard comprises: determining a number of good slice data and a number of poor slice data in the slice data before the interoperation starts and a number of good slice data and a number of poor slice data in the slice data after the interoperation ends according to a first reference line and a second reference line preset in the index time sequence graph; wherein the good slice data is slice data with an index value higher than the first reference line, the poor slice data is slice data with an index value lower than the second reference line, and the first reference line is higher than the second reference line; obtaining the evaluation result of the interoperation by the preset evaluation standard according to the number of good slice data and the number of poor slice data in the slice data before the interoperation starts and the number of good slice data and the number of poor slice data in the slice data after the interoperation ends.

5. The method of claim 4, wherein, The evaluation result of the interoperation is obtained through preset evaluation criteria. The evaluation result of the interoperation is obtained through the evaluation criteria corresponding to each mobile mode.

6. A network interoperability evaluation apparatus characterized by comprising: The device comprises: The identification module is configured to determine an interoperation type of the interoperation according to first data of the interoperation, and associate the first data with a first model corresponding to the interoperation type to obtain second data; the first data is signaling data of a control plane, and the first model is a signaling dot association model; The association module is configured to associate the second data with third data of the interoperation to obtain fourth data; the third data is service data of a user plane; The analysis module is configured to obtain an index time sequence graph of the interoperation according to the fourth data through a preset time sequence modeling method; The evaluation module is configured to obtain an evaluation result of the interoperation according to the index time sequence graph through preset evaluation criteria. In the analysis module, the index time sequence graph of the interoperation is obtained according to the fourth data through a preset time sequence modeling method, which comprises: The fourth data is sliced according to a preset time slicing method to obtain each slice data; Index values of each slice data are determined to obtain the index time sequence graph of the interoperation; The determination of the index values of each slice data comprises: The index values of each slice data are determined according to the interoperation type, a service type of the third data, and a mobile mode of a user terminal; The mobile mode of the user terminal is determined according to each slice data, the second data, and cell information of a cell corresponding to the interoperation through a preset mobile mode identification method.

7. An electronic device, comprising: The device comprises a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface, and the memory communicate with each other through the bus; the memory is configured to store a computer program; the processor is configured to execute the program stored in the memory to implement the network interoperation evaluation method steps of any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer program is stored in the computer readable storage medium, and the computer program is executed by the processor to implement the network interoperation evaluation method steps of any one of claims 1-5.

Images