A method, device and equipment for collecting and monitoring DNN performance indicators

Abstract

The present invention provides a method, device and equipment for collecting and monitoring DNN performance indicators, the method comprising: a user enters the performance indicators of the DNN dimension to be collected into a database table through an indicator entry page; obtains a list of DNN indicators to be collected from the database table; reads the BP recorded in Redis, obtains the 5GC performance file list under the Ceph directory, collects the performance files after storing the BP, saves the time in the file name as the BP and records it in Redis, and reports relevant performance file information to a MySQL database; parses the 5GC performance file to obtain DNN indicator data; writes the performance indicator data of the DNN dimension obtained based on S04 into an input file; writes the input file into an ES database, and reports the information of the input link into MySQL; periodically queries the data status of each network element type in each province in each link in the MySQL monitoring data table, and sends an alarm SMS notification if the number of files or the amount of data in a certain link is lower than a threshold.

Description

Technical Field

[0001] The embodiments of the present invention generally relate to the field of communication technology, and more particularly to a method, apparatus, and device for collecting and monitoring DNN performance indicators. Background Art

[0002] Traditional performance metrics in 5G core networks are collected at the network element level, making it impossible to perceive DNN-level metrics and usage. Furthermore, because the collection process involves other system interfaces and unexpected issues such as network and server performance bottlenecks, data loss, data delays, and even system crashes and service outages can occur during the data collection process.

[0003] For example, the patent "A Method, Device, and System for Acquiring Network Performance Indicators (Application Number: CN201210186546.1)" involves obtaining network element version information provided by network element logs; selecting a network performance indicator algorithm that matches the network element version information based on the network element version information; and calculating network performance indicators based on the network performance indicator calculation method provided by the network performance indicator algorithm. This solution can quickly and easily describe network performance indicator algorithms, helping operators monitor network performance, but it does not address the issue of being unable to perceive DNN-dimensional indicator data and usage. Summary of the Invention

[0004] To solve the above problems, the present invention collects original performance files based on the performance indicators of the DNN dimension entered on the page, obtains performance indicator data of different indicator objects, namely DNN; adopts multiple databases to adapt to different usage scenarios; uses MySQL to enter and store performance indicators, uses Redis for efficient processing in the collection and analysis process, and stores massive performance indicator data in ES for real-time retrieval; the combination of the three brings a more efficient and timely data query experience; adds monitoring and alarm functions for each link in the entire file life cycle (including Ceph generation, collection, analysis, and warehousing), and can automatically send alarm notifications to relevant implementation and maintenance personnel in a timely manner when abnormal situations such as data delays and missing occur, making the handling of abnormal situations particularly efficient.

[0005] According to an embodiment of the present invention, a method, apparatus and device for collecting and monitoring DNN performance indicators are provided.

[0006] In a first aspect of the present invention, a method for collecting and monitoring DNN performance indicators is provided. The method comprises:

[0007] S01: The user enters the performance indicators of the DNN dimensions to be collected into the database table through the indicator entry page;

[0008] S02: Get the list of DNN indicators that need to be collected from the database table;

[0009] S03: Read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database;

[0010] S04: Parse the 5GC performance file and obtain DNN indicator data;

[0011] S05: Write the performance indicator data of the DNN dimension obtained in S04 into the storage file;

[0012] S06: Write the incoming file into the ES database and report the incoming information into MySQL;

[0013] S07: Periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification is sent.

[0014] Furthermore, the indicators described in S01 include calculation indicators and non-calculation indicators; when the calculation indicators are entered, the indicator calculation caliber on the indicator entry page is filled in with the corresponding indicator calculation formula, and whether it is the original indicator is checked by checking "no"; when the non-calculation indicators are entered, the indicator calculation caliber on the indicator entry page is filled in with the original indicator code, and whether it is the original indicator is checked by checking "yes".

[0015] Furthermore, while collecting and storing the performance file after BP in S03, the relevant information of the file pushed to Ceph is reported into Mysql. The relevant information includes: link name, file name, provincial node, network element type, number of entries contained in the file and the sending time of the link. The link name is the file push to Ceph link, which is mapped to Ceph. The sending time of the link is the generation time of the file under Ceph.

[0016] Furthermore, the time in the saved file name in S03 is used as BP. If multiple files are collected at one time, the maximum time in the files collected this time is taken. The purpose of recording BP is to avoid repeated collection of performance files.

[0017] Furthermore, the relevant performance file information described in S03 is reported to the Mysql database, wherein the relevant performance file information includes: the link name, file name, provincial node to which it belongs, network element type to which it belongs, the number of entries contained in the file, and the time when the link occurs. The link name is the collection link, mapped to Collect, and the time when the link occurs is the time when the file is currently collected.

[0018] Furthermore, the specific steps of S04 are:

[0019] S041: For non-computing indicators, read the performance file data one by one. If the original code of the indicator in the data is not in the DNN indicator list to be collected, filter it; otherwise, retain it and confirm the corresponding DNN indicator data based on the indicator object in the data;

[0020] S042: For calculation indicators, convert the original indicators contained therein into corresponding indicator values according to the corresponding indicator calculation caliber for calculation, thereby obtaining the corresponding values;

[0021] S043: Report the relevant performance file information of the parsing process to the ES database. The performance file information includes: link name, file name, provincial node, network element type, number of entries in the file and the time when the link occurs. The link name is the parsing link, mapped to Process, and the time when the link occurs is the time when the file is currently parsed.

[0022] Furthermore, the performance indicator data described in S05 includes: device ID, performance indicator time, network element type, indicator code, indicator object, indicator value, storage file creation time, unique identifier and province node. The performance indicator time is the generation time of the indicator in the performance file, the indicator object is DNN, and the unique identifier is a unique identifier contained in a storage file generated after each performance file is collected and processed.

[0023] Furthermore, the information of the warehousing link described in S06 includes: link name, warehousing file name, provincial node to which it belongs, network element type to which it belongs, number of entries contained in the file, and time when the link occurs. The link name is the warehousing link, which is mapped to ES, and the time when the link occurs is the time when the file is currently stored.

[0024] In a second aspect of the present invention, a device for collecting and monitoring DNN performance indicators is provided. The device includes:

[0025] Indicator entry module: used by users to enter the performance indicators of the DNN dimensions that need to be collected into the database table through the indicator entry page;

[0026] Acquisition module: used to obtain the list of DNN indicators that need to be collected from the database table;

[0027] Reporting module: used to read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database;

[0028] Parsing module: used to parse 5GC performance files and obtain DNN indicator data;

[0029] Writing module: used to write the performance indicator data of the DNN dimension obtained by the parsing module into the storage file;

[0030] Database module: used to write incoming files into the ES database and report the incoming information into MySQL;

[0031] Monitoring module: used to periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification will be sent.

[0032] Furthermore, the analysis module further includes:

[0033] Non-computational indicator module: used to read performance file data one by one for non-computational indicators. If the original indicator code in the data is not in the DNN indicator list to be collected, it is filtered; otherwise, it is retained and the corresponding DNN indicator data is confirmed based on the indicator object in the data.

[0034] Calculation indicator module: used for calculating indicators, converting the original indicators contained therein into corresponding indicator values according to the corresponding indicator calculation caliber for calculation, so as to obtain the corresponding values;

[0035] Performance file reporting module: used to report the relevant performance file information of the parsing process to the ES database. The performance file information includes: link name, file name, provincial node, network element type, number of entries contained in the file and the time when the link occurs. The link name is the parsing link, mapped to Process, and the time when the link occurs is the time when the file is currently parsed.

[0036] In a third aspect of the present invention, an electronic device is provided, comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the program, the method according to the first aspect of the present invention is implemented.

[0037] In a fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method according to the first aspect of the present invention is implemented.

[0038] The meanings of the above mentioned English abbreviations:

[0039] DNN: DataNetworkName, data network name

[0040] 5GC: 5G Core Network

[0041] BP: Break Point

[0042] Redis: Remote Directory Server, an open source, network-friendly, memory-based, and persistent log-based, key-value database written in ANSI C.

[0043] MySQL: a relational database management system

[0044] ES: Elasticsearch, a distributed, highly scalable, and real-time search and data analysis engine

[0045] Ceph: Ceph distributed file system, which adds replication and fault tolerance while maintaining POSIX compatibility

[0046] The present invention collects original performance files based on the performance indicators of DNN dimensions entered on the page, obtains performance indicator data of different indicator objects, namely DNN; adopts multiple databases to adapt to different usage scenarios; uses MySQL to enter and store performance indicators, uses Redis for efficient processing in the collection and analysis process, and stores massive performance indicator data in ES for real-time retrieval; the combination of the three brings a more efficient and timely data query experience; adds monitoring and alarm functions for each link in the entire file life cycle (including Ceph generation, collection, analysis, and warehousing), and can automatically send alarm notifications to relevant implementation and maintenance personnel in a timely manner when abnormal situations such as data delays and missing occur, making the handling of abnormal situations particularly efficient.

[0047] It should be understood that the contents described in the summary of the invention are not intended to limit the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The above and other features, advantages and aspects of the embodiments of the present invention will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings, in which:

[0049] Figure 1 A flow chart of a method for collecting and monitoring DNN performance indicators according to an embodiment of the present invention is shown;

[0050] Figure 2 A schematic diagram of an indicator entry page according to an embodiment of the present invention is shown;

[0051] Figure 3It shows a schematic diagram of indicator acquisition content according to an embodiment of the present invention;

[0052] Figure 4 A schematic diagram of the performance file content according to an embodiment of the present invention is shown;

[0053] Figure 5 A block diagram of a device for collecting and monitoring DNN performance indicators according to an embodiment of the present invention is shown;

[0054] Figure 6 A schematic diagram of a device based on DNN performance indicator collection and monitoring according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0055] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0056] According to the implementation manner of the present invention, a method, device and equipment based on DNN performance indicator collection and monitoring are proposed. Based on the performance indicators of the DNN dimension entered on the page, the original performance file is collected to obtain the performance indicator data of different indicator objects, namely DNN; a variety of databases are used to adapt to different usage scenarios; MySQL is used for the entry and storage of performance indicators, Redis is used for efficient processing in the collection and analysis process, and massive performance indicator data is stored in ES for real-time retrieval; the combination of the three brings a more efficient and timely data query experience; a monitoring and alarm function is added to each link in the entire file life cycle (including Ceph generation, collection, analysis, and warehousing), and when abnormal situations such as data delays and missing occur, an alarm notification can be automatically sent in time to the relevant implementation and operation and maintenance personnel for processing, making the handling of abnormal situations particularly efficient.

[0057] The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments of the present invention.

[0058] Figure 1 1 is a flow chart of a method for collecting and monitoring DNN performance indicators according to an embodiment of the present invention. The method includes:

[0059] S01: The user enters the performance indicators of the DNN dimensions to be collected into the database table through the indicator entry page;

[0060] S02: Get the list of DNN indicators that need to be collected from the database table;

[0061] S03: Read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database;

[0062] S04: Parse the 5GC performance file and obtain DNN indicator data;

[0063] S05: Write the performance indicator data of the DNN dimension obtained in S04 into the storage file;

[0064] S06: Write the incoming file into the ES database and report the incoming information into MySQL;

[0065] S07: Periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification is sent.

[0066] It should be noted that although the operations of the method of the present invention are described in a specific order in the above embodiments and drawings, this does not require or imply that these operations must be performed in this specific order, or that all illustrated operations must be performed to achieve the desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0067] In order to more clearly explain the above-mentioned method based on DNN performance indicator collection and monitoring, a specific embodiment is used for illustration below. However, it should be noted that this embodiment is only for better illustrating the present invention and does not constitute an improper limitation to the present invention.

[0068] The following example further illustrates the method of collecting and monitoring DNN performance indicators in more detail:

[0069] DNN indicator enters a calculation indicator. The indicator calculation caliber should fill in the corresponding indicator calculation formula: 5gcSmfDnnMaxIpv4Num+5gcSmfDnnMaxIpv6Num. Whether it is the original indicator should be checked. Figure 2 As shown;

[0070] Get the list of DNN indicators that need to be collected from the database table, such as Figure 3 As shown;

[0071] Read the time breakpoint recorded in Redis. For example, 20221014144500 indicates that the last file collection time was 2022-10-14 14:45:00. Only files after this time point can be collected for analysis. Read the file list in the Ceph directory. The directory format is fixed at / ceph2 / RDSP / 5GC / PM / Province Pinyin / Manufacturer Code / Network Element Type / Date. Based on the indicator scope on the indicator entry page, which is ZX SMF network element, read the performance files in the / ceph2 / RDSP / 5GC / PM / AH / ZX / SMF / 20221014 directory and collect and store files after the time breakpoint 2022-10-14 14:45:00. For example, in this directory, there's a file called UCCP_SMF_PM_5_AH-HF-DZL-RP0001B-A-5GC-ZE-SMF24-B_17.52.25.57_20221014145225_20221014144500_20221014145000_04916.csv. The time in the file name is 20221014145000, which is after the time breakpoint. This indicates that the file can be collected and stored this time. Therefore, the file's creation time in the Ceph directory, the link name (mapped to Ceph), the file name, the province node (AH, mapped to the corresponding province code NOD00b), the network element type (SMF), and the number of entries in the file (use the `wc -l filename` command to obtain the file entry count) can be reported to the MySQL database. The file name's time is also updated in Redis, and this time is used as the benchmark for file collection and processing next time. Then report the collected file information to the MySQL database, including the collection time (i.e. current time), link name (mapped to Collect), file name, province node (AH, mapped to the corresponding province code NOD00b), network element type (SMF), and the number of entries contained in the file (same as Ceph link).

[0072] Parse the performance files collected above, the file contents are as follows Figure 4As shown in the figure, obtaining DNN indicator data: This indicator is a computational indicator, that is, it is calculated from the indicators 5gcSmfDnnMaxIpv4Num and 5gcSmfDnnMaxIpv6Num. Therefore, the values of the non-computational indicators 5gcSmfDnnMaxIpv4Num and 5gcSmfDnnMaxIpv6Num must be calculated first. The corresponding indicator calculation calibers, that is, the item_equal fields in the library, are 04916.C04916011 and 04916.C04916013, respectively. In other words, the original indicator codes are 04916.C04916011 and 04916.C04916013. We parse the file content line by line and extract the data with counterIds 04916.C04916011 and 04916.C04916013. We see that the corresponding indicator object field, measObjLdn, has the following format: POOBJID = 1; POOBJVALUE = 1, MODULE = 0, indicating that the corresponding DNN is 1. The indicator value field, measResult, is used to find the corresponding value 4010. This allows us to obtain the data values of the indicators 5gcSmfDnnMaxIpv4Num and 5gcSmfDnnMaxIpv6Num under different DNNs at 2022-10-14 14:45:00. Calculate the composite metric 5gcSmfDnnMaxIpNum by adding the data for 5gcSmfDnnMaxIpv4Num and 5gcSmfDnnMaxIpv6Num for the same DNN, based on the metric calculation criteria, to obtain the metric value for 5gcSmfDnnMaxIpNum for that DNN. Report this parsing step information to the MySQL database, including the parsing time (i.e., current time), step name (mapped to Process), file name, province node (AH, mapped to the corresponding province code NOD00b), network element type (SMF), and the number of entries in the file (same as the Ceph step).

[0073] The obtained DNN dimension performance indicator data is written to the storage file, including RESID (device ID, according to the device name AH-HF-DZL-RP0001B-A-5GC-ZE-SMF24-B in the file name, the corresponding device ID is 911020000000000385634442), RECORD_TIME (performance indicator time, that is, the beginTime of each record in the file), DEVICE_SET (network element type, according to the indicator belonging to the network element range on the page: ZX SMF network element, mapped to DEV_5G_S_ZX_COM), ITEM_CODE (indicator code), ITEM_PARA (indicator object, that is, DNN), VALUE (indicator value), CREATE_TIME (storage file creation time), TOKENID (unique identifier), NODECODE (province node NOD00b) information, the format is as follows:

[0074] 911020000000000385634442_20221014145000_43oIxlJ3rBduDHbEtz8cLCMj.csv

[0075] RESID@@RECORD_TIME@@DEVICE_SET@@ITEM_CODE@@ITEM_OBJECT@@ITEM_PARA@@VALUE@@CREATE_TIME@@TOKENID@@NODECODE

[0076] 911020000000000385634442@@2022-10-14 14:45:00@@DEV_5G_S_ZX_COM@@5gcSmfDnnMaxIpv4Num@@DNN@1@@4010@@2022-10-1414:55:03@@43oIxlJ3rBduDHbEtz8cLCMj@@NOD00b

[0077] 911020000000000385634442@@2022-10-14 14:45:00@@DEV_5G_S_ZX_COM@@5gcSmfDnnMaxIpv6Num@@DNN@1@@35@@2022-10-1414:55:03@@43oIxlJ3rBduDHbEtz8cLCMj@@NOD00b

[0078] 911020000000000385634442@@2022-10-14 14:45:00@@DEV_5G_S_ZX_COM@@5gcSmfDnnMaxIpv6Num@@DNN@1@@4045@@2022-10-1414:55:03@@43oIxlJ3rBduDHbEtz8cLCMj@@NOD00b

[0079] The incoming file is stored in ES and the relevant information of the link is stored in the MySQL database, including the entry time (i.e. the current time), link name (mapped to ES), file name, province node (AH, mapped to the corresponding province code NOD00b), network element type (SMF), and the number of entries in the file (same as Ceph link).

[0080] Under normal circumstances, the relevant information of Ceph, Collect, Process, and ES in each of the above links will be entered into the MySQL data monitoring table. Therefore, the data status of each province and each network element type in each link can be periodically queried in the MySQL data monitoring table. Generally, the number of files and data volume of each network element type in each province during this period in Ceph push link, collection link, analysis link, and storage link are counted every half hour. If the number of files or data volume in a certain link is lower than the threshold (usually one file every five minutes, half an hour is 6 files, and the number of SMF network elements in each province is at least 1, that is, the threshold is 30), an alarm SMS will be sent to notify the operation and maintenance colleagues that there is a problem in the SMF network type collection link in Anhui Province, helping the operation and maintenance colleagues to quickly locate the problem and intervene manually in time to ensure the stability of the device.

[0081] Based on the same inventive concept, the present invention also proposes a device based on DNN performance indicator collection and monitoring. The implementation of the device can refer to the implementation of the above method, and the repeated parts will not be repeated. Figure 5 As shown, the device 100 includes:

[0082] Index entry module 101: used for users to enter the performance indicators of the DNN dimensions that need to be collected into the database table through the indicator entry page;

[0083] Acquisition module 102: used to obtain the DNN indicator list that needs to be collected from the database table;

[0084] Reporting module 103: used to read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database;

[0085] Parsing module 104: used to parse 5GC performance files and obtain DNN indicator data;

[0086] Writing module 105: used to write the performance indicator data of the DNN dimension obtained based on the parsing module into the storage file;

[0087] Database module 106: used to write the incoming files into the ES database and report the information of the incoming links into MySQL;

[0088] Monitoring module 107: used to periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification will be sent.

[0089] The analysis module 104 further includes:

[0090] Non-computational indicator module 1041: for reading performance file data for non-computational indicators one by one. If the original indicator code in the data is not in the DNN indicator list to be collected, it is filtered; otherwise, it is retained and the corresponding DNN indicator data is confirmed based on the indicator object in the data.

[0091] The calculation indicator module 1042 is used to convert the original indicators contained therein into corresponding indicator values according to the corresponding indicator calculation caliber for calculation, thereby obtaining corresponding values;

[0092] Performance file reporting module 1043: used to report relevant performance file information of the parsing process to the ES database. The performance file information includes: link name, file name, provincial node, network element type, number of entries contained in the file and the time when the link occurs. The link name is the parsing link, mapped to Process, and the time when the link occurs is the time when the file is currently parsed.

[0093] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0094] like Figure 6 As shown, the device includes a central processing unit (CPU), which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) or loaded from a storage unit into a random access memory (RAM). In the RAM, various programs and data required for the operation of the device can also be stored. The CPU, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0095] Many components in a device are connected to the I / O interface, including: input units, such as a keyboard and mouse; output units, such as various types of displays and speakers; storage units, such as magnetic disks and optical disks; and communication units, such as network cards, modems, and wireless communication transceivers. The communication unit allows the device to exchange information / data with other devices via computer networks such as the Internet and / or various telecommunication networks.

[0096] The processing unit performs the various methods and processes described above, such as methods S01 to S07. For example, in some embodiments, methods S01 to S07 can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit. In some embodiments, part or all of the computer program can be loaded and / or installed on the device via a ROM and / or a communication unit. When the computer program is loaded into the RAM and executed by the CPU, one or more steps of methods S01 to S07 described above can be performed. Alternatively, in other embodiments, the CPU can be configured to execute methods S01 to S07 by any other appropriate means (for example, by means of firmware).

[0097] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), and the like.

[0098] The program code for implementing the method of the present invention can be written in any combination of one or more programming languages. Such program code can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0099] In the context of the present invention, machine-readable medium can be a tangible medium that can contain or store a program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0100] In addition, although adopting specific order to describe each operation, this should be understood as requiring such operation to be carried out in the specific order shown or in sequential order, or requiring all illustrated operations to be carried out to obtain desired result.Under certain environment, multitasking and parallel processing may be advantageous.Similarly, although comprising some specific implementation details in the above discussion, these should not be construed as limiting the scope of the present invention.Some features described in the context of independent embodiment can also be realized in single realization in combination.On the contrary, the various features described in the context of independent realization also can be realized in multiple realizations individually or in the mode of any suitable subcombination.

[0101] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A method for collecting and monitoring DNN performance indicators, characterized in that: The method includes: S01: The user enters the performance indicators of the DNN dimensions to be collected into the database table through the indicator entry page. The indicators include calculation indicators and non-computational indicators. When entering the calculation indicators, the indicator calculation caliber on the indicator entry page is filled in with the corresponding indicator calculation formula, and whether it is an original indicator is checked "No". When entering the non-computational indicators, the indicator calculation caliber on the indicator entry page is filled in with the original indicator code, and whether it is an original indicator is checked "Yes"; S02: Get the list of DNN indicators that need to be collected from the database table; S03: Read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database; S04: Parse the 5GC performance file and obtain DNN indicator data. The specific steps are as follows: S041: For non-computing indicators, read the performance file data one by one. If the original code of the indicator in the data is not in the DNN indicator list to be collected, filter it; otherwise, retain it and confirm the corresponding DNN indicator data based on the indicator object in the data; S042: For calculation indicators, convert the original indicators contained therein into corresponding indicator values according to the corresponding indicator calculation caliber for calculation, thereby obtaining the corresponding values; S043: Report the relevant performance file information of the parsing process to the ES database. The performance file information includes: link name, file name, province node, network element type, number of entries in the file, and the time when the link occurs. The link name is the parsing link, mapped to Process, and the time when the link occurs is the time when the file is currently parsed. S05: Write the performance indicator data of the DNN dimension obtained in S04 into the storage file; S06: Write the incoming file into the ES database and report the incoming information into MySQL; S07: Periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification is sent.

2. The method for collecting and monitoring DNN performance indicators according to claim 1, characterized in that: The performance file after collecting and storing BP as described in S03 is reported and the relevant information of the file is pushed to Ceph into Mysql. The relevant information includes: link name, file name, provincial node to which it belongs, network element type to which it belongs, number of entries contained in the file and the sending time of the link. The link name is the file push to Ceph link, which is mapped to Ceph. The sending time of the link is the generation time of the file under Ceph.

3. The method for collecting and monitoring DNN performance indicators according to claim 1, characterized in that: The time in the saved file name in S03 is used as BP. If multiple files are collected at one time, the maximum time in the files collected this time is taken. The purpose of recording BP is to avoid repeated collection of performance files.

4. The method for collecting and monitoring DNN performance indicators according to claim 1, characterized in that: S03 reports the relevant performance file information to the Mysql database, wherein the relevant performance file information includes: the link name, file name, provincial node, network element type, number of entries contained in the file, and the time when the link occurs. The link name is the collection link, mapped to Collect, and the time when the link occurs is the time when the file is currently collected.

5. The method for collecting and monitoring DNN performance indicators according to claim 1, characterized in that: The performance indicator data described in S05 include: device ID, performance indicator time, network element type, indicator code, indicator object, indicator value, storage file creation time, unique identifier and province node. The performance indicator time is the generation time of the indicator in the performance file, the indicator object is DNN, and the unique identifier is a unique identifier contained in a storage file generated after each performance file is collected and processed.

6. The method for collecting and monitoring DNN performance indicators according to claim 1, characterized in that: The information of the warehousing link described in S06 includes: link name, warehousing file name, provincial node to which it belongs, network element type to which it belongs, number of entries contained in the file, and time when the link occurs. The link name is the warehousing link, which is mapped to ES, and the time when the link occurs is the time when the file is currently stored.

7. A device for collecting and monitoring DNN performance indicators, characterized in that: The device includes: Indicator entry module: used by users to enter the performance indicators of the DNN dimensions that need to be collected into the database table through the indicator entry page; Acquisition module: used to obtain the list of DNN indicators that need to be collected from the database table; Reporting module: used to read the BP recorded in Redis, obtain the 5GC performance file list in the Ceph directory, collect the performance files after the BP is stored, save the time in the file name as the BP and record it in Redis, and report the relevant performance file information to the MySQL database; Parsing module: used to parse 5GC performance files and obtain DNN indicator data; Writing module: used to write the performance indicator data of the DNN dimension obtained by the parsing module into the storage file; Database module: used to write incoming files into the ES database and report the incoming information into MySQL; Monitoring module: used to periodically query the data status of each province and each network element type in each link in the Mysql monitoring data table. If the number of files or data volume in a certain link is lower than the threshold, an alarm SMS notification will be sent.

8. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the processor executes the program, the method according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images