A method, apparatus, storage medium, and program product for determining community quality.

Abstract

This application provides a method, apparatus, storage medium, and program product for determining cell quality, relating to the field of communication technology, and solving the technical problem of potential errors in the determination of poor-quality cells in related technologies. The method includes: acquiring XDR data; generating a service evaluation factor library based on the XDR data, the service evaluation factor library including cell quality information of multiple cells, each cell quality information consisting of at least one service evaluation factor; and determining the cell service quality score of the multiple cells based on the service evaluation factor library.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a method, apparatus, storage medium and program product for determining cell quality. Background Technology

[0002] During the establishment of a voice call, poor-quality cells can be identified based on data from the signaling plane.

[0003] However, after the voice service bearer is established, the IP-based multimedia subsystem (IMS) no longer performs signaling plane updates. This results in no updates to cell information in the IMS domain media plane data. Therefore, in the event of cell handover at the terminal, the identification of poor-quality cells based on the IMS domain media plane data may be incorrect. Consequently, a reliable method for determining cell quality is lacking. Summary of the Invention

[0004] This application provides a method, apparatus, storage medium, and program product for determining cell quality, which solves the technical problem of possible errors in the determination of poor-quality cells in related technologies.

[0005] In a first aspect, this application provides a method for determining cell quality, the method comprising: acquiring XDR data; generating a service evaluation factor library based on the XDR data, the service evaluation factor library including cell quality information of multiple cells, wherein a cell quality information consists of at least one service evaluation factor; and determining the cell service quality score of the multiple cells based on the service evaluation factor library.

[0006] In one possible implementation, generating a service evaluation factor library based on the XDR data includes: for each terminal, determining voice service quality information from the terminal based on the XDR data to obtain multiple cell quality information; determining cell quality information corresponding to each cell based on the multiple cell quality information; and generating the service evaluation factor library based on the cell quality information corresponding to each cell.

[0007] In one possible implementation, the method further includes: acquiring new XDR data; for each terminal, extracting new cell quality information corresponding to the terminal based on the new XDR data; deleting a third number of target cell quality information from the cell quality information database corresponding to the terminal, and adding the new cell quality information to the cell quality information database corresponding to the terminal; the third number is the number of new cell quality information corresponding to the terminal; the target cell quality information is the cell quality information stored in the cell quality information database at the earliest time.

[0008] In one possible implementation, determining the cell service quality score of the multiple cells based on the service evaluation factor library includes: for each cell corresponding to the service evaluation factor library, obtaining the cell quality information of the cell within a preset time period from the service evaluation factor library; determining the target percentage of the cell based on the cell quality information of the cell within the preset time period; the target percentage is the proportion of the voice quality corresponding to the cell quality information that does not meet the expected voice quality; and determining the cell service quality score of the cell based on the ratio range in which the target percentage falls.

[0009] In one possible implementation, determining the cell service quality score of the multiple cells based on the service evaluation factor library includes: when the number of cell quality information in the service evaluation factor library reaches a target number, determining the cell service quality score of the multiple cells based on the service evaluation factor library and deleting the cell quality information in the service evaluation factor library.

[0010] In one possible implementation, the cell quality information includes at least one of the following: packet loss count, single-pass identifier, intermittent identifier, and average opinion score; the cell includes at least one of the following: a session cell, and a cell corresponding to a network slice.

[0011] Secondly, this application provides a cell quality determination apparatus, comprising: an acquisition module, a generation module, and a determination module; the acquisition module is used to acquire XDR data; the generation module is used to generate a service evaluation factor library based on the XDR data, the service evaluation factor library including cell quality information of multiple cells, and a cell quality information is composed of at least one service evaluation factor; the determination module is used to determine the cell service quality score of the multiple cells based on the service evaluation factor library.

[0012] In one possible implementation, the determining module is further configured to, for each terminal, determine the voice service quality information from the terminal based on the XDR data to obtain multiple cell quality information; the determining module is further configured to, based on the multiple cell quality information, determine the cell quality information corresponding to each cell; and the generating module is specifically configured to, based on the cell quality information corresponding to each cell, generate the service evaluation factor library.

[0013] In one possible implementation, the device further includes a processing module; the acquisition module is further configured to acquire new XDR data; the processing module is configured to extract new cell quality information corresponding to each terminal based on the new XDR data; the processing module is further configured to delete a third number of target cell quality information from the cell quality information database corresponding to the terminal, and add the new cell quality information to the cell quality information database corresponding to the terminal; the third number is the number of new cell quality information corresponding to the terminal; the target cell quality information is the cell quality information stored in the cell quality information database at the earliest time.

[0014] In one possible implementation, the acquisition module is further configured to acquire cell quality information of each cell within a preset time period from the service evaluation factor library for each cell corresponding to the service evaluation factor library; the determination module is specifically configured to determine the target proportion of the cell based on the cell quality information of the cell within the preset time period; the target proportion is the proportion of the voice quality corresponding to the cell quality information that does not meet the expected voice quality; and the service quality score of the cell is determined based on the ratio range in which the target proportion is located.

[0015] In one possible implementation, the determining module is specifically used to determine the cell service quality score of the multiple cells and delete the cell quality information in the service evaluation factor library when the number of cell quality information in the service evaluation factor library reaches the target number.

[0016] In one possible implementation, the cell quality information includes at least one of the following: packet loss count, single-pass identifier, intermittent identifier, and average opinion score; the cell includes at least one of the following: a session cell, and a cell corresponding to a network slice.

[0017] Thirdly, this application provides a cell quality determination apparatus, comprising: a processor and a memory configured to store processor-executable instructions; wherein the processor is configured to execute the instructions to implement any of the optional cell quality determination methods in the first aspect described above.

[0018] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed by a cell quality determination device, enable the cell quality determination device to perform any of the optional cell quality determination methods described in the first aspect.

[0019] Fifthly, this application provides a computer program product, which includes computer technology program instructions. When the computer program instructions are executed by a processor, they implement any of the optional cell quality determination methods described in the first aspect above.

[0020] The cell quality determination method, apparatus, storage medium, and program product provided in this application include: acquiring XDR data; generating a service evaluation factor library based on the XDR data, the service evaluation factor library including cell quality information of multiple cells, each cell quality information consisting of at least one service evaluation factor; and determining the cell service quality score of the multiple cells based on the service evaluation factor library. In this application, since the XDR data includes cell quality information of multiple cells, and there is a correspondence between the cell quality information and the cells, the voice service quality of the cell can be accurately evaluated using this cell quality information. Thus, by acquiring XDR data, generating a service evaluation factor library based on the XDR data, and determining the cell service quality score of multiple cells based on the service evaluation factor library, the voice service quality evaluation of the cell can be reliably and accurately completed. Compared to the prior art, where the determined cell quality information may be erroneous because the IMS domain media plane data does not update cell handover information, the cell quality information directly corresponding to the cell determined by XDR data can more accurately determine cell quality, improving the accuracy and reliability of cell quality evaluation. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below.

[0022] Figure 1 A schematic diagram of the network architecture of a cell quality determination system provided in this application embodiment;

[0023] Figure 2 This is a schematic diagram of the structure of a cell quality determination device provided in an embodiment of this application;

[0024] Figure 3 A flowchart illustrating a method for determining cell quality provided in an embodiment of this application;

[0025] Figure 4 A flowchart illustrating another method for determining cell quality provided in an embodiment of this application;

[0026] Figure 5 A flowchart illustrating another method for determining cell quality provided in an embodiment of this application;

[0027] Figure 6 A flowchart illustrating another method for determining cell quality provided in an embodiment of this application;

[0028] Figure 7 This is a schematic diagram of another cell quality determination device provided in an embodiment of this application;

[0029] Figure 8 This is a schematic diagram of another cell quality determination device provided in an embodiment of this application. Detailed Implementation

[0030] The cell quality determination method, apparatus, storage medium, and program product provided in the embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0031] The terms "first" and "second," etc., in the specification and drawings of this application are used to distinguish different objects, rather than to describe a specific order of objects. For example, "first HTTP request message" and "second HTTP request message," etc., are used to distinguish different HTTP request messages, rather than to describe a specific order of HTTP request messages.

[0032] Furthermore, the terms “comprising” and “having”, and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to such processes, methods, products, or apparatus.

[0033] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0034] The term "and / or" as used in this application includes using either one of two methods or using both methods simultaneously.

[0035] In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0036] The following explains some concepts involved in the cell quality determination method, apparatus, storage medium, and program product provided in the embodiments of this application.

[0037] During the establishment of a voice call, poor-quality cells can be identified based on data from the signaling plane.

[0038] However, after the voice service bearer is established, the IP-based multimedia subsystem (IMS) no longer performs signaling plane updates. At this time, the terminal may experience cell handover, and the poor-quality cells identified based on the IMS domain media plane data may be incorrectly identified. Therefore, a reliable method for determining cell quality is lacking.

[0039] Based on this, embodiments of this application provide a cell quality determination method, apparatus, storage medium, and program product. Since XDR data includes cell quality information for multiple cells, and there is a correspondence between this cell quality information and the cells, the voice service quality of the cell can be accurately evaluated using this cell quality information. Thus, by acquiring XDR data, generating a service evaluation factor library based on the XDR data, and determining the cell service quality scores for multiple cells based on the service evaluation factor library, the voice service quality evaluation of the cell can be reliably and accurately completed. Compared to existing technologies, where IMS domain media plane data does not update cell handover information during a call, potentially leading to errors in the determined cell quality information, the cell quality information determined through XDR data, which directly corresponds to the cell, can more accurately determine cell quality, improving the accuracy and reliability of cell quality evaluation.

[0040] The cell quality determination method, apparatus, storage medium, and program product provided in this application embodiment can be applied to a cell quality determination system, such as... Figure 1 As shown, the cell quality determination system includes a cell quality determination device 101 and a call detail record (CDR) storage system 102. Typically, in practical applications, the connections between these devices can be wireless. To facilitate a clear and intuitive representation of the connection relationships between the devices, Figure 1 Solid lines are used to represent the meaning.

[0041] The cell quality determination device 101 is used to acquire XDR data; or to generate a service evaluation factor library based on the XDR data; or to determine the cell service quality score of the multiple cells based on the service evaluation factor library.

[0042] The call detail record (CDR) storage system 102 is used to store XDR data; or to provide a shared data subscription service to the cell quality determination device 101; or to periodically transmit XDR data to the cell quality determination device 101.

[0043] In some embodiments, XDR data may be referred to as XDR call detail records.

[0044] In some embodiments, the call detail record (CDR) storage system 102 may be referred to as the XDR CDR storage system.

[0045] For example, the cell quality determination device that executes the cell quality determination method provided in the embodiments of this application can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery network (CDN) services, and big data and artificial intelligence platforms.

[0046] like Figure 2 The diagram shown is a structural schematic of a cell quality determination device provided in an embodiment of this application, including a data entry and data cleaning module 201, a real-time update module for user cell information 202, a voice service call quality evaluation factor library update module 203, a voice service call quality analysis module 204, a voice service call quality report module 205, and a system initial setup module 206.

[0047] The data entry and data cleaning module 201 is used to subscribe to data from the XDR call detail record (CDR) storage system to request the XDR CDR storage system to send XDR CDRs to the data entry and data cleaning module 201; or to periodically receive XDR CDRs periodically sent by the XDR CDR storage system; or to send one or more of the SIP interface CDRs, SIME interface CDRs, and N1 / N2 interface CDRs to the user cell information real-time update module 202 so that the user cell information real-time update module 202 can acquire or update user cell information in real time; or to send session interface CDRs and / or slice interface CDRs to the voice service call quality evaluation factor library update module 203 so that the voice service call quality evaluation factor library update module 203 can determine or update the evaluation factors in the voice service call quality evaluation factor library based on the session interface CDRs and / or slice interface CDRs; or to clean the XDR CDRs and enter the cleaned data into the database.

[0048] In some embodiments, the data entry and data cleaning module 201 can determine one or more of the following based on the XDR call detail records: SIP interface call detail records, SIME interface call detail records, N1 / N2 interface call detail records, sessions interface call detail records, and slices interface call detail records.

[0049] The real-time update module 202 for user cell information is used to receive one or more of the SIP interface call detail records, SIME interface call detail records, and N1 / N2 interface call detail records from the data entry and data cleaning module 201; or to receive the original database table sent by the system initial setup module 206; or to receive real-time cell information requests from the voice service call quality evaluation factor database update module 203; or to send real-time cell information responses to the voice service call quality evaluation factor database update module 203; or to obtain user cell information based on one or more of the SIP interface call detail records, SIME interface call detail records, and N1 / N2 interface call detail records.

[0050] The voice service call quality evaluation factor library update module 203 is used to send a real-time cell information request to the user cell information real-time update module 202; or to receive a real-time cell information response from the user cell information real-time update module 202; or to send data from the voice service call quality evaluation factor library to the voice service call quality analysis module 204; or to receive session interface call detail records and / or slice interface call detail records from the data entry and data cleaning module 201; or to determine data related to voice service call quality evaluation factors based on session interface call detail records and / or slice interface call detail records, so that the voice service call quality analysis module 204 can perform voice service call quality analysis; or to receive the original library tables from the system initial setup module 206.

[0051] The voice service call quality analysis module 204 is used to receive data from the voice service call quality evaluation factor library from the voice service call quality evaluation factor library update module 203; or to send the voice service call quality analysis results to the voice service call quality report module 205.

[0052] The voice service call quality report module 205 is used to receive the voice service call quality analysis results from the voice service call quality analysis module 204; or to generate a voice service call quality report based on the voice service call quality analysis results.

[0053] In some embodiments, the voice service call quality reporting module 205 may be referred to as the voice service call quality alarm module.

[0054] The system initial setup module 206 is used to establish the system initial database table, which is used to store data; or to establish the initial user cell information database, which is used to store user cell information; or to send the original database table to the user cell information real-time update module 202 or the voice service call quality evaluation factor database update module 203.

[0055] In some embodiments, the system initial setup module 206 can establish either the voice service call quality session evaluation factor library or the voice service call quality slice evaluation factor library in the voice service call quality evaluation factor library update module 203. The voice service call quality session evaluation factor library stores session-related voice service call quality evaluation factors, while the voice service call quality slice evaluation factor library stores slice-related voice service call quality evaluation factors.

[0056] In some embodiments, the voice service call quality session evaluation factor library corresponds to a session in the LTE network.

[0057] In some embodiments, the voice service call quality slice evaluation factor library corresponds to a session in a slice network (such as a 5G network).

[0058] In some embodiments, the system initial setup module 206 can establish an initial user cell information database in the user cell information real-time update module 202.

[0059] like Figure 3 As shown, the cell quality determination method provided in this application embodiment may include S301-S303.

[0060] S301, Obtain XDR data.

[0061] In some embodiments, signal data record (SDR) data and flow data record (FDR) data, together referred to as X data record (XDR).

[0062] In some embodiments, the cell quality determination device can acquire XDR call detail records (CDRs) in the 5G core (5GC) domain, the evolved packet core (EPC) domain, and the IP multimedia subsystem (IMS) domain for a specified area.

[0063] In some embodiments, the cell quality determination device may acquire XDR data based on a preset period (or a specified period).

[0064] In some embodiments, a designated region can be divided from at least one of the following dimensions: national, regional, provincial, municipal, or sub-regional.

[0065] In some embodiments, IMS domain XDR data may include at least one of the following: IMS domain session initiation protocol (SIP), session, and slice interface call detail records.

[0066] In some embodiments, EPC domain XDR data may include at least one of the following: S1 interface to the mobility management entity (S1-MME) call detail records (CDRs) of the EPC domain, N1 interface CDRs of the 5GC domain, and N2 interface CDRs.

[0067] In some embodiments, call detail records (CDRs) in the XDR data can be stored in the storage module of the cell quality determination system.

[0068] In some embodiments, if multiple call detail records (CDRs) have the same XDR ID field, one CDR can be retained while the others are deleted. This involves data cleaning of the XDR data (or the CDRs within the XDR data).

[0069] In some embodiments, XDR data stored in the cell quality determination system may be periodically deleted.

[0070] In some embodiments, the database is deleted every hour (or a database deletion operation is performed), and the deleted data is the call detail records saved three hours ago.

[0071] For example, call detail records (CDRs) saved before 7:00 AM on the same day are deleted at 10:00 AM, and call detail records saved before 8:00 AM on the same day are deleted at 11:00 AM.

[0072] S302. Generate a business evaluation factor library based on XDR data.

[0073] The business evaluation factor library includes cell quality information from multiple cells, and each cell quality information consists of at least one business evaluation factor.

[0074] In some embodiments, the service evaluation factor library includes a voice service call quality session evaluation factor library and / or a voice service call quality slice evaluation factor library.

[0075] In some embodiments, establishing or generating a voice service call quality session evaluation factor library based on XDR data can be achieved in the following way: When the data storage module receives Sessions call detail records, it extracts at least one of the following from the Sessions call detail records: XDR identifier (XDR ID), mobile station international ISDN number (MSISDN), session identifier (Session ID), procedure_start_time, expected uplink packet count (RTP_calling_packet_count), RTP uplink packet loss (RTP_calling_packet_loss), expected downlink packet count (RTP_called_packet_count), RTP downlink packet loss (RTP_called_packet_loss), single_pass, interrupt_flag, and mean opinion score of the uplink of the real-time transport control protocol (RTCP). score, MOS value (RTCP_CALLINGAVE_MOS), RTCP downlink average MOS value (RTCP_CALLEDGAVE_MOS).

[0076] In some embodiments, a new record is created based on at least one of the contents of the Sessions call detail records (CDRs) and stored in the voice service call quality evaluation session factor database. Then, the "User Cell Information Real-time Update Module" is accessed, and the tracking area code (TAC) and E-UTRAN cell identifier (ECI) closest to the procedure_start_time of this user's record are selected from the user cell information database and filled into the corresponding TAC and ECI positions of the new record. If the "User Cell Information Real-time Update Module" does not have the user information, the source tracking area code (SOURCE_TAC) and source cell identifier (SOURCE_ECI) of the Sessions CDRs are filled into the TAC and ECI positions of this new record.

[0077] S303. Based on the business evaluation factor library, determine the business quality score of multiple communities.

[0078] It should be understood that since XDR data includes cell quality information from multiple cells, and there is a correspondence between this cell quality information and the cells, the voice service quality of a cell can be accurately evaluated using this cell quality information. Thus, by acquiring XDR data, generating a service evaluation factor library based on the XDR data, and determining the cell service quality scores for multiple cells based on this service evaluation factor library, the voice service quality evaluation of a cell can be reliably and accurately completed.

[0079] It should be understood that, compared to existing technologies, the cell quality information determined by IMS domain media plane data may be erroneous because it does not update cell handover information. Cell quality information directly corresponding to a cell, determined by XDR data, can more accurately determine cell quality, thus improving the accuracy and reliability of cell quality evaluation.

[0080] In some embodiments, cell quality information directly corresponding to a cell, determined by XDR data from the 5GC domain, EPC domain, and IMS domain signaling planes, can more accurately determine cell quality, thereby improving the accuracy and reliability of cell quality evaluation.

[0081] In some embodiments, combined with Figure 3 The illustrated embodiments, such as Figure 4 As shown, S302 above generates a business evaluation factor library based on XDR data, including S401-S403:

[0082] S401. For each terminal, based on XDR data, determine the voice service quality information from the terminal to obtain multiple cell quality information.

[0083] In some embodiments, the quality information of the voice service corresponding to each terminal can be determined based on XDR data, and the quality information of the cell where the voice service is located can be obtained through the quality information of the voice service.

[0084] S402. Based on the quality information of multiple cells, determine the cell quality information corresponding to each cell.

[0085] In some embodiments, the cell quality information can be statistically summarized to obtain the cell quality information for each cell.

[0086] For example, a cell quality information can be the number of times a voice call service is interrupted in a cell; by using multiple cell quality information, the number of voice call interruptions in a cell can be determined, and the cell quality information of a cell in the dimension of voice call interruption can be determined based on the number of voice call interruptions in a cell.

[0087] S403. Generate a service evaluation factor library based on the cell quality information corresponding to each cell.

[0088] In some embodiments, the cell quality information of each cell can be aggregated in the business evaluation factor library.

[0089] It should be understood that by using XDR data to determine the voice service quality information from the terminal and obtaining multiple cell quality information, the cell quality information at the cell level can be accurately determined from the voice service quality information corresponding to the terminal.

[0090] It should be understood that by determining the corresponding cell quality information for each cell based on the quality information of multiple cells, the cell quality information of the cells can be reliably summarized.

[0091] It should be understood that generating a business evaluation factor library based on the community quality information corresponding to each community can summarize the community quality information of each community in the form of a business evaluation factor library, which can improve the efficiency of subsequent community quality evaluation or determination.

[0092] In some embodiments, combined with Figure 4 The illustrated embodiments, such as Figure 5 As shown, the above method also includes S501-S503:

[0093] S501, Obtain new XDR data.

[0094] In some embodiments, new XDR data can be actively acquired after a preset time period.

[0095] In some embodiments, new XDR data corresponding to a new voice service may be received when a new voice service is generated.

[0096] S502. For each terminal, extract the new cell quality information corresponding to the terminal based on the new XDR data.

[0097] In some embodiments, new cell quality information corresponding to a terminal can be extracted from new XDR data based on the information type of cell quality information or the identifier of the terminal.

[0098] S503. Delete the third number of target cell quality information from the cell quality information database corresponding to the terminal, and add the new cell quality information to the cell quality information database corresponding to the terminal.

[0099] The third quantity is the number of new cell quality information corresponding to the terminal; the target cell quality information is the cell quality information stored in the cell quality information database at the earliest time.

[0100] It should be understood that by deleting the earliest-timed community quality information and adding new community quality information to the community quality information database, the validity of the information in the database can be guaranteed, and the amount of information in the database can be maintained at the desired level, reducing the difficulty of maintaining the community quality information database. Furthermore, maintaining the desired amount of community quality information that needs to be processed can improve the efficiency of community quality evaluation.

[0101] For example, a database table for storing user cell information can be established, as shown in Table 1 below. A terminal (or user) can be configured to store a maximum of 20 cell information entries. When storing the 21st cell information entry, the earliest cell information entry is deleted, and the newly added cell information entry and its time are entered. This process is repeated to ensure the updating of cell information.

[0102] Table 1

[0103]

[0104]

[0105] In some embodiments, combined with Figure 3 The illustrated embodiments, such as Figure 6 As shown, S303 above, based on the service evaluation factor library, determines the service quality scores of multiple cells, including S601-S603:

[0106] S601. For each cell corresponding to the business evaluation factor library, obtain the cell quality information of the cell within a preset time period from the business evaluation factor library.

[0107] In some embodiments, cell quality information within a preset time period is obtained based on the entry time of the cell quality information or the occurrence time of the service corresponding to the cell quality information.

[0108] S602. Based on the cell quality information of the cell within a preset time period, determine the target percentage of the cell.

[0109] The target percentage is the proportion of voice quality corresponding to the community quality information that does not meet the expected voice quality.

[0110] In some embodiments, the target percentage of a cell can be determined based on the cell quality information of the cell within a preset time period and the judgment conditions corresponding to the desired voice quality.

[0111] S603. Based on the ratio range of the target percentage, determine the community service quality score of the community.

[0112] It should be understood that the range of ratios in which the target percentage lies indicates the degree to which the voice quality of the corresponding cell does not meet the expected voice quality. Therefore, the cell service quality score of a cell can be accurately and reliably determined based on the range of ratios in which the target percentage lies.

[0113] In some embodiments, the RTP packet loss rate can be selected. RTP丢包 Single-pass rate single_pass Intermittent Rate interrupt and RTP average MOS value Ave RTPMOS Used as an evaluation factor for community service quality scoring; or as a primary evaluation indicator for voice service call quality analysis, to establish a voice service call quality analysis model.

[0114] In some embodiments, the RTP packet loss rate is defined as the ratio of the total number of RTP uplink and downlink packets lost during a voice call over a certain period of time to the expected total number of packets lost, satisfying the formula shown in Formula 1:

[0115]

[0116] In some embodiments, the one-way call percentage is defined as: the ratio of the number of one-way calls to the total number of calls during a certain period of time, satisfying Formula 2:

[0117]

[0118] In some embodiments, the intermittent call percentage is defined as the ratio of the number of intermittent calls to the total number of calls during a certain period, satisfying Formula 3:

[0119]

[0120] In some embodiments, the RTP average MOS value is defined as the average of the RTCP uplink average MOS value and the RTCP downlink average MOS value during a voice call over a certain period of time, satisfying Formula 4:

[0121]

[0122] In some embodiments, the RTP packet loss rate is [Rate]. RTP丢包 The scoring criteria are shown in Table 2:

[0123] Table 2

[0124]

[0125] In some embodiments, the single-pass rate single_pass The scoring criteria are shown in Table 3:

[0126] Table 3

[0127]

[0128] In some embodiments, the intermittent percentage rate interrupt The scoring criteria are shown in Table 4:

[0129] Table 4

[0130]

[0131] In some embodiments, the RTP average MOS value Ave RTPMOS The scoring criteria are shown in Table 5:

[0132] Table 5

[0133]

[0134] In some embodiments, based on the impact of the above-mentioned key evaluation indicators for voice service call quality analysis on user perception, the overall perceived score for voice service call quality analysis is designed as follows: Overall perceived score for voice service call quality analysis = 0.3 * RTP packet loss rate. RTP丢包 Score + 0.2 * Single-pass percentage Rate single_pass Score + 0.2 * Intermittent Rate interrupt Score +0.3 * RTP Average MOS Value Ave RTPMOS The score is calculated, and the perceived quality of the voice service call is determined based on the overall score of the voice service call quality analysis.

[0135] In some embodiments, the overall scoring criteria for voice service call quality analysis are shown in Table 6:

[0136] Table 6

[0137]

[0138] In some embodiments, an alarm module is included in this system to enable faster notification and response to poor call quality. Based on the model's calculation results, a call quality awareness alarm threshold can be set as needed and matched with a list of maintenance personnel. When a call quality alarm occurs, the system can automatically send SMS messages and emails to the maintenance personnel's mobile phones and email addresses, promptly reminding them to investigate the alarm and handle the fault.

[0139] In some embodiments, an alarm is issued based on the perceived results of voice call quality analysis, for example, when the perceived voice call quality is judged to be poor.

[0140] In some embodiments, an alarm is triggered when the perceived result of a specified indicator is less than a threshold, such as when the RTP packet loss rate score is less than a threshold or the RTP average MOS score is less than a threshold.

[0141] In some embodiments, multi-level service alarms can also be designed, supporting logical settings.

[0142] In some embodiments, S303 above, determining the cell service quality score of multiple cells based on the service evaluation factor library, can be achieved in the following way: when the number of cell quality information in the service evaluation factor library reaches the target number, the cell service quality score of multiple cells is determined based on the service evaluation factor library and the cell quality information in the service evaluation factor library is deleted.

[0143] It should be understood that once the number of cell quality information entries in the service evaluation factor library reaches the target number, it indicates that an effective cell quality evaluation can be completed based on this target number of entries. At this point, based on the service evaluation factor library, the service quality scores for multiple cells are determined, and the cell quality information in the service evaluation factor library is deleted. This ensures the effectiveness of the cell quality evaluation, and after the evaluation is completed, the cell quality information is deleted, leaving storage space for subsequent cell quality evaluations.

[0144] In some embodiments, cell quality information includes at least one of the following: packet loss count, single-pass identifier, intermittent identifier, and average opinion score.

[0145] In some embodiments, a cell includes at least one of the following: a session cell, a cell corresponding to a network slice.

[0146] For example, establishing a voice service call quality session evaluation factor library includes: establishing a storage table for voice service call quality session evaluation factors and a storage table for voice service call quality session evaluation factor statistical results, with the table headers shown in Tables 7 and 8 below.

[0147] Table 7

[0148]

[0149] Table 8

[0150]

[0151] Table 8 is a statistical summary of the three dimensions hidden in Table 7: XDR ID, MSISDN, and Session ID, categorized by 5-minute time periods and TAC and ECI dimensions. The RTP_calling_packet_count (expected uplink RTP packets), RTP_calling_packet_loss (RTP uplink packet loss), RTP_called_packet_count (expected downlink RTP packets), and RTP_called_packet_loss (RTP downlink packet loss) are summed to obtain the total number of expected uplink RTP packets (SUM_RTP_calling_packet_count), the total number of lost uplink RTP packets (SUM_RTP_calling_packet_loss), the total number of expected downlink RTP packets (SUM_RTP_called_packet_count), and the total number of lost downlink RTP packets (SUM_RTP_called_packet_loss). The number of times the single-pass flag ("1", "2", or "3") appeared in the session detail record (CDR) is obtained using single_pass (single-pass flag) and interrupt_flag (interruption flag). The values ​​for `COUNT_single_pass_2`, `COUNT_single_pass_3`, and `COUNT_interrupt_flag_1`, `COUNT_interrupt_flag_2`, and `COUNT_interrupt_flag_3` represent the number of interruptions ("1", "2", and "3" respectively). (`single_pass` and `interrupt_flag` have values ​​of 0, 1, 2, and 3. 0: No occurrence; 1: Occurred in uplink; 2: Occurred in downlink; 3: Occurred in both uplink and downlink.) The cumulative summation of `RTCP_CALLINGAVE_MOS` (RTCP uplink average MOS value) and `RTCP_CALLEDGAVE_MOS` (RTCP downlink average MOS value) yields the cumulative sum of the RTCP uplink average MOS value (`SUM_RTCP_CALLINGAVE_MOS`) and the cumulative summation of the RTCP downlink average MOS value (`SUM_RTCP_CALLEDGAVE_MOS`). Simultaneously, the total number of call detail records (`COUNT`) within 5 minutes is added.

[0152] In some embodiments, establishing a voice service call quality slice evaluation factor library includes: establishing a storage table for voice service call quality slice evaluation factors and a storage table for voice service call quality evaluation slice factor statistical results, with the table headers shown in Tables 9 and 10 below.

[0153] Table 9

[0154]

[0155] Table 10

[0156]

[0157] Table 10 summarizes the statistics of Table 9, which hides the three dimensions: XDR ID, MSISDN, and SliceID, and is categorized by 5-minute time intervals and TAC and ECI dimensions. The evaluation factors include: RTP_calling_packet_count (expected RTP uplink packet count), RTP_calling_packet_loss (RTP uplink packet loss), RTP_called_packet_count (expected RTP downlink packet count), and RTP_called_packet_loss (RTP downlink packet loss). These are cumulatively summarized to obtain the total expected RTP uplink packets (SUM_RTP_calling_packet_count), the total expected RTP uplink packets (SUM_RTP_calling_packet_loss), the total expected RTP downlink packets (SUM_RTP_called_packet_count), and the total expected RTP downlink packets (SUM_RTP_called_packet_loss). The slice call detail records (CDRs) are obtained using `single_pass` (single-pass flag) and `interrupt_flag` (interrupt flag). The CDRs show the number of times the single-pass flag is "1", "2", or "3" using `COUNT_single_pass_1`, `COUNT_single_pass_2`, and `COUNT_single_pass_3`, and the number of times the interrupt flag is "1", "2", or "3" using `COUNT_interrupt_flag_1`, `COUNT_interrupt_flag_2`, and `COUNT_interrupt_flag_3`. (`single_pass`, `interrupt_flag`, `interrupt_flag_3`) The `rrupt_flag` (interruption flag) has values ​​of 0, 1, 2, and 3. 0: No occurrence; 1: Occurred in uplink; 2: Occurred in downlink; 3: Occurred in both uplink and downlink. `RTCP_CALLINGAVE_MOS` (RTCP uplink average MOS value) and `RTCP_CALLEDGAVE_MOS` (RTCP downlink average MOS value) are cumulatively summed to obtain the cumulative sum of RTCP uplink average MOS values ​​(`SUM_RTCP_CALLINGAVE_MOS`) and RTCP downlink average MOS values ​​(`SUM_RTCP_CALLEDGAVE_MOS`). Simultaneously, a statistical value `COUNT` is added to the total number of sliced ​​call detail records within 5 minutes.

[0158] This application embodiment can divide the cell determination device and the like into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0159] When dividing each function into modules according to its corresponding function. Figure 7 This diagram illustrates another possible structural schematic of the cell quality determination device involved in the above embodiments, as shown below. Figure 7 As shown, the cell quality determination device may include: an acquisition module 701, a generation module 702, and a determination module 703.

[0160] The acquisition module 701 is used to acquire XDR data.

[0161] The generation module 702 is used to generate a service evaluation factor library based on the XDR data. The service evaluation factor library includes cell quality information of multiple cells, and a cell quality information consists of at least one service evaluation factor.

[0162] The determining module 703 is used to determine the cell service quality score of the multiple cells based on the service evaluation factor library.

[0163] In one possible implementation, the determining module 703 is further configured to, for each terminal, determine the voice service quality information from that terminal based on the XDR data, in order to obtain multiple cell quality information.

[0164] The determining module 703 is also used to determine the cell quality information corresponding to each cell based on the multiple cell quality information.

[0165] The generation module 702 is specifically used to generate the service evaluation factor library based on the cell quality information corresponding to each cell.

[0166] In one possible implementation, the device further includes a processing module 704.

[0167] The acquisition module 701 is also used to acquire new XDR data; the processing module 704 is used to extract new cell quality information corresponding to each terminal based on the new XDR data.

[0168] The processing module 704 is further configured to delete a third number of target cell quality information from the cell quality information database corresponding to the terminal, and add the new cell quality information to the cell quality information database corresponding to the terminal; the third number is the number of new cell quality information corresponding to the terminal; the target cell quality information is the cell quality information stored in the cell quality information database at the earliest time.

[0169] In one possible implementation, the acquisition module 701 is further configured to acquire cell quality information of each cell within a preset time period from the service evaluation factor library for each cell corresponding to the service evaluation factor library.

[0170] The determining module 703 is specifically used to determine the target percentage of the cell based on the cell quality information of the cell within a preset time period; the target percentage is the proportion of the voice quality corresponding to the cell quality information that does not meet the expected voice quality; and the cell service quality score of the cell is determined based on the ratio range in which the target percentage is located.

[0171] In one possible implementation, the determining module 703 is specifically used to determine the cell service quality score of the multiple cells and delete the cell quality information in the service evaluation factor library when the number of cell quality information in the service evaluation factor library reaches the target number.

[0172] In one possible implementation, the cell quality information includes at least one of the following: packet loss count, single-pass identifier, intermittent identifier, and average opinion score; the cell includes at least one of the following: a session cell, and a cell corresponding to a network slice.

[0173] When using integrated units, Figure 8 A schematic diagram of another possible structure of the cell quality determination device involved in the above embodiments is shown. For example... Figure 8 As shown, the cell quality determination device may include a processing module 801 and a communication module 802. The processing module 801 can be used to control and manage the operation of the cell quality determination device. The communication module 802 can be used to support communication between the cell quality determination device and other entities. Optionally, as... Figure 8 As shown, the cell quality determination device may also include a storage module 803 for storing the program code and data of the cell quality determination device.

[0174] The processing module 801 can be a processor or a controller. The communication module 802 can be a transceiver, transceiver circuit, or communication interface, etc. The storage module 803 can be a memory.

[0175] In this configuration, when the processing module 801 is a processor, the communication module 802 is a transceiver, and the storage module 803 is a memory, the processor, transceiver, and memory can be connected via a bus. The bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc.

[0176] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0177] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0178] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0179] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0180] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks, SSDs), etc.

[0181] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method of cell quality determination, characterized by, The method includes: Obtain the XDR data record of the X detailed bill; the XDR data includes IMS domain XDR data, EPC domain XDR data and 5GC domain XDR data; If multiple call detail records (CDRs) in the XDR data have the same XDR ID field, one CDR will be randomly retained and the rest will be deleted. Based on the XDR data, a service evaluation factor library is generated. The service evaluation factor library includes a voice service call quality session evaluation factor library and cell quality information of multiple cells. A cell quality information consists of at least one service evaluation factor. The voice service call quality session evaluation factor library contains target records. The target records are records established based on the content of the Sessions call detail records in the XDR data. Fill the target record with the tracking area code and cell identifier that are closest to the procedure_start_time of the target record in the user cell information database; Based on the aforementioned service evaluation factor library, the service quality scores of the multiple cells are determined.

2. The method of claim 1, wherein, The process of generating a business evaluation factor library based on the XDR data includes: For each terminal, based on the XDR data, voice service quality information from the terminal is determined to obtain multiple cell quality information. Based on the quality information of the multiple cells, determine the cell quality information corresponding to each cell; The service evaluation factor library is generated based on the community quality information corresponding to each community.

3. The method of claim 2, wherein, The method further includes: Acquire new XDR data; For each terminal, based on the new XDR data, extract the new cell quality information corresponding to the terminal; Delete the third number of target cell quality information from the cell quality information database corresponding to the terminal, and add the new cell quality information to the cell quality information database corresponding to the terminal; the third number is the number of new cell quality information corresponding to the terminal; the target cell quality information is the cell quality information stored in the cell quality information database at the earliest time.

4. The method of claim 2, wherein, The process of determining the cell service quality score of the multiple cells based on the service evaluation factor library includes: For each cell corresponding to the service evaluation factor library, obtain the cell quality information of the cell within a preset time period from the service evaluation factor library; Based on the cell quality information of the cell within a preset time period, a target percentage of the cell is determined; the target percentage is the proportion of the cell whose voice quality does not meet the expected voice quality corresponding to the cell quality information. Based on the ratio range in which the target percentage falls, the service quality score of the cell is determined.

5. The method of claim 2, wherein, The process of determining the cell service quality score of the multiple cells based on the service evaluation factor library includes: If the number of cell quality information in the service evaluation factor library reaches the target number, the cell service quality score of the multiple cells is determined based on the service evaluation factor library, and the cell quality information in the service evaluation factor library is deleted.

6. The method according to any one of claims 1-5, characterized in that, The community quality information includes at least one of the following: The number of lost packets, single-pass identification, intermittent identification, mean opinion score; The cell comprises at least one of the following: a session cell, a cell corresponding to a network slice.

7. A device for determining the quality of a residential community, characterized in that, The method comprises an obtaining module, a processing module and a determining module. The obtaining module is configured to obtain XDR data; the XDR data comprises IMS domain XDR data, EPC domain XDR data and 5GC domain XDR data; in the case where XDR ID fields corresponding to multiple bills are the same in the XDR data, one of the bills is randomly retained and the remaining bills are deleted; The processing module is configured to extract cell quality information based on the XDR data; the cell quality information is used to indicate the voice service quality in a cell; The processing module is configured to generate a service evaluation factor library based on the cell quality information; the service evaluation factor library further comprises a voice service call quality session evaluation factor library; the voice service call quality session evaluation factor library comprises a target record; the target record is a record established based on the content of the Sessions bill in the XDR data; a tracking area code and a cell identifier in the user cell information library that are closest to the procedure_start_time of the target record are filled into the target record; The determining module is configured to determine a cell service quality score based on the service evaluation factor library.

8. A device for determining the quality of a residential community, characterized in that, The cell quality determination apparatus comprises: a processor; a memory configured to store instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the cell quality determination method according to any one of claims 1-6.

9. A computer-readable storage medium having stored thereon instructions, the computer-readable storage medium comprising: When the instructions in the computer readable storage medium are executed by the cell quality determination apparatus, the cell quality determination apparatus can perform the cell quality determination method according to any one of claims 1-6.

10. A computer program product, characterised in that, The computer program product comprises computer program instructions, which, when executed by a processor, implement the cell quality determination method according to any one of claims 1-6. The computer program product comprises computer program instructions, which, when executed by a processor, implement the cell quality determination method according to any one of claims 1-6.

Images