Dial testing method and device, equipment, program product and storage medium

Abstract

The invention discloses a dial testing method and device, equipment, a program product and a storage medium. The method comprises the following steps: determining a dial testing task based on a preset dial testing strategy;

Description

Technical Field

[0001] The present application relates to the field of data service technology, and in particular to a dialing method and apparatus, equipment, program product, and storage medium. Background Art

[0002] Evaluating and improving broadband network and service quality requires a robust foundation of indicator data to accurately analyze and effectively improve user internet quality. Therefore, indicator data must meet the following requirements: sufficient quantity, sufficient coverage of user online time, sufficient ability to reflect user perceived quality of experience (QoE), service key quality indicators (KQIs), and network key performance indicators (KPIs), and accurate data collection. Furthermore, indicator values must be able to indicate whether network or service degradation is occurring. Collecting satisfactory indicator data requires consideration of factors such as collection equipment, software, and solutions. Existing monitoring and dial-up testing solutions for collecting user internet quality data present several challenges. These include difficulty in implementation, high implementation costs, limited collection of relevant indicator data, and limited coverage of online time, which incompletely reflects user internet quality. Therefore, continuously and accurately acquiring user internet quality data is an urgent issue that needs improvement. Summary of the Invention

[0003] To solve the above technical problems, the present application provides a dialing test method and apparatus, equipment, program product, and storage medium.

[0004] The dialing test method provided in this application includes:

[0005] Determine the dialing test tasks based on the pre-defined dialing test strategy.

[0006] The dialing test device provided in this application includes:

[0007] The determination unit is used to determine the dialing test task based on a pre-defined dialing test strategy.

[0008] The dialing test device provided in the present application includes: a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to perform any one of the above-mentioned dialing test methods.

[0009] A computer program product provided in the present application includes: a computer program, which implements any one of the above methods when executed by a processor.

[0010] The computer-readable storage medium provided in the present application is used to store a computer program, and the computer program enables a computer to execute any one of the above methods.

[0011] In the technical solution of this application, a dialing test task is determined based on a pre-established dialing test strategy. Thus, obtaining a pre-established dialing test strategy and determining the dialing test task according to the dialing test strategy enables the test terminal to meet various dialing test tasks, continuously collect data, and thus collect sufficient user Internet access quality data. Controlling the test terminal to execute the dialing test task according to the dialing test strategy can reduce the impact on the user's Internet access, reduce the performance consumption of the test terminal, and at the same time, the user Internet access quality data obtained after the dialing test can accurately reflect the actual user's Internet access, ensuring the accuracy of data collection. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 This is a flowchart of the dialing method provided in the embodiment of the present application. Figure 1 ;

[0013] Figure 2 This is a schematic diagram of a user accessing a website and gradually drilling down to covered network elements from top to bottom, provided by an embodiment of the present application;

[0014] Figure 3 This is a schematic diagram of dialing and testing Internet access network and service quality data based on a user-side device (terminal) according to an embodiment of the present application;

[0015] Figure 4 This is a flowchart of the dialing method provided in the embodiment of the present application. Figure 2 ;

[0016] Figure 5 Schematic diagram of a method for determining the number of dial tests provided in an embodiment of the present application;

[0017] Figure 6 This is a schematic diagram of jointly determining or adjusting the number of dial tests under multiple conditions provided in an embodiment of the present application;

[0018] Figure 7 This is a schematic diagram of the revision and update rules of the dial-up test website provided in an embodiment of the present application;

[0019] Figure 8 This is a schematic diagram of the structure of the dial test device provided in the embodiment of the present application. Figure 1 ;

[0020] Figure 9 This is a schematic structural diagram of a dialing and testing device provided in an embodiment of the present application;

[0021] Figure 10 It is a schematic structural diagram of the chip of an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will describe the technical solutions in the embodiments of this application in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0023] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0024] It should also be noted that the terms "first\second\third" involved in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific order for the objects. It is understandable that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. The term "and / or" herein is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " herein generally indicates that the related objects before and after are in an "or" relationship. It should also be understood that the "indication" mentioned in the embodiments of the present application can be a direct indication, an indirect indication, or an indication of an association relationship. For example, A indicates B, which can mean that A directly indicates B, for example, B can be obtained through A; it can also mean that A indirectly indicates B, for example, A indicates C, and B can be obtained through C; it can also mean that there is an association relationship between A and B. It should also be understood that the "correspondence" mentioned in the embodiments of the present application may indicate a direct or indirect correspondence between the two, or an association between the two, or a relationship between indication and being indicated, configuration and being configured, etc.

[0025] Evaluating and improving broadband network and service quality requires a robust foundation of indicator data to accurately analyze and effectively improve user internet quality. Therefore, indicator data must meet the following requirements: sufficient quantity, sufficient coverage of user online time, sufficient information to reflect user-perceived QoE, service KQI, and network KPI indicators, and accurate data collection. Furthermore, indicator values must be able to indicate whether the network or service is experiencing degradation.

[0026] To collect indicator data that meets the requirements, it is necessary to consider the impact of collection equipment, collection software, and collection solutions. Currently, there are two general methods for collecting data reflecting user Internet access quality indicators. One is to monitor the traffic data generated when users access the Internet, or to capture packets during monitoring, and collect Internet access quality indicator data from the monitored data stream. This data can be collected continuously and in large quantities. This method is mainly suitable for monitoring wired broadband network and service quality and collecting data using high-performance equipment (such as dedicated data collection equipment / hardware, computers, etc.), and is used in scenarios where high-performance equipment is used. The other method is to dial the content or corresponding address that users access online to obtain network quality and service quality indicator data during the dialing test. Currently, the data collected by dialing tests is generally short-term and the amount of data collected is limited. This method is mainly suitable for collecting data from devices with average or low performance, or to avoid the impact of collected data on terminal Internet access and to evaluate broadband network and service quality. This method is used in scenarios where average performance devices or commonly used Internet terminals (such as mobile phones) are used.

[0027] While current monitoring technologies and solutions provide high-quality data collection on wired broadband networks and service quality, they place high demands on the equipment used for monitoring and data collection. While user-side devices, such as mobile phones, offer good performance, they are unable to provide long-term, in-service monitoring and accurately collect relevant metrics. Packet capture can sometimes be attempted, but mobile phones are user-owned terminals, making it difficult for large numbers of users to install monitoring and data collection tools. This can even impact mobile internet access. Monitoring and data collection can be implemented on network-side network elements, but this requires costly capacity expansion, and the increased data volume complicates data analysis. Tools on set-top boxes can only monitor the quality of Internet TV services and the network they carry, and are limited by the number of users, making it difficult to cover all wired broadband users. Therefore, monitoring and data collection technologies and solutions are difficult to implement on user-side devices and expensive to implement on network-side network elements.

[0028] Current dial-up testing technologies and solutions can collect some metrics about users' internet access. However, these technologies and solutions often have long test cycles and a limited number of test times. Furthermore, the test results often differ from the user's actual access experience. The content tested might not be what the user wants to access at any given time, and the content they do want to access might not be available. Therefore, these technologies and solutions can only partially reflect the status of wired broadband networks and services, which is a limitation. However, dial-up testing solutions inherently have low requirements for user-side devices. Dial-up testing can be performed on any user-side device, such as a mobile phone. This solution offers advantages such as low cost and ease of implementation and rollout.

[0029] Existing monitoring and dial-up testing solutions for collecting user Internet access quality data all have some problems. These solutions are difficult to implement and costly to implement, or they collect relatively little relevant indicator data and cover a short period of time, failing to fully reflect user Internet access quality. Therefore, how to continuously and accurately obtain user Internet access quality data is a critical issue. To this end, the following technical solutions are proposed in the embodiments of this application.

[0030] To facilitate understanding of the technical solutions of the embodiments of the present application, the technical solutions of the present application are described in detail below through specific embodiments. The above related technologies can be combined arbitrarily with the technical solutions of the embodiments of the present application as optional solutions, and all of them fall within the scope of protection of the embodiments of the present application. The embodiments of the present application include at least part of the following contents.

[0031] It should be noted that the "test terminal" in this application can be replaced by "dial test terminal"; the "dial test demand" in this application can be replaced by "dial test requirement".

[0032] Figure 1 This is a flowchart of the dialing method provided in the embodiment of the present application. Figure 1 ,like Figure 1 As shown, the dialing method includes the following steps:

[0033] Step 101: Determine a dialing test task based on a pre-defined dialing test strategy.

[0034] In some implementations, during routine network monitoring, based on pre-established dialing test strategies (including dialing test location, time, content, and other information), dialing test terminals are deployed, dialing test content is arranged, and network operation is monitored regularly in a fixed-point and regular manner; in fixed-point sampling detection, dialing test terminals are deployed immediately and dialing test content is specified for specific application scenarios or user complaints, thereby realizing the function of proactively discovering network anomalies or reproducing user usage conditions.

[0035] It is understood that a dialing test strategy can satisfy both normalized dialing test processes, exemplarily, regular and periodic dialing test processes, and dialing test processes in specific application scenarios, exemplarily, corresponding to network anomalies. This application does not specifically limit the scenarios that a dialing test strategy satisfies. Therefore, this application does not specifically limit the scenarios of dialing test tasks determined based on the dialing test strategy.

[0036] In some implementations, the dial test strategy includes one or more of the following: dial test location, dial test time, dial test frequency, dial test terminal, data reporting strategy, dial test scope, dial test frequency, total number of dial tests, dial test cycle, deployment of test terminals, and arrangement of dial test content.

[0037] It is understandable that the dialing test time may refer to the time when the dialing test is performed.

[0038] In some implementations, the dial testing strategy may be pre-set, or a corresponding dial testing strategy may be determined according to a new dial testing requirement.

[0039] The specific content of the dialing test strategy can be determined according to actual needs, and this application does not make any specific restrictions on this.

[0040] In some implementations, the method further includes: sending the dialing test task to the test terminal according to first information of the test terminal, where the first information represents status information of the test terminal.

[0041] In some implementations, sending the dialing test task to the test terminal for execution includes: sending the dialing test task to the test terminal for execution based on at least the power level of the test terminal and the terminal system resource occupancy rate.

[0042] In some implementations, the test terminal and test software remain enabled, non-testing applications are closed, and the test terminal is controlled via the platform. Dial-up testing tasks are issued to the test terminal based on the test terminal's battery level and terminal system resource utilization. Parameters are configured based on the actual application scenario, and data services are configured on the test terminal via the test software, alternating between upload and download services. At the start of the test, the test device is powered on and data service cycles are maintained. The upload / download service latency, data volume, test duration, and rate details for each sampling point are measured and recorded.

[0043] For example, the configuration parameters may be: the server is configured as a locally deployed dedicated FTP / HTTP server; the upload file size is 2GB, the download file size is 20GB; the upload / download threads are 10; the ping packet size is 32 bytes; the test interval is 15 seconds; the single upload / download test duration is 30 seconds; and the network can be selected based on actual conditions. This application does not specify these specific configuration parameters and they can be determined based on actual conditions.

[0044] In some implementations, the test software needs to meet the following basic requirements: it can control the switching of 4G / 5G networks and support the collection of the main wireless parameters of the 4G / 5G networks; it supports perception service testing and can provide service experience indicators through interface elements, key frame information of the screen, etc.; it can report its own status at any time before and during the test to support the control of the test process and adjustment of the dialing test strategy at any time through remote or manual means; it has a certain degree of security, and the test results are transmitted to the dialing test management platform in an encrypted manner to prevent malicious programs from stealing; it can run stably and properly handle various anomalies encountered during operation to avoid affecting the normal operation of the test terminal; it has its own status detection function and supports reporting real-time Application operation status, system resource utilization, application running time and frequency statistics, etc.; device anomalies that occur during the test can be reported to the dial test management platform in a timely manner; in addition to test-related functional requirements, no additional system resources of the test terminal are occupied; the terminal is provided with functions that can be set according to test requirements, such as closing other Internet processes and firewalls; it has a terminal performance detection function, which can determine whether the terminal has the performance and configuration requirements required for the test; it has an online upgrade function, and provides automatic upgrade and manual upgrade options; before the test, the platform is informed of the terminal information that may be collected, including device ID, network parameters, IP address, location information, etc.; at least 1 month of historical test records and query functions are provided.

[0045] In some implementations, the terminal has its own status detection function, supports reporting real-time application running status, system resource occupancy, statistics on application running time and frequency, and other information.

[0046] In some implementations, the first information includes the power level of the test terminal and the terminal system resource occupancy rate, etc. The specific content of the first information can be determined according to actual needs, and this application does not impose any specific restrictions on this.

[0047] In some implementations, the terminal is required to report information related to terminal performance, such as current system resource usage, top applications used, and whether video playback is in progress. It is understood that the terminal is a test terminal, and illustratively, the terminal may be a mobile phone.

[0048] In some implementations, the method further includes: acquiring state information of the test terminal itself reported by the test terminal, and adjusting the dialing test strategy according to the state information.

[0049] In some implementations, before and during a test, the terminal may report its own status at any time to support remote or manual control of the test process and adjustment of the dialing test strategy.

[0050] It is understandable that before and during the test, that is, before or during the dialing test process, the terminal can report its own status at any time.

[0051] In some implementations, the dialing frequency of a user's mobile phone (terminal) can be adjusted based on the information reported by the mobile phone (terminal). This adjustment involves adjusting the dialing policy on the dialing management platform, or the dialing software installed on the mobile phone needs to be able to detect terminal performance data and suspend the dialing test until the terminal is suitable for dialing (for example, no longer playing high-traffic video).

[0052] In some implementations, the method further includes: obtaining a dialing test requirement.

[0053] In some implementations, the dialing test task is determined according to a dialing test requirement.

[0054] It is understandable that before the evaluation, after obtaining the current dialing test requirements, the current dialing test task can be determined according to the current dialing test requirements and sent to the dialing test terminal to execute the corresponding dialing test task.

[0055] In some implementations, the method further includes: setting at least a test area, a dial test sampling frequency, and a total number of dial tests in the dial test task to achieve effective and uniform coverage of the tested network elements.

[0056] In some implementations, at least the test area, the dial test sampling frequency, and the total number of dial tests are set in the dial test task to achieve effective and uniform coverage of the tested network elements, users, and servers.

[0057] In some implementations, the test area, sampling frequency, total test times, and other requirements are determined based on the test requirements before evaluation to ensure that the tested network elements in the test area can be effectively and evenly covered and that sufficient test data can be collected for these network elements.

[0058] It can be understood that the test area, dialing sampling frequency and total number of dialing tests are set in the dialing test task to ensure that the dialed network elements in the test area can be effectively and evenly covered. Among them, the corresponding dialing test task is achieved with the least total number of dialing tests, which is effective coverage, and the number of dialing tests for each dialed network element is relatively average, that is, the number of dialing tests for each dialed network element will not be significantly different, which is uniform coverage.

[0059] The setting content of the specific dialing test task can be determined according to actual needs, and this application does not make any specific restrictions on this.

[0060] In some implementations, the method further includes: determining network area information required to be covered by the dialing test task, and determining the number of test terminals to be deployed and the minimum sampling frequency of the test terminals based on topology information within the network area.

[0061] In some implementations, a sampling frequency that meets the requirements needs to be set for the test content or test terminal. The operator network area information that needs to be covered by the dialing test task should be determined. The dialing test strategy should be executed based on the topology information and cell coverage in the area. The number of test terminals to be deployed in the area and the minimum sampling frequency of the test terminals should be set. The number of test terminals and the minimum sampling frequency should be able to cover the main topology scenarios in the test area. The test content should come from multiple commonly used servers to eliminate the impact of server selection on test indicators.

[0062] The number of test cycles must ensure sufficient sample size for statistical purposes. If comparative service testing is required across different carrier networks, data services on each carrier network must be synchronized during testing, meaning that the test equipment on each network initiates service requests at the same time. A sampling frequency that meets the requirements must be set for the test content or test terminals. The carrier network area to be covered by the dial-up test task must be determined, and a dial-up test strategy must be developed based on the topology within that area. The number of test terminals to be deployed within the area and the minimum sampling frequency for the test terminals must be set.

[0063] In some implementations, by determining the number of dial tests of the lowest-level network element, the number of dial test samplings of network elements at each level can be evenly covered step by step from bottom to top, and the number of dial test samplings covers the lowest-level network element or user, which includes one or more of the following from bottom to top: Internet users, wireless access base stations, wireless access network elements, core network elements, websites (APPs, business platforms), etc.

[0064] In some implementations, a proportional coefficient of the dial test times of the upper and lower level network elements is determined according to the number of upper and lower level network elements, and the dial test times of network elements at all levels are determined based on the dial test times of the lower level network elements and the proportional coefficient.

[0065] For example, if the number of bottom-level network elements is a and the number of upper-level network elements is b, and a total of M1 dial tests are performed on a bottom-level network elements, then the number of dial tests on the upper-level network elements is M1 / K1, where K1 is the ratio of the number of upper- and lower-level network elements, K1 = a / b. It is understood that by obtaining the number of dial tests for one level and the number of upper- and lower-level network elements, the number of dial tests for any other level can be determined.

[0066] In some implementations, a sampling frequency that meets the requirements for test content or test terminals must be set. The operator network area that the test task needs to cover must be determined. A test strategy must be developed based on the topology and cell coverage within the area. The number of test terminals to be deployed within the area and the minimum sampling frequency for the test terminals must be set. The number of test terminals and the minimum sampling frequency should be sufficient to cover the major topological scenarios within the test area. Test content should be sourced from multiple commonly used servers to eliminate the impact of server selection on test performance.

[0067] In some embodiments, the method also includes: the dialing test platform can determine whether the dialing test terminal is suitable for dialing test based on the status information of the dialing test terminal, and determine whether the dialing test times of each terminal can meet the effective coverage and uniform coverage of the lowest-level topology / network element based on the minimum dialing test times of the terminal that can be dialed. If not, the dialing test tasks will continue to be issued to the terminals under the network elements whose dialing test times are insufficient, until the feedback information received according to the dialing test task indicates that the dialing test coverage requirements can be met, and the dynamic adjustment of the dialing test times is completed.

[0068] In some embodiments, terminals that meet the dialing test conditions are selected based on the status of the dialing test terminals, and a network element hierarchical relationship is established through multi-level topology modeling. Based on the minimum dialing test number benchmark value of the most remote network element node, combined with a preset inter-level proportional coefficient, the required dialing test number for each level of topology / network element is derived from the bottom up. The system can implement dynamic monitoring. When the dialing test sample volume at a certain level does not reach the minimum coverage threshold of the corresponding topological unit, a supplementary dialing test task is automatically triggered, and an incremental dialing test instruction is issued to the dialing test terminal under the topological path. This iterative process continues until the dialing test result feedback verifies that the dialing test coverage density of each level of the topological structure meets both the vertical proportional relationship and the horizontal uniform distribution requirements, thereby ensuring that the network quality assessment is statistically valid.

[0069] In some implementations, the dial test strategy includes one or more of the following: a test area, a dial test sampling frequency, and a total number of dial tests; wherein the test area includes a website, a service platform, a wireless base station, multi-level network elements, and a test terminal.

[0070] It should be noted that the test terminal may also be referred to as a user-side device. The test area refers to a designated area or network element (such as a wireless base station) of an operator's mobile communication network.

[0071] In some implementations, the above dialing test method can be applied to a dialing test management platform.

[0072] In some implementations, before determining the dial testing strategy, a dial testing requirement is obtained, and the dial testing strategy is determined according to the dial testing requirement.

[0073] In some implementations, the dial test requirement may be a function setting requirement for the entire dial test management platform, or may be a dial test requirement corresponding to a current dial test task.

[0074] In some embodiments, user Internet access information is obtained, and the test area and / or dialing test object and / or dialing test sampling frequency and / or total number of dialing tests are determined according to the user Internet access information of the dialing test requirements. The dialing test management platform determines the scheduling of the dialing test tasks based on the dialing test strategy. The user-side device dials according to the dialing test range, dialing test cycle, dialing test frequency and / or total number of dialing tests to obtain user Internet access quality data, and then realizes continuous Internet access quality monitoring, fault analysis, etc. according to the user Internet access quality data, thereby improving the user Internet access experience.

[0075] In some embodiments, the test area and / or the dial test object and / or the dial test sampling frequency and / or the total number of dial tests are determined according to the dial test requirements. The dial test management platform determines the scheduling of the dial test tasks based on the dial test strategy, obtains the user Internet access quality data, and then implements continuous Internet access quality monitoring, fault analysis, etc. based on the user Internet access quality data, thereby improving the user Internet access experience.

[0076] In some implementations, the method further includes: if the dial test requirement is updated, updating the dial test strategy according to the updated dial test requirement.

[0077] In some implementations, performance-related information reported by the dial test terminal is obtained, and the dial test frequency and dial test strategy are updated / modified / adjusted according to the reported performance-related information.

[0078] In some implementations, the difference between the number of dialing tests returned by the dialing test terminal and the number of issued dialing test tasks is obtained, the dialing test terminal is updated, and the dialing test task is issued to the updated dialing test terminal.

[0079] In some implementations, if the dial test requirements are updated, one or more of the following items are updated based on the updated dial test requirements: test area, dial test sampling frequency, and total number of dial tests. This allows for timely adjustment of the dial test strategy and accurate collection of user Internet quality data.

[0080] In some implementations, the dialing object further includes a business server, which may also be referred to as a business platform or an application server. The business server is used to implement the functions of a website or an APP, and the business server includes a content source and a website.

[0081] In some embodiments, the setting of the dial test sampling frequency includes one or more of the following: determining the operator network area information that needs to be covered by the dial test task, and obtaining the number of lowest-level network elements in the network area based on the topology information in the network area, and setting the minimum dial test sampling frequency for the lowest-level network elements based on the number; setting a sampling frequency that meets the requirements for the dial test content or the dial test object.

[0082] In some embodiments, the test terminal is capable of reporting identification information of the wireless base station; the method further includes: obtaining the identification information of the wireless base station reported by the terminal, and formulating the dialing test strategy based on the identification information of the wireless base station, wherein the dialing test tasks arranged according to the dialing test strategy evenly cover the wireless base stations that need to be dialed.

[0083] In some implementations, the dialing test strategy further includes a dialing test address; obtaining the dialing test requirement includes obtaining address information of a test area; and determining the dialing test strategy based on the dialing test requirement includes determining the dialing test address based on the address information of the test area.

[0084] In some implementations, the method further includes: reducing the dialing test frequency of a single test terminal on the basis of satisfying the dialing test coverage and uniformity requirements.

[0085] In some embodiments, the dialing test requirement also includes information about the device associated with the user's Internet access. Exemplarily, it may include one or more of the following: obtaining the address information of the service server and / or the identification information of the service server; obtaining the address information of the core network network element device and / or the identification information of the core network network element device; obtaining the address information of the access network network element device and / or the identification information of the access network network element device; and / or obtaining the address information of the test terminal and / or the identification information of the test terminal and / or the power of the test terminal and / or the resource occupancy rate of the test terminal.

[0086] In some implementations, if you want to obtain user Internet access quality data, you need to consider the various network elements, content sources, and / or websites that the user accesses when surfing the Internet. Therefore, the dial-up test solution of the embodiment of the present application needs to drill down step by step to the lowest level network element or user granularity for full coverage. The dial-up test covers the network elements accessed by the user, multi-level network elements (from access network elements upwards), and test terminals. Specifically, it may include: websites (APPs, business platforms), core network network elements, access network network elements, wireless access base stations, Internet users, etc. For example, Figure 2This is a schematic diagram of a user accessing a website and gradually drilling down to cover network elements from top to bottom, as provided in an embodiment of the present application. By obtaining information on different business platforms / websites or application servers, and network element devices at all levels, for example, the information on devices associated with the user's Internet access includes the number of each device and / or the address information and / or device identification information, etc. The specific information content can be determined based on actual conditions, and this application does not make specific restrictions on this. Furthermore, the device information associated with these users' Internet access can be determined to determine the dialing strategy, and the scheduling of the dialing tasks can be determined based on the dialing strategy to obtain the user's Internet access quality data, which also ensures that different business platforms / websites or application servers, and network element devices at all levels can report a certain number of dialing results within a certain period, so as to achieve the purpose of real-time monitoring through dialing and conducting various diagnostic analyses.

[0087] In some embodiments, obtaining the dialing test requirements includes one or more of the following: obtaining the address information of the website and / or the identification information of the website and / or the dialing test sampling frequency of the website; obtaining the address information of the service platform and / or the identification information of the service platform and / or the dialing test sampling frequency of the service platform; obtaining the address information of the wireless base station and / or the identification information of the wireless base station and / or the dialing test sampling frequency of the wireless base station; obtaining the address information of the multi-level network element and / or the identification information of the multi-level network element and / or the dialing test sampling frequency of the multi-level network element; obtaining the address information of the test terminal and / or the identification information of the test terminal and / or the dialing test sampling frequency of the test terminal and / or the power of the test terminal and / or the terminal system resource occupancy rate of the test terminal.

[0088] In some implementations, the dialing test requirement includes one or more of the following: the dialing test requirement of the website, the dialing test requirement of the service platform, the dialing test requirement of the wireless base station, the dialing test requirement of the multi-level network element, and the dialing test requirement of the test terminal.

[0089] In some implementations, the method further includes: determining a dialing test strategy according to the dialing test requirement.

[0090] In some embodiments, the dialing test requirements of the website include the dialing test sampling frequency of the website; the dialing test requirements of the service platform include the dialing test sampling frequency of the service platform; the dialing test requirements of the wireless base station include the dialing test sampling frequency of the wireless base station; the dialing test requirements of the multi-level network element include the dialing test sampling frequency of the multi-level network element; the dialing test requirements of the test terminal include the dialing test sampling frequency of the test terminal; wherein, when the dialing test sampling frequency is set to meet the dialing test coverage and uniformity requirements, the dialing test frequency of a single test terminal is reduced.

[0091] In some embodiments, the dial test sampling frequency can be determined based on the dial test cycle and the dial test frequency. Different users have different dial test requirements for their Internet access devices. The dial test cycle can be at the second level, including 1 second, 10 seconds, etc.; or at the minute level, including 1 minute, 10 minutes, 30 minutes, etc.; or at the hour level, including 1 hour or more. For the minimum time granularity dial test cycle, the dial test frequency includes at least 1 time; or at the 10-times level, including 10 times, 20 times, 50 times, etc.; or at the hundred-times level, including 100 times, 500 times, etc.; or at the thousand-times level, including 1000 times, 5000 times, etc. The specific dial test cycle and dial test frequency can be determined according to actual conditions, and this application does not make specific restrictions on this.

[0092] In some implementations, for the dial test cycle with the minimum time granularity, the dial test frequency may be the average time of the dial test, or the time interval between each dial test may be set according to actual conditions, which is not specifically limited in this application.

[0093] In some embodiments, the dialing test cycle can be determined based on the time requirements for discovering anomalies for different websites and / or business platforms and / or wireless base stations and / or multi-level network elements and / or test terminals. For example, the business platform / website or APP application server adopts minute-level dialing test; network elements at all levels adopt second-level dialing test. For example, t can be defined as the time granularity variable, and the value of t is generally 1 second, 10 seconds, 1 minute, 10 minutes, and 30 minutes, and the value is determined according to different monitoring and analysis needs.

[0094] In some implementations, based on the varying number of dial tests and / or connected users required by different network element devices and servers, dial test frequency requirements are imposed on network elements and service servers at all levels. n can be defined as the minimum number of times that indicator data can be collected / counted at the minimum time granularity. The value of n is greater than or equal to 1. A larger value of n indicates more frequent dial tests, more data collected, and better monitoring and analysis results.

[0095] In some implementations, the dial test sampling frequency of the website and / or the dial test sampling frequency of the core network element device and / or the dial test sampling frequency of the access network element device and / or the dial test sampling frequency of the test terminal and / or the dial test sampling frequency of the service platform is updated according to actual conditions.

[0096] In some embodiments, determining the dialing test strategy based on the dialing test requirements includes: determining at least one or more of the following based on the dialing test requirements: a test area, the dialing test area refers to a designated area of the mobile communication network and / or a dialing test object within the designated area; a dialing test sampling frequency, the dialing test sampling frequency includes one or more of the following: the dialing test sampling frequency of the website, the dialing test sampling frequency of the service platform, the dialing test sampling frequency of the wireless base station, the dialing test sampling frequency of the multi-level network element, and the dialing test sampling frequency of the test terminal; the total number of dialing tests, the total number of dialing tests is determined based on the dialing test sampling frequency.

[0097] In some embodiments, the total number of dial tests can also be determined based on one or more of the following: the dial test sampling frequency of the website, the dial test sampling frequency of the service platform, the dial test sampling frequency of the wireless base station, the dial test sampling frequency of the multi-level network element, and the dial test sampling frequency of the test terminal.

[0098] In some implementations, the dial test object can be determined based on the test area. The test area can refer to a geographical area range, a cell range, etc. Different test areas correspond to different users. The specific test area can be determined based on actual conditions, and this application does not make specific limitations on this.

[0099] It should be noted that the test area may also be referred to as a dial test area or a dial test range. The test area refers to a designated area or network element (such as a wireless base station) of an operator's mobile communication network.

[0100] In some embodiments, the total dial test frequency can also be adjusted based on the updated dial test sampling frequency of the website and / or the dial test sampling frequency of the service platform and / or the dial test sampling frequency of the wireless base station and / or the dial test sampling frequency of the multi-level network element and / or the dial test sampling frequency of the test terminal.

[0101] In some implementations, considering the possibility of dial test failure, corresponding compensation can be made for the total number of dial tests, or corresponding compensation can be made for the number of dial tests at each level of network elements and servers. The specific number of compensations can be determined based on actual conditions, and this application does not make any specific restrictions on this.

[0102] In some implementations, the number of dial tests of network elements at all levels can be increased proportionally. The setting of the ratio can be adjusted according to the number of upper and lower layer network elements, or adjusted according to the impact of business significance. For example, the dial test cycle of network element monitoring can be set to minutes or seconds. Therefore, the number of dial tests of network element monitoring will also be affected by business significance. The specific value of the ratio can be determined according to actual conditions, and this application does not make specific limitations on this.

[0103] In some implementations, the total number of dial tests may be determined based on the number of devices at each level, the number of dial tests of the highest-level network element, and the dial test compensation.

[0104] In some implementations, the total number of dial tests can also be determined based on the ratio of the number of dial tests for each level of equipment, the number of dial tests for the lowest-level network element, and the dial test compensation. For example, the number of bottom-level network elements is a, the number of upper-level network elements is b, the number of next-highest-level network elements is m, and the number of top-level network elements is n. For a number of bottom-level network elements, N1 dial tests are performed, and a dial test failure compensation of delta1 is performed. That is, for a number of bottom-level network elements, M1 dial tests are performed, for the upper-level network elements, M1 / K1 dial tests are performed, and for m next-highest-level network elements, M1 / (K1×…×Kn-2) dial tests are performed, where Ki is the ratio coefficient between the number of upper and lower-level network elements. For n top-level network elements, M1 / (K1×…×Kn-2×Kn-1) dial tests are performed, i.e., the number of dial tests decreases linearly with the number of network elements.

[0105] In some implementations, the total number of dial tests must also meet the following requirements: the sampling frequency requirement is set according to the designated area or network element (such as a wireless base station) of the operator's mobile communication network. Support the combination of the network topology of the tested area to meet the minimum sampling frequency requirement for each dialed object within the dial test coverage area in the dial test requirements, and ensure that the lowest-level network element is covered with sufficient collection frequency. There is sufficient sampling frequency for the dial test content or the multi-level network elements of the dial test. On the basis of meeting the dial test coverage and uniformity requirements, the dial test frequency of a single test terminal should be minimized to reduce the potential impact of the dial test task on the test terminal user's own Internet experience.

[0106] In some embodiments, the total number of dial tests requires that the number of dial tests of each business server within the dial test cycle is not less than a first threshold. The specific first threshold can be determined based on actual conditions. This application does not make specific limitations on this. For example, the first threshold is ten dial tests within ten minutes.

[0107] In some embodiments, the total number of dial tests requires that the number of dial tests of each network element within the dial test cycle is not less than a second threshold. The second threshold can be determined based on actual conditions. This application does not make specific limitations on this. For example, the second threshold is determined based on the number of access users, such as half of the users connected to each base station.

[0108] In some implementations, it is necessary to perform statistical analysis of dial test data at a minute level or smaller, requiring the total number of dial tests to increase by a multiple of the same proportion.

[0109] In some implementations, the dialing strategy further includes a dialing address; obtaining user Internet access information includes: obtaining information about an access address associated with the user's Internet access; and determining the dialing strategy based on the user's Internet access information includes: determining the dialing address based on the access address information.

[0110] In some implementations, to account for the varying online habits of users in different regions and to ensure that they closely match their actual online usage, the dialing addresses of user-side devices connected to these network elements can be updated by city or prefecture, and updated at a predetermined frequency. This is then linked to the analysis results of the user's online websites in real time, and the dialing addresses are updated in real time to ensure that the dialing addresses are as consistent as possible with the user's actual online usage habits.

[0111] In some implementations, based on user online habits and other behavioral data analyzed by existing systems, customized dialing tests are performed for frequently visited addresses, including customized requirements for dialing frequency and periodicity for specific addresses. During the user's dialing test period, second- or minute-by-second testing is used to closely align with the user's actual online behavior, collecting user online data. For example, some user access habits can be obtained from existing monitoring systems for reference.

[0112] Exemplarily, the dialing address may include one or more of the following: addresses of apps, websites, etc. that users frequently visit, or music, application software packages, etc. that are downloaded in a short time.

[0113] In some implementations, the dial test type includes one or more of the following: page access / open type dial test, content download type dial test, and ping delay type dial test. The specific dial test type can be set according to actual conditions and is not specifically limited in this application.

[0114] In some embodiments, the dial test can collect data on one or more of the following indicators: Transmission Control Protocol (TCP) handshake link establishment round trip time (RTT), data transmission RTT, Domain Name System (DNS) latency, Hypertext Transfer Protocol (HTTP) first GET latency, and average download rate. The specific indicators collected can be determined based on actual conditions and are not specifically limited in this application.

[0115] In some implementations, network-side and end-to-end service metrics are collected without performing packet capture or long-term stream mirroring operations. Second-level dial testing is primarily used. Short, fast-completed TCP and TCP-layer tests, such as HTTP GET and Ping, are primarily used. These tests involve low-byte and low-message dialing. Each user-side device undergoes continuous dialing testing for at least 10 minutes, or multiple discrete 10-minute intervals. These tests involve minimal content and bytes, resulting in minimal or negligible impact on the device. This reduces performance consumption on the user-side device, prevents disruption to users' internet access, and ensures accurate data collection.

[0116] In some embodiments, for daily network monitoring, the test area and sampling frequency and other requirements are determined based on the dial test requirements before the evaluation. The dial test management platform arranges the dial test strategy and sends the dial test tasks to the terminals in the test area for execution according to the strategy to ensure that each dial test network element in the test area is evenly covered. The test area refers to the designated area or network element (such as a wireless base station) of the operator's mobile communication network. Based on the pre-determined dial test area and time, the test terminals are deployed, the dial test content is arranged, and the network operation is normalized and monitored in a fixed-point and regular manner. Specific requirements are as follows: The dial test object, dial test sampling frequency, total number of dial tests and other parameters are set in the dial test strategy to realize the arrangement of the dial test task. The sampling frequency requirements are set according to the designated area or network element (such as a wireless base station) of the operator's mobile communication network. It supports the combination of the network topology of the tested area to meet the minimum sampling frequency requirements of each dial test object in the dial test coverage area in the dial test requirements, and ensure that the lowest-level network element is covered with sufficient collection frequency. Specific dialing test strategies can be set in the following ways: determine the operator network area information that the dialing test task needs to cover, and based on the topology information within the network area, determine the number of lowest-level network elements, set the minimum dialing test sampling frequency for the lowest-level network elements (e.g., 60 times per hour), and provide dialing test task scheduling information. Sufficient sampling frequency is provided for the dialing test content or the multi-level network elements being tested. The test terminal can report the identification information of the connected wireless base station so that the dialing test platform can ensure that the dialing test task evenly covers the wireless base stations that need to be tested when formulating the dialing test strategy. On the basis of meeting the dialing test coverage and uniformity requirements, the dialing test frequency of a single test terminal should be minimized to reduce the potential impact of the dialing test task on the test terminal user's own Internet experience. When the dialing test task is sent to the terminal for execution, factors such as the test terminal's battery life and the terminal system resource utilization rate should be considered to reduce the impact of the dialing test task on the user's normal use of the terminal.

[0117] The technical solution of the embodiment of the present application determines a dialing test task based on a pre-defined dialing test strategy. Thus, obtaining a pre-defined dialing test strategy and determining a dialing test task based on the dialing test strategy enables the test terminal to fulfill various dialing test tasks, continuously collect data, and thereby collect sufficient user Internet access quality data. Controlling the test terminal to execute dialing test tasks according to the dialing test strategy can reduce the impact on user Internet access, reduce test terminal performance consumption, and, at the same time, the user Internet access quality data obtained after executing the dialing test can accurately reflect the actual user Internet access situation, ensuring the accuracy of data collection.

[0118] The technical solutions of the embodiments of the present application are illustrated below with reference to specific application examples.

[0119] Currently, there are two general methods for collecting data reflecting user Internet access quality indicators. One is to monitor the traffic data generated by users while they are online, or to capture packets during monitoring, and collect Internet access quality indicator data from the monitored data stream. This data can be collected continuously and in large quantities. This method is mainly suitable for monitoring wired broadband network and service quality and collecting data using high-performance equipment (such as dedicated data collection equipment / hardware, computers, etc.), and is used in scenarios where high-performance equipment is used. The other method is to dial the content or corresponding address that users access online to obtain network quality and service quality indicator data during the dial-up test. Currently, the data collected by dial-up tests is generally short-term and the amount of data collected is limited. This method is mainly suitable for collecting data from devices with average or low performance, or to avoid the impact of collected data on terminal Internet access, and to evaluate broadband network and service quality. This method is used in scenarios where average performance equipment or commonly used Internet terminals (mobile phones, routers, etc.) are used.

[0120] While current monitoring technologies and solutions provide high-quality data collection on wired broadband networks and service quality, they place high demands on the equipment used for monitoring and data collection. While user-side devices, such as mobile phones, offer good performance, they are unable to provide long-term, in-service monitoring and accurately collect relevant metrics. Packet capture can sometimes be attempted, but mobile phones are user-owned terminals, making it difficult for large numbers of users to install monitoring and data collection tools. This can even impact mobile internet access. Monitoring and data collection can be implemented on network-side network elements, but this requires costly capacity expansion, and the increased data volume complicates data analysis. Tools on set-top boxes can only monitor the quality of Internet TV services and the network they carry, and are limited by the number of users, making it difficult to cover all wired broadband users. Therefore, monitoring and data collection technologies and solutions are difficult to implement on user-side devices and expensive to implement on network-side network elements.

[0121] Current dial-up testing technologies and solutions can collect some metrics about users' internet access. However, these technologies and solutions often have long test cycles and a limited number of test times. Furthermore, the test results often differ from the user's actual access experience. The content tested might not be what the user wants to access, and the content they do want to access might not be available. Therefore, current dial-up testing technologies and solutions can only partially reflect the status of broadband networks and services, which is a limitation. However, dial-up testing solutions inherently have low requirements for user-side devices. Dial-up testing can be performed on any user-side device, such as a mobile phone. This solution is low-cost and easy to implement and scale.

[0122] The above analysis shows that there are some problems in collecting user Internet access quality data through the existing monitoring and dial-up testing solutions. Either the solutions are difficult to implement and the implementation costs are high, or the solutions collect less relevant indicator data and cover a short Internet access time, which cannot fully reflect the user Internet access quality.

[0123] Therefore, in order to address the problems existing in the existing technology, the embodiments of the present application need to consider the subsequent implementation and solve the following technical problems based on the capabilities of the existing devices on the user side:

[0124] 1) Using dial-up testing, based on user-side devices (mobile phones, terminals, etc.), intensively collects data covering the user's primary access content and the end-to-end broadband network quality. This method requires continuous data collection. Compared to monitoring, dial-up testing offers lower costs for continuous data collection. Using the correct dial-up testing method, the data collection objectives can be achieved, including continuous monitoring of broadband Internet quality and fault analysis and location.

[0125] 2) The index data collected in this way needs to be consistent with the data obtained from the user's normal online access content, and the collected index data can reflect the user's actual online situation.

[0126] 3) Collecting indicator data in this way needs to have little impact on device performance to ensure the accuracy of data collection and not affect users' normal Internet access.

[0127] Figure 3 This is a schematic diagram of the user-side device (terminal) dial-up test of the Internet access network and service quality data provided in the embodiment of the present application, such as Figure 3 As shown in the figure, the user-side test device (mobile phone 1, mobile phone 2...mobile phone n) is connected to the network element device through the base station, and then connected to the service platform / website or APP server. The user-side device obtains Internet quality data through dial-up testing. The dial-up testing management platform can issue dial-up testing tasks and judge Internet quality by collecting and analyzing data.

[0128] For routine network monitoring, the test area and sampling frequency are determined based on the dial-test requirements before evaluation. The dial-test management platform orchestrates the dial-test strategy and distributes the dial-test tasks to terminals in the test area to ensure uniform coverage of every dial-test network element in the test area. A test area refers to a designated area or network element (such as a wireless base station) within an operator's mobile communications network.

[0129] Based on the pre-determined dial test area and time, deploy test terminals, arrange dial test content, and monitor network operation status regularly through fixed-point and regular methods. Specific requirements are as follows:

[0130] In the dial test strategy, parameters such as the dial test object, dial test sampling frequency, and total number of dial tests are set to implement the scheduling of dial test tasks.

[0131] Set sampling frequency requirements based on designated areas or network elements (e.g., wireless base stations) within the operator's mobile communications network. This allows for integration with the network topology of the measured area to ensure that the minimum sampling frequency requirement for each measured object within the coverage area is met, ensuring sufficient sampling frequency for even the lowest-level network elements.

[0132] The specific dialing test strategy can be set in the following way: determine the operator network area information that needs to be covered by the dialing test task, and obtain the number of the lowest-level network elements based on the topology information in the network area, set the minimum dialing test sampling frequency for the lowest-level network elements (such as 60 times per hour) to provide the dialing test task scheduling information.

[0133] There is sufficient sampling frequency for the dial test content or the multi-level network elements of the dial test.

[0134] The test terminal can report the identification information of the connected wireless base station so that the dialing test platform can make the dialing test tasks evenly cover the wireless base stations that need to be dialed when formulating the dialing test strategy.

[0135] On the basis of meeting the requirements of dial-up test coverage and uniformity, the dial-up test frequency of a single test terminal should be minimized to reduce the potential impact of the dial-up test task on the Internet experience of the test terminal user himself.

[0136] When a dial-up test task is sent to a terminal for execution, factors such as the battery level of the test terminal and the terminal system resource usage should be considered to minimize the impact of the dial-up test task on the user's normal use of the terminal.

[0137] Compared with the advantages of the monitoring solution, this application proposes the following dial-up testing solution: Figure 4 This is a flowchart of the dialing method provided in the embodiment of the present application. Figure 2 ,like Figure 4As shown, the dialing test method provided in the embodiment of the present application needs to consider the user-side test device / terminal intensively dialing the user's frequently visited content, the update and setting of the user-side device dialing address, and the need to consider the performance consumption and small impact of the user-side device. Among them, for the user-side device / terminal intensively dialing the user's frequently visited content, it is necessary to consider the dialing test drilling down to the lowest level of the network topology step by step, the dialing test cycle supports multiple time granularities, and the minimum time granularity can collect / count the maximum number of indicator data. For the update and customization of the user-side device dialing address, it is necessary to consider the continuous correction and update of the dialing address of frequently used websites, the consistency of the collected indicator data with the data obtained by the user's normal Internet access content, and the dialing test protocol type. The specific description is as follows:

[0138] (1) The user-side device uses dialing to intensively access the websites, apps, and other service contents that the user frequently visits: Based on the user-side device, such as a mobile phone, or a dedicated dialing device deployed on the user side, the user's frequently visited addresses are accessed intensively and for a long time through dialing. Unlike the existing dialing scheme, the dialing scheme proposed in the embodiment of the present application considers that the number of dialings can cover all network elements and websites that the user accesses online, and the following factors need to be considered:

[0139] a) Determine the number of dial tests for the lowest level network element, and evenly cover the number of dial test samples for each level network element from bottom to top: the number of dial test samples covers the lowest level network element or user, from bottom to top including: Internet users, wireless access base stations, wireless access network elements, core network elements, websites (APP, business platforms). Figure 2 The diagram shows a tree structure from top to bottom. By covering the network from bottom to top, network elements at all levels, different service platforms / websites, or application servers must ensure that a certain number of dial test results can be reported within a certain period. This is the only way to achieve real-time monitoring through dial tests and perform various diagnostic analyses.

[0140] For example, Figure 5 FIG. 1 is a schematic diagram of a method for determining the number of dial tests provided in an embodiment of the present application. Figure 5 As shown, the number of dial tests is determined according to the number of upper and lower network elements, and compensation is performed for dial test failures. The number of bottom-level network elements is a, the number of upper-level network elements is b, the number of next-upper-level network elements is m, and the number of top-level network elements is n. For a bottom-level network elements, dial tests are performed N1 times, and the dial test failure compensation is delta1 times. That is, for a bottom-level network elements, dial tests are performed M1 times in total, for the upper-level network elements, dial tests are performed M1 / K1 times in total, and for m next-upper-level network elements, dial tests are performed M1 / (K1×…×Kn-2) times in total, where Ki is the proportional coefficient of the number of upper and lower-level network elements. For n top-level network elements, dial tests are performed M1 / (K1×…×Kn-2×Kn-1) times in total, that is, the number of dial tests decreases linearly with the decrease in the number of network elements.

[0141] For example, the method for calculating the number of dial tests proposed in the embodiments of the present application is as follows: the number of dial tests is reduced proportionally from bottom to top. For example, the ratio of the number of dial tests for network elements at the upper and lower layers can be set to K. The specific setting of K can be determined based on actual conditions and is not specifically limited in this application. In this way, the number of dial tests that can cover the top-level device can be calculated from the number of coverage times for the bottom-level device. For example, if the number of coverage times for the bottom-level device is M1, then the number of dial tests for the top-level device is M1 / (K1×…×Kn-2×Kn-1). This dial test method can basically achieve coverage of network elements and users at each level with a smaller number of dial tests.

[0142] For example, the number of dial tests should also meet the following requirements: if there are X layers, daily dial tests can cover the bottom-layer devices N1 times. The specific number of dial tests for the bottom-layer devices depends on the number of network elements (or service platforms, or content sources) in that layer. In addition, to account for the possibility of dial test failure, the number of dial tests for devices in that layer is compensated by delta1. Therefore, the number of dial tests for the bottom-layer devices is M1 = N1 + delta1.

[0143] From bottom to top, if the ratio of the number of network elements between the lower layer and the upper layer is K1; if based on the number of dial tests on the lowest layer of equipment, the number of dial tests that can cover the network elements of the upper layer is M1 / K1, and the related parameters such as the dial test density of the other layers are similar.

[0144] Since there are X layers, the number of dial tests at the lowest layer can be M1. Here, K is affected not only by the ratio of the number of network elements in the upper and lower layers, but also by the business significance. For example, network element monitoring is best achieved at the minute or second level. If the monitoring of the upper-layer website (content source) can be achieved at the 10-minute level, then the coefficient for monitoring the network elements at the lower layer, K, = (number of network elements in the lower layer / number of content sources in the upper layer) × 10.

[0145] b) The minimum time granularity can be covered to the second level: The dialing test cycle provided in the embodiment of the present application, that is, the data collection and statistical cycle can be at the second level, including 1 second, 10 seconds, etc.; or at the minute level, including 1 minute, 10 minutes, 30 minutes, etc.; or at the hour level, including a time granularity of 1 hour or more.

[0146] Dial test cycles are divided based on the time requirements for anomaly detection for different network elements and servers. For example, the dial test cycle for the service platform / website or app application server is minute-level, while the dial test cycle for network elements at all levels is second-level. Thus, a time granularity variable t can be defined, with typical values for t being 1 second, 10 seconds, 1 minute, 10 minutes, and 30 minutes. This value is determined based on different monitoring and analysis requirements.

[0147] c) The number of indicator data that can be collected / counted at the minimum time granularity: The dialing frequency provided in the embodiment of the present application, that is, for the minimum time granularity statistical period, includes at least 1 time; or 10 times level, including 10 times, 20 times, 50 times, etc.; or 100 times level, including 100 times, 500 times, etc.; or 1,000 times level, including 1,000 times, 5,000 times, etc., the number of times indicator data is collected / counted.

[0148] Dial test frequency meets the following requirements: The number of dial tests and connected users varies depending on the network element and server. This requirement applies to network elements and service servers at all levels. For example, n can be defined as the minimum number of times that indicator data can be collected / counted at the minimum time granularity. The value of n should be greater than or equal to 1. A larger value indicates more frequent dial tests, more data collected, and better monitoring and analysis results.

[0149] The dial test sampling frequency can be determined based on the dial test cycle and dial test frequency.

[0150] Based on the above three points, different coverage requirements are proposed according to the coverage of different levels of websites, network elements, and users. For example, it can be required that the number of dial test coverage throughout the day can at least reach the minute-level statistical principle.

[0151] Figure 6 This is a schematic diagram of the embodiment of the present application providing a multi-condition combined determination of the number of dial tests or adjustment of the number of dial tests. Figure 6 As shown, the minimum total number of dial tests, the minimum dial test frequency for different network elements / servers, etc. are determined based on the content and server dial test requirements, multi-level network element dial test requirements, and single-user dial test requirements.

[0152] The following uses a specific example to illustrate the conditions that the number of dial tests should meet:

[0153] Quality dial test coverage requirements for websites and multi-level network elements (core network elements, core network elements, base stations): The total number of dial tests in a certain area throughout the day is M. From the top to the bottom in a tree structure, the following two conditions must be met. By meeting conditions i and ii, the minimum M value is found to achieve the optimal dial test effect and reduce the pressure on terminals caused by excessive dial tests.

[0154] Condition i) M*(1 / N websites) > 10 minute-by-minute (at least 10 minutes) calls to each website, continuously testing to obtain the minimum number of calls required to cover the top-level website (content source). The number of minute-by-minute calls to each website can be determined based on actual circumstances and is not specifically limited in this application.

[0155] Condition ii) M*(1 / D base stations) > half the number of users typically connected to the base station (or 1 if only one user is connected). This condition must be met at all time granularities, and the test must be continuous. M*(1 / D base stations) should be close to M1, or the larger of the two can be used as the total number of test attempts.

[0156] Assume there are A cities, B core network elements, C access network elements, and D base stations. According to the top-down topology, D>C>B>A. Therefore, the number of dial tests that can cover the most devices is selected for consideration.

[0157] For example, the values of M, N, A, B, C, and D are: M=10 million times, N=5000, A=10, B=30, C=150, and D=30.

[0158] The number of website dial tests on the tree nodes throughout the day can reach: each website can be dialed 2000 times per day; the number of website dial tests on the tree nodes every 10 minutes can reach 13 times, that is, more than 10 times, which meets the requirements of condition i).

[0159] The number of dial tests of network elements at all levels on the tree nodes throughout the day can reach: each city link / network element is dialed 1 million times, each core network network element is dialed 30,000 times, each access network network element is dialed 200 times, and each base station is dialed 6 times; the number of dial tests of network elements at all levels on the tree nodes every 10 minutes can reach: each city link / network element is dialed 6944 times, each core network network element is dialed 208 times, and each access network network element is dialed 1 time. Other tests less than 1 time will no longer be counted. At this time, the requirements of condition ii) are not met.

[0160] Therefore, it is necessary to meet the requirements of conditions i and ii at the same time to find the minimum number of M dial tests throughout the day. If it is necessary to perform statistical analysis of dial test data at the 1-minute or even smaller level, M is required to increase by multiples in the same proportion.

[0161] In addition, we can see that the 10 million daily dial tests in the above example only cover a small number of users throughout the day and every 10 minutes. The quality data of these dial tests can also be used to further analyze anomalies of websites and multi-level network elements.

[0162] Indoor network quality dial test coverage requirements: For user-side network quality, coverage must be available for all user-side network devices, allowing analysis of user-side network anomalies, which typically occur continuously over a certain period of time. This is because it is neither necessary nor practical to continuously test users. This embodiment of the present application proposes a solution whereby user dial tests are performed within a limited timeframe, with each user performing a round-robin test. If conditions i) and ii) are met, condition iii) is added.

[0163] Condition iii) Conduct serial polling and dialing tests on the lowest-level network elements within a certain period of time, at a rate of 100,000 every ten minutes (this data can be adjusted and configured based on actual conditions). Each lowest-level network element can be dialed continuously for thirty minutes and at least 30 times. All lowest-level network elements in the province and / or the required test area will be dialed throughout the day.

[0164] It is also possible to perform dial-up testing on the lowest-level network elements during peak Internet access hours.

[0165] In summary, if conditions i, ii, and iii are met at the same time, the number of indicator data required for quality analysis of websites and network elements at all levels can be covered; the quality indicator data of user-side network equipment can also be covered.

[0166] 2) Update and customize the dialing address of user-side equipment

[0167] a) Continuously update the dial-up test addresses of N websites

[0168] Figure 7 This is a schematic diagram of the revision and update rules of the dial-up test website provided in the embodiment of this application. Figure 7 As shown, the network elements (such as city links) count the frequently visited addresses of users, and the dial-up addresses of user-side devices are updated in real time / at a certain period. Then, the dial-up addresses of user-side devices can be updated in batches by network elements / application servers.

[0169] For example, the dial-up address can be regularly updated based on frequently visited user websites discovered through existing system analysis. Considering that user internet access habits vary across regions, and to ensure that they closely align with actual user internet usage, the dial-up address for user-side devices connected to these network elements can be updated by city or prefecture. This can be updated weekly or monthly. This is done in real time based on user website analysis results, and the dial-up address is updated in real time to ensure that the dial-up address closely aligns with actual user access habits.

[0170] b) The collected indicator data is consistent with the data obtained by users when they usually access the content online

[0171] Based on user online habits and other behavioral data discovered through existing system analysis, customized dialing tests can be performed on frequently visited addresses, including customized requirements for the frequency and / or period of dialing tests for specific addresses. During the period of the user dialing test, second- or minute-level dialing tests are used to closely align with the user's actual online behavior, collecting user online data.

[0172] For example, some user access habits can be obtained from existing monitoring systems as a reference. The reference mainly includes the following elements: frequently visited content and average access frequency, access time distribution, average access duration; network element topology at all levels to which users connect; routing topology for frequently accessed content by users in each province; and content cache or CDN topology at all levels.

[0173] c) Dial test protocol type

[0174] Dial testing is mainly performed on user-side devices. The performance of the devices is average, and the user-side devices mainly provide users with Internet access. It is necessary to be able to use user terminals with various performance or network element devices of operators on the user side. There cannot be too many performance requirements for the equipment. Therefore, the dial test addresses are mainly based on the addresses of APPs, websites, etc. that users frequently visit, or the addresses of music, application software packages, etc. that are downloaded for a short time. The following types of dial tests are supported: page access / open type dial tests; content download type dial tests; Ping delay type dial tests. All of the above dial tests support at least the data collection of the indicators shown in Table 1. Table 1 is the name and detailed description of the indicators supported by the above dial tests.

[0175]

[0176] Table 1 Names and detailed descriptions of supported collection indicators

[0177] 3) It has little impact on the performance of user-side equipment, does not affect the user's normal Internet access, and ensures the accuracy of data collection

[0178] Through the above description of the embodiment of the present application in points 1) and 2), it can be found that although there are certain requirements for the number of daily dial tests, all network elements that need to be tested at all levels must be covered. Because the dial test needs to be initiated from the user's mobile phone (terminal), when the dial test task is sent to the terminal for execution, factors such as the battery level of the test terminal and the terminal system resource utilization rate should be considered to reduce the impact of the dial test task execution on the user's normal use of the mobile phone.

[0179] During the dial test interaction:

[0180] 1) The mobile phone (terminal) needs to be able to report information related to the current system resource usage, top applications used, whether video is being played, and other information related to the mobile phone (terminal) performance.

[0181] 2) The frequency of dialing tests on a user's phone (terminal) can be adjusted based on the information reported by the phone (terminal). This adjustment involves adjusting the dialing test strategy on the dialing test management platform, or the dialing test software installed on the phone needs to be able to detect terminal performance data and suspend dialing tests until the terminal is suitable for testing (for example, no longer playing high-traffic video).

[0182] 3) The dial test management platform needs to be able to count the difference between the number of dial test returns and the number of actual dial test tasks issued, select the appropriate terminal to be tested, and issue additional dial test tasks.

[0183] In addition, the performance of user-side equipment is also guaranteed through the following aspects: collecting network-side and end-to-end business indicators, not performing flow capture and long-term mirroring operations, and mainly performing second-level dialing tests; dialing tests are mainly short-term, quickly completed general TCP types such as HTTP GET and Ping, and dialing tests above TCP with small number of bytes and small number of messages; each user-side device is continuously dialed for at least 10 minutes, or multiple non-continuous 10-minute periods, and the dialing test content is small and the bytes are small, which has basically no impact on the device, or the impact can be negligible.

[0184] The technical solution of the embodiment of the present application proposes a fast dialing test solution at the second / minute level from the user side, covering websites, network elements at all levels, and single users. Through dialing test, intensive access is made to websites, APPs and other business contents that users frequently visit, and the dialing test is carried out continuously throughout the day. In this way, a sufficient amount of user Internet access indicator data can be obtained. It is proposed to obtain content consistent with the user's usual Internet access through dialing test, and to keep it consistent with the indicator data collected from the user's Internet access under monitoring conditions, so that the actual situation of the user's Internet access can be accurately reflected. In addition, the proposed overall dialing test solution can not only meet the requirements for the quantity of collected data and the content requirements for collected indicators, but also ensure that there is no impact on the user's Internet access, and the performance consumption of the user-side equipment used is low, thereby ensuring the accuracy of the collected data.

[0185] By using the data collected by the embodiments of this application, wired broadband quality issues can be analyzed and anomalies can be discovered. The accuracy of detecting problematic network elements and websites is high, and the difference is small compared to the results of data analysis collected by monitoring methods. Furthermore, accurate data can be collected to evaluate the quality of home broadband services, identify abnormal websites or network elements in the end-to-end network system, and effectively improve the quality of home broadband networks and services.

[0186] The dialing test solution on the user-side device proposed in the embodiment of the present application, compared with user Internet monitoring, can collect a large amount of indicator data that can reflect the quality of user Internet access for a long time and very effectively. It is low-cost and can also improve the utilization rate of existing terminal-side equipment.

[0187] Figure 8 Schematic diagram of the structure of the dialing device provided in the embodiment of the present application. Figure 8 As shown, the dialing device includes:

[0188] The determining unit 801 is configured to determine a dialing test task based on a pre-defined dialing test strategy.

[0189] In some implementations, the apparatus further includes: a processing unit 802; the processing unit 802 is configured to send the dialing task to the test terminal according to first information of the test terminal, where the first information indicates status information of the test terminal.

[0190] In some implementations, before and during a test, the terminal may report its own status at any time to support remote or manual control of the test process and adjustment of the dialing test strategy.

[0191] In some implementations, the processing unit 802 is configured to set at least a test area, a dial test sampling frequency, and a total number of dial tests in the dial test task, so as to achieve effective and uniform coverage of the tested network elements.

[0192] In some implementations, the processing unit 802 is configured to determine network area information required to be covered by the dialing test task, and determine the number of test terminals to be deployed and the minimum sampling frequency of the test terminals based on topology information within the network area.

[0193] In some embodiments, the processing unit 802 is used to select terminals that meet the dialing conditions based on the dialing terminal status, and establish a network element hierarchical relationship through multi-level topology modeling. Based on the minimum dialing number benchmark value of the most remote network element node, combined with a preset inter-level proportional coefficient, the required dialing number of each level of topology / network element is derived from the bottom up. The system can implement dynamic monitoring. When the dialing sample volume of a certain level does not reach the minimum coverage threshold of the corresponding topological unit, it automatically triggers a supplementary dialing task and issues an incremental dialing instruction to the dialing terminal under the topological path. This iterative process continues until the dialing coverage density of each level of the topological structure is verified by feedback of the dialing results to meet the requirements of both the vertical proportional relationship and the horizontal uniform distribution, thereby ensuring that the network quality assessment is statistically valid.

[0194] In some implementations, the dial test strategy includes one or more of the following: a test area, a dial test sampling frequency, and a total number of dial tests; wherein the test area includes a website, a service platform, a wireless base station, multi-level network elements, and a test terminal.

[0195] In some implementations, the apparatus further includes an acquisition unit 803 ; the acquisition unit 803 is configured to acquire a dialing test requirement.

[0196] In some embodiments, the acquisition unit 803 is used to obtain one or more of the following: obtaining the address information of the website and / or the identification information of the website and / or the dialing sampling frequency of the website; obtaining the address information of the service platform and / or the identification information of the service platform and / or the dialing sampling frequency of the service platform; obtaining the address information of the wireless base station and / or the identification information of the wireless base station and / or the dialing sampling frequency of the wireless base station; obtaining the address information of the multi-level network element and / or the identification information of the multi-level network element and / or the dialing sampling frequency of the multi-level network element; obtaining the address information of the test terminal and / or the identification information of the test terminal and / or the dialing sampling frequency of the test terminal and / or the power of the test terminal and / or the terminal system resource occupancy rate of the test terminal.

[0197] In some implementations, the dialing test requirement includes one or more of the following: the dialing test requirement of the website, the dialing test requirement of the service platform, the dialing test requirement of the wireless base station, the dialing test requirement of the multi-level network element, and the dialing test requirement of the test terminal.

[0198] In some implementations, the determining unit 801 is configured to determine the dialing test strategy according to the dialing test requirement.

[0199] In some embodiments, the dialing test requirement of the website includes the dialing test sampling frequency of the website; the dialing test requirement of the service platform includes the dialing test sampling frequency of the service platform; the dialing test requirement of the wireless base station includes the dialing test sampling frequency of the wireless base station; the dialing test requirement of the multi-level network element includes the dialing test sampling frequency of the multi-level network element; the dialing test requirement of the test terminal includes the dialing test sampling frequency of the test terminal; wherein, when the dialing test sampling frequency is set to meet the dialing test coverage and uniformity requirements, the dialing test frequency of a single test terminal is reduced.

[0200] In some embodiments, the determination unit 801 is used to determine at least one or more of the following based on the dialing test requirements: a test area, the dialing test area refers to a designated area of the mobile communication network and / or a dialing test object within the designated area; a dialing test sampling frequency, the dialing test sampling frequency includes one or more of the following: the dialing test sampling frequency of the website, the dialing test sampling frequency of the service platform, the dialing test sampling frequency of the wireless base station, the dialing test sampling frequency of the multi-level network element, and the dialing test sampling frequency of the test terminal; the total number of dialing tests, the total number of dialing tests is determined based on the dialing test sampling frequency.

[0201] In some embodiments, the test terminal is capable of reporting identification information of the wireless base station; the acquisition unit 803 is used to obtain the identification information of the wireless base station reported by the terminal; the processing unit 802 is used to formulate the dialing test strategy based on the identification information of the wireless base station, wherein the dialing test tasks arranged according to the dialing test strategy evenly cover the wireless base stations that need to be dialed.

[0202] In some implementations, the dialing frequency of a single test terminal is reduced while meeting the dialing coverage and uniformity requirements.

[0203] In some implementations, the dialing test strategy further includes a dialing test address; the acquiring unit 803 is configured to acquire address information of a test area; and the determining unit 801 is configured to determine the dialing test address according to the address information of the test area.

[0204] In some implementations, the dial testing apparatus further includes: an updating unit 804; the updating unit 804 is configured to update the dial testing strategy according to the updated dial testing requirement if the dial testing requirement is updated.

[0205] Those skilled in the art should understand that Figure 8 The functions implemented by each unit in the dialing and testing device shown can be understood by referring to the relevant description of the aforementioned method. Figure 8 The functions of the various units in the dialing and testing device shown can be implemented by a program running on a processor, or by a specific logic circuit.

[0206] Figure 9 1 is a schematic structural diagram of a dialing and testing device 900 provided in an embodiment of the present application. Figure 9 The dialing device 900 shown includes a processor 910, which can call and run a computer program from a memory to implement the method in the embodiment of the present application.

[0207] Alternatively, as Figure 9 As shown, the dialing and testing device 900 may further include a memory 920. The processor 910 may call and execute a computer program from the memory 920 to implement the method in the embodiment of the present application.

[0208] The memory 920 may be a separate device independent of the processor 910 , or may be integrated into the processor 910 .

[0209] Alternatively, as Figure 9 As shown, the dialing device 900 may further include a transceiver 930 , and the processor 910 may control the transceiver 930 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices.

[0210] The transceiver 930 may include a transmitter and a receiver. The transceiver 930 may further include an antenna, and the number of antennas may be one or more.

[0211] The dialing test device 900 can implement the corresponding processes implemented by the dialing test apparatus in each method of the embodiments of the present application, and for the sake of brevity, they are not described here in detail.

[0212] Figure 10 It is a schematic structural diagram of the chip of an embodiment of the present application. Figure 10 The chip 1000 shown includes a processor 1010, which can call and run a computer program from a memory to implement the method in the embodiment of the present application.

[0213] Alternatively, as Figure 10 As shown, the chip 1000 may further include a memory 1020. The processor 1010 may call and execute a computer program from the memory 1020 to implement the method in the embodiment of the present application.

[0214] The memory 1020 may be a separate device independent of the processor 1010 , or may be integrated into the processor 1010 .

[0215] Optionally, the chip 1000 may further include an input interface 1030. The processor 1010 may control the input interface 1030 to communicate with other devices or chips, and specifically, may obtain information or data sent by other devices or chips.

[0216] Optionally, the chip 1000 may further include an output interface 1040. The processor 1010 may control the output interface 1040 to communicate with other devices or chips, and specifically, may output information or data to other devices or chips.

[0217] The chip can implement the corresponding processes implemented by the dialing and testing device in each method of the embodiments of the present application. For the sake of brevity, they will not be described here in detail.

[0218] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0219] It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiment can be completed by hardware integrated logic circuits in the processor or software instructions. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly implemented as a hardware decoding processor, or can be implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0220] It is understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0221] It should be understood that the above-mentioned memories are exemplary but not restrictive. For example, the memories in the embodiments of the present application may also be static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM RAM (DR RAM), etc. In other words, the memories in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0222] An embodiment of the present application also provides a computer program product, including a computer program.

[0223] When the computer program is executed by the processor, the corresponding processes implemented by the dialing device in each method of the embodiment of the present application are implemented. For the sake of brevity, they are not described here in detail.

[0224] An embodiment of the present application also provides a computer-readable storage medium for storing a computer program.

[0225] The computer program enables the computer to execute the corresponding processes implemented by the dialing and testing device in each method of the embodiments of the present application, which will not be described in detail here for the sake of brevity.

[0226] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0227] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0228] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0229] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0230] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0231] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0232] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A dialing test method, characterized in that: The method comprises: Determine the dialing test tasks based on the pre-defined dialing test strategy.

2. The method according to claim 1, characterized in that The method further comprises: The dialing test task is sent to the test terminal according to first information of the test terminal, where the first information indicates status information of the test terminal.

3. The method according to claim 2, characterized in that Before and during the test, the terminal can report its own status at any time to support remote or manual control of the test process and adjustment of the dialing test strategy.

4. The method according to claim 2, characterized in that The method further comprises: In the dial test task, at least the test area, dial test sampling frequency, and total number of dial tests are set to achieve effective and uniform coverage of the tested network elements.

5. The method according to claim 2, characterized in that The method further comprises: Terminals that meet the dial test conditions are selected based on the status of the dial test terminals, and the network element hierarchical relationship is established through multi-level topology modeling. Based on the minimum dial test number benchmark value of the most remote network element node and combined with the preset inter-level proportional coefficient, the required dial test number for each level of topology / network element is derived from the bottom up. The system can implement dynamic monitoring. When the dial test sample volume at a certain level does not reach the minimum coverage threshold of the corresponding topological unit, the supplementary dial test task is automatically triggered, and incremental dial test instructions are issued to the dial test terminals under the topological path. This iterative process continues until the dial test result feedback verifies that the dial test coverage density of each level of the topological structure meets both the vertical proportional relationship and the horizontal uniform distribution requirements, ensuring the statistical validity of the network quality assessment.

6. The method according to claim 1, characterized in that The dial test strategy includes one or more of the following: test area, dial test sampling frequency and total number of dial tests; wherein the test area includes a website, a service platform, a wireless base station, multi-level network elements and a test terminal.

7. The method according to claim 6, characterized in that The method further includes: obtaining a dial test requirement; The acquisition of dial testing requirements may include one or more of the following: Obtaining the address information of the website and / or the identification information of the website and / or the dialing sampling frequency of the website; Acquiring the address information of the service platform and / or the identification information of the service platform and / or the dialing sampling frequency of the service platform; Acquiring the address information of the wireless base station and / or the identification information of the wireless base station and / or the dialing test sampling frequency of the wireless base station; Acquire the address information of the multi-level network element and / or the identification information of the multi-level network element and / or the dial test sampling frequency of the multi-level network element; Acquire the address information of the test terminal and / or the identification information of the test terminal and / or the dialing sampling frequency of the test terminal and / or the power of the test terminal and / or the terminal system resource occupancy rate of the test terminal.

8. The method according to claim 7, characterized in that The dial test requirement includes one or more of the following: the dial test requirement of the website, the dial test requirement of the service platform, the dial test requirement of the wireless base station, the dial test requirement of the multi-level network element, and the dial test requirement of the test terminal; The method further comprises: The dial testing strategy is determined according to the dial testing requirement.

9. The method according to claim 8, characterized in that The dial test requirements of the website include the dial test sampling frequency of the website; The dial test requirements of the service platform include the dial test sampling frequency of the service platform; The dial test requirement of the wireless base station includes the dial test sampling frequency of the wireless base station; The dial test requirements of the multi-level network elements include the dial test sampling frequency of the multi-level network elements; The dial test requirement of the test terminal includes the dial test sampling frequency of the test terminal; Among them, when the dial test sampling frequency is set to meet the dial test coverage and uniformity requirements, the dial test frequency of a single test terminal is reduced.

10. The method according to claim 9, characterized in that The determining the dial testing strategy according to the dial testing requirement includes: Determine at least one or more of the following based on the dial test requirements: A test area, wherein the test area refers to a designated area of a mobile communication network and / or a test object within the designated area; The dial test sampling frequency includes one or more of the following: the dial test sampling frequency of the website, the dial test sampling frequency of the service platform, the dial test sampling frequency of the wireless base station, the dial test sampling frequency of the multi-level network element, and the dial test sampling frequency of the test terminal; The total number of dial tests is determined based on the dial test sampling frequency.

11. The method according to claim 2, characterized in that The test terminal is capable of reporting identification information of the wireless base station; the method further includes: The identification information of the wireless base station reported by the terminal is obtained, and the dialing test strategy is formulated according to the identification information of the wireless base station, wherein the dialing test tasks arranged according to the dialing test strategy evenly cover the wireless base stations that need to be dialed.

12. The method according to claim 1, characterized in that The method further comprises: On the basis of meeting the dial test coverage and uniformity requirements, reduce the dial test frequency of a single test terminal.

13. The method according to claim 8, characterized in that The dial test strategy also includes a dial test address; The obtaining of the dial test requirement includes: obtaining address information of the test area; The determining the dial test strategy according to the dial test requirement includes: determining a dial test address according to address information of the test area.

14. The method according to any one of claims 8 to 14, characterized in that The method further comprises: If the dial test requirement is updated, the dial test strategy is updated according to the updated dial test requirement.

15. A dialing device, characterized in that: The device comprises: The determination unit is used to determine the dialing test task based on a pre-defined dialing test strategy.

16. A dial testing device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 14.

17. A computer program product, characterized in that include: A computer program which, when executed by a processor, implements the method according to any one of claims 1 to 14.

18. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 14.

Images