End-to-end service quality test method, device, equipment, medium and product

Abstract

The invention discloses an end-to-end service quality test method and device, equipment, a medium and a product. A platform side screens test access point configuration and test rules according to acquired target customer information; generating a test task containing a test case according to the test rule; and issuing the test task to a test terminal connected with the to-be-tested Internet of Things card in the access point configuration for quality test. According to the scheme, testing is carried out through the testing platform before the Internet of Things card is online, and the testing effect and efficiency are improved.

Description

Technical Field

[0001] This invention relates to the field of Internet of Things (IoT) technology, and more specifically, to an end-to-end service quality testing method, apparatus, equipment, medium, and product. Background Technology

[0002] IoT device access service providers typically offer various IoT SIM cards for use with different types of IoT devices. To promptly assess the availability of these IoT SIM cards in different regions and the user experience, it is necessary to test the service quality of these SIM cards.

[0003] Existing physical network interface card (NIC) service quality testing targets the lifecycle of a single IoT NIC. This requires deep integration with operators, waiting for account ID feedback to detect problems, and testing is conducted when users use the IoT NIC. Furthermore, there is no unified testing platform, making resource integration impossible and resulting in low testing effectiveness and efficiency. Summary of the Invention

[0004] To address the aforementioned issues, this invention proposes an end-to-end service quality testing method, apparatus, equipment, medium, and product. By using a testing platform to conduct tests on IoT cards before they go online, the testing effectiveness and efficiency are improved.

[0005] This invention provides an end-to-end service quality testing method, applied to the platform side, the method comprising: The access point configuration and test rules for the test are selected based on the obtained target customer information; Generate a test task containing test cases based on the test rules; The test task is sent to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

[0006] Preferably, the method further includes: The access point configuration data is obtained through polling. When the test task is idle, clear the interference items and switch back to the access point of the test server; Upon receiving a test task, a new access point is added according to the test rules corresponding to the test task.

[0007] Preferably, the process of obtaining access point configuration data specifically includes: The access point of the IoT card under test is determined by using the generic resource identifier index to locate the resource and obtain the access point configuration data.

[0008] Preferably, the method further includes: The system receives test logs from the test terminal and generates a test report.

[0009] Preferably, the method further includes: Based on the test logs, monitor the execution of quality tests in real time; When a critical condition is detected, an alarm will be output.

[0010] Preferably, the test task includes different test cases that support multi-threaded or multi-process execution.

[0011] This invention also provides an end-to-end service quality testing method, applied to a test terminal, the method comprising: Receive test tasks issued by the platform. Quality testing is performed on the simulated business operations of the IoT SIM card under test based on the test task, and the test results are obtained.

[0012] Preferably, before performing quality testing on the service operations of the IoT SIM card under test that are simulated according to the test task, the method further includes: Register the account opening information of the IoT card to be tested to the platform side; Mobility management is performed on the IoT card under test.

[0013] Preferably, the mobility management of the IoT card under test includes: After powering on, the test terminal is attached to a preset packet data network using AT command set commands; After successful attachment, the access point identifier of the packet data network is detected, other access points are deleted, and the test terminal is kept to send and receive data using only one access point identifier.

[0014] Preferably, the quality test includes one or more of the following: activity test, blacklist / whitelist test, uplink / downlink rate test, application-specific test, connectivity test, voice-directed test, and SMS test.

[0015] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: Based on the service data transmitted from the server, the network service actions are controlled using AT command sets to test whether the network is abnormally shut down, and the test result is used as the test result.

[0016] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: The blacklist and whitelist are mapped to URLs or IP ports and data packets through a mapping table. The module is used as a network card to test whether the blacklist and whitelist pass and to verify the response latency of the AT+HTTPACTION command. The test results are used as the test results.

[0017] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: The test application initiates a URL request or opens a third-party application to obtain the responding peer's IP address, port, and L4Protocol transport protocol, which serves as the test result.

[0018] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: The AT+CPING command was used to ping the target address with different parameters to test network connectivity and speed under different packet data networks, and the test results were used as the test results.

[0019] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: Use ATD commands to set up outbound data calls, control supplementary services, and check whether a specified call is connected, as the test result.

[0020] Preferably, the step of performing quality testing based on the simulated service operations of the IoT SIM card under test according to the test task, and obtaining test results, includes: Using the AT+CMGS and AT+CMGF commands, specifying the use of text mode to send the SMS center number and the sending number, the destination address, address value field, and number in string format are converted into characters of the currently selected TE character set, and the converted characters are read as the test result.

[0021] Preferably, the method further includes: The test results are then fed back to the platform.

[0022] Another embodiment of the present invention provides an end-to-end service quality testing device, the device comprising: The filtering module is used to filter the access point configuration and test rules for testing based on the acquired target customer information; The generation module is used to generate test tasks containing test cases according to the test rules; The distribution module is used to distribute the test task to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

[0023] Another embodiment of the present invention provides an end-to-end service quality testing device, the device comprising: The receiving module is used to receive test tasks issued by the platform. The testing module is used to simulate the service operations of the connected IoT card under test according to the test task to perform quality tests and obtain test results.

[0024] This invention also provides a terminal device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the end-to-end service quality testing method as described in any of the above embodiments.

[0025] This invention also provides a computer-readable storage medium, which includes a stored computer program, wherein the computer program, when running, controls the device where the computer-readable storage medium is located to perform the end-to-end service quality testing method as described in any of the above embodiments.

[0026] This invention also provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the steps of any of the methods described above.

[0027] This invention provides an end-to-end service quality testing method, apparatus, equipment, medium, and product. The platform side filters the access point configuration and test rules based on acquired target customer information; generates test tasks containing test cases according to the test rules; and distributes the test tasks to the test terminals connected to the IoT cards to be tested in the access point configuration for quality testing. This application's solution improves testing effectiveness and efficiency by conducting tests on the IoT cards before they go online through a testing platform. Attached Figure Description

[0028] Figure 1 This is a flowchart illustrating the end-to-end service quality testing method provided in an embodiment of the present invention; Figure 2 This is a flowchart illustrating the platform-side execution function provided in the embodiments of the present invention; Figure 3 This is another flowchart illustrating the platform-side execution function provided in this embodiment of the invention; Figure 4 This is another flowchart illustrating the end-to-end service quality testing method provided in this embodiment of the invention; Figure 5 This is a schematic diagram of the structure of an end-to-end service quality testing device provided in an embodiment of the present invention; Figure 6 This is another structural schematic diagram of an end-to-end service quality testing device provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Detailed Implementation

[0029] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0030] Existing technologies target the lifecycle testing of a single IoT SIM card, requiring deep integration with operators, waiting for feedback from the account opening ID when problems are detected, conducting tests when users use the IoT SIM card, and lacking a unified testing system, thus failing to achieve resource integration.

[0031] To address the aforementioned technical issues, this paper provides an end-to-end service quality testing method, applied to the platform side. See [link / reference] Figure 1 This is a flowchart illustrating an end-to-end service quality testing method provided in an embodiment of the present invention. The method includes: Step S1: Filter the access point configuration and test rules for testing based on the obtained target customer information; Step S2: Generate a test task containing test cases according to the test rules; Step S3: The test task is sent to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

[0032] In this specific implementation, the core of this case lies in building an automated IoT SIM card quality testing system. By centrally managing the configuration of test access points and test rules on the platform side, efficient evaluation of IoT SIM card connection quality is achieved. The system dynamically generates test tasks based on customer needs and distributes them to terminals for execution, forming a closed-loop testing process of configuration, execution, and feedback.

[0033] The platform acquires target customer information, including customer ID, service type, and service level. It then filters and matches Access Point Configurations (APNs) and test rules based on preset policies. APNs include network parameters and authentication information. Test rules define test types, frequencies, and metric thresholds.

[0034] By parsing test rules, specific test cases are generated. Test case types can include: network connectivity, bandwidth testing, packet loss rate, latency, etc. A unique identifier and execution parameters are assigned to each test case. Test cases are then assembled to form a complete test task.

[0035] Test tasks are distributed to designated test terminals through the management channel. The test terminals execute the test tasks based on IoT cards, collect test data in real time and feed it back to the platform. The platform analyzes and stores the test results.

[0036] This application solution effectively addresses the challenges of scale and differentiation in IoT SIM card quality testing through platform-based management and distributed execution, providing strong support for the stable operation of IoT services. Automated testing processes reduce manual intervention, shorten testing cycles, and improve testing efficiency. Standardized testing rules ensure objective and comparable test results, enhancing accuracy. Centralized management can simultaneously support the testing needs of multiple customers and various scenarios. It provides a complete testing platform for conducting IoT SIM card testing before deployment, improving testing effectiveness and efficiency.

[0037] In another embodiment of the present invention, the IoT card testing platform also has dynamic management capabilities. Through polling mechanisms, environment cleanup, and dynamic configuration of access points, it ensures the stability of the testing environment and the accuracy of test results. An adaptive testing environment management system is constructed, which can automatically adjust network configuration according to the test task status, reduce external interference, and support diverse testing needs.

[0038] The access point configuration data is obtained by polling.

[0039] Specifically: The platform periodically polls access point configuration data, including APN parameters, network status, and terminal connection information; establishes a data comparison mechanism to detect abnormal changes in configuration parameters; and monitors access point load and availability in real time to provide a basis for test task allocation.

[0040] During off-peak hours of testing tasks, such as at night, the system automatically performs environment cleanup; it identifies and removes interfering items such as temporary files and cached data generated during the test, and switches the access point back to the default test server configuration to ensure environment consistency.

[0041] When a new test task is received, the test rules corresponding to the task are parsed; according to the rule requirements, such as specific network type and area coverage, a new access point is dynamically created; access point parameters, such as APN name, authentication method, and IP type, are configured, and the availability of the new access point is verified before it is included in the test environment.

[0042] To enable rapid testing in different business scenarios, this system automates APN data operations through polling. When business is idle, the system client clears interference items from the APN and switches back to an access point that can connect to the test server. Upon receiving a test task, it adds or switches to a new access point according to the test rules.

[0043] See Figure 2 This is a flowchart illustrating the platform-side execution functions provided in this embodiment of the invention. The system on the platform side specifically executes APN management and service quality testing functions.

[0044] APN management includes actions such as adding, modifying, deleting, and querying. Business quality testing utilizes command-line components for startup, AT execution, input / output stream reading, and data parsing. It can perform 24 / 7 testing on IoT cards across various industries, identifying quality issues across different IoT customers, testing targets, time periods, applications, and services, providing a comprehensive overview of business quality testing throughout the day.

[0045] In another embodiment of the present invention, the process of obtaining access point configuration data specifically includes: By using the ContentResolver class of the Android system to obtain an instance, the content URI index resource is used to locate the APN configuration under the IoT SIM card, and the data in the content URI management APN table is received.

[0046] A Universal Resource Identifier (URI) is used as the core indexing mechanism to achieve efficient location and retrieval of access point configuration data. The URI indexing mechanism transforms traditional multi-table join queries into single-key value queries, significantly shortening data retrieval time.

[0047] In another embodiment provided by the present invention, after the platform sends the test task to the test terminal, it also receives the test logs fed back by the test terminal and generates a test report output.

[0048] The client initiates a command-line tool component to create a local process control command, recording its input, output, and completion status. It reads the command execution results through input / output streams and acquires and parses the data. The server analyzes and processes the data collected from the tested application's page, such as the distribution of elements like buttons, text boxes, and images in the user interface.

[0049] See Figure 3 This is another flowchart illustrating the platform-side execution function provided in this embodiment of the invention. The IoT testing platform system, constituted by the platform side, allows users to log in to the testing platform, add customer information, and associate newly added APNs with customers. When configuring IoT testing rules, different APNs can be selected based on the customer. In task management, tasks can be generated according to the configured rules, and operations such as start, pause, and terminate can be performed. The test cases under the task match the configured rules. After the start time of the test case is reached, the server will automatically send the test task to the terminal for testing. The terminal returns the test results, and the server statistically summarizes and organizes the test results to generate a test report.

[0050] In the test results and test data backtracking phase, this solution provides an intuitive interface for easy observation of log output during test execution, real-time monitoring of element status, and rapid problem localization. This helps collect more debugging information during testing, thereby optimizing data analysis.

[0051] In another embodiment provided by the present invention, the platform side also monitors and alarms the test logs.

[0052] Specifically: Based on the test logs, monitor the execution of quality tests in real time; When a critical condition is detected, an alarm will be output.

[0053] The platform enables real-time monitoring of test execution and triggers alerts when critical issues are detected. It features logging capabilities, collecting detailed log information throughout the testing process, including server logs and device logs. Detailed analysis of test results is possible, including passed / failed test cases, errors, and exceptions, all of which can be recorded and analyzed to detect and identify testing problems.

[0054] In another embodiment of the present invention, the test task includes different test cases that support multi-threaded or multi-process execution.

[0055] In this specific implementation, the platform uses multi-threading or multi-processing to execute test cases in parallel, supporting cross-platform testing, running on different operating systems, and simultaneously calling different platform devices, such as Android phones, iOS phones, tablets, IoT devices, and dedicated devices, to achieve the goals of improving testing efficiency, enabling inter-device testing linkage, and enriching test scenarios.

[0056] Another embodiment of the present invention provides an end-to-end service quality testing method, applied to a test terminal, see [link to relevant documentation]. Figure 4 This is another flowchart illustrating the end-to-end service quality testing method provided in this embodiment of the invention. The method further includes: Step S401: Receive the test task issued by the platform side; Step S402: Perform quality testing on the simulated service operations of the IoT card under test according to the test task, and obtain the test results.

[0057] In this specific implementation, when conducting IoT card quality testing on the test terminal side, a deep verification of the IoT card connection quality is achieved by simulating real-world business scenarios. A terminal-level testing closed loop is constructed, encompassing instruction reception, scenario simulation, and result feedback: the test terminal, acting as the execution carrier, receives standardized test tasks from the platform side and reproduces the actual business operations of the IoT card under test, such as data transmission, status reporting, and instruction response. Quality assessment is completed by collecting key performance indicators. This ensures a high degree of consistency between the test scenario and actual business operations, avoiding test deviations between the laboratory environment and real-world scenarios; the test is executed directly on the terminal side, reducing interference from intermediate steps; and the standardized task format supports a unified testing process for multiple types of IoT cards.

[0058] In practice, the test task is first received and parsed: the test terminal receives the test task issued by the platform through an encrypted communication channel; the task content is parsed and key information is extracted; the legality of the task is verified to ensure that the source of the task is reliable.

[0059] Business scenario simulation and test execution: Activate the corresponding simulation module according to the task type. For example: for vehicle IoT cards: simulate real-time location data reporting, remote command response and other operations; for industrial IoT cards: simulate scenarios such as periodic uploading of device status and receiving control commands. Establish a connection with the target access point to simulate business interactions in a real network environment; collect test metrics in real time: network latency, data packet loss rate, connection establishment time, signal strength, etc. When a metric exceeds a threshold, an anomaly logging mechanism is triggered to save detailed context information; After the test is completed, the terminal preprocesses the raw data to generate a structured test report, which includes basic information and core metrics. The test results are then sent back to the platform via a secure channel, awaiting further instructions. In another embodiment of the present invention, an account registration and mobility management step is added before the IoT card quality test, constructing a pre-test assurance mechanism that includes identity authentication, network adaptation, and dynamic management. By completing the IoT card's identity registration and network parameter configuration before testing, it is ensured that the test terminal can simulate business operations in a real network environment, while supporting the switching management of IoT cards in different network scenarios, providing a standardized and traceable basic environment for subsequent quality testing.

[0060] The test terminal reads the unique identifier of the IoT card under test, collects basic account opening information such as card type, operator information, preset APN, and service level, and uploads the account opening information to the platform through an encrypted channel to complete identity registration. The platform generates a unique test file, associates the IoT card identifier with subsequent test data, and returns the initialization configuration parameters after registration is completed.

[0061] Configure mobility management policies based on the requirements of the testing task.

[0062] Before conducting quality testing, the test card must be attached to the network, and the account opening information must be registered with the network to manage the mobility of the account card. Registering the account opening information establishes a complete IoT card identity profile, facilitating the tracking of historical test data and supporting full lifecycle analysis of quality issues.

[0063] In another embodiment of the present invention, the process of performing mobility management specifically includes: In the Internet of Things (IoT), the AT command set can be used for communication module debugging, control, and equipment debugging. During UE power-on, the attach procedure is initiated, and AT commands are written to attach the MT (Mean Transmission Device) to the packet domain service. After successful MT attachment, to enable the end user to send and receive data normally, the PDN (Programmable Node Network) needs to be detected. The PDN connection is identified by the APN (Application Password Network) and needs to be associated with the UE's IP address. Since multiple bearers can be established for a PDN connection, to ensure clean and uncontaminated data, during IoT testing, the test app controls the UE to maintain only one APN. After switching APNs, the existing one is deleted, ensuring that data transmission and reception are performed by the switched APN during testing, providing a prerequisite for subsequent quality testing.

[0064] In another embodiment of the present invention, the quality test includes one or more of the following: activity test, blacklist / whitelist test, uplink / downlink speed test, application-specific test, connectivity test, voice-directed test, and SMS test.

[0065] In the specific implementation of this embodiment, quality testing involves simulating IoT card business operations across various industries and types via terminal simulation. This includes activity testing, blacklist / whitelist testing, uplink / downlink speed testing, application-specific testing, connectivity testing, voice-directed testing, and SMS testing. Alternatively, different scenario-based tests can be conducted by customizing the combination of various test types and test condition details according to the business characteristics of different customers.

[0066] In yet another embodiment of the present invention, the quality test of the service operation of the IoT card to be tested includes activity testing. The activity test uses the target IP, port, and data packets transmitted from the server to start the TCP / IP service or test whether the network is abnormally shut down. It uses AT+NETOPEN to open a UDP or TCP client socket connection, AT+CIPOPEN to send data, AT+CIPSEND to send data, and AT+CIPCLOSE to close the UDP or TCP client socket connection. Finally, it uses AT+NETCLOSE to stop the connection service and end the test.

[0067] In yet another embodiment of the present invention, the quality testing of the service operation of the IoT card to be tested includes blacklist and whitelist testing. The blacklist / whitelist test is conducted in the same way as the uplink / downlink speed test. The blacklist / whitelist test maps the blacklist / whitelist to URLs or IP ports and data packets through a mapping table, treating the module as a network card. Based on this, the blacklist / whitelist test is conducted to check whether the blacklist / whitelist passes. The uplink / downlink speed test verifies the latency from AT+HTTPACTION to a successful response.

[0068] In yet another embodiment of the present invention, the quality test of the service operation of the IoT card to be tested includes connectivity testing. Connectivity tests use the AT+CPING command with different parameters to ping the target address, testing network connectivity and speed under different APNs.

[0069] In yet another embodiment of the present invention, the quality test of the service operation of the IoT card to be tested includes voice orientation test; Voice orientation testing uses ATD commands to set up outbound data calls and control supplementary services to achieve the purpose of dialing a specified call. This command is usually terminated when an ATH command is received during execution, i.e., the call ends. However, the connection cannot be terminated in certain states of connection establishment (such as handshake).

[0070] In yet another embodiment of the present invention, the quality test of the service operation of the IoT card to be tested includes SMS testing. The SMS test sends SMS messages from the TE to the network using the AT+CMGS command. AT+CMGF specifies the text mode for sending, writes the SMS center number and the sender number, and converts the string formatted destination address, address value field, and number (or the GSM 7-bit default character set) into characters of the currently selected TE character set.

[0071] In another embodiment provided by the present invention, the method further includes: The test results are then fed back to the platform.

[0072] After the precondition testing and quality testing are completed, the device extracts the test results and automatically feeds them back to the server-side testing platform.

[0073] This application solution is flexible and efficient. Testers only need to write test cases, using pre-configured test rules and test scripts to simulate real user operations and business behaviors on IoT terminals (such as in-vehicle systems and other smart terminals). Specific test scenarios, test objectives, and expected test results are set, generating test cases. The entire process of test execution and pre-collection of test result data is automated, reducing manual intervention and ensuring efficient testing and data accuracy. It is highly scalable, allowing for expansion of test targets by easily replacing and inserting IoT cards into portable test devices. Rich, targeted scenario-based testing can be achieved through system-side condition settings, and rapid switching between test customers and targets can be achieved by sending card writing data from the system backend. It has broad coverage, enabling all-day testing of IoT cards across various industries. It can identify quality issues across different IoT customers, test targets, time periods, applications, and businesses, providing a comprehensive overview of business quality testing throughout the day.

[0074] The testing solution provided in this case allows for testing of IoT cards after testers input test cases. The testing process is encapsulated on the device terminal, requiring minimal involvement from testers and thus reducing costs and increasing efficiency. It can test all IoT cards already registered with operators, minimizing obstacles to market promotion and facilitating iterative optimization based on the needs of different manufacturers. Comprehensive, continuous testing of IoT card quality enables the detection of defects before product launch, reducing the cost of defect repair. Furthermore, test results can be used to incorporate defect prevention measures, contributing to product quality.

[0075] See Figure 5 This is a schematic diagram of an end-to-end service quality testing device provided in an embodiment of the present invention. The device includes: The filtering module is used to filter the access point configuration and test rules for testing based on the acquired target customer information; The generation module is used to generate test tasks containing test cases according to the test rules; The distribution module is used to distribute the test task to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

[0076] The end-to-end service quality testing device provided in this embodiment can execute all the steps and functions performed on the platform side in the end-to-end service quality testing method provided in any of the above embodiments. The specific functions of the device will not be described in detail here.

[0077] See Figure 6 This is another structural schematic diagram of an end-to-end service quality testing device provided in an embodiment of the present invention. The device includes: The receiving module is used to receive test tasks issued by the platform. The testing module is used to simulate the service operations of the connected IoT card under test according to the test task to perform quality tests and obtain test results.

[0078] The end-to-end service quality testing device provided in this embodiment can execute all the steps and functions performed on the test terminal side in the end-to-end service quality testing method provided in any of the above embodiments. The specific functions of the device will not be described in detail here.

[0079] See Figure 7 This is a schematic diagram of a terminal device provided in an embodiment of the present invention. The terminal device includes: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as an end-to-end service quality testing program. When the processor executes the computer program, it implements the steps in the various embodiments of the above-described end-to-end service quality testing method, for example... Figure 1 Steps S1~S3 shown or Figure 4The steps S401-S402 are shown. Alternatively, when the processor executes the computer program, it implements the functions of each module in the above-described device embodiments.

[0080] For example, the computer program can be divided into one or more modules, which are stored in the memory and executed by the processor to complete the present invention. The one or more modules can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program in the end-to-end service quality testing device. For example, the computer program can be divided into several modules, the specific functions of which have been described in detail in the end-to-end service quality testing method provided in any of the above embodiments; therefore, the specific functions of the device will not be repeated here.

[0081] The terminal device described can be a desktop computer, laptop, handheld computer, or cloud server, etc. The terminal device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that the schematic diagram is merely an example of a terminal device and does not constitute a limitation on an end-to-end service quality testing device. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the terminal device may also include input / output devices, network access devices, buses, etc.

[0082] The processor referred to can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. This processor is the control center of the end-to-end service quality testing device, connecting all parts of the device via various interfaces and lines.

[0083] The memory can be used to store the computer programs and / or modules. The processor implements various functions of the end-to-end service quality testing device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0084] If the modules integrated in the end-to-end service quality testing device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the above embodiments of the present invention can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0085] This invention also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the functional network element implementing the method described in the above embodiments.

[0086] The computer program product provided in this embodiment can execute all the steps and functions of the end-to-end service quality testing method provided in any of the above embodiments. The specific functions of the product will not be described in detail here.

[0087] It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this invention, and these improvements and modifications are also considered to be within the scope of protection of this invention.

Claims

1. An end-to-end service quality testing method, characterized in that, Applied to the platform side, the method includes: The access point configuration and test rules for the test are selected based on the obtained target customer information; Generate a test task containing test cases based on the test rules; The test task is sent to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

2. The end-to-end service quality testing method according to claim 1, characterized in that, The method further includes: The access point configuration data is obtained through polling. When the test task is idle, clear the interference items and switch back to the access point of the test server; Upon receiving a test task, a new access point is added according to the test rules corresponding to the test task.

3. The end-to-end service quality testing method according to claim 2, characterized in that, The process of obtaining access point configuration data specifically includes: The access point of the IoT card under test is determined by using the generic resource identifier index to locate the resource and obtain the access point configuration data.

4. The end-to-end service quality testing method according to claim 1, characterized in that, The method further includes: Receive test logs from the test terminal and generate a test report. Based on the test logs, monitor the execution of quality tests in real time; When a critical condition is detected, an alarm will be output.

5. The end-to-end service quality testing method according to claim 1, characterized in that, The test tasks include different test cases that support multi-threaded or multi-process execution.

6. An end-to-end service quality testing method, characterized in that, Applied to a test terminal, the method includes: Receive test tasks issued by the platform. Quality testing is performed on the simulated business operations of the IoT SIM card under test based on the test task, and the test results are obtained.

7. The end-to-end service quality testing method according to claim 6, characterized in that, Before performing quality testing on the simulated service operations of the IoT SIM card under test according to the test task, the method further includes: Register the account opening information of the IoT card to be tested to the platform side; Mobility management is performed on the IoT card under test; The mobility management of the IoT card under test includes: After powering on, the test terminal is attached to a preset packet data network using AT command set commands; After successful attachment, the access point identifier of the packet data network is detected, other access points are deleted, and the test terminal is kept to send and receive data using only one access point identifier.

8. The end-to-end service quality testing method according to claim 6, characterized in that, The quality tests include one or more of the following: activity testing, blacklist / whitelist testing, uplink / downlink speed testing, application-specific testing, connectivity testing, voice-directed testing, and SMS testing.

9. The end-to-end service quality testing method according to claim 6, characterized in that, The quality test is performed on the simulated service operation of the IoT SIM card under test according to the test task, and the test result includes any one of the following: Based on the service data transmitted from the server, the network service actions are controlled using AT command set commands to test whether the network is abnormally shut down, and the test result is used as the test result. The blacklist and whitelist are mapped to URLs or IP ports and data packets through a mapping table. The module is used as a network card to test whether the blacklist and whitelist pass and to verify the response latency of the AT+HTTPACTION command. The test results are used as the test results. The test application initiates a URL request or opens a third-party application to obtain the responding peer's IP address, port, and L4Protocol transport protocol, which serves as the test result. The AT+CPING command was used to ping the target address with different parameters to test network connectivity and speed under different packet data networks, and the test results were used as the test results. Use ATD commands to set up outbound data calls, control supplementary services, and detect whether a specified call is connected, as the test result. Using the AT+CMGS and AT+CMGF commands, the SMS center number and the sending number are sent in text mode. The destination address, address value field, and number in string format are converted into characters in the currently selected TE character set, and the converted characters are read as the test result.

10. The end-to-end service quality testing method according to claim 6, characterized in that, The method further includes: The test results are then fed back to the platform.

11. An end-to-end service quality testing device, characterized in that, The device includes: The filtering module is used to filter the access point configuration and test rules for testing based on the acquired target customer information; The generation module is used to generate test tasks containing test cases according to the test rules; The distribution module is used to distribute the test task to the test terminal connected to the IoT card to be tested in the access point configuration for quality testing.

12. An end-to-end service quality testing device, characterized in that, The device includes: The receiving module is used to receive test tasks issued by the platform. The testing module is used to simulate the service operations of the connected IoT card under test according to the test task to perform quality tests and obtain test results.

13. A terminal device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the end-to-end service quality testing method as described in any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the end-to-end service quality testing method as described in any one of claims 1 to 10.

15. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method described in any one of claims 1 to 10.

Images