Terminal testing methods, devices, and storage media based on black-box applications

Abstract

This application provides a terminal testing method, apparatus, and storage medium based on black-box applications, relating to the field of terminal testing technology. The method includes: upon detecting a test request from a terminal, identifying and analyzing the management request INFORM message reported by the terminal using an application-layer network management technology protocol of the black-box application to obtain at least one target test item requested by the terminal; managing the test process of the terminal using a task management technology protocol of the black-box application, creating a target test task for the terminal based on the at least one target test item, executing the target test task, and obtaining test results.

Description

Technical Field

[0001] This application relates to the field of terminal testing technology, and in particular to a terminal testing method, apparatus and storage medium based on black-box applications. Background Technology

[0002] With the rapid development of gigabit broadband services, the types of services and terminals are constantly being innovated, leading to a continuous increase in the procurement and network access of various terminals. Due to the large number of terminal types and suppliers, and the varying quality of versions, some terminals that do not meet the standards have been added to the network, causing various problems in the existing network and affecting the user experience of broadband customers.

[0003] The current terminal testing process is incomplete. From installation and network access testing to terminal network access testing, service delivery testing, and version upgrade testing, each is carried out independently. Each item requires a lot of manpower, material resources, and financial resources to conduct repetitive testing, resulting in low testing efficiency and the inability to achieve full-process control of the entire testing process.

[0004] The existing solution has the following problems: the terminal testing process is imperfect, the terminal testing efficiency is low, and the terminal testing process cannot be controlled. Summary of the Invention

[0005] This application provides a terminal testing method, apparatus, and storage medium based on black-box applications, which can solve the problems of imperfect terminal testing processes and the inability to control terminal testing processes.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] Firstly, this application provides a terminal testing method based on a black-box application. The method includes: upon detecting a test request from a terminal, identifying and analyzing the management request INFORM message reported by the terminal using the application layer network management technology protocol of the black-box application to obtain at least one target test item requested by the terminal; managing the terminal's test process using the task management technology protocol of the black-box application, creating a target test task for the terminal based on at least one target test item, executing the target test task, and obtaining test results. Based on the above technical solution, the terminal testing method based on a black-box application provided in this application, upon detecting a test request from a terminal, analyzes the management request INFORM message reported by the terminal using the application layer network management technology protocol encapsulated by the black-box application software. Based on the analysis results, it manages the terminal's test process using the task management technology protocol of the black-box application, automatically implementing the entire process from task creation and execution to finally obtaining test results, improving testing efficiency and achieving control over the entire terminal testing process.

[0008] In the first possible implementation of the first aspect, the management request INFORM message reported by the terminal is analyzed through the application layer network management technology protocol of the black box application, including: the application layer network management technology protocol of the black box application performs unified authentication on the online terminal.

[0009] In the second possible implementation of the first aspect, the terminal is managed through the task management technology protocol of the black-box application, including setting different test processes for the terminal using the task management technology protocol of the black-box application.

[0010] In the third possible implementation of the first aspect, a target test task is created for the terminal based on at least one target test item, and the target test task is executed to obtain test results, including: creating a target test task based on at least one target test item; waiting for the terminal to go online after the test task reaches the set test execution time; receiving the terminal's online message, and calling a predefined test script based on the target test task to automatically execute the target test task and output the target test results.

[0011] In the fourth possible implementation of the first aspect, before performing the identification operation on the management request INFORM message reported by the terminal through the black-box application when a terminal test request is detected, the method further includes: configuring parameters for the black-box application, wherein the parameter configuration includes: configuring the parameter name of the test item and configuring the parameter value of the test item; wherein the black-box application includes multiple test items, and each test item contains multiple default parameters.

[0012] Secondly, this application provides a terminal testing device based on black-box applications. The device includes an identification module, an analysis module, and a process management module. The identification module, upon detecting a test request from a terminal, identifies the management request INFORM message reported by the terminal using the application layer network management technology protocol of the black-box application. The analysis module analyzes the management request INFORM message reported by the terminal to obtain at least one target test item requested by the terminal. The process management module manages the test process for the terminal using the task management technology protocol of the black-box application, creates a target test task for the terminal based on the at least one target test item obtained by the identification and analysis module, executes the target test task, and obtains the test results.

[0013] In the first possible implementation of the second aspect, the analysis module is specifically used to perform unified authentication of the terminal through the application layer network management technology protocol of the black-box application.

[0014] In the second possible implementation of the second aspect, the management module is specifically used to provide a task management technology protocol for black-box applications to set different test processes for the terminal.

[0015] In the third possible implementation of the second aspect, the management module is specifically used to create a target test task based on at least one target test item; after the test task reaches the set test execution time, it waits for the terminal to go online; upon receiving the terminal's online message, it calls a predefined test script based on the target test task, automatically executes the target test task, and outputs the target test result.

[0016] In a fourth possible implementation of the second aspect, the apparatus further includes a configuration module. The configuration module is used to configure parameters for the black-box application, the parameter configuration including configuring the parameter names and parameter values ​​of the test items; wherein the black-box application includes multiple test items, and each test item contains multiple default parameters.

[0017] Thirdly, this application provides a terminal testing device based on black-box applications, the device comprising: a processor and a communication interface; the communication interface and the processor are coupled, the processor being used to run computer programs or instructions to implement the terminal testing method based on black-box applications as described in the first aspect and any possible implementation thereof.

[0018] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed on a terminal, cause the terminal to perform a terminal testing method based on a black-box application as described in the first aspect and any possible implementation thereof.

[0019] Fifthly, embodiments of this application provide a computer program product containing instructions that, when the computer program product is run on a terminal testing device based on a black-box application, cause the terminal testing device based on a black-box application to execute the terminal testing method based on a black-box application as described in the first aspect and any possible implementation thereof.

[0020] In a sixth aspect, embodiments of this application provide a chip, which includes a processor and a communication interface coupled to the processor. The processor is used to run computer programs or instructions to implement the terminal testing method based on black-box applications as described in the first aspect and any possible implementation thereof.

[0021] Specifically, the chip provided in this application embodiment also includes a memory for storing computer programs or instructions. Attached Figure Description

[0022] Figure 1 A flowchart illustrating a terminal testing method based on black-box applications provided in this application embodiment;

[0023] Figure 2A schematic diagram illustrating the interaction between a black-box application and an ACS application, provided as an embodiment of this application;

[0024] Figure 3 A schematic diagram illustrating the test item configuration for a black-box application provided in an embodiment of this application;

[0025] Figure 4 A schematic diagram of the structure of a terminal testing device based on black-box applications provided in an embodiment of this application;

[0026] Figure 5 This is a schematic diagram of another terminal testing device based on black-box applications provided in an embodiment of this application.

[0027] Figure 6 This is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0028] The following description, in conjunction with the accompanying drawings, details a terminal testing method, apparatus, and storage medium based on black-box applications provided in this application.

[0029] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0030] The terms "first" and "second," etc., used in the specification and drawings of this application are used to distinguish different objects or to distinguish different treatments of the same object, rather than to describe a specific order of objects.

[0031] Furthermore, the terms "comprising" and "having," and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0032] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0033] With the rapid development of gigabit broadband services by operators, the types of services and terminals are constantly innovating (such as FTTR, gigabit optical modems, smart routers, etc.), leading to a continuous increase in the procurement and network access of various terminals. Due to the large number of terminal types and suppliers, and the varying quality of versions, some non-compliant terminals have been added to the network, causing various problems and affecting the user experience of broadband customers. The following defects exist in the existing technology:

[0034] (1) The current terminal testing process is not perfect. There are some gaps in application scenarios such as terminal network access testing, problem retesting, sampling / submission testing, business configuration testing, and version upgrade testing. At the same time, there is no system to support and manage the smart home terminal testing process.

[0035] (2) In the past, information was mainly recorded and transmitted via email, which was not rigorous enough and could easily lead to risks such as leakage. At the same time, there was a lack of monitoring methods, making it impossible to make the entire testing process visible, manageable and controllable.

[0036] (3) Currently, the process of terminal installation and network access testing, terminal network access, service delivery, and version upgrade is carried out independently. Each item requires a lot of manpower, material resources, and financial resources to conduct repeated tests, which is inefficient.

[0037] (4) There is no strict review process and management mechanism for terminal version access and version upgrade. When a fault occurs, the response mechanism and source tracing mechanism are relatively weak. The entire process has not established a relatively complete testing, management and response mechanism.

[0038] To address the problems of incomplete terminal testing processes, low terminal testing efficiency, and lack of control over terminal testing processes in existing technologies, this application provides a terminal testing method based on black-box applications. Upon detecting a terminal's test request, the method uses the application-layer network management technology protocol of the black-box application to identify and analyze the management request INFORM message reported by the terminal, obtaining at least one target test item requested by the terminal. Then, using the task management technology protocol of the black-box application, the method manages the terminal's test process, creates target test tasks for the terminal based on at least one target test item, executes the target test tasks, and obtains the test results. Based on this method, upon detecting a terminal's test request, the black-box application software encapsulates the application-layer network management technology protocol to analyze the management request INFORM message reported by the terminal. Based on the analysis results, the black-box application's task management technology protocol manages the terminal's test process, automating the entire process from task creation and execution to final test result retrieval, thus improving testing efficiency and achieving control over the entire terminal testing process.

[0039] This application provides a terminal testing method based on black-box applications, applicable to various terminal testing scenarios such as terminal network access testing, retesting of existing network issues, random sampling / submission for testing, standardization testing, and version upgrades.

[0040] like Figure 1 The diagram shows a flowchart of a terminal testing method based on a black-box application provided in an embodiment of this application. The method includes the following steps S101 and S102:

[0041] Step S101: Upon detecting a test request from a terminal, the management request INFORM message reported by the terminal is identified and analyzed using the application layer network management technology protocol of the black-box application to obtain at least one target test item requested by the terminal.

[0042] Optionally, in this embodiment of the application, a black-box application refers to an application that, from the user's perspective, does not concern itself with the internal structure and principles of a product or application, but only with its functions and how to use those functions.

[0043] Optionally, in this embodiment of the application, the target test items include, but are not limited to, at least one of the following: service activation test items, fault diagnosis test items, local configuration test items, standardization test verification test items, and key data collection test items.

[0044] Optionally, in this embodiment, the application layer network management technology protocol, TR-069, whose full name is "CPE WAN Management Protocol," provides a general framework and protocol for managing and configuring home network devices in next-generation networks. It is used for remote centralized management of devices such as gateways, routers, and set-top boxes in the home network from the network side. It adopts a mature communication protocol and an open, object-oriented management information architecture, possessing strong flexibility and scalability, and can meet the device management and configuration needs of various remote users. As more and more devices, such as home gateways, support the CPE WAN Management Protocol, this protocol will inevitably replace various proprietary configuration protocols and become the mainstream configuration method for services above the IP layer. It adopts a mature communication protocol and an open, object-oriented management information architecture, possessing strong flexibility and scalability, and can meet the device management and configuration needs of various remote users.

[0045] For example, such as Figure 2 As shown, this embodiment of the application demonstrates the identification operation performed on the management request INFORM message reported by the terminal:

[0046] (1) Device startup; After establishing a secure HTTP connection based on the configured ACS address, each time a black-box application connects, it must first send an Inform RPC call request to the ACS to report the connection information. The ACS will return an Inform response as confirmation of the connection;

[0047] (2) After the ACS server receives the inform message sent by the black-box application, it will give an informresponse response and the CWMP connection will be successfully established.

[0048] (3) The device sends an empty message, indicating that there are no further requests;

[0049] (4) After receiving an empty message, the black-box application verifies the legality of the device based on the serial number carried in the empty message. If the verification is successful, the subsequent operation is performed. If the verification fails, a message is sent to indicate that the device is illegal.

[0050] (5) The ACS verifies the validity of the device serial number and sends a message requesting the device to report the network management account information;

[0051] (6) After receiving the message from the ACS server requesting the reporting of the account, the black-box application will send the account information configured on the device as the response to the request.

[0052] (7) After receiving the message, the ACS server verifies the legitimacy of the account information carried in the message. If the verification is successful, the subsequent operation is performed. If the verification fails, a message is sent to indicate that the account is invalid.

[0053] (8) The ACS verifies the account's legitimacy and sends a message requesting the device to download the configuration file from a specific URL;

[0054] (9) After receiving the message, the device configures itself according to the URL address in the message and automatically configures itself, and sends a success response message to the ACS server.

[0055] (10) The ACS server sends a message to test the black-box application according to the task scheduling configuration;

[0056] (11) After receiving the message, the black-box application obtains the upgrade file according to the URL address in the message and sends a response to the ACS server.

[0057] (12) The ACS server sends an empty message to end the process.

[0058] Optionally, in this embodiment of the application, the above step S101 can be implemented by the following step S101A.

[0059] Step S101A: The application layer network management technology protocol of the black box application performs unified authentication on the online terminals.

[0060] Optionally, in this embodiment, the application layer network management technology protocol of the black-box application is encapsulated as TR-069 messages in the CPE end to realize interaction with the terminal, and performs identification and analysis operations on the management request INFORM messages reported by the terminal. The CPE end calls the RPC method encapsulated by the TR-069 protocol of the TR-069 server through the WPMAIDL communication mechanism between the TR-069 message server and the CPE client to realize the unification of CPE terminal devices at the application software layer.

[0061] This application provides a terminal testing device based on a black-box application. When a test request from a terminal is detected, the device analyzes the management request INFORM message reported by the terminal by encapsulating the application layer network management technology protocol through black-box application software. Based on the analysis results, the device manages the terminal's test process through the task management technology protocol of the black-box application. The entire process, from task creation and execution to obtaining the test results, is implemented automatically, improving testing efficiency and achieving control over the entire terminal testing process.

[0062] Step S102: Through the task management technology protocol of black-box application, perform test process management on the terminal, create target test tasks for the terminal based on at least one target test item, execute the target test tasks, and obtain test results.

[0063] Optionally, in this embodiment of the application, the step S102 above, "managing the test process of the terminal through the task management technology protocol of the black box application", can be specifically implemented through the following step S102A.

[0064] Step S102A: The task management technology protocol of the black-box application sets different test processes for the terminal.

[0065] Optionally, in this embodiment, the black-box application will set different process controls depending on the test item. If the application test type is a network access test item, the test items can be customized to form a test set.

[0066] Optionally, in this embodiment of the application, when a test request from a terminal is detected, the management request INFORM message reported by the terminal is analyzed by encapsulating the application layer network management technology protocol through black-box application software. Based on the analysis results, the terminal is managed through the task management technology protocol of the black-box application. The entire process, from task creation and execution to finally obtaining the test results, is implemented automatically, which improves testing efficiency and realizes control over the entire terminal testing process.

[0067] Optionally, in this embodiment of the application, the step S102 above, "creating a target test task for the terminal based on at least one target test item, executing the target test task, and obtaining test results", can be specifically implemented through the following steps S102B-S102D.

[0068] Step S102B: Create a target test task based on the at least one target test item.

[0069] Step S102C: After the test task reaches the set test execution time, wait for the terminal to go online.

[0070] Step S102D: Receive the terminal's online message, and according to the target test task, call the predefined test script to automatically execute the target test task and output the target test results.

[0071] Optionally, in this embodiment, based on the target test results, a full analysis of the test data before the terminal's network access is performed. Detailed data is generated through all test items, including service delivery, remote operation, upgrade management, and decoupling management, and a poor-quality terminal identifier is formed, thereby selecting high-quality terminals and improving market competitiveness. This can also serve as a reference standard to guide broadband terminal procurement. A report is generated based on the target test results, establishing a poor-quality terminal database for existing problematic terminals. Then, service indicators are used to test the service execution effect after the terminals are connected to the network, providing service assurance for subsequent connections of existing problematic terminals. This improves customer service quality and user experience, and reduces customer complaint rates.

[0072] Optionally, in this embodiment of the application, before step S101 above, the terminal testing method based on black-box applications provided in this embodiment of the application further includes the following step S103.

[0073] Step S103: Configure parameters for the black-box application, including configuring the parameter name and parameter value of the test item.

[0074] In this embodiment of the application, the black-box application includes multiple test items, and each test item contains multiple default parameters.

[0075] Optionally, in this embodiment of the application, the black-box application includes multiple test items, including: configuration parameter test item, TR069 parameter test item, network remote operation test item, service operation test item, remote upgrade test item, device access function test item, device address function test item, device networking test item, and soft probe plugin adaptation test item, etc.

[0076] For example, such as Figure 3 As shown, each test item includes its own identifier and the identifier of its parent class, and can configure its own execution parameters and return parameters.

[0077] Optionally, in this embodiment, multiple test items are predefined in the black-box application, and each test item includes some basic default parameters. Without special customization by the user, the issued command can obtain the corresponding default parameters. It also supports custom addition of return parameter configurations; when the command returns, the corresponding configured return parameters will be obtained.

[0078] Optionally, in this embodiment of the application, a method for automated terminal testing is implemented by encapsulating automated task management and TR-069 message interaction with the terminal using black-box application software. This method automatically identifies the terminal's reported management request INFORM message by encapsulating TR-069 message technology, implements unified authentication management of the terminal using the TR-069 protocol, and automatically analyzes the terminal's INFORM message through the automated task management of the black-box application software. This method controls the process for terminal device standardization testing, version upgrade testing, and service delivery testing tasks, providing end-to-end task control from application, review, execution, and results.

[0079] Optionally, in this embodiment of the application, before step S101 above, the terminal testing method based on black-box applications provided in this embodiment of the application further includes the following steps S104-S106.

[0080] Step S104: Terminal manufacturers under the provincial / municipal branch need to apply for terminal network access testing. They need to fill in the basic equipment information and submit the application during the review process.

[0081] Step S105: The provincial / municipal branch company reviews the application requirements submitted by the terminal manufacturer; selects the test items that need to be tested.

[0082] Step S106: For scenarios where terminal manufacturers may repeatedly test certain test items, the network department's review is configured as a configurable node to allow terminal manufacturers to review the information. After the terminal manufacturers complete the review, the task status changes from pending to completed.

[0083] Optionally, in this embodiment of the application, after step S102 above, the terminal testing method based on black-box applications provided in this embodiment of the application further includes the following step S107.

[0084] Step S107: The black-box application can repeatedly test the terminal for the test items that fail.

[0085] Optionally, in this embodiment of the application, for test items that fail to execute, the test items that fail to execute are rewritten, tested again, and the test results are statistically analyzed, and the information of the test items that fail is analyzed.

[0086] This application provides a terminal testing method based on black-box applications. Upon detecting a test request from a terminal, the method uses the application-layer network management technology protocol of the black-box application to identify and analyze the management request INFORM message reported by the terminal, obtaining at least one target test item requested by the terminal. Then, using the task management technology protocol of the black-box application, the method manages the terminal's test process, creates target test tasks for the terminal based on at least one target test item, executes the target test tasks, and obtains the test results. Based on this method, upon detecting a terminal's test request, the black-box application software encapsulates the application-layer network management technology protocol to analyze the management request INFORM message reported by the terminal. Based on the analysis results, the black-box application's task management technology protocol manages the terminal's test process, automating the entire process from task creation and execution to obtaining the final test results. This improves testing efficiency and achieves control over the entire terminal testing process.

[0087] Optionally, in this embodiment, the black-box application uses the Java programming language, and the development environment is deployed based on JDK 1.8 and a Maven-based code build tool. As an Apache open-source project, Maven primarily serves project building, dependency management, and project information management on the Java platform. The registry center uses ZooKeeper: a distributed, open-source distributed application coordination service that provides consistency services for distributed applications, facilitating configuration maintenance, domain name services, distributed synchronization, group services, etc. The distributed service framework uses Dubbo: application services are built according to a layered architecture, allowing for decoupling (or maximizing loose coupling) between layers. It operates according to the principle of providers offering services and consumers consuming services. The logging framework uses log4j2: used for log monitoring, management, classification, and other processing. The message middleware uses RocketMQ: a low-latency, high-concurrency, high-availability, and highly reliable distributed message middleware that supports cluster mode, consumer load balancing, horizontal scaling, and broadcast mode. The database uses an Oracle cluster: good system portability, ease of use, and powerful functionality, suitable for various large, medium, and small microcomputer environments. It is a highly efficient, reliable database solution adapted to high throughput. The persistence layer uses the Spring JDBC persistence framework. The overall framework is Spring + Vue + JDBC + Oracle + Dubbo. Spring's IOC container and AOP (Aspect-Oriented Programming) reduce code coupling and improve reusability. It also simplifies the use of Java EE APIs, making code inspection and maintenance easier. The front-end is developed using Vue, achieving separation between the back-end and front-end. Vue's MVVM pattern greatly simplifies development and view operations, making code testing and maintenance more convenient. JDBC integration is used to access the database. The database is Oracle, ensuring strong data availability, scalability, security, and stability. Dubbo is used to manage service registration and invocation based on the Zookeeper registry.

[0088] Optionally, in this embodiment, the black-box application achieves automated terminal test management by encapsulating automated task management and application-layer network management technology protocol messages to interact with the terminal. It integrates automated testing functions such as pre-configuration parameter testing, TR069 parameter testing, network remote operation testing, service operation testing, remote upgrade testing, device access function testing, device address function testing, device networking testing, and soft probe plugin adaptation testing, performing full-scale testing on the terminal before network access. All test items are manageable, controllable, and configurable. Through different testing processes, they are integrated into a single workflow, compressing all terminal testing tasks into the terminal network access testing items. Review process management: The terminal manufacturer initiates an automated testing application, the network department or marketing department reviews the test set, and testers execute the tests, making the testing system process-oriented and standardized. Automatic test task creation: Based on the application content, business work orders and test tasks are automatically created during test execution. Test result analysis: Test reports are generated based on the test set. Statistical analysis is performed on the test results, and information on failed test items is analyzed. By strengthening support mechanisms through audit process management, automated test task creation management, and full-scale testing system management, an automated terminal testing process system is constructed. Audit Process Control: Automated Creation and Execution of Test Tasks: After the audit process system is created, task work orders, task information, tasks are automatically created, and task test reports are automatically generated. All processes are executed automatically. Building Automated Terminal Testing: A management system for all test items before terminal network access is built. Through automated testing, a single process completes full-scale testing before terminal network access and generates test reports, providing detailed reports on terminal test information and analyzing terminal test data.

[0089] Optionally, in this embodiment, process control is implemented for terminal equipment standardization testing, version upgrade testing, and service distribution testing tasks, with end-to-end task control throughout the entire process from application, review, and execution. In particular, the optical modem terminal network access testing part solves the problems of cumbersome manual testing process, long time consumption, and inaccurate resource matching, further improving the quality and efficiency of terminal network access. It provides a guarantee for the high-quality broadband service development of Guangdong Unicom. (1) Automated testing - efficiency improvement: Through automatic network access testing of broadband terminals, test sets are selected, service work orders are automatically created, test tasks are automatically created, and test result reports are generated after the test tasks are executed. The entire process takes less than 2 hours to complete the test, whereas the previous test cycle took 1 to 3 weeks to complete, greatly improving the testing efficiency. (2) Process-oriented approval - basis for network access: The test process is initiated by the marketing department, reviewed by the network department, and executed by testers. The entire test process is manageable and controllable, making the entire test process process-oriented and standardized. After the test is completed, a full and detailed test report is generated, providing a reliable basis for the formal network access of the terminal. (3) Intelligent Assessment - Safeguarding the Market: Based on test report data, a full analysis of pre-network test data is conducted. Detailed data is generated through all test items, including service delivery, remote operation, upgrade management, and decoupling management, and a defective terminal identifier is formed, thereby screening out high-quality terminals and enhancing market competitiveness. It can also serve as a reference standard to guide broadband terminal procurement. (4) Service Quality Assessment - Ensuring Service Quality: Based on test result reports, a defective terminal database is established for existing problematic terminals. Service indicators are then used to assess the service performance of terminals after network access, providing service assurance for subsequent network access of existing problematic terminals. This aims to improve customer service quality and user experience, and reduce customer complaint rates.

[0090] Optionally, in this embodiment, process control is implemented for terminal device standardization testing, version upgrade testing, and service delivery testing tasks, with end-to-end task control throughout the entire process from application, review, and execution. In particular, the optical modem terminal network access testing part solves the problems of cumbersome manual testing processes, long processing times, and inaccurate resource matching, further improving the quality and efficiency of terminal network access.

[0091] This application embodiment can divide a terminal testing device based on a black-box application into functional modules or functional units according to the above method example. For example, each function can be divided into a separate functional module or functional unit, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module or functional unit. The module or unit division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0092] like Figure 4 The diagram shown is a structural schematic of a terminal testing device based on a black-box application provided in an embodiment of this application. The device includes: an identification module 41, an analysis module 42, and a management module 43.

[0093] The identification module 41 is used to identify the management request INFORM message reported by the terminal through the application layer network management technology protocol of the black box application when a test application is detected; the analysis module 42 is used to analyze the management request INFORM message reported by the terminal to obtain at least one target test item requested by the terminal; the management module 43 is used to manage the test process of the terminal through the task management technology protocol of the black box application, and create a target test task for the terminal based on the at least one target test item obtained by the identification and analysis module, execute the target test task, and obtain the test result.

[0094] This application provides a terminal testing device based on a black-box application. When a test request from a terminal is detected, the device analyzes the management request INFORM message reported by the terminal by encapsulating the application layer network management technology protocol through black-box application software. Based on the analysis results, the device manages the terminal's test process through the task management technology protocol of the black-box application. The entire process, from task creation and execution to obtaining the test results, is implemented automatically, improving testing efficiency and achieving control over the entire terminal testing process.

[0095] In one possible implementation, the analysis module 42 is specifically used to perform unified authentication of the terminal through the application layer network management technology protocol of the black-box application.

[0096] In one possible implementation, the management module 43 is specifically used for the task management technology protocol of the black-box application to set different test processes for the terminal.

[0097] In one possible implementation, the management module 43 is specifically used to create a target test task based on at least one target test item; after the test task reaches the set test execution time, it waits for the terminal to go online; upon receiving the terminal's online message, it calls a predefined test script based on the target test task, automatically executes the target test task, and outputs the target test results.

[0098] In one possible implementation, the device further includes a configuration module for configuring parameters of the black-box application, including configuring the parameter names and parameter values ​​of the test items; wherein the black-box application includes multiple test items, and each test item contains multiple default parameters.

[0099] When implemented in hardware, the identification module 41, analysis module 42, management module 43, and configuration module in this embodiment can be integrated onto the processor. Specific implementation methods are as follows: Figure 5 As shown.

[0100] Figure 5 This diagram illustrates another possible structural schematic of a black-box application-based terminal testing device involved in the above embodiments. This black-box application-based terminal testing device includes a processor 302 and a communication interface 303. The processor 302 is used to control and manage the operation of the black-box application-based terminal testing device, for example, executing the steps performed by the black-box application-based terminal testing device described above, and / or executing other processes of the technology described herein. The communication interface 303 is used to support communication between the black-box application-based terminal testing device and other network entities. The black-box application-based terminal testing device may further include a memory 301 and a bus 304. The memory 301 is used to store the program code and data of the black-box application-based terminal testing device.

[0101] The memory 301 can be a memory in a terminal testing device based on black-box applications, etc. The memory can include volatile memory, such as random access memory; the memory can also include non-volatile memory, such as read-only memory, flash memory, hard disk or solid-state drive; the memory can also include a combination of the above types of memory.

[0102] The processor 302 described above can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0103] Bus 304 can be an Extended Industry Standard Architecture (EISA) bus, etc. Bus 304 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 5 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0104] Figure 6This is a schematic diagram of the structure of chip 170 provided in an embodiment of this application. Chip 170 includes one or more (including two) processors 1710 and communication interfaces 1730.

[0105] Optionally, the chip 170 also includes a memory 1740, which may include read-only memory and random access memory, and provides operation instructions and data to the processor 1710. A portion of the memory 1740 may also include non-volatile random access memory (NVRAM).

[0106] In some implementations, memory 1740 stores elements such as execution modules or data structures, or subsets thereof, or extended sets thereof.

[0107] In this embodiment of the application, the corresponding operation is executed by calling the operation instructions stored in the memory 1740 (the operation instructions can be stored in the operating system).

[0108] The processor 1710 described above can implement or execute various exemplary logic blocks, units, and circuits described in conjunction with the disclosure of this application. The processor can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, units, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0109] The memory 1740 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk or solid-state drive; the memory may also include combinations of the above types of memory.

[0110] The Bus 1720 can be an Extended Industry Standard Architecture (EISA) bus, etc. The Bus 1720 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 6 The symbol is represented by only one line, but this does not mean that there is only one bus or one type of bus.

[0111] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0112] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to execute a terminal testing method based on a black-box application as described in the above method embodiments.

[0113] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform a terminal testing method based on a black-box application as shown in the method flow of the above-described method embodiments.

[0114] The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires; a portable computer disk drive; a hard disk drive; a random access memory (RAM); a read-only memory (ROM); an erasable programmable read-only memory (EPROM); a register; a hard disk drive; an optical fiber; a portable compact disk read-only memory (CD-ROM); an optical storage device; a magnetic storage device; or any suitable combination thereof; or any other form of computer-readable storage medium known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium may also be a component of the processor. The processor and the storage medium may reside in an application-specific integrated circuit (ASIC). In the embodiments of this application, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0115] Embodiments of the present invention provide a computer program product containing instructions that, when executed on a computer, cause the computer to perform a terminal testing method based on a black-box application as described in the above method embodiments.

[0116] Since the terminal testing device, computer-readable storage medium, and computer program product based on black-box application in the embodiments of the present invention can be applied to the above method, the technical effects obtained can also be referred to the above method embodiments, and the embodiments of the present invention will not be repeated here.

[0117] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0118] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0119] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0120] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A black box application based terminal testing method, characterized by, The method comprises: In the case of detecting the test application of the terminal, the management request INFORM message reported by the terminal is identified and analyzed through the application layer network management technology protocol of the black box application, at least one target test item for which the terminal applies for testing is obtained; wherein the application layer network management technology protocol of the black box application is used for unified authentication of the terminal online; The terminal is managed through the task management technology protocol of the black box application, and a target test task is created for the terminal based on the at least one target test item, and the target test task is executed to obtain a test result; wherein the task management technology protocol of the black box application is used for setting different test processes for the terminal.

2. The method of claim 1, wherein, The method based on the at least one target test item for creating a target test task for the terminal and executing the target test task to obtain a test result comprises: According to the at least one target test item, a target test task is created; After the test task reaches the set test execution time, the online message of the terminal is waited for; After receiving the online message of the terminal, a pre-defined test script is called according to the target test task, the target test task is automatically executed, and the target test result is output.

3. The method of claim 1, wherein, Before the method detects the test application of the terminal and identifies the management request INFORM message reported by the terminal through the black box application, the method further comprises: The parameters of the black box application are configured, and the parameter configuration comprises: configuring the parameter name of the test item and configuring the parameter value of the test item; wherein the black box application comprises a plurality of test items, and each test item comprises a plurality of default parameters.

4. A black-box application based terminal testing apparatus, characterized by, The device comprises an identification module, an analysis module and a management module. The identification module is configured to, in the case of detecting the test application of the terminal, identify the management request INFORM message reported by the terminal through the application layer network management technology protocol of the black box application. The analysis module is configured to analyze the management request INFORM message reported by the terminal to obtain at least one target test item for which the terminal applies for testing; wherein the analysis module is specifically configured to perform unified authentication of the terminal through the application layer network management technology protocol of the black box application. The management module is configured to manage the test process of the terminal through the task management technology protocol of the black box application, create a target test task for the terminal based on the at least one target test item obtained by the analysis module, and execute the target test task to obtain a test result; wherein the management module is specifically configured to set different test processes for the terminal through the task management technology protocol of the black box application.

5. The apparatus of claim 4, wherein, The management module is specifically configured to: According to the at least one target test item, a target test task is created; After the test task reaches the set test execution time, the online message of the terminal is waited for; After receiving the online message of the terminal, a pre-defined test script is called according to the target test task, the target test task is automatically executed, and the target test result is output.

6. The apparatus of claim 4, wherein, The device further comprises a configuration module: The configuration module is configured to configure parameters of the black-box application, and the parameter configuration includes: configuring parameter names of test items and configuring parameter values of the test items; wherein the black-box application includes a plurality of test items, and each test item contains a plurality of default parameters.

7. A black-box application based terminal testing apparatus, characterized by, Comprise: A processor and a communication interface; the communication interface and the processor are coupled, and the processor is configured to run a computer program or instructions to implement the terminal test method based on the black-box application as described in any one of claims 1-3.

8. A computer-readable storage medium having stored therein instructions, the computer-readable storage medium comprising: When a computer executes the instructions, the computer executes the terminal test method based on the black-box application as described in any one of claims 1-3.

Images