System for testing user equipment

Abstract

A system for testing a cellular device under test (DUT), the system comprising: a display (101) device for displaying a mirrored image of a screen of the cellular DUT; and a network emulator (103) configured to emulate a cellular network when communicating with the cellular DUT. The system further comprises a sequencer engine module (401a) comprising a graphical user automatic test interface configured to control the network emulator (103) and the cellular DUT, automatically execute a series of test commands on the cellular DUT, and automatically execute a user emulation script, the graphical user auto-test interface is displayed on the display (101) device together with a mirrored image of a screen of the cellular DUT. The system further includes a user simulation module (402b) configured to simulate a graphical user interface of the DUT by generating the user module script in accordance with the series of test commands. The system further comprises a data analysis module (402c) configured to generate display (101) data of measurements of the DUT on the display (101) device.

Description

Background Art

[0001] As the adoption of 5G technology and related use cases accelerates, ensuring seamless operation of user equipment (UE) and its synchronization with the state of the 5G network is critical. This task involves not only detecting problems, but also determining the root cause to provide a solid foundation for robust solutions. Traditional commands and interfaces can still be effective in tracking certain performance indicators. However, in order to fully understand system performance and application interactions, it is clear that there is a need to simulate real user experience.

[0002] In the current network design and analysis environment, professionals face a fragmented tool ecosystem that creates significant operational barriers. One portion of these tools is designed to automate the user interface and user experience, leveraging application programming interfaces (APIs) to perform tasks. Another portion is designed to automate measurement hardware and low-level DUT operations, relying heavily on graphical simulation techniques. These two different aspects follow different paths, operate on different principles, and rarely intersect.

[0003] Additionally, the data generated by these separate tools often lacks centralization, making correlation and analysis a complex task. The lack of seamless data integration hinders the ability to combine network events with user actions, creating gaps in understanding the full picture of system operations. As a result, the manual and time-consuming process of gathering necessary information from these disparate systems not only hinders productivity, but also prevents a comprehensive understanding of network design, testing, and analysis. Summary of the invention

[0004] According to one aspect of the inventive concept, a system for testing a cellular device under test (DUT) is provided, and the system includes: a display device for displaying a mirror image of a screen of the cellular DUT; and a network emulator configured to simulate a cellular network when communicating with the cellular DUT. The system further includes a sequencer engine module, the sequencer engine module including a graphical user automatic test interface, configured to control the network emulator and the cellular DUT, automatically run a series of test commands on the cellular DUT, and automatically run a user simulation script, the graphical user automatic test interface being displayed on the display device together with the mirror image of the screen of the cellular DUT. The system further includes a user simulation module, the user simulation module being configured to simulate a graphical user interface of the DUT by generating the user module script according to the series of test commands. The system further includes a data analysis module, the data analysis module being configured to generate display data of measurement results of the DUT on the display device.

[0005] The user simulation module can be configured to scan the mirror image of the screen of the DUT for a specified input pattern and selectively activate the specified input pattern on the DUT according to the user simulation script. The user simulation module can be further configured to scan the mirror image of the screen of the DUT to obtain a test result applied to the data analysis module.

[0006] The DUT may be an Android device controlled by the sequencer engine module or the user emulation module. Alternatively, the DUT is an IOS device controlled by the user emulation module.

[0007] The system may further include a test computer, the test computer including the display. The sequencer engine module, the user simulation module, and the data analysis module may be loaded in a memory of the test computer. Alternatively, the sequencer engine module may be loaded in a memory of the test computer, and the user simulation module and the data analysis module may be on a network server.

[0008] According to another aspect of the inventive concept, there is provided a non-transitory computer-readable medium having executable instructions stored thereon embodied in the computer-readable medium, the executable instructions causing the computer to perform steps of testing a cellular device under test (DUT) when executed by at least one processor of a computer, wherein the executable instructions include a sequencer engine module, a user simulation module, and a data analysis module. The sequencer engine module includes a graphical user automatic test interface, and when executed by the at least one processor, controls the network emulator and the cellular DUT, automatically runs a series of test commands on the cellular DUT, and automatically runs a user simulation script, the graphical user automatic test interface will be displayed on a display device together with a mirror image of a screen of the cellular DUT. The user simulation module, when executed by the at least one processor, simulates a graphical user interface of the DUT by generating the user simulation script according to the series of test commands. The data analysis module, when executed by the at least one processor, generates display data of measurement results of the DUT on the display device.

[0009] When the user simulation module is executed by the at least one processor, the mirror image of the screen of the DUT may be scanned for a specified input pattern, and the specified input pattern may be selectively activated on the DUT according to the user simulation script. When the user simulation module is executed by the at least one processor, the mirror image of the screen of the DUT may be further scanned to obtain a test result applied to the data analysis module.

[0010] The DUT may be an Android device controlled by the sequencer engine module or the user emulation module. Alternatively, the DUT is an IOS device controlled by the user emulation module. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other aspects and features of the present inventive concept will become apparent from the following detailed description with reference to the accompanying drawings, in which:

[0012] Figure 1 is a schematic diagram of a test setup according to an embodiment of the present inventive concept;

[0013] Figure 2 is a flow chart showing a configuration workflow according to an embodiment of the present inventive concept;

[0014] Figure 3 is a schematic diagram of a test setup according to an embodiment of the present inventive concept;

[0015] Figure 4 An example screenshot including a mirror image of a user equipment (UE) screen is shown;

[0016] Figure 5 Demonstrates an example test plan that simulates changes in network performance when the primary cell switches from LTE to 5G;

[0017] Figure 6 Shows an example of testing network speed;

[0018] Figure 7 Shows examples of scripts used in speed testing;

[0019] Figure 8 Examples of metrics obtained in a downlink speed test and an uplink speed test are shown;

[0020] Fig. 9 An example of test steps for activating a 5G cell is shown;

[0021] Fig.10 An example of a portion of a log associated with a cell configuration is shown;

[0022] Fig.11 An example of associating uplink speed and downlink speed with cell type is shown;

[0023] Fig.12 Examples showing correlation between UE IP address and network performance with various test operators; and

[0024] Fig.13is a diagram showing an overview of test operations performed during testing a UE according to an embodiment of the inventive concept. DETAILED DESCRIPTION

[0025] Emulating a real user experience requires a multifaceted approach that not only ensures smooth UE operation and network state synchronization, but also integrates aspects such as power consumption, spectrum efficiency, and interference into the test regime. In addition, by focusing on tracking only necessary metrics, processes can be optimized, noise can be reduced, and data can be made more manageable. Visualizing and analyzing these metrics can help us understand patterns, discover anomalies, and make informed decisions. At least some of the embodiments described herein are intended to bring all of these elements together to create a comprehensive solution that enhances the user experience and overall performance of 5G networks.

[0026] The present invention contemplates building a complete framework that takes full advantage of e.g. Test automation software, Eggplant solutions using intelligent automation (AI), and Measurement Analytics, each from Keysight Technologies. The inventive concept uniquely addresses a range of challenges in cellular network performance testing in an application-oriented domain context by combining various use case simulations, measurement automation, and data analytics into a centralized environment.

[0027] Figure 1 4 is a simplified schematic diagram of a test setup according to an embodiment of the present inventive concept. In general, the embodiment includes a network emulator 401 and a suite 402 of test software for testing user equipment (UE). As shown, the test suite includes a sequencer engine module 402a, a user simulation module 402b, and a data analysis module 402c.

[0028] Test automation software is an example of a sequencer engine module 401a. As will be described herein, the sequencer engine module 401a of at least some embodiments includes a graphical user automated test interface for display on a display device together with a mirrored image of a screen of the cellular DUT, and is configured to control a network emulator and a cellular DUT, automatically run a series of test commands on the cellular DUT, and automatically run a user simulation script.

[0029] Eggplant is an example of a user simulation module 402b. The user simulation module 402b of at least some embodiments is configured to simulate a graphical user interface of a DUT by generating a user simulation script from a series of test commands.

[0030] Measurement analysis is an example of data analysis module 402c. Data analysis module 402c according to at least some embodiments is configured to generate display data of measurement results of the DUT on a display device.

[0031] The following is a comprehensive guide provided by Keysight Technologies Test Automation, Eggplant, and The present invention is described in the context of an implementation of a measurement analysis toolset. However, it is emphasized that the present invention is not limited to the use of this particular toolset. Rather, the present invention encompasses other sequencer engine modules, other user simulation modules, and other data analysis modules configured as recited in the appended claims.

[0032] Before describing the embodiments, some key functionalities that can be implemented according to the present inventive concept are briefly discussed.

[0033] Unified platform for 5G application use case simulation: The present invention provides a one-stop platform where engineers can leverage network simulators, RF hardware, and sophisticated control of 5G cellular applications to launch different use case simulations, such as file transfer or streaming (e.g., ), video call( or ), network speed test This centralization simplifies the simulation process and increases its efficiency.

[0034] Automated User Experience Testing: The Eggplant toolset integration described in this article automates the testing of user interfaces and user experiences by replicating user behaviors and ensuring repeatable application interactions.

[0035] Automated measurement hardware and device control: used in the manner described in this article The present invention facilitates automated communication with measurement hardware and enables low-level control of the device under test by replacing the existing plug-in architecture for test automation.

[0036] Centralized Data Management: The framework of at least some embodiments directs all collected data from user experience testing, device under test automation, and measured hardware parameters to Centralized data sets within measurement analytics. This integration ensures easy access to data and maintains data integrity.

[0037] Comprehensive analytical capabilities: Using centralized data, the present invention provides comprehensive visualization of collected KPIs, enabling the identification of correlations between network events and user activities. This provides a comprehensive understanding of system performance.

[0038] Combination of measurement results: The inventive concept enables combining measurement results, thereby linking specific user activities to network performance. This comprehensive view can be helpful in optimizing the system.

[0039] Embodiments of the inventive concept will now be described.

[0040] First, configure the test and measurement environment. Here, before running the complete automated workflow, the user may need to use, for example Core engine to configure Test Automation Environment. First, in some implementations, users may need to install and deploy the KS8400B, a Development version of test automation. In this case, the user needs to ensure that the KS8400B test automation is compatible with the Eggplant tool, network simulator (e.g., UXM 5G network simulator), Interoperability with the KS6800A, the measurement analysis, and the automation of data set import (e.g., results listener). Eggplant toolset and The measurement analysis can be performed locally or on a network server. Eggplant control software package based on C# and Python, The measurement analysis software package and the UXM E7515B software package can be installed by the user. Now the user can create a test sequence (test plan) which will be run by the machine in an automated manner.

[0041] Reference Figure 2 The whole workflow can be composed of the following main steps.

[0042] S101-Hardware control. This step requires the use of the LAN interface and USB interface to establish connection and control between the 5G network emulator (E7515B) and the device under test (5G user equipment).

[0043] S102-Simulation phase. This step includes reproducing a specific use case scenario by simulating application-based user activities on the 5G network and UE. In the following description, as an example, the C8700200A UXM test application (which may be referred to as C8700200A for short) is used for 5G network simulation, and The screen mirroring tool is used to mirror the UE's screen.

[0044] S103-Automated operation. This step includes using KS8400B (based on and plugins mentioned below) and Eggplant tool (which uses AI-based algorithms to go through application settings and predefined scripts) to run test automation.

[0045] S104 - Data Analysis: Here, data visualization and analysis of associated measurement data are performed to track KPIs and find correlations.

[0046] Next, the operation of the automation and analysis framework according to an embodiment of the present inventive concept will be described.

[0047] First, the user sets up a test bench, an example of which is given in Figure 3 As shown, the testbed of the illustrated example includes the following items operably connected in a local area network (LAN): a computer 100 (e.g., a PC) having a display 101, a network switch 102, a network emulator 103, and an Eggplant gateway 104. As noted above, the Eggplant toolset (and The measurement analysis) can be deployed locally on the computer 100, or can be run on a network server. In the example of this embodiment, the user sets up the bench settings in the KS8400B and ensures that the E7515B and the user equipment (UE) are connected to each other according to the diagram. The example test bench settings support both iOS (105) and Android (106) UE automation, such as Figure 3 . The Android device 106 can be controlled by Eggplant or by using the Android Debug Bridge (ADB). The iOS device 105 can be controlled by Eggplant.

[0048] After the test bed is fully configured and the USB / LAN addresses are correct, the user ensures that the C8700200A is operational with a PC-based Vysor application (such as Vysor mirroring the UE screen). Figure 4 An example screenshot is shown in , where the UE screen is mirrored on the right side of the display.

[0049] Next, the user uses the UXM E7515B control, Eggplant control and Test Steps for the Measurement Analysis Result Listener Plug-in Create a test plan in the KS8400B to reproduce the following example test algorithm: a. Utilization Test Automation The KS8400B opens a SCPI-based connection to the C8700200A application to load the network configuration, control network parameters, and start tracing C8700200A / E7515B-specific parameters in the background using a result listener; b. Connect to the device under test to turn off airplane mode (can be done via ADB or Eggplant Gateway); c. After the network is initialized and the UE is attached, run the Eggplant script and track application related metrics; d. When the first Eggplant script is complete, new changes can be applied to the network - such as format changes, cell reselection, channel impairments, etc. e. Run the Eggplant script to collect updated metrics; f. Complete the test by turning on UE flight mode, powering off the cell, and publishing the test results to the KS6800A database.

[0050] Figure 5 Shows an example test plan that simulates the change in network performance when the primary cell switches from LTE to 5G.

[0051] To integrate Eggplant with its embedded automation intelligence functionality into the sequencing environment of the KS8400B, the user should parameterize the Eggplant test step to run a dedicated script with the DUT name as a parameter. Figure 6 shows an example in which Eggplant is used to test network speed by running the SpeedTest application installed on the UE. The Eggplant script uses the SenseTalk framework and its contents are in Figure 7 Shown in.

[0052] During the Eggplant script, the AI ​​engine analyzes the mirrored UE screen to collect some application related metrics. In the case of the SpeedTest application, these metrics are as follows Figure 8 The Eggplant tool's AI engine reads these values ​​and stores them in a CSV log and after each script is completed. Test Automation KS8400B Service Log.

[0053] The log information from the KS8400B will contain not only the Eggplant results, but also the network parameters from the C8700200A application, and information related to the UXM E7515B network emulator test including the SCPI commands used to set the correct LTE / 5G network parameters. Fig. 9 Example test steps for activating a 5G cell from the KS8400B via SCPI commands are shown in Fig.10 An example of a part of a log associated with a cell configuration illustrating the hardware automation concept of a KS8400B controlling a C870020A and a UXM E7515B is shown in FIG.

[0054] Some key characteristics of the network include but are not limited to cell type, access point name, DUT IP address, gateway IP address, mobile country code, mobile network code, downlink modulation and coding scheme (MCS), uplink MCS, UE output power, etc., which are quite important for associating application performance with network capabilities.

[0055] In the KS8400B test plan, all of these parameters are set during the C8700200A initialization and can also be requested by SCPI commands as part of the KS8400 test automation. With the added Eggplant logging information, each response is also published in the final log / results.

[0056] After the test is completed, run the The measurement analysis result listener automatically generates a new data set in the KS6800A. This data set can be displayed in a web browser when accessing the KS6800A installation URL.

[0057] The dataset considered includes data from several sources. Mainly, it contains data related to 5G networks based on C8700200A / UXM E7515B parameters related to network characteristics. Secondly, it contains data related to 5G user equipment (UE). This data can be based on speed test results obtained using the Eggplant Digital Automation Intelligence Suite and a supporting AI engine that tracks user interface metrics. Finally, it combines test and measurement metadata, which provides additional context for the measurements. These include details like: the name of the test operator, KS8400B and Eggplant versions, the test location, and other environmental or specific setup parameters that may have an impact on the test.

[0058] Engineers can use this rich data set to fully validate network performance. For example, engineers can use popular network diagnostic tools such as the Applications) to assess uplink speed and downlink speed. This is an effective way to measure bandwidth and determine if the network is operating optimally or if there are areas that need correction. Speed ​​measurements can be further correlated with other parameters. Fig.11 An example of associating uplink speed and downlink speed with cell type is shown.

[0059] The combined and related functionality of the KS6800A provides the user with the ability to correlate parameters with each other. Fig.11 As shown in , the network speed associated with the LTE cell is inferior to the performance of the simulated 5G cell. Additionally, given that the data set is enriched by the fact that all measurements are collected consistently using the KS8400B and OpenTAP, engineers can also examine the corresponding metadata values ​​in detail. This analysis can include correlations between UE IP addresses and the performance of the network or individual test operators, such as Fig.12 as shown in the example.

[0060] Fig.13 is a diagram showing an overview of the above test operation. Specifically, the diagram shows how a user and a KS8400B OpenTAP engine (representing a machine or an automated system) collaborate to perform and complete the entire test and measurement process according to the above description.

[0061] refer to Fig.13 At 201, the user uses the OpenTAP core engine configuration Test the automation environment to ensure interoperability with necessary tools.

[0062] At 301, the KS8400B OpenTAP engine is installed and deployed Test the development version of the automation and any required packages.

[0063] At 202, a user establishes connection and control over a 5G network emulator and a UE.

[0064] At 302, the KS8400B OpenTAP engine verifies the connection and initializes related processes.

[0065] At 203, a user develops a test plan to reproduce a specific use case scenario.

[0066] At 303, the KS8400B OpenTAP engine runs the developed test plan based on the given sequence using a combination of plug-ins and AI-based algorithms.

[0067] At 204, the user sets the workstation settings in KS8400B and ensures that E7515B is connected to the UE (e.g., Figure 3 shown in ).

[0068] At 304, the KS8400B OpenTAP engine checks and confirms successful setup of the workbench setup and connection.

[0069] At 205, the user creates a test plan in the KS8400B to reproduce the desired algorithm using the provided plug-ins.

[0070] At 305, the KS8400B OpenTAP engine uses the Eggplant tool and Measure the analysis results listener to execute the test plan.

[0071] At 206 , the user visualizes and analyzes the generated data set in the KS6800A.

[0072] At 306, the KS6800B OpenTAP engine automatically generates the data set post-test in preparation for user visualization and analysis.

[0073] The tool set of the present invention as described above is suitable for collecting and processing different arrays of data. This includes 5G network emulator logs, 5G user equipment (UE) application KPIs, and measuring hardware physical layer parameters. Therefore, the suite expands traditional functional testing with comprehensive low-level data.

[0074] The embodiments described above can be enhanced to increase the practicality, flexibility, and comprehensiveness of the system, thereby delivering greater value to users and expanding its applicability to a wider range of use cases. For example, the system can be developed to control additional hardware components. For example, the combination of power supplies, spectrum analyzers, and other test equipment can provide more comprehensive testing capabilities and generate more fine-grained data. Further, the system can be enhanced to perform more complex tests and collect a wider range of user KPIs. For example, it can automate the process of sharing and verifying access points, or track other user KPIs (such as call quality, messaging, and more).

[0075] Another enhancement may be to expand the compatibility of the system to include more devices under test (DUTs). This may include not only phones without ADB controls (such as iPhones), but also any other mobile operating systems (OS) that can be mirrored on the test PC to provide a more inclusive test environment. It also represents the diversity of user devices under real-world conditions. In addition, the framework can be expanded to interact with any user-installed application, thereby leveraging the power of Eggplant to emulate and track UX / UI performance. This may allow for more fine-grained, application-specific performance evaluations, thereby enhancing the depth of user experience insights and broadening test scenarios.

[0076] It should be further noted that the functional blocks, components, systems, devices and / or circuits described herein can be implemented using hardware, software or a combination of hardware and software. For example, the disclosed embodiments can be implemented using one or more programmable integrated circuits that are programmed to perform the functions, tasks, methods, actions and / or other operational features described herein for the disclosed embodiments. One or more programmable integrated circuits may include, for example, one or more processors and / or PLDs (programmable logic devices). One or more processors may be, for example, one or more central processing units (CPUs), graphics processing units (GPUs), controllers, microprocessors, hardware accelerators, ASICs (application specific integrated circuits) and / or other integrated processing devices. One or more PLDs may be, for example, one or more CPLDs (complex programmable logic devices), FPGAs (field programmable gate arrays), PLAs (programmable logic arrays), reconfigurable logic circuits and / or other integrated logic devices. In addition, programmable integrated circuits including one or more processors may be configured to execute software, firmware, code and / or other program instructions implemented in one or more non-transient tangible computer-readable media to perform the functions, tasks, methods, actions and / or other operational features described herein for the disclosed embodiments. A programmable integrated circuit including one or more PLDs may also be programmed using logic code, logic definitions, hardware description languages, configuration files, and / or other logic instructions implemented in one or more non-transient tangible computer-readable media to perform the functions, tasks, methods, actions, and / or other operational features described herein for the disclosed embodiments. Additionally, the one or more non-transient tangible computer-readable media may include, for example, one or more data storage devices, memory devices, flash memory, random access memory, read-only memory, programmable memory devices, reprogrammable storage devices, hard drives, floppy disks, DVDs, CD-ROMs, and / or any other non-transient tangible computer-readable media. Other variations may also be implemented while still utilizing the client monitor application pre-classification techniques described herein.

[0077] In view of this description, further modifications and alternative embodiments of the present invention will be clear to those skilled in the art. Therefore, it will be appreciated that the present invention is not limited by these example arrangements. Therefore, this description is interpreted as illustrative only, and is for the purpose of teaching those skilled in the art to implement the mode of the present invention. It should be understood that the forms of the present invention shown and described herein are considered to be currently preferred embodiments. Various changes can be made in implementations and architectures. For example, equivalent elements can replace the elements shown and described herein, and certain features of the present invention can be utilized independently of the use of other features, all of which will be clear to those skilled in the art after benefiting from this description of the present invention.

[0078] The present invention also includes the following items: 1. A system for testing a cellular device under test (DUT), the system comprising: A display (101) device for displaying a mirror image of a screen of the cellular DUT; a network emulator (103) configured to emulate a cellular network when communicating with the cellular DUT; a sequencer engine module (401a) comprising a graphical user automatic test interface configured to control the network emulator (103) and the cellular DUT, automatically run a series of test commands on the cellular DUT, and automatically run a user simulation script, the graphical user automatic test interface being displayed on the display (101) device together with a mirror image of the screen of the cellular DUT; a user simulation module (402b) configured to simulate a graphical user interface of the DUT by generating the user module script according to the series of test commands; and A data analysis module (402c) is configured to generate display (101) data of the measurement result of the DUT on the display (101) device. 2. A system according to item 1, wherein the user simulation module (402b) is configured to scan a mirror image of the screen of the DUT for a specified input graphic, and selectively activate the specified input graphic on the DUT according to the user simulation script. 3. A system according to item 2, wherein the user simulation module (402b) is further configured to scan a mirror image of the screen of the DUT to obtain test results applied to the data analysis module (402c). 4. The system of claim 1, wherein the DUT is an Android device (106) controllable by the sequencer engine module (401a) or the user emulation module (402b). 5. The system of claim 1, wherein the DUT is an IOS device controlled by the user emulation module (402b). 6. The system according to item 1, further comprising a test computer (100) comprising a display (101). 7. The system according to item 6, wherein the sequencer engine module (401a), the user simulation module (402b) and the data analysis module (402c) are loaded into the memory of the test computer (100). 8. The system of claim 7, wherein the sequencer engine module (401a) is loaded into a memory of the test computer (100), and the user simulation module (402b) and the data analysis module (402c) are on a network server. 9. A non-transitory computer (100) readable medium having stored thereon executable instructions embodied in the computer (100) readable medium, the executable instructions, when executed by at least one processor of a computer (100), causing the computer (100) to perform steps of testing a cellular device under test (DUT), wherein the executable instructions include a sequencer engine module (401a), a user simulation module (402b), and a data analysis module (402c), wherein the sequencer engine module (401a) comprises a graphical user automatic test interface, and when executed by the at least one processor, controls the network simulator (103) and the cellular DUT, automatically runs a series of test commands on the cellular DUT, and automatically runs a user simulation script, the graphical user automatic test interface being displayed on the display (101) device together with a mirror image of the screen of the cellular DUT; wherein the user simulation module (402b), when executed by the at least one processor, simulates the graphical user interface of the DUT by generating the user simulation script according to the series of test commands; and Wherein, when the data analysis module (402c) is executed by the at least one processor, it generates display (101) data of the measurement result of the DUT on the display (101) device. 10. A non-transitory computer (100) readable medium according to item 9, wherein the user simulation module (402b), when executed by the at least one processor, scans a mirror image of the screen of the DUT for a specified input graphic and selectively activates the specified input graphic on the DUT according to the user simulation script. 11. A non-transitory computer (100) readable medium according to item 10, wherein, when executed by the at least one processor, the user simulation module further scans a mirror image of the screen of the DUT to obtain test results applied to the data analysis module. 12. The non-transitory computer (100) readable medium of clause 9, wherein the DUT is an Android device controllable by the sequencer engine module or the user emulation module. 13. The non-transitory computer (100) readable medium of clause 9, wherein the DUT is an IOS device controlled by the user emulation module.

Claims

1. A system for testing a cellular device under test (DUT), the system comprising: A display (101) device for displaying a mirror image of a screen of the cellular DUT; a network emulator (103) configured to emulate a cellular network when communicating with the cellular DUT; a sequencer engine module (401a) comprising a graphical user automatic test interface configured to control the network emulator (103) and the cellular DUT, automatically run a series of test commands on the cellular DUT, and automatically run a user simulation script, the graphical user automatic test interface being displayed on the display (101) device together with a mirror image of the screen of the cellular DUT; a user simulation module (402b) configured to simulate a graphical user interface of the DUT by generating the user module script according to the series of test commands; as well as A data analysis module (402c) is configured to generate display (101) data of the measurement result of the DUT on the display (101) device.

2. The system according to claim 1, wherein: The user simulation module (402b) is configured to scan a mirror image of the screen of the DUT for a designated input pattern and selectively activate the designated input pattern on the DUT according to the user simulation script.

3. The system according to claim 2, wherein: The user simulation module (402b) is further configured to scan the mirror image of the screen of the DUT to obtain the test results applied to the data analysis module (402c).

4. The system according to claim 1, wherein: The DUT is an Android device (106) that can be controlled by the sequencer engine module (401a) or the user emulation module (402b).

5. The system according to claim 1, wherein: The DUT is an IOS device controlled by the user emulation module (402b).

6. The system of claim 1, further comprising a test computer (100) comprising a display (101).

7. The system according to claim 6, wherein: The sequencer engine module (401a), the user simulation module (402b) and the data analysis module (402c) are loaded into the memory of the test computer (100).

8. The system according to claim 7, wherein: The sequencer engine module (401a) is loaded in the memory of the test computer (100), and the user simulation module (402b) and the data analysis module (402c) are on a network server.

9. A non-transitory computer (100) readable medium having stored thereon executable instructions embodied in the computer (100) readable medium, the executable instructions, when executed by at least one processor of a computer (100), causing the computer (100) to perform steps of testing a cellular device under test (DUT), wherein: The executable instructions include a sequencer engine module (401a), a user simulation module (402b) and a data analysis module (402c), wherein the sequencer engine module (401a) comprises a graphical user automatic test interface, and when executed by the at least one processor, controls the network simulator (103) and the cellular DUT, automatically runs a series of test commands on the cellular DUT, and automatically runs a user simulation script, the graphical user automatic test interface being displayed on the display (101) device together with a mirror image of the screen of the cellular DUT; wherein the user simulation module (402b), when executed by the at least one processor, simulates the graphical user interface of the DUT by generating the user simulation script according to the series of test commands; and Wherein, when the data analysis module (402c) is executed by the at least one processor, it generates display (101) data of the measurement result of the DUT on the display (101) device.

10. The non-transitory computer (100) readable medium of claim 9, wherein: The user simulation module (402b), when executed by the at least one processor, scans a mirror image of the screen of the DUT for a designated input pattern and selectively activates the designated input pattern on the DUT according to the user simulation script.

Images