Apparatus and method for providing service for testing application, service providing system including same, and non-volatile recording medium having computer program recorded therein

The service provision system enables the creation of universally applicable test scenarios for diverse terminals by focusing on components rather than coordinates, enhancing testing efficiency and accuracy through web-based creation and real-time video analysis, addressing the limitations of existing methods in handling different screen sizes and modes.

WO2024248340A1PCT designated stage expired Publication Date: 2024-12-05SK PLANET CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005774
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-30
Filing Date
2024-04-29
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing application testing services face limitations in creating universally applicable test scenarios across different screen sizes and modes, requiring cumbersome coordinate-based methods and struggling with continuous monitoring and quality verification, especially on diverse and foldable terminals.

Method used

A service provision system and method that supports the creation of test scenarios based on components rather than coordinates, allowing for web-based scenario creation and automatic identification of components, enabling scenarios to be universally applied across various screen configurations, with real-time video recording and analysis for efficient problem identification.

Benefits of technology

This approach increases the convenience and efficiency of writing test scenarios, improves user understanding, and enhances the accuracy and reliability of application testing by allowing scenarios to be easily adapted and executed on multiple terminal types, including foldable devices, with real-time issue detection and analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005774_05122024_PF_FP_ABST
    Figure KR2024005774_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to an apparatus and method for providing a service for testing an application, a service providing system including same, and a non-volatile recording medium having a computer program recorded therein and, more particularly, to an apparatus and method for providing a service for testing an application, a service providing system including same, and a non-volatile recording medium having a computer program recorded therein, wherein, when a scenario for testing an application is prepared, the scenario is supported to be prepared based on a component in a screen according to execution of the application so that preparation of a generally applicable test scenario is supported without being constrained by screen sizes or screen modes of different terminals.
Need to check novelty before this filing date? Find Prior Art

Description

A service providing device and method for application testing, and a service providing system and computer program including the same, and a nonvolatile recording medium having the same recorded thereon

[0001] The present invention relates to a service providing device and method for application testing, and a service providing system including the same, and a nonvolatile recording medium having a computer program recorded thereon, and more particularly, to a service providing device and method for application testing, which support writing a scenario for application testing based on components on a screen according to the execution of the application when writing the scenario, thereby supporting writing a test scenario that can be universally applied regardless of the screen size or screen mode of different terminals, and a service providing system including the same, and a nonvolatile recording medium having a computer program recorded thereon.

[0002] Recently, application testing services have been provided for monitoring quality and detecting failures in application development and operation. These application testing services consist of test automation based on scenario settings, non-functional testing, and data visualization and analysis based on collected and analyzed results.

[0003] At this time, test automation is for scenario-based execution and test result verification, and QA resource efficiency, non-functional testing is for measuring aging tests, E2E loading speed, current consumption, APP traffic, etc., and result information collection and analysis is for analyzing success / failure rate / response time by device / OS / app version / network, CPU / Memory / battery consumption / Network Size, etc.

[0004] Additionally, the importance of application operation monitoring is increasing due to the diversity of OS versions, terminal screen configurations, terminal performance, terminal characteristics, increasing application complexity, and increasing need for server communication.

[0005] Typically, existing application testing services are based on local mobile terminals directly connected to developer terminals, and automated test scenarios are recorded by recording information on the developer's actual screen manipulation based on the mobile terminal's screen coordinates displayed on the developer terminal, and automated testing is conducted by executing the scenarios using coordinate-based macro methods.

[0006] However, this method has limitations in verifying application failures / quality according to regional characteristics, and it is difficult to respond when continuous 24-hour application failure / quality verification is required.

[0007] In addition, since these existing application test services create test scenarios by performing test control inputs based on the coordinates of the screen according to a fixed screen size of a specific mobile terminal, it is impossible to apply test scenarios created according to the fixed screen size to other types of mobile terminals with changed screen sizes, and even if the screen is rotated by rotating the mobile terminal and becomes different from the screen size at the time of creating the test scenario, the scenario cannot be applied, and since the displayed state is different for each screen in a foldable terminal with multiple screen modes, there is a problem in that test scenarios cannot be applied.

[0008] Ultimately, existing application testing services have the problem of having to write test scenarios for each model with different screen states, screen modes, and screen sizes. In addition, existing scenario writing methods that record actions have limitations in that it is cumbersome to record comments or descriptions for each unit of action in the scenario, and it is also difficult to grasp the scenario setting status at a glance.

[0009] On the other hand, even if the test system is configured to allow developers to access the test system from anywhere and to edit and execute test scenarios via the web, while performing tests in multiple regions to check communication status, etc., the problems associated with the existing local method of scenario creation and execution (inability to apply scenarios due to changes in screen size, inability to apply scenarios when control target arrangement changes, inconvenience in scenario management) still occur because scenarios are written and tests are performed by recording clicks on the location on the screen while viewing the screen of the mobile terminal by emulating or streaming the screen of the mobile terminal.

[0010] The present invention supports the creation of a scenario for application testing in a web manner, but when a component is selected on a mobile screen being streamed for scenario creation, the component itself, rather than the location, is identified so that the scenario can be created based on the component, thereby enabling one scenario to be commonly used on terminals with various screen configurations, thereby increasing the versatility of the applicable mobile terminals. In addition, the present invention confirms information on a component within a screen specified by the user and automatically generates and provides for editing unit operation description information of the scenario, thereby increasing the convenience of script creation for test scenarios, and supporting intuitive understanding of test operations by checking only the script, thereby increasing user convenience.

[0011] In addition, the present invention supports the easy identification of screen transition operation abnormalities depending on the presence or absence of pre-set screen components (elements) when screen transitions due to changes in test steps during an application test execution process using a test scenario, and supports recording automatic test content separately from streaming on a local mobile terminal and transmitting the recorded video file when necessary to enable real-time test status confirmation without screen omission or delay, thereby supporting easy judgment of failures or quality, and at the same time, supporting easy identification of accurate test situations and analysis of failure content through recorded video.

[0012] A service providing system for application testing according to an embodiment of the present invention comprises: a mobile agent unit configured in a mobile terminal to transmit a screen display image for a screen of the mobile terminal, obtain and provide screen configuration information including coordinates and component information for each operable component of the screen that is used in an operating system of the mobile terminal for displaying the screen, and perform a function according to the remote control information when receiving remote control information for operating the mobile terminal; a terminal agent unit configured in a management terminal communicating with the mobile terminal to receive the screen display image and transmit it in a streaming manner, receive and transmit the screen configuration information corresponding to the screen display image, and receive and transmit the remote control information to the mobile terminal; and a service providing a web page for creating a test scenario for an application installed in the mobile terminal, providing a screen display image received from the terminal agent unit through the web page, generating the remote control information according to operation information for any one of one or more components included in the screen display image, and transmitting the remote control information to the terminal agent unit, extracting component information corresponding to the operation information from the screen configuration information and generating event information including the extracted component information, and accumulating one or more event information generated until the completion of writing the test scenario to generate test scenario information. May include devices.

[0013] The present invention can improve the convenience of writing test scenarios based on automated scripts by supporting the convenient creation of test scenarios for testing applications on mobile terminals on a web basis, and can also support the creation of test scenarios based on the components themselves rather than the coordinates of the components when manipulating the components for executing the functions of applications installed on mobile terminals, thereby creating test scenarios that can be universally applied to all types of mobile terminals with different screen sizes or screen structures, thereby greatly improving the efficiency of writing test scenarios.

[0014] Figure 1 is a configuration diagram of a service providing system for application testing according to an embodiment of the present invention.

[0015] Figures 2 to 4 are operation examples of a service providing method for application testing of a service providing system according to an embodiment of the present invention.

[0016] Figure 5 is a configuration diagram of a service providing device for application testing according to an embodiment of the present invention.

[0017] Figures 6 and 7 are flowcharts of a service providing method for application testing of a service providing device according to an embodiment of the present invention.

[0018] Figures 8 to 12 are operation examples of a service providing device according to an embodiment of the present invention.

[0019] Hereinafter, detailed embodiments of the present invention will be described with reference to the drawings.

[0020] Figure 1 is a configuration diagram of a service providing system for application testing according to an embodiment of the present invention.

[0021] As illustrated, a service providing system for application testing according to an embodiment of the present invention may be configured to include a management terminal (20), a mobile terminal (30) communicating with the management terminal (20), a service providing device (100) communicating with the management terminal (20) via a communication network, and a user terminal (10) communicating with the service providing device (100) via a communication network.

[0022] At this time, the management terminal (20) and mobile terminal (30) may be configured locally, and the service providing device (100) may be configured remotely from the location of the management terminal (20) and mobile terminal (30).

[0023] Additionally, a service providing system for application testing may be implemented with more components than those illustrated in FIG. 1, or may be implemented with fewer components.

[0024] In addition, the communication network described in the present invention may include a wired / wireless communication network, and examples of such wireless communication networks include Wireless LAN (WLAN), Digital Living Network Alliance (DLNA), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), 5G mobile communication service, This may include Bluetooth, LoRa (Long Range), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct.Additionally, wired communication networks may include wired Local Area Networks (LANs), wired Wide Area Networks (WANs), Power Line Communications (PLCs), USB communications, Ethernet, serial communications, and optical / coaxial cables.

[0025] In addition, the user terminal (10), mobile terminal (30), or management terminal (20) may be configured as a smart phone, portable terminal, mobile terminal, personal digital assistant (PDA), personal computer, notebook computer, slate PC, tablet PC, ultrabook, etc. having a communication function.

[0026] Additionally, the service providing device (100) may be configured as a service server.

[0027] In addition, a service providing system for application testing according to an embodiment of the present invention may be configured to include a mobile agent unit (31) configured in a mobile terminal (30) and a terminal agent unit (21) (or management agent unit) configured in a management terminal (20).

[0028] At this time, each of the user terminal (10), mobile terminal (30), and management terminal (20) may be configured to include a terminal communication unit, a terminal storage unit, a terminal display unit, a terminal input unit, a terminal control unit, etc.

[0029] In addition, the terminal communication unit can communicate with other devices through the communication network, and can be configured to include an interface unit for wired communication with the other devices.

[0030] For example, the interface unit configured in each of the mobile terminal (30) and the management terminal (20) includes a USB (Universal Serial Bus)-based communication interface, so that the mobile terminal (30) and the management terminal (20) can be connected to each other via a wire through the interface unit and communicate with each other based on USB.

[0031] In addition, the terminal storage unit can store various types of information, and the terminal storage unit can be configured in various forms such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc.

[0032] In addition, the terminal control unit performs the overall control function of the mobile terminal (30) or management terminal (20), and the terminal control unit may include RAM, ROM, CPU, GPU, and a bus, and the RAM, ROM, CPU, GPU, etc. may be connected to each other through a bus.

[0033] Additionally, the terminal communication unit and the terminal storage unit may be configured to be included in the terminal control unit.

[0034] Additionally, the terminal display unit can be configured to display various types of information, and the terminal input unit can receive user input.

[0035] Additionally, the terminal display unit and terminal input unit may be configured as components that constitute a single touch screen.

[0036] In addition, the mobile agent unit (31) may be configured as a terminal control unit that is installed in the mobile terminal (30) and executes a mobile terminal agent program that is data stored in the terminal storage unit of the mobile terminal (30).

[0037] In addition, the terminal agent unit (21) (or management agent unit) may be configured as a terminal control unit that is installed in the management terminal (20) and executes an agent program for the management terminal, which is data stored in the terminal storage unit of the management terminal (20).

[0038] In addition, the user terminal (10) may be configured to include an editing agent unit, which is a terminal control unit configured in the user terminal (10) to store an editing agent program for creating a test scenario by connecting to the service providing device (100) and executing the editing agent program, and the configuration of the user terminal (10) described below may be performed by the editing agent unit.

[0039] According to the above-described configuration, the service providing system for application testing according to the present invention is linked with the mobile agent unit (31) configured in the mobile terminal (30), and communicates with the terminal agent unit (21) of the management terminal (20) that manages the mobile agent unit (31) through a communication network between the terminal agent unit (21) and the service providing device (100) to test the application installed in the mobile terminal (30) from before the application is executed on the user terminal (10) to the state where the application execution is terminated, and provides an interface based on the web for creating a test scenario, and supports creating the test scenario based on the components included in the screen of the mobile terminal (30), thereby supporting the creation of a test scenario that is applicable to various types of mobile terminals (30) with different sizes and screen configurations, and supports convenient application testing based on such a test scenario, which will be described in detail below with reference to the drawings.

[0040] FIG. 2 and FIG. 3 are operation examples of a service providing method for application testing of a service providing system for application testing according to an embodiment of the present invention.

[0041] Before the explanation, the mobile agent unit (31) configured in the mobile terminal (30) can communicate with various external devices (for example, the management terminal (20)) through the terminal communication unit configured in the mobile terminal (30), and the terminal agent unit (21) configured in the management terminal (20) can communicate with various external devices (for example, the mobile terminal (30), the service providing device (100)) through the terminal communication unit configured in the management terminal (20). In the following, the communication configuration of the mobile agent unit (31) or the terminal agent unit (21) through the terminal communication unit will be omitted.

[0042] In addition, the mobile terminal (30) can be interconnected with the management terminal (20) through wired communication, and the mobile terminal (30) and the management terminal (20) can communicate with each other through wired communication.

[0043] First, the process of writing (creating) a test scenario for the service provision system is described in detail with reference to Fig. 2.

[0044] The service providing device (100) can provide a web page including a development interface required for writing a test scenario to perform a test on an application from a state prior to application execution installed on a mobile terminal (30) to a state after the application is terminated, to the user terminal (10) that is the subject of writing the test scenario.

[0045] Accordingly, the user terminal (10) can access the web page, receive the web page, and create the test scenario through the web page.

[0046] In addition, one or more mobile terminals (30) can be connected to the management terminal (20) so as to be able to communicate with each other, and the service providing device (100) can include a terminal DB in which information on one or more mobile terminals (30) located locally and management terminal information on management terminals (20) connected to the one or more mobile terminals (30) are stored.

[0047] At this time, the mobile terminal information may include terminal specification information including the terminal type, screen size, screen mode (for example, horizontal screen mode, vertical screen mode, single screen mode, multi screen mode, etc.) of the mobile terminal (30), and terminal identification information corresponding to the mobile terminal (30).

[0048] In addition, the management terminal information may include terminal identification information corresponding to the management terminal (20), terminal identification information for each mobile terminal connected to the management terminal (20), etc.

[0049] In addition, the service providing device (100) can generate terminal list information including one or more mobile terminal information and provide it to the user terminal (10) through the web page, and when receiving selection information including terminal identification information for a specific mobile terminal (30) selected from the terminal list information from the user terminal (10), a test scenario can be created based on the specific mobile terminal (30) corresponding to the selection information.

[0050] In addition, the service providing device (100) can transmit screen request information to the management terminal (20) for requesting screen display image and screen configuration information to the mobile agent unit (31) of a specific mobile terminal (30) corresponding to the selection information.

[0051] Accordingly, the terminal agent unit (21) of the management terminal (20) can identify the specific mobile terminal (30) based on the terminal identification information included in the screen request information when receiving the screen request information, and transmit the screen request information to the identified specific mobile terminal (30).

[0052] The mobile agent unit (31) of the specific mobile terminal (30) above can generate an image (hereinafter, “screen display image”) of the screen displayed on the mobile terminal (30) or the screen displayed on the mobile terminal (30) according to the execution of the application when the screen request information is received and transmit the image to the management terminal (20), and can also transmit the image to the management terminal (20) in a streaming manner.

[0053] At this time, the screen display image can be generated by the operating system of the mobile terminal (30), and the mobile agent unit (31) can receive the generated screen display image from the operating system and transmit it to the management terminal (20).

[0054] In addition, the mobile agent unit (31) can obtain screen configuration information in XML (eXtensible Markup Language) format used for displaying a screen corresponding to the screen display image in the operating system from the operating system and transmit it to the terminal agent unit (21).

[0055] For example, an Android-based operating system operating on a mobile terminal (30) can generate a screen display image for a screen displayed on a terminal display unit of the mobile terminal (30) and can generate the screen display content of the screen as XML data.

[0056] Accordingly, the mobile agent unit (31) operating based on the above operating system can obtain a screen display image from the above operating system by linking with the above operating system, and can obtain screen configuration information in XML format regarding the screen display content.

[0057] At this time, the screen configuration information may include the location (coordinates) of each component (element) that constitutes the screen corresponding to the screen display image, component information for the component, etc., and the component information may include component identification information for the component, a description of the component, etc.

[0058] Additionally, the location of the above components may be configured as a coordinate-based boundary area (or selection valid area) within which the selection of the components is valid.

[0059] Additionally, the above components (or elements) may include all kinds of components that can be displayed and manipulated on the screen, such as icons, menus, items, text input boxes, etc.

[0060] In addition, the terminal agent part (21) of the management terminal (20) can transmit the screen display image received from the mobile terminal (30) to the service providing device (100) in a streaming manner.

[0061] In addition, the service providing device (100) can transmit the screen display image received from the terminal agent unit (21) of the management terminal (20) to the user terminal (10) in a streaming manner, and can provide the screen display image to the user terminal (10) every time it receives the screen display image from the terminal agent unit (21) so that it can be displayed through the development interface included in the web page.

[0062] In addition, the service providing device (100) can receive the screen configuration information from the terminal agent part (21) of the management terminal (20).

[0063] In addition, the service providing device (100) can receive operation information according to an operation input for the specific mobile terminal (30) using the screen display image from the user terminal (10) through the web page, and can receive the operation information in real time.

[0064] At this time, the above operation information may be information about an operation input for any one of one or more components included in the above screen display image.

[0065] Additionally, the screen configuration information may include a boundary area for each component that constitutes a screen corresponding to the screen display image.

[0066] In addition, the service providing device (100) can receive in real time from the user terminal (10) operation information including coordinates corresponding to the position of a cursor moving on the development interface, and when the coordinates according to the operation information in the screen configuration information are included within a boundary area corresponding to a specific component of the screen, the service providing device (100) can generate a screen display image in which the boundary area corresponding to the specific component is displayed differently from other areas included in the screen display image based on the screen display image and transmit the screen display image to the user terminal (10).

[0067] Accordingly, the user terminal (10) can receive and display a screen display image in which a boundary area corresponding to the specific component is displayed differently from other areas in the screen display image from the service providing device (100), thereby enabling a user (developer) of the user terminal (10) to easily identify a component corresponding to the position of a cursor executed on the user terminal (10).

[0068] In addition, when operation information (hereinafter, first operation information) including an input event for operation of a specific component and coordinates where the input event occurred is received based on the screen display image, the service providing device (100) can confirm a preset event type corresponding to the input event according to the first operation information based on preset setting information, and generate remote control information corresponding to the first operation information for operating the specific mobile terminal (30) located remotely based on the coordinates according to the first operation information and the event type corresponding to the first operation information.

[0069] At this time, the event types may include touch, click, drag, drop, swipe, text input, etc.

[0070] In addition, the service providing device (100) may store in advance setting information in which a plurality of different types of events are preset for each input event, and the service providing device (100) may identify (confirm) the type of event corresponding to the input event of the first operation information based on the setting information.

[0071] At this time, the input event and event type may be identical to each other.

[0072] In addition, the service providing device (100) can identify and extract component information of a component corresponding to coordinates according to the first operation information among one or more components that constitute a screen displayed on a specific mobile terminal (30) corresponding to the screen configuration information based on the screen configuration information from the screen configuration information.

[0073] Accordingly, the service providing device (100) can generate event information (hereinafter, first event information) including an event type corresponding to the first operation information received from the user terminal (10) based on the screen display image and component information (hereinafter, first component information) extracted to correspond to the operation information.

[0074] At this time, the service providing device (100) can provide the event information to the user terminal (10) so that the user can intuitively understand the unit operation corresponding to the event information and edit the event information through the development interface, and can receive event description information for the event information from the user terminal (10) and include it in the event information.

[0075] Additionally, the service providing device (100) can store the first event information in a scenario DB included in the storage unit.

[0076] At this time, the service providing device (100) may receive scenario identification information for creating (generating) a test scenario through the web page to the user terminal (10) and store it in the scenario DB, and match the first event information with the scenario identification information and store it in the scenario DB.

[0077] In addition, the service providing device (100) can transmit the remote control information to the terminal agent part (21) of the management terminal (20).

[0078] In addition, the terminal agent unit (21) can transmit the remote control information to a specific mobile terminal (30) corresponding to the remote control information when receiving the remote control information.

[0079] Accordingly, the mobile agent unit (31) configured in the specific mobile terminal (30) performs a function of manipulating a specific component corresponding to coordinates according to the remote control information among one or more components configured on the screen corresponding to the screen display image when receiving the remote control information, based on the remote control information, according to an input event corresponding to the event type according to the remote control information, and can execute an application corresponding to the specific component or a function of the application.

[0080] For example, the mobile agent unit (31) may perform a function of selecting the icon when the screen display image transmitted to the service providing device (100) is an application selection screen including one or more application icons, a specific component corresponding to the coordinates according to the remote control information is an icon for application execution, and the input type is a click, thereby executing an application corresponding to the icon, and accordingly, the mobile terminal (30) may switch from the application selection screen to a start screen according to the start of execution of the application, and display the start screen.

[0081] Alternatively, the mobile agent unit (31) may perform a function of selecting an application provision menu, which is a component corresponding to the coordinates according to the remote control information among one or more components constituting the screen in the state of executing the application, and accordingly perform a function of switching to a menu screen displaying one or more items included in the application provision menu on the mobile terminal (30), and displaying the menu screen.

[0082] In addition, the mobile agent unit (31) can transmit a screen display image for an execution screen (current execution screen or current display screen) that is a screen converted (switched) by an application executed according to the performance of a function corresponding to the remote control information to the terminal agent unit (21), and can transmit screen configuration information in XML format corresponding to the converted execution screen to the terminal agent unit (21).

[0083] In addition, the terminal agent unit (21) can transmit the screen display image corresponding to the execution screen received from the mobile terminal (30) to the service providing device (100) in a streaming manner, and transmit the screen configuration information corresponding to the execution screen received from the mobile terminal (30) to the service providing device (100).

[0084] Accordingly, the service providing device (100) can provide a web page including a screen display image corresponding to the execution screen to the user terminal (10) and receive other operation information (hereinafter, second operation information) corresponding to the execution screen from the user terminal (10).

[0085] At this time, the user terminal (10) can transmit second operation information including coordinates corresponding to the selected component and an input event corresponding to the user input to the service providing device (100) based on a user input for one or more components included in the execution screen from the screen display image for the execution screen.

[0086] Accordingly, when the service providing device (100) receives second operation information generated based on a screen display image corresponding to the execution screen from the user terminal (10), the device searches for screen configuration information corresponding to the execution screen based on coordinates according to the second operation information, and can identify component information (hereinafter, second component information) corresponding to the coordinates according to the second operation information from the screen configuration information corresponding to the execution screen, and can extract the identified second component information.

[0087] In addition, the service providing device (100) may identify a preset event type corresponding to an input event according to the second operation information based on the setting information, generate event information (hereinafter, second event information) including the event type corresponding to the second operation information and the second component information, and then match the second event information with the scenario identification information or the first event information to accumulate and store the second event information in the scenario DB in a subsequent order to the first event information.

[0088] In addition, the service providing device (100) can generate remote control information corresponding to the second operation information, including coordinates according to the second operation information and an event type corresponding to the second operation information, and transmit the remote control information corresponding to the second operation information to the terminal agent unit (21) of the management terminal (20).

[0089] Accordingly, the terminal agent unit (21) transmits the remote control information to the mobile agent unit (31) of the mobile terminal (30), and the mobile agent unit (31) performs a function according to an input event corresponding to the remote control information for a component corresponding to the second component information according to the remote control information, so as to transmit a screen display image and screen configuration information for an execution screen converted by an application executed by the remote control information corresponding to the second operation information to the service providing device (100) through the management terminal (20).

[0090] In addition, the service providing device (100), after generating the second event information based on the second operation information and then receiving the third operation information, generates the third event information in the same manner as generating the first event information based on the first operation information or generating the second event information based on the second operation information based on the screen display image and screen configuration information corresponding to the converted execution screen, and matches the third event information with the second event information and accumulates and stores it in a lower priority as event information following the second event information, and generates remote control information corresponding to the third operation information by linking with the mobile agent unit (31) through the terminal agent unit (21) and transmits the corresponding remote control information to the specific mobile terminal (30) through the management terminal (20) in the same manner as transmitting the above-described remote control information.

[0091] Even thereafter, the service providing device (100) can generate one or more event information following the third event information in the same manner as the first to third event information described above, and can accumulate and store the generated one or more event information in a scenario DB by matching it with previously generated event information or scenario identification information according to the generation order.

[0092] In addition, the user terminal (10) can generate writing completion information (or writing completion information) regarding the completion (end) of writing a test scenario based on the development interface according to user input and transmit the information to the service providing device (100).

[0093] For example, when a completion button for completing the writing of a test scenario included in the development interface of the web page is selected based on user input, the user terminal (10) can generate the writing completion information and transmit it to the service providing device (100).

[0094] Accordingly, the service providing device (100) determines that the writing of the test scenario is completed based on the writing completion information when receiving the writing completion information from the user terminal (10), and can generate test scenario information based on one or more event information and scenario identification information accumulated and stored in the scenario DB.

[0095] At this time, the test scenario information may include one or more event information.

[0096] In addition, the service providing device (100) can set a test step for each event information according to the order of creation (or storage order) of each of the one or more event information in the process of creating the test scenario information, and can set a test step for each event information so that the earlier the creation order, the earlier the test step.

[0097] For example, the service providing device (100) can set the first test step with the highest priority for the first event information generated first, set the second test step for the second event information generated next in order, and set the third test step for the third event information generated after the second event information, thereby generating test scenario information including event information for each of the first to third test steps.

[0098] At this time, the service providing device (100) can generate test scenario information including event information for one or more test steps in the form of a script.

[0099] Additionally, the service providing device (100) can store the test scenario information in a scenario DB.

[0100] Meanwhile, as illustrated in FIG. 3, the service providing device (100) can perform application testing on each of one or more mobile terminals (30) connected to the management terminal (20) based on the test scenario information stored in the scenario DB when the test scenario creation by the user terminal (10) is completed, which will be described in detail below.

[0101] The above service providing device (100) selects another mobile terminal (30) communicating with the management terminal (20) as a test terminal for a test according to the test scenario information, performs a test targeting the test terminal based on event information corresponding to a test step included in the test scenario information, identifies component information according to the event information included in the test scenario information from screen configuration information received from the test terminal, extracts coordinates corresponding to the identified component information from the screen configuration information, generates event control information for causing a function according to the event information to be performed for a component corresponding to the identified component information based on the extracted coordinates and event information, and transmits the event control information to the terminal agent unit (21) of the management terminal (20) so that the event control information is transmitted to the test terminal, and receives screen configuration information for an execution screen switched by an application executed according to the function performance according to the event control information in the test terminal from the management terminal (20) as a response to the event control information, and then generates event result information including the screen configuration information for the execution screen and the test step corresponding to the event control information, thereby performing a test for each test step, thereby generating event result information. It is possible to generate and generate test result information including event result information for each test step at the end of the test for all test steps.

[0102] For example, the service providing device (100) can extract the test scenario information stored in the scenario DB based on pre-stored schedule information or upon receiving test request information from the user terminal (10).

[0103] In addition, the service providing device (100) can select one of one or more mobile terminals (30) connected to the management terminal (20) as a test target and transmit test start information to the management terminal (20), and the terminal agent part (21) of the management terminal (20) can transmit the test start information to the mobile terminal (30).

[0104] Accordingly, the mobile agent part (31) of the mobile terminal (30) (hereinafter, test terminal) selected as the test subject transmits screen configuration information for the current screen to the management terminal (20) when receiving the test start information, and the terminal agent part (21) of the management terminal (20) can transmit the received screen configuration information to the service providing device (100).

[0105] In addition, the service providing device (100) can extract scenario identification information from the extracted test scenario information, extract terminal identification information for the test terminal from the terminal DB, match it with the scenario identification information, and store it in the test DB included in the storage unit.

[0106] At this time, the service providing device (100) may store the test scenario information instead of the scenario identification information in the test DB.

[0107] In addition, the service providing device (100) can extract component information of event information corresponding to the highest priority test step from the test scenario information when receiving the screen configuration information, identify the extracted component information from the screen configuration information, and obtain coordinates corresponding to the extracted component information from the screen configuration information, and generate event control information including the acquired coordinates and the event type included in the event information and transmit the event control information to the management terminal (20).

[0108] Additionally, the terminal agent part (21) of the management terminal (20) can transmit the event control information to the test terminal.

[0109] In addition, the mobile agent part (31) of the test terminal can identify a component corresponding to the coordinates according to the event control information on the current screen when the event control information is received, perform a function corresponding to the input event for the component, and execute an application according to the execution of the function, and can cause the screen to be switched by the executed application.

[0110] In addition, the mobile agent unit (31) can transmit screen configuration information corresponding to the converted screen to the management terminal (20), and the terminal agent unit (21) of the management terminal (20) can transmit screen configuration information corresponding to the converted screen to the service providing device (100).

[0111] In addition, the service providing device (100) can generate event result information including screen configuration information corresponding to the switched screen received in response to the event control information, set a test step corresponding to the event control information in the event result information, and store the event result information in a test DB by matching it with the scenario identification information.

[0112] In addition, the service providing device (100) can identify event information matching a test step corresponding to the next highest priority test step in the test scenario information when receiving screen configuration information corresponding to the converted screen, acquire coordinates corresponding to component information according to the identified event information from the screen configuration information corresponding to the converted screen, and generate other event control information including the acquired coordinates and the event type included in the identified event information, and transmit the information to the test terminal via the management terminal (20).

[0113] In addition, the mobile agent part (31) of the test terminal, when receiving the other event control information, identifies a component corresponding to the coordinates included in the other event control information in the switched screen, and performs a function according to an input event included in the other event control information for the identified component, thereby transmitting screen configuration information for the other screen switched by the application executed according to the function performed according to the other event control information to the management terminal (20), and the terminal agent part (21) of the management terminal (20) can transmit screen configuration information for the other screen switched to the service providing device (100).

[0114] Accordingly, when receiving screen configuration information for the other converted screen, the service providing device (100) can generate other event result information including the screen configuration information for the other converted screen and having a test step corresponding to the other event control information set, and then store the information in a test DB by matching it with the scenario identification information.

[0115] In this way, the service providing device (100) can perform a test as described above for each of the remaining test steps included in the test scenario information by linking with the mobile agent part (31) of the test terminal through the terminal agent part (21) of the management terminal (20).

[0116] Meanwhile, the service providing device (100) can determine whether a failure occurs during the testing process, which will be described in detail with reference to FIG. 4.

[0117] The above service providing device (100) can check component information from event information corresponding to another test step corresponding to the next order of test steps included in the event result information based on the test scenario information when generating the event result information during a test process using the test scenario information, and can check the screen configuration information from the event result information.

[0118] In addition, the service providing device (100) can determine whether the component information of the other test step exists in the screen configuration information included in the event result information, and can determine whether there is a problem with the event result information based on whether the component information of the other test step exists in the screen configuration information according to the event result information.

[0119] That is, if the component information of the other test step does not exist in the screen configuration information according to the event result information, the service providing device (100) determines that a failure has occurred in the test step according to the event result information, and generates failure occurrence information including the event result information and log information on the failure occurrence, and then matches it with the scenario identification information and stores it in the test DB.

[0120] At this time, the service providing device (100) may extract terminal identification information of the test terminal corresponding to the event result information from the terminal DB when the occurrence of the failure is determined to be the occurrence of the failure and include it in the occurrence of the failure information.

[0121] In addition, the service providing device (100) can generate test result information based on the event result information for each test step stored in the test DB and store it in the test DB by matching it with the scenario identification information when no failure occurs during the test process according to the test scenario information after completing the execution of all test steps according to the test scenario information.

[0122] At this time, the test result information may include one or more test steps and one or more event result information corresponding to each test step.

[0123] In addition, the service providing device (100) can generate test result information including the failure occurrence information when a failure occurs during a test process according to the test scenario information, and then store the information in the test DB by matching it with the scenario identification information.

[0124] At this time, the service providing device (100) can extract terminal identification information corresponding to the test terminal from the terminal DB and include it in the test result information.

[0125] In addition, the service providing device (100) can generate test termination information to notify the end of the test when all test steps according to the test scenario information are completed (ended) or when a failure occurs, and transmit the information to the test terminal through the management terminal (20).

[0126] Meanwhile, the service providing device (100) may perform a test by sequentially automatically transmitting event control information for each of one or more test steps according to the test scenario information, and may check the response time for each test step according to the reception time of each of one or more different screen configuration information, and may measure the quality by applying the response time for each test step to a preset quality measurement algorithm, and may generate quality information on the measured quality and include it in the test result information.

[0127] In addition, the service providing device (100) transmits video request information for requesting a specific test step-related video corresponding to the failure occurrence information when the failure occurrence information is generated to the terminal agent unit (21) of the management terminal (20), and the terminal agent unit (21) can transmit the video request information to the test terminal.

[0128] In addition, the mobile agent unit (31) can record the screen of the test terminal from the time of receiving the test start information to create a video, create recording information including the video, and store the recording information in the terminal storage unit configured in the mobile terminal (30).

[0129] At this time, the video included in the above recording information may be a video created by recording the screen of the mobile terminal (30) from the start of the test according to the above test scenario information until the end according to the above test end information.

[0130] In addition, the mobile agent unit (31) can transmit the recording information to the terminal agent unit (21) of the management terminal (20) when receiving the video request information, and the terminal agent unit (21) can transmit the recording information to the service providing device (100).

[0131] In addition, the service providing device (100) may store the recording information in the test DB by matching it with the scenario identification information when receiving the recording information, and may also include the recording information in the test result information.

[0132] In addition, the service providing device (100) may transmit notification information to the user terminal (10) or a preset contact when generating test result information including the failure occurrence information to notify of the occurrence of a failure (abnormality), and may transmit the notification information by including link information that can access the test result information including the failure occurrence information.

[0133] Through this, the service providing device (100) can notify a user or administrator who manages application testing according to test scenario information of a failure occurrence and provide a video so that the failure occurrence status can be confirmed.

[0134] Alternatively, the service providing device (100) may determine that a delay or error has occurred during the execution of the application and that a quality problem has occurred based on the quality information included in the test result information and does not satisfy a preset quality standard, and may transmit the video request information to the test terminal, and may generate the notification information corresponding to the test result information that does not satisfy the quality standard and transmit it to the user terminal (10) or a preset contact.

[0135] As described above, the present invention can improve the convenience of writing test scenarios based on automated scripts by supporting the convenient creation of test scenarios for testing applications on mobile terminals on a web basis, and can also support the creation of test scenarios based on the components themselves rather than the coordinates of the components when manipulating the components for executing the functions of applications installed on the mobile terminals, thereby creating test scenarios that can be universally applied to all types of mobile terminals with different screen sizes or screen structures, thereby greatly improving the efficiency of writing test scenarios.

[0136] In addition, the present invention can determine a failure based on a component for each test step that constitutes a test scenario, thereby providing a clear standard for determining a failure and increasing the accuracy of determining a failure, thereby greatly increasing the reliability and accuracy of application testing.

[0137] In addition, the present invention can increase the convenience of writing scripts for test scenarios by automatically generating and editing event information for unit operations of a scenario by checking information on components within a screen designated by a user, and can increase user convenience by supporting intuitive understanding of test operations by checking only the script.

[0138] In addition, the present invention supports the easy identification of abnormalities in screen transition operation depending on the presence or absence of pre-set screen components (elements) when screen transitions due to changes in test steps during the process of performing application testing using a test scenario, and supports recording automatic test content separately from streaming on a local mobile terminal and transmitting the recorded video file to a service providing device when necessary to enable real-time test status confirmation without screen omission or delay, thereby supporting easy judgment of failures or quality, and can support easy identification of accurate test situations and analysis of failure content through recorded video.

[0139] Based on the above-described configuration, the detailed configuration of the service providing device (100) according to the embodiment of the present invention is described.

[0140] FIG. 5 is a configuration diagram of a service providing device (100) according to an embodiment of the present invention, and FIGS. 6 and 7 are flowcharts of a service providing method for application testing of a service providing device (100) according to an embodiment of the present invention.

[0141] As illustrated, a service providing device (100) according to an embodiment of the present invention may be configured to include a communication unit (110), a storage unit (120), and a control unit (130).

[0142] First, the communication unit (110) can communicate with a user terminal (10), one or more management terminals (20), etc., through the communication network.

[0143] At this time, each of the one or more management terminals (20) may be configured to communicate with one or more mobile terminals (30).

[0144] In addition, the storage unit (120) can store various types of information, and the storage unit (120) can be configured in various forms such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc., and can be configured as a DB or including one or more DBs.

[0145] For example, the storage unit (120) may be configured to include a service DB in which web page-related information including a development interface is stored, a scenario DB in which the test scenario information is stored, a test DB in which test result information is stored, a terminal DB in which one or more management terminal information corresponding to one or more of the management terminals (20) and one or more mobile terminal information corresponding to one or more of the mobile terminals (30) are stored, etc.

[0146] In addition, the control unit (130) performs the overall control function of the service providing device (100), and the control unit (130) may include RAM, ROM, CPU, GPU, and a bus, and the RAM, ROM, CPU, GPU, etc. may be connected to each other through a bus.

[0147] Additionally, the communication unit (110) and storage unit (120) may be configured to be included in the control unit (130).

[0148] In addition, the control unit (130) can perform the overall control function of the service providing device (100), and can be configured to include a scenario writing unit (131), a test execution unit (132), a dashboard management unit (133), etc.

[0149] At this time, the control unit (130) and at least one of the various components constituting the control unit (130) can communicate with the administrator terminal and external server through the communication unit (110), and the communication configuration through the communication unit (110) will be omitted below.

[0150] The plurality of components constituting the above control unit (130) may be implemented by a processor capable of data processing, etc., and may be implemented separately by different processors, or may be functionally separated within one processor.

[0151] In addition, the service providing device (100) may be configured as a system in which a scenario writing unit (131), a test execution unit (132), and a dashboard management unit (133) are each configured as individual servers and communicate with each other, and the service DB, test DB, scenario DB, and terminal DB may also be configured as individual servers or may be configured to be included in at least one of the scenario writing unit (131), the test execution unit (132), and the dashboard management unit (133) and may be configured to be included in the service providing device (100).

[0152] First, an example of the operation of the above scenario writing unit (131) is explained with reference to the flowchart of Fig. 6.

[0153] The above scenario writing unit (131) can provide a web page for writing a test scenario including the development interface to a user terminal (10) connected to the service providing device (100) (S1).

[0154] Through this, the scenario writing unit (131) can write a test scenario while transmitting and receiving information with the user terminal (10) based on the web page.

[0155] In addition, the scenario writing unit (131) can generate terminal list information including mobile terminal information for one or more mobile terminals for writing the test scenario based on the terminal DB and provide the terminal list information to the user terminal (10) through the web page, and when receiving selection information including terminal identification information for a specific mobile terminal (30) selected from the terminal list information from the user terminal (10), the specific mobile terminal (30) corresponding to the selection information can be set as a scenario writing target, and a test scenario can be written based on the specific mobile terminal (30).

[0156] In addition, the scenario writing unit (131) can transmit screen request information to the management terminal (20) to request screen display image and screen configuration information from the mobile agent unit (31) of a specific mobile terminal (30) corresponding to the selection information.

[0157] Accordingly, the scenario writing unit (131) can receive the screen display image of the specific mobile terminal (30) from the management terminal (20) in a streaming manner, and can receive screen configuration information corresponding to the screen display image from the management terminal (20) (S2).

[0158] In addition, the scenario writing unit (131) can transmit the screen display image to the user terminal (10) in a streaming manner whenever the screen display image is received from the management terminal (20), and can display the received screen display image through a development interface included in the web page on the user terminal (10) (S3).

[0159] In addition, the scenario writing unit (131) can receive in real time operation information according to operation input for the specific mobile terminal (30) using the screen display image from the user terminal (10) through the web page (S4).

[0160] In addition, the scenario writing unit (131) can, when operation information (hereinafter, first operation information) including an input event for operation of a specific component and the coordinates where the input event occurred is received based on the screen display image, confirm a preset event type corresponding to the input event according to the first operation information based on preset setting information.

[0161] At this time, the event type may include touch, click, drag, drop, swipe, text input, etc., and the event type may be the same as the input event or may include the input event.

[0162] In addition, the scenario writing unit (131) may include preset setting information in which event types for a plurality of different input events are preset, and may identify (confirm) the event type corresponding to the input event of the first operation information based on the setting information.

[0163] In addition, the scenario writing unit (131) can identify and extract component information of a component corresponding to the coordinates according to the first operation information among one or more components that constitute a screen displayed on a specific mobile terminal (30) corresponding to the screen configuration information based on the screen configuration information from the screen configuration information (S5).

[0164] At this time, the above component information may be information that can identify the component.

[0165] Accordingly, the scenario writing unit (131) can generate event information (hereinafter, first event information) including an event type corresponding to the first operation information received from the user terminal (10) based on the screen display image and component information (hereinafter, first component information) extracted to correspond to the operation information (S6).

[0166] Additionally, the scenario writing unit (131) can store the first event information in the scenario DB included in the storage unit (120).

[0167] At this time, the scenario writing unit (131) may receive scenario identification information for writing (creating) a test scenario through the web page to the user terminal (10) and store it in the scenario DB, and match the first event information with the scenario identification information and store it in the scenario DB.

[0168] In addition, the scenario writing unit (131) can generate remote control information corresponding to the first operation information for operating the specific mobile terminal (30) located remotely based on the coordinates according to the first operation information and the type of event corresponding to the first operation information, and transmit the remote control information to the management terminal (20) so that the remote control information is transmitted to the specific mobile terminal (30) through the management terminal (20) (S7).

[0169] Accordingly, the mobile agent unit (31) configured in the specific mobile terminal (30) can perform a function of operating a specific component corresponding to the coordinates according to the remote control information among one or more components configured on the screen corresponding to the screen display image when receiving the remote control information, based on the remote control information, according to an input event corresponding to the event type according to the remote control information.

[0170] In addition, the mobile agent unit (31) can transmit a screen display image for a screen converted (converted) from an existing screen to an execution screen, which is the execution result of an application executed on the mobile terminal (30), according to the execution of a function corresponding to the remote control information, to the terminal agent unit (21) of the management terminal (20), and can transmit screen configuration information in XML format corresponding to the execution screen to the terminal agent unit (21).

[0171] In addition, the terminal agent unit (21) can transmit the screen display image corresponding to the execution screen received from the mobile terminal (30) to the service providing device (100) in a streaming manner, and transmit the screen configuration information corresponding to the execution screen received from the mobile terminal (30) to the service providing device (100).

[0172] Accordingly, the scenario writing unit (131) can provide a screen display image corresponding to the execution screen to the user terminal (10) and receive operation information corresponding to the execution screen from the user terminal (10).

[0173] At this time, the user terminal (10) can transmit second operation information including an input event for operation of the selected component and coordinates (location (coordinates) where the input event occurred) corresponding to the input event based on a user input for one or more components included in the execution screen from the screen display image for the execution screen to the service providing device (100).

[0174] Accordingly, the scenario writing unit (131) can, when receiving second operation information from the user terminal (10), search for screen configuration information corresponding to the execution screen based on the coordinates according to the second operation information, identify component information (hereinafter, second component information) corresponding to the coordinates according to the second operation information from the screen configuration information corresponding to the execution screen, and extract the identified second component information from the screen configuration information.

[0175] In addition, the scenario writing unit (131) can identify a preset event type corresponding to an input event according to the second operation information based on the setting information, generate event information (hereinafter, second event information) including the event type corresponding to the second operation information and the second component information, match it with the first event information, and accumulate and store the second event information in the scenario DB so that it is sequentially successive to the first event information.

[0176] At this time, the scenario writing unit (131) can match the second event information with the scenario identification information and accumulate and store it in the scenario DB.

[0177] In addition, the scenario writing unit (131) can generate remote control information including coordinates according to the second operation information and an event type corresponding to the second operation information in response to the second operation information, and transmit the remote control information corresponding to the second operation information to the management terminal (20).

[0178] Accordingly, the terminal agent unit (21) of the management terminal (20) transmits remote control information corresponding to the second operation information to the mobile agent unit (31) of the specific mobile terminal (30), and the mobile agent unit (31) can perform a function according to an input event corresponding to the second operation information on the component corresponding to the second operation information on the execution screen according to the remote control information received from the management terminal (20).

[0179] In addition, the mobile agent unit (31) may switch from the execution screen to another execution screen, which is the execution result of the application executed on the specific mobile terminal (30), according to the performance of a function according to remote control information corresponding to the second operation information, obtain a screen display image for the other execution screen from the operating system of the specific mobile terminal (30) and transmit it to the service providing device (100) in a streaming manner through the management terminal (20), and obtain screen configuration information for the other execution screen from the operating system of the specific mobile terminal (30) and transmit it to the service providing device (100) through the management terminal (20).

[0180] In addition, the scenario writing unit (131) can receive a screen display image and screen configuration information corresponding to the other execution screen, and provide the screen display image corresponding to the other execution screen to the user terminal (10), and when receiving third operation information including an input event from the user terminal (10) that has generated third operation information based on the screen display image corresponding to the other execution screen, the terminal agent unit (21) can link with the mobile agent unit (31) to generate third event information in the same manner as generating first event information based on the first operation information or generating second event information based on the second operation information, and can match the third event information with the second event information and accumulate and store it in the scenario DB as event information subsequent to the second event information in a lower priority, and can transmit remote control information corresponding to the third operation information to the mobile agent unit (31) of the specific mobile terminal (30) through the management terminal (20) so that a function according to the third operation information can be performed.

[0181] Even thereafter, the scenario writing unit (131) can generate one or more event information following the third event information in the same manner as the first to third event information described above, and can match the generated one or more event information with the preceding event information or with the scenario identification information in the order of generation and accumulate and store the same in the scenario DB.

[0182] In addition, the scenario writing unit (131) determines that the writing of the test scenario is completed based on the writing completion information received from the user terminal (10) (S8), and can generate test scenario information based on one or more event information accumulated and stored in the scenario DB (S9).

[0183] At this time, the test scenario information may include one or more event information matching the scenario identification information and the scenario identification information.

[0184] In addition, the scenario writing unit (131) can create test scenario information that sets test steps for each event information according to the order of creation of one or more of the event information, and can set test steps for each event information so that the earlier the creation order, the earlier the test step.

[0185] For example, the scenario writing unit (131) can set the first test step with the highest priority for the first event information generated first, set the second test step for the second event information generated next in order, and set the third test step for the third event information generated after the second event information, thereby generating test scenario information including event information for each of the first to third test steps.

[0186] At this time, the scenario writing unit (131) can generate test scenario information including event information for one or more test steps in the form of a script.

[0187] Additionally, the scenario writing unit (131) can store the test scenario information in the scenario DB.

[0188] As an example of the above-described configuration, as illustrated in FIG. 8, the scenario writing unit (131) may receive, from the user terminal (10), first operation information including coordinates corresponding to the location where the phone icon was clicked and an input event for the click input when an input event occurs in which a phone icon, which is a component included in the application selection screen, is clicked on the user terminal (10) based on a screen display image for an application selection screen including one or more application icons provided to the user terminal (10).

[0189] At this time, the scenario writing unit (131) can receive a screen display image corresponding to the application selection screen and first screen configuration information for the application selection screen received from the mobile agent unit (31) of a specific mobile terminal (30) through the terminal agent unit (21) of the management terminal (20) before receiving the first operation information, and transmit the screen display image to the user terminal (10) to receive the first operation information from the user terminal (10).

[0190] In addition, the scenario writing unit (131) can identify the type of event corresponding to the input event according to the first operation information based on preset setting information when receiving the first operation information.

[0191] In addition, as illustrated in FIG. 9, first component information related to a phone icon corresponding to the coordinates included in the operation information can be identified in the first screen configuration information corresponding to the application selection screen, and first component information corresponding to the phone icon can be extracted from the first screen configuration information.

[0192] Accordingly, the scenario writing unit (131) can generate first event information including the event type identified based on the first operation information and the first component information extracted from the first screen configuration information based on the first operation information, and then store the generated first event information in the scenario DB included in the storage unit (120).

[0193] At this time, the scenario writing unit (131) can store the first event information in the scenario DB by matching it with the scenario identification information received from the user terminal (10) and stored in the scenario DB for the purpose of generating the test scenario.

[0194] In addition, the scenario writing unit (131) can generate first remote control information including coordinates according to the first operation information and an event type corresponding to an input event according to the first operation information and transmit the same to the management terminal (20).

[0195] At this time, the first remote control information may include the same information as the first operation information, and may include terminal identification information of a specific mobile terminal (30) that is the target for use in creating the scenario.

[0196] Accordingly, the terminal agent unit (21) configured in the management terminal (20) can transmit the first remote control information to the specific mobile terminal (30), and the mobile agent unit (31) configured in the specific mobile terminal (30) can perform a function of clicking a phone icon on the application selection screen based on the first remote control information, so that a phone application corresponding to the phone icon is executed on the specific mobile terminal (30) according to the execution of the function, and a first execution screen according to the execution of the phone application is displayed on the specific mobile terminal (30), and can acquire a screen display image corresponding to the first execution screen and second screen configuration information corresponding to the first execution screen from an operating system operating in the specific mobile terminal (30) and transmit them to the management terminal (20).

[0197] The terminal agent unit (21) configured in the above management terminal (20) can transmit the second screen configuration information to the service providing device (100) while transmitting the screen display image received from the specific mobile terminal (30) to the service providing device (100) in a streaming manner.

[0198] Accordingly, as illustrated in FIG. 10, the scenario writing unit (131) can transmit a screen display image for the first execution screen according to the initial execution of the phone application to the user terminal (10), and receive second operation information including an input event according to a click of a button corresponding to '1' among the plurality of components constituting the first execution screen from the user terminal (10).

[0199] In addition, the scenario writing unit (131) can generate second remote control information including coordinates corresponding to the button according to the second operation information and an event type corresponding to the click-related input event, and then transmit the information to the specific mobile terminal (30) through the management terminal (20).

[0200] In addition, the scenario writing unit (131) can extract second component information for the button corresponding to the coordinates included in the second operation information from the second screen configuration information, and then generate second event information including the event type and the second component information, and then match it with the first event information or the scenario identification information and store it in the scenario DB.

[0201] In addition, the scenario writing unit (131) can receive the screen display image for the second execution screen, which is an execution screen converted to display '1' in the number display window included in the first execution screen, from a specific mobile terminal (30) that received the second remote control information and performed the function for clicking the button, and the screen display image and third screen configuration information corresponding to the second execution screen transmitted from the management terminal (20) that received the third screen configuration information, and can transmit the corresponding screen display image to the user terminal (10).

[0202] In addition, as illustrated in FIG. 11, when the scenario writing unit (131) receives third operation information for an operation of clicking the button again from the user terminal (10), it transmits third remote control information corresponding to the third operation information to the user terminal (10), and generates third event information including an event type corresponding to the third operation information and third component information (or second component information) corresponding to the button corresponding to '1' based on the third screen configuration information, and can accumulate and store the same in the scenario DB by matching it with the second event information or the scenario identification information.

[0203] In addition, the scenario writing unit (131) can receive the screen display image for the third execution screen, which is an execution screen converted to display '11' in the number display window included in the second execution screen by the phone application from a specific mobile terminal (30) that performed a function for clicking the button by receiving the third remote control information, and the screen display image and the fourth screen configuration information corresponding to the third execution screen transmitted from the management terminal (20) that received the fourth screen configuration information corresponding to the third execution screen, and can transmit the corresponding screen display image to the user terminal (10).

[0204] In addition, as illustrated in FIG. 12, when the scenario writing unit (131) receives fourth operation information for an operation of clicking the Home button among the plurality of components included in the third execution screen from the user terminal (10), the scenario writing unit (131) transmits fourth remote control information corresponding to the fourth operation information to the user terminal (10), and generates fourth event information including an event type corresponding to the fourth operation information and fourth component information corresponding to the Home button based on the fourth screen configuration information, and then accumulates and stores the fourth event information or the scenario identification information in the scenario DB by matching it.

[0205] In addition, the scenario writing unit (131) can receive the screen display image and the fifth screen configuration information transmitted from the management terminal (20) that received the screen display image for the fourth execution screen and the fifth screen configuration information corresponding to the fourth execution screen in a state where the third execution screen is converted to the fourth execution screen, which is the application selection screen, from a specific mobile terminal (30) that received the fourth remote control information and performed the function for clicking the home button, and can transmit the corresponding screen display image to the user terminal (10).

[0206] In addition, when receiving completion information on completion of writing of a test scenario from the user terminal (10), the scenario writing unit (131) can set test steps in the order of creation of the first event information, the second event information, the third event information, and the fourth event information matched with the scenario identification information stored in the scenario DB corresponding to the completion information, to create test scenario information including the first to fourth event information, and can store the test scenario information in the scenario DB.

[0207] Meanwhile, the test execution unit (132) can perform application testing on each of one or more mobile terminals (30) connected to the management terminal (20) based on the test scenario information, which will be described in detail with reference to the flowchart of FIG. 7.

[0208] For example, the test execution unit (132) can extract the test scenario information stored in the scenario DB according to preset schedule information or test request information received from the user terminal (10) (S11).

[0209] In addition, the test execution unit (132) can select one of one or more mobile terminals (30) connected to the management terminal (20) as a test target, and receive screen configuration information transmitted by the mobile agent unit (31) of the mobile terminal (30) (test terminal) selected as the test target through the management terminal (20) (S12).

[0210] Accordingly, the test execution unit (132) can extract scenario identification information from the test scenario information, extract terminal identification information for the test terminal from the terminal DB, match it with the scenario identification information, and store it in the test DB included in the storage unit (120).

[0211] At this time, the test execution unit (132) may store the test scenario information instead of the scenario identification information in the test DB.

[0212] In addition, the test execution unit (132) can identify the first component information corresponding to the first event information based on the first event information corresponding to the first test step, which is the most advanced test step according to the test scenario information, from the screen configuration information (hereinafter, 11th screen configuration information) initially transmitted by the mobile terminal (30) (hereinafter, test terminal) that is the test subject, and can identify and extract the coordinates corresponding to the first component information from the 11th screen configuration information (S13).

[0213] In addition, the test execution unit (132) generates first event control information including coordinates corresponding to the first component information and an event type according to the first event information and transmits the information to the terminal agent unit (21) of the management terminal (20), and the terminal agent unit (21) can transmit the first event control information to the test terminal (S14).

[0214] Accordingly, the terminal agent part (21) of the test terminal identifies a component corresponding to the first component information on the screen based on the coordinates according to the first event control information, and performs a function corresponding to the event type according to the first event control information for the identified component to execute an application (or a function of the application) corresponding to the identified component, and transmits other screen configuration information (hereinafter, 12th screen configuration information) corresponding to the execution screen which is the execution result of the application (function of the application) to the service providing device (100) through the management terminal (20).

[0215] In addition, the test execution unit (132) can generate event result information (first event result information) including the 12th screen configuration information received from the management terminal (20), which is an execution result according to the execution of the 1st test step, and the 12th screen configuration information, and store the event result information (first event result information) in the test DB by matching it with the scenario identification information (S15).

[0216] In addition, the test execution unit (132) can identify second component information corresponding to the second event information based on second event information corresponding to the second test step corresponding to the next order of the first test step according to the test scenario information, identify coordinates corresponding to the second component information from the 12th screen configuration information, and generate second event control information including the coordinates corresponding to the second component information and the event type according to the second event information, and transmit the second event control information to the test terminal through the management terminal (20) (S16, 17, 19).

[0217] Accordingly, the mobile agent part (31) of the test terminal identifies a component corresponding to the second component information based on the coordinates according to the second event control information, and performs a function corresponding to the event type according to the second event control information for the identified component so that an application (or a function of the application) corresponding to the identified component is executed, and can transmit another screen configuration information (hereinafter, 13th screen configuration information) corresponding to an execution screen which is an execution result of the application (or function of the application) to the service providing device (100) through the management terminal (20).

[0218] In addition, the test execution unit (132) can generate event result information including the 13th screen configuration information and the 2nd test step, which is an execution result according to the execution of the 2nd test step when the 13th screen configuration information is received, and then match it with the scenario identification information and store it in the test DB.

[0219] In this way, the test execution unit (132) can perform a test as described above for each of the remaining test steps included in the test scenario information.

[0220] In addition, the test execution unit (132) can check component information in event information corresponding to another test step corresponding to the next order of the test step included in the event result information based on the test scenario information when generating the event result information, and can check the screen configuration information in the event result information.

[0221] In addition, the test execution unit (132) can determine whether the component information of the other test step exists in the screen configuration information included in the event result information (S16), and can determine whether there is a problem with the event result information based on whether the component information of the other test step exists in the screen configuration information according to the event result information (S17).

[0222] That is, the test execution unit (132) determines that a failure has occurred when the component information included in the event information corresponding to a specific test step according to the test scenario information does not exist in the screen configuration information included in the event result information corresponding to the test step immediately before the specific test step, and can generate failure occurrence information for the immediately before test step (S18).

[0223] In other words, if the screen configuration information corresponding to the test step immediately before the specific test step does not contain information about a component that is the execution target of the input event corresponding to the specific test step, the test execution unit (132) can determine that the specific test step cannot be performed because the component that is the selection target of the specific test step is not on the screen, and thus it can be determined as a failure.

[0224] As an example of this, the test execution unit (132) identifies second component information corresponding to the second event information based on the second event information corresponding to the second test step when performing the second test step corresponding to the next order of the first test step according to the test scenario information, and checks whether the second component information exists in the 12th screen configuration information received from the management terminal (20), which is an execution result according to the execution of the first test step, and if the second component information does not exist in the 12th screen configuration information, determines that a failure has occurred, and generates failure occurrence information including first event result information including the 12th screen configuration information.

[0225] In addition, the test execution unit (132) completes all test steps according to the test scenario information (S19), and if no failure occurs during the test process according to the test scenario information, it can generate test result information including event result information for each test step stored in the test DB, and then match it with the scenario identification information and store it in the test DB (S20).

[0226] In addition, the test execution unit (132) can generate test result information including the failure occurrence information when a failure occurs during a test process according to the test scenario information, and then match it with the scenario identification information and store it in the test DB.

[0227] At this time, the test execution unit (132) can extract terminal identification information corresponding to the test terminal from the terminal DB and include it in the test result information.

[0228] Meanwhile, the test execution unit (132) performs a test by sequentially automatically transmitting event control information for each of one or more test steps according to the test scenario information, and checks the response time for each test step according to the reception time of each of one or more different screen configuration information, and measures the quality by applying the response time for each test step to a preset quality measurement standard, and generates quality information on the measured quality and includes it in the test result information.

[0229] In addition, the test execution unit (132) can transmit (transmit) video request information to the test terminal via the management terminal (20) to request a video related to a specific test step corresponding to the failure occurrence information when the failure occurrence information is generated.

[0230] In addition, the test execution unit (132) may receive recording information transmitted by the test terminal in response to the video request information through the management terminal (20), and, when receiving the recording information, may match it with the scenario identification information and store it in the test DB, and may also include the recording information in the test result information.

[0231] In addition, the test execution unit (132) may transmit notification information to the user terminal (10) or a preset contact when generating test result information including the failure occurrence information to notify of the occurrence of a failure (abnormality), and may transmit the notification information by including link information that can access the test result information including the failure occurrence information.

[0232] Through this, the test execution unit (132) can notify a user or administrator who manages application testing according to test scenario information of the occurrence of a failure and provide a video so that the failure occurrence status can be confirmed through the video according to the recording information.

[0233] Alternatively, the test execution unit (132) may determine that a delay or error has occurred during the execution of the application and that a quality problem has occurred based on the quality information included in the test result information and does not satisfy a preset quality standard, and may transmit the video request information to the test terminal, and may generate the notification information corresponding to the test result information that does not satisfy the quality standard and transmit it to the user terminal (10) or a preset contact.

[0234] In addition, when the generation of test result information corresponding to the test terminal is completed, the test execution unit (132) automatically designates (selects) another mobile terminal (30) connected to the management terminal (20) as a test target according to preset schedule information or the test request information, or automatically designates a mobile terminal (30) connected to another management terminal (20) communicating with the service providing device (100) as a test target, and generates test result information for the designated test target mobile terminal (30) as described above and stores the information in the test DB, and generates the information in the test DB for each of a plurality of different mobile terminals (30) that can communicate through one or more management terminals (20).

[0235] Meanwhile, the dashboard management unit (133) can analyze one or more test result information stored in the test DB to generate analysis result information in a dashboard display format, and provide (transmit) the analysis result information to the user terminal (10) or a preset contact.

[0236] The user terminal (10), management terminal (20), mobile terminal (30), and service providing device (100) described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components.

[0237] Additionally, the components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding.

[0238] The user terminal (10), management terminal (20), mobile terminal (30), and service providing device (100) can execute an operating system (OS) and one or more software applications executed on the operating system.

[0239] The service providing method according to the embodiment of the present invention described in the above-described embodiment can be written as a computer program, and the codes and code segments constituting the computer program can be easily inferred by a computer programmer in the relevant field. In addition, the computer program is stored in a computer-readable information storage medium, and is read and executed by a computer or a user terminal (10), a management terminal (20), a mobile terminal (30), a service providing device (100), etc. according to the embodiment of the present invention, thereby implementing the service providing method according to the embodiment of the present invention.

[0240] Information storage media include magnetic recording media and optical recording media. A computer program implementing a service provision method according to an embodiment of the present invention may be stored and installed in the built-in memory of a user terminal (10), a management terminal (20), a mobile terminal (30), or a service provision device (100). Alternatively, an external memory, such as a smart card, storing and installing a computer program implementing a service provision method according to an embodiment of the present invention may be mounted on a user terminal (10), a management terminal (20), a mobile terminal (30), or a service provision device (100) via an interface.

[0241] The various devices and components described herein may be implemented using hardware circuitry (e.g., CMOS-based logic circuitry), firmware, software, or a combination thereof. For example, they may be implemented using transistors, logic gates, and electronic circuits in various electrical structures.

[0242] Those skilled in the art will appreciate that modifications and variations of the above-described content may be made without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed herein are intended to illustrate, rather than limit, the technical spirit of the present invention, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included within the scope of the present invention.

[0243] Description of the symbol

[0244] 10: User terminal 20: Management terminal

[0245] 21: Terminal agent part 30: Mobile terminal

[0246] 31: Mobile Agent Unit 100: Service Providing Device

[0247] 110: Communications 120: Storage

[0248] 130: Control Unit 131: Scenario Writing Unit

[0249] 132: Test Execution Department 133: Dashboard Management Department

Claims

1. A mobile agent unit configured to transmit a screen display image for a screen of the mobile terminal, obtain and provide screen configuration information including coordinates and component information for each operable component of the screen that is used in the operating system of the mobile terminal for the screen display, and perform a function according to the remote control information when receiving remote control information for operating the mobile terminal; A terminal agent unit configured in a management terminal communicating with the mobile terminal, which receives the screen display image and transmits it in a streaming manner, receives and transmits the screen configuration information corresponding to the screen display image, and receives and transmits the remote control information to the mobile terminal; and A service providing system for application testing, comprising a service providing device that provides a web page for creating a test scenario for an application installed on the mobile terminal, provides a screen display image received from the terminal agent unit through the web page, generates remote control information according to operation information for any one of one or more components included in the screen display image and transmits the remote control information to the terminal agent unit, extracts component information corresponding to the operation information from the screen configuration information and generates event information including the same, and generates test scenario information by accumulating one or more event information generated until the test scenario creation is completed.

2. In paragraph 1, The above event information includes a preset event type corresponding to an input event according to the above operation information, A service providing system for application testing, characterized in that the above event type includes at least one of touch, click, drag, drop, swipe, and text input.

3. In paragraph 1, A service providing system for application testing, wherein the above screen configuration information is information in XML format used for screen display in the operating system of the mobile terminal, and includes all types of component information displayed on the screen.

4. In paragraph 1, A service providing system for application testing, characterized in that the service providing device sets test steps for each event information according to the order in which the event information is generated, and generates and stores test scenario information including event information for one or more test steps in the form of a script.

5. In paragraph 4, The service providing device selects another mobile terminal communicating with the management terminal as a test terminal for a test according to the test scenario information, performs a test targeting the test terminal based on event information corresponding to a test step included in the test scenario information, identifies component information according to the event information included in the test scenario information from screen configuration information received from the test terminal, extracts coordinates corresponding to the identified component information from the screen configuration information, generates event control information for causing a function according to the event information to be performed for a component corresponding to the identified component information based on the extracted coordinates and event information, and transmits the event control information to a terminal agent unit of the management terminal so that the event control information is transmitted to the test terminal, and receives screen configuration information for an execution screen switched by an application executed according to the function performance according to the event control information from the management terminal as a response to the event control information, and then generates event result information including the screen configuration information for the execution screen and the test step corresponding to the event control information, thereby performing a test for each test step to generate event result information, and upon termination of the test for all test steps, generates test result information including the event result information for each test step. A service provision system for application testing.

6. In paragraph 5, A service providing system for application testing, characterized in that the service providing device determines that a failure has occurred when component information included in event information corresponding to a specific test step according to the test scenario information does not exist in screen configuration information included in event result information corresponding to a test step immediately preceding the specific test step, generates failure occurrence information for the immediately preceding test step, and generates test result information including the failure occurrence information.

7. In paragraph 6, The above mobile agent unit records the screen of the mobile terminal from the start to the end of the test according to the test scenario information, creates recording information including a video, and then stores it. The above service providing device transmits video request information for the video request to the terminal agent unit when the above failure occurrence information is generated, A service providing system for application testing, characterized in that the terminal agent unit transmits the video request information to the mobile agent unit when receiving the video request information, and transmits the recording information received from the mobile agent unit to the service providing device so that it is included in the test result information.

8. In a service provision method for application testing of a service provision device, A step of acquiring a screen display image and screen configuration information for the screen of the mobile terminal transmitted by the mobile terminal; A step of providing a web page including the screen display image for creating a test scenario of an application installed on the mobile terminal, and receiving operation information for one or more components included in the screen display image; A step of generating the remote control information according to the above operation information and transmitting it to the mobile terminal, extracting component information corresponding to the operation information from the screen configuration information including coordinates and component information for each operable component of the screen used in the operating system of the mobile terminal to display a screen corresponding to the screen display image, and generating event information including the extracted component information; and A service providing method for application testing, comprising a step of generating test scenario information by accumulating one or more event information generated until the above test scenario writing is completed.

9. A non-volatile computer-readable recording medium having recorded thereon a computer program for causing a computer to perform the method according to Article 8.

10. A communication unit that communicates through a communication network; and A service providing device for application testing, comprising a control unit that obtains a screen display image and screen configuration information for a screen of a mobile terminal transmitted by the mobile terminal through the communication unit, provides a web page including the screen display image for creating a test scenario for an application installed on the mobile terminal, receives operation information for any one of one or more components included in the screen display image through the communication unit, generates the remote control information according to the operation information and transmits it through the communication unit so that it is transmitted to the mobile terminal, extracts component information corresponding to the operation information from the screen configuration information including coordinates and component information for each operable component of the screen used in the operating system of the mobile terminal for displaying a screen corresponding to the screen display image, and generates event information including the extracted component information, and generates test scenario information by accumulating one or more event information generated until the test scenario creation is completed.

Citation Information

Patent Citations

  • System, verification apparatus, terminal device, method and computer-readable recording medium for verifying application

    KR1020150024972A

  • Vaccine composition for oral administration comprising an inactivated microbial cell encapsulated by a hydrogel

    KR102115708B1

  • Method for providing remote test service for mobile application

    KR102173137B1

  • Steel structure with improved moment responsiveness

    KR102487782B1

  • Event-driven automation testing for mobile devices

    US20160283356A1