Popup window processing method and device, equipment, medium and product

By detecting and handling occluded windows in UI automation testing, the problem of test interruption caused by the sudden appearance of pop-ups was solved, improving testing efficiency and accuracy.

CN118916258APending Publication Date: 2024-11-08DOUYIN VISION CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310512869.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-08
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

During UI automation testing, the sudden appearance of pop-ups can interrupt the testing process, leading to low testing efficiency.

Method used

By detecting the response elements in the user interface's operation logic tree, determining whether they are in an obscured state, and capturing the obscured window to execute pop-up processing, the continuity of the test is ensured.

Benefits of technology

It enables timely handling of pop-ups during automated user interface testing, improving testing efficiency and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118916258A_ABST
    Figure CN118916258A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a pop-up window processing method and device, equipment, a medium and a product. The method comprises the following steps: in response to a click operation executed on a user interface, obtaining an element coordinate corresponding to an element specified by the click operation; according to an operation logic tree corresponding to the user interface, response elements of the element coordinates in the operation logic tree are detected, and the operation logic tree is of a tree structure formed by connecting a plurality of elements of the user interface according to the processing logic of the elements; if it is determined that the first window where the response element is located is in the shielding state, a second window shielding the first window is captured; and performing popup processing on the second window based on the popup processing logic to obtain a processing result of the second window. The problem that the pop-up window interrupts the user interface test process is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular, to a pop-up window processing method, device, equipment, medium and product. Background Art

[0002] UI (User Interface) automation testing can refer to automatically executing click operations on controls in the human-computer interaction interface so that the UI page automatically responds to the page operations and realizes the execution of controls.

[0003] Automated testing of the UI can include automatic processing of pop-up windows that appear during the running of the application, such as closing the pop-up window, clicking on the link in the pop-up window, etc. Pop-up windows can appear during the interaction between the application and the user, and the user needs to perform corresponding processing before using other functions of the APP. However, the timing of the pop-up window appears suddenly, resulting in the inability to process the pop-up window in time, causing the UI test to fail, and then causing the entire APP's automated testing process to be interrupted, resulting in reduced testing efficiency. Summary of the invention

[0004] The embodiments of the present disclosure provide a pop-up window processing method, device, equipment, medium and product to overcome the problem of interruption of the automated testing process of an application program, resulting in low testing efficiency.

[0005] In a first aspect, an embodiment of the present disclosure provides a pop-up window processing method, including:

[0006] In response to a click operation performed on the user interface, obtaining element coordinates corresponding to an element specified by the click operation;

[0007] According to the operation logic tree corresponding to the user interface, detecting the response element of the element coordinate in the operation logic tree, the operation logic tree is a tree structure formed by connecting multiple elements of the user interface according to the processing logic of each element;

[0008] If it is determined that the first window where the response element is located is in an obstructed state, capturing the second window that obstructs the first window;

[0009] Perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0010] In a second aspect, an embodiment of the present disclosure provides a pop-up window processing device, including:

[0011] A click response unit, used to obtain, in response to a click operation performed on the user interface, element coordinates corresponding to the element specified by the click operation;

[0012] An element detection unit, used to detect a response element of an element coordinate in an operation logic tree according to an operation logic tree corresponding to the user interface, wherein the operation logic tree is a tree structure formed by connecting multiple elements of the user interface according to the processing logic of each element;

[0013] A window capturing unit, configured to capture a second window that blocks the first window if it is determined that the first window where the response element is located is in a blocked state;

[0014] The pop-up window processing unit is used to perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0015] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0016] Memory stores computer-executable instructions;

[0017] The processor executes the computer execution instructions stored in the memory, so that at least one processor executes the pop-up window processing method as described in the first aspect and various possible designs of the first aspect.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the pop-up window processing method as described in the first aspect and various possible designs of the first aspect is implemented.

[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the pop-up window processing method as described in the first aspect and various possible designs of the first aspect.

[0020] The technical solution provided in this embodiment can automatically detect and process pop-up windows during the process of executing automated testing on the user interface. Through the detection and automated processing of pop-up windows, timely processing of pop-up windows during the automated testing of the user interface is achieved, thereby ensuring the continuity of the automated testing execution of the user interface and improving the testing efficiency and accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 An example diagram of an application of the pop-up window processing method provided in an embodiment of the present disclosure;

[0023] Figure 2 A flowchart of an embodiment of a pop-up window processing method provided by an embodiment of the present disclosure;

[0024] Figure 3 An example diagram of a pop-up window processing method provided in an embodiment of the present disclosure;

[0025] Figure 4 A flow chart of another embodiment of a pop-up window processing method provided by the embodiment of the present disclosure;

[0026] Figure 5 A schematic diagram of the structure of an embodiment of a pop-up window processing device provided by an embodiment of the present disclosure;

[0027] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0029] The technical solution disclosed in the present invention can be applied to the automated testing scenario of the user interface. By detecting the element coordinates of the operation logic tree of the user interface, the response element can be captured, and the corresponding pop-up window detection can be implemented according to the state of the response element, and pop-up window processing can be performed on the detected pop-up window, thereby realizing automatic detection and processing of pop-up windows that appear in the interface testing process, ensuring the continuity of the automated testing execution of the user interface, and improving the testing efficiency and accuracy.

[0030] In the related art, the automated testing of the user interface (UI) can refer to automatically executing operations such as clicking on controls in the human-computer interaction interface so that the UI page can be automatically tested. However, during the UI automated testing process, pop-up windows often appear. If the pop-up windows are not handled in a timely manner, the UI testing process will be interrupted. At present, the timing of the pop-up window is generally uncertain. Therefore, if the pop-up window cannot be detected in time, the UI test will also fail, which will in turn interrupt the automated testing process of the entire APP and reduce the testing efficiency.

[0031] In order to solve the above technical problems, the technical solution disclosed in the present invention can, in the process of performing automated testing on the user interface, detect the operation logic tree of the user interface for the element coordinates corresponding to the element specified by the click operation during the test, and obtain the response element of the element coordinates in the operation logic tree. The operation logic tree can be constructed based on multiple elements of the user interface according to the processing logic connection of each element. After the response element is obtained, it can be detected whether the first window of the response element is in an obstructed state. If it is in an obstructed state, the second window that obstructs the first window can be captured. The corresponding pop-up window processing is performed on the second window through the pop-up window processing logic to obtain the processing result of the second window. Through the detection and automated processing of pop-up windows, timely processing of pop-up windows in the automated testing process of the user interface is achieved, which ensures the continuity of the automated testing execution of the user interface and improves the testing efficiency and accuracy.

[0032] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0033] Figure 1 It is an application example diagram of the pop-up window processing method provided according to the embodiment of the present disclosure. According to the embodiment of the present disclosure, during the test process of the user interface, multiple terminal devices 11 can be set, each terminal device 11 can be connected to an electronic device 12, and the electronic device 12 can control the test process of the multiple terminal devices 11. For example, the electronic device 12 can send an automatic test program of the user interface to the multiple terminal devices 11, and each terminal device 11 can perform an automatic test of the user interface based on the automatic test program.

[0034] Specifically, the terminal device 11 can be configured with the pop-up window processing method provided by the present disclosure, and the click operation performed on the user interface can obtain the element coordinates corresponding to the element specified by the click operation. According to the operation logic book corresponding to the user interface, the response element of the element coordinates in the operation logic tree is detected. The operation logic tree is composed of multiple elements of the user interface connected according to the processing logic of each element. The response element corresponding to the element coordinate can be obtained through the operation logic tree. By detecting the state of the first window corresponding to the response element, the second window that blocks the first window can be captured when the first window is in an obstructed state. The pop-up window processing logic performs pop-up window processing on the second window to obtain the processing result of the second window. Therefore, in the actual test process of the terminal device 11, the accurate detection of the pop-up window can be achieved by detecting the obstruction state of the window, and the windows that appear during the test can be detected in time, and processed quickly to improve the test efficiency and accuracy.

[0035] refer to Figure 2 , Figure 2 This is a flowchart of an embodiment of a pop-up window processing method provided in an embodiment of the present disclosure. The pop-up window processing method may include the following steps:

[0036] 201: In response to a click operation performed on a user interface, obtain element coordinates corresponding to an element specified by the click operation.

[0037] Optionally, the method disclosed herein may be executed during the automatic testing process of the application program executed by the terminal device, and specifically, the pop-up window processing method disclosed herein may be started when the automatic testing is performed on the target program. The user interface may be a page displayed in the target program. For example, a home page, a video playback page, etc., and the specific type of the user interface is not excessively limited in this embodiment.

[0038] The click operation can be a trigger operation performed by the automated test program of the target program on the user interface, and the click operation can be generated during the user interface test. In practical applications, the click operation can be, for example, a UI action (user interface response) that can configure the button style on the user interface and the event to be triggered after clicking the button, and can include the coordinates of the element being clicked.

[0039] The click operation may also include the element information of the specified element, such as the element name, element identifier, etc. By responding to the click operation, the coordinates of the clicked element can be determined in a timely manner. An element, or interface element, refers to a series of elements that meet the user's interaction needs contained in a software or system interface that can meet the interaction needs. Specifically, it may refer to objects such as controls, images, and text areas in the user interface that can interact with the user to achieve corresponding operation responses.

[0040] 202: According to the operation logic tree corresponding to the user interface, detect the response element of the element coordinate in the operation logic tree, where the operation logic tree is formed based on multiple elements of the user interface and connected according to the processing logic of each element.

[0041] Optionally, the logic operation tree (UI Tree) refers to a tree structure formed by connecting the elements in the user interface as nodes according to the processing logic of the elements. The functions of the nodes in the logic operation tree can be obtained according to the element coordinate detection. Each node of the operation logic tree can be associated with relevant element information, such as element position or element area, element name, type, identification and other information.

[0042] The operation logic tree can be established during the use of the user interface. After obtaining the element coordinates, the element coordinates can be matched with the nodes in the operation logic tree, and the element corresponding to the node matching the element coordinates can be used as the response element. Among them, matching the element coordinates with the nodes in the operation logic tree can include: comparing the element coordinates with the position or area corresponding to the node in the operation logic tree to obtain the coordinate point comparison result. If the difference between the coordinates and the position is small or the coordinates belong to the element area of ​​a node, the node is determined to be the corresponding element as the response element.

[0043] 203: If it is determined that the first window where the response element is located is in an obstructed state, capture the second window that obstructs the first window.

[0044] Optionally, the view window where the response element is located may be the first window. The view window of the response element in the user interface may be captured to obtain the first window. For example, the window of the response element may be obtained by obtaining a window function, such as capturing a window handle by obtaining a window function, and representing the window function by a window handle. The window may be determined by a window handle. Similarly, the second window may be captured by obtaining a window function, and specifically, the handle of the second window may be obtained by a window obtaining function.

[0045] 204: Perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0046] Optionally, the pop-up window processing logic can be a processing logic executable on the pop-up window, such as the closing logic of the pop-up window and the click logic of a control in the pop-up window. The processing logic of each pop-up window can be preset, and the pop-up window can be automatically processed through the pop-up window processing logic to improve the processing efficiency of the pop-up window.

[0047] In this embodiment, in the process of performing automated testing on the user interface, the element coordinates corresponding to the element specified by the click operation during the test can be detected by the operation logic tree of the user interface, and the response element of the element coordinates in the operation logic tree can be obtained. The operation logic tree can be formed based on multiple elements of the user interface according to the processing logic connection of each element. After the response element is obtained, it can be detected whether the first window of the response element is in an obstructed state. If it is in an obstructed state, the second window that obstructs the first window can be captured. The corresponding pop-up window processing is performed on the second window through the pop-up window processing logic to obtain the processing result of the second window. Through the detection and automated processing of the pop-up window, the timely processing of the pop-up window in the automated testing process of the user interface is realized, which ensures the continuity of the automated testing execution of the user interface and improves the test efficiency and accuracy.

[0048] Further, based on the above embodiment, according to the operation logic tree corresponding to the user interface, detecting the response element of the element coordinate in the operation logic tree includes:

[0049] Get the operation logic tree corresponding to the user interface.

[0050] Generates click tests for operating the logic tree based on element coordinates.

[0051] Execute a click test and obtain the response element in the operation logic tree that responds to the click test.

[0052] Optionally, generating a click test for the operation logic tree according to the element coordinates may include: determining a click test function, inputting the element coordinates into the click test function, and running the click test function to perform the click test. The click test function may be generated based on the operation logic tree, and the element click operation is set according to the processing logic of each element, with the input being the element coordinates and the output being the click test result. The click test result includes the response element corresponding to the clicked element coordinates.

[0053] That is, executing the click test may include: inputting element coordinates into a click test function, running the click test function with the element coordinates input, obtaining a click test result of the click test function, and obtaining a response element.

[0054] In this embodiment, the operation logic tree of the user interface can be obtained. The operation logic tree can be a tree structure formed by connecting the elements of the user interface according to their processing logic. The operation logic tree can provide a click response of the user interface. Therefore, after obtaining the element coordinates, a click test for the logic operation tree can be generated. By executing the click test, a response element in the operation logic tree that responds to the click test can be obtained. By generating the click test in real time, the response element corresponding to the click operation can be detected in time, which can improve the detection efficiency and accuracy of the response element.

[0055] For ease of understanding, Figure 3 This is an example diagram of a pop-up window processing method provided by an embodiment of the present disclosure. Figure 3 , the pop-up window processing method may include the following steps:

[0056] 301: Get the element coordinates (x, y) corresponding to the click operation.

[0057] 302: Generate a click test click(x,y) for the UI tree according to the element coordinates.

[0058] 303: Execute a click test and obtain a response element in the UI Tree that responds to the click test.

[0059] 303: Perform window detection on the response element to determine whether the first window of the response element is blocked. If yes, execute step 304. If no, continue to execute the next click operation and return to step 301 to continue execution.

[0060] 304: Capture the second window that blocks the first window.

[0061] Optionally, the second window that blocks the first window can be executed by a window capture method, that is, the second window that blocks the first window can be captured by a window call method. In addition, the second window that blocks the first window can be obtained by detecting a window handle and testing a window response by a handle. Of course, the above-mentioned window capture and blocking method is not limited to this, and any method that can capture the second window that blocks the first window belongs to the implementation scheme of this embodiment.

[0062] Of course, in practical applications, the second window may include at least one, that is, one window may be blocked by multiple windows at the same time. Of course, there may be an blocking relationship among the multiple second windows blocking the first window. Through steps 301-304, the second window blocking other windows can be continuously captured, and the newly captured second window can also be used as a new first window. There is a second window blocking the new first window. In this embodiment, the number of blocked windows and the number of blocking levels are not specifically limited.

[0063] In this embodiment, the first window and the second window may refer to different windows, and the windows are not distinguished from the perspectives of window size, content, etc.

[0064] 305: Perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0065] In this embodiment, after obtaining the element coordinates, an accurate response element can be obtained by performing a click test on the element coordinates. By obtaining the response element, a window detection can be performed on the response element to determine whether the first window of the response element is blocked, that is, the second window blocking the first window can be found in time through the blockage detection. By clicking the test, window capture can be achieved, and pop-up window detection can be achieved through the captured window, thereby improving the efficiency and accuracy of pop-up window detection.

[0066] Further, based on any of the above embodiments, determining that the first window where the response element is located is in a blocked state includes:

[0067] Determines the window level of the responding element in the first window.

[0068] According to the window level, detect whether there is a pop-up window in the upper level of the response element.

[0069] If so, it is determined that the first window where the response element is located is in an obstructed state.

[0070] Optionally, a window hierarchy can be set for each element in the user interface. The window hierarchy can be the display order of windows on the screen. The window hierarchy of the user interface can include multiple levels, for example, the common window hierarchy is 0-36 levels, a total of 37 levels.

[0071] After obtaining the window level corresponding to the first window of the response element, it is possible to obtain whether there is a pop-up window at the upper level of the window level. If there is a pop-up window at the upper level of the window level, it is determined that there is a pop-up window and that the response element is in a blocked state in the first window.

[0072] In this embodiment, when occlusion detection is performed on the first window, the window level of the response element in the first window can be determined. Through the window level, it can be detected whether there is a pop-up window at the upper level of the response element. Through the detection of the window level, effective detection of windows at different levels can be achieved, thereby improving the detection efficiency and accuracy of the window occlusion status.

[0073] Further, based on any of the above embodiments, determining that the first window where the response element is located is in a blocked state includes:

[0074] Call the selected test method of the response element to obtain the return result of the selected test method. The selected test method is used to perform a window selection operation on the response element.

[0075] If it is determined that the returned result does not satisfy the occlusion condition, then it is determined that the response element is in an unoccluded state.

[0076] If it is determined that the returned result satisfies the occlusion condition, it is determined that the response element is in an occlusion state.

[0077] Optionally, the selection test method of the response element may be a method for capturing the response element and performing an operation response when a click operation is performed on the response element. The window of the response element may be obtained through the selection test method.

[0078] When the window of the response element does not satisfy the occlusion condition, it can be determined that the response element is in an unoccluded state. When the window of the response element satisfies the occlusion condition, it can be determined that the response element is in an occluded state.

[0079] In practical applications, the technical solution of the present invention can be implemented by any software system, such as any of the iOS system, Android system and other systems. The selected test method can be, for example, the hitTest method, which can detect the response elements under specific coordinates and feedback the response window.

[0080] In this embodiment, the selection test method of the response element can be called, and the response element can be tested by the selection test method. The real-time test of the response element can be realized by the selection test method. If the test can be performed normally, it means that the response element is not blocked. Therefore, the blocking condition is detected by the return result of the selection test method. If the return result indicates that the blocking condition is not met, it means that the response element is in an unblocked state. If the return result indicates that the blocking condition is met, it means that the response element is in a blocked state. Through the selection test of the response element, the click test of the response element can be realized to detect whether the response element responds, obtain the detection result of the blocking condition, and then determine the blocking state of the response element through the detection result of the blocking condition, thereby improving the detection efficiency and accuracy of the blocking state.

[0081] Further, based on the above embodiment, the returned result includes the window of the response element, and determining that the returned result does not meet the occlusion condition includes:

[0082] If the detection result does not have an execution association relationship with other windows, it is determined that the returned result does not meet the occlusion condition;

[0083] If the detection result is associated with other windows, it is determined that the returned result does not meet the occlusion condition.

[0084] Optionally, the execution association relationship may be a display order relationship between two windows, wherein a window with a higher level is displayed and processed before a window with a lower level, and a window with a lower level is displayed and processed after a window with a higher level.

[0085] If the returned result has no execution association relationship with other windows, it means that the returned window is not associated with other windows and can be executed independently, so it can be determined that the returned result does not meet the occlusion condition. If the returned result has an execution association relationship with other windows, it means that the returned window is associated with other windows and other windows need to be executed first before the window in the returned result is executed.

[0086] In this embodiment, the returned result may include the window of the response element. If the detection return result does not have an execution association relationship with other windows, it means that the window of the response element is the level currently clicked, and the result can be returned that does not meet the occlusion condition. If the detection return result has an execution association relationship with other windows, it means that the returned result needs to be associated with other windows for execution, and the high-level window needs to be executed first and then the low-level window level needs to be executed. By performing execution association detection on the window of the response element and other windows, a direct window judgment can be made on whether the response element meets the occlusion condition, which can improve the detection efficiency and accuracy of the occlusion condition.

[0087] Further, based on the above embodiment, the returned result includes the window level of the response element, and detecting whether the returned result has an execution association relationship with other windows includes:

[0088] If the window level corresponding to the returned result is higher than the reminder level of the user interface window, it is determined that the returned result has an execution association relationship with other windows;

[0089] Alternatively, if the returned result is a key window, it is determined that the returned result has an execution association relationship with other windows;

[0090] Alternatively, if the window level of the returned result is higher than the horizontal status bar level of the user interface window, it is determined that the returned result has an execution association relationship with other windows;

[0091] Alternatively, if the returned result is a keyboard window, it is determined that the returned result has an execution association relationship with other windows.

[0092] Optionally, the user interface window (UIWindow) can be sorted according to the level of Uiwindow when displayed, that is, windows with higher levels are sorted before windows with lower levels. The reminder level (UIWindowLevelAlert) of the user interface window can be a display level of the UI window, which can be used to define windows at the reminder level.

[0093] The key window (keyWindow) may be a window for displaying a key control, such as a confirmation control, a cancel control, and the like.

[0094] The keyboard window (UITextEffectsWindow) can be a window that displays a keyboard and detects user input, and can obtain text content by interacting with the user's input operation.

[0095] The horizontal status bar level (UIWindowLevelStatusBar) is one of the three window levels defined in the IOS system. This level is used to display horizontal status controls.

[0096] Three levels of UI windows are defined in the iOS system:

[0097] UIWindowLevelNormal (normal level), UIWindowLevelAlert (alert level), UIWindowLevelStatusBar (horizontal status bar level). Window levels of different levels are used to display different windows. In actual applications, a level can also include multiple sub-levels, which will not be described here one by one. The size of different window levels can be set according to actual usage requirements. For example, the normal level can be smaller than the alert level.

[0098] In this embodiment, when judging the execution association relationship between the window of the response element and other windows, it is possible to accurately judge whether there is an execution association relationship between the window of the response element and other windows by comparing with the reminder level of the user interface window, judging the type of the key window, comparing the window level with the horizontal status bar level of the user interface window, or judging the category of the keyboard window, thereby improving the judgment efficiency and accuracy of the response element.

[0099] Further, based on the above embodiment, in response to a click operation performed on the user interface, after obtaining the element coordinates corresponding to the element specified by the click operation, the above method may further include:

[0100] Determine the target element corresponding to the element coordinates;

[0101] Perform element matching processing on the response element and the target element to obtain the element matching result;

[0102] If the element matching result is that the response element and the target element are different, or there is no descendant relationship between the response element and the target element, it is determined that the first window where the response element is located is in an obstructed state.

[0103] Optionally, performing element matching processing on the response element and the target element may include determining whether the response element and the target element are the same element, and detecting whether there is a descendant relationship between the response element and the target element.

[0104] Specifically, determining whether the response element and the target element are the same element may include: comparing the element names of the response element and the target element or comparing the element handles, etc. If the element names are the same or the element handles are the same, then it is determined that the response element and the target element are the same element; otherwise, it can be determined that the response element and the target element are different elements.

[0105] Specifically, determining whether the response element and the target element have a descendant relationship may include: the response element and the target element are different elements, and there is a processing association between the response element and the target element.

[0106] The element matching result can be used to determine whether a pop-up window exists, and whether the response element is in a blocked state in the first window can be determined based on the element matching result.

[0107] Further, optionally, the element matching result may include that the response element and the target element are the same, or that the response element and the target element are different. The element matching result may also include: the response element and the target element have a descendant relationship or do not have a descendant relationship. Wherein, when the element matching result is that the response element and the target element are different, or the response element and the target element do not have a descendant relationship, it is determined that the first window where the response element is located is in an obstructed state. When the element matching result is that the response element and the target element are the same, or the response element and the target element have a descendant relationship, it is determined that the first window where the response element is located is not in an obstructed state.

[0108] In this embodiment, after obtaining the element coordinates, the target element corresponding to the element coordinates can be determined, and then after the pop-up window processing is completed, the response element and the target element can be matched to obtain the element matching result. By matching the response element and the target element, the currently executed element can be matched with the target element, the response verification of the element can be realized, and the accuracy of the operation on the executed element can be improved.

[0109] Further, based on any of the above embodiments, performing pop-up window processing on the second window based on the pop-up window processing logic to obtain the processing result of the second window may include:

[0110] Generate pop-up exception events when there are pop-ups;

[0111] In response to the pop-up window exception event, pop-up window processing is performed on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0112] Optionally, the pop-up window abnormal event may be a pop-up window processing event generated for the pop-up window, and the pop-up window may be responded to through the event to achieve automatic processing of the pop-up window.

[0113] In this embodiment, when it is determined that a second window exists, a pop-up window exception event can be generated. By responding to the pop-up window exception event, the pop-up window processing logic can be executed to perform pop-up window processing on the second window, thereby achieving timely processing of the second pop-up window and improving the processing efficiency of the second pop-up window.

[0114] like Figure 4 As shown, it is a flow chart of another embodiment of a pop-up window processing method provided by an embodiment of the present disclosure, which is different from the above-mentioned embodiment in that step 204, performing pop-up window processing on the second window based on the pop-up window processing logic to obtain the processing result of the second window, may include:

[0115] 401: Get a pre-registered pop-up rule list, where the pop-up rule list includes multiple pop-ups arranged in the order of registration.

[0116] 402: According to the registration order of each pop-up window in the pop-up window rule list, the second window is matched with the pop-up windows in the pop-up window rule list in sequence to obtain a target pop-up window that successfully matches the second window.

[0117] 403: Call the processing logic of the target pop-up window based on the pop-up window rule list, perform pop-up window processing on the second window, and obtain the processing result of the second window.

[0118] Optionally, the popup rule list may store popups and popup-related processing logic in the form of a list, for example: [PopupClass1, PopupClass2, ..., PopupClassn], where PopupClass refers to the popup and popup-related processing logic.

[0119] Pop-up window processing rules can be pre-registered. During registration, each pop-up window processing rule can be assigned a corresponding registration order.

[0120] Matching the second window with the pop-up window in the pop-up window rule list may include: matching the path of the second window with the UI path corresponding to the pop-up window rule list, and using the pop-up window corresponding to the UI path that is the same as the path of the second pop-up window as the target pop-up window.

[0121] In this embodiment, when processing a pop-up window, a pop-up window rule list can be obtained first. In the pop-up window rule list, multiple pop-ups are arranged in the order of registration. Then, the second window can be matched with the pop-ups in the pop-up window rule list in sequence according to the registration order of each pop-up window, and the target pop-up window that successfully matches the second window can be obtained. Through pop-up window matching, the target pop-up window that successfully matches the second window can be obtained. Then, the processing logic of the target pop-up window is obtained from the pop-up window rule list, and then the second window is processed by the processing logic to obtain the processing result of the second window. By setting the pop-up window rule list, the processing logic of the pop-up window can be obtained in real time, and the pop-up window of the second window can be automatically processed, thereby improving the efficiency and effectiveness of pop-up window processing.

[0122] like Figure 5 FIG. 1 is a schematic diagram of a structure of an embodiment of a pop-up window processing device provided by an embodiment of the present disclosure. The pop-up window processing device 500 may include:

[0123] Click response unit 501: used for obtaining element coordinates corresponding to the element specified by the click operation in response to the click operation performed on the user interface.

[0124] The element detection unit 502 is used to detect the response element of the element coordinate in the operation logic tree according to the operation logic tree corresponding to the user interface.

[0125] The window capturing unit 503 is configured to capture the second window that blocks the first window if it is determined that the first window where the response element is located is in a blocked state.

[0126] The pop-up window processing unit 504 is used to perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0127] Further, based on any of the above embodiments, the element detection unit includes:

[0128] An operation acquisition module is used to acquire the operation logic tree corresponding to the user interface;

[0129] A test generation module is used to generate a click test for the operation logic tree according to the element coordinates;

[0130] The test execution module is used to execute the click test and obtain the response element in the operation logic tree that responds to the click test.

[0131] Further, based on any of the above embodiments, the window capturing unit includes:

[0132] A level determination module, used to determine the window level of the response element in the first window;

[0133] The pop-up window detection module is used to detect whether there is a pop-up window at the previous level of the response element according to the window level;

[0134] The occlusion determination module is used to determine whether the first window where the response element is located is in an occlusion state.

[0135] Further, based on any of the above embodiments, the window capturing unit includes:

[0136] A method calling module is used to call a selected test method of a response element, obtain a return result of the selected test method, and perform a window selection operation on the response element by the selected test method;

[0137] A first determination module, configured to determine that the response element is in an unobstructed state if it is determined that the returned result does not satisfy the obstruction condition;

[0138] The second determination module is used to determine that the response element is in an obstructed state if it is determined that the returned result meets the obstruction condition.

[0139] Further, based on any of the above embodiments, the returned result includes a window of the response element; and further includes:

[0140] A first detection unit, used to detect that the returned result has no execution association relationship with other windows, and then determine that the returned result does not meet the occlusion condition;

[0141] The second detection unit is used to detect whether the returned result has an execution association relationship with other windows, and then return to determine whether the returned result meets the blocking condition.

[0142] Further, based on any of the above embodiments, the second detection unit includes:

[0143] A first detection module, configured to determine that the returned result has an execution association relationship with other windows if the window level of the returned result is higher than the reminder level of the user interface window;

[0144] Alternatively, the second detection module is used to determine whether the returned result has an execution association relationship with other windows if the returned result is a key window;

[0145] Alternatively, a third detection module is used to determine that the returned result has an execution association relationship with other windows if the window level of the returned result is higher than the horizontal status bar level of the user interface window;

[0146] Alternatively, the fourth detection module is used to determine whether the returned result has an execution association relationship with other windows if the returned result is a keyboard window.

[0147] Furthermore, based on any of the above embodiments, the method further includes:

[0148] A target determination unit, used to determine a target element corresponding to an element coordinate;

[0149] An element matching unit is used to perform element matching processing on the response element and the target element to obtain an element matching result;

[0150] The state determination unit is used to determine that the first window where the response element is located is in an obstructed state if the element matching result is that the response element and the target element are different, or there is no descendant relationship between the response element and the target element.

[0151] Further, based on any of the above embodiments, the pop-up window processing unit includes:

[0152] An event generation module is used to generate pop-up window exception events when there are pop-up windows;

[0153] The window processing module is used to respond to the pop-up window abnormal event, perform pop-up window processing on the second window based on the pop-up window processing logic, and obtain the processing result of the second window.

[0154] Further, based on any of the above embodiments, the pop-up window processing unit includes:

[0155] A list acquisition module is used to acquire a pre-registered pop-up window rule list, where the pop-up window rule list includes multiple pop-ups arranged in the order of registration;

[0156] A pop-up window matching module, used to match the second window with the pop-up windows in the pop-up window rule list in sequence according to the registration order of each pop-up window in the pop-up window rule list, and obtain a target pop-up window that successfully matches the second window;

[0157] The algorithm processing module is used to call the processing logic of the target pop-up window based on the pop-up window rule list, perform pop-up window processing on the second window, and obtain the processing result of the second window.

[0158] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.

[0159] In order to implement the above embodiment, the embodiment of the present disclosure also provides an electronic device.

[0160] refer to Figure 6 , which shows a schematic diagram of the structure of an electronic device 600 suitable for implementing the embodiment of the present disclosure, and the electronic device 600 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0161] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 to a random access memory (RAM) 603. Various programs and data required for the operation of the electronic device 600 are also stored in the RAM 603. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0162] Typically, the following devices may be connected to the I / O interface 605: input devices 606 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 608 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 609. The communication devices 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0163] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0164] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0165] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0166] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0167] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0168] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0169] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0170] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0171] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0172] In a first aspect, according to one or more embodiments of the present disclosure, a method for processing a pop-up window is provided, including:

[0173] In response to a click operation performed on the user interface, obtaining element coordinates corresponding to an element specified by the click operation;

[0174] According to the operation logic tree corresponding to the user interface, detecting the response element of the element coordinate in the operation logic tree, the operation logic tree is a tree structure formed by connecting multiple elements of the user interface according to the processing logic of each element;

[0175] If it is determined that the first window where the response element is located is in an obstructed state, capturing the second window that obstructs the first window;

[0176] Perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0177] According to one or more embodiments of the present disclosure, according to the operation logic tree corresponding to the user interface, detecting a response element of an element coordinate in the operation logic tree includes:

[0178] Get the operation logic tree corresponding to the user interface;

[0179] Generate click tests for the operation logic tree based on element coordinates;

[0180] Execute a click test and obtain the response element in the operation logic tree that responds to the click test.

[0181] According to one or more embodiments of the present disclosure, determining that the first window where the response element is located is in an obstructed state includes:

[0182] Determine the window level of the response element in the first window;

[0183] According to the window level, detect whether there is a pop-up window in the upper level of the response element;

[0184] If so, it is determined that the first window where the response element is located is in an obstructed state.

[0185] According to one or more embodiments of the present disclosure, determining that the first window where the response element is located is in an obstructed state includes:

[0186] Call the selected test method of the response element to obtain the return result of the selected test method, and the selected test method performs a window selection operation on the response element;

[0187] If it is determined that the returned result does not satisfy the occlusion condition, then it is determined that the response element is in an unoccluded state;

[0188] If it is determined that the returned result satisfies the occlusion condition, it is determined that the response element is in an occlusion state.

[0189] According to one or more embodiments of the present disclosure, the returned result includes a window of a response element; and the step of detecting an occlusion condition includes:

[0190] If the detection result does not have an execution association relationship with other windows, it is determined that the returned result does not meet the occlusion condition;

[0191] If the detection result has an execution association relationship with other windows, the return result is determined to meet the occlusion condition.

[0192] According to one or more embodiments of the present disclosure, detecting that a returned result has an execution association relationship with other windows includes:

[0193] If the window level of the returned result is higher than the reminder level of the user interface window, it is determined that the returned result has an execution association relationship with other windows;

[0194] Alternatively, if the returned result is a key window, it is determined that the returned result has an execution association relationship with other windows;

[0195] Alternatively, if the window level of the returned result is higher than the horizontal status bar level of the user interface window, it is determined that the returned result has an execution association relationship with other windows;

[0196] Alternatively, if the returned result is a keyboard window, it is determined that the returned result has an execution association relationship with other windows.

[0197] According to one or more embodiments of the present disclosure, the present invention further includes:

[0198] Determine the target element corresponding to the element coordinates;

[0199] Perform element matching processing on the response element and the target element to obtain the element matching result;

[0200] If the element matching result is that the response element and the target element are different, or there is no descendant relationship between the response element and the target element, it is determined that the first window where the response element is located is in an obstructed state.

[0201] According to one or more embodiments of the present disclosure, performing pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window includes:

[0202] Generate pop-up exception events when there are pop-ups;

[0203] In response to the pop-up window exception event, pop-up window processing is performed on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0204] According to one or more embodiments of the present disclosure, performing pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window includes:

[0205] Get a pre-registered pop-up rule list, which includes multiple pop-ups arranged in the order of registration;

[0206] According to the registration order of each pop-up window in the pop-up window rule list, the second window is matched with the pop-up windows in the pop-up window rule list in turn to obtain a target pop-up window that successfully matches the second window;

[0207] The processing logic of the target pop-up window is called based on the pop-up window rule list, the pop-up window processing is performed on the second window, and the processing result of the second window is obtained.

[0208] In a second aspect, according to one or more embodiments of the present disclosure, a pop-up window processing device is provided, including:

[0209] A click response unit, used to obtain, in response to a click operation performed on the user interface, element coordinates corresponding to the element specified by the click operation;

[0210] An element detection unit, used to detect a response element of an element coordinate in an operation logic tree according to an operation logic tree corresponding to the user interface, wherein the operation logic tree is a tree structure formed by connecting multiple elements of the user interface according to the processing logic of each element;

[0211] A window capturing unit, configured to capture a second window that blocks the first window if it is determined that the first window where the response element is located is in a blocked state;

[0212] The pop-up window processing unit is used to perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

[0213] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0214] Memory stores computer-executable instructions;

[0215] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the pop-up window processing method as described in the first aspect and various possible designs of the first aspect.

[0216] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the pop-up window processing method as described in the first aspect and various possible designs of the first aspect are implemented.

[0217] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the pop-up window processing method as described in the first aspect and various possible designs of the first aspect.

[0218] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0219] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0220] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A pop-up window processing method, characterized in that: include: In response to a click operation performed on the user interface, obtaining element coordinates corresponding to an element specified by the click operation; According to the operation logic tree corresponding to the user interface, detecting the response element of the element coordinate in the operation logic tree, wherein the operation logic tree is a tree structure formed by connecting multiple elements of the user interface according to the processing logic of each element; If it is determined that the first window where the response element is located is in an obstructed state, capturing the second window that obstructs the first window; Perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

2. The method according to claim 1, characterized in that The detecting, according to the operation logic tree corresponding to the user interface, a response element of the element coordinate in the operation logic tree comprises: Obtaining an operation logic tree corresponding to the user interface; Generating a click test for the operation logic tree according to the element coordinates; The click test is executed, and the response element in the operation logic tree that responds to the click test is obtained.

3. The method according to claim 1, characterized in that The determining that the first window where the response element is located is in an obstructed state includes: Determining a window level of the response element in the first window; According to the window level, detecting whether there is a pop-up window at the upper level of the response element; If so, it is determined that the first window where the response element is located is in a blocked state.

4. The method according to claim 1, characterized in that The determining that the first window where the response element is located is in an obstructed state includes: Calling a selection test method of the response element to obtain a return result of the selection test method, wherein the selection test method performs a window selection operation on the response element; If it is determined that the returned result does not satisfy the occlusion condition, determining that the response element is in an unoccluded state; If it is determined that the returned result satisfies the blocking condition, it is determined that the response element is in a blocking state.

5. The method according to claim 4, characterized in that The returned result includes the window of the response element; The step of detecting the occlusion condition comprises: Detecting that there is no execution association relationship between the returned result and other windows, then determining that the returned result does not meet the blocking condition; It is detected that the returned result has an execution association relationship with other windows, and then it is returned to determine that the returned result meets the blocking condition.

6. The method according to claim 5, characterized in that The detecting that the returned result has an execution association relationship with other windows includes: If the window level of the returned result is higher than the reminder level of the user interface window, determining that the returned result has an execution association relationship with other windows; Alternatively, if the returned result is a key window, determining that the returned result has an execution association relationship with other windows; Alternatively, if the window level of the returned result is higher than the horizontal status bar level of the user interface window, it is determined that the returned result has an execution association relationship with other windows; Alternatively, if the returned result is a keyboard window, it is determined that the returned result has an execution association relationship with other windows.

7. The method according to claim 1, characterized in that Also includes: Determine the target element corresponding to the element coordinates; Performing element matching processing on the response element and the target element to obtain an element matching result; If the element matching result is that the response element and the target element are different, or the response element and the target element do not have a descendant relationship, it is determined that the first window where the response element is located is in an obstructed state.

8. The method according to claim 1, characterized in that: The performing pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window includes: Generate pop-up exception events when there are pop-ups; In response to the pop-up window exception event, pop-up window processing is performed on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

9. The method according to claim 1, characterized in that: The performing pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window includes: Obtain a pre-registered pop-up window rule list, wherein the pop-up window rule list includes multiple pop-ups arranged in a registration order; According to the registration order of each pop-up window in the pop-up window rule list, the second window is matched with the pop-up windows in the pop-up window rule list in sequence to obtain a target pop-up window that successfully matches the second window; The processing logic of the target pop-up window is called based on the pop-up window rule list, and the pop-up window processing is performed on the second window to obtain the processing result of the second window.

10. A pop-up window processing device, characterized in that: include: A click response unit, configured to obtain, in response to a click operation performed on the user interface, element coordinates corresponding to an element specified by the click operation; an element detection unit, configured to detect, according to an operation logic tree corresponding to the user interface, a response element of the element coordinates in the operation logic tree, wherein the operation logic tree is a tree structure formed by connecting a plurality of elements of the user interface according to the processing logic of each element; a window capturing unit, configured to capture a second window that blocks the first window if it is determined that the first window where the response element is located is in a blocked state; A pop-up window processing unit is used to perform pop-up window processing on the second window based on the pop-up window processing logic to obtain a processing result of the second window.

11. An electronic device, characterized in that: include: Processor, memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor is configured with the pop-up window processing method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the pop-up window processing method according to any one of claims 1 to 9 is implemented.

13. A computer program product, comprising a computer program, characterized in that The computer program is executed by a processor to be configured with the pop-up window processing method according to any one of claims 1 to 9.