Data processing method and device, equipment and medium
By introducing RPA general components and UIAutomation crawlers into the RPA system, abnormal pop-ups are automatically identified and processed, and the problem of low exception pop-ups is solved in the existing technology, achieving more efficient pop-ups and reducing development time.
Patent Information
- Application Number
- CN202411785863.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-06
- Publication Date
- 2025-03-28
AI Technical Summary
The prior art is inefficient when handling abnormal pop-ups, resulting in an increase in RPA application development time and affecting the efficiency of normal business processing.
By introducing RPA common components and UIAutomation crawlers, the page elements are extracted and the number of initial page elements is compared, and the new page elements are determined whether the added page elements are an exception pop-up window, and the corresponding data processing method is selected according to the element level for processing.
Improve the processing efficiency of exception pop-up windows, save the development time of new RPA applications to process pop-up windows, and reduce production risks.
Smart Images
Figure CN119718742A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of artificial intelligence technology, and specifically to a data processing method, device, equipment and medium. Background Art
[0002] The main function of Robotic Process Automation (RPA) is to execute work information and business interactions through robots according to preset processes. It is usually used to handle a large number of repetitive manual operations.
[0003] During the execution of the automated process, an abnormal pop-up window may appear, resulting in the termination of the process. The existing pop-up window processing method is to write corresponding codes for each PRA component, and different PRA component codes may be written by different developers. Therefore, there are differences in writing logic and style between the codes of different PRA components.
[0004] Since the existing pop-up window processing is a pop-up window processing logic set for pop-up windows that appear in a specified process of a PRA component, this pop-up window processing logic cannot be directly reused in newly developed RPA applications, which increases the development time of RPA applications; in addition, the appearance of abnormal pop-up windows will also affect the efficiency of normal business processing. Summary of the invention
[0005] Embodiments of the present application provide a data processing method, apparatus, device, and medium for solving the problem of low efficiency in processing abnormal pop-up windows.
[0006] In a first aspect, the data processing method provided by the present application includes:
[0007] In response to the target object's page operation on the initial page, extracting the current page element of the target page after the operation;
[0008] Determining whether the number of elements on the current page is greater than the number of elements on the initial page, wherein the initial page elements are obtained by crawling element information of the initial page;
[0009] If yes, then determine the newly added page element, and based on the element level of the newly added page element, select a data processing method associated with the element level to process the newly added page element;
[0010] If not, the newly added page element is processed according to the preset first data processing method.
[0011] This application introduces PRA common components and uses UIAutomation crawling tools to crawl page elements. It compares and analyzes the number of current page elements and initial page elements, and can determine whether abnormal pop-up windows appear in the automated processing flow. When abnormal pop-up windows appear, the corresponding data processing method is selected according to the pop-up window type to process the abnormal pop-up windows, which can improve the processing efficiency of abnormal pop-up windows, save the development time of new RPA application processing pop-up windows, and reduce production risks.
[0012] In a possible embodiment, determining the newly added page element and, based on the element level of the newly added page element, selecting a data processing method associated with the element level to process the newly added page element includes:
[0013] Determine the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute and type of the newly added page element;
[0014] Determining whether the newly added element information and the initial element information of the initial page element meet a preset association condition;
[0015] If yes, based on the element level of the newly added page element, a data processing method associated with the element level is selected to process the newly added page element;
[0016] If not, the newly added page element is processed according to the first data processing method.
[0017] Through the above method, it is possible to further determine whether the newly added page element is an abnormal pop-up window, and select a data processing method related to the element level of the abnormal pop-up window to process the abnormal pop-up window.
[0018] In a possible embodiment, if the newly added page element is a secondary element, then based on the element level of the newly added page element, selecting a data processing method associated with the element level to process the newly added page element includes:
[0019] Determining the element type of the secondary element based on the sub-elements of the secondary element;
[0020] Selecting a second data processing method corresponding to the element type of the secondary element from a preset data processing method set;
[0021] The newly added page element is processed based on the second data processing method.
[0022] Through the above method, when it is determined that the newly added page element is a secondary element, the newly added page element can be processed based on the second data processing method corresponding to the element type of the secondary element.
[0023] In a possible embodiment, determining the element type of the secondary element based on the sub-elements of the secondary element includes:
[0024] Determine whether the sub-elements of the secondary element include an input-type element, wherein the input-type element includes an input box, a selection box, or a check box;
[0025] If yes, then determine that the secondary element is a form pop-up window;
[0026] If not, it is determined that the secondary element is a notification pop-up window.
[0027] By determining whether there is an input-type element in the child elements of the secondary element, it can be determined whether the abnormal pop-up window is a form-type pop-up window or a notification-type pop-up window.
[0028] In a possible embodiment, if the secondary element is a form-type pop-up window, the form-type pop-up window is processed by the following second data processing method:
[0029] Determine a target sub-element from each sub-element information of the form-type pop-up window, wherein the target sub-element is used to operate the form-type pop-up window;
[0030] Close the form pop-up window through the target sub-element.
[0031] Based on the above method, when the PRA general component determines that the secondary element is a form-type pop-up window, it can directly close the form-type pop-up window through the target child element, and hand over the operation of the form content in the form-type pop-up window to subsequent code processing in the business system.
[0032] In a possible embodiment, if the secondary element is a notification pop-up window, the notification pop-up window is processed by the following second data processing method:
[0033] Capture the text information in the notification pop-up window;
[0034] Record the text information into a running log, and determine a target sub-element from each sub-element information of the notification pop-up window, wherein the target sub-element is used to operate the notification pop-up window;
[0035] Close the notification pop-up window through the target sub-element.
[0036] Through the above method, when the PRA general component determines that the secondary element is a notification pop-up window, it can record the text information in the notification pop-up window in the operation log for subsequent operation and maintenance personnel to view, and then close the notification pop-up window through the target sub-element in the notification pop-up window, and hand over the notification pop-up window to the subsequent code processing in the business system.
[0037] In a possible embodiment, the preset association condition is as follows:
[0038] The position of the newly added page element covers the position of the initial page element; or,
[0039] The similarity between the newly added page element and the initial page element is less than a first set value; or,
[0040] The difference in element style between the newly added page element and the initial page element is greater than a second set value.
[0041] Based on the above method, it is possible to better determine whether the newly added page element is an abnormal pop-up window.
[0042] In a second aspect, the present application provides a data processing device, the device comprising:
[0043] A response module, used for extracting the current page element of the target page after the operation in response to the page operation of the target object on the initial page;
[0044] A determination module, used to determine whether the number of elements on the current page is greater than the number of elements on the initial page, wherein the initial page elements are obtained by capturing element information on the initial page;
[0045] If yes, then determine the newly added page element, and based on the element level of the newly added page element, select a data processing method associated with the element level to process the newly added page element;
[0046] If not, the newly added page element is processed according to the preset first data processing method.
[0047] In a possible embodiment, the determination module is further configured to:
[0048] Determine the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute and type of the newly added page element;
[0049] Determining whether the newly added element information and the initial element information of the initial page element meet a preset association condition;
[0050] If yes, based on the element level of the newly added page element, a data processing method associated with the element level is selected to process the newly added page element;
[0051] If not, the newly added page element is processed according to the first data processing method.
[0052] In a possible embodiment, the determination module is specifically used for:
[0053] Determining the element type of the secondary element based on the sub-elements of the secondary element;
[0054] Selecting a second data processing method corresponding to the element type of the secondary element from a preset data processing method set;
[0055] The newly added page element is processed based on the second data processing method.
[0056] In a possible embodiment, the determination module is specifically used for:
[0057] Determine whether the sub-elements of the secondary element include an input-type element, wherein the input-type element includes an input box, a selection box, or a check box;
[0058] If yes, then determine that the secondary element is a form pop-up window;
[0059] If not, it is determined that the secondary element is a notification pop-up window.
[0060] In a possible embodiment, the determination module is specifically used for:
[0061] Determine a target sub-element from each sub-element information of the form-type pop-up window, wherein the target sub-element is used to operate the form-type pop-up window;
[0062] Close the form pop-up window through the target sub-element.
[0063] In a possible embodiment, the determination module is specifically used for:
[0064] Capture the text information in the notification pop-up window;
[0065] Record the text information into a running log, and determine a target sub-element from each sub-element information of the notification pop-up window, wherein the target sub-element is used to operate the notification pop-up window;
[0066] Close the notification pop-up window through the target sub-element.
[0067] In a third aspect, the present application provides an electronic device, including:
[0068] A memory for storing program instructions;
[0069] The processor is used to call the program instructions stored in the memory, and execute the steps included in any one of the data processing methods in the first aspect according to the obtained program instructions.
[0070] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the data processing method described in any one of the first aspects.
[0071] In a fifth aspect, the present application provides a computer program product, comprising: a computer program code, when the computer program code is run on a computer, the computer executes the data processing method described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] Figure 1 A flowchart of a data processing method provided in an embodiment of the present application;
[0073] Figure 2 A schematic diagram of a data processing system architecture provided in an embodiment of the present application;
[0074] Figure 3 A flowchart of abnormal pop-up window processing provided in an embodiment of the present application;
[0075] Figure 4 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application;
[0076] Figure 5 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0077] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is only a part of the embodiment of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be arbitrarily combined with each other. In addition, although the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in an order different from that here.
[0078] The terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of their variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in the present application can mean at least two, for example, two, three or more, and the embodiments of the present application are not limited.
[0079] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description. It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, which should be considered as exemplary, and their purpose is only to illustrate the feasibility of the implementation of the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0080] In the technical solution of this application, the acquisition, transmission, storage, and use of data are in compliance with the requirements of relevant national laws and regulations.
[0081] Before introducing the data processing method provided in the embodiment of the present application, in order to facilitate understanding, the technical background of the embodiment of the present application is first introduced in detail below.
[0082] The main function of Robotic Process Automation (RPA) is to execute work information and business interactions through robots according to preset processes, replacing manual processing of large amounts of repetitive work.
[0083] During the execution of the automated process, abnormal pop-up windows may appear, resulting in the termination of the business process. For example, abnormal pop-up windows such as "Current account is unavailable" or "Current business cannot be processed during the current time period" may be reported during the normal execution of the program. The existing pop-up window processing method is to write corresponding codes for each PRA component, where a PRA component represents a code file for processing a single transaction, and different PRA component codes may be written by different developers. Therefore, there are differences in the writing logic and style between the codes of different PRA components.
[0084] Since the existing pop-up window processing is a pop-up window processing logic set for pop-up windows that appear in a specified process of a PRA component, this pop-up window processing logic cannot be directly reused in newly developed RPA applications, which increases the development time of RPA applications; in addition, the appearance of abnormal pop-up windows will also affect the efficiency of normal business processing.
[0085] In view of this, in order to improve the efficiency of processing abnormal pop-up windows, save development time of new RPA applications, and reduce production risks, an embodiment of the present application provides a data processing method, which specifically includes: first, in response to the page operation of the target object on the initial page, extract the current page elements of the target page after the operation; then determine whether the number of current page elements is greater than the number of initial page elements. If so, determine the newly added page elements, and based on the element level of the newly added page elements, select the data processing method associated with the element level to process the newly added page elements; if not, process the newly added page elements according to the preset first data processing method.
[0086] This application introduces RPA common components to unify the processing of abnormal pop-up windows that appear in the automation process, which can improve the efficiency of processing abnormal pop-up windows, save the development time of new RPA applications to process pop-up windows, and reduce production risks.
[0087] Reference Figure 1 As shown, it is a flow chart of a data processing method provided in an embodiment of the present application, the method comprising:
[0088] S1, in response to a page operation of a target object on an initial page, extracting a current page element of the target page after the operation.
[0089] First of all, the method provided in this application can be applied to Figure 2 In the system architecture shown, the system architecture includes: a terminal device, a target object, and the method provided in the present application can be executed in the terminal device.
[0090] The terminal device includes a portable or handheld terminal, such as a computer, a notebook, a smart phone, a display device, etc. The terminal device is installed with a corresponding application program (APP), and the target object can perform corresponding operations on the application program to obtain corresponding services.
[0091] The target object can be a user who subscribes to the service or an administrator of the service. The following uses the user operating the terminal device as an example to explain the process of handling abnormal pop-up windows within the terminal device:
[0092] In the embodiments of this application, see the attached Figure 3As shown, when the target object performs a page operation on the initial page of the terminal device, for example, the user clicks a button, types, opens a web page, etc. The PRA general component in the terminal device will respond to the page operation of the target object in real time and extract the current page element of the target page after the target object operation. In specific implementation, the PRA general component can use the user interface automation (UIAutomation) crawler to extract the current page element, wherein the current page element contains information such as the coordinate position, text, attribute (level) and type of the element.
[0093] The UIAutomation crawler can convert the page elements of an application into a specific data structure by analyzing the entire application. For example, the entire application (browser page) is taken as the outermost (first-level) element; the page title, border (page size, position) and the entire pop-up window of the browser page are taken as second-level elements; the pop-up window title and bottom button are taken as third-level elements, and this application does not impose specific restrictions on the classification level of page elements. In addition, while using the UIAutomation crawler to crawl page elements, the number of elements at each level in the entire application can also be determined.
[0094] In an embodiment of the present application, the UIAutomation crawler can also obtain a data structure similar to the specific data structure of the above-mentioned entire application and the number of current page elements by analyzing the application corresponding to the initial page, so as to facilitate the subsequent automated processing flow of normal business or pop-up windows.
[0095] S2, determining whether the number of elements on the current page is greater than the number of elements on the initial page.
[0096] When the PRA general component determines that the number of elements on the current page is greater than the number of elements on the initial page, it may execute step S31; otherwise, it may execute step S32.
[0097] In an embodiment of the present application, after the PRA general component extracts the current page element of the target page after the user operation, the current page element can be an N-level element, where N is an integer greater than or equal to 1. It should be pointed out that the PRA general component provided by the present application is applicable to operation interfaces of various types and levels, and no matter at which level the user operates the user interface of the terminal device, the abnormal pop-up window will appear at the second level.
[0098] The PRA general component may first determine whether the number of current page elements is greater than the number of initial page elements to determine whether there is an interface change caused by a user operation.
[0099] S31, determining a newly added page element, and based on the element level of the newly added page element, selecting a data processing method associated with the element level to process the newly added page element.
[0100] In the embodiment of the present application, when the PRA general component determines that the number of current page elements is greater than the number of initial page elements, it is usually caused by an abnormal pop-up window (but it does not rule out the appearance of lower-level page elements than the abnormal pop-up window (secondary element) when the business system is running normally). Therefore, the PRA general component can determine the newly added page element, and based on the element level of the newly added page element, select the data processing method associated with the element level to process the newly added page element.
[0101] In a possible embodiment, in order to better determine whether the newly added page element is an abnormal pop-up window, when the PRA general component determines that the number of current page elements is greater than the number of initial page elements, the newly added page element can also be processed in the following manner:
[0102] The PRA general component first determines the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute (level) and type of the newly added page element; and then determines whether the newly added element information and the initial element information of the initial page element meet the preset association condition. In the present application, the preset association condition can be that the position of the newly added page element covers the position of the initial page element (the newly added page element floats on the surface of the initial page element); or, the similarity between the newly added page element and the initial page element is less than a first set value; or, the difference in element style between the newly added page element and the initial page element is greater than a second set value. The above conditions can be flexibly combined in actual application, and the present application does not specifically limit the number of the above conditions.
[0103] When it is determined that the preset association conditions are met, the PRA general component can determine that the newly added page element is an abnormal pop-up window, and then based on the element level of the newly added page element, select the data processing method associated with the element level to process the newly added page element; when it is determined that the preset association conditions are not met, the PRA general component can process the newly added page element according to the first data processing method, and the first data processing method can be a normal business execution process.
[0104] By determining whether the number of current page elements is greater than the number of initial page elements, or after the number of current page elements is greater than the number of initial page elements, determining again whether the newly added element information and the initial element information of the initial page elements meet the preset association conditions, it can be determined whether the newly added page element is an abnormal pop-up window.
[0105] In the embodiment of the present application, if the newly added page element is a secondary element, the PRA general component can determine that the page change is caused by an abnormal pop-up window (a pop-up window exists), and then based on the element level of the newly added page element, select the data processing method associated with the element level to process the newly added page element. The specific process is as follows:
[0106] The PRA general component first determines the element type of the secondary element based on the sub-elements of the secondary element; then selects the second data processing method corresponding to the element type of the secondary element from the preset data processing method set; finally, processes the newly added page elements based on the second data processing method.
[0107] In specific implementation, the element type of the secondary element can be determined by determining whether the sub-elements of the secondary element contain input-type elements, where the sub-elements may include pop-up titles, pop-up buttons, input boxes, selection boxes, or check boxes; if the sub-elements include input-type elements, it can be determined that the secondary element is a form-type pop-up; if the sub-elements do not contain input-type elements, it can be determined that the secondary element is a notification-type pop-up.
[0108] By analyzing the sub-elements of the secondary element, the type of the pop-up window can be determined, so that different pop-up window processing methods can be adopted for subsequent automatic processing.
[0109] In the embodiment of the present application, since the business system is provided with a corresponding business process for form-type pop-up windows, when the PRA general component determines that the secondary element is a form-type pop-up window, the form-type pop-up window can be processed by the following second data processing method:
[0110] The PRA general component first determines the target sub-element from the information of each sub-element of the form pop-up window, where the target sub-element is the element used to operate the form pop-up window, such as the "OK" and "Close" buttons, and then closes the form pop-up window through the target sub-element.
[0111] Through the above method, when the PRA general component determines that the secondary element is a form-type pop-up window, it can directly close the form-type pop-up window through the target child element, and hand over the operation of the form content in the form-type pop-up window to subsequent code processing in the business system.
[0112] In the embodiment of the present application, when the PRA general component determines that the secondary element is a notification pop-up window, the notification pop-up window can be processed by the following second data processing method:
[0113] The PRA general component can first use a text capture tool to capture the text information in the notification pop-up window; then record the text information to the operation log, so that the administrator or maintenance personnel can view the operation log and solve the abnormal pop-up window that cannot be handled when the business system is running. After the PRA general component records the text information to the operation log, it determines the target sub-element from the sub-element information of the notification pop-up window in the same way as the above-mentioned processing of the form pop-up window, where the target sub-element is used to operate the notification pop-up window; finally, the notification pop-up window is closed through the target sub-element.
[0114] Through the above method, when the PRA general component determines that the secondary element is a notification pop-up window, it can record the text information in the notification pop-up window in the operation log for subsequent operation and maintenance personnel to view, and then close the notification pop-up window through the target sub-element in the notification pop-up window, and hand over the notification pop-up window to the subsequent code processing in the business system.
[0115] S32: Process the newly added page element according to a preset first data processing method.
[0116] In an embodiment of the present application, when the PRA general component determines that the number of current page elements is equal to the number of initial page elements, it can be determined that no abnormal pop-up window appears. Therefore, the PRA general component can process the newly added page elements according to the preset first data processing method. The first data processing method can represent the normal business processing logic (process) of the business system.
[0117] To summarize, this application introduces PRA general components and uses the UIAutomation crawler tool to crawl page elements, and compares and analyzes the number of current page elements and initial page elements, so as to determine whether abnormal pop-up windows appear in the automated processing flow; when abnormal pop-up windows appear, the corresponding data processing method is selected according to the pop-up window type to process the abnormal pop-up windows, which can improve the processing efficiency of abnormal pop-up windows, save the development time of new RPA applications to process pop-up windows, and reduce production risks.
[0118] Based on the same inventive concept, the present application embodiment provides a data processing device, please refer to Figure 4 , the device comprises:
[0119] A response module 401 is used to extract the current page element of the target page after the operation in response to the page operation of the target object on the initial page;
[0120] The determination module 402 is used to determine whether the number of the current page elements is greater than the number of the initial page elements, wherein the initial page elements are obtained by crawling the element information of the initial page;
[0121] If yes, then determine the newly added page element, and based on the element level of the newly added page element, select a data processing method associated with the element level to process the newly added page element;
[0122] If not, the newly added page element is processed according to the preset first data processing method.
[0123] In a possible embodiment, the determining module 402 is further configured to:
[0124] Determine the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute and type of the newly added page element;
[0125] Determining whether the newly added element information and the initial element information of the initial page element meet a preset association condition;
[0126] If yes, based on the element level of the newly added page element, a data processing method associated with the element level is selected to process the newly added page element;
[0127] If not, the newly added page element is processed according to the first data processing method.
[0128] In a possible embodiment, the determination module 402 is specifically configured to:
[0129] Determining the element type of the secondary element based on the sub-elements of the secondary element;
[0130] Selecting a second data processing method corresponding to the element type of the secondary element from a preset data processing method set;
[0131] The newly added page element is processed based on the second data processing method.
[0132] In a possible embodiment, the determination module 402 is specifically configured to:
[0133] Determine whether the sub-elements of the secondary element include an input-type element, wherein the input-type element includes an input box, a selection box, or a check box;
[0134] If yes, then determine that the secondary element is a form pop-up window;
[0135] If not, it is determined that the secondary element is a notification pop-up window.
[0136] In a possible embodiment, the determination module 402 is specifically configured to:
[0137] Determine a target sub-element from each sub-element information of the form-type pop-up window, wherein the target sub-element is used to operate the form-type pop-up window;
[0138] Close the form pop-up window through the target sub-element.
[0139] In a possible embodiment, the determination module 402 is specifically configured to:
[0140] Capture the text information in the notification pop-up window;
[0141] Record the text information into a running log, and determine a target sub-element from each sub-element information of the notification pop-up window, wherein the target sub-element is used to operate the notification pop-up window;
[0142] Close the notification pop-up window through the target sub-element.
[0143] Based on the same inventive concept, the present application embodiment provides an electronic device, which can realize the functions of the data processing device discussed above. Please refer to Figure 5 , the electronic device comprises:
[0144] At least one processor 501, and a memory 502 connected to the at least one processor 501. The specific connection medium between the processor 501 and the memory 502 is not limited in the embodiment of the present application. Figure 5 In the example, the processor 501 and the memory 502 are connected via a bus 500. The bus 500 is Figure 5 The connections between other components are shown in bold lines, and are not intended to be limiting. The bus 500 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. Alternatively, the processor 501 can also be called a controller, and there is no limitation on the name.
[0145] In the embodiment of the present application, the memory 502 stores instructions that can be executed by at least one processor 501. The at least one processor 501 can execute the data processing method discussed above by executing the instructions stored in the memory 502. The processor 501 can implement Figure 4 The functions of each module in the device shown.
[0146] Among them, the processor 501 is the control center of the device, and can use various interfaces and lines to connect the various parts of the entire control device. By running or executing instructions stored in the memory 502 and calling data stored in the memory 502, the various functions of the device and processing data, the device can be monitored as a whole.
[0147] In one possible design, the processor 501 may include one or more processing units, and the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 501. In some embodiments, the processor 501 and the memory 502 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on separate chips.
[0148] Processor 501 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the data processing method disclosed in the embodiments of the present application can be directly embodied as a hardware processor to be executed, or a combination of hardware and software modules in the processor can be executed.
[0149] The memory 502 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 502 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 502 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 502 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.
[0150] By designing and programming the processor 501, the code corresponding to the data processing method described in the above embodiment can be fixed into the chip, so that the chip can execute the data processing method when it is running. Figure 1The steps of the data processing method of the embodiment shown are as follows: How to design and program the processor 501 is a technique well known to those skilled in the art and will not be described in detail here.
[0151] Based on the same inventive concept, the embodiment of the present application provides a computer-readable storage medium, and the computer program product includes: computer program code, when the computer program code is run on a computer, the computer executes any of the data processing methods discussed above. Since the principle of solving the problem by the above-mentioned computer-readable storage medium is similar to that of the data processing method, the implementation of the above-mentioned computer-readable storage medium can refer to the implementation of the method, and the repeated parts will not be repeated.
[0152] Based on the same inventive concept, the embodiment of the present application also provides a computer program product, which includes: computer program code, when the computer program code is run on a computer, the computer executes any of the data processing methods discussed above. Since the principle of solving the problem by the above computer program product is similar to that of the data processing method, the implementation of the above computer program product can refer to the implementation of the method, and the repeated parts will not be repeated.
[0153] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0154] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0155] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0156] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of user-operated steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0157] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A data processing method, characterized in that: include: In response to the target object's page operation on the initial page, extracting the current page element of the target page after the operation; Determining whether the number of elements on the current page is greater than the number of elements on the initial page, wherein the initial page elements are obtained by crawling element information of the initial page; If yes, then determine the newly added page element, and based on the element level of the newly added page element, select a data processing method associated with the element level to process the newly added page element; If not, the newly added page element is processed according to the preset first data processing method.
2. The method according to claim 1, characterized in that The determining of the newly added page element and, based on the element level of the newly added page element, selecting a data processing method associated with the element level to process the newly added page element includes: Determine the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute and type of the newly added page element; Determining whether the newly added element information and the initial element information of the initial page element meet a preset association condition; If yes, based on the element level of the newly added page element, a data processing method associated with the element level is selected to process the newly added page element; If not, the newly added page element is processed according to the first data processing method.
3. The method according to any one of claims 1 to 2, characterized in that: If the newly added page element is a secondary element, then based on the element level of the newly added page element, selecting a data processing method associated with the element level to process the newly added page element includes: Determining the element type of the secondary element based on the sub-elements of the secondary element; Selecting a second data processing method corresponding to the element type of the secondary element from a preset data processing method set; The newly added page element is processed based on the second data processing method.
4. The method according to claim 3, characterized in that The determining the element type of the secondary element based on the sub-element of the secondary element includes: Determine whether the sub-elements of the secondary element include an input-type element, wherein the input-type element includes an input box, a selection box, or a check box; If yes, then determine that the secondary element is a form pop-up window; If not, it is determined that the secondary element is a notification pop-up window.
5. The method according to claim 4, characterized in that If the secondary element is a form pop-up window, the form pop-up window is processed by the following second data processing method: Determine a target sub-element from each sub-element information of the form-type pop-up window, wherein the target sub-element is used to operate the form-type pop-up window; Close the form pop-up window through the target sub-element.
6. The method according to claim 4, characterized in that If the secondary element is a notification pop-up window, the notification pop-up window is processed by the following second data processing method: Capture the text information in the notification pop-up window; Record the text information into a running log, and determine a target sub-element from each sub-element information of the notification pop-up window, wherein the target sub-element is used to operate the notification pop-up window; Close the notification pop-up window through the target sub-element.
7. The method according to claim 2, characterized in that The preset association conditions are as follows: The position of the newly added page element covers the position of the initial page element; or, The similarity between the newly added page element and the initial page element is less than a first set value; or, The difference in element style between the newly added page element and the initial page element is greater than a second set value.
8. A data processing device, characterized in that: include: A response module, used for extracting the current page element of the target page after the operation in response to the page operation of the target object on the initial page; A determination module, used to determine whether the number of elements on the current page is greater than the number of elements on the initial page, wherein the initial page elements are obtained by capturing element information on the initial page; If yes, then determine the newly added page element, and based on the element level of the newly added page element, select a data processing method associated with the element level to process the newly added page element; If not, the newly added page element is processed according to the preset first data processing method.
9. The device according to claim 8, characterized in that The determination module is also used for: Determine the newly added element information of the newly added page element, wherein the newly added element information includes the position, attribute and type of the newly added page element; Determining whether the newly added element information and the initial element information of the initial page element meet a preset association condition; If yes, based on the element level of the newly added page element, a data processing method associated with the element level is selected to process the newly added page element; If not, the newly added page element is processed according to the first data processing method.
10. The device according to any one of claims 8 to 9, characterized in that: The determination module is specifically used for: Determining the element type of the secondary element based on the sub-elements of the secondary element; Selecting a second data processing method corresponding to the element type of the secondary element from a preset data processing method set; The newly added page element is processed based on the second data processing method.
11. The device according to claim 10, characterized in that The determination module is specifically used for: Determine whether the sub-elements of the secondary element include an input-type element, wherein the input-type element includes an input box, a selection box, or a check box; If yes, then determine that the secondary element is a form pop-up window; If not, it is determined that the secondary element is a notification pop-up window.
12. The device according to claim 11, characterized in that The determination module is specifically used for: Determine a target sub-element from each sub-element information of the form-type pop-up window, wherein the target sub-element is used to operate the form-type pop-up window; Close the form pop-up window through the target sub-element.
13. The device according to claim 11, characterized in that The determination module is specifically used for: Capture the text information in the notification pop-up window; Record the text information into a running log, and determine a target sub-element from each sub-element information of the notification pop-up window, wherein the target sub-element is used to operate the notification pop-up window; Close the notification pop-up window through the target sub-element.
14. An electronic device, characterized in that: include: A memory for storing program instructions; A processor is used to call the program instructions stored in the memory, and execute the steps included in any one of claims 1-7 according to the obtained program instructions.
15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the method according to any one of claims 1 to 7.
16. A computer program product, characterized in that The computer program product comprises: a computer program code, and when the computer program code is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 7.