An automated process operating system and method for IE browser

By designing an automated process operating system based on MSHTML components, the four substantive problems of the RPA system when operating the IE browser through webDriver technology are solved, and a more efficient, unified and flexible operation method is achieved.

CN115114551BActive Publication Date: 2025-03-25CHANGSHA XIAOBANG INTELLIGENT TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210715933.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-23
Publication Date
2025-03-25
Estimated Expiration
2042-06-23

AI Technical Summary

Technical Problem

There are four substantial problems when operating the IE browser through webDriver technology: the corresponding webDriver driver needs to be installed for different IE versions, the IE browser page cannot be scaled, the IE security mode needs to be manually set, and text input in a 32-bit IE browser is inefficient.

Method used

An automated process operating system for IE browser is designed, including the underlying module, the intermediate module and the user-level module. The intermediate layer module encapsulates the object operations or attribute access of the IE browser based on the MSHTML component into API methods. The user layer module calls these API methods according to business needs and encapsulates them into configurable steps, and finally operates on the IE browser through these steps.

Benefits of technology

It solves the four substantive problems faced by traditional RPA technology when operating IE browser using webDriver technology, improves operational consistency, flexibility and efficiency, and does not require setting IE security mode and installing version-specific drivers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115114551B_ABST
    Figure CN115114551B_ABST
Patent Text Reader

Abstract

The present invention discloses an automated process operating system and method for IE browser. The middle layer module of the system encapsulates the operation or attribute access of the object of the simulated IE browser by the user based on the MSHTML component into an API method that can be conveniently called; the user layer module encapsulates the API method into a configurable and executable step with a single function, completes the configuration according to the business needs, and finally executes the corresponding operation through the configuration information. The system can solve the four major substantive problems faced by the traditional RPA technology when using the webDriver technology to operate the IE browser, and through the middle layer module, on the one hand, it can highly encapsulate various objects based on the basic functions provided by the MSHTML component of the underlying module, realize all operations and attribute access functions of various objects, and provide a convenient API calling method; on the other hand, it simplifies the configuration options of various object operations for the user layer module.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of RPA control technology, and in particular to an automated process operating system and method for IE browsers. Background Art

[0002] RPA (Robotic Process Automation): is a new type of artificial intelligence virtual process automation robot that can replace or assist humans in completing repetitive work tasks on digital devices such as computers and mobile phones.

[0003] At present, the RPA software system mainly performs automated operations on window desktop client programs and mainstream browsers, including Google Chrome, Firefox, Edge and IE. Microsoft has given up updating the IE browser, and most users no longer use it. However, most government agencies and departments such as the medical industry used to use IE as their preferred development target. Usually, when upgrading the old system of such government medical software, they will face problems such as the inability to connect interfaces, the lack of connectivity between the old and new systems, and difficulty in data migration. One of the application scenarios of RPA technology is to seamlessly connect to the target software system, automatically obtain the business data of the old system and write it into the new system by configuring the business process, thereby solving the problem of difficult data migration in the upgrade of old systems such as the Ministry of Government Affairs and the Ministry of Health. Existing RPA usually uses the selenium webDriver-based automated testing technology to operate the IE browser, thereby completing the automated operation of the RPA system on the target IE browser.

[0004] At present, the RPA system has great limitations in operating IE browser through webDriver technology:

[0005] 1) The corresponding webDriver driver needs to be installed for different IE versions, which cannot be handled uniformly;

[0006] 2) During the automation process, the IE browser page cannot be scaled;

[0007] 3) You need to manually set the IE security mode before operation, otherwise it cannot be used;

[0008] 4) The efficiency is very low when operating the 32-bit IE browser for text input. Summary of the invention

[0009] The present invention aims to at least solve the technical problems existing in the prior art. To this end, the present invention proposes an automated process operation system and method for IE browser, which can improve the prediction performance of the model and also improve the robustness and generalization of the model.

[0010] In a first aspect, an embodiment of the present invention provides an automated process operating system for an IE browser, comprising:

[0011] Low-level modules, including MSHTML components;

[0012] The middle layer module is used to encapsulate the operation or property access of the object of the IE browser into an API method according to the MSHTML component;

[0013] The user layer module is used to call the corresponding API method to encapsulate it into configurable executable steps according to the step flow of user business needs, and operate the IE browser according to the configurable executable steps.

[0014] According to the embodiments of the present invention, there are at least the following technical effects:

[0015] The middle-layer module of this system encapsulates the operation or attribute access of the object of the simulated IE browser into an API method that can be conveniently called based on the MSHTML component, and provides the user-layer module with various user-operable API methods; the user-layer module encapsulates this type of API method into a configurable and executable step with a single function, and completes the configuration in sequence according to the steps decomposed into business needs, and finally executes the corresponding operation through the completed configuration. This system can solve the four major substantive problems faced by traditional RPA technology when using webDriver technology to operate the IE browser. Moreover, this system can highly encapsulate various objects based on the basic functions provided by the MSHTML component of the underlying module through the middle-layer module, realize all operations and attribute access functions of various objects, and provide a convenient API calling method available to the user-layer module; on the other hand, it shields the user-layer module from the underlying interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations of the MSHTML component, simplifying the configuration options for various object operations.

[0016] According to some embodiments of the present invention, when the number of the configurable executable steps is greater than one, the user layer module combines the configurable executable steps in sequence into a process container according to the step flow, and operates the IE browser according to the process container.

[0017] According to some embodiments of the present invention, the object of the IE browser includes one or more of a browser object, a web page tab object, an element control object, and an element finder object.

[0018] According to some embodiments of the present invention, the operations or property accesses of the browser object include: starting the browser, closing the browser, opening a web page, closing a web page, switching tabs, obtaining an activated tab, maximizing, minimizing, and obtaining cookies settings.

[0019] According to some embodiments of the present invention, the operations or property access of the web page tab object include: URL acquisition, URL setting, web page title acquisition, setting function, element access, tab closing function and JS script execution command.

[0020] According to some embodiments of the present invention, the element control object includes a button control, a text box control, a drop-down box control, a date input box control, a list control, and a table control.

[0021] According to some embodiments of the present invention, the operation or property access of the element control object includes:

[0022] Click, double-click, right-click;

[0023] Text acquisition, text input, text clearing;

[0024] Get the current option value and select the target option that matches the input text;

[0025] Date acquisition, date setting;

[0026] Get all texts in the list;

[0027] Traverse all items and table rows of the table control.

[0028] According to some embodiments of the present invention, the operations or attribute access of the element finder object include: searching for web page elements by coordinate position, searching for web page elements by xpath, searching for web page elements by id, searching for web page elements by css or element attributes, and searching for positioning information of web page elements.

[0029] In a second aspect, an embodiment of the present invention provides an automated process operation method for an IE browser, comprising the following steps:

[0030] Obtain user business needs;

[0031] Decompose a step flow according to the user's business needs, and obtain simulated operations or property access to objects of the IE browser according to the step flow;

[0032] According to the MSHTML component, the operation or property access to the object of the IE browser is encapsulated into an API method;

[0033] Encapsulate the API method into configurable executable steps;

[0034] The IE browser is operated according to the configurable executable steps.

[0035] According to the embodiments of the present invention, there are at least the following technical effects:

[0036] The middle-layer module of this method encapsulates the simulated user operation or attribute access to the object of the IE browser into an API method that can be conveniently called based on the MSHTML component, and provides the user-layer module with various user-operable API methods; the user-layer module encapsulates this type of API method into a configurable and executable step with a single function, completes the configuration in sequence according to the steps decomposed into business needs, and finally executes the corresponding operation through the completed configuration. This method can solve the four major substantive problems faced by traditional RPA technology when using webDriver technology to operate the IE browser. Moreover, this method can, on the one hand, highly encapsulate various objects based on the basic functions provided by the MSHTML component of the underlying module through the middle-layer module, realize all operations and attribute access functions of various objects, and provide a convenient API calling method available to the user-layer module; on the other hand, it shields the user-layer module from the underlying interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations of the MSHTML component, simplifying the configuration options for various object operations.

[0037] According to some embodiments of the present invention, the operating the IE browser according to the configurable executable steps comprises the steps of:

[0038] When there are more than one configurable executable steps, the configurable executable steps are sequentially combined into a process container according to the step flow;

[0039] The IE browser is operated according to the process container.

[0040] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0042] Figure 1 A schematic diagram of the structure of an automated process operating system for IE browsers provided by the first embodiment of the present invention;

[0043] Figure 2 A flowchart of an automated process operation method for IE browser provided by the second embodiment of the present invention;

[0044] Figure 3 A schematic diagram of the structure of an automated process operating system for IE browsers provided in the third embodiment of the present invention;

[0045] Figure 4 A schematic diagram of a middle layer module calling a bottom layer module provided in the third embodiment of the present invention;

[0046] Figure 5 A schematic diagram of combining steps into a process container provided for a third embodiment of the present invention;

[0047] Figure 6 A schematic diagram of the process configuration and process operation of the automated process operating system for IE browser provided in the fourth embodiment of the present invention. DETAILED DESCRIPTION

[0048] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0049] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "axial", "radial", "circumferential" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. In addition, features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0050] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0051] RPA is a new type of artificial intelligence virtual process automation robot that can replace or assist humans in completing repetitive work tasks in digital devices such as computers and mobile phones. In addition to the scheduling system for task allocation and management, RPA mainly includes a process designer and a process runner. The main function of the process designer is to configure the steps in sequence according to the target software business logic processing process involving each control operation, forming multiple step combinations and nested configuration information. The process runner stage loads the corresponding process configuration information to form a process object composed of steps and starts to execute the steps from top to bottom. For steps that require operating the target software interface elements (controls), it is usually necessary to locate the control and then perform the corresponding control operations (click, input, collection, etc.).

[0052] Existing RPA usually uses selenium webDriver-based automated testing technology to operate IE browsers, thereby completing the automated operation of the RPA system on the target IE browser. However, the current RPA system has major limitations in operating IE browsers through webDriver technology, such as:

[0053] 1) The corresponding webDriver driver needs to be installed for different IE versions, which cannot be handled uniformly;

[0054] 2) During the automation process, the IE browser page cannot be scaled;

[0055] 3) You need to manually set the IE security mode before operation, otherwise it cannot be used;

[0056] 4) The efficiency is very low when operating the 32-bit IE browser for text input.

[0057] First embodiment;

[0058] Reference Figure 1 One embodiment of the present invention provides an automated process operating system for IE browser, including a bottom layer module, a middle layer module and a user layer module, wherein:

[0059] The underlying modules include the MSHTML component. The MSHTML component is a COM component released by Microsoft, which provides basic operations for the IE browser and its web page elements. The automation system can use this component to access and operate the IE browser across processes without invading it, greatly reducing the damage to the IE browser's operating environment. Unlike webDriver, which does not require the installation of drivers for the corresponding browser version and safe mode settings, automation of the IE browser through MSTHML will be very adaptable, and there is no need to set a safe mode, nor will it be affected by the browser page zoom ratio and unable to operate automatically. If used reasonably, it can solve the four major substantive problems faced by webDriver technology when operating the IE browser.

[0060] The middle layer module is used to encapsulate the operation or property access of the IE browser object into an API (Application Programming Interface) method according to the MSHTML component. The IE browser objects here include but are not limited to browser objects, web page tab objects, element control objects, and element finder objects.

[0061] The middle-layer module is regarded as the bridge for access and communication between the upper-layer user-layer module and the IE browser. The middle-layer module provides all the API methods that simulate the user's operation on the IE browser for the upper-layer user-layer module. Since many operation interfaces provided in the MSHTML component have relatively complex parameters, different element types need to be forcibly converted before corresponding types of operations can be performed. If they are directly provided to the user-layer module for configuration, the user-layer module will face relatively complex configuration options and unclear type conversion problems. Therefore, the middle-layer module is mainly based on the basic functions provided by the MSHTML component, and highly encapsulates various IE browser objects to implement all operations and attribute access functions of various objects, and provides the user-layer module with a convenient API calling method, shielding the user-layer module from the MSHTML component's underlying interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations, simplifying various object operation configuration options.

[0062] The user layer module is used to call the corresponding API method according to the step flow of the user's business needs, encapsulate it into configurable execution steps, and operate the IE browser according to the configurable execution steps.

[0063] The user layer module encapsulates this type of API method into configurable and executable steps with a single function through the API calling method provided by the middle layer module, combines the steps to complete the configuration, and finally executes the corresponding operation through the completed configuration.

[0064] Due to the characteristics of MSHTML components, the process operation of IE browser can be performed through MSHTML components. However, since many operation interfaces provided by MSHTML components have relatively complex parameters, different element types need to be converted to perform corresponding types of operations. If they are directly provided to users for configuration, they will face relatively complex configuration options and unclear type conversion problems.

[0065] Therefore, in order to solve this defect, this system includes a bottom layer module, a middle layer module and a user layer module. The middle layer module is regarded as a bridge for access and communication between the user layer module and the IE browser. On the one hand, the middle layer module can highly encapsulate various objects based on the basic functions provided by the MSHTML component of the bottom layer module, realize all operations and attribute access functions of various objects, and provide a convenient API calling method available to the user layer module; on the other hand, it shields the MSHTML component bottom interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations from the user layer module, simplifying the configuration options of various object operations. Finally, the user layer module encapsulates this type of API method into a configurable and executable step with a single function through the convenient API calling method provided by the middle layer module, combines the steps to complete the configuration, and finally executes the corresponding operation through the completed configuration.

[0066] This system embodiment has the following beneficial effects:

[0067] The middle-layer module of this system encapsulates the operation or attribute access of the object of the simulated IE browser into an API method that can be conveniently called based on the MSHTML component, and provides the user-layer module with various user-operable API methods; the user-layer module encapsulates this type of API method into a configurable and executable step with a single function, and completes the configuration in sequence according to the steps decomposed into business needs, and finally executes the corresponding operation through the completed configuration. This system can solve the four major substantive problems faced by traditional RPA technology when using webDriver technology to operate the IE browser. Moreover, this system can highly encapsulate various objects based on the basic functions provided by the MSHTML component of the underlying module through the middle-layer module, realize all operations and attribute access functions of various objects, and provide a convenient API calling method available to the user-layer module; on the other hand, it shields the user-layer module from the underlying interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations of the MSHTML component, simplifying the configuration options for various object operations.

[0068] Second embodiment;

[0069] Reference Figure 1One embodiment of the present invention provides an automated process operation method for IE browser, comprising the following steps:

[0070] Step S101: Obtain user service requirements.

[0071] Step S102: Decompose the step flow according to the user's business needs, and obtain the simulated operation or property access to the object of the IE browser according to the step flow.

[0072] Step S103: Encapsulate the operation or property access to the object of the IE browser into an API method according to the MSHTML component.

[0073] Step S104: encapsulate the API method into a configurable executable step.

[0074] Step S105: operate the IE browser according to the configurable executable steps.

[0075] The system provided in the first embodiment is based on the same inventive concept, and the related concepts are not described again.

[0076] According to the embodiments of the present invention, there are at least the following technical effects:

[0077] Based on the MSHTML component, this method encapsulates the operation or attribute access of the object of the simulated user to the IE browser into an API method that can be conveniently called, so that various types of user-operable API methods can be provided; then the user can encapsulate this type of API method into a configurable and executable step with a single function, and the user can complete the configuration in sequence according to the steps decomposed into business needs, and finally perform the corresponding operation through the completed configuration. This method can solve the four major substantive problems faced by traditional RPA technology when using webDriver technology to operate the IE browser. Moreover, this method skips directly using the MSHTML component to operate the IE browser, but first encapsulates the operation or attribute access of the object of the simulated user to the IE browser based on the MSHTML component into an API method that can be conveniently called. The advantage of this is that on the one hand, various types of objects can be highly encapsulated through the basic functions provided by the MSHTML component, all operations and attribute access functions of various objects can be realized, and convenient API calling methods available to users can be provided; on the other hand, the underlying interface object acquisition logic, element type conversion, element attribute acquisition setting, event monitoring trigger interface call and other operations of the MSHTML component are shielded from the user, simplifying the configuration options for various object operations.

[0078] Third embodiment;

[0079] For ease of understanding, refer to Figures 3 to 5One embodiment of the present invention provides an automated process operating system for IE browser. The system includes: a bottom layer module, a middle layer module and a user layer module. The implementation logic of the system is as follows:

[0080] 1. Bottom layer module;

[0081] The underlying module includes MSHTML components. The following is an introduction to the basic functions of MSHTML: 1) Open and close IE browser web pages;

[0082] 2) Access the internal element pairs of the web page;

[0083] 3) Get and set web page element attributes;

[0084] 4) Trigger specific events of different web page elements.

[0085] 2. Middle layer module;

[0086] The middle layer module is regarded as a bridge for access and communication between the upper user layer module and the IE browser, and provides the user layer module with all the API methods that simulate the user's operation on the IE browser. Since many operation interfaces provided in the MSHTML component have relatively complex parameters, different element types need to be converted forcibly before corresponding types of operations can be performed. If they are directly provided to the upper user module for configuration, the user layer module will face relatively complex configuration options and the common and unclear type conversion problem. Therefore, the middle layer module is mainly based on the basic functions provided by the MSHTML component, and highly encapsulates various objects (such as browser object operations, web page object operations, element control objects, and element finder objects), realizes all operations and attribute access functions of various objects, and provides a convenient API calling method available to the user layer module, shielding the user layer module from the MSHTML component's underlying interface object acquisition logic, element type conversion, element attribute acquisition settings, event monitoring trigger interface calls and other operations, and simplifying various object operation configuration options.

[0087] To use the MSHTML COM interface to implement RPA's automated operation of IE browsers, the underlying interface needs to be encapsulated into a middle-layer module required by RPA. The middle-layer module is connected to the user layer module, so that the system can complete the business configuration function and process execution function through the middle-layer module. The calling process is as follows: Figure 4 shown.

[0088] The following is an example of middle-layer module encapsulation:

[0089] 1) Browser object: used to implement the IE browser operation function encapsulation, such as: starting the browser, closing the browser, opening a web page, closing a web page, switching tabs, obtaining the activated tab, all tabs, maximizing, minimizing, cookies setting and other functions to meet the system's automated operation of the IE browser.

[0090] 2) Web page tab object: It mainly implements basic web page operations through the joint call of the API provided by MSHTML and the API provided by the WINDOWS system to start and end the operation process, such as: URL acquisition, URL setting, web page title acquisition, setting function, element access, tab closing function and JS script execution command and other functions.

[0091] 3) Control objects: mainly through the joint call of various interface APIs of MSHTML to realize the functional encapsulation of various controls in the web page. The encapsulation of various controls is used to realize the common operations of the corresponding controls. The encapsulation of controls supports the functional requirements of the system user layer business process to operate various web page elements; examples are as follows:

[0092] Button control: provides click, double-click, and right-click functions;

[0093] Text box control: provides text acquisition, text input, and text clearing functions;

[0094] Drop-down box control: provides the function of obtaining the current option value and selecting the target option that matches the input text;

[0095] Date input box control: provides the functions of date acquisition and date setting;

[0096] List control: provides the function of obtaining all text in the list;

[0097] Table control: Provides the function of traversing all items and rows of the table control.

[0098] 4) Element finder object: Through the above-mentioned example of obtaining web page elements and the function of JS command execution script, the function of generating and locating the target web page element positioning information is realized, for example: finding web page elements by coordinate position, finding web page elements by xpath, finding web page elements by id, finding web page elements by css or element attributes, and generating the corresponding RPA process The process can be used to find the location information of the target web page element, such as saving element id, element css, element tag, element xpath, element attribute information, etc.

[0099] 3. User layer module;

[0100] The user layer module provides a configurable implementation of a single step function point in the user operation or a configuration implementation of a process container that combines multiple steps. Through the call of the middle layer module, the system can configure the corresponding process information according to business needs during the configuration period, and call the middle layer module through the corresponding configuration information during the process operation stage to achieve the function of automatic execution of business processes.

[0101] The process object uses the queue model to implement the container, implements the first-in-first-out rule, and executes the steps in the added container in order. It has the functions of adding steps, deleting steps, inserting steps, saving configurations, loading configurations, and executing the entire process. The steps are as follows:

[0102] 1) Browser opening step: Open the IE browser of the window system through the browser object of the middle layer module.

[0103] 2) Opening a web page step: specifying the IE browser to open a specified web page through the browser object of the middle layer module, and the web page URL is configured by the user; this step records the URL text information configured by the user.

[0104] 3) Text box editing step: specify the middle-layer text box control to be operated through the element finder of the middle-layer module, specify the text information that the user needs to enter, and complete the text box input step; this step records the positioning information of the text box control operated by the user and the text information to be entered.

[0105] 4) Button click step: specify the button control to be operated through the element finder of the middle layer module to implement various button click operations. This step records the location information of the button control operated by the user.

[0106] like Figure 5 As shown in the figure, an example is given of a user implementing the configuration process of automatically opening Baidu Maps in IE browser. After the user configures each step according to business needs and adds it to the process, the configured process can be executed from top to bottom to complete the business automation processing.

[0107] In the process of step implementation, not only the steps of web page control operation can be implemented, but also the steps of process control can be added, such as adding conditional execution steps (execute different business steps according to the true or false judgment results), and adding loop execution steps (can loop a fixed number of times, or loop a table or list in a web page).

[0108] Fourth embodiment;

[0109] Reference Figure 6 An embodiment of the present invention provides an automated process operating system for IE browsers. The system structure and operation description are as follows:

[0110] Process configuration phase;

[0111] Based on the API provided by MSHTML components and the window system, the middle-layer module encapsulates the browser object, control object, and tab object operations. The middle-layer module provides various user-operable API methods to the user-layer module. The user-layer module encapsulates this type of API method into a single function that can be configured and executed, such as Figure 5 As shown, the user breaks down the configuration into steps one by one according to the business requirements, and adds the steps to the process container for combination, and finally waits for the entire process configuration information that meets the business requirements.

[0112] Process operation phase;

[0113] During the process, the configured information is loaded and all steps are executed in sequence, thus completing the process automation operation. In the system structure, controls are added to the middle-layer module and steps are added to the user-layer module to expand the business incompatibility. For example, a tree control can be added to the middle-layer module, and the user-layer module can add tree control operation steps to improve the system's compatibility with tree control operations. Table controls are added to the middle-layer module, and table traversal steps are added to the user layer to improve the compatibility of table row-by-row traversal operations.

[0114] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0115] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. An automated process operating system for IE browser, characterized in that: include: Low-level modules, including MSHTML components; The middle layer module is used to encapsulate the operation or property access of the object of the IE browser into an API method according to the MSHTML component; A user layer module is used to call the corresponding API method to encapsulate it into configurable executable steps according to the step flow of user business needs, and operate the IE browser according to the configurable executable steps; The IE browser object includes one or more of a browser object, a web page tab object, an element control object, and an element finder object; Based on the basic functions provided by the MSHTML component, the middle layer module highly encapsulates the objects of various IE browsers, obtains the API calling methods of all operations and attribute access functions of the objects of each IE browser, and shields the MSHTML component's underlying interface object acquisition logic, element type conversion, element attribute acquisition setting and event monitoring trigger interface call operations from the user layer module.

2. The automated process operating system for IE browser according to claim 1, characterized in that: When the number of the configurable executable steps is greater than one, the user layer module combines the configurable executable steps in sequence into a process container according to the step flow, and operates the IE browser according to the process container.

3. The automated process operating system for IE browser according to claim 1, characterized in that: The operations or property access of the browser object include: starting the browser, closing the browser, opening a web page, closing a web page, switching tabs, obtaining an activated tab, maximizing, minimizing, and obtaining cookies settings.

4. The automated process operating system for IE browser according to claim 1, characterized in that: The operations or attribute access of the web page tab object include: URL acquisition, URL setting, web page title acquisition, setting function, element access, tab closing function and JS script execution command.

5. The automated process operating system for IE browser according to claim 1, characterized in that: The element control objects include button controls, text box controls, drop-down box controls, date input box controls, list controls, and table controls.

6. The automated process operating system for IE browser according to claim 5, characterized in that: The operations or property access of the element control object include: Click, double-click, right-click; Text acquisition, text input, text clearing; Get the current option value and select the target option that matches the input text; Date acquisition, date setting; Get all texts in the list; Traverse all items and table rows of the table control.

7. The automated process operating system for IE browser according to claim 1, characterized in that: The operations or attribute access of the element finder object include: searching for web page elements by coordinate position, searching for web page elements by xpath, searching for web page elements by id, searching for web page elements by css or element attributes, and searching for positioning information of web page elements.

8. An automated process operation method for IE browser, characterized in that: The steps include: Obtain user business needs; Decompose a step flow according to the user's business needs, and obtain simulated operations or property access to objects of the IE browser according to the step flow; According to the MSHTML component, the operation or property access to the object of the IE browser is encapsulated into an API method; The IE browser object includes one or more of a browser object, a web page tab object, an element control object, and an element finder object; The operation or attribute access to the object of the IE browser is encapsulated into an API method according to the MSHTML component, including: based on the basic functions provided by the MSHTML component, highly encapsulating the objects of various IE browsers, obtaining the API calling methods of all the operations and attribute access functions of the objects of each IE browser, and shielding the underlying interface object acquisition logic, element type conversion, element attribute acquisition setting and event monitoring trigger interface call operation of the MSHTML component from the user; Encapsulate the API method into configurable executable steps; The IE browser is operated according to the configurable executable steps.

9. The automated process operation method for IE browser according to claim 8, characterized in that: The step of operating the IE browser according to the configurable executable steps comprises the steps of: When there are more than one configurable executable steps, the configurable executable steps are sequentially combined into a process container according to the step flow; The IE browser is operated according to the process container.

Citation Information

Patent Citations

  • Intelligent man-machine interaction innumerable network control module

    CN111722770A

  • RPA robot process automation implementation system and method

    CN113254174A