RPA robot manufacturing method based on software screenshot and medium

Abstract

The invention relates to a software screenshot-based RPA robot manufacturing method and a medium, and relates to the technical field of computer information processing, and the method comprises the steps: entering an operation interface of a software system, carrying out the automatic operation of the operation interface according to a preset operation mode, carrying out the screenshot of the interface after each operation, and storing the screenshot; recording an operation coordinate position corresponding to the screenshot after each operation; for the stored screenshots, one of the screenshots with the same identification interface is reserved, and the reserved screenshots with different interfaces are obtained; obtaining preset fields based on the reserved screenshots, and obtaining a corresponding relation between the screenshots with any preset field and the preset fields; based on the corresponding relation and the page where the preset field is located, operation coordinates of operation needing to be executed are obtained, and the RPA robot for conducting screenshot on the page where the preset field is located is manufactured. Compared with the prior art, the manufacturing workload of the RPA robot can be reduced, and the labor cost is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of computer information processing, and particularly relates to a method and medium for manufacturing an RPA robot based on software screenshots. Background Art

[0002] There are a large number of stroke patients, accounting for a huge proportion in the causes of death and disabilities, which has brought a heavy burden to families and society. Therefore, after stroke inpatients are discharged from the hospital, the hospital must upload 357 treatment data indicators during the hospitalization of stroke patients to the specified stroke database in a timely manner for further quality control of stroke cases, data analysis, optimization of treatment measures, improvement of the treatment rate, and reduction of the disease burden.

[0003] With the rapid development of information technology and the wide application of artificial intelligence, it is necessary to build a set of software robots based on RPA (Robotic Process Automation) technology for automatic extraction, automatic review, and automatic reporting of stroke center data, targeting thousands of hospital stroke centers across the country to assist hospitals in reporting stroke data. However, during the RPA development process, customized development needs to be carried out for different manufacturers and / or software versions of data sources. There are many versions of the same system in each company, and a new robot needs to be made for each version of the software, resulting in a sharp increase in the workload of manually making RPA. How to reduce the workload of making RPA robots has become an urgent problem to be solved. Summary of the Invention

[0004] The technical problem to be solved by this application is to provide a method and medium for manufacturing an RPA robot based on software screenshots, which has the characteristics of reducing the workload of making RPA robots and reducing labor costs.

[0005] In a first aspect, in one embodiment, a method for manufacturing an RPA robot based on software screenshots is provided, including: Enter the operation interface of the software system, perform automatic operations on the operation interface according to a preset operation method, take screenshots of the interface after each operation and save them, and record the operation coordinate positions corresponding to the screenshots after each operation; For the saved screenshots, identify the screenshots with the same interface and retain one of them to obtain the screenshots with different interfaces that are retained; Based on the retained screenshots, obtain preset fields, and obtain the corresponding relationship between the screenshots with any one of the preset fields and the preset fields; Based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates of the operations to be performed, and manufacture an RPA robot for taking screenshots of the page where the preset field is located.

[0006] In one embodiment, the performing automatic operations on the operation interface according to a preset operation method includes: Perform operations on each coordinate position in the order of the preset coordinate positions.

[0007] In one embodiment, the performing operations on each coordinate position in the order of the preset coordinate positions includes: Perform operations on each coordinate position in the order of the preset coordinate positions, with each coordinate position moved 3px each time.

[0008] In one embodiment, the automatically operating the operation interface according to a preset operation mode includes: Automatically operate according to the preset operation types, and record the operation types corresponding to the screenshots after each operation. The operation types include single-click operations and double-click operations; The making of an RPA robot for taking screenshots of the page where the preset field is located based on the corresponding relationship and the page where the preset field is located, including: Based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates and operation types of the operations to be performed, and make an RPA robot for taking screenshots of the page where the preset field is located.

[0009] In one embodiment, the performing operations on each coordinate position in the order of the preset coordinate positions includes: Perform operations of all operation types on each coordinate position in the order of the preset coordinate positions.

[0010] In one embodiment, for the saved screenshots, retaining one of the screenshots with the same interface and obtaining the screenshots with different interfaces that are retained, including: Enter the operation interface of the software system. Before performing the first automatic operation, save a screenshot first. For the screenshots after any operation, compare them with the saved screenshot, and determine whether there is a screenshot in the saved screenshot that is the same as the screenshot after that arbitrary operation. If so, delete the screenshot after that arbitrary operation. If not, save the screenshot after that arbitrary operation, so as to obtain the screenshots with different interfaces that are retained.

[0011] In one embodiment, for the saved screenshots, retaining one of the screenshots with the same interface and obtaining the screenshots with different interfaces that are retained, including: Enter the operation interface of the software system. Before performing the first automatic operation, save a screenshot first, and save the screenshots after each operation in chronological order; Based on all the saved screenshots, for any current screenshot, determine whether there is a screenshot identical to the current one among the previous screenshots. If so, delete the current screenshot to obtain the screenshots with different interfaces that are retained.

[0012] In one embodiment, the saving format of the screenshots may include: NO_x_y.jpg; where NO represents the serial number of the screenshot, starting from 1 and incrementing by 1; x and y respectively represent the x-axis coordinate and y-axis coordinate of the operation coordinate position.

[0013] In one embodiment, the automatic operation of the operation interface according to a preset operation method includes: Automatically operate according to a preset operation type, and record the operation type corresponding to the screenshot after each operation. The operation types include single-click operation and double-click operation; The saving format of the screenshots may include: NO_x_y_click.jpg; where NO represents the serial number of the screenshot, starting from 1 and incrementing by 1; x and y respectively represent the x coordinate and y coordinate of the operation coordinate position; click represents the operation type.

[0014] In a second aspect, in one embodiment, a computer-readable storage medium is provided. A program is stored in the medium, and the program can be loaded and executed by a processor to perform the RPA robot manufacturing method described in any one of the above embodiments.

[0015] The beneficial effects of the present invention are: Due to the automatic operation of the operation interface according to the preset operation method, taking screenshots of the interface after each operation and saving them, and recording the operation coordinate positions corresponding to the screenshots after each operation, it is possible to obtain the screenshots that can be obtained at each operation coordinate position. For the saved screenshots, retain one of the screenshots with the same recognized interface, and obtain the screenshots with different remaining interfaces; based on the remaining screenshots, obtain the preset fields, and obtain the corresponding relationship between the screenshots with any one of the preset fields and the preset fields; so that it is possible to find the screenshot interface where the preset field to be extracted is located. Based on the above corresponding relationship and the page where the preset field is located, obtain the operation coordinates of the operations to be performed, and make an RPA robot for taking screenshots of the page where the preset field is located. In this way, according to the screenshot interface where the preset field is located, the coordinate positions of the operations required to obtain this screenshot interface each time can be obtained. In this way, it is possible to make an RPA robot for extracting the coordinate positions required to operate on the preset field, and take screenshots based on the coordinate positions, to obtain an RPA robot for extracting the screenshots of the preset field, thereby realizing the automatic production of the RPA robot for extracting the required screenshots of the preset field, reducing the workload of making the RPA robot, and greatly reducing the labor cost. Brief Description of the Drawings

[0016] Figure 1 It is a schematic flowchart of a method for making an RPA robot based on software screenshots according to an embodiment of the present application. Detailed Embodiments

[0017] The present invention will be further described in detail below in conjunction with the accompanying drawings through specific embodiments. Similar elements in different embodiments are labeled with related similar element numbers. In the following embodiments, many detailed descriptions are provided to enable a better understanding of the present application. However, those skilled in the art can easily recognize that some of the features can be omitted in different situations, or can be replaced by other elements, materials, or methods. In some cases, some operations related to the present application are not shown or described in the specification to avoid the core part of the present application being overwhelmed by excessive descriptions. For those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations based on the descriptions in the specification and the general technical knowledge in the art.

[0018] In addition, the features, operations, or characteristics described in the specification can be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can also be reordered or adjusted in a manner obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for clearly describing a certain embodiment and do not mean that they are the necessary sequences, unless it is stated that a certain sequence must be followed.

[0019] The serial numbers assigned to components in this text, such as "first", "second", etc., are only used to distinguish the described objects and do not have any sequential or technical meaning.

[0020] For the convenience of explaining the inventive concept of this application, the following briefly describes the RPA robot manufacturing technology.

[0021] In the current data extraction of stroke centers, for each version of the data source software, manual operation is required for the data extraction process. There are a total of 357 fields required by stroke centers, and the data for these fields comes from various different systems. RPA needs to be used to create robots for the collection of each field. It is very likely that the information systems used by different hospitals are provided by different information companies, and these companies may also have multiple versions of the same system. There are more than a hundred HIS software companies across the country, resulting in extremely high manpower consumption in finding which software interface a field is in. If RPA can also automatically locate the software system and interface where the field is located, then the labor cost will be greatly reduced.

[0022] The applicant found in the research that if RPA is to automatically locate the software system and interface where the field is located, first finding the screenshot of the software interface where the field is located and automatically locating it from the screenshot is a feasible option. However, to further improve work efficiency and reduce the workload of RPA robot manufacturing, realizing automatic screenshotting and creating a robot for taking corresponding page screenshots then becomes an urgent problem to be solved.

[0023] In view of this, the embodiments of this application provide an RPA robot manufacturing method and medium based on software screenshots. In the operation interface of the entered software system, the operation interface is automatically operated according to a preset operation method, the interface after each operation is screenshot and saved, and the operation coordinate position corresponding to the screenshot after each operation is recorded. In this way, screenshots that can be obtained at each operation coordinate position can be obtained. For the saved screenshots, screenshots with the same interface are identified and only one of them is retained, and screenshots with different interfaces are obtained; based on the retained screenshots, preset fields are obtained, and the corresponding relationship between the screenshots with any one of the preset fields and the preset fields is obtained; in this way, the screenshot interface where the preset field to be extracted is located can be found. Based on the above corresponding relationship and the page where the preset field is located, the operation coordinates of the operations to be performed are obtained, and an RPA robot for taking screenshots of the page where the preset field is located is manufactured. In this way, the coordinate positions of the operations required to obtain the screenshot interface each time can be obtained according to the screenshot interface where the preset field is located, so that the coordinate positions of the operations required to extract the preset field can be manufactured, and screenshots are taken based on the coordinate positions, and an RPA robot for taking screenshots of the extracted preset field is obtained, thereby realizing the automatic manufacturing of the RPA robot for taking screenshots required for extracting the preset field, reducing the workload of RPA robot manufacturing, and greatly reducing the labor cost.

[0024] The method for manufacturing an RPA robot based on software screenshots according to an embodiment of the present application can be applied to a computer system, which includes a processor and a computer storage medium. At least one processor is used to load and execute a program for the method for manufacturing an RPA robot based on software screenshots and perform processing.

[0025] For a method for manufacturing an RPA robot based on software screenshots in an embodiment of the present application, please refer to Figure 1 , including: Step S10, enter the operation interface of the software system, perform automatic operations on the operation interface according to a preset operation method, take screenshots of the interface after each operation and save them, and record the operation coordinate positions corresponding to the screenshots after each operation.

[0026] The applicant found in the research that in order to improve work efficiency and reduce the workload of manufacturing RPA robots, the traditional manual operation data extraction process is difficult to meet the automatic manufacturing requirements of RPA robots. To solve this technical difficulty, a feasible solution may be to find a screenshot of the software interface where the field is located and automatically locate and find the field to be extracted from the screenshot. In view of this, it is necessary to automatically manufacture a software screenshot RPA robot.

[0027] After entering the operation interface of the software system, different pages may appear at different operation positions. For example, a pop-up window may appear after an operation at certain operation positions, further detailed information may appear after an operation at certain operation positions, and the page may be updated after an operation at certain operation positions. And in these new pages, there may be fields that need to be extracted. Therefore, we need to take screenshots of the new pages after each operation to manufacture an RPA robot for automatic screenshotting. On the one hand, it is necessary to perform automatic operations on the page, and on the other hand, it is necessary to automatically take screenshots of the page after the automatic operation to implement the automatic manufacturing process of the RPA robot.

[0028] In one embodiment, performing automatic operations on the operation interface according to a preset operation method includes: performing operations on each coordinate position in sequence according to a preset coordinate position order. That is, in response to a preset operation order and operation method instruction, perform operations on each coordinate position in sequence according to a preset coordinate position order. For example, after entering a certain operation interface, automatic operations can be performed in the preset coordinate position order from left to right and top to bottom. In this way, after each operation at a coordinate position is completed, the next coordinate position operation is performed according to the preset coordinate position order until all the preset coordinate position operations are completed or all the coordinate position operations on the entire page are completed. Those skilled in the art can understand that the coordinate position order here can also be other coordinate position orders, and those skilled in the art can set it according to actual needs, which are all within the protection scope of the present application.

[0029] In one embodiment, operations are performed for each coordinate position in accordance with a preset order of coordinate positions. It may further include: moving 3 px for each coordinate position in accordance with the preset order of coordinate positions and performing operations for each coordinate position. Those skilled in the art can understand that the size of the movement can be configured according to actual requirements.

[0030] Operating on a software interface to obtain a new interface may be a single-click operation, a double-click operation, or other operation types. To ensure the comprehensiveness of the display of the new interface, in one embodiment, automatic operations are performed in accordance with a preset operation type, and the operation type corresponding to the screenshot after each operation is recorded, where the operation types include single-click operations and double-click operations.

[0031] In one embodiment, if there are more than two preset operation types, when performing operations for each coordinate position, after all preset operation types are executed at each operation position, then proceed to the next operation position for operations. For example, after the single-click operation and the double-click operation are executed at the current operation position, then proceed to the next coordinate position to execute the single-click operation and the double-click operation. It is also possible to perform operations for each coordinate position of one operation type first and then perform operations for each coordinate position of the next operation type. Those skilled in the art can understand that the operations for each coordinate position need to execute all operation types, and the specific operation method can be set according to requirements and is within the protection scope of this application.

[0032] In one embodiment, after entering the operation interface of the software system, a page screenshot is taken first before performing automatic operations.

[0033] Since the interface after each operation is screenshot and saved, and the operation coordinate position corresponding to the screenshot after each operation is recorded, then it is possible to know the operation coordinate positions that need to be executed to obtain the screenshot. If an RPA robot is produced subsequently, it is possible to know the operation coordinate positions that need to be automatically executed to obtain the target screenshot. In the case of multiple operation types, since the operation type corresponding to the screenshot after each operation is recorded, therefore, it is possible to know the operation types that need to be automatically executed to obtain the target screenshot. Thus, it is possible to know the operation position coordinates and operation types that need to be automatically executed to obtain the target screenshot.

[0034] For example, after performing a click operation on the operation coordinate position (x, y) of the current software page, a screenshot M is obtained. The disease type field to be extracted can be retrieved from the screenshot M. If the screenshot M is used as the target screenshot to create an RPA robot, since the specific operation coordinate position and operation type corresponding to the screenshot are known, the RPA robot for obtaining the target screenshot can be automatically created based on the operation coordinate position and operation type corresponding to the screenshot M, thereby realizing the automatic creation of the RPA robot.

[0035] Step S20: For the saved screenshots, retain one of the screenshots with the same interface and obtain the screenshots with different interfaces that are retained.

[0036] For a software interface, since there is a screenshot at each preset coordinate position, if there are 1000 preset coordinate positions, there will be 1000 screenshots. And if there are two operation types at each coordinate position, there will be 2000 screenshots. The applicant found in the research that there are a large number of duplicate screenshots among the 2000 screenshots, that is, screenshots with the same interface. For example, it is found that among the 2000 screenshots, 300 screenshots have the same interface, but we only need to retain one of them to obtain information. Therefore, in order to improve the recognition efficiency and reduce the occupation of computer resources, in one embodiment, step S20 may include: entering the operation interface of the software system, saving screenshots before performing the first automatic operation. For the screenshots after any operation, compare them with the saved screenshots, and determine whether there is a screenshot in the saved screenshots that is the same as the screenshot after the any operation. If so, delete the screenshot after the any operation. If not, save the screenshot after the any operation, thereby obtaining the screenshots with different interfaces that are retained.

[0037] Based on the above embodiment, enter the operation interface of the software system, save screenshots before performing the first automatic operation to obtain the first screenshot. For the screenshots after any operation, compare them with the saved screenshots. For example, after the first operation, a screenshot is obtained, which can be compared with the first screenshot. Determine whether there is a screenshot in the saved screenshots that is the same as the screenshot after the any operation. If so, delete the screenshot after the any operation. If not, save the screenshot after the any operation. If the screenshot obtained after the first operation is the same as the first screenshot, delete the screenshot obtained after the first operation to avoid duplicate screenshots. If the screenshot obtained after the first operation is different from the first screenshot, save the screenshot obtained after the first operation. And so on, all the screenshots with different interfaces that are retained are obtained. In this implementation, each time a screenshot is obtained, it is compared with the previously saved screenshots. If they are the same, delete it, which can reduce the occupation of storage space.

[0038] In one embodiment, as an alternative to the above embodiment, step S20 may include: entering the operation interface of the software system, taking a screenshot and saving it before performing the first automatic operation, and saving screenshots after each operation in chronological order; based on all the saved screenshots, for any current screenshot, determining whether there is a screenshot identical to the current screenshot among the previous screenshots, and if so, deleting the current screenshot, so as to obtain the screenshots with different interfaces that are retained.

[0039] Through any of the embodiments of step S20 above, duplicate pictures are cleared to ensure that there is only one picture for each interface.

[0040] In one embodiment, when there is only one operation type for the operation at each coordinate position, the saving format of the screenshot can be expressed as: NO_x_y.jpg; where NO represents the serial number of the screenshot, starting from 1 and incrementing by 1; x and y respectively represent the x-axis coordinate and y-axis coordinate of the operation coordinate position. For example, if the saving format of a certain screenshot can be expressed as 102_15_603.jpg, it means that the serial number of this screenshot is 102, and the position coordinate of the operation is (15, 603).

[0041] In the case where there are multiple operation types for the operation at each coordinate position, in one embodiment, the saving format of the screenshot can be expressed as: NO_x_y_click.jpg; where NO represents the serial number of the screenshot, starting from 1 and incrementing by 1; x and y respectively represent the x coordinate and y coordinate of the operation coordinate position; click represents the operation type. For example, if the saving format of a certain screenshot can be expressed as 102_15_603_1.jpg, it means that the serial number of this screenshot is 102, the position coordinate of the operation is (15, 603), and the operation type is 1. If operation type 1 represents a click operation, it means the operation type is a click operation. Thus, if the screenshot with the format 102_15_603_1.jpg is the target picture for extracting a preset field, the RPA robot that produced this screenshot can be obtained according to the format information of this screenshot, that is, the information of this RPA robot may include taking a screenshot after a click operation at the coordinate position (15, 603) and saving it to a preset location.

[0042] Step S30, based on the retained screenshots, obtain the preset fields, and obtain the correspondence between the screenshots with any one of the preset fields and the preset fields.

[0043] Taking one of the preset fields as "department name" as an example, screenshots with "department name" can be recognized by OCR. In this way, the corresponding relationship between the preset field and the screenshots can be obtained, and the screenshots without the preset field can be deleted, only retaining the screenshots with the preset field.

[0044] Step S40: Based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates of the operations to be performed, and create an RPA robot for taking screenshots of the page where the preset field is located.

[0045] In the case of knowing the corresponding relationship between the screenshots and the preset fields, for the preset field "department name", the screenshots required to reach the "department name" field can be known. In the above embodiment, since the operation coordinate positions corresponding to the screenshots are recorded, an RPA robot for the screenshot of the "department name" field can be created based on the relationship between the screenshots and the operation position coordinates.

[0046] In one embodiment, in the case of multiple operation types, based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates and operation types of the operations to be performed, and create an RPA robot for taking screenshots of the page where the preset field is located.

[0047] One embodiment of the present application provides a computer-readable storage medium, on which a program is stored. The stored program includes methods that can be loaded and processed by a processor in any of the above embodiments.

[0048] Those skilled in the art can understand that all or part of the functions of the various methods in the above embodiments can be implemented in a hardware manner or in a computer program manner. When all or part of the functions in the above embodiments are implemented in a computer program manner, the program can be stored in a computer-readable storage medium. The storage medium may include: read-only memory, random access memory, magnetic disk, optical disk, hard disk, etc. The above functions are implemented by a computer executing the program. For example, when the program is stored in the memory of a device and the program in the memory is executed by a processor, all or part of the above functions can be implemented. In addition, when all or part of the functions in the above embodiments are implemented in a computer program manner, the program can also be stored in a storage medium such as a server, another computer, magnetic disk, optical disk, flash drive, or mobile hard disk, downloaded or copied and saved to the memory of a local device, or the system of the local device is updated. When the program in the memory is executed by a processor, all or part of the functions in the above embodiments can be implemented.

[0049] The above uses specific examples to illustrate the present invention, which is only used to help understand the present invention and is not intended to limit the present invention. For those skilled in the art to which the present invention pertains, based on the idea of the present invention, several simple deductions, deformations or substitutions can also be made.

Claims

1. A method for manufacturing an RPA robot based on software screenshots, characterized in that Including: Enter the operation interface of the software system, perform automatic operations on the operation interface according to the preset operation method, take screenshots of the interface after each operation and save them, and record the operation coordinate positions corresponding to the screenshots after each operation; For the saved screenshots, identify the screenshots with the same interface and keep only one of them, obtaining the screenshots with different interfaces that are retained; Based on the retained screenshots, obtain the preset fields, and obtain the corresponding relationship between the screenshots with any one of the preset fields and the preset fields; Based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates of the operations to be performed, and create an RPA robot for taking screenshots of the page where the preset field is located.

2. The method for manufacturing an RPA robot according to claim 1, wherein, The automatic operation of the operation interface according to the preset operation method includes: Perform operations coordinate by coordinate in the order of the preset coordinate positions.

3. The method for manufacturing an RPA robot according to claim 2, wherein, The performing operations coordinate by coordinate in the order of the preset coordinate positions includes: Perform operations coordinate by coordinate in the order of the preset coordinate positions, moving 3px for each coordinate position each time.

4. The method for manufacturing an RPA robot according to claim 1, wherein, The automatic operation of the operation interface according to the preset operation method includes: Perform automatic operations according to the preset operation types, and record the operation types corresponding to the screenshots after each operation. The operation types include single-click operations and double-click operations; The obtaining the operation coordinates of the operations to be performed based on the corresponding relationship and the page where the preset field is located, and creating an RPA robot for taking screenshots of the page where the preset field is located includes: Based on the corresponding relationship and the page where the preset field is located, obtain the operation coordinates and operation types of the operations to be performed, and create an RPA robot for taking screenshots of the page where the preset field is located.

5. The method for manufacturing an RPA robot according to claim 4, wherein The performing operations coordinate by coordinate in the order of the preset coordinate positions includes: Perform operations of all operation types for each coordinate position in the order of the preset coordinate positions.

6. The method for manufacturing an RPA robot according to claim 1, wherein The identifying the screenshots with the same interface and keeping only one of them for the saved screenshots, obtaining the screenshots with different interfaces that are retained includes: Enter the operation interface of the software system. Before performing the first automatic operation, take a screenshot and save it. For the screenshots after any operation, compare them with the saved screenshot, and determine whether there is a screenshot in the saved screenshot that is the same as the screenshot after the any operation. If so, delete the screenshot after the any operation. If not, save the screenshot after the any operation, thereby obtaining the screenshots with different interfaces that are retained.

7. The method for manufacturing an RPA robot according to claim 1, wherein The identifying the screenshots with the same interface and keeping only one of them for the saved screenshots, obtaining the screenshots with different interfaces that are retained includes: Enter the operation interface of the software system. Before performing the first automatic operation, take a screenshot and save it, and save the screenshots after each operation in chronological order; Based on all the saved screenshots, for any current screenshot, determine whether there is a screenshot among the previous screenshots that is the same as the any current screenshot. If so, delete the any current screenshot, thereby obtaining the screenshots with different interfaces that are retained.

8. The method for manufacturing an RPA robot according to claim 1, characterized in that, The saving format of the screenshots can include: NO_x_y.jpg; Among them, NO represents the serial number of the screenshot, starting from 1 and increasing by 1 sequentially; x and y respectively represent the x-axis coordinate and y-axis coordinate of the operation coordinate position.

9. The method for manufacturing an RPA robot according to claim 4, wherein The automatic operation of the operation interface according to a preset operation method includes: Performing automatic operation according to a preset operation type, and recording the operation type corresponding to the screenshot after each operation, where the operation type includes single-click operation and double-click operation; The saving format of the screenshot can include: NO_x_y_click.jpg; Among them, NO represents the serial number of the screenshot, starting from 1 and increasing by 1 sequentially; x and y respectively represent the x coordinate and y coordinate of the operation coordinate position; click represents the operation type.

10. A computer-readable storage medium, characterized in that, The medium stores a program that can be loaded and executed by a processor to perform the RPA robot manufacturing method described in any one of claims 1 to 9.

Images