A rpa robot intelligent element positioning and picking method and system
A technology of robot intelligence and elements, applied in neural learning methods, instruments, computer parts, etc., can solve problems such as inability to locate and operate elements
Active Publication Date: 2021-04-27
杭州实在智能科技有限公司
View PDF4 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0018] First of all, the computer vision technology combining template matching, OCR and image retrieval is used to solve the problem that elements such as remote desktops and virtual systems cannot be located and operated in RPA application scenarios. The proposed new solution can locate and pick up more accurately and stably The position and content of elements on the image;
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0055] The principle and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present invention, rather than to limit the scope of the present invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. "Example" or "implementation manner" in the description may mean one embodiment or an implementation manner, or some embodiments or some implementation manners.
[0056] Those skilled in the art know that the embodiments of the present invention can be implemented as a system, device, device, method or computer program product. Therefore, the present disclosure may be specifically implemented in the form of complete hardware, complete software (including firmw...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method and system for positioning and picking intelligent elements of an RPA robot. Firstly, the computer vision technology combining template matching, OCR and image retrieval is used to solve the problem that elements such as remote desktops and virtual systems cannot be located and operated. The scheme can more accurately and stably locate and pick up the position and content of elements on the picture; secondly, the element positioning scheme based on template matching is adopted, which does not require a large number of labeled samples, and is more stable and controllable; thirdly, the fusion of pixel features, The corner feature and the convolution feature of the deep neural network make the template matching effect more accurate and stable. At the same time, the OCR technology can further assist the positioning of elements with text information; finally, the image retrieval technology is used to build a template library search engine, which can Accurately determine which application the page picture to be processed belongs to, so as to solve the problem of slow retrieval and matching speed caused by the growth of the template library in multiple scenarios.
Description
technical field [0001] The invention relates to the technical field of page element positioning, in particular to a method and system for positioning and picking intelligent elements of an RPA robot. Background technique [0002] With the gradual disappearance of my country's demographic dividend, the national economy has entered a "new steady state". Many enterprises will reduce labor costs and improve personnel efficiency as their core development demands, and use intelligent and automated technologies to empower and transform existing business operations, management and offices. The mode of entrusting simple tasks to machines has become a new trend and will bring new momentum to economic and social development. RPA (Robot Process Automation) technology is a process automation technology. Through the process editor provided by RPA software, business operation processes that can be automatically executed can be designed and configured, and packaged into the form of "software...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/635G06V30/10G06N3/045G06F18/241
Inventor 欧阳小刚
Owner 杭州实在智能科技有限公司