RPA robot intelligent element positioning and picking method and system

A technology of robot intelligence and elements, applied in neural learning methods, instruments, computer parts, etc., can solve the problems of inability to locate and operate elements, and achieve accurate and stable effects, accurate element positioning and picking, and controllable element positioning Effect
CN112101357AActive Publication Date: 2020-12-18杭州实在智能科技有限公司
4 Cites 20 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
杭州实在智能科技有限公司
Publication Date
2020-12-18

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses an RPA robot intelligent element positioning and picking method and system. According to the method, firstly a problem that a remote desktop, a virtual system and other elements cannot be positioned and operated is solved through employing a computer vision technology combining template matching, OCR and image retrieval, and a proposed new scheme can more accurately and stably locate and pick up the positions and contents of the elements on the picture; secondly, an element positioning scheme based on template matching is adopted, a large number of labeling samples arenot needed, and the scheme is more stable and controllable; thirdly, pixel point features, corner point features and convolution features of a deep neural network are fused, so that the template matching effect is more accurate and stable, and meanwhile, the OCR technology can further assist in positioning elements with text information; and finally, a template library retrieval engine is constructed by adopting an image retrieval technology, and which application the page picture to be processed belongs to can be accurately judged, so that the problem of low retrieval and matching speed caused by template library growth in multiple scenes is solved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of page element positioning, in particular to a method and system for positioning and picking intelligent elements of an RPA robot. Background technique

[0002] With the gradual disappearance of my country's demographic dividend, the national economy has entered a "new steady state". Many enterprises will reduce labor costs and improve personnel efficiency as their core development demands, and use intelligent and automated technologies to empower and transform existing business operations, management and offices. The mode of entrusting simple tasks to machines has become a new trend and will bring new momentum to economic and social development. RPA (Robot Process Automation) technology is a process automation technology. Through the process editor provided by RPA software, business operation processes that can be automatically executed can be designed and configured, and packaged into the form of "software...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More