Robotic process automation

A robot and computer technology, applied in the field of robot processing automation, can solve problems such as time-consuming, and achieve the effect of improving system accuracy, reducing memory requirements, and reducing memory requirements

Active Publication Date: 2020-02-25
ACCENTURE GLOBAL SOLUTIONS LTD
View PDF26 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Manual processing performed on a computer can be repetitive and time-consuming

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robotic process automation
  • Robotic process automation
  • Robotic process automation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016]The robotic system may perform the corresponding process using, for example, executing a script defining one or more operations. The process may include interacting with one or more applications, including applications including selectable user interface icons. When the script defines the operation of the user interface interaction, the robotic system can use the script to compare the image of the user interface icon referenced by the script with the icons included in the user interface generated by the application, with which the robotic system interacts to determine which icon to select.

[0017] Given that robotic systems rely on images of user interface icons, the quality of the images may affect the accuracy with which robotic systems perform certain procedures. For example, if the image depicts the wrong icon or content adjacent to the icon, it may be difficult for the robotic system to locate the icon, select the icon, or both within the user interface. For examp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for creating user interface control images for robotic automation. One of the methods includes detecting, during a training process, a control selection event; retrieving a first image and a second image; determining a difference image that represents a difference between the first image and the secondimage; determining, using the difference image, a plurality of colors for pixels included in the difference image that are likely located outside of a control location for the control; determining oneor more shapes depicted in the difference image that each have a color other than all of the colors in the plurality of colors; selecting, from the one or more shapes and using an event location, a particular shape as likely representing the control; and storing a cropped image of the control extracted from one of the two or more images.

Description

technical field [0001] The present disclosure relates generally to robotic process automation. Background technique [0002] Manual processing performed on a computer can be repetitive and time-consuming. For example, a user may send an email in response to a web form submission, and for each web form submission, manual interaction with the computer may be required to click a button to open a window for composing a new email, click a button to send the web form submission to the Copy the information into the window, click the button to write the text of the email body, and click the button to send the email. Contents of the invention [0003] In some implementations, the robotic training system may use computer vision and user interface component analysis to identify user interface controls, such as icons, selected during a process automated by the robotic training system. The robot training system can analyze differences between the plurality of images of the user inter...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/451G06Q10/10
CPCG06F9/451G06Q10/107G06Q10/00G06T7/90G06F16/51B25J9/163B25J9/1697G06T1/0014G06T3/40G06T2200/24G06T2207/10024G06T2207/20081G06F18/22
Inventor C·D·威特J·范登赫维尔P·M·K·普拉萨德
Owner ACCENTURE GLOBAL SOLUTIONS LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products