Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for automatically extracting desktop elements based on computer vision

A computer vision and element technology, applied in computing, user interface execution, 3D image processing, etc., can solve problems such as failure to successfully obtain desktop elements

Pending Publication Date: 2022-06-07
上海云扩信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for some special applications, such as Flash and some special systems, the above method cannot successfully obtain desktop elements
For these scenarios, the implementation and application of RPA have brought great challenges

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for automatically extracting desktop elements based on computer vision
  • Method for automatically extracting desktop elements based on computer vision
  • Method for automatically extracting desktop elements based on computer vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The following will be combined with the accompanying drawings in the embodiments of the present invention, the technical solution in the embodiments of the present invention will be described clearly and completely, it is clear that the embodiments described are only a part of the embodiment of the present invention, not all embodiments. Based on embodiments in the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative work, are within the scope of protection of the present invention.

[0027] The present embodiment provides a technical solution: a method based on automated extraction of desktop elements of computer vision, such as Figure 1As shown, the current desktop display window is first obtained through the local system API. If the local system call fails, you can obtain the position and size information of the current window through target detection. Renders the obtained window and prompts the user to select th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for automatically extracting desktop elements based on computer vision. The method specifically comprises the following steps: step 1, acquiring a target window image; step 2, positioning and identifying elements in the window body; and 3, selecting and confirming elements of the window body. According to the method, desktop elements can be positioned and recognized, and the method is not only suitable for Flash and some special systems, but also suitable for element recognition of other general scenes.

Description

Technical field [0001] The present invention relates to the technical field of computer vision desktop elements, specifically a method based on the automated extraction of computer vision desktop elements. Background [0002] In Robotic Process Automation, desktop elements need to be identified in order for robots to interact non-intrusively with various applications. Desktop elements include the basic elements of icon, Button, Checkbox, RadioBox, Inputbox, etc. [0003] In general-purpose Windows applications and web applications, desktop elements can obtain information about elements through interfaces such as operating systems and Web drivers. However, for some special applications, such as Flash and some special systems, the above methods cannot successfully obtain desktop elements. For these scenarios, the implementation and application of RPA bring great challenges. Contents of the Invention [0004] Object of the present invention is to provide a method based on automated...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/00G06F9/451
CPCG06T15/005G06F9/451
Inventor 刘春刚李佩钊
Owner 上海云扩信息科技有限公司