User interface interactive process recording method and system, computer equipment and readable storage medium

A user interface and interactive technology, applied in the direction of user interface execution, program control device, hardware monitoring, etc., can solve the problem that the recording technology cannot be extended at the product level, achieve the effect of good user experience and improve efficiency

Pending Publication Date: 2022-07-01
DATAGRAND TECH INC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] B. It is impossible to carry out in-depth product-level expansion with the current recording technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User interface interactive process recording method and system, computer equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Embodiment 1, the method for recording an interactive flow of a user interface of the present invention is described in detail below through specific examples.

[0057] In this embodiment, the user interface interactive process recording method of the present invention includes the following steps:

[0058] S1, according to the current screen coordinates of the mouse to determine its corresponding user interface element and element position, the specific steps are:

[0059] First, determine its screen coordinates according to the current position of the mouse, and determine its corresponding user interface element according to the screen coordinates of the mouse;

[0060] Then, determine whether the user interface element belongs to the interface element native to the operating system. If the user interface element is an interface element native to the operating system, locate the position of the user interface element through the API interface provided by the operating...

Embodiment 2

[0066] In the second embodiment, the user interface interactive process recording method in this embodiment is basically the same as that in the first embodiment, but there are differences.

[0067] In this embodiment, the user interface interactive process recording method of the present invention includes the following steps:

[0068] S1, according to the current screen coordinates of the mouse to determine its corresponding user interface element and element position, the specific steps are:

[0069] First, determine its screen coordinates according to the current position of the mouse, and determine its corresponding user interface element according to the screen coordinates of the mouse;

[0070] Then, determine whether the user interface element belongs to the interface element native to the operating system. If the user interface element is not an interface element native to the operating system (such as Java, SAP, etc.), then determine whether the application where the...

Embodiment 3

[0075] In the third embodiment, the user interface interactive process recording method in this embodiment is basically the same as that in the second embodiment, but there are differences.

[0076] In this embodiment, the user interface interactive process recording method of the present invention includes the following steps:

[0077] S1, according to the current screen coordinates of the mouse to determine its corresponding user interface element and element position, the specific steps are:

[0078] First, determine its screen coordinates according to the current position of the mouse, and determine its corresponding user interface element according to the screen coordinates of the mouse;

[0079] Then, determine whether the user interface element belongs to the interface element native to the operating system. If the user interface element is not an interface element native to the operating system (such as Java, SAP, etc.), then determine whether the application where the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a user interface interactive process recording method and system, computer equipment and a readable storage medium, which can eliminate a large amount of interference caused by process recording based on an operating system event, each recording step is definitely defined, more effective process codes can be generated, and the process recording efficiency is improved. The process recording efficiency is improved, and more attention is paid to the recording of business logic; meanwhile, the problem that product-level expansion is difficult to carry out in the recording process is solved, deep combination with products and product-level expansion can be supported through interactive logic, more product forms can be expanded, a plug-in solution is provided for later product newly-added functions and transverse infinite expansion, and better user experience can be provided.

Description

technical field [0001] The invention relates to the technical field of RPA automated testing, and in particular, to a user interface interactive process recording method, system, computer device and readable storage medium. Background technique [0002] User interface process recording (hereinafter referred to as "process recording") is mainly used for precipitation of behavior during the user's operation of the business environment. The user's behavior is automatically recorded through the capabilities provided by the operating system. Process recording mainly uses the event mechanism provided by the operating system to record user behavior, which is achieved by recording the user's interaction behavior with interface elements. [0003] In addition, the positioning of user interface elements mainly uses Accessibility and CV (ComputerVision) two technologies. Through these two techniques, RPA or automated testing can freely obtain information about user interface elements ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/451G06F11/34G06F11/36
CPCG06F9/451G06F11/3604G06F11/3438
Inventor 何双钻张涛刘迪康王攀邵万骏金克陈运文纪达麒
Owner DATAGRAND TECH INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap