Interface element processing method and device and electronic equipment

Abstract

The invention relates to the technical field of graphical user interfaces of application programs, in particular to a method and a device for enabling a GUI analysis program to recognize and operate interface elements, which do not support Activity, of a mobile device app, and electronic equipment, and the method comprises the following steps: acquiring operation of a user on the interface elements of the application program; when it is detected that the operation is not responded within preset time, obtaining identification information of the interface element operated by the user from a screen road sign database, wherein the screen road sign database comprises at least one interface element and identification information corresponding to the interface element; and controlling a graphical user interface program to load the identification information to obtain graphical user interface information corresponding to the interface element. According to the invention, the operation of the user on the interface elements can be timely and accurately responded, and particularly when the GUI of the application program cannot be analyzed by the graphical user interface program, the user experience of the user who urgently uses the GUI of the application program can be obviously improved.

Description

technical field [0001] The invention relates to the technical field of graphic user interface of application programs, in particular to a processing method, device and electronic equipment of interface elements. Background technique [0002] A graphical user interface or a graphical user interface (Graphical User Interface, GUI) refers to a computer operating environment user interface displayed in a graphical manner. Graphical interfaces are easier for users to use than command-line interfaces used by early computers. The wide application of GUI is one of the major achievements in the development of today's computers. It greatly facilitates the use of non-professional users. People no longer need to memorize a large number of commands by rote. Easy to operate. [0003] As the GUI evolved, it became more complicated to run the GUI parser. Therefore, the GUI parsing program is forced to adopt the underlying technology to collect the information of the operating system to b...

AI Technical Summary

Problems solved by technology

[0004] However, when the application does not follow the relevant development specifications, it loses its effectiveness

For example, because Microsoft Word does not follow MSAA, the GUI analysis program cannot scan and analyze the GUI information of Microsoft Word, resulting in the inability to respond to user operations on interface elements in a timely and accurate manner.

Images