User interface identification method and device

A user interface and identification method technology, applied in the field of data processing, can solve problems such as affecting user usage, UI display confusion, display confusion, etc., and achieve the effect of efficient and accurate out-of-frame situations

Pending Publication Date: 2020-03-06
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] UI element overframe is a common cause of UI display confusion. UI element overframe refers to the situation where the UI element exceeds the original specified area in the displayed image, for example, the text of the virtual button is too long and exceeds the border of the virtual button , UI elements out of frame will lead to display confusion, and even block other UI elements, seriously affecting the user's use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User interface identification method and device
  • User interface identification method and device
  • User interface identification method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Embodiments of the present application are described below in conjunction with the accompanying drawings.

[0044] At present, the manual method is mainly used, that is, the superframe of the UI element in the software is inspected by naked eyes, which leads to low detection efficiency and accuracy.

[0045] For this reason, the embodiment of the present application provides a user interface identification method, hoping that after determining the topological relationship between the UI elements in the display image of the software to be tested, the automatic traversal of the UI elements in the display image can be realized based on the topological relationship, and the identification Among them, the super frame situation of UI elements. Based on this automatic traversal method, the overframe situation of the UI elements in the software under test can be determined efficiently and accurately.

[0046] It should be noted that the user interface identification method pro...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a user interface identification method and device. The user interface identification method can be applied to user interface identification of various game software. The user interface identification method includes the steps of automatically determining a plurality of user interface elements, at least including a first user interface element and a seconduser interface element, included in a display image by analyzing the display image displayed when to-be-tested software runs and traversing the display image; determining the overlapping condition ofthe regions where a plurality of user interface elements are located according to the determined position information of the region of the plurality of user interface elements in the display image; and if the region frame of the region where the first user interface element is located is overlapped with the region frame of the region where the second user interface element is located, identifyingthe super-frame condition on the display image. Therefore, the user interface element super-frame condition of the to-be-tested software can be efficiently and accurately determined.

Description

technical field [0001] The present application relates to the field of data processing, in particular to a user interface identification method and device. Background technique [0002] Various types of software can be configured in smart devices, such as application programs, applets, APPs, etc., to provide users with various functional services by running the software. When the software is running, the display image can include various user interface (UI) elements or combinations, such as virtual buttons, images, text, etc. Whether the display of UI elements in the display image is chaotic can reflect the quality of the software. [0003] UI element overframe is a common cause of UI display confusion. UI element overframe refers to the situation where the UI element exceeds the original specified area in the displayed image, for example, the text of the virtual button is too long and exceeds the border of the virtual button , UI elements out of frame will lead to display ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/38A63F13/52
CPCA63F13/52G06F8/38
Inventor 张飞阳
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap