Mobile application program user interface error automatic detection method, system and terminal

Abstract

The invention provides a mobile application program user interface error automatic detection method, which comprises the following steps of obtaining the hierarchical relationship among the controls in an interface screenshot and the node information of each control to form an original data set; establishing a single control error classification model, and performing error detection on the text control and the image control by utilizing the single control error classification model; describing the relative position relationship, the symbiotic relationship and the mutual dependency relationshipamong the control pairs, and generating a relationship assertion table among the control pairs; and performing control error detection on the newly acquired interface screenshot by using the model and the assertion table. The invention also provides a detection system and a terminal. According to the present invention, the UI control errors existing in the APP are effectively positioned, the detection model is continuously optimized according to the detection result, the error detection efficiency is improved, and the human and worker cost is greatly reduced. The method can be widely appliedto the mobile application program UI testing, and an efficient and available automatic UI error detection method is provided for the development and testing of the mobile application program.

Description

technical field [0001] The present invention relates to the technical field of mobile terminal software testing, in particular to a mobile application user interface (UI) error automatic detection method, system and terminal. Background technique [0002] As the first step in the interaction between the APP and the user, the user interface is very important to the user experience. If there is an error in the display of the UI content of the APP, or if there is ambiguity in the UI layout, it may lead to user loss. Therefore, checking and discovering UI errors during APP testing is an important part of the APP development process. A large number of screenshots are generated during the testing process of existing mobile applications (APP), and manual review of screenshots is generally used to find errors such as user interface layout, misalignment, and failure to load. However, this method is costly, time-consuming, inefficient and easy to overlook some small errors. [0003...

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a mobile application program for the deficiencies in the prior art, such as low accuracy rate of manual review, high test cost, high randomness of test, low test efficiency and few UI error detection methods in the UI test technology existing in the prior art. Graphical interface error automatic detection method, system and terminal

Images