Method and device for determining operation coordinate of automation test script during playback

Abstract

The invention relates to a method and a device for determining an operation coordinate of an automation test script during playback, comprising steps of zooming a graphic user interface of a tested mobile device to a preset size to obtain a first graph user interface and a second graphic user interface before recording and playing back the test script, recording the operation coordinate and the operation icon during the recording process during the process of recording the test script, calculating the characteristic points of the operation icon and the second graphic user interface during the process of playing back the test script, screening a characteristic point as an effective characteristic point from the characteristic points according to the distance between the operation coordinate, calculating all the matching points between the effective characteristic point and the operation coordinate, and using the mass center of the calculated matching point as the operation coordinate for the playback. The disclosed technical scheme can effectively filter the noise point which is relatively far away from the real object, can accurately match the operation object during recording and improves the matching efficiency.

Description

Technical field [0001] The present disclosure relates to the field of image recognition technology, and in particular, to a method and device for determining operation coordinates during playback of an automated test script. Background technique [0002] At present, the related technologies based on the recording and playback of picture scripts are sikuli (Sikuli is a novel graphics scripting language, which is a novel graphics scripting language designed by MIT researchers. Computer users only need to have the most basic programming skills. To write out lines of code, instead of using screenshots to combine the captured graphic elements to create a magical program), this technology uses a pixel-based template matching method for image recognition, that is, by sliding the template image and The original images are compared, and the difference result of each sliding comparison is obtained through the square difference matching algorithm, and finally the area of ​​the sliding compa...

AI Technical Summary

Problems solved by technology

[0005] However, in the actual application of script recording and playback, there are still some problems with the use of SIFT feature matching. First, it will lead to incorrect matching of operation coordinates. Unnecessary matching points will affect the accuracy of matching results and matching positions, and affect the accuracy of target relocation.

When SIFT features are matched, two key points with different positions may have similar feature vectors, so that the algorithm considers that these two key points match, and these unnecessary matching points will affect the accuracy of the matching results and matching positions. , affecting the accuracy of target relocation

Secondly, the matching operation time affects the real-time performance of playback. When SIFT feature points are matched, the 128-dimensional feature vector distance calculation will generate unnecessary computing time for matching with invalid SIFT feature points, which will affect the real-time playback performance.

Images