Mobile application control sampling method based on sliding window and control information

A mobile application and sliding window technology, which is applied in computer components, software testing/debugging, character and pattern recognition, etc., can solve the problems of lack of control sampling methods, improve effective coverage, improve accuracy, and reduce misjudgment Effect

Pending Publication Date: 2022-08-02
ZHEJIANG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are many methods for automatic traversal of mobile applications. They design strategies based on breadth-first search or deep wired search. Relationship and page similarity are pruned, but the control sampling method is very lacking

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile application control sampling method based on sliding window and control information
  • Mobile application control sampling method based on sliding window and control information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The technical solutions of the present invention will be described in detail below with reference to the accompanying drawings.

[0031] like figure 1 As shown in the present invention, a mobile application control sampling method based on sliding window and control information, the specific steps are as follows:

[0032] S1: Turn on the screen reader that comes with the mobile phone operating system. After turning on the device control module, the controls on the mobile application page are successively focused.

[0033] Specifically, the Android screen reader is selected as Talkback, or the iOS screen reader is VoiceOver; the device control module iOS is selected to simulate the Bluetooth keyboard control, or Android uses the accessibility service of the system, which can focus on the previous / next control, return, click to enter control, etc.

[0034] S2: When a control on the page of the mobile application is focused, obtain information such as the size, position ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mobile application control sampling method based on a sliding window and control information, which comprises the following steps of: respectively acquiring structure information of a mobile application control through functional characteristics of a mobile phone operating system and an external computer vision means, mining similar modes from a time sequence flow of the control information by using a sliding window method, and sampling the control information by using the similar modes. In this way, the purpose of sampling the controls is achieved, and when the controls of the page are clicked and traversed subsequently, the control groups with high similarity will be skipped. For an Android system, the position, the size, the control label type, the text and the like of each control are obtained by utilizing a system-level barrier-free service and a talkback function of the Android system; for an iOS system, a focusing frame and an auxiliary text generated by a VoiceOver function of the iOS system are identified by using a computer vision technology, so that the size, the position and the text information of a focused control are obtained.

Description

technical field [0001] The invention belongs to the field of automatic detection of mobile applications, in particular to a mobile application control sampling method based on sliding windows and control information. Background technique [0002] With the rapid development of the Internet, the number of various web and mobile applications has exploded. Huge user groups and various mobile applications also pose new challenges to the field of automatic detection of mobile applications. [0003] At present, there are many methods for automatic traversal of mobile applications. They design strategies based on breadth-first search or deep-line search. Some of them analyze the source code in advance to obtain page relationships, and some are based on the topology between pages. The relationship and page similarity are pruned, but the sampling method of the control is very lacking. SUMMARY OF THE INVENTION [0004] The purpose of the present invention is to provide a mobile app...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36G06V30/414G06F3/04847
CPCG06F11/3676G06F11/3684G06F11/3688G06F11/3696G06V30/414G06F3/04847Y02D30/70
Inventor 卜佳俊张建锋周晟蔡宇航于智王炜
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap