Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Cross-platform script recording and playback method based on image recognition

A technology of image recognition and script recording, which is applied in character and pattern recognition, instruments, electrical digital data processing, etc., can solve the problems of high testing cost, etc., achieve the effect of strengthening cross-platform capabilities, lowering the threshold of generation, and reducing maintenance costs

Pending Publication Date: 2021-03-30
NANJING UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the diversity of mobile device models and platforms, and the variability of the UI interface itself, there are a lot of repetitive modifications and maintenance in the actual production process of UI automation test scripts.
At the same time, the writing of test scripts is based on high-level language, which has high technical requirements for testers
A large number of repetitive scripts under different platforms and models need to be modified and maintained, resulting in high testing costs for enterprises

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-platform script recording and playback method based on image recognition
  • Cross-platform script recording and playback method based on image recognition
  • Cross-platform script recording and playback method based on image recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] This method mainly includes three parts: device management, script recording, and script playback. For the overall structure, see figure 1 . Script recording and script playback are the core parts of this method; device management is mainly responsible for remote mobile device access, status monitoring, interface acquisition, command distribution and execution, etc.; image recognition and processing technology in script playback is to realize test script multi-device, Key points for cross-platform playback.

[0021] The device management module is mainly used for device access, device status monitoring, device data transmission and device query. figure 2 The operation process of the whole module is described.

[0022] When the system starts, the device listener and timer will start accordingly. The device listener will trigger an access event when a new device is connected to the system, and then obtain the software and hardware information of the newly connected mob...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a cross-platform script recording and playback method based on image recognition, which is used for reducing an automatic test script writing threshold in the field of automatictest of mobile applications and avoiding repeated script writing and maintenance overhead of the same application under different devices and different platforms. The main innovation of the method isas follows: (1) a traditional script recording method is improved, and a Web terminal in which a remote real machine is put is provided for a user to operate and record in real time; and (2) the image recognition and layout matching technology is combined to realize the operation playback of the recorded script under multiple devices and different platforms, the cross-platform capability of the test script is greatly improved while the automatic script generation process is simplified, and the effectiveness and universality of the automatic test are improved.

Description

technical field [0001] The invention belongs to the technical field of software testing in computer technology, especially the technical field of automated testing in software testing. It is used for recording mobile application testing operations, generating automated testing scripts, and realizing single-time recording of testing scripts in combination with image recognition technology. Multi-device and cross-platform playback. Background technique [0002] With the comprehensive and rapid development of the mobile Internet, user needs are no longer limited to the functional level, and people pay more and more attention to software quality. As the quality assurance of mobile applications, software testing is particularly important in the entire development process. The existing test types in the industry can be divided into unit test, interface test and UI (User Interface) test. Since unit tests and interface tests are relatively stable, existing test frameworks are suff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36G06K9/62
CPCG06F11/3688G06F11/3684G06F18/22
Inventor 房春荣田元汉虞圣呈李秋婷吉品刘佳玮
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com