User interface playback method and device, equipment, and storage medium

A user interface and user technology, applied in the direction of user interface execution, program control devices, instruments, etc., can solve the problem of high cost of maintaining test cases, and achieve the effect of reducing the requirements of code capabilities

Pending Publication Date: 2020-12-18
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, this method requires high coding ability of testers, and the bottom layer of the UI test framework is tightly coupled with the application development framework code of the application. When the application development framework is updated, the existing test cases need to be re-adapted. configuration, making maintenance test cases also have a large cost, especially in high-speed iterative mobile applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User interface playback method and device, equipment, and storage medium
  • User interface playback method and device, equipment, and storage medium
  • User interface playback method and device, equipment, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Embodiments of the present application are described below in conjunction with the accompanying drawings.

[0045] In related technologies, the automation framework Appium is mainly used to realize UI playback. The principle of the automation framework can be found in figure 1 As shown, testers can write codes on the client 101 to obtain test cases, and testers can use multiple programming languages ​​such as Java, Ruby, Python, etc. to write test cases to adapt to different systems. The written test cases can be uploaded to the server 102, and Appium can be applied to devices with different operating systems, such as MAC systems, Windows systems, IOS systems, and Android systems. Taking the playback of test cases on IOS and Android devices as an example, the proxy unit 103 and the driver 104 can be used to drive the underlying libraries of each system during playback to achieve playback or automation capabilities. Wherein, the driver 104 on the device of the IOS syste...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a user interface playback method and device, equipment and a storage medium, and the method comprises the steps: recording an interaction process of a user and a user interface, and obtaining a to-be-processed video; respectively carrying out feature extraction on each frame of video image in multiple frames of video images included in a to-be-processed video to obtain image features, and respectively carrying out operation track identification on each frame of video image in the multiple frames of video images to obtain operation track features; and according to the image features and the operation track features, determining a key image in which interactive operation occurs from the multiple frames of video images, generating a test case according to the image features, the operation track features and the key image, and playing back the test case. According to the method, a tester does not need to compile codes, so that the requirement on tester code capability is greatly reduced. Meanwhile, the method does not need to be associated with a page development framework of the software, so that the method is slightly influenced by iterationof the page development framework, the method has a relatively strong cross-platform characteristic, and the maintenance cost is greatly reduced.

Description

technical field [0001] The present application relates to the technical field of computer software testing, in particular to a user interface playback method, device, device and storage medium. Background technique [0002] User Interface (UI) is a medium for human-computer interaction between users and applications. The user exchanges information with the application through the UI, which is an important part of the application. The quality of the UI directly affects whether the performance of the application can be fully utilized, and whether it can enable users to work accurately, efficiently, easily and happily. [0003] UI testing can check whether the UI of the application is working properly or whether there are any vulnerabilities that hinder the user's behavior and do not meet the written specifications. UI testing can be realized through UI playback. In related technologies, testers learn and develop codes to generate test cases to imitate the behavior of users i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36G06K9/00G06F9/451
CPCG06F11/3684G06F9/451G06V20/46
Inventor 宋浩
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap