A Method and System for Automatically Recording and Analyzing Mobile Application Behaviors to Locate Defects

By monitoring and recording touch events and screenshots of mobile applications in real time, generating hash sets and performing image recognition and analysis, the problem of difficult defect reproducing and verifying in mobile application testing is solved, and automated defect positioning and repair verification is achieved.

CN115952079BActive Publication Date: 2025-07-22CHINA CITIC BANK CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211549891.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-05
Publication Date
2025-07-22
Estimated Expiration
2042-12-05

AI Technical Summary

Technical Problem

In mobile application testing, defects are difficult to reproduce, locate and verify, and there is a lack of comprehensive tester behavior records and analysis methods, especially the problem of difficult replication lacks automated reproduction and verification functions.

Method used

By monitoring client touch events in real time, recording touch coordinate information and screenshots of screen pages, generating hash collections, performing secure encrypted storage, back-tracking the test process when encountering problems, using image recognition technology to analyze problems, and automatically verify the repair effect.

Benefits of technology

It realizes behavioral recording and analysis during mobile application testing, can automatically reproduce and verify defects, and improves the efficiency of defect location and repair.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115952079B_ABST
    Figure CN115952079B_ABST
Patent Text Reader

Abstract

The present invention relates to a method and system for automatically recording and analyzing location defects of mobile application behaviors. When a user operates a client or a tester conducts manual testing, the touch events of the client are monitored in real time, the touch coordinate information is obtained, the screen page of the client with touch events is captured, and is saved in a partitioned manner according to a specific method. If a problem is encountered during the test, the problem is traced back, a test process traceback diagram is generated, and the entire test process can be reproduced. Data analysis is performed on the problems encountered in the test to provide data for verifying the program to be detected after repair. After the program to be detected is repaired, automatic verification is performed to determine whether the repaired program to be detected is successfully repaired. Therefore, the present invention can record and analyze the behaviors of testers for mobile application devices, and at the same time has a function method for automatic reproduction and verification for problems that are difficult to reproduce.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of automated program testing, and particularly to a method and system for automatically recording and analyzing the behavior of mobile applications to locate defects. Background Art

[0002] During the testing process of mobile applications, many defects encountered by testers are caused by a series of operations. Often, these problems are difficult to reproduce, locate, and verify.

[0003] The existing methods are as follows:

[0004] By recalling the operations performed by oneself, it entirely depends on the individual. If one cannot remember, it is very difficult to reproduce and locate the problem; relying on server logs, it is also impossible to determine which operation caused the server interface call; it is necessary to search based on the business knowledge of R & D personnel and testers and the documentation of the background interface to speculate on the reproduction operation steps. Therefore, there is currently no comprehensive method and system for recording and analyzing the behavior of testers for mobile application devices during the mobile application testing process, and there is no functional method for automatic reproduction and verification for difficult-to-reproduce problems. Summary of the Invention

[0005] To solve the deficiencies of the existing technology, the present invention proposes a method and system for automatically recording and analyzing the behavior of mobile applications to locate defects. When a tester conducts manual testing, by listening to the click operations of the tester in real time, the page of the currently tested application is recorded and intercepted. Each time the page is touched, a screenshot is stored, and the screenshots are stored in partitions according to the time and the moment after each operation to log out. After encountering a defect, it is possible to replay the test behavior operations, give a complete link to reproduce the problem, and at the same time conduct automatic verification.

[0006] To achieve the above objectives, the technical solutions adopted by the present invention include:

[0007] A method for automatically recording and analyzing the behavior of mobile applications to locate defects, including:

[0008] S1. Start the test of the program to be detected, and listen to the touch events of the client, including:

[0009] Obtain touch coordinate information;

[0010] Take a screenshot of the client screen page with a touch event to obtain a screenshot of the screen page corresponding to the touch event;

[0011] Encrypt the screenshot of the screen page corresponding to the touch event, and store the encrypted screenshot of the screen page corresponding to the touch event in the form of a folder in the local memory of the client to obtain a user test process record folder;

[0012] Generate a hash set with the obtained touch coordinate information as the key and the screen page screenshot corresponding to the encrypted touch event as the value;

[0013] S2. If a problem is encountered during the test, perform problem backtracking to generate a test process backtracking diagram, including:

[0014] Locate the corresponding user test process record folder through the user account where the problem occurred and the time when the test was started;

[0015] Safely decrypt the screen page screenshot corresponding to the encrypted touch event in the user test process record folder to obtain the screen page screenshot corresponding to the decrypted touch event;

[0016] According to the correspondence between the touch coordinate information and the screen page screenshot corresponding to the encrypted touch event in the hash set, mark the touch coordinates in the form of coordinate points on the screen page screenshot corresponding to the decrypted touch event to obtain the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points;

[0017] Integrate the screen page screenshots corresponding to the decrypted touch events marked with touch coordinate points in chronological order into a test process backtracking diagram;

[0018] S3. Perform data analysis on the problems encountered in the test to provide data for verifying the repaired program to be detected, including:

[0019] On the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points, take a screenshot within a predetermined button pixel range centered on the coordinate points to obtain the first picture data;

[0020] Identify the text information in the first picture data through image recognition technology to obtain the first picture data information;

[0021] On the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points, take a screenshot within the pixel range of the predetermined picture top title bar to obtain the second picture data;

[0022] Identify the text information in the second picture data through image recognition technology to obtain the second picture data information;

[0023] S4. Verify whether the repaired program to be detected is successfully repaired.

[0024] Furthermore, the step S4 includes:

[0025] S41. Use the click method in the Devices and Object classes provided by the automated open-source framework uiautomater, with the first picture data information as the parameter, to perform event operations on the first picture information to obtain a verification page;

[0026] S42. By using the method of assert assertion, confirm whether the information on the verification page contains the second picture data information;

[0027] S43. If it is confirmed that the information on the verification page contains the second picture data information, the repair is successful;

[0028] S44. If it is confirmed that the information on the verification page does not contain the second picture data information, the repair fails.

[0029] Further, the user test process record folder uses the start test time as the folder name. If the user performs a login operation, the folder name is modified to the start test time, user account, and password.

[0030] Further, the encryption method for securely encrypting the screen page screenshot corresponding to the touch event is base64 encoding.

[0031] Further, the touch events include: touch, click, slide, lift, and multi-finger events.

[0032] Further, the image recognition technology is the open-source image recognition technology of tesseract-ocr.

[0033] The present invention also provides a mobile application automated behavior recording and analysis positioning defect system, which is characterized by including:

[0034] A touch event listening module, used to start the test of the program to be detected and listen to the touch events of the client;

[0035] A problem backtracking module, used to perform problem backtracking and generate a test process backtracking diagram if a problem is encountered during the test;

[0036] A data analysis module, used to perform data analysis on the problems encountered in the test and provide data for verifying the repaired program to be detected;

[0037] A repair verification module, used to verify whether the repaired program to be detected is successfully repaired.

[0038] The present invention also provides a computer-readable storage medium, which is characterized in that a computer program is stored on the storage medium, and when the computer program is executed by a processor, the above-mentioned mobile application automated behavior recording and analysis positioning defect method is implemented.

[0039] The present invention also provides an electronic device, which is characterized by including a processor and a memory;

[0040] The memory is used to store the user test process record folder and the hash set;

[0041] The processor is used to execute the above-mentioned method for recording and analyzing the automated behavior of mobile applications to locate defects by calling the user test process record folder and the hash set.

[0042] The present invention also provides a computer program product, including a computer program and / or instructions, characterized in that when the computer program and / or instructions are executed by a processor, the steps of the above-mentioned method for recording and analyzing the automated behavior of mobile applications to locate defects are implemented.

[0043] The beneficial effects of the present invention are as follows:

[0044] By adopting the method and system for recording and analyzing the automated behavior of mobile applications to locate defects according to the present invention, when a user operates the client or a tester conducts manual testing, the touch events of the client are monitored in real time, the touch coordinate information is obtained, the screen page of the client with touch events is captured, and is saved in partitions in a specific manner, and the coordinate information is associated with the screen page screenshot of the client. If a problem is encountered during the test, the problem is traced back, a test process traceback diagram is generated, and the entire test process can be reproduced. Data analysis is performed on the problems encountered during the test to provide data for verifying the program to be detected after repair. After the program to be detected is repaired, automated verification is performed to check whether the repair is successful. Therefore, the method and system for recording and analyzing the automated behavior of mobile applications to locate defects according to the present invention can record and analyze the tester's behavior for mobile application devices, and at the same time have the function and method of automated reproduction and verification for problems that are difficult to reproduce. Description of the Drawings

[0045] Figure 1 It is a schematic diagram of a method for recording and analyzing the automated behavior of mobile applications to locate defects according to the present invention.

[0046] Figure 2 It is a schematic diagram of a system for recording and analyzing the automated behavior of mobile applications to locate defects according to the present invention. Detailed Embodiments

[0047] In order to understand the content of the present invention more clearly, it will be described in detail in combination with the drawings and embodiments.

[0048] Figure 1 It is a schematic diagram of a method for recording and analyzing the automated behavior of mobile applications to locate defects according to the present invention. The method includes the following steps:

[0049] S1. Start the test of the program to be detected and monitor the touch events of the client;

[0050] According to the Android event distribution mechanism, rewrite the three methods of dipatchTouchEvent to distribute user touch screen events, onInterceptTouchEvent and onTouchEvent to obtain user touch, click, move / slide, up, and multi-finger events on the screen. Specifically:

[0051] After receiving the user's touch screen event in the dipatchTouchEvent method, obtain the touch event through MotionEvent.getActionMask;

[0052] Obtain the touch coordinate information; if it is a press touch event, record the current coordinates through MotionEvent.getX() and MotionEvent.getY(). When the lift event is received, record the coordinates when the finger is lifted, and the method is the same as above.

[0053] Take a screenshot of the client screen page with a touch event to obtain a screenshot of the screen page corresponding to the touch event; after receiving the lift event, call the Android system screenshot interface through reflection to complete the screenshot generation of the current screen state and button positions. Perform security encryption on the screenshot of the screen page corresponding to the touch event, perform base64 encoding (based on security encryption processing), and complete the conversion of the bitmap type of the screenshot to the base64 format by calling the APIs of the BitmapFactory and FileOutputStream classes, and finally flush and write it to the local storage directory.

[0054] Store the encrypted screenshot of the screen page corresponding to the touch event in the form of a folder in the client local memory to obtain a user test process record folder;

[0055] The creation form of the directory is illustrated by examples as follows:

[0056] For example, if the current time is 20211223100401 after the monitoring device is turned on, a directory named 20211223100401 will be created in the picture directory of this device. The tester operates on the device under test, logs in with the account name A (i.e., 19911110000) and the password 111111. After clicking the login button, the screen screenshot is placed in the 20211223100401 picture directory and image analysis is performed to check if it is the login page, that is, if there is a login button. If there is, the directory file is modified to 20211223100401+19911110000+111111. Subsequently, the tester conducts scenario testing. Clicking different buttons enters different pages, and each click will take a screenshot and place it in the 20211223100401+19911110000+111111 directory;

[0057] The tester logs out and then logs in again with the account B (i.e., 19911000001) and the password 222222. After clicking the login button, the screen screenshot is placed in the 20211223100401 picture directory and image analysis is performed to check if it is the login page, that is, if there is a login button. If there is, a new directory is created with the current time 20211223103001+19911000001+222222. And so on, multiple picture folders named with the time and username password will be generated.

[0058] Using the obtained touch coordinate information as the key and the encrypted touch event - corresponding screen page screenshot as the value, a hash set is generated; a hash set will be generated in memory to record the corresponding coordinate positions under each screenshot, facilitating subsequent backtracking verification operations. For example: {key:value}{(x,y):base64 encoded}.

[0059] S2. If problems are encountered during the test, perform problem backtracking to generate a test process backtracking diagram.

[0060] First, search for the specific file directory based on the user dimension + the time when the problem occurred. That is, locate the corresponding user test process record folder through the user account where the problem occurred and the time when the test was started.

[0061] Safely decrypt the encrypted touch event - corresponding screen page screenshots in the user test process record folder to obtain the decrypted touch event - corresponding screen page screenshots; convert the base64 file into a bitmap through the Android built - in class bitmapFactory for image display.

[0062] After decoding a set of pictures, put them into memory, cache them through the Android built - in class Lrucache, count the overall cache size, and support the synthesis of multiple pictures through a custom View.

[0063] According to the correspondence between the touch coordinate information in the hash set and the screen page screenshot corresponding to the encrypted touch event, mark the touch coordinates in the form of coordinate points on the screen page screenshot corresponding to the decrypted touch event, and obtain the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points. Set the picture selection range (i.e., the coordinate box generated by clicking the touch) through the OpenGL method for the coordinate points, and rewrite the onMeasure, onLayout, and onDraw methods of the custom view to draw the red dot on the current picture View.

[0064] Integrate the screen page screenshots corresponding to the decrypted touch events marked with touch coordinate points into a test process backtracking diagram in chronological order; after rendering, generate the final complete process picture through the BitmapFactory method and store it in the problem backtracking directory.

[0065] S3. Perform data analysis on the problems encountered in the test to provide data for verifying the program to be detected after repair.

[0066] According to the image recognition technology of the open-source tesseract-ocr for image recognition, recognize the login account and password on the login page.

[0067] On the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points, take a screenshot within the predetermined button pixel range centered on the coordinate points to obtain the first picture data; the predetermined button pixel range is 200 pixels in length and 200 pixels in width. That is, expand the area of the red dot position of the coordinates by a length (in pixels): 200, width (in pixels): 200 (the normal button size of the application under test) to take a picture as 1.png.

[0068] Identify the text information in the first picture data through the image recognition technology to obtain the first picture data information; that is, through the open-source image recognition technology of tesseract-ocr, identify the text in the picture 1.png, that is, identify the name of the click area of the tester, such as identifying information: touch-info transaction details and other information.

[0069] On the screen page screenshot corresponding to the decrypted touch event marked with touch coordinate points, take a screenshot within the pixel range of the predetermined top title bar of the picture to obtain the second picture data; where the predetermined pixel range of the top title bar of the picture is X(0 - 1024), Y(0 - 220). That is, for the top area X(0 - 1024), Y(0 - 220) (1024 is the width of the device's resolution) of each picture in the picture library, that is, the top horizontal bar (according to the characteristics of our application under test, almost every page will have a top title), take a screenshot of the picture.

[0070] Identify the text information in the second picture data through image recognition technology to obtain the second picture data information. That is, identify the title information of the page, such as title-infor My Account, etc.

[0071] If the image recognition does not obtain the final result, the coordinates in the hash set stored in the previous step will be used to complete the acquisition of the data of the user click area.

[0072] Illustrate the above process by examples:

[0073] After the user enters the account number and clicks Login at 10:00 am on March 14, 2022, clicks All Applications, clicks Account Application, and clicks Transaction Details, an error occurs. Then the process products completed are:

[0074] The folder name is: 20220314100001 + 19911000001 + 111111

[0075] Storage:

[0076] {(x1,y1),image1-base64},{(x2,y2),image2-base64},{(x3,y3),image3-base64},{(x4,y4),image4-base64}

[0077] The obtained data information:

[0078] The logged-in account name account: 19911000001 password password: 111111

[0079] Operation process:

[0080] touch-info(1): Login title-infor(1): Empty (There is no title on the login page)

[0081] touch-info(2): All title-infor(2): Empty (There is no title on the page after login)

[0082] touch-info(3): Account title-infor(3): Search function / Product / Outlet

[0083] touch-info(4): Transaction Details title-infor(4): My Account

[0084] S4. After fixing the problems encountered in the above test process, verify whether the program to be detected after repair is successfully repaired.

[0085] Obtain the user account, password, and operation process through the data analysis function. Use the click method in the Devices and Object classes provided by the automated open-source framework uiautomater, with the first picture data information as the parameter, to perform event operations on the first picture information and obtain the verification page;

[0086] Use the assert assertion method to confirm whether the information on the verification page contains the second picture data information;

[0087] If it is confirmed that the information on the verification page contains the second picture data information, the repair is successful;

[0088] If it is confirmed that the information on the verification page does not contain the second picture data information, the repair fails.

[0089] Another aspect of the present invention also relates to a mobile application automated behavior recording and analysis positioning defect system, the structure of which is as Figure 2 shown, including:

[0090] A touch event monitoring module, used to start the test of the program to be detected and monitor the touch events of the client;

[0091] A problem backtracking module, used to perform problem backtracking and generate a test process backtracking diagram if problems are encountered during the test;

[0092] A data analysis module, used to perform data analysis on the problems encountered during the test and provide data for verifying the repaired program to be detected;

[0093] A repair verification module, used to verify whether the repaired program to be detected is successfully repaired.

[0094] By using this system, the above-mentioned arithmetic processing method can be executed and the corresponding technical effects can be achieved.

[0095] An embodiment of the present invention also provides a computer-readable storage medium capable of implementing all the steps in the method in the above embodiment. A computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, all the steps in the method in the above embodiment are implemented.

[0096] An embodiment of the present invention also provides an electronic device for executing the above method. As an implementation device of this method, the electronic device at least has a processor and a memory. In particular, the memory stores the data and related computer programs required for executing the method, such as the user test process record folder and the hash set, etc. The processor calls the data and programs in the memory to execute all the steps of the method and obtain the corresponding technical effects.

[0097] Preferably, the electronic device may include a bus architecture. The bus may include any number of interconnected buses and bridges, which link together various circuits including one or more processors and memories. The bus may also link together various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and thus will not be further described herein. The bus interface provides an interface between the bus and the receiver and transmitter. The receiver and transmitter may be the same element, i.e., a transceiver, which provides a unit for communicating with various other systems over a transmission medium. The processor is responsible for managing the bus and general processing, while the memory may be used to store data used by the processor when performing operations.

[0098] Additionally, the electronic device may further include components such as a communication module, an input unit, an audio processor, a display, a power supply, etc. The processor (or controller, operating control) employed may include a microprocessor or other processor device and / or logic device, which receives inputs and controls the operations of the various components of the electronic device; the memory may be one or more of a buffer, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable devices, which can store the above-mentioned relevant data information, and can also store programs for executing relevant information, and the processor can execute the programs stored in the memory to implement information storage or processing, etc.; the input unit is used to provide inputs to the processor, for example, it can be a key or a touch input device; the power supply is used to provide power to the electronic device; the display is used to display display objects such as images and texts, for example, it can be an LCD display. The communication module is a transmitter / receiver that transmits and receives signals via an antenna. The communication module (transmitter / receiver) is coupled to the processor to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal. Based on different communication technologies, multiple communication modules may be provided in the same electronic device, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module, etc. The communication module (transmitter / receiver) is also coupled to the speaker and microphone via the audio processor to provide audio output via the speaker and receive audio input from the microphone, thereby implementing normal telecommunication functions. The audio processor may include any suitable buffer, decoder, amplifier, etc. Additionally, the audio processor is also coupled to the central processor, so that recording can be performed on the device through the microphone, and the sound stored on the device can be played through the speaker.

[0099] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) that contain computer-usable program code.

[0100] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to the embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a system for realizing the functions specified in one Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0101] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction system that realizes the functions specified in one Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0102] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide steps for realizing the functions specified in one Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks. Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they know the basic creative concepts. Therefore, the appended claims are intended to be construed as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0103] The above are only the preferred specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A method for automatically recording and analyzing the behavior of a mobile application to locate defects, characterized in that, including: S1. Start the test of the program to be detected and listen for touch events on the client, including: Obtain touch coordinate information; Take a screenshot of the client screen page with a touch event to obtain a screenshot of the screen page corresponding to the touch event; Perform security encryption on the screenshot of the screen page corresponding to the touch event, and store the encrypted screenshot of the screen page corresponding to the touch event in the form of a folder in the local memory of the client to obtain a user test process record folder; Generate a hash set with the obtained touch coordinate information as the key and the encrypted screenshot of the screen page corresponding to the touch event as the value; S2. If a problem is encountered during the test, perform problem backtracking to generate a test process backtracking diagram, including: Locate the corresponding user test process record folder through the user account where the problem occurred and the time when the test was started; Perform security decryption on the screenshot of the screen page corresponding to the touch event in the user test process record folder to obtain a decrypted screenshot of the screen page corresponding to the touch event; According to the correspondence between the touch coordinate information and the encrypted screenshot of the screen page corresponding to the touch event in the hash set, mark the touch coordinates in the form of coordinate points on the decrypted screenshot of the screen page corresponding to the touch event to obtain a decrypted screenshot of the screen page corresponding to the touch event marked with touch coordinate points; Integrate the decrypted screenshots of the screen pages corresponding to the touch events marked with touch coordinate points in chronological order into a test process backtracking diagram; S3. Perform data analysis on the problems encountered in the test to provide data for verifying the repaired program to be detected, including: Take a screenshot within a predetermined key pixel range centered on the coordinate points on the decrypted screenshot of the screen page corresponding to the touch event marked with touch coordinate points to obtain first picture data; Identify the text information in the first picture data through image recognition technology to obtain first picture data information; Take a screenshot within a pixel range of a predetermined picture top title bar on the decrypted screenshot of the screen page corresponding to the touch event marked with touch coordinate points to obtain second picture data; Identify the text information in the second picture data through image recognition technology to obtain second picture data information; S4. Verify whether the repaired program to be detected is successfully repaired.

2. The method according to claim 1, characterized in that, The step S4 includes: S41. Use the click method in the Devices and Object classes provided by the automated open-source framework uiautomater, with the first picture data information as a parameter, to perform an event operation on the first picture information to obtain a verification page; S42. Use the assert assertion method to confirm whether the information on the verification page contains the second picture data information; S43. If it is confirmed that the information on the verification page contains the second picture data information, the repair is successful; S44. If it is confirmed that the information on the verification page does not contain the second picture data information, the repair fails.

3. The method according to claim 1, characterized in that, The user test process record folder uses the start test time as the folder name. If the user performs a login operation, the folder name is modified to the start test time, user account, and password.

4. The method according to claim 1, wherein The encryption method for securely encrypting the screen page screenshot corresponding to the touch event is base64 encoding.

5. The method according to claim 1, characterized in that The touch events include: touch, click, slide, lift, and multi-finger events.

6. The method according to claim 1, wherein The image recognition technology is the open-source image recognition technology of tesseract-ocr.

7. A mobile application automated behavior recording and analysis positioning defect system, characterized in that, It includes: A touch event monitoring module, used to start the test of the program to be detected and monitor the touch events of the client; A problem backtracking module, used to perform problem backtracking and generate a test process backtracking diagram if problems are encountered during the test; A data analysis module, used to perform data analysis on the problems encountered during the test and provide data for verifying the program to be detected after repair; A repair verification module, used to verify whether the program to be detected after repair is successfully repaired.

8. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, and when the computer program is executed by a processor, it implements the mobile application automated behavior recording and analysis for defect location method according to any one of claims 1 to 6.

9. An electronic device, characterized in that, It includes a processor and a memory; The memory is used to store the user test process record folder and the hash set; The processor is used to execute the mobile application automated behavior recording and analysis for defect location method according to any one of claims 1 to 6 by calling the user test process record folder and the hash set.

10. A computer program product, comprising a computer program and / or instructions, characterized in that, When the computer program and / or instruction is executed by the processor, it implements the steps of the mobile application automated behavior recording and analysis for defect location method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Browser compatibility automatic test method, system, equipment and storage medium

    CN113836036A

  • Page graying detection method and system for mobile client

    CN114816992A