Application program testing method and device, equipment, medium and product

Abstract

The embodiment of the invention provides an application program testing method and device, equipment, a medium and a product. The method comprises the following steps: establishing a specified user model for a specified user; under the condition that the application program enters the specified user mode for the specified user, calling the specified user model to simulate the operation behavior of the specified user so as to test the application program; acquiring behavior data of the operation behavior, and evaluating the behavior data; and according to the evaluation result, generating a test result for the specified user mode. According to the embodiment of the invention, the application program is tested by establishing the user model for the designated user such as the old and simulating the operation behavior of the designated user, and the accuracy and the stability of the application program test are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of application testing, and in particular to a method, device, equipment, medium and product for application testing. Background Art

[0002] In the current information age, smart devices and various application software (APPs) have been deeply integrated into people's daily lives, greatly improving the convenience of life and the availability of information.

[0003] Although there are many types of APPs on the market with different functions, most APPs are mainly designed for young user groups. Their interface design, operation process and interaction methods are often more in line with the usage habits of young people. This leads to designated users such as the elderly may encounter many inconveniences when using these APPs, such as small fonts making it difficult to read, complex interface layouts making it difficult to quickly locate required functions, and cumbersome operation processes that are prone to errors. Summary of the invention

[0004] In view of the above problems, a method, device, equipment, medium and product for application testing are proposed to overcome the above problems or at least partially solve the above problems, including:

[0005] A method for testing an application program, the method comprising:

[0006] Establish a specified user model for a specified user;

[0007] When the application enters the designated user mode for the designated user, calling the designated user model to simulate the operation behavior of the designated user to test the application;

[0008] Acquiring behavioral data of the operation behavior and evaluating the behavioral data;

[0009] According to the evaluation result, a test result for the specified user mode is generated.

[0010] Optionally, it also includes:

[0011] Obtaining constraints related to the specified user;

[0012] detecting whether the application satisfies the constraint condition;

[0013] According to the detection result, a test result for the specified user mode is generated.

[0014] Optionally, the constraint condition includes a constraint condition for a visual element in the application, and generating a test result for the specified user mode according to the detection result includes:

[0015] When a visualization element in the application does not satisfy a constraint condition of the visualization element, a test result indicating that the visualization element in the specified user mode is abnormal is generated.

[0016] Optionally, the operation behavior includes an operation behavior on a controllable element in the application, and evaluating the behavior data includes:

[0017] Determining, based on the behavior data, an operation result on a controllable element in the application program;

[0018] Determining a probability value of an erroneous operation on the controllable element according to the operation result;

[0019] The erroneous operation probability value is compared with a preset probability value to obtain an evaluation result.

[0020] Optionally, generating a test result for the specified user mode according to the evaluation result includes:

[0021] When the erroneous operation probability value is greater than a preset probability value, a test result indicating that the manipulable element in the designated user mode is abnormal is generated.

[0022] Optionally, the establishing a designated user model for a designated user includes:

[0023] Get historical user data of a specified user;

[0024] A designated user model for the designated user is established based on the historical user data.

[0025] Optionally, it also includes:

[0026] According to the test result, an optimization solution for the specified user mode is generated.

[0027] Optionally, the designated user is an elderly user.

[0028] A device for testing an application program, the device comprising:

[0029] A designated user model establishment module is used to establish a designated user model for a designated user;

[0030] a simulation behavior testing module, configured to call the designated user model to simulate the operation behavior of the designated user to test the application when the application enters the designated user mode for the designated user;

[0031] A behavior evaluation module, used to obtain behavior data of the operation behavior and evaluate the behavior data;

[0032] The first test result generating module is used to generate a test result for the specified user mode according to the evaluation result.

[0033] An electronic device comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the method described above when executed by the processor.

[0034] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described above is implemented.

[0035] A computer program product comprises a computer program, wherein when the computer program is executed by a processor, the computer program implements the method as described above.

[0036] The embodiments of the present invention have the following advantages:

[0037] In an embodiment of the present invention, a designated user model is established for a designated user; when the application enters the designated user mode for the designated user, the designated user model is called to simulate the operating behavior of the designated user to test the application; behavioral data of the operating behavior is obtained, and the behavioral data is evaluated; based on the evaluation result, a test result for the designated user mode is generated, thereby achieving testing of the application by establishing a user model for designated users such as the elderly and simulating their operating behavior, thereby improving the accuracy and stability of application testing. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0039] Figure 1 is a flowchart of the steps of a method for testing an application program provided by some embodiments of the present invention;

[0040] Figure 2 is a flowchart of an application testing method provided by some embodiments of the present invention;

[0041] Figure 3 is a flowchart of steps of another method for application testing provided by some embodiments of the present invention;

[0042] Figure 4 is a flowchart of steps of another method for application testing provided by some embodiments of the present invention;

[0043] Figure 5 It is a structural block diagram of an application testing device provided by some embodiments of the present invention. DETAILED DESCRIPTION

[0044] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] In the relevant technology, the testing of applications can be divided into two types: the first is the automated testing of applications, but it can only verify the correctness and consistency of the page elements in the application, and cannot test the special needs of specified users; the second is the manual experience testing, which requires a lot of human resources to conduct specific experience testing for the needs of different groups of people, which will lead to the inability to quickly verify that the APP meets the aging-friendly requirements and iterate the new version during the APP iteration process.

[0046] Therefore, in an embodiment of the present invention, a method for testing an application for designated users (such as elderly users) is proposed. Based on the establishment of a complete AI (Artificial Intelligence) workflow, by collecting the real experience data of the designated users, the user model of the application is continuously improved to simulate the behavior of the designated users; by designing an interaction draft in combination with the designated user mode of the application, the user experience evaluation algorithm is completed, and whether the page elements meet the needs of the designated users are identified and evaluated.

[0047] In the embodiment of the present invention, the above solution can effectively improve the efficiency of aging-friendly user experience testing. At the same time, the test coverage and effect brought by the solution will be more accurate and stable than manual experience testing, thereby improving the satisfaction and usage rate of designated users for the APP and enhancing market competitiveness.

[0048] The present invention will be further described below in conjunction with the accompanying drawings:

[0049] Reference Figure 1 , shows a flowchart of a method for testing an application program provided by some embodiments of the present invention, which may specifically include the following steps:

[0050] Step 101: Establish a designated user model for a designated user.

[0051] In some embodiments of the present invention, the designated user is an elderly user.

[0052] In some embodiments of the present invention, establishing a designated user model for a designated user includes: acquiring historical user data of the designated user; and establishing a designated user model for the designated user based on the historical user data.

[0053] As some examples, you can embed data in the application (embedding analysis) to obtain historical user data of a specified user through embedding analysis. The historical user data of a specified user can be a behavior record for elderly users, such as purchase history, browsing history, search history, personal information (such as age, gender, geographic location, etc.), and the number of clicks, popularity, and hot searches of web pages.

[0054] Data collection analysis refers to a data collection method, which is to attach the data collection program code to the functional program code in the application that needs to collect data, so as to capture user behaviors or events on the application.

[0055] After collecting enough historical user data, you can use this data to build a model for the specified user. This model is an abstract representation that aims to summarize and reflect the characteristics, preferences, and behavior patterns of the specified user.

[0056] As some examples, when establishing a designated user model for a designated user, useful information and patterns can be extracted from the raw data (historical user data) through statistical analysis, machine learning, data mining, etc., and integrated into a structured model.

[0057] In some examples, a dedicated aging-friendly test module can be added to the automated testing system of the application. The specified user model of this module will include common operations and preferences of elderly users, such as font size, control size, etc., common feedback issues and incorrect operations, etc. By continuously improving this model, the automated testing tool can more accurately simulate the behavior of elderly users.

[0058] Step 102: When the application enters the designated user mode for the designated user, the designated user model is called to simulate the operation behavior of the designated user to test the application.

[0059] In actual applications, the application can be set with a designated user mode for a designated user, such as an elderly mode, and the application can be controlled to enter the designated user mode by clicking a designated button in the interactive interface.

[0060] After the application enters the designated user mode, the system will call the designated user model pre-established for the designated user. This designated user model can contain various information about the designated user's operating behavior, such as commonly used functions, click paths, input habits, etc.

[0061] When calling the specified user model, the system can simulate the specified user's operation behavior automatically or through a test script, such as automatically clicking buttons, entering text, browsing pages (scrolling pages), etc.

[0062] By simulating the operation behavior of a specified user, you can perform various tests on the application and generate test results for the specified user mode.

[0063] Step 103: Acquire behavior data of the operation behavior and evaluate the behavior data.

[0064] As some examples, obtaining the behavior data of the operation behavior refers to collecting or recording the behavior data generated by the specific operation behavior when the specified user model simulates the operation behavior of the specified user and tests the application. Among them, these behavior data may include but are not limited to the clicks, slides, inputs, selections, browsing paths, dwell time, etc. of the specified user model simulating the specified user.

[0065] After obtaining the behavioral data, you can evaluate it to analyze its characteristics, patterns, trends, etc., so as to find areas where the application needs improvement.

[0066] In some embodiments of the present invention, the operating behavior includes operating behavior on the controllable elements in the application, and the behavior data is evaluated, including: determining the operating results of the controllable elements in the application based on the behavior data; determining the probability value of incorrect operation on the controllable elements based on the operating results; comparing the incorrect operation probability value with a preset probability value to obtain an evaluation result.

[0067] In a specific implementation, the specific operations performed by the designated user model on various controllable elements (such as buttons, links, input boxes, etc.) in the application and the results of these operations can be determined based on the behavior data of the operation behavior. For example, if the designated user model simulates the designated user clicking a button, the click behavior can be recorded and the result generated after the click (such as page jump, pop-up dialog box, data submission, etc.) can be determined.

[0068] After determining the operation results, it is possible to evaluate whether these operations are likely to constitute erroneous operations. For example, this can be determined by comparing the simulated operation results with the expected, correct operation results; if the user's operation does not match the expectations, it is considered an erroneous operation; then, based on the frequency or pattern of these erroneous operations, an erroneous operation probability value can be calculated, that is, the probability of a specified user performing an erroneous operation in a specified user.

[0069] After the erroneous operation probability value is obtained, the calculated erroneous operation probability value may be compared with a preset probability value.

[0070] As some examples, the preset probability value may be set according to specific requirements of an application or industry standards, representing an acceptable threshold of erroneous operation; for example, the preset probability value may be 10%.

[0071] If the calculated error operation probability value is higher than the preset probability value, it can be determined that there is a problem in the design or implementation of the controllable element, or that the specified user is prone to making mistakes when using the element. Conversely, if the error operation probability value is lower than the preset probability value, it means that the design of the element is reasonable and the specified user is not prone to making mistakes when using it.

[0072] After comparing the probability value of incorrect operation with the preset probability value, the evaluation results of the controllable elements in the application can be obtained, such as unreasonable button design.

[0073] As some examples, the error operation probability value may be a misoperation probability or a failed operation probability.

[0074] Step 104: Generate a test result for the specified user pattern according to the evaluation result.

[0075] After obtaining the evaluation results, a test result for a specified user mode (elderly user mode) can be generated. The test result can indicate the performance of the specified user in the specified mode, such as whether there are problems or defects, whether the expected goals are met, and other feedback.

[0076] Generating test results can help developers, testers, or product managers understand the performance of the application in a specified user scenario and improve or optimize the application accordingly.

[0077] In some embodiments of the present invention, generating a test result for the specified user mode based on the evaluation result includes: when the erroneous operation probability value is greater than a preset probability value, generating a test result indicating that a controllable element in the specified user mode is abnormal.

[0078] After comparing the error operation probability value with the preset probability value, if the error operation probability value exceeds the preset probability value, a test result indicating an abnormality of the controllable element in the specified user mode can be generated, and the test result indicates that in the specified user mode, there is an abnormality of the controllable element (such as a button, link, input box, etc.). This abnormality indicates that it is difficult for the user to correctly operate these elements, or these elements are prone to cause erroneous operations in the specified user mode.

[0079] In some embodiments of the present invention, the method further includes: obtaining constraint conditions related to the designated user; detecting whether the application satisfies the constraint conditions; and generating test results for the designated user mode based on the detection results.

[0080] As some examples, constraints refer to judgment conditions based on detecting visual elements in an application when testing the application. Constraints can be regulations on the layout, size, color, font, interactive behavior, etc. of visual elements. For example, an elderly person needs a larger text, and the current 16px text of the application is not suitable. The constraint can be that the text can only be adjusted in the range of 16-50px.

[0081] In some examples, due to the need to develop a user experience evaluation algorithm, developers can add a large number of constraints in the aging-friendly test module, combine the above-mentioned specified user model characteristics, and develop custom configurations and constraint inputs to adjust the test parameters of the algorithm, such as font size, control size, contrast, color, control complexity and other multi-dimensional constraints.

[0082] Among them, the user experience evaluation algorithm refers to a business algorithm, which is used to judge whether the function of the specified user mode is truly suitable for the specified user; for example, the elderly mode is to enlarge the size of button controls, enlarge the text size, and increase the color contrast. However, how big the button, how big the text, and how strong the contrast color are suitable for the elderly, and whether the button-type function is easier for the elderly to operate, or the slider-type function, all require continuous debugging and calculation to calculate better results.

[0083] The automated testing system obtains constraints related to a specified user, detects whether the application meets the constraints, generates a detection result, and generates a test result for the specified user mode based on the detection result.

[0084] In some embodiments of the present invention, the constraints include constraints on visual elements in the application, and generating test results for the specified user pattern based on the detection results includes: when the visual elements in the application do not satisfy the constraints on the visual elements, generating a test result indicating that the visual elements in the specified user pattern are abnormal.

[0085] The constraint condition is not satisfied, which means that during the test, some visual elements in the application are found not to comply with the constraint condition, for example, a button is placed in the wrong position, or the size of a text box exceeds the range specified by the constraint condition.

[0086] When a visual element is detected to not satisfy its constraints, the automated testing system can generate a test result indicating the visual element anomaly in the specified user pattern. This test result can indicate which visual elements have problems and which constraints they violate. The test result can also include a detailed description of the problem, screenshots, suggested fixes, or any other information that helps developers understand and solve the problem.

[0087] In some embodiments of the present invention, the method further includes: generating an optimization solution for the specified user mode based on the test results.

[0088] Among them, the optimization plan may include adjusting the interface design of the application, improving the interaction logic, adding new features or fixing existing problems, etc., to improve the satisfaction of designated users in using the application.

[0089] By developing optimization plans for specific user patterns based on test results, it helps ensure that the optimization measures can accurately solve the problems found in the test and improve user experience and system performance.

[0090] In an embodiment of the present invention, a designated user model is established for a designated user; when the application enters the designated user mode for the designated user, the designated user model is called to simulate the operating behavior of the designated user to test the application; behavioral data of the operating behavior is obtained, and the behavioral data is evaluated; based on the evaluation result, a test result for the designated user mode is generated, thereby achieving testing of the application by establishing a user model for designated users such as the elderly and simulating their operating behavior, thereby improving the accuracy and stability of application testing.

[0091] The following is combined with Figure 2 The present invention is exemplified as follows:

[0092] Step 201, investigate and collect user data.

[0093] Step 202: pre-processing of user data (screening high-quality available data and eliminating junk and useless data).

[0094] Step 203: data aggregation and model building.

[0095] By collecting and integrating the feedback function of designated users and reading the embedded data analysis in the application, a designated user model (elderly user model) is built through a large amount of real experience data. Then, an aging-friendly test module is added to the automated testing system. The user model of this module will include common operations and preferences of elderly users, such as font size, control size, etc., common feedback issues and incorrect operations, etc. By continuously improving this model, the automated testing tool can more accurately simulate the behavior of elderly users.

[0096] Step 204: designing a user experience evaluation algorithm.

[0097] Step 205, combining model data, custom configuration, and constraint input.

[0098] Develop the user experience evaluation algorithm and add a large number of constraints to the aging-friendly test module. Combine the above specified user model characteristics and develop custom configuration and constraint inputs to adjust the algorithm's test parameters, such as font size, control size, contrast, color, control complexity and other multi-dimensional constraints.

[0099] For example, the elderly need larger text, and the existing 16px text is not suitable. The constraint condition can be that the text can only be adjusted to a maximum range of 16-50px.

[0100] Step 206, combining and generating a test case script.

[0101] Step 207: Feedback the test results.

[0102] Step 208, development, modification and optimization.

[0103] Combining the above elderly user model with the user experience evaluation algorithm, a set of test case scripts simulating elderly user behavior is designed. The script can call the elderly user model to simulate the operation habits of elderly users, such as clicking buttons, entering text, scrolling pages, etc. By simulating the operations of elderly users, it is tested whether the APP has a good elderly-friendly experience during actual use.

[0104] For example, based on the historical data of designated users, it is found that elderly people over 60 years old stay on the timing page of the air conditioner for more than five minutes, and the trigger rate of the timing button is low, while the blank area has a high false touch rate. In this case, the false touch rate can be calculated and summarized, added to the designated user model data, and the configuration of the timing button can be read to obtain the size of the button. Repeated automated testing experiments on the model can be carried out to verify how large the click area is required to reduce the false touch rate without affecting other functions. In this process, if the product has a standard button that cannot be round, the constraint condition should be added before conducting the test.

[0105] For example, verify whether the click area of ​​the button is large enough to facilitate elderly users to click; whether the input box is easy to input, whether the contrast between the text and the background color is obvious enough, etc. During the testing process, you can also collect the number of clicks, operation time, error rate, etc. generated by the execution of the test case script. By analyzing these data, you can evaluate the aging-friendly degree of the APP and find out where improvement is needed. For example, if the execution time of the use case script on a certain page is too long, or there are multiple abnormal clicks, you need to simplify the layout and operation of the page.

[0106] Reference Figure 3 , shows a flowchart of another method for testing an application program provided by some embodiments of the present invention, which may specifically include the following steps:

[0107] Step 301, obtaining historical user data of a specified user.

[0108] In some embodiments of the present invention, the designated user is an elderly user.

[0109] As some examples, you can embed data in the application (embedding analysis) to obtain historical user data of a specified user through embedding analysis. The historical user data of a specified user can be a behavior record for elderly users, such as purchase history, browsing history, search history, personal information (such as age, gender, geographic location, etc.), and the number of clicks, popularity, and hot searches of web pages.

[0110] Data collection analysis refers to a data collection method, which is to attach the data collection program code to the functional program code in the application that needs to collect data, so as to capture user behaviors or events on the application.

[0111] Step 302: Establish a designated user model for the designated user based on the historical user data.

[0112] After collecting enough historical user data, you can use this data to build a model for the specified user. This model is an abstract representation that aims to summarize and reflect the characteristics, preferences, and behavior patterns of the specified user.

[0113] As some examples, when establishing a designated user model for a designated user, useful information and patterns can be extracted from the raw data (historical user data) through statistical analysis, machine learning, data mining, etc., and integrated into a structured model.

[0114] In some examples, a dedicated aging-friendly test module can be added to the automated testing system of the application. The specified user model of this module will include common operations and preferences of elderly users, such as font size, control size, etc., common feedback issues and incorrect operations, etc. By continuously improving this model, the automated testing tool can more accurately simulate the behavior of elderly users.

[0115] Step 303: When the application enters the designated user mode for the designated user, the designated user model is called to simulate the operation behavior of the designated user to test the application.

[0116] In actual applications, the application can be set with a designated user mode for a designated user, such as an elderly mode, and the application can be controlled to enter the designated user mode by clicking a designated button in the interactive interface.

[0117] After the application enters the designated user mode, the system will call the designated user model pre-established for the designated user. This designated user model can contain various information about the designated user's operating behavior, such as commonly used functions, click paths, input habits, etc.

[0118] When calling the specified user model, the system can simulate the specified user's operation behavior automatically or through a test script, such as automatically clicking buttons, entering text, browsing pages (scrolling pages), etc.

[0119] By simulating the operation behavior of a specified user, you can perform various tests on the application and generate test results for the specified user mode.

[0120] Step 304: Obtain behavior data of the operation behavior and evaluate the behavior data.

[0121] As some examples, obtaining the behavior data of the operation behavior refers to collecting or recording the behavior data generated by the specific operation behavior when the specified user model simulates the operation behavior of the specified user and tests the application. Among them, these behavior data may include but are not limited to the clicks, slides, inputs, selections, browsing paths, dwell time, etc. of the specified user model simulating the specified user.

[0122] After obtaining the behavioral data, you can evaluate it to analyze its characteristics, patterns, trends, etc., so as to find areas where the application needs improvement.

[0123] In some embodiments of the present invention, the operating behavior includes operating behavior on the controllable elements in the application, and the behavior data is evaluated, including: determining the operating results of the controllable elements in the application based on the behavior data; determining the probability value of incorrect operation on the controllable elements based on the operating results; comparing the incorrect operation probability value with a preset probability value to obtain an evaluation result.

[0124] In a specific implementation, the specific operations performed by the designated user model on various controllable elements (such as buttons, links, input boxes, etc.) in the application and the results of these operations can be determined based on the behavior data of the operation behavior. For example, if the designated user model simulates the designated user clicking a button, the click behavior can be recorded and the result generated after the click (such as page jump, pop-up dialog box, data submission, etc.) can be determined.

[0125] After determining the operation results, it is possible to evaluate whether these operations are likely to constitute erroneous operations. For example, this can be determined by comparing the simulated operation results with the expected, correct operation results; if the user's operation does not match the expectations, it is considered an erroneous operation; then, based on the frequency or pattern of these erroneous operations, an erroneous operation probability value can be calculated, that is, the probability of a specified user performing an erroneous operation in a specified user.

[0126] After the erroneous operation probability value is obtained, the calculated erroneous operation probability value may be compared with a preset probability value.

[0127] As some examples, the preset probability value may be set according to specific requirements of an application or industry standards, representing an acceptable threshold of erroneous operation; for example, the preset probability value may be 10%.

[0128] If the calculated error operation probability value is higher than the preset probability value, it can be determined that there is a problem in the design or implementation of the controllable element, or that the specified user is prone to making mistakes when using the element. Conversely, if the error operation probability value is lower than the preset probability value, it means that the design of the element is reasonable and the specified user is not prone to making mistakes when using it.

[0129] After comparing the probability value of incorrect operation with the preset probability value, the evaluation results of the controllable elements in the application can be obtained, such as unreasonable button design.

[0130] As some examples, the error operation probability value may be a misoperation probability or a failed operation probability.

[0131] Step 305: Generate a test result for the specified user pattern according to the evaluation result.

[0132] After obtaining the evaluation results, a test result for a specified user mode (elderly user mode) can be generated. The test result can indicate the performance of the specified user in the specified mode, such as whether there are problems or defects, whether the expected goals are met, and other feedback.

[0133] Generating test results can help developers, testers, or product managers understand the performance of the application in a specified user scenario and improve or optimize the application accordingly.

[0134] In some embodiments of the present invention, generating a test result for the specified user mode based on the evaluation result includes: when the erroneous operation probability value is greater than a preset probability value, generating a test result indicating that a controllable element in the specified user mode is abnormal.

[0135] After comparing the error operation probability value with the preset probability value, if the error operation probability value exceeds the preset probability value, a test result indicating an abnormality of the controllable element in the specified user mode can be generated, and the test result indicates that in the specified user mode, there is an abnormality of the controllable element (such as a button, link, input box, etc.). This abnormality indicates that it is difficult for the user to correctly operate these elements, or these elements are prone to cause erroneous operations in the specified user mode.

[0136] In some embodiments of the present invention, the method further includes: obtaining constraint conditions related to the designated user; detecting whether the application satisfies the constraint conditions; and generating test results for the designated user mode based on the detection results.

[0137] As some examples, constraints refer to judgment conditions based on detecting visual elements in an application when testing the application. Constraints can be regulations on the layout, size, color, font, interactive behavior, etc. of visual elements. For example, an elderly person needs a larger text, and the current 16px text of the application is not suitable. The constraint can be that the text can only be adjusted in the range of 16-50px.

[0138] In some examples, due to the need to develop a user experience evaluation algorithm, developers can add a large number of constraints in the aging-friendly test module, combine the above-mentioned specified user model characteristics, and develop custom configurations and constraint inputs to adjust the test parameters of the algorithm, such as font size, control size, contrast, color, control complexity and other multi-dimensional constraints.

[0139] Among them, the user experience evaluation algorithm refers to a business algorithm, which is used to judge whether the function of the specified user mode is truly suitable for the specified user; for example, the elderly mode is to enlarge the size of button controls, enlarge the text size, and increase the color contrast. However, how big the button, how big the text, and how strong the contrast color are suitable for the elderly, and whether the button-type function is easier for the elderly to operate, or the slider-type function, all require continuous debugging and calculation to calculate better results.

[0140] The automated testing system obtains constraints related to a specified user, detects whether the application meets the constraints, generates a detection result, and generates a test result for the specified user mode based on the detection result.

[0141] In some embodiments of the present invention, the constraints include constraints on visual elements in the application, and generating test results for the specified user pattern based on the detection results includes: when the visual elements in the application do not satisfy the constraints on the visual elements, generating a test result indicating that the visual elements in the specified user pattern are abnormal.

[0142] The constraint condition is not satisfied, which means that during the test, some visual elements in the application are found not to comply with the constraint condition, for example, a button is placed in the wrong position, or the size of a text box exceeds the range specified by the constraint condition.

[0143] When a visual element is detected to not satisfy its constraints, the automated testing system can generate a test result indicating the visual element anomaly in the specified user pattern. This test result can indicate which visual elements have problems and which constraints they violate. The test result can also include a detailed description of the problem, screenshots, suggested fixes, or any other information that helps developers understand and solve the problem.

[0144] In some embodiments of the present invention, the method further includes: generating an optimization solution for the specified user mode based on the test results.

[0145] Among them, the optimization plan may include adjusting the interface design of the application, improving the interaction logic, adding new features or fixing existing problems, etc., to improve the satisfaction of designated users in using the application.

[0146] By developing optimization plans for specific user patterns based on test results, it helps ensure that the optimization measures can accurately solve the problems found in the test and improve user experience and system performance.

[0147] In an embodiment of the present invention, historical user data of a designated user is obtained, and a designated user model for the designated user is established based on the historical user data; when the application enters the designated user mode for the designated user, the designated user model is called to simulate the operating behavior of the designated user to test the application; behavioral data of the operating behavior is obtained, and the behavioral data is evaluated; based on the evaluation result, a test result for the designated user mode is generated, thereby achieving testing of the application by establishing a user model for designated users such as the elderly and simulating their operating behavior, thereby improving the accuracy and stability of application testing.

[0148] Reference Figure 4 , shows a flowchart of the steps of another method for application testing provided by some embodiments of the present invention, which may specifically include the following steps:

[0149] Step 401: Establish a designated user model for a designated user.

[0150] In some embodiments of the present invention, the designated user is an elderly user.

[0151] In some embodiments of the present invention, establishing a designated user model for a designated user includes: acquiring historical user data of the designated user; and establishing a designated user model for the designated user based on the historical user data.

[0152] As some examples, you can embed data in the application (embedding analysis) to obtain historical user data of a specified user through embedding analysis. The historical user data of a specified user can be a behavior record for elderly users, such as purchase history, browsing history, search history, personal information (such as age, gender, geographic location, etc.), and the number of clicks, popularity, and hot searches of web pages.

[0153] Data collection analysis refers to a data collection method, which is to attach the data collection program code to the functional program code in the application that needs to collect data, so as to capture user behaviors or events on the application.

[0154] After collecting enough historical user data, you can use this data to build a model for the specified user. This model is an abstract representation that aims to summarize and reflect the characteristics, preferences, and behavior patterns of the specified user.

[0155] As some examples, when establishing a designated user model for a designated user, useful information and patterns can be extracted from the raw data (historical user data) through statistical analysis, machine learning, data mining, etc., and integrated into a structured model.

[0156] In some examples, a dedicated aging-friendly test module can be added to the automated testing system of the application. The specified user model of this module will include common operations and preferences of elderly users, such as font size, control size, etc., common feedback issues and incorrect operations, etc. By continuously improving this model, the automated testing tool can more accurately simulate the behavior of elderly users.

[0157] Step 402: When the application enters the designated user mode for the designated user, the designated user model is called to simulate the operation behavior of the designated user to test the application.

[0158] In actual applications, the application can be set with a designated user mode for a designated user, such as an elderly mode, and the application can be controlled to enter the designated user mode by clicking a designated button in the interactive interface.

[0159] After the application enters the designated user mode, the system will call the designated user model pre-established for the designated user. This designated user model can contain various information about the designated user's operating behavior, such as commonly used functions, click paths, input habits, etc.

[0160] When calling the specified user model, the system can simulate the specified user's operation behavior automatically or through a test script, such as automatically clicking buttons, entering text, browsing pages (scrolling pages), etc.

[0161] By simulating the operation behavior of a specified user, you can perform various tests on the application and generate test results for the specified user mode.

[0162] Step 403: Acquire behavior data of the operation behavior and evaluate the behavior data.

[0163] As some examples, obtaining the behavior data of the operation behavior refers to collecting or recording the behavior data generated by the specific operation behavior when the specified user model simulates the operation behavior of the specified user and tests the application. Among them, these behavior data may include but are not limited to the clicks, slides, inputs, selections, browsing paths, dwell time, etc. of the specified user model simulating the specified user.

[0164] After obtaining the behavioral data, you can evaluate it to analyze its characteristics, patterns, trends, etc., so as to find areas where the application needs improvement.

[0165] In some embodiments of the present invention, the operating behavior includes operating behavior on the controllable elements in the application, and the behavior data is evaluated, including: determining the operating results of the controllable elements in the application based on the behavior data; determining the probability value of incorrect operation on the controllable elements based on the operating results; comparing the incorrect operation probability value with a preset probability value to obtain an evaluation result.

[0166] In a specific implementation, the specific operations performed by the designated user model on various controllable elements (such as buttons, links, input boxes, etc.) in the application and the results of these operations can be determined based on the behavior data of the operation behavior. For example, if the designated user model simulates the designated user clicking a button, the click behavior can be recorded and the result generated after the click (such as page jump, pop-up dialog box, data submission, etc.) can be determined.

[0167] After determining the operation results, it is possible to evaluate whether these operations are likely to constitute erroneous operations. For example, this can be determined by comparing the simulated operation results with the expected, correct operation results; if the user's operation does not match the expectations, it is considered an erroneous operation; then, based on the frequency or pattern of these erroneous operations, an erroneous operation probability value can be calculated, that is, the probability of a specified user performing an erroneous operation in a specified user.

[0168] After the erroneous operation probability value is obtained, the calculated erroneous operation probability value may be compared with a preset probability value.

[0169] As some examples, the preset probability value may be set according to specific requirements of an application or industry standards, representing an acceptable threshold of erroneous operation; for example, the preset probability value may be 10%.

[0170] If the calculated error operation probability value is higher than the preset probability value, it can be determined that there is a problem in the design or implementation of the controllable element, or that the specified user is prone to making mistakes when using the element. Conversely, if the error operation probability value is lower than the preset probability value, it means that the design of the element is reasonable and the specified user is not prone to making mistakes when using it.

[0171] After comparing the probability value of incorrect operation with the preset probability value, the evaluation results of the controllable elements in the application can be obtained, such as unreasonable button design.

[0172] As some examples, the error operation probability value may be a misoperation probability or a failed operation probability.

[0173] Step 404: Generate a test result for the specified user pattern based on the evaluation result.

[0174] After obtaining the evaluation results, a test result for a specified user mode (elderly user mode) can be generated. The test result can indicate the performance of the specified user in the specified mode, such as whether there are problems or defects, whether the expected goals are met, and other feedback.

[0175] Generating test results can help developers, testers, or product managers understand the performance of the application in a specified user scenario and improve or optimize the application accordingly.

[0176] In some embodiments of the present invention, generating a test result for the specified user mode based on the evaluation result includes: when the erroneous operation probability value is greater than a preset probability value, generating a test result indicating that a controllable element in the specified user mode is abnormal.

[0177] After comparing the error operation probability value with the preset probability value, if the error operation probability value exceeds the preset probability value, a test result indicating an abnormality of the controllable element in the specified user mode can be generated, and the test result indicates that in the specified user mode, there is an abnormality of the controllable element (such as a button, link, input box, etc.). This abnormality indicates that it is difficult for the user to correctly operate these elements, or these elements are prone to cause erroneous operations in the specified user mode.

[0178] In some embodiments of the present invention, the method further includes: obtaining constraint conditions related to the designated user; detecting whether the application satisfies the constraint conditions; and generating test results for the designated user mode based on the detection results.

[0179] As some examples, constraints refer to judgment conditions based on detecting visual elements in an application when testing the application. Constraints can be regulations on the layout, size, color, font, interactive behavior, etc. of visual elements. For example, an elderly person needs a larger text, and the current 16px text of the application is not suitable. The constraint can be that the text can only be adjusted in the range of 16-50px.

[0180] In some examples, due to the need to develop a user experience evaluation algorithm, developers can add a large number of constraints in the aging-friendly test module, combine the above-mentioned specified user model characteristics, and develop custom configurations and constraint inputs to adjust the test parameters of the algorithm, such as font size, control size, contrast, color, control complexity and other multi-dimensional constraints.

[0181] Among them, the user experience evaluation algorithm refers to a business algorithm, which is used to judge whether the function of the specified user mode is truly suitable for the specified user; for example, the elderly mode is to enlarge the size of button controls, enlarge the text size, and increase the color contrast. However, how big the button, how big the text, and how strong the contrast color are suitable for the elderly, and whether the button-type function is easier for the elderly to operate, or the slider-type function, all require continuous debugging and calculation to calculate better results.

[0182] The automated testing system obtains constraints related to a specified user, detects whether the application meets the constraints, generates a detection result, and generates a test result for the specified user mode based on the detection result.

[0183] In some embodiments of the present invention, the constraints include constraints on visual elements in the application, and generating test results for the specified user pattern based on the detection results includes: when the visual elements in the application do not satisfy the constraints on the visual elements, generating a test result indicating that the visual elements in the specified user pattern are abnormal.

[0184] The constraint condition is not satisfied, which means that during the test, some visual elements in the application are found not to comply with the constraint condition, for example, a button is placed in the wrong position, or the size of a text box exceeds the range specified by the constraint condition.

[0185] When a visual element is detected to not satisfy its constraints, the automated testing system can generate a test result indicating the visual element anomaly in the specified user pattern. This test result can indicate which visual elements have problems and which constraints they violate. The test result can also include a detailed description of the problem, screenshots, suggested fixes, or any other information that helps developers understand and solve the problem.

[0186] Step 405: Generate an optimization solution for the specified user mode based on the test result.

[0187] Among them, the optimization plan may include adjusting the interface design of the application, improving the interaction logic, adding new features or fixing existing problems, etc., to improve the satisfaction of designated users in using the application.

[0188] By developing optimization plans for specific user patterns based on test results, it helps ensure that the optimization measures can accurately solve the problems found in the test and improve user experience and system performance.

[0189] In an embodiment of the present invention, a designated user model is established for a designated user; when the application enters the designated user mode for the designated user, the designated user model is called to simulate the operating behavior of the designated user to test the application; behavioral data of the operating behavior is obtained and the behavioral data is evaluated; based on the evaluation result, a test result for the designated user mode is generated; based on the test result, an optimization plan for the designated user mode is generated, thereby achieving testing of the application by establishing a user model for designated users such as the elderly and simulating their operating behavior, thereby improving the accuracy and stability of application testing.

[0190] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0191] Reference Figure 5 , shows a schematic diagram of the structure of an application testing device provided by some embodiments of the present invention, which may specifically include the following modules:

[0192] A designated user model building module 501 is used to build a designated user model for a designated user;

[0193] A simulation behavior testing module 502 is used to call the specified user model to simulate the operation behavior of the specified user to test the application when the application enters the specified user mode for the specified user;

[0194] A behavior evaluation module 503 is used to obtain behavior data of the operation behavior and evaluate the behavior data;

[0195] The test result generating module 504 is used to generate a test result for the specified user mode according to the evaluation result.

[0196] In some embodiments of the present invention, the device further comprises:

[0197] A constraint condition acquisition module, used to acquire the constraint conditions related to the specified user;

[0198] A constraint condition determination module, used to detect whether the application satisfies the constraint condition;

[0199] The test result generating module is used to generate the test result for the specified user mode according to the detection result.

[0200] In some embodiments of the present invention, the constraint condition includes a constraint condition for a visual element in the application program, and the test result generating module 504 includes:

[0201] The visualization element determination submodule is used to generate a test result indicating that the visualization element in the specified user mode is abnormal when the visualization element in the application does not satisfy the constraint condition of the visualization element.

[0202] In some embodiments of the present invention, the operation behavior includes an operation behavior on a controllable element in the application program, and the behavior evaluation module 503 includes:

[0203] An operation result determination submodule, used to determine the operation result of the controllable element in the application according to the behavior data;

[0204] A probability value determination submodule, used to determine a probability value of an erroneous operation on the controllable element according to the operation result;

[0205] The probability value comparison submodule is used to compare the erroneous operation probability value with a preset probability value to obtain an evaluation result.

[0206] In some embodiments of the present invention, the test result generating module 504 includes:

[0207] The erroneous operation determination submodule is used to generate a test result indicating that the controllable element in the specified user mode is abnormal when the erroneous operation probability value is greater than a preset probability value.

[0208] In some embodiments of the present invention, the designated user model building module 501 includes:

[0209] The historical user data acquisition submodule is used to acquire the historical user data of a specified user;

[0210] The designated user model establishment submodule is used to establish a designated user model for the designated user based on the historical user data.

[0211] In some embodiments of the present invention, the device further comprises:

[0212] The optimization solution generation module is used to generate an optimization solution for the specified user mode according to the test results.

[0213] In some embodiments of the present invention, the designated user is an elderly user.

[0214] In an embodiment of the present invention, a designated user model is established for a designated user; when an application enters the designated user mode for a designated user, the designated user model is called to simulate the operation behavior of the designated user to test the application; behavioral data of the operation behavior is obtained, and the behavioral data is evaluated; based on the evaluation result, a test result for the designated user mode is generated, thereby achieving testing of the application by establishing a user model for the designated user and simulating his operation behavior, thereby improving the accuracy and stability of application testing.

[0215] Some embodiments of the present invention further provide an electronic device, comprising a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the above method is implemented when the computer program is executed by the processor.

[0216] Some embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, and the computer program implements the above method when executed by a processor.

[0217] Some embodiments of the present invention further provide a computer program product, including a computer program, which implements the above method when executed by a processor.

[0218] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0219] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0220] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0221] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0222] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0223] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0224] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0225] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0226] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the above elements.

[0227] The above is a detailed introduction to the provided method, device, equipment, medium and product for application testing. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for application testing, characterized in that: The method comprises: Establish a specified user model for a specified user; When the application enters the designated user mode for the designated user, calling the designated user model to simulate the operation behavior of the designated user to test the application; Acquiring behavioral data of the operation behavior and evaluating the behavioral data; According to the evaluation result, a test result for the specified user mode is generated.

2. The method according to claim 1, characterized in that Also includes: Obtaining constraints related to the specified user; detecting whether the application satisfies the constraint condition; According to the detection result, a test result for the specified user mode is generated.

3. The method according to claim 2, characterized in that The constraint condition includes a constraint condition for a visual element in the application program, and generating a test result for the specified user mode according to the detection result includes: When a visualization element in the application does not satisfy a constraint condition of the visualization element, a test result indicating that the visualization element in the specified user mode is abnormal is generated.

4. The method according to any one of claims 1 to 3, characterized in that: The operation behavior includes the operation behavior on the controllable elements in the application, and the behavior data is evaluated, including: Determining, based on the behavior data, an operation result on a controllable element in the application program; Determining a probability value of an erroneous operation on the controllable element according to the operation result; The erroneous operation probability value is compared with a preset probability value to obtain an evaluation result.

5. The method according to claim 4, characterized in that Generating a test result for the specified user mode according to the evaluation result includes: When the erroneous operation probability value is greater than a preset probability value, a test result indicating that the manipulable element in the designated user mode is abnormal is generated.

6. The method according to any one of claims 1 to 3, characterized in that: The step of establishing a designated user model for a designated user includes: Get historical user data of a specified user; A designated user model for the designated user is established based on the historical user data.

7. The method according to any one of claims 1 to 3, characterized in that: Also includes: According to the test result, an optimization solution for the specified user mode is generated.

8. The method according to claim 1, characterized in that: The designated user is an elderly user.

9. A device for application testing, characterized in that: The device comprises: A designated user model establishment module is used to establish a designated user model for a designated user; a simulation behavior testing module, configured to call the designated user model to simulate the operation behavior of the designated user to test the application when the application enters the designated user mode for the designated user; A behavior evaluation module, used to obtain behavior data of the operation behavior and evaluate the behavior data; The first test result generating module is used to generate a test result for the specified user mode according to the evaluation result.

10. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the method according to any one of claims 1 to 8 when executed by the processor.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

12. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 8.

Images