Terminal performance test method and device, computer equipment and readable storage medium
By using a robot and a high-speed camera to perform multiple test cases in a preset test environment, evaluating the performance of the mobile phone in game scenarios, solving the problem of difficulty in effectively evaluating mobile game performance in the prior art, and achieving a comprehensive evaluation of the overall performance of the mobile phone and improving the gaming experience.
Patent Information
- Application Number
- CN202411664102.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-03-28
AI Technical Summary
The prior art is difficult to effectively evaluate the performance of mobile phones in gaming scenarios, especially in terms of game mode, game acceleration function, heating and battery consumption.
Use a robot of the specified model to start the terminal to be tested in a preset test environment and perform performance tests based on multiple pre-built test cases, including software and hardware test cases. Operation process data is collected through a high-speed camera, and weighted calculations are performed according to preset performance scoring standards to generate the terminal's performance score and test report.
It has achieved a comprehensive evaluation of the comprehensive performance of mobile phones, especially user experience evaluation in game scenarios, providing a solid guarantee for the product's market competitiveness and user satisfaction, and providing a scientific basis for product iterative updates and performance improvements.
Smart Images

Figure CN119728835A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of automated testing technology, and in particular to a terminal performance testing method, apparatus, computer equipment, and readable storage medium. Background Art
[0002] With the continuous evolution of smartphone technology, the specific market of gaming phones has emerged. Since the launch of gaming phones, their product design has always focused on the gaming experience, and has formed a sharp contrast with traditional smartphones through performance improvement, system tuning, and improvements in button design. Therefore, when evaluating the performance of a mobile phone, people tend to focus on its performance in gaming, such as whether the phone has gaming mode, game acceleration and other functions, as well as the heat generation and battery consumption of the phone when running at high load. Therefore, there is an urgent need for a terminal performance testing method for testing the performance of mobile phone games. Summary of the invention
[0003] In view of this, the present application provides a terminal performance testing method, apparatus, computer equipment and readable storage medium, the main purpose of which is to solve the problem that when evaluating the performance of mobile phones, people tend to focus more on their performance in games, for example, whether the mobile phone has game mode, game acceleration and other functions, as well as the heat generation and battery consumption of the mobile phone when running under high load, etc. Therefore, there is an urgent need for a terminal performance testing method for testing the performance of mobile phone games.
[0004] According to the first aspect of the present application, a terminal performance testing method is provided, the method comprising:
[0005] Use a manipulator of a specified model to start the terminal to be tested in a preset test environment;
[0006] Executing a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each of the test cases, wherein the plurality of test cases are used to perform a performance test on the terminal to be tested, and the plurality of test cases include software test cases and hardware test cases;
[0007] According to the project weights and calculation methods indicated by the preset performance scoring standard, weighted calculation is performed on the project scores associated with each test case to obtain the performance score corresponding to the terminal to be tested;
[0008] The performance score is associated with the terminal to be tested and a test report is generated.
[0009] Optionally, the executing of a plurality of pre-constructed test cases based on the manipulator to obtain a project score associated with each test case includes:
[0010] For any test case, determine the test steps corresponding to the test case, and determine whether the test case has a preset condition;
[0011] If there is a preset condition, the manipulator is configured according to the preset condition, so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition;
[0012] The manipulator is configured according to the test step so that the manipulator performs at least one round of performance test on the terminal to be tested according to the test step, wherein the test step is associated with a test number, and the manipulator cyclically executes the test step according to the test number to complete at least one round of performance test on the terminal to be tested;
[0013] Collecting at least one set of operation process data corresponding to the test case based on a high-speed camera associated with the manipulator, wherein each round of performance testing corresponds to a set of operation process data;
[0014] According to the project scoring standard corresponding to the test case, at least one set of operation process data corresponding to the test case is identified to obtain the project score associated with the test case.
[0015] Optionally, identifying at least one set of operation process data corresponding to the test case according to a project scoring standard corresponding to the test case to obtain a project score associated with the test case includes:
[0016] Determine at least one indicator item indicated by the project scoring standard, and determine an indicator value corresponding to each indicator item in each group of the operation process data;
[0017] According to the calculation method indicated by the project scoring standard, the indicator value corresponding to each indicator item is calculated to obtain the test value corresponding to each round of performance testing, and the average value of the test value corresponding to each round of performance testing is used as the test value associated with the test case, or the indicator value corresponding to each indicator item is used as the test value associated with the test case;
[0018] Determine a scoring formula indicated by the project scoring standard, use the scoring formula to calculate the test value, and obtain the project score associated with the test case.
[0019] Optionally, the collecting of at least one set of operation process data corresponding to the test case by a high-speed camera associated with the manipulator includes:
[0020] When it is detected that the manipulator starts to operate the terminal to be tested according to the corresponding configuration, the high-speed camera associated with the manipulator is started to enable the high-speed camera to start recording function;
[0021] When it is detected that the robot has completed the last operation instruction, the recording is terminated to obtain a set of operation process data;
[0022] If it is detected that the manipulator starts to operate the terminal to be tested again according to the corresponding configuration, the high-speed camera associated with the manipulator is started again to record until the test completion prompt information generated by the manipulator is received to obtain the at least one set of operation process data.
[0023] Optionally, the hardware test cases include performance computing test cases, display device test cases, battery test cases, heat dissipation test cases, audio unit test cases and grip test cases, and the software test cases include game fluency test cases, OS underlying control capability test cases and game experience improvement test cases.
[0024] Optionally, performing weighted calculation on the project scores associated with each test case according to the project weights and calculation method indicated by the preset performance scoring standard to obtain the performance score includes:
[0025] Determine a calculation formula associated with the calculation method, use the project weight to replace the weight variable in the calculation formula, and use the test project score associated with each test case to replace the corresponding score variable in the calculation formula, and use the calculation result associated with the calculation formula as the performance score.
[0026] Optionally, the method further comprises:
[0027] Using a manipulator of the same model to execute a plurality of the test cases on a plurality of terminals of specified models to be tested in a preset test environment, and using a high-speed camera to collect operation process data, the preset test environment is used to indicate an environment in which the network environment is stable and the room temperature is stable at a preset value;
[0028] For any terminal to be tested, identifying at least one set of operation process data corresponding to the terminal to be tested, determining the project score of each test case corresponding to the terminal to be tested, and performing weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard to obtain the performance score corresponding to the terminal to be tested;
[0029] An average value of all performance scores corresponding to all terminals to be tested is used as the target performance score of the terminal to be tested of the specified model.
[0030] According to a second aspect of the present application, a terminal performance testing device is provided, the device comprising:
[0031] A startup module is used to start the terminal to be tested using a manipulator of a specified model in a preset test environment;
[0032] A testing module, used to execute a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each of the test cases, wherein the plurality of test cases are used to perform a performance test on the terminal to be tested, and the plurality of test cases include software test cases and hardware test cases;
[0033] A calculation module, configured to perform weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard, so as to obtain the performance score corresponding to the terminal to be tested;
[0034] A generating module is used to associate the performance score with the terminal to be tested and generate a test report.
[0035] Optionally, the test module is used to determine, for any test case, the test steps corresponding to the test case, and to determine whether the test case has a preset condition; if the preset condition exists, configure the manipulator according to the preset condition, so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition; configure the manipulator according to the test step, so that the manipulator performs at least one round of performance testing on the terminal to be tested according to the test step, wherein the test step is associated with a test number, and the manipulator cyclically executes the test step according to the test number to complete at least one round of performance testing on the terminal to be tested; collect at least one set of operation process data corresponding to the test case based on a high-speed camera associated with the manipulator, wherein each round of performance testing corresponds to a set of operation process data; identify at least one set of operation process data corresponding to the test case according to the project scoring standard corresponding to the test case, and obtain the project score associated with the test case.
[0036] Optionally, the test module is used to determine at least one indicator item indicated by the project scoring standard, and determine the indicator value corresponding to each indicator item in each group of the operation process data; calculate the indicator value corresponding to each indicator item according to the calculation method indicated by the project scoring standard, and obtain the test value corresponding to each round of performance testing, and use the average value of the test value corresponding to each round of performance testing as the test value associated with the test case, or use the indicator value corresponding to each indicator item as the test value associated with the test case; determine the scoring formula indicated by the project scoring standard, use the scoring formula to calculate the test value, and obtain the project score associated with the test case.
[0037] Optionally, the test module is used to start the high-speed camera associated with the manipulator when it is detected that the manipulator starts to operate the terminal to be tested according to the corresponding configuration, so that the high-speed camera starts the recording function; end the recording when it is detected that the manipulator completes the last operation instruction, and obtain a set of the operation process data; if it is detected that the manipulator starts to operate the terminal to be tested again according to the corresponding configuration, then start the high-speed camera associated with the manipulator to record again until the test completion prompt information generated by the manipulator is received, and obtain at least one set of operation process data.
[0038] Optionally, the hardware test cases in the test module include performance computing test cases, display device test cases, battery test cases, heat dissipation test cases, audio unit test cases and grip test cases, and the software test cases include game fluency test cases, OS underlying control capability test cases and game experience improvement test cases.
[0039] Optionally, the calculation module is used to determine a calculation formula associated with the calculation method, use the project weight to replace the weight variable in the calculation formula, and use the test project score associated with each test case to replace the corresponding score variable in the calculation formula, and use the calculation result associated with the calculation formula as the performance score.
[0040] Optionally, the device further comprises:
[0041] The test module is further used to execute the plurality of test cases on the plurality of terminals to be tested of specified models using a manipulator of the same model in a preset test environment, and collect operation process data using a high-speed camera, wherein the preset test environment is used to indicate an environment in which the network environment is stable and the room temperature is stable at a preset value;
[0042] The calculation module is further configured to, for any terminal to be tested, identify at least one set of operation process data corresponding to the terminal to be tested, determine the project score of each test case corresponding to the terminal to be tested, and perform weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard to obtain the performance score corresponding to the terminal to be tested;
[0043] The determination module is used to take the average value of all performance scores corresponding to all the terminals to be tested as the target performance score of the terminal to be tested of the specified model.
[0044] According to a third aspect of the present application, a computer device is provided, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any one of the methods described in the first aspect when executing the computer program.
[0045] According to a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of any one of the methods described in the first aspect are implemented.
[0046] By means of the above technical scheme, the present application provides a terminal performance testing method and device. The present application first uses a manipulator of a specified model to start the terminal to be tested in a preset test environment. Further, based on the execution of multiple pre-built test cases by the manipulator, the project score associated with each test case is obtained. The multiple test cases are used to perform performance tests on the terminal to be tested, and the multiple test cases include software test cases and hardware test cases. Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the performance score corresponding to the terminal to be tested. Finally, the performance score is associated with the terminal to be tested and a test report is generated. The multiple test cases include software test cases (such as game running smoothness, picture rendering quality, frame rate stability, etc.) and hardware test cases (such as CPU, GPU load, heat dissipation performance, etc.). Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the comprehensive performance score corresponding to the terminal to be tested, especially the special score for game performance. Finally, the performance score is associated with the terminal to be tested and a detailed test report is generated. The embodiment of the present application not only enhances the ability to evaluate the comprehensive performance of the tested terminal, but also pays special attention to the user experience in the game scene, providing a solid guarantee for the market competitiveness and user satisfaction of the product. In addition, the embodiment of the present application also provides a test report, which contains the data and analysis results associated with each test case, which can provide a scientific basis for the iterative update of the product, performance improvement and the formulation of marketing strategies.
[0047] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
[0049] Figure 1 A schematic diagram of a terminal performance testing method provided in an embodiment of the present application is shown;
[0050] Figure 2 A schematic diagram of a terminal performance testing method provided in an embodiment of the present application is shown;
[0051] Figure 3 A schematic diagram of a terminal performance testing method provided in an embodiment of the present application is shown;
[0052] Figure 4 A schematic diagram of the structure of a terminal performance testing device provided in an embodiment of the present application is shown;
[0053] Figure 5 A schematic diagram of the device structure of a computer device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0054] The exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.
[0055] With the continuous evolution of smartphone technology, the specific market of gaming phones has emerged. Since the launch of gaming phones, their product design has always focused on the gaming experience, and has formed a sharp contrast with traditional smartphones through measures such as performance improvement, system tuning, and improvement of button design. Therefore, when evaluating the performance of a mobile phone, people tend to pay more attention to its performance in gaming, for example, whether the mobile phone has functions such as gaming mode and game acceleration, as well as the heating and battery consumption of the mobile phone when running under high load, etc. Therefore, the embodiment of the present application provides a terminal performance testing method, firstly, a manipulator of a specified model is used to start the terminal to be tested in a preset test environment. Further, based on the execution of multiple pre-built test cases by the manipulator, the project score associated with each test case is obtained, and the multiple test cases are used to perform performance testing on the terminal to be tested, and the multiple test cases include software test cases and hardware test cases. Next, according to the project weights and calculation methods indicated by the preset performance scoring criteria, the project scores associated with each test case are weighted and calculated to obtain the performance score corresponding to the terminal to be tested. Finally, the performance score is associated with the terminal to be tested and a test report is generated. Multiple test cases include software test cases (such as game running smoothness, picture rendering quality, frame rate stability, etc.) and hardware test cases (such as CPU, GPU load, heat dissipation performance, etc.). Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the comprehensive performance score corresponding to the terminal to be tested, especially the special score for game performance. Finally, the performance score is associated with the terminal to be tested and a detailed test report is generated. The embodiment of the present application not only enhances the ability to evaluate the comprehensive performance of the terminal to be tested, but also pays special attention to the user experience in the game scene, providing a solid guarantee for the market competitiveness and user satisfaction of the product. In addition, the embodiment of the present application also provides a test report, in which the data and analysis results associated with each test case contained therein can provide a scientific basis for the iterative update of the product, performance improvement and the formulation of marketing strategies.
[0056] The present application embodiment provides a terminal performance testing method, such as Figure 1 As shown, the method includes:
[0057] S10. Start the terminal to be tested using a manipulator of a specified model in a preset test environment.
[0058] In the embodiment of the present application, the terminal to be tested can be a traditional type of mobile phone or a game type mobile phone, and the present application does not specifically limit the model of the terminal to be tested. The present application is applicable to the test model of the playability index of smart phones, and the model mainly consists of two parts: hardware performance and software ecology. Among them, the hardware performance section mainly tests the hardware part of the mobile phone product with the highest correlation with the game experience. The test items can all produce relevant effects and utilities of the experience during the game. Hardware such as cameras that have little effect on the game experience do not enter the test module. The software ecology section mainly examines the software compatibility, underlying system design, and official supporting parts of mobile phone products. In order to ensure that all devices to be tested are in a unified and stable test environment, the test environment needs to be configured in advance. In the embodiment of the present application, the configuration of the test environment includes connecting all terminals to be tested to a unified WiFi network, and the network environment remains stable, and the room temperature of the test environment is maintained at a specified temperature, which can generally be set to 25 degrees Celsius. The present application does not specifically limit the value of the room temperature and uses the same model of test instruments (manipulators and high-speed cameras) to complete the test process. Furthermore, the terminals to be tested need to be prepared before testing. Specifically, first restore the phones to their factory state, do not add or delete the manufacturer's built-in applications, and ensure the consistency of the test machine and the product obtained by the user. Next, unify the brightness setting standards of the phones, and adjust the brightness of the phones according to the same setting method. Finally, pre-install the same version of the test program, and shut down the network when necessary to ensure that it is not affected by third-party information.
[0059] S20. Execute a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each test case. The plurality of test cases are used to perform performance testing on the terminal to be tested. The plurality of test cases include software test cases and hardware test cases.
[0060] In the embodiment of the present application, the operator pre-builds multiple test cases, including software test cases and hardware test cases, wherein the hardware test cases include performance computing test cases, display device test cases, battery test cases, heat dissipation test cases, audio unit test cases and grip test cases, and the software test cases include game fluency test cases, OS underlying control ability test cases and game experience improvement test cases, as shown in Table 1 below:
[0061] Table 1. Test cases
[0062]
[0063] A manipulator is an automated device with multiple degrees of freedom. Its design principle is to simulate the movement and function of the human arm. It is mainly used to perform delicate, repetitive or high-precision operations. In actual operation, the manipulator can execute multiple test cases according to preset programs to perform performance tests on the equipment under test. By executing test cases with a robotic arm, the standardization of the test process can be ensured, significantly reducing the interference of human operation errors on the test results. At the same time, in the process of completing the test cases, the manipulator can automatically quantify the performance of the equipment under test and output detailed test reports and scoring data. Figure 2 As shown, the specific operation process is as described in the following steps S21 to S25.
[0064] S21. For any test case, determine the test steps corresponding to the test case, and determine whether the test case has a preset condition.
[0065] In this step, for any test case, we must first determine the test steps corresponding to the test case, and determine whether there are preset conditions for the test case. If there are preset conditions, execute the following step S22 to configure the manipulator according to the preset conditions. If there are no preset conditions, directly execute the following step S23 to configure the manipulator according to the test steps, so that the manipulator performs at least one round of performance testing on the terminal to be tested according to the test steps.
[0066] S22. If there is a preset condition, the manipulator is configured according to the preset condition so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition;
[0067] In this step, if it is detected that the test case to be executed is associated with a preset condition, the manipulator is configured according to the preset condition so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition. In the embodiment of the present application, only when the test case to be executed is a battery energy efficiency ratio test case, there is a preset condition, as shown in Table 2 below:
[0068] Table 2. Pre-conditions for battery energy efficiency test cases
[0069]
[0070] S23, configuring the manipulator according to the test steps, so that the manipulator performs at least one round of performance testing on the terminal to be tested according to the test steps, wherein the test steps are associated with a test number, and the manipulator cyclically executes the test steps according to the test number to complete at least one round of performance testing on the terminal to be tested;
[0071] During the configuration of the manipulator, the manipulator needs to be configured according to the test steps to ensure that the manipulator can perform a comprehensive performance evaluation of the tested terminal device according to these steps. These test steps are associated with specific test times, that is, the number of times the test steps need to be executed in a loop. The manipulator will execute the test steps in a loop according to these test times, thereby ensuring that at least one complete round of performance testing is performed on the tested terminal device. Among them, tests involving performance, fluency, etc. are tested 3 times to take the average value, and long-term projects such as battery life, heating, charging, and gaming experience are tested for 1 hour for each sub-project to take the average value. In addition, subjective evaluation is minimized in the gameplay score as much as possible, and non-test projects such as appearance, weight, design, accessories, and OS use an order of magnitude evaluation mode, that is, the more the number of gameplay-related module enhancements, the higher the score. For example, the more headphone access methods, the higher the score. The lower the score of the project with a clear negative correlation with the game, for example, the heavier the weight, the lower the score. In this way, the comprehensiveness and accuracy of the test can be ensured, thereby obtaining reliable test results.
[0072] S24. Collect at least one set of operation process data corresponding to the test case based on the high-speed camera associated with the manipulator, wherein each round of performance test corresponds to a set of operation process data.
[0073] In this step, when performing the high-speed camera acquisition test based on the manipulator association, we need to collect at least one set of operation process data related to it. These data will be used to record and analyze the specific execution of each round of performance test. Specifically, each round of performance test will correspond to a set of detailed operation process data. It should be noted that the operation process data is the operation process video recorded by the high-speed camera, which records the exact time when the manipulator starts the operation, ends the operation, and each key step occurs. The timestamp helps to analyze the duration, efficiency, and time interval between the steps of the operation process. The motion trajectory, speed, acceleration, joint angle, etc. of the manipulator can reflect whether the manipulator performs the operation according to the expected path and speed. The high-speed camera will continuously capture images during the operation of the manipulator. These image sequences capture every detail of the operation process, including the reaction, state change, and possible abnormal conditions of the terminal to be tested. Specifically, when it is detected that the manipulator starts to operate the terminal to be tested according to the corresponding configuration, the high-speed camera associated with the manipulator is started to enable the high-speed camera to start the recording function. When it is detected that the manipulator completes the last operation instruction, the recording ends and a set of operation process data is obtained. During the actual operation, considering that the test steps of some test cases need to be executed multiple times in a loop to obtain more accurate performance test results, if it is detected that the robot starts to operate the terminal to be tested according to the corresponding configuration again, the high-speed camera associated with the robot is started again to record until the test completion prompt information generated by the robot is received, and at least one set of operation process data is obtained.
[0074] S25. According to the project scoring standard corresponding to the test case, at least one set of operation process data corresponding to the test case is identified to obtain a project score associated with the test case.
[0075] In the embodiments of the present application, Figure 3 As shown, according to the project scoring criteria corresponding to the test case, this application needs to deeply identify and analyze at least one set of operation process data corresponding to the test case, and then obtain the project score associated with each test case. Through this process, the project score related to the test case can be accurately obtained, thereby providing solid support for the performance test of the terminal.
[0076] S251. Determine at least one indicator item indicated by the project scoring standard, and determine the indicator value corresponding to each indicator item in each group of operation process data.
[0077] In this step, for each specific test case, the model first identifies and determines at least one key indicator item indicated by the project scoring criteria. These key indicator items are important references for evaluating project performance and quality, and they provide a clear basis for the evaluation process. Next, the model will further analyze each set of operation process data in order to accurately identify the indicator values corresponding to each key indicator item in these data. These indicator values are numerical representations of the specific performance of the project in various aspects, and they can reflect the actual performance of the project in various aspects. In this way, the model can comprehensively evaluate the performance of each test case and provide reliable data support for subsequent analysis and improvement. For example, in the speaker power test case, the project scoring criteria indicate that the speaker power score needs to be calculated based on the maximum volume value X1 corresponding to the speaker size adjusted to 50% and the maximum volume value X2 when the speaker size is adjusted to 100%. Therefore, the two key indicator items indicated by the project scoring criteria are the maximum volume value X1 corresponding to the speaker size adjusted to 50% and the maximum volume value X2 when the speaker size is adjusted to 100%. After determining the indicator value corresponding to each key indicator item in each set of operation process data, the model will execute the following step S252 for calculation to ensure the accuracy and reliability of the evaluation process.
[0078] S252. Calculate the indicator value corresponding to each indicator item according to the calculation method indicated by the project scoring standard to obtain the test value corresponding to each round of performance testing, and use the average value of the test value corresponding to each round of performance testing as the test value associated with the test case, or use the indicator value corresponding to each indicator item as the test value associated with the test case.
[0079] According to the calculation method indicated by the project scoring criteria, the indicator value corresponding to each indicator item is calculated in detail. This process involves accurate analysis and processing of the test values obtained from each round of performance testing. Specifically, the test value corresponding to each round of performance testing is used as the test value associated with the test case, or the average value of the test value corresponding to each round of performance testing is selected as the test value associated with the test case. This processing method ensures that we can comprehensively evaluate and measure the results of each round of performance testing, thereby providing accurate data support for the overall evaluation of the project. For example, for the OS underlying control capability test case, the test round is 1 round. At this time, there is no need to take the average value. Only the indicator value corresponding to each indicator item is needed as the test value associated with the test case. For the display device refresh rate test, the browser, WeChat, Weibo, iQiyi, QQ Music, Phonebook, and Taobao are opened in turn. The robot slides the above applications respectively. The test step of recording the actual refresh rate of the mobile phone screen needs to be executed 10 times. At this time, the average value of the test value corresponding to each round of performance testing needs to be used as the test value associated with the test case.
[0080] S253. Determine a scoring formula indicated by the project scoring standard, calculate the test value using the scoring formula, and obtain a project score associated with the test case.
[0081] In the embodiment of the present application, in order to ensure the accuracy and fairness of the project scoring, it is first necessary to clarify the specific content of the project scoring standard instructions and formulate a corresponding scoring formula. The scoring formula is designed according to the various requirements and indicators in the project scoring standard instructions to ensure the scientificity and rationality of the scoring process. After formulating the scoring formula, we need to perform detailed calculations and analyses on each test case to ensure that the scoring results of each test case can accurately reflect its performance and quality in the project. By calculating the scoring formula for the test case, we can obtain the project score associated with each test case, thereby providing reliable data support for the overall evaluation of the project.
[0082] Next, each test case is introduced based on steps S23 to S25:
[0083] 1. Performance computing power running test case
[0084] The test items include CPU computing power, GPU computing power, NPU computing power, RAM (memory performance and capacity), and ROM (flash memory read and write performance and database performance).
[0085] The test steps include: (1) setting the test machine to high-performance mode. (2) performing performance testing through the Master Lu APP, recording the results of selecting CPU, GPU, RAM (memory), and storage performance. (3) performing the Master Lu AI evaluation, recording the AI performance score (NPU computing power) of the test machine. (4) after each running test, turning off the screen and letting it stand for 5 minutes before conducting the next test. (5) performing steps (2) and (3) three times respectively, and taking the average of the results. (6) taking the sum of the average values of the CPU and GPU, X1, as the final result of the SOC processor. (7) taking the sum of the average values of the RAM and ROM, X2, as the final result of the storage performance. (8) taking the average value X3 of the three times of step (3) as the final result of the NPU computing power.
[0086] The test results (project scoring criteria) include, first, calculating the SOC score Y1, which is used to measure and compare the performance of different chip platforms. These scores are usually based on a series of standardized test cases, covering multiple aspects such as processor performance, graphics processing capabilities, memory access speed, network transmission speed, etc. Y1 = 100*(X1-500000) / (1100000-500000). Further, the storage performance score Y2 is calculated. The storage performance score is used to measure and evaluate the performance of storage devices (such as solid-state drives (SSDs), mechanical hard disks (HDDs), flash memory, etc.) in the system. These scores are usually based on a series of standardized tests, covering multiple aspects such as the read and write speeds, response times, and data throughput of storage devices. The storage performance score is crucial for evaluating the overall system performance, user experience, and applicability to specific application scenarios. Y2 = (220 * (X2-200000) / (600000-200000)) * 0.3. Further, the NPU computing power score Y3 is calculated. The NPU computing power score refers to an indicator used to measure the performance of a neural network processor (NPU). This score is usually based on a series of standardized tests designed to evaluate the efficiency and ability of the NPU in performing neural network-related tasks. Y3 = 30 * (X3-10000) / (200000-10000). Finally, the performance computing power score is obtained: Y = (Y1 + Y3) * 0.27 + Y2 * 0.67.
[0087] 2. Display device refresh rate test case
[0088] Test items include refresh rate test.
[0089] The test steps include: (1) the high-speed camera starts recording the operation process; (2) the browser, WeChat, Weibo, iQiyi, QQ Music, phone book, and Taobao are opened in sequence, and the robot slides the above applications respectively to record the actual refresh rate of the mobile phone screen. (3) Step (2) is tested for 10 rounds, and the average value of the 10 rounds of tests for each application is recorded respectively. (4) The average value of all applications in step (3) is X1, and the average is taken as the final result of this test.
[0090] The test results (project scoring criteria) include score Y=((100*(X1-60) / (165-60))*30%)*0.67.
[0091] 3. Multi-device display test cases
[0092] Test items include multi-device display.
[0093] The test steps include: (1) Counting whether the test machine has a secondary screen, and recording the number of secondary screens as X1. (2) Counting the screen projection interconnection modes supported by the test machine, and recording the number as X2.
[0094] The test results (project scoring criteria) include calculating the score of the mobile phone's secondary screen as 5X1, calculating the score of the number of mobile phone screen projection interconnection modes as 5X2, and finally calculating the display score Y=(5X1+5X2)*0.67.
[0095] 4. Battery energy efficiency ratio test, as shown in Table 3 below:
[0096] Table 3. Battery energy efficiency ratio test
[0097]
[0098] 5. Charging efficiency test case
[0099] Test items include charging efficiency test.
[0100] The test steps include recording the charging time X of the 10%-80% stage of power during the charging process of the test machine through a power instrument and software as the final result of this test.
[0101] The test results include a charging efficiency score Y = (20*(X-3000) / (600-3000))*0.8.
[0102] 6. Game battery life test case
[0103] Test items include game endurance test.
[0104] The test steps include: (1) setting the test machine to high performance mode and charging it to 100%. (2) opening and running Honor of Kings for 1 hour, with the game quality settings at the highest level. (3) recording the power consumed by the test machine and charging it to 100%. (4) repeating the above steps, and then running Game for Peace, Collapse: Sky Railway, Genshin Impact, and QQ Speed respectively. (5) taking the sum of the power consumed by the five tests, X, as the final result of this test.
[0105] The test results include: game endurance test score Y=(20*(X-8500) / (4500-8500))*0.8.
[0106] 7. Game temperature measurement example
[0107] Test items include actual game temperature measurement.
[0108] The test steps include: (1) setting the test machine to high performance mode and charging it to 100%. (2) opening and running Honor of Kings for 1 hour, with the game quality settings at the highest. (3) recording the temperatures of five points on the front and back of the test machine during initial operation, 10 minutes, 30 minutes, and 60 minutes. (4) selecting the highest temperature among all values as the test result of Honor of Kings. (5) repeating the above steps, running Game for Peace, Collapse: Sky Railway, Genshin Impact, and QQ Speed respectively, and recording the corresponding highest temperatures. (6) taking the average value X of the highest temperature values of the five game tests as the final result of this test.
[0109] The test results include: the actual game temperature score Y = (40*(X-52) / (38-52))*2.1.
[0110] 8. Active cooling design test cases
[0111] Test items include active heat dissipation design.
[0112] The test steps include counting whether the test machine has active heat dissipation design (such as cooling fan, liquid cooling and other active heat dissipation designs), and recording it as X according to the supported quantity.
[0113] The test results (project scoring criteria) include: active heat dissipation design score Y = 4*X
[0114] 9. Audio unit test cases
[0115] Test items include the number of speakers, audio device access method and number.
[0116] The test steps include: counting the number of speakers of the test machine, recorded as X1;
[0117] Count the number of audio interfaces of the test machine, as well as the access method (such as 3.5mm headphone jack, Bluetooth 5.3, etc.), and record it as X2.
[0118] The test results (project scoring criteria) include: audio unit score Y = 2.5X1 + 1.25X2
[0119] 10. Speaker power test case
[0120] Test items include speaker power test.
[0121] The test steps include: (1) importing a unified test audio file from the local to the test machine. (2) placing the decibel meter 30 cm away from the test machine. (3) adjusting the speaker volume of the test machine to 50%, playing the local audio file, recording the volume every 5 seconds, recording for 60 seconds, and recording the maximum volume value X1. (4) adjusting the speaker volume of the test machine to 100%, playing the local audio file, recording the volume every 5 seconds, recording for 60 seconds, and recording the maximum volume value X2.
[0122] The test results include: speaker power score Y = 5*((X1+X2) / 2-45) / (65-45)
[0123] 11. Mobile phone weight test case
[0124] Test items include mobile phone weight test.
[0125] The test steps include: (1) using a high-precision electronic scale to weigh the bare weight of the test machine. (2) taking the test weight X as the final result of this test.
[0126] The test results (project scoring criteria) include: mobile phone weight score Y = 10*(X-250) / (150-250).
[0127] 12. Game Fluency Test Cases
[0128] Test items include game fluency test.
[0129] The test steps include: (1) setting the test machine to high performance mode and charging it to 100%. (2) adjusting the game image quality settings to the highest. (3) running Honor of Kings for 1 hour on the test machine, and recording the average frame rate of 1 hour through the software. (4) charging the test machine to 100% and letting it cool. (5) repeating the above steps, testing Game for Peace, Honkai Impact 3rd, Genshin Impact, and QQ Speed, and recording the average frame rates as X2, X3, X4, and X5.
[0130] The test results (project scoring criteria) include: Honor of Kings Y1 = 12*(X1-60) / (120-60)). Game for Peace Y2 = 12*(X2-45) / (90-45)) Collapse, Star Rail Y3 = 12*(X3-30) / (60-30)). Genshin Impact Y4 = 12*(X4-30) / (60-30)). QQ Speed Y5 = 12*(X5-60) / (120-60)). Finally, integrating the above calculation results, we get the game fluency score Y = 0.8*(Y1+Y2+Y3+Y4+Y5).
[0131] 13. OS underlying control capability test cases
[0132] Test items include OS underlying control capabilities.
[0133] The test steps include: (1) counting the number of performance control modes provided by the OS system of the test machine X1 (such as balanced mode, performance mode, etc.). (2) counting the number of controllable units in different game modes of the test machine X2 (such as crosshair assistance, game reminder, control adjustment, display enhancement, etc.).
[0134] The test results (project scoring criteria) include: OS underlying control capability score Y = 0.8*(30*((X1+X2)-5) / (30-5)).
[0135] 14. Test cases to improve gaming experience
[0136] Testing items include game-related official accessories; related operation buttons; and the design of somatosensory effects such as vibration, light effects, and secondary screens.
[0137] The test steps include: (1) Counting the number of official accessories associated with the test machine and the game (such as game controllers, game keyboards, game headphones, etc.) (2) Counting the number of game-related operation buttons on the test machine itself (such as shoulder buttons on the body frame and dual-control pressure-sensitive buttons under the screen) (3) Counting the number of somatosensory effect designs such as vibration, light effects, and secondary screens on the test machine itself (such as single / dual X-axis linear motors, secondary screen displays, lighting effect designs, etc.)
[0138] The test results (project scoring criteria) include: gaming experience improvement score Y=0.8*(2X1+5X2+4X3).
[0139] S30. Perform weighted calculation on the project scores associated with each test case according to the project weights and calculation method indicated by the preset performance scoring standard to obtain a performance score corresponding to the terminal to be tested.
[0140] After calculating the project score associated with each test case (that is, the score Y associated with each test case mentioned above), the next step is to determine the specific calculation method, that is, what calculation formula to use to obtain the final performance score. This step is particularly important in the mobile phone performance test scenario, because it involves replacing the project weight (such as the weight of key performance indicators such as response time, battery life, screen resolution, etc.) to the weight variable position in the calculation formula, and replacing the project score associated with each test case (that is, the score of each test case for a specific performance indicator) to the corresponding score variable position in the calculation formula. In this way, the calculation formula can be closely combined with the actual scoring data to obtain the performance score of each test case. In mobile phone performance testing, such processing not only ensures the objectivity and accuracy of the scoring, so that the scoring results can truly reflect the performance level of the mobile phone, but also makes the entire scoring process more transparent and traceable, which helps testers to accurately analyze and optimize product performance. In summary, the scoring calculation in the mobile phone performance test scenario is a rigorous and complex process, which requires comprehensive consideration of multiple performance indicators and test case scores, and the final performance score is obtained through a reasonable calculation formula, providing strong support for product optimization and improvement.
[0141] S40: Associating the performance score with the terminal to be tested and generating a test report.
[0142] In the embodiment of the present application, a scenario of performing performance tests on multiple specified models of mobile phones is also provided. First, the tester uses the same model of manipulator to execute multiple test cases on multiple mobile phones to be tested in a preset test environment. The preset test environment ensures that the network environment is stable and the room temperature is maintained at a preset value to ensure the consistency and accuracy of the test results.
[0143] During the execution of the test cases, high-speed cameras are used to collect operation process data, which can include key performance indicators such as screen touch response time, application startup time, and running smoothness. With this data, the performance of the mobile phone when performing specific tasks can be more accurately evaluated. For each mobile phone to be tested, the test system will identify at least one set of operation process data corresponding to it, and determine the project score of each test case based on this data. These scores will be weighted according to the preset performance scoring criteria, which will take into account the importance and weight of different test cases. For example, some test cases may have a greater impact on the user experience, so they will be given a higher weight. Finally, the weighted scores of all test cases are summarized to obtain the comprehensive performance score of each mobile phone to be tested. In order to obtain an overall performance evaluation of a model of mobile phone, the performance scores of all mobile phones to be tested are averaged to obtain the target performance score of the model of mobile phone. Through the preset scoring criteria and weight calculation, an objective performance score can be obtained, providing reliable data support for consumers and manufacturers.
[0144] The method provided in the embodiment of the present application first uses a manipulator of a specified model to start the terminal to be tested in a preset test environment. Further, based on the execution of multiple pre-built test cases by the manipulator, the project score associated with each test case is obtained, and the multiple test cases are used to perform performance tests on the terminal to be tested, and the multiple test cases include software test cases and hardware test cases. Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the performance score corresponding to the terminal to be tested. Finally, the performance score is associated with the terminal to be tested and a test report is generated. The multiple test cases include software test cases (such as game running smoothness, picture rendering quality, frame rate stability, etc.) and hardware test cases (such as CPU, GPU load, heat dissipation performance, etc.). Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the comprehensive performance score corresponding to the terminal to be tested, especially the special score for game performance. Finally, the performance score is associated with the terminal to be tested and a detailed test report is generated. The embodiment of the present application not only enhances the ability to evaluate the comprehensive performance of the tested terminal, but also pays special attention to the user experience in the game scene, providing a solid guarantee for the market competitiveness and user satisfaction of the product. In addition, the embodiment of the present application also provides a test report, which contains the data and analysis results associated with each test case, which can provide a scientific basis for the iterative update of the product, performance improvement and the formulation of marketing strategies.
[0145] Further, as Figure 1 In a specific implementation of the method, the present application provides a terminal performance testing device, such as Figure 4As shown, the device includes: a starting module 401, a testing module 402, a calculating module 403, and a generating module 404.
[0146] The starting module 401 is used to start the terminal to be tested using a manipulator of a specified model in a preset test environment;
[0147] The test module 402 is used to execute a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each of the test cases, wherein the plurality of test cases are used to perform a performance test on the terminal to be tested, and the plurality of test cases include software test cases and hardware test cases;
[0148] The calculation module 403 is used to perform weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard to obtain the performance score corresponding to the terminal under test;
[0149] The generating module 404 is used to associate the performance score with the terminal to be tested and generate a test report.
[0150] Optionally, the test module 402 is used to determine, for any test case, the test steps corresponding to the test case, and to determine whether the test case has a preset condition; if the preset condition exists, configure the manipulator according to the preset condition, so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition; configure the manipulator according to the test step, so that the manipulator performs at least one round of performance testing on the terminal to be tested according to the test step, wherein the test step is associated with a test number, and the manipulator cyclically executes the test step according to the test number to complete at least one round of performance testing on the terminal to be tested; based on the high-speed camera associated with the manipulator, at least one group of operation process data corresponding to the test case is collected, wherein each round of performance testing corresponds to a group of operation process data, and according to the project scoring standard corresponding to the test case, at least one group of operation process data corresponding to the test case is identified to obtain the project score associated with the test case.
[0151] Optionally, the test module 402 is used to determine at least one indicator item indicated by the project scoring standard, and determine the indicator value corresponding to each indicator item in each group of the operation process data; calculate the indicator value corresponding to each indicator item according to the calculation method indicated by the project scoring standard to obtain the test value corresponding to each round of performance testing, and use the average value of the test value corresponding to each round of performance testing as the test value associated with the test case, or use the indicator value corresponding to each indicator item as the test value associated with the test case; determine the scoring formula indicated by the project scoring standard, use the scoring formula to calculate the test value, and obtain the project score associated with the test case.
[0152] Optionally, the test module 402 is used to start the high-speed camera associated with the manipulator when it is detected that the manipulator starts to operate the terminal to be tested according to the corresponding configuration, so that the high-speed camera starts the recording function; when it is detected that the manipulator completes the last operation instruction, the recording is ended to obtain a set of the operation process data; if it is detected that the manipulator starts to operate the terminal to be tested again according to the corresponding configuration, the high-speed camera associated with the manipulator is started again to record until the test completion prompt information generated by the manipulator is received, and at least one set of operation process data is obtained.
[0153] Optionally, the hardware test cases in the test module 402 include performance computing test cases, display device test cases, battery test cases, heat dissipation test cases, audio unit test cases and grip test cases, and the software test cases include game fluency test cases, OS underlying control capability test cases and game experience improvement test cases.
[0154] Optionally, the calculation module 403 is used to determine a calculation formula associated with the calculation method, use the project weight to replace the weight variable in the calculation formula, and use the test project score associated with each test case to replace the corresponding score variable in the calculation formula, and use the calculation result associated with the calculation formula as the performance score.
[0155] Optionally, the device further includes: a determination module 405.
[0156] The test module 402 is further used to execute the plurality of test cases on the plurality of terminals to be tested of specified models using a manipulator of the same model in a preset test environment, and collect operation process data using a high-speed camera, wherein the preset test environment is used to indicate an environment in which the network environment is stable and the room temperature is stable at a preset value;
[0157] The calculation module 403 is further configured to, for any terminal to be tested, identify at least one set of operation process data corresponding to the terminal to be tested, determine the project score of each test case corresponding to the terminal to be tested, and perform weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard to obtain the performance score corresponding to the terminal to be tested;
[0158] The determination module 405 is configured to use an average value of all performance scores corresponding to all the terminals to be tested as a target performance score of the terminal to be tested of the specified model.
[0159] The device provided in the embodiment of the present application first uses a manipulator of a specified model to start the terminal to be tested in a preset test environment. Further, based on the execution of multiple pre-built test cases by the manipulator, the project score associated with each test case is obtained, and the multiple test cases are used to perform performance tests on the terminal to be tested, and the multiple test cases include software test cases and hardware test cases. Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the performance score corresponding to the terminal to be tested. Finally, the performance score is associated with the terminal to be tested and a test report is generated. The multiple test cases include software test cases (such as game running smoothness, picture rendering quality, frame rate stability, etc.) and hardware test cases (such as CPU, GPU load, heat dissipation performance, etc.). Next, according to the project weights and calculation methods indicated by the preset performance scoring standards, the project scores associated with each test case are weighted and calculated to obtain the comprehensive performance score corresponding to the terminal to be tested, especially the special score for game performance. Finally, the performance score is associated with the terminal to be tested and a detailed test report is generated. The embodiment of the present application not only enhances the ability to evaluate the comprehensive performance of the tested terminal, but also pays special attention to the user experience in the game scene, providing a solid guarantee for the market competitiveness and user satisfaction of the product. In addition, the embodiment of the present application also provides a test report, which contains the data and analysis results associated with each test case, which can provide a scientific basis for the iterative update of the product, performance improvement and the formulation of marketing strategies.
[0160] It should be noted that for other corresponding descriptions of the functional units involved in the terminal performance testing device provided in the embodiment of the present application, reference can be made to Figures 1 to 3 The corresponding description in will not be repeated here.
[0161] In an exemplary embodiment, see Figure 5, and also provides a device, which includes a communication bus, a processor, a memory and a communication interface, and may also include an input and output interface and a display device, wherein each functional unit can communicate with each other through the bus. The memory stores a computer program, and the processor is used to execute the program stored in the memory and execute the terminal performance test method in the above embodiment.
[0162] A computer-readable storage medium stores a computer program, which implements the steps of the terminal performance testing method when executed by a processor.
[0163] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by hardware, or by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each implementation scenario of the present application.
[0164] Those skilled in the art will appreciate that the accompanying drawings are merely schematic diagrams of a preferred implementation scenario, and the modules or processes in the accompanying drawings are not necessarily required for implementing the present application.
[0165] Those skilled in the art will appreciate that the modules in the device in the implementation scenario can be distributed in the device in the implementation scenario according to the implementation scenario description, or can be changed accordingly and located in one or more devices different from the implementation scenario. The modules in the above implementation scenario can be combined into one module, or can be further split into multiple sub-modules.
[0166] The above application serial numbers are for description only and do not represent the advantages or disadvantages of the implementation scenarios.
[0167] The above disclosure only discloses several specific implementation scenarios of the present application. However, the present application is not limited thereto, and any changes that can be conceived by technicians in this field should fall within the scope of protection of the present application.
Claims
1. A terminal performance testing method, characterized in that: include: Use a manipulator of a specified model to start the terminal to be tested in a preset test environment; Executing a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each of the test cases, wherein the plurality of test cases are used to perform a performance test on the terminal to be tested, and the plurality of test cases include software test cases and hardware test cases; According to the project weights and calculation methods indicated by the preset performance scoring standard, weighted calculation is performed on the project scores associated with each test case to obtain the performance score corresponding to the terminal to be tested; The performance score is associated with the terminal to be tested and a test report is generated.
2. The method according to claim 1, characterized in that The step of executing a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each test case includes: For any test case, determine the test steps corresponding to the test case, and determine whether the test case has a preset condition; If there is a preset condition, the manipulator is configured according to the preset condition, so that the manipulator adjusts the operating state of the terminal to be tested according to the preset condition; The manipulator is configured according to the test step so that the manipulator performs at least one round of performance test on the terminal to be tested according to the test step, wherein the test step is associated with a test number, and the manipulator cyclically executes the test step according to the test number to complete at least one round of performance test on the terminal to be tested; Collecting at least one set of operation process data corresponding to the test case based on a high-speed camera associated with the manipulator, wherein each round of performance testing corresponds to a set of operation process data; According to the project scoring standard corresponding to the test case, at least one set of operation process data corresponding to the test case is identified to obtain the project score associated with the test case.
3. The method according to claim 2, characterized in that The step of identifying at least one set of operation process data corresponding to the test case according to the project scoring standard corresponding to the test case to obtain the project score associated with the test case includes: Determine at least one indicator item indicated by the project scoring standard, and determine an indicator value corresponding to each indicator item in each group of the operation process data; According to the calculation method indicated by the project scoring standard, the indicator value corresponding to each indicator item is calculated to obtain the test value corresponding to each round of performance testing, and the average value of the test value corresponding to each round of performance testing is used as the test value associated with the test case, or the indicator value corresponding to each indicator item is used as the test value associated with the test case; Determine a scoring formula indicated by the project scoring standard, use the scoring formula to calculate the test value, and obtain the project score associated with the test case.
4. The method according to claim 2, characterized in that: The collecting of at least one set of operation process data corresponding to the test case by a high-speed camera associated with the manipulator includes: When it is detected that the manipulator starts to operate the terminal to be tested according to the corresponding configuration, the high-speed camera associated with the manipulator is started to enable the high-speed camera to start recording function; When it is detected that the robot has completed the last operation instruction, the recording is terminated to obtain a set of operation process data; If it is detected that the manipulator starts to operate the terminal to be tested again according to the corresponding configuration, the high-speed camera associated with the manipulator is started again to record until the test completion prompt information generated by the manipulator is received to obtain the at least one set of operation process data.
5. The method according to claim 4, characterized in that The hardware test cases include performance computing test cases, display device test cases, battery test cases, heat dissipation test cases, audio unit test cases and grip test cases; the software test cases include game fluency test cases, OS underlying control capability test cases and game experience improvement test cases.
6. The method according to claim 1, characterized in that The project scores associated with each test case are weighted and calculated according to the project weights and calculation methods indicated by the preset performance scoring standards to obtain a performance score, including: Determine a calculation formula associated with the calculation method, use the project weight to replace the weight variable in the calculation formula, and use the test project score associated with each test case to replace the corresponding score variable in the calculation formula, and use the calculation result associated with the calculation formula as the performance score.
7. The method according to claim 1, characterized in that The method further comprises: Using a manipulator of the same model to execute a plurality of the test cases on a plurality of terminals of specified models to be tested in a preset test environment, and using a high-speed camera to collect operation process data, the preset test environment is used to indicate an environment in which the network environment is stable and the room temperature is stable at a preset value; For any terminal to be tested, identifying at least one set of operation process data corresponding to the terminal to be tested, determining the project score of each test case corresponding to the terminal to be tested, and performing weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard to obtain the performance score corresponding to the terminal to be tested; An average value of all performance scores corresponding to all terminals to be tested is used as the target performance score of the terminal to be tested of the specified model.
8. A terminal performance testing device, characterized in that: include: A startup module is used to start the terminal to be tested using a manipulator of a specified model in a preset test environment; A testing module, used to execute a plurality of pre-built test cases based on the manipulator to obtain a project score associated with each of the test cases, wherein the plurality of test cases are used to perform a performance test on the terminal to be tested, and the plurality of test cases include software test cases and hardware test cases; A calculation module, configured to perform weighted calculation on the project score associated with each test case according to the project weight and calculation method indicated by the preset performance scoring standard, so as to obtain the performance score corresponding to the terminal to be tested; A generating module is used to associate the performance score with the terminal to be tested and generate a test report.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
Citation Information
Cited By
Terminal operation experience evaluation method and system
CN120523545A