Display performance test method and device, and electronic device

Abstract

The application relates to a display performance test method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: obtaining a display performance test task; based on the display performance test task, a target test equipment is determined by controlling a multi-station machine; the multi-station machine is used for clamping at least two test equipments; if the display performance test task is an optical parameter measurement task, in the process of running a software script corresponding to the optical parameter measurement task, based on each configuration item in the software script, the screen of the target test equipment is switched to different display modes, a color analyzer is called to measure different display modes, and corresponding test results are obtained; the color analyzer is used for measuring optical parameters. The method can effectively improve the test efficiency of display performance test.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a display performance testing method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] With the development of computer technology and the arrival of the 5G era, the emergence of the Internet has brought great convenience to modern life. The rapid development of mobile communication equipment has made communication equipment more and more diverse, providing more convenience for people's lives. Users can use various types of electronic devices to interact with information. Therefore, it is necessary to test the display performance of various types of electronic devices to understand their display performance.

[0003] However, current display performance testing methods, such as basic optical testing and display stability anomaly detection, require manual deployment and testing, which consumes a lot of time and effort and easily leads to low testing efficiency. Summary of the Invention

[0004] This application provides a display performance testing method, apparatus, electronic device, and computer-readable storage medium, which can effectively improve the testing efficiency of display performance testing.

[0005] A display performance testing method, the method comprising:

[0006] Obtain display performance test tasks;

[0007] Based on the display performance test task, the multi-station machine tool is controlled to determine the target test equipment; wherein, the multi-station machine tool is used to hold at least two test equipment.

[0008] If the display performance test task is an optical parameter measurement task, then during the execution of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the screen of the target test device is switched to different display modes, and a color analyzer is called to measure the different display modes to obtain the corresponding test results; wherein, the color analyzer is used to measure optical parameters.

[0009] A display performance testing device, comprising:

[0010] The acquisition module is used to acquire display performance test tasks;

[0011] The determination module is used to control a multi-station machine to determine the target test equipment based on the display performance test task; wherein the multi-station machine is used to hold at least two test equipment.

[0012] The running module is used to switch the screen of the target test device to different display modes based on the configuration items in the software script during the execution of the software script corresponding to the optical parameter measurement task if the display performance test task is an optical parameter measurement task.

[0013] The calling module is used to call the color analyzer to measure different display modes and obtain corresponding test results; wherein, the color analyzer is used to measure optical parameters.

[0014] An electronic device includes a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the display performance testing method described above.

[0015] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described above.

[0016] The aforementioned display performance testing method acquires a display performance testing task and, based on this task, controls a multi-station machine to determine the target testing device. The multi-station machine is used to hold at least two testing devices. If the display performance testing task is an optical parameter measurement task, during the execution of the software script corresponding to the optical parameter measurement task, the screen of the target testing device is switched to different display modes based on the configuration items in the software script, and a color analyzer is invoked to measure the different display modes to obtain the corresponding test results. The color analyzer is used to measure optical parameters. Because the hardware driver, color analyzer, and multi-station machine are highly integrated to form a complete software-hardware automated testing solution, corresponding software scripts can be acquired based on different display performance testing tasks. This connects the device's software and hardware testability, i.e., by combining the mobile phone software to simulate switching to different color modes for optical parameter acquisition, the basic optical parameter acquisition of the hardware itself is connected to the software. This achieves end-to-end automated testing of the mobile phone hardware, driver, and system settings. The optical parameter measurement task can be automatically completed by running the corresponding software script, avoiding manual deployment and testing, thus effectively improving the testing efficiency of display performance testing. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 Here is a flowchart illustrating a performance testing method in one embodiment;

[0019] Figure 2 In one embodiment, if the display performance test task is an optical parameter measurement task, then during the running of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the screen of the target test device is switched to different display modes, and the color analyzer is called to measure the different display modes to obtain the corresponding test results.

[0020] Figure 3 This is an architecture diagram of a display end-to-end testing system based on a combination of software and hardware in one embodiment;

[0021] Figure 4 This is a schematic diagram of the process for measuring basic optical parameters in one embodiment;

[0022] Figure 5 This is a schematic diagram illustrating the post-processing flow of anomaly detection in one embodiment;

[0023] Figure 6 This is a structural block diagram of the performance testing device in one embodiment;

[0024] Figure 7 This is a diagram of the internal structure of an electronic device in one embodiment. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0026] In one embodiment, such as Figure 1 As shown, a display performance testing method is provided. This embodiment illustrates the method applied to a terminal, but it is understood that the method can also be applied to a server, and to a system including both a terminal and a server, and implemented through interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0027] Step 102: Obtain the display performance test task.

[0028] Display performance testing tasks refer to the testing tasks used to test the display performance of different devices under test. Display performance testing tasks can include different types of tests, such as basic optical parameter measurement, backlight curve measurement, and display anomaly detection.

[0029] The terminal can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include smart speakers, smart TVs, smart air conditioners, smart in-vehicle systems, etc. Portable wearable devices can include smartwatches, smart bracelets, head-mounted devices, etc.

[0030] Specifically, after a user starts the test terminal through a trigger operation, the user can configure the software scripts corresponding to different test tasks in the configuration interface. The user can select the target test device and the corresponding display performance task to be tested in the test interface. The test terminal responds to the user's trigger operation and can obtain the corresponding display performance test task triggered by the user.

[0031] For example, suppose a user selects device A as the target test device and optical parameter measurement as the corresponding display performance task in the test interface. In response to the user's triggering operation, the test terminal can obtain the corresponding display performance test task triggered by the user as optical parameter measurement task for device A.

[0032] Step 104: Based on the display performance test task, control the multi-station machine to determine the target test equipment; wherein, the multi-station machine is used to hold at least two test equipment.

[0033] Among them, a multi-station machine tool refers to a device used to clamp multiple objects to be tested. For example, a multi-station machine tool can clamp multiple mobile phone terminals to be tested.

[0034] Test equipment refers to the device to be tested. Test equipment can include various types of devices, such as laptops, smartphones, tablets, IoT devices, and portable wearable devices.

[0035] The target test device refers to the device to be tested in this test, selected from multiple devices to be tested. For example, if a multi-station test bench holds device A and device B, then based on the user-triggered display performance test task, device B can be identified as the target test device.

[0036] Specifically, in response to a user's trigger operation, after obtaining the corresponding display performance test task triggered by the user, the test terminal can control the multi-station machine to determine the target test equipment based on the display performance test task; wherein, the multi-station machine is used to hold at least two test devices. That is, the test terminal can send an instruction to the multi-station machine to select the target device under test based on the display performance test task, so as to control the multi-station machine to determine the target test equipment corresponding to the display performance test task.

[0037] For example, suppose a user selects device A as the target test device and optical parameter measurement as the corresponding display performance task in the test interface. In response to the user's triggering operation, the test terminal can obtain the corresponding display performance test task triggered by the user as optical parameter measurement task for device A. Based on the display performance test task, the test terminal sends an instruction to the multi-station machine to select the target device under test, so as to control the multi-station machine to determine the target test device corresponding to the display performance test task as device A. For example, the multi-station machine can move device A as the target test device to the corresponding position on the workbench based on the received instruction.

[0038] Step 106: If the display performance test task is an optical parameter measurement task, then during the running of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the screen of the target test device is switched to different display modes, and the color analyzer is called to measure the different display modes to obtain the corresponding test results; wherein, the color analyzer is used to measure optical parameters.

[0039] The optical parameter measurement task refers to the task of measuring the optical parameters of the test equipment. Optical parameters may include luminance, chromaticity, NTSC, gamma curve, etc. The gamma curve is a special hue curve; when the gamma value equals 1, the curve is a straight line at 45° to the coordinate axis. This indicates that the input and output densities are the same. A gamma value higher than 1 will cause the output to be darker, and a gamma value lower than 1 will cause the output to be brighter. The NTSC standard, also known as the N-system, is a color television broadcasting standard developed by the National Television System Committee (NTSC) in the United States.

[0040] A software script is an executable file written using a specific descriptive language and following a certain format. It can be understood that the display performance testing tasks in this application include different types of testing tasks, and users can configure the corresponding software script name and number based on each type of testing task. For example, the software script name for the optical parameter measurement task can be pre-configured as "Optical Parameter Test Script," and the software script number as 001.

[0041] Configuration items refer to different types of configuration information written in the software script. Configuration items can be corresponding configuration items set for different test tasks. For example, configuration items may include backlight settings, customized upper-level display operation settings, etc.

[0042] Display mode refers to the display mode corresponding to the screen of the device under test. For example, display mode can include night mode, vivid mode, etc. Different manufacturers provide different display modes for their devices under test.

[0043] A color analyzer is a device used to measure optical parameters. In this application, the color analyzer can be hardware integrated into the test system or a hardware module with color analyzer function integrated into the test system.

[0044] The test results refer to the test results corresponding to each display performance test task. The test results corresponding to different types of display performance test tasks are different.

[0045] Specifically, based on the display performance test task, after controlling the multi-station machine to determine the target test equipment, the test terminal can run the software script corresponding to the display performance test task to complete the test task on the target test equipment. If the display performance test task is an optical parameter measurement task, then during the execution of the software script corresponding to the optical parameter measurement task, the test terminal can switch the screen of the target test equipment to different display modes based on the configuration parameters in the software script, and call the color analyzer to measure the different display modes to obtain the corresponding test results.

[0046] For example, suppose a user selects device A as the target test device and optical parameter measurement as the corresponding display performance task in the test interface. In response to the user's trigger operation, the test terminal can obtain the corresponding display performance test task triggered by the user as optical parameter measurement task for device A. Based on the display performance test task, the test terminal sends an instruction to the multi-station machine to select the target device under test, so as to control the multi-station machine to move device A as the target test device to the corresponding position on the workbench.

[0047] Furthermore, the test terminal can obtain the name and number of the software script corresponding to the optical parameter measurement task. Assuming the software script name for the optical parameter measurement task is script A and the software script number is 001, the test terminal can run the software script named script A and numbered 001. During the execution of software script A corresponding to the optical parameter measurement task, the test terminal can switch the screen of the target test device, i.e., device A, to different display modes based on the configuration parameters in software script A, and call the color analyzer to measure the different display modes of device A to obtain the test results corresponding to the optical parameter measurement task.

[0048] In the aforementioned display performance testing method, a display performance test task is acquired, and based on this task, a multi-station machine is controlled to determine the target test equipment. The multi-station machine is used to hold at least two test devices. If the display performance test task is an optical parameter measurement task, during the execution of the software script corresponding to the optical parameter measurement task, the screen of the target test equipment is switched to different display modes based on the configuration items in the software script, and a color analyzer is called to measure the different display modes to obtain the corresponding test results. The color analyzer is used to measure optical parameters. Because the hardware driver, color analyzer, and multi-station machine are highly integrated to form a complete software-hardware automated testing solution, corresponding software scripts can be acquired based on different display performance test tasks. This connects the device's software and hardware testability, i.e., by combining the mobile phone software to simulate switching to different color modes for optical parameter acquisition, the basic optical parameter acquisition of the hardware itself is connected to the software. This achieves end-to-end automated testing of the mobile phone hardware, driver, and system settings. By running the corresponding software script, the optical parameter measurement task can be automatically completed, avoiding manual deployment and testing, thus effectively improving the testing efficiency of display performance testing.

[0049] In one embodiment, such as Figure 2 As shown, if the display performance test task is an optical parameter measurement task, then during the execution of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the steps of switching the target test device's screen to different display modes and calling the color analyzer to measure the different display modes to obtain the corresponding test results include:

[0050] Step 202: Adjust the color mode of the current screen of the target test device to vivid mode, and send a command to the color analyzer to collect optical parameters so that the color analyzer can collect the optical parameters in vivid mode and obtain the first optical parameters in vivid mode.

[0051] Step 204: Switch the vivid mode of the current screen of the target test device to another display mode, and send a command to the color analyzer to collect optical parameters so that the color analyzer can collect optical parameters in other display modes and obtain the second optical parameters in other display modes.

[0052] Step 206: Based on the first optical parameter and the second optical parameter, generate a test report corresponding to the optical parameter measurement task.

[0053] Specifically, if the display performance test task is an optical parameter measurement task, then during the process of running the software script corresponding to the optical parameter measurement task, the test terminal can adjust the color mode of the current screen of the target test device to vivid mode based on the configuration items in the software script, and send a command to the color analyzer to collect optical parameters, so that the color analyzer can collect the optical parameters of the target test device in vivid mode and obtain the first optical parameters of the target test device in vivid mode.

[0054] Furthermore, the test terminal can switch the current vivid mode of the target test device's screen to other display modes and send a command to the color analyzer to collect optical parameters. This allows the color analyzer to collect the optical parameters of the target test device in other display modes, obtaining a second set of optical parameters for the target test device in those other display modes. Based on the first and second optical parameters, the test terminal can generate a test report corresponding to the optical parameter measurement task. It can be understood that if the target test device has three switchable display modes, the test terminal needs to iterate through all display modes on the target test device and send a command to the color analyzer to collect optical parameters. This allows the color analyzer to collect the optical parameters of the target test device in all three display modes. Finally, based on the optical parameters corresponding to the three display modes, the test terminal summarizes and generates a test report corresponding to the optical parameter measurement task for that target test device.

[0055] In this embodiment, compared to traditional technologies where the acquisition of basic optical parameters is usually done purely through hardware, the acquisition method in this application combines the acquisition of optical parameters by simulating switching to different color modes using mobile phone software. This connects the acquisition of basic optical parameters from the hardware itself with the software, enabling end-to-end automated testing of mobile phone hardware, drivers, and system settings. This effectively improves the automation efficiency of the test and also enhances the quantitative accuracy of the test.

[0056] In one embodiment, before obtaining the display performance test task, the method further includes:

[0057] To acquire the optical parameters that need to be measured in the optical parameter measurement task;

[0058] Configure the interface number corresponding to each optical parameter to obtain the optical parameter interface corresponding to each optical parameter, so that the corresponding optical parameter can be obtained by calling the optical parameter interface.

[0059] Specifically, before acquiring the display performance test task, the test terminal can obtain the various optical parameters required for measurement in the optical parameter measurement task, such as brightness, chromaticity, NTSC, and gamma, as input by the user in the configuration interface. Furthermore, the test terminal can configure the interface number corresponding to each optical parameter based on the acquired optical parameter measurement task, obtaining the corresponding optical parameter interface. This allows the test terminal to obtain the corresponding optical parameters by calling the optical parameter interface during subsequent test task execution. For example, the color analyzer driver can be pre-integrated into the software script control module, and the pre-configured, encapsulated optical parameter interfaces for measurement can be pre-configured for use. When the test terminal runs the software script, it will control the process through a synchronization mechanism. After the software script switches to different display modes, it will call the color analyzer for measurement and send the test results back.

[0060] In this embodiment, by combining the acquisition of optical parameters when the mobile phone software simulates switching to different color modes, the acquisition of the basic optical parameters of the hardware itself and the software are connected, realizing end-to-end automated testing of mobile phone hardware, drivers, and system settings. This effectively improves the automation efficiency of the test and also improves the quantitative accuracy of the test.

[0061] In one embodiment, after controlling the multi-station machine to select the target testing equipment based on the display performance testing task, the method further includes:

[0062] If the display performance test task is a backlight curve measurement task, then during the execution of the software script corresponding to the backlight curve measurement task, the controllable light box is called to set the ambient light based on the backlight settings in the software script, so as to obtain the ambient light corresponding to the backlight settings; wherein, the controllable light box is used to control the illuminance and color temperature changes of the ambient light.

[0063] The color analyzer is moved to the center of the screen of the target test device to collect brightness data, and the screen backlight curve corresponding to the change in ambient light is obtained.

[0064] Based on the preset key acceptance points, determine whether the screen backlight curve meets the preset key indicators and generate the corresponding test results.

[0065] Critical acceptance points refer to pre-set key indicators. For example, critical acceptance points may include response time. Setting critical acceptance points is to add key acceptance indicators to the curve. The test terminal can automatically determine whether the curve meets the initially preset key indicators by running the software script corresponding to the test task, and automatically make a pass or fail conclusion.

[0066] Specifically, after the test terminal controls the multi-station machine to determine the target test equipment based on the display performance test task, if the display performance test task is a backlight curve measurement task, the test terminal can call the controllable light box to set the ambient light based on the backlight setting item in the software script during the execution of the software script, so as to obtain the ambient light corresponding to the backlight setting item; wherein, the controllable light box is used to control the illuminance and color temperature changes of the ambient light;

[0067] Furthermore, the test terminal can call a color analyzer to move to the center of the target test device's screen to collect brightness data, obtaining the screen backlight curve corresponding to changes in ambient light. The test terminal can determine whether the screen backlight curve meets preset key indicators based on preset key acceptance points. If the test terminal determines that the screen backlight curve meets the preset key indicators based on the preset key acceptance points, the test terminal generates the corresponding test result as "pass," indicating that the test has passed. If the test terminal determines that the screen backlight curve does not meet the preset key indicators based on the preset key acceptance points, the test terminal generates the corresponding test result as "fail," indicating that the test has failed.

[0068] For example, assuming the target test device is test unit A, selecting the corresponding backlight settings in the software script will begin the ambient light setup. Simultaneously, the test terminal controls the color analyzer to move to the center of test unit A's screen to collect brightness data, thereby obtaining a screen backlight curve that changes with ambient light. Key acceptance points are set on this curve, allowing the test terminal to perform threshold judgments. Thus, by running the test script corresponding to the backlight curve measurement task, the system automatically determines whether the curve meets the initially preset key indicators and automatically determines pass or fail. This achieves end-to-end automated testing of the phone's hardware, drivers, and system settings, avoiding manual deployment and testing, effectively improving the automation efficiency of the test, and also enhancing the quantitative accuracy of the test.

[0069] In one embodiment, after controlling the multi-station machine to select the target testing equipment based on the display performance testing task, the method further includes:

[0070] If the display performance test task is a display anomaly detection task, then during the execution of the software script corresponding to the display anomaly detection task, customized upper-level display operations are run through the main thread of the software script. The upper-level display operations are used to simulate the user's daily operation scenarios.

[0071] The first sub-thread of the software script calls the high-speed camera to capture the running software script display interface of the target test device, and obtains the corresponding first image.

[0072] The second sub-thread of the software script synchronously controls the target test device to perform screenshot and screen recording operations, thereby obtaining the corresponding second image.

[0073] Log information from the target test device is captured synchronously via a third sub-thread of the software script;

[0074] Based on the first image, the second image, and log information, a corresponding detection report is generated.

[0075] Among them, the display anomaly detection task refers to the test task used to detect screen display anomalies. For example, the display anomaly detection task can detect various types of anomalies such as screen distortion, white screen, green screen, blur, stripes, and tearing.

[0076] Customized upper-layer display operations refer to customized upper-layer display MTBF operations, including scenarios involving permutations and combinations of display features, and scenarios simulating daily user operations in top applications. In this embodiment, customized upper-layer display MTBF operations refer to the scenario coverage of traversing all permutations of software features and interactions, which will be implemented through script or tool development. MTBF refers to Mean Time Between Failures.

[0077] Specifically, based on the display performance test task, the test terminal controls the multi-station machine to select the target test device. If the display performance test task is a display anomaly detection task, the test terminal, while running the software script corresponding to the display anomaly detection task, executes customized upper-layer display MTBF operations through the main thread of the software script. These upper-layer display MTBF operations simulate daily user operation scenarios. The test terminal uses the first sub-thread of the software script to call a high-speed camera to capture the display interface of the target test device running the software script, obtaining the corresponding first image. The test terminal uses the second sub-thread of the software script to synchronously control the target test device to perform screenshot and screen recording operations, obtaining the corresponding second image. The test terminal uses the third sub-thread of the software script to synchronously capture the log information of the target test device. Based on the first image, the second image, and the log information, the test terminal generates a corresponding test report. Therefore, by comparing anomalies in the entire customized scenario operation process through screen recording, screenshots, and high-speed camera capture, it is possible to quickly and effectively locate whether the problem is a low-level display issue or an upper-layer display issue, avoiding manual deployment and testing, and effectively improving the testing efficiency of display performance testing.

[0078] In one embodiment, the step of generating a corresponding detection report based on the first image, the second image, and log information includes:

[0079] The first image is inspected to obtain the corresponding first detection result;

[0080] The second image is then inspected to obtain the corresponding second inspection result.

[0081] Filter the log information to obtain the corresponding error log information;

[0082] Based on the first detection result, the second detection result, and the error log information, a corresponding detection report is generated.

[0083] Specifically, based on the display performance test task, after the test terminal controls the multi-station machine to select the target test device, if the display performance test task is a display anomaly detection task, the test terminal, while running the software script corresponding to the display anomaly detection task, runs a customized upper-level display MTBF operation through the main thread of the software script. The upper-level display MTBF operation is used to simulate the user's daily operation scenario. The test terminal, through the first sub-thread of the software script, calls a high-speed camera to capture the display interface of the running software script on the target test device, obtaining the corresponding first image, and then detects the first image to obtain the corresponding first detection result. The test terminal, through the second sub-thread of the software script, synchronously controls the target test device to perform screenshot and screen recording operations, obtaining the corresponding second image, and then detects the second image to obtain the corresponding second detection result. The test terminal, through the third sub-thread of the software script, synchronously captures the log information of the target test device, filters the log information, and obtains the corresponding error log information. For example, the test terminal can match and filter keywords in real time to obtain the corresponding error log information and save the error log. Finally, the test terminal can generate a corresponding test report based on the obtained first detection result, second detection result, and error log information.

[0084] In this embodiment, by recording the screen, taking screenshots, and using a high-speed camera to capture and compare the anomalies in the entire customized scene operation process, it is possible to quickly and effectively locate whether the problem is a problem with the underlying display or the upper-level display, avoiding manual deployment and manual testing, and also effectively improving the testing efficiency of display performance testing.

[0085] In one embodiment, the method provided in this application can be applied to a scenario of a display end-to-end testing system based on a combination of software and hardware. The following description uses a scenario of a display end-to-end testing system based on a combination of software and hardware as an example to illustrate the display performance testing method provided in this application.

[0086] Traditional display performance testing methods, such as basic optical testing and display stability anomaly detection, require manual deployment and testing, which consumes a lot of time and effort and easily leads to low testing efficiency.

[0087] Therefore, this application proposes a design method for a display end-to-end testing system based on a combination of hardware and software. Traditional basic optical parameter acquisition is purely hardware-based, and backlight curve measurement is performed separately, without highly integrated automated testing equipment, light boxes, etc., and is done manually. Furthermore, it cannot quickly and effectively pinpoint whether the display problem is at the lower or upper layer during anomaly detection. Therefore, this application proposes a design method for a display end-to-end testing system based on a combination of hardware and software, highly integrating hardware drivers, color analyzers, controllable light boxes, and high-speed cameras to form a complete hardware-software end-to-end automated display testing design scheme. Specifically, it integrates the driver with software scripts to connect the software and hardware testability of the device, and uses data post-processing to automatically calculate the test results. This application integrates an image anomaly detection post-processing algorithm, including six detection models. The entire design scheme effectively combines hardware and software, improving both the automation efficiency and the quantitative accuracy of the test.

[0088] like Figure 3 The diagram shown is an architecture diagram of a display end-to-end testing system based on a combination of software and hardware. Figure 3 The testing system integrates hardware and software modules, enabling parallel testing of various functions, including basic optical parameter measurement, automatic backlight curve measurement, customized upper-layer display MTBF operation, brightness sequence post-processing (screen flicker), and display anomaly detection algorithm post-processing. Figure 3 The hardware module integrates a multi-station machine, a color analyzer, a controllable lightbox, and a high-speed camera, all controlled by the same set of driver code. A PLC drives a conveyor belt for transmission, carrying the color analyzer, which is controlled by software to perform basic optical parameter measurements. The controllable lightbox in the hardware module controls the ambient light illuminance and color temperature changes, and can be used for automated backlight curve testing. The high-speed camera in the hardware module has adjustable sampling rate and resolution. Controlled by the software, the high-speed camera records and captures images of the test machine's display interface, sending the captured images to a display anomaly detection algorithm for post-processing, enabling the detection of display anomalies. The software module integrates ambient light control, basic optical parameter measurement, automatic backlight curve measurement, customized upper-layer display MTBF operation, brightness sequence post-processing algorithms, and display anomaly detection algorithms. Specifically, the brightness sequence post-processing (screen flickering) in this application is used to intercept flickering / high-brightness anomalies caused by software or hardware malfunctions in fingerprint unlocking scenarios, such as a sudden momentary high brightness on the screen during a user's fingerprint unlock. The purpose of multi-station testing equipment is to serve as an auxiliary testing fixture, thereby achieving consistency in the testing environment and reducing manpower input.

[0089] Furthermore, in addition to integrating four hardware devices—a multi-station testing platform, a color analyzer, a controllable lightbox, and a high-speed camera—the hardware module in this application can also integrate other hardware devices, such as a robotic arm, to achieve asynchronous and synchronous testing tasks. In contrast, in traditional technologies, each device has a different testing object and function, and its driver is also different.

[0090] 1. Basic Optical Parameter Measurement Scheme

[0091] like Figure 4 The diagram shows a flowchart of the basic optical parameter measurement process. This solution incorporates a color analyzer as hardware. The color analyzer's driver is integrated into the software script control module, and pre-configured interfaces for the optical parameters to be measured, such as luminance, chromaticity, NTSC, and gamma, are provided for use. During the execution of the software script, a synchronization mechanism controls the process. By switching different display modes on the test machine through the software script, the color analyzer is invoked for measurement, and the test results are retrieved.

[0092] Specifically, in such Figure 4 In the flowchart shown for basic optical parameter measurement, the test phone is first connected to a data cable, with the center of its screen placed under the color analyzer. The first step involves adding WRGB images to the image library while simultaneously adjusting the screen brightness to its maximum value. In this application, the image library is used as an auxiliary tool for testing. The main thread of the test script will automatically acquire test resources from the image library. Adjusting the screen brightness to its maximum value ensures the accuracy and consistency of the test data. That is, the test phone can automatically acquire test images from the image library and call the color analyzer to test each test image. The test images can be solid color test images.

[0093] For example, Figure 4 After the test phone enters the gallery, it displays the corresponding WRGB images. The WRGB images refer to four test images, namely pure color test images of white, red, green and blue, so that the test phone can call the color analyzer to test the basic optical parameters of these typical colors. Figure 4 The process involves calculating the NTSC values ​​of R, G, and B and determining whether they are within a threshold. This process involves testing the color gamut of each image under pure red, green, and blue test images. NTSC refers to color gamut; for example, testing the display color gamut under a red interface. Figure 4 The power button in the settings is used to turn the screen on and off to simulate real-world user scenarios and test whether system anomalies occur before and after the screen is turned on and off, thus allowing for scenario calibration. Figure 4 The various colored images in the video are all used as test images.

[0094] Compared to traditional technologies where the acquisition of basic optical parameters is typically purely hardware-based, the acquisition method in this application combines software simulation of switching to different color modes to acquire optical parameters. This connects the hardware's basic optical parameter acquisition with the software, achieving end-to-end automated testing of the phone's hardware, drivers, and system settings. For example, the test script automatically sets the phone's current color mode to vivid mode, and the main thread sends a command to the color analyzer to acquire the basic optical parameters for this color mode. This allows the color analyzer to acquire the corresponding parameters for vivid mode. The script then automatically switches to other display modes and initiates the acquisition of basic optical parameters from the color analyzer again, repeating this cycle to achieve end-to-end automated testing of the phone's hardware, drivers, and system settings.

[0095] 2. Automatic Backlight Curve Measurement Solution

[0096] This solution is designed to integrate a custom-designed controllable lightbox and a color analyzer. By controlling the lightbox's driver, brightness and color temperature can be automatically adjusted. The lightbox driver is integrated into a software script module. Selecting the corresponding backlight setting in the software script initiates ambient light configuration. Simultaneously, the color analyzer moves to the center of the test machine screen to collect brightness data, thereby obtaining a screen backlight curve that changes with ambient light. Key acceptance points are set on this curve for threshold judgment.

[0097] In this application, the critical acceptance point can be set to the response time. Setting the critical acceptance point is to add the key acceptance indicators to the curve. When the test script runs, it can automatically determine whether the curve meets the initially preset key indicators and automatically make a pass or fail conclusion.

[0098] Compared to traditional methods where backlight curve measurement is performed separately without highly integrating automated equipment and light boxes, and is done manually, the testing system in this application can automatically determine whether the curve meets the initially preset key indicators by running the test script corresponding to the backlight curve measurement task, and automatically make a pass or fail conclusion, thus realizing end-to-end automated testing of mobile phone hardware, drivers, and system settings.

[0099] 3. Post-processing test plan for displaying anomaly detection algorithm

[0100] like Figure 5The diagram illustrates the post-processing flow for display anomaly detection. The test phone runs a software script. The main thread of the script performs customized upper-layer display MTBF operations, including scenarios involving permutations and combinations of display features, and simulating daily user operations with the top application. The script also runs three separate threads: one thread controls a high-speed camera to record the entire interface of the test phone's running software script and sends the captured images to the display anomaly detection post-processing algorithm; another thread simultaneously controls the test phone to take screenshots and record the screen on the software, processing the captured images and video streams by frame extraction before sending them to the algorithm; and the third thread simultaneously captures the test phone's log data, matches and filters error keys in real time, and saves the error logs. The display anomaly detection algorithm is based on the Keras + Tensorflow framework and can detect several types of anomalies, including screen tearing, white screen, green screen, blurriness, stripes, and tearing. The display anomaly detection post-processing algorithm can be deployed on a server.

[0101] In such Figure 5 The flowchart shown includes the following key points in the post-detection processing of display anomalies:

[0102] 1.) The software scripts need to cover customized scenarios: upper-layer customized MTBF scenarios, such as the permutation and combination of display features, and the top application simulating the user's daily operation scenarios;

[0103] 2.) The entire customized scene operation process is captured using a high-speed camera. The sampling rate of the high-speed camera is adjustable, and the recorded images are post-processed using a display anomaly detection algorithm.

[0104] 3.) Screen recording, screenshots, and high-speed camera comparisons can quickly pinpoint whether the problem lies with the underlying or upper-level display.

[0105] In the display anomaly detection scheme of this application, by using screen recording, screenshots, and high-speed camera to capture the entire customized scene operation process for anomaly comparison, it is possible to quickly and effectively locate whether the underlying display problem or the upper-layer display problem is a problem. When the screen recording of the test phone can be recorded, but the screenshot cannot be captured, it can be located to be a problem with the underlying driver or hardware of the phone. If the screenshot can be captured, regardless of whether the external camera can record, it is highly likely to be a problem with the upper-layer display.

[0106] Taking the Android system as an example, the underlying display problems in this application include problems with the Android driver or the screen hardware itself; the upper-layer display problems refer to display services above Hall or GPU-related display problems in the Android architecture.

[0107] The beneficial effects produced in the embodiments of this application include:

[0108] (1) By building a laboratory environment with highly integrated device-driven control scripts, we can establish a more comprehensive, professional and efficient basic optical testing and display stability anomaly detection, benchmarking against professional display testing institutions at home and abroad;

[0109] (2) An Arduino-based embedded driver board PLC controls a multi-station customized machine tool and communicates with a color analyzer to achieve mechanical automation.

[0110] (3) Based on the color analyzer driver, secondary development is carried out to achieve 100% automation of each optical measurement item through control driver and packaging, and to automatically generate a complete test report.

[0111] (4) Based on Uiautomator2.0, implement node commands, simulate user switching modes through controls, customize system MTBF scenarios and synchronous log capture in another thread, and integrate and package test images and videos into APK. From the Debug user scenario, we can jointly achieve the coverage of the underlying driver settings and link the display parameter verification in each mode to open up the software and hardware links.

[0112] (5) A screen flickering detection algorithm based on the Keras & Tensorflow framework, equipped with high-speed camera recording, combined with software script upper-level customized MTBF scene and synchronous log capture, realizes automated random scene screen flickering detection, as well as quick location of whether the problem is a low-level display problem or an upper-level display problem.

[0113] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0114] Based on the same inventive concept, this application also provides a display performance testing apparatus for implementing the display performance testing method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more display performance testing apparatus embodiments provided below can be found in the limitations of the display performance testing method described above, and will not be repeated here.

[0115] In one embodiment, such as Figure 6 As shown, a display performance testing device is provided, comprising: an acquisition module 602, a determination module 604, a running module 606, and a calling module 608, wherein:

[0116] Module 602 is used to acquire display performance test tasks.

[0117] The determination module 604 is used to control a multi-station machine to determine the target test equipment based on the display performance test task; wherein the multi-station machine is used to hold at least two test equipment.

[0118] The running module 606 is used to switch the screen of the target test device to different display modes based on the configuration items in the software script during the execution of the software script corresponding to the optical parameter measurement task if the display performance test task is an optical parameter measurement task.

[0119] Module 608 is used to call the color analyzer to measure different display modes and obtain corresponding test results; the color analyzer is used to measure optical parameters.

[0120] In one embodiment, the device further includes an adjustment module, a switching module, and a generation module.

[0121] The adjustment module is used to adjust the color mode of the current screen of the target test device to vivid mode, and send a command to the color analyzer to collect optical parameters, so that the color analyzer collects the optical parameters in vivid mode to obtain the first optical parameters in vivid mode; the switching module is used to switch the current screen of the target test device to other display modes, and send a command to the color analyzer to collect optical parameters, so that the color analyzer collects the optical parameters in the other display modes to obtain the second optical parameters in the other display modes; the generation module is used to generate a test report corresponding to the optical parameter measurement task based on the first optical parameters and the second optical parameters.

[0122] In one embodiment, the device further includes a configuration module.

[0123] The acquisition module is also used to acquire each optical parameter that needs to be measured in the optical parameter measurement task; the configuration module is used to configure the interface number corresponding to each optical parameter, and obtain the optical parameter interface corresponding to each optical parameter, so that the corresponding optical parameter can be obtained by calling the optical parameter interface.

[0124] In one embodiment, the running module is further configured to, if the display performance test task is a backlight curve measurement task, call a controllable light box to set the ambient light based on the backlight setting item in the software script during the execution of the software script corresponding to the backlight curve measurement task, so as to obtain the ambient light corresponding to the backlight setting item; wherein, the controllable light box is used to control the illuminance and color temperature changes of the ambient light; the calling module is further configured to call the color analyzer to move to the center position of the screen of the target test device to collect brightness, so as to obtain the screen backlight curve corresponding to the change of the ambient light; the determining module is further configured to determine whether the screen backlight curve meets the preset key indicators according to the preset key acceptance points, and generate the corresponding test results.

[0125] In one embodiment, the device further includes a control module and a grasping module.

[0126] The running module is further configured to, if the display performance test task is a display anomaly detection task, execute customized upper-level display operations through the main thread of the software script during the execution of the software script corresponding to the display anomaly detection task. The upper-level display operations are used to simulate daily user operation scenarios. The calling module is further configured to call a high-speed camera through the first sub-thread of the software script to capture the display interface of the running software script of the target test device and obtain a corresponding first image. The control module is configured to synchronously control the target test device to perform screenshot and screen recording operations through the second sub-thread of the software script and obtain a corresponding second image. The capturing module is configured to synchronously capture the log information of the target test device through the third sub-thread of the software script. The generating module is further configured to generate a corresponding test report based on the first image, the second image, and the log information.

[0127] In one embodiment, the device further includes a detection module and a screening module.

[0128] The detection module is used to detect the first image and obtain a corresponding first detection result; and to detect the second image and obtain a corresponding second detection result; the filtering module is used to filter the log information and obtain corresponding error log information; the generation module is also used to generate a corresponding detection report based on the first detection result, the second detection result, and the error log information.

[0129] Each module in the aforementioned display performance testing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0130] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 7 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a display performance testing method. The display unit of the computer device is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0131] Those skilled in the art will understand that Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0132] This application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, which, when executed by one or more processors, cause the processors to perform the steps of a display performance testing method.

[0133] This application also provides a computer program product containing instructions that, when run on a computer, cause the computer to perform a display performance testing method.

[0134] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0135] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0136] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0137] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for testing display performance, characterized in that, The method, applied to a display end-to-end testing system based on a combination of software and hardware, includes: Obtain display performance test tasks; Based on the display performance test task, the multi-station machine tool is controlled to determine the target test equipment; wherein, the multi-station machine tool is used to hold at least two test equipment. If the display performance test task is an optical parameter measurement task, then during the execution of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the screen of the target test device is switched to different display modes, and a color analyzer is called to measure the different display modes to obtain the corresponding test results; wherein, the color analyzer is used to measure optical parameters; Before obtaining the display performance test task, the method further includes: Obtain the optical parameters that need to be measured in the optical parameter measurement task; Configure the interface number corresponding to each optical parameter to obtain the optical parameter interface corresponding to each optical parameter, so that the corresponding optical parameter can be obtained by calling the optical parameter interface; After controlling the multi-station machine to determine the target testing equipment based on the display performance testing task, the method further includes: If the display performance test task is a backlight curve measurement task, then during the execution of the software script corresponding to the backlight curve measurement task, based on the backlight setting item in the software script, the controllable light box is called to set the ambient light so as to obtain the ambient light corresponding to the backlight setting item; wherein, the controllable light box is used to control the illuminance and color temperature changes of the ambient light; The color analyzer is moved to the center of the screen of the target test device to collect brightness data, and the screen backlight curve corresponding to the change of ambient light is obtained. Based on the preset key acceptance points, determine whether the screen backlight curve meets the preset key indicators and generate the corresponding test results; After controlling the multi-station machine to determine the target testing equipment based on the display performance testing task, the method further includes: If the display performance test task is a display anomaly detection task, then during the execution of the software script corresponding to the display anomaly detection task, a customized upper-level display operation is run through the main thread of the software script. The upper-level display operation is used to simulate the user's daily operation scenario. The first sub-thread of the software script calls the high-speed camera to capture the display interface of the running software script of the target test device, thereby obtaining the corresponding first image. The second sub-thread of the software script synchronously controls the target test device to perform screenshot and screen recording operations, thereby obtaining the corresponding second image. The third sub-thread of the software script synchronously captures the log information of the target test device; Based on the first image, the second image, and the log information, a corresponding detection report is generated.

2. The method according to claim 1, characterized in that, If the display performance test task is an optical parameter measurement task, then during the execution of the software script corresponding to the optical parameter measurement task, based on the configuration items in the software script, the screen of the target test device is switched to different display modes, and a color analyzer is called to measure the different display modes to obtain the corresponding test results, including: The color mode of the target test device's current screen is adjusted to vivid mode, and a command is sent to the color analyzer to collect optical parameters, so that the color analyzer collects the optical parameters in vivid mode and obtains the first optical parameters in vivid mode. The vivid mode of the current screen of the target test device is switched to another display mode, and a command is sent to the color analyzer to collect optical parameters, so that the color analyzer collects the optical parameters in the other display mode and obtains the second optical parameters in the other display mode. Based on the first optical parameter and the second optical parameter, a test report corresponding to the optical parameter measurement task is generated.

3. The method according to claim 1, characterized in that, The step of generating a corresponding detection report based on the first image, the second image, and the log information includes: The first image is detected to obtain the corresponding first detection result; The second image is then inspected to obtain the corresponding second inspection result; The log information is filtered to obtain the corresponding error log information; Based on the first detection result, the second detection result, and the error log information, a corresponding detection report is generated.

4. A display performance testing device, characterized in that, For applications in display end-to-end testing systems based on a combination of software and hardware, the device includes: The acquisition module is used to acquire display performance test tasks; The determination module is used to control a multi-station machine to determine the target test equipment based on the display performance test task; wherein the multi-station machine is used to hold at least two test equipment. The running module is used to switch the screen of the target test device to different display modes based on the configuration items in the software script during the execution of the software script corresponding to the optical parameter measurement task if the display performance test task is an optical parameter measurement task. The calling module is used to call the color analyzer to measure different display modes and obtain corresponding test results; wherein, the color analyzer is used to measure optical parameters; The device further includes: a configuration module; The acquisition module is also used to acquire the optical parameters that need to be measured in the optical parameter measurement task; The configuration module is used to configure the interface number corresponding to each optical parameter, and obtain the optical parameter interface corresponding to each optical parameter, so that the corresponding optical parameter can be obtained by calling the optical parameter interface; The running module is also used to, if the display performance test task is a backlight curve measurement task, call a controllable light box to set the ambient light based on the backlight setting item in the software script during the running of the software script corresponding to the backlight curve measurement task, so as to obtain the ambient light corresponding to the backlight setting item; wherein, the controllable light box is used to control the illuminance and color temperature changes of the ambient light. The calling module is also used to call the color analyzer to move to the center position of the screen of the target test device to collect brightness and obtain the screen backlight curve corresponding to the change of ambient light. The determining module is also used to determine whether the screen backlight curve meets the preset key indicators based on the preset key acceptance points, and generate the corresponding test results. The device also includes a control module, a generation module, and a grasping module; The running module is also used to run customized upper-level display operations through the main thread of the software script during the running of the software script corresponding to the display anomaly detection task if the display performance test task is a display anomaly detection task. The upper-level display operations are used to simulate the user's daily operation scenarios. The calling module is also used to call the high-speed camera to capture the running software script display interface of the target test device through the first sub-thread of the software script to obtain the corresponding first image; The control module is used to synchronously control the target test device to perform screenshot and screen recording operations through the second sub-thread of the software script, so as to obtain the corresponding second image. The capture module is used to synchronously capture the log information of the target test device through the third sub-thread of the software script; The generation module is used to generate a corresponding detection report based on the first image, the second image, and the log information.

5. An electronic device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the computer program is executed by the processor, the processor performs the steps of the display performance testing method as described in any one of claims 1 to 3.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 3.

7. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 3.

Images