Screen display effect detection method, device and equipment

By automatically comparing the values ​​of the kernel layer registers of the terminal device with image features, the problem of relying on subjective human judgment for detecting the screen display effect of the terminal device is solved, and highly accurate automatic detection is achieved.

CN115222714BActive Publication Date: 2026-01-13SPREADTRUM COMMUNICATION (SHANGHAI) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210897746.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-28
Publication Date
2026-01-13
Estimated Expiration
2042-07-28

AI Technical Summary

Technical Problem

In existing technologies, the detection of the display effect of terminal device screens relies on subjective judgment by the human eye, resulting in low accuracy and wasted manpower.

Method used

By obtaining the values ​​of the kernel layer registers of the test device, turning on the corresponding switches for screen display effects, comparing the changes in values, and combining the image features of screenshots and returned images, the system can automatically determine whether the screen display effect is normal.

Benefits of technology

It improves the accuracy of screen display effect detection, saves manpower, and increases detection efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115222714B_ABST
    Figure CN115222714B_ABST
Patent Text Reader

Abstract

The application provides a screen display effect detection method, device and equipment, the method comprising: obtaining the value of a register in the kernel layer of a test device, obtaining a first value; turning on the switch corresponding to any one of the screen display effects of the test device; obtaining the value of the register in the kernel layer again, obtaining a second value; if the first value is the same as the second value, determining that the screen display effect is abnormal; if the first value is different from the second value, determining the screen display effect currently turned on by the test device; obtaining the screenshot of the test device and the back image of the test device; the back image is the image returned from the display processor to the memory of the test device; for any one of the screen display effects currently turned on by the test device, determining whether the screen display effect is normally displayed according to the image features of the screenshot and the back image. In this way, it can be determined whether the screen display effect is normally displayed, the detection accuracy is improved, and manpower is saved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a method, apparatus and device for detecting screen display effects. Background Technology

[0002] With the continuous development of core technologies such as communication and chips, the types and numbers of terminal devices are gradually increasing. Due to the inconsistent quality of terminal device screens, related technologies typically rely on Picture Quality (PQ) modules to provide various screen display effects in order to improve image display quality.

[0003] When testing screen display effects, related technologies often rely on subjective judgment by human eyes, resulting in a waste of manpower and low testing accuracy. Summary of the Invention

[0004] This application provides a method, apparatus, and device for testing screen display effects, which improves the accuracy of screen display effect testing and saves manpower.

[0005] In a first aspect, embodiments of this application provide a method for detecting screen display effects, including:

[0006] Obtain the values ​​of the registers in the kernel layer of the test device to get the first value;

[0007] Turn on the switch corresponding to the display effect of any screen in the test device;

[0008] The values ​​of the registers in the kernel layer of the test device are obtained again to get the second value;

[0009] When the first value is the same as the second value, it is determined that the screen display effect is abnormal;

[0010] When the first value is different from the second value, determine the screen display effect currently enabled by the test device;

[0011] Obtain a screenshot of the test device and obtain the returned image from the test device; the returned image is the image returned by the test device from the display processor to the memory;

[0012] For any screen display effect currently enabled by the test device, determine whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image.

[0013] In one possible implementation, determining whether the screen display effect is normal based on the image features of the screenshot and the returned image includes:

[0014] Determine the first image features of the screenshot and the second image features of the returned image;

[0015] If the first image feature is the same as the second image feature, then the screen display effect is determined to be abnormal.

[0016] If the first image feature is different from the second image feature, then the screen display effect is determined to be normal.

[0017] In one possible implementation, determining that the screen display effect is normal if the first image feature is different from the second image feature includes:

[0018] When the first image feature is different from the second image feature, determine the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the test device;

[0019] When the difference between the desired adjustment ratio and the actual adjustment ratio is less than a preset threshold, it is determined that the screen display effect is normal.

[0020] When the difference between the desired adjustment ratio and the actual adjustment ratio is equal to or greater than a preset threshold, the screen display effect is determined to be abnormal.

[0021] In one possible implementation, determining the desired adjustment ratio of the screen display effect and the actual adjustment ratio of the test device includes:

[0022] Based on the expected value corresponding to the screen display effect and the default value of the test device, determine the expected adjustment ratio corresponding to the screen display effect;

[0023] Based on the first image features and the second image features, the actual adjustment ratio of the test equipment is determined.

[0024] In one possible implementation, the method further includes:

[0025] Based on the current test scenario and a preset correspondence, the target light source brightness corresponding to the current test scenario is determined; the preset correspondence includes the correspondence between different test scenarios and different light source brightnesses.

[0026] Adjust the ambient light source to the brightness of the target light source.

[0027] Secondly, embodiments of this application provide a screen display effect detection device, comprising:

[0028] The first acquisition module is used to acquire the value of the register in the kernel layer of the test device to obtain the first value;

[0029] The activation module is used to activate the switch corresponding to the display effect of any screen in the test device.

[0030] The second acquisition module is used to acquire the value of the register in the kernel layer of the test device again to obtain the second value;

[0031] The first determining module is used to determine that the screen display effect is abnormal when the first value is the same as the second value.

[0032] The second determining module is used to determine the screen display effect currently enabled by the test device when the first value is different from the second value.

[0033] The third acquisition module is used to acquire a screenshot of the test device and acquire the returned image of the test device; the returned image is an image that the test device returns from the display processor to the memory;

[0034] The third determining module is used to determine whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image for any screen display effect currently enabled by the test device.

[0035] In one possible implementation, the third determining module is specifically used for:

[0036] Determine the first image features of the screenshot and the second image features of the returned image;

[0037] If the first image feature is the same as the second image feature, then the screen display effect is determined to be abnormal.

[0038] If the first image feature is different from the second image feature, then the screen display effect is determined to be normal.

[0039] In one possible implementation, the third determining module is specifically used for:

[0040] When the first image feature is different from the second image feature, the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the test device are determined.

[0041] When the difference between the desired adjustment ratio and the actual adjustment ratio is less than a preset threshold, it is determined that the screen display effect is normal.

[0042] When the difference between the desired adjustment ratio and the actual adjustment ratio is equal to or greater than a preset threshold, the screen display effect is determined to be abnormal.

[0043] In one possible implementation, the third determining module is specifically used for:

[0044] Based on the expected value corresponding to the screen display effect and the default value of the test device, determine the expected adjustment ratio corresponding to the screen display effect;

[0045] Based on the first image features and the second image features, the actual adjustment ratio of the test equipment is determined.

[0046] In one possible implementation, the device further includes:

[0047] The fourth determining module is used to determine the target light source brightness corresponding to the current test scenario based on the current test scenario and a preset correspondence; the preset correspondence includes the correspondence between different test scenarios and different light source brightness.

[0048] An adjustment module is used to adjust the ambient light source to the brightness of the target light source.

[0049] Thirdly, embodiments of this application provide a screen display effect testing device, including: a processor and a memory;

[0050] The memory stores computer-executed instructions;

[0051] The processor executes computer execution instructions stored in the memory to implement the method as described in any of the first aspects.

[0052] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed, are used to implement the method described in any of the first aspects.

[0053] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed, implements the method described in any of the first aspects.

[0054] Sixthly, embodiments of this application provide a chip on which a computer program is stored, and when the computer program is executed by the chip, it implements the method described in any of the first aspects.

[0055] In a seventh aspect, embodiments of this application provide a chip module on which a computer program is stored. When the computer program is executed by the chip, it implements the method described in any of the first aspects.

[0056] The screen display effect detection method, apparatus, and device provided in this application embodiment obtain the value of the register in the kernel layer of the test device to obtain a first value; turn on the switch corresponding to any screen display effect in the test device; obtain the value of the register in the kernel layer of the test device again to obtain a second value; when the first value and the second value are the same, it is determined that the screen display effect is abnormal; when the first value and the second value are different, it is determined that the screen display effect currently enabled by the test device is the one that is being tested; obtain a screenshot of the test device and obtain the returned image of the test device; the returned image is the image returned by the test device from the display processor to the memory; for any screen display effect currently enabled by the test device, it is determined whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image. In this way, it is possible to accurately determine whether the screen display effect is displayed normally, improving the accuracy of detection and saving manpower. Attached Figure Description

[0057] Figure 1 This is a schematic diagram illustrating an application scenario provided in the embodiments of this application;

[0058] Figure 2 A logical diagram of a screen display provided for an embodiment of this application;

[0059] Figure 3 A flowchart illustrating a screen display effect detection method provided in an embodiment of this application;

[0060] Figure 4 A flowchart illustrating another screen display effect detection method provided in this application embodiment;

[0061] Figure 5 This is a schematic diagram of a test environment according to an embodiment of this application;

[0062] Figure 6 This is a schematic diagram of a screenshot and a returned image according to an embodiment of this application;

[0063] Figure 7 This is a schematic diagram illustrating the execution logic of a screen display effect detection method provided in an embodiment of this application.

[0064] Figure 8 This is a schematic diagram of the structure of a screen display effect testing device provided in an embodiment of this application;

[0065] Figure 9 This is a schematic diagram of the structure of a screen display effect testing device provided in an embodiment of this application. Detailed Implementation

[0066] To enable those skilled in the art to better understand the technical solutions of this application, the application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments and drawings described herein are merely for explaining this application and are not intended to limit this application.

[0067] Figure 1 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application. Please refer to [link / reference]. Figure 1 The system includes a testing terminal 101 and a testing device 102 (DUT). The testing terminal 101 can refer to a terminal device used to test the various functions of the testing device 102, specifically a personal computer (PC), such as a desktop, laptop, or tablet computer, or other smart terminal devices; this embodiment does not limit the specific type of testing device 102. The testing device 102 can specifically refer to the terminal device to be tested, specifically a mobile phone, wearable device, etc.; this embodiment also does not limit the specific type of testing device 102.

[0068] Because different terminal devices have varying screen qualities, poor image quality may occur when displaying images. Related technologies typically rely on screen quality modules (PQ modules) to provide various screen display effects, thereby improving image quality and enhancing the user's viewing experience.

[0069] For example, Figure 2 This illustration shows a logical diagram of an image display provided in an embodiment of this application. For example... Figure 2 As shown, the central processing unit (CPU) of test device 102 first caches the image in memory, which can be Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), etc. Then, test device 102 loads the image from the DDR memory into the Display Processing Unit (DPU) module for back-end image processing. The DPU module may include multiple PQ modules, capable of providing various screen display effects. After the image back-end processing, the DPU module sends the image to the display, ultimately displaying the image on the screen of test device 102.

[0070] In related technologies, various parameter indicators of an image are usually detected based on screenshots. However, when detecting screen display effects, screenshots taken from the test device 102 can only capture the image in memory, not the image in the DPU module of the image backend processing section. Therefore, the screenshots do not reflect the various screen display effects in the PQ module. Thus, since the screen display effect cannot be obtained from screenshots, related technologies often rely on subjective judgment of the screen display effect by human eyes, which is both wasteful of manpower and has low accuracy.

[0071] In this embodiment, the detection terminal obtains the value of the register in the kernel layer of the test device to obtain a first value; turns on the switch corresponding to any screen display effect in the test device; obtains the value of the register in the kernel layer of the test device again to obtain a second value; when the first value and the second value are the same, it is determined that the screen display effect is abnormal; when the first value and the second value are different, it is determined that the screen display effect currently enabled by the test device is being tested; a screenshot of the test device is obtained, and a returned image of the test device is obtained; the returned image is the image returned by the test device from the display processor to the memory; for any screen display effect currently enabled by the test device, it is determined whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image. In this way, by first determining whether the kernel layer PQ module is enabled after the upper layer switch is turned on, it is determined whether the path from the APP layer to the kernel layer is normal. Then, by comparing the image features of the screenshot and the returned image, it is possible to accurately determine whether the screen display effect is displayed normally, which improves the accuracy of detection and saves manpower.

[0072] The solution presented in this application will now be described in detail through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; identical or similar content will not be repeated in different embodiments.

[0073] Below, in conjunction with Figure 3 The illustrated embodiment explains the process of screen display effect detection.

[0074] Figure 3 This is a schematic flowchart illustrating a screen display effect detection method provided in an embodiment of this application. Please refer to... Figure 3 The method may include:

[0075] S301. Obtain the value of the register in the kernel layer of the test device to get the first value.

[0076] In this embodiment of the application, when testing the screen display effect, the testing terminal can first determine whether the path from the application layer (APP) to the kernel layer (Kernel) of the test device is normal, that is, confirm whether the register value of the PQ module in the kernel layer (or bottom layer) of the test device changes after the interactive switch (User Interface, UI switch) corresponding to the PQ module is turned on in the application layer (or upper layer).

[0077] The first value can refer to the value of the kernel layer register of the test device in its initial state. Specifically, the testing terminal can first send a command to the test device to query the value corresponding to the PQ module in the kernel layer register, and obtain the first value, which can be denoted as M1.

[0078] S302. Turn on the switch corresponding to the display effect of any screen in the test device.

[0079] In this embodiment, the application layer of the testing device can be configured with UI switches corresponding to various screen display effects, such as an eye protection mode switch. The testing terminal can automatically turn on the UI switch corresponding to any screen display effect on the testing device via a preset script. This preset script can refer to a UIA automation script, and UIA can refer to the Android UI automation framework UIAutomator2. Of course, the preset script can also be implemented based on other frameworks, and this embodiment does not limit it.

[0080] S303. Obtain the value of the register in the kernel layer of the test device again to get the second value.

[0081] In this embodiment of the application, after the detection terminal turns on any UI switch in the test device, it can send an instruction to the test device again to query the value corresponding to the PQ module in the kernel layer register and obtain the second value, which can be recorded as M2.

[0082] S304. When the first value is the same as the second value, it is determined that the screen display effect is abnormal.

[0083] In this embodiment, if the path from the application layer to the kernel layer is normal, the register value corresponding to the PQ module in the kernel layer will change after the detection terminal turns on the UI switch in the test device. Based on this, after determining the first value M1 and the second value M2, the detection terminal can determine whether they are the same. If the first value M1 and the second value M2 are the same, it indicates that after the detection terminal turns on the UI switch in the application layer of the test device, the kernel layer has not adjusted the register value to turn on the PQ module. At this time, it can be determined that the PQ module is not effective, and the screen display effect corresponding to the UI switch is abnormal. In this way, by detecting and comparing the register values ​​in the kernel layer, the accuracy of screen display effect detection is improved. At the same time, once it is determined that the two are the same, the abnormal screen display effect can be determined without further detection, which also improves detection efficiency.

[0084] S305. When the first value and the second value are different, determine the screen display effect currently enabled by the test device.

[0085] In this embodiment, when the first value M1 and the second value M2 are different, the detection terminal can determine that the path from the application layer to the kernel layer register of the PQ module is normal. At this time, the detection terminal determines the current screen display effect of the test device, and can subsequently judge whether the screen display effect is normal. It should be noted that the PQ module may correspond to one or more registers in the kernel layer, which can be set according to actual needs, and this embodiment does not limit this.

[0086] In this embodiment, each PQ module can correspond to a screen display effect. The test device may have one or more PQ modules enabled, corresponding to one or more screen display effects. When detecting whether the screen display effect is displayed correctly, the testing terminal can determine the currently enabled PQ module of the test device, i.e., determine the currently enabled screen display effect, based on the second value M2 or the historical operation records of the UI switches.

[0087] S306. Obtain a screenshot of the test device and obtain the returned image from the test device; the returned image is the image returned by the test device from the display processor to the memory.

[0088] In this embodiment, a screenshot can refer to an image captured directly from the memory of the test device, excluding the screen display effect. A returned image can refer to an image that includes the screen display effect and is returned from the display processor (DPU) module to the memory by the test device.

[0089] In this step, the detection terminal can send instructions to the testing device to capture screenshots in memory; then, based on the image backhaul function, the testing device backhauls the image after image backend processing in the DPU module to memory, so that the detection terminal can capture the backhauled image in memory through specific instructions.

[0090] S307. For any screen currently displayed on the test device, determine whether the screen display is normal based on the image characteristics of the screenshot and the transmitted image.

[0091] In this embodiment of the application, after the detection terminal obtains the screenshot and the returned image, it can determine the image features of the screenshot and the returned image, compare the image features, and determine whether the screen display effect is normal based on the comparison result.

[0092] The screen display effect detection method provided in this application embodiment involves: a detection terminal acquiring the value of a register in the kernel layer of a test device to obtain a first value; turning on the switch corresponding to any screen display effect in the test device; acquiring the value of the register in the kernel layer of the test device again to obtain a second value; determining that the screen display effect is abnormal when the first value and the second value are the same; determining the currently enabled screen display effect of the test device when the first value and the second value are different; acquiring a screenshot of the test device and acquiring a returned image from the test device; the returned image is an image returned from the display processor to the memory by the test device; and determining whether the screen display effect is normal for any currently enabled screen display effect of the test device based on the image features of the screenshot and the returned image.

[0093] Based on any of the above embodiments, the following, in conjunction with Figure 4 The illustrated embodiment provides a detailed description of the screen display effect detection process.

[0094] Figure 4 This is a flowchart illustrating another screen display effect detection method provided in an embodiment of this application. Please refer to... Figure 4 The method may include:

[0095] S401. Determine the target light source brightness corresponding to the current test scenario based on the current test scenario and the preset correspondence; the preset correspondence includes the correspondence between different test scenarios and different light source brightness; adjust the ambient light source to the target light source brightness.

[0096] In this embodiment, the test scenario refers to different simulated scenarios used when testing the test equipment, and the test scenario can correspond to a real-world environment. Specifically, the test scenario can include a nighttime scenario, an office scenario, an outdoor scenario, etc., where a nighttime scenario corresponds to a completely dark environment, an office scenario corresponds to a softly lit environment, and an outdoor scenario corresponds to a brightly lit environment. The current test scenario refers to the simulated scenario currently corresponding to the test equipment, determined by the detection terminal based on input commands or default settings. The preset correspondence can refer to a pre-set mapping relationship between different test scenarios and different light source brightness.

[0097] The target light source brightness can refer to the light source brightness corresponding to the current test environment. In this embodiment, the light source brightness can be adjusted based on the light source device, which can be a light box including multiple lamps, etc. The brightness of the light source can correspond to the number of lamps turned on in the light box; the more lamps turned on in the light box, the higher the brightness of the light source. Of course, depending on the type of light source device, the brightness of the light source can also be adjusted by parameters such as the output power and output current of the light source device. Specific adjustments can be flexibly made based on actual needs. This embodiment does not limit the specific type of light source device or the specific method of adjusting the light source brightness.

[0098] In this step, the testing terminal can pre-store preset correspondences between different test scenarios and different light source brightness levels. When testing equipment is required, the testing terminal can receive instructions to specify a test scenario and determine the current test scenario. These instructions can be input by the tester or generated by the testing terminal based on default settings. After determining the current test scenario, the testing terminal determines the target light source brightness corresponding to the current test scenario based on the preset correspondences. Then, the testing terminal sends instructions to the light source device. These instructions may include the number of lamps to be turned on or the required output power of the light source device. Subsequently, the light source device can adjust the ambient light source to the target light source brightness based on the instructions sent by the testing terminal.

[0099] In this embodiment, the detection terminal determines the brightness of the target light source based on the current test scenario and a preset correspondence, and adjusts the ambient light source to the brightness of the target light source. This achieves automatic adjustment of the test environment light source, meets the actual needs of screen display effect detection in multiple scenarios, and can improve the accuracy of screen effect detection to a certain extent.

[0100] For example, Figure 5 A schematic diagram of a test environment according to an embodiment of this application is shown. For example... Figure 5As shown, the test environment includes a detection terminal 501, a test device 502, and a light source device 503. The detection terminal 501 and the test device 502 are communicatively connected; the detection terminal 501 and the light source device 503 are also communicatively connected. The detection terminal 501 can send various commands to the test device 502 via an Android debug bridge (ADB). The test device 502 can send various data, such as register values ​​or images, to the detection terminal 501 via a Universal Serial Bus (USB). The detection terminal 501 can send commands to the light source device 503 via wired or wireless means to adjust the light source in the test environment.

[0101] Specifically, the detection terminal 501 can determine the current test scenario and the target light source brightness based on the current test scenario. Then, it sends an instruction to the light source device 503. The light source device 503 can adjust the test environment light source to the target light source brightness based on the instruction sent by the detection terminal 501, thereby realizing the automatic adjustment of the test environment light source. This can simulate various real environments and improve the comprehensiveness and accuracy of the detection.

[0102] S402. Obtain the value of the register in the kernel layer of the test device to get the first value.

[0103] S403. Turn on the switch corresponding to the display effect of any screen in the test device.

[0104] S404. Obtain the value of the register in the kernel layer of the test device again to get the second value.

[0105] S405. If the first value and the second value are the same, it is determined that the screen display effect is abnormal.

[0106] S406. If the first value and the second value are different, determine the screen display effect currently enabled by the test device.

[0107] S407. Obtain a screenshot of the test device and obtain the returned image from the test device; the returned image is the image returned by the test device from the display processor to the memory.

[0108] For example, Figure 6 This illustration shows a screenshot and a returned image according to an embodiment of this application. Figure 6 As shown, (1) is a screenshot, which can be an image directly captured from memory without including screen display effects. When the screen display effects in the test device are enabled ( Figure 6 After switching on the eye protection mode, the test device will activate the corresponding PQ module in the DPU module to add screen display effects. Figure 6(2) is the returned image after the screen display effect is turned on. The dotted diagonal line indicates that in eye protection mode, the PQ module reduces the blue tone of the image, so that the screen is displayed as amber (tending towards yellow).

[0109] S408. Determine the first image feature corresponding to the screenshot and the second image feature corresponding to the returned image.

[0110] In this embodiment, image features can refer to various parameter indicators corresponding to the image, such as the mean and variance of the three channels of hue, saturation, and value in the HSV color space. Of course, they can also be other image indicators such as hue and contrast; this embodiment does not limit this. The first image feature can refer to the image parameter indicators corresponding to a screenshot. The second image feature can refer to the image parameter indicators corresponding to a returned image.

[0111] Specifically, after acquiring the screenshot and the returned image, the detection terminal can convert both images from the RGB color space to the HSV color space. Then, the detection terminal calculates the mean and variance of the H, S, and V channels of the screenshot to obtain the first image feature; simultaneously, it calculates the mean and variance of the H, S, and V channels of the returned image to obtain the second image feature.

[0112] S409. If the first image feature is the same as the second image feature, then the screen display effect is determined to be abnormal.

[0113] S410. When the first image feature and the second image feature are not the same, determine the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the test device.

[0114] In this embodiment, the returned image is an image processed by the PQ module based on a screenshot, meaning that a screen display effect is added to the returned image. Furthermore, the screen display effect is often achieved by the PQ module adjusting a certain image feature of the screenshot. Based on this, if the PQ module is active, meaning the screen display effect can be displayed normally, then the second image feature of the returned image will contain at least one image feature that is different from the first image feature of the screenshot. If the PQ module is inactive, meaning the screen display effect cannot be displayed normally, then the PQ module has not adjusted the screenshot, and the second image feature of the returned image is the same as the first image feature of the screenshot.

[0115] In this step, after determining the first image feature of the screenshot and the second image feature of the returned image, the detection terminal compares the first and second image features. If the first and second image features are the same, the detection terminal can determine that the PQ module is not working and the screen display is abnormal. If the first and second image features are different, the detection terminal can determine that the PQ module is working and the screen display is normal.

[0116] Specifically, since the returned image is obtained by the DPU module of the testing device after backend image processing (e.g., processing by the PQ module) based on the screenshot, under normal screen display conditions, the returned image and the screenshot will differ in at least one image feature. Based on this, after determining the first image feature of the screenshot and the second image feature of the returned image, the detection terminal can compare the first and second image features. If the first and second image features are the same, the detection terminal can determine that the screen display is abnormal.

[0117] When the first image feature and the second image feature are different, the detection terminal can determine that a screen display effect exists. At this point, the detection terminal can further determine whether the actual display effect matches the function of the PQ module, i.e., the screen display effect, to improve the accuracy of screen display effect detection. The expected adjustment ratio refers to the expected adjustment ratio of the screen display effect corresponding to the PQ module for the image. This expected adjustment ratio can be calculated based on the expected value of the PQ module and the default value of the test equipment, and can be represented by N1. The actual adjustment ratio refers to the image adjustment ratio corresponding to the image actually displayed on the screen. This actual adjustment ratio can be determined based on the returned image and screenshot, and can be represented by N2.

[0118] In one possible implementation, S401 can be achieved as follows:

[0119] Based on the expected value corresponding to the screen display effect and the default value of the test device, determine the expected adjustment ratio corresponding to the screen display effect; based on the first image feature and the second image feature, determine the actual adjustment ratio of the test device.

[0120] In this embodiment, the expected value can refer to the adjustment parameter value in the PQ module corresponding to the screen display effect, and the default value can refer to the default value in the testing device. Based on the expected value and the default value, the testing device can determine the expected adjustment ratio corresponding to the screen display effect. For example, if the default value in the testing device is 1024 and the expected value in the screen quality module (PQ module) is 896, then the expected adjustment ratio can be (896-1024) / 1024, that is, the expected adjustment ratio is (-12.5%). It should be noted that the specific values ​​of the expected value and the default value corresponding to the screen display effect correspond to the specific PQ module, and may be different for different PQ modules. For example, the PQ module can be a color management module (CM), which can adjust the color changes of the displayed image, such as enhancing the image saturation. In this case, the default value can be determined based on the actual parameters such as the bit depth of the testing device. Of course, the PQ module can also be other types, and the corresponding expected value and default value can be determined based on the specific PQ module. This embodiment does not limit this.

[0121] Similarly, when calculating the actual adjustment ratio, the detection terminal can use a screenshot as a reference image and calculate the actual adjustment ratio based on the second image features of the returned image and the first image features of the screenshot. Of course, other methods can also be used to calculate the desired adjustment ratio and the actual adjustment ratio, or other methods can be used to characterize the adjustment ratio; this application embodiment does not limit this.

[0122] S411. When the difference between the expected adjustment ratio and the actual adjustment ratio is less than a preset threshold, the screen display effect is determined to be normal; when the difference between the expected adjustment ratio and the actual adjustment ratio is equal to or greater than the preset threshold, the screen display effect is determined to be abnormal.

[0123] In this embodiment, after determining the desired adjustment ratio N1 and the actual adjustment ratio N2, the detection terminal can determine their magnitudes. When the difference between N1 and N2 is less than a preset threshold, the detection terminal can determine that the actual image display effect matches the screen display effect corresponding to the PQ module, and the screen display effect is normal. When the difference between N1 and N2 is equal to or equal to the preset threshold, the detection terminal can determine that the actual image display effect does not match the screen display effect corresponding to the PQ module, and the screen display effect is abnormal. The specific value of the preset threshold can be 5%, 10%, etc., and can be set based on actual needs. This embodiment does not limit this setting.

[0124] In this embodiment, when the first image feature and the second image feature are different, the detection terminal determines the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the testing device; when the difference between the expected adjustment ratio and the actual adjustment ratio is less than a preset threshold, the screen display effect is determined to be normal; when the difference between the expected adjustment ratio and the actual adjustment ratio is equal to or greater than the preset threshold, the screen display effect is determined to be abnormal. Thus, by comparing the expected adjustment ratio and the actual adjustment ratio, it is possible to further determine whether the actual display effect of the image matches the function of the PQ module, improving the accuracy of screen display effect detection.

[0125] For example, Figure 7 This diagram illustrates the execution logic for screen display effect detection according to an embodiment of this application. Figure 7 As shown, the detection terminal first determines the target light source brightness based on the current test scenario, and then adjusts the light source device to that brightness, achieving automatic adjustment of the test environment's light source. Next, the detection terminal determines the value of the kernel layer register, denoted as the first value M1. Based on a preset script, the detection terminal activates any UI switch corresponding to a screen display effect, and then determines the value of the kernel layer register again, denoted as the second value M2. The detection terminal checks if the first value M1 and the second value M2 are the same. If they are the same, it can be determined that the PQ module is not working, and the screen display effect cannot be displayed normally. If the first value M1 and the second value M2 are different, the detection terminal can determine the currently activated screen display effect of the test device based on the second value. Then, the detection terminal can acquire a screenshot and a returned image, and determine the first image feature of the screenshot and the second image feature of the returned image. When the first image feature and the second image feature are the same, the detection terminal can determine that the screen display effect is abnormal. When the first image feature and the second image feature are different, the detection terminal can further determine the expected adjustment ratio N1 of the PQ module and the actual adjustment ratio N2 of the returned image relative to the screenshot. Then, the terminal device calculates the difference between the actual adjustment ratio N2 and the expected adjustment ratio N1. If the difference is greater than or equal to a preset threshold, the detection terminal can determine that the screen display effect is abnormal; if the difference is less than the preset threshold, the detection terminal can determine that the screen display effect is normal.

[0126] In this embodiment, after automatically turning on the UI switch of any PQ module, the system can automatically detect whether the corresponding PQ module in the register is in the enabled state. If the corresponding PQ module is enabled, the system automatically acquires the returned image and a screenshot using the image return function. The system compares the image features of the returned image and the screenshot to automatically determine whether the screen has a display effect and whether the display effect matches the function of the PQ module. This improves the accuracy of screen display effect detection, eliminates the need for subjective judgment, and saves manpower.

[0127] Figure 8 This is a schematic diagram of a screen display effect testing device provided in an embodiment of this application. Please refer to... Figure 8 The screen display effect detection device 10 may include:

[0128] The first acquisition module 11 is used to acquire the value of the register in the kernel layer of the test device to obtain the first value;

[0129] Module 12 is used to turn on the switch corresponding to the display effect of any screen in the test device.

[0130] The second acquisition module 13 is used to acquire the value of the register in the kernel layer of the test device again to obtain the second value;

[0131] The first determining module 14 is used to determine that the screen display effect is abnormal when the first value is the same as the second value.

[0132] The second determining module 15 is used to determine the screen display effect currently enabled by the test device when the first value and the second value are different.

[0133] The third acquisition module 16 is used to acquire a screenshot of the test device and acquire the returned image from the test device; the returned image is the image that the test device sends back from the display processor to the memory;

[0134] The third determining module 17 is used to determine whether the screen display effect is normal based on the image characteristics of the screenshot and the returned image for any screen display effect currently enabled by the test device.

[0135] The screen display effect detection device 10 provided in this application embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.

[0136] In one possible implementation, the third determining module 17 is specifically used for:

[0137] Determine the first image features of the screenshot and the second image features of the returned image;

[0138] If the first image feature is the same as the second image feature, then the screen display effect is determined to be abnormal.

[0139] If the first image features are different from the second image features, then the screen display effect is determined to be normal.

[0140] In one possible implementation, the third determining module 17 is specifically used for:

[0141] When the first image feature and the second image feature are different, determine the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the test device;

[0142] When the difference between the expected adjustment ratio and the actual adjustment ratio is less than a preset threshold, the screen display effect is determined to be normal.

[0143] If the difference between the expected adjustment ratio and the actual adjustment ratio is equal to or greater than a preset threshold, the screen display effect is determined to be abnormal.

[0144] In one possible implementation, the third determining module 17 is specifically used for:

[0145] Based on the expected values ​​corresponding to the screen display effect and the default values ​​of the test equipment, determine the expected adjustment ratio corresponding to the screen display effect;

[0146] Based on the first image features and the second image features, the actual adjustment ratio of the test equipment is determined.

[0147] In one possible implementation, the device 10 further includes:

[0148] The fourth determination module is used to determine the target light source brightness corresponding to the current test scenario based on the current test scenario and the preset correspondence; the preset correspondence includes the correspondence between different test scenarios and different light source brightness.

[0149] The adjustment module is used to adjust the ambient light source to the brightness of the target light source.

[0150] The screen display effect detection device 10 provided in this application embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here. The screen display effect detection device 10 can specifically be a chip, chip module, etc., and this application embodiment does not limit it.

[0151] Figure 9 This is a schematic diagram of a screen display effect testing device provided in an embodiment of this application. Please refer to... Figure 9 The screen display effect detection device 20 may include a memory 21 and a processor 22. For example, the memory 21 and the processor 22 are interconnected via a bus 23.

[0152] Memory 21 is used to store program instructions;

[0153] The processor 22 is used to execute the program instructions stored in the memory to implement the screen display effect detection method shown in the above embodiment.

[0154] Figure 9 The screen display effect testing device 20 shown in the embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.

[0155] This application provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above-described screen display effect detection method when executed by a processor.

[0156] This application embodiment may also provide a computer program product, including a computer program, which, when executed by a processor, can implement the above-described screen display effect detection method.

[0157] This application provides a chip that stores a computer program. When the computer program is executed by the chip, the above-mentioned screen display effect detection method is implemented.

[0158] This application provides a chip module that stores a computer program. When the computer program is executed by the chip module, the above-mentioned screen display effect detection method is implemented.

[0159] It should be noted that the processor mentioned in the embodiments of this application can be a central processing unit (CPU), or it can be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0160] It should be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DR RAM). It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, the memory (storage module) is integrated into the processor. It should be noted that the memory described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0161] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0162] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0163] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0164] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0165] Regarding the modules / units included in the various devices and products described in the above embodiments, they can be software modules / units, hardware modules / units, or a combination of both. Each device and product can be applied to or integrated into a chip, chip module, or terminal device. For example, for devices and products applied to or integrated into a chip, each included module / chip can be implemented entirely using hardware methods such as circuits, or at least some modules / units can be implemented using software programs running on a processor integrated within the chip, while the remaining modules / units can be implemented using hardware methods such as circuits.

[0166] In this application, the term "comprising" and its variations can refer to non-limiting inclusion; the term "or" and its variations can refer to "and / or". The terms "first", "second", etc., in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. In this application, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0167] The above are only some embodiments of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principles of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for detecting screen display effect, characterized in that, include: Obtain the values ​​of the registers in the kernel layer of the test device to get the first value; Turn on the switch corresponding to the display effect of any screen in the test device; The values ​​of the registers in the kernel layer of the test device are obtained again to get the second value; When the first value is the same as the second value, it is determined that the screen display effect is abnormal; When the first value is different from the second value, determine the screen display effect currently enabled by the test device; A screenshot of the test device is obtained, and a returned image of the test device is obtained; the screenshot is an image directly captured from the memory of the test device and does not include the screen display effect; the returned image is an image that includes the screen display effect and is returned to the memory by the test device after image back-end processing by the display processor module. For any screen display effect currently enabled by the test device, determine whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image.

2. The method according to claim 1, characterized in that, The step of determining whether the screen display effect is normal based on the image features of the screenshot and the returned image includes: Determine the first image features of the screenshot and the second image features of the returned image; If the first image feature is the same as the second image feature, then the screen display effect is determined to be abnormal. If the first image feature is different from the second image feature, then the screen display effect is determined to be normal.

3. The method according to claim 2, characterized in that, The step of determining that the screen display effect is normal if the first image feature is different from the second image feature includes: When the first image feature is different from the second image feature, determine the expected adjustment ratio of the screen display effect and the actual adjustment ratio of the test device; When the difference between the desired adjustment ratio and the actual adjustment ratio is less than a preset threshold, it is determined that the screen display effect is normal. When the difference between the desired adjustment ratio and the actual adjustment ratio is equal to or greater than a preset threshold, the screen display effect is determined to be abnormal.

4. The method according to claim 3, characterized in that, Determining the desired adjustment ratio of the screen display effect and the actual adjustment ratio of the test device includes: Based on the expected value corresponding to the screen display effect and the default value of the test device, determine the expected adjustment ratio corresponding to the screen display effect; Based on the first image features and the second image features, the actual adjustment ratio of the test equipment is determined.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Based on the current test scenario and a preset correspondence, the target light source brightness corresponding to the current test scenario is determined; the preset correspondence includes the correspondence between different test scenarios and different light source brightnesses. Adjust the ambient light source to the brightness of the target light source.

6. A screen display effect testing device, characterized in that, include: The first acquisition module is used to acquire the value of the register in the kernel layer of the test device to obtain the first value; The activation module is used to activate the switch corresponding to the display effect of any screen in the test device. The second acquisition module is used to acquire the value of the register in the kernel layer of the test device again to obtain the second value; The first determining module is used to determine that the screen display effect is abnormal when the first value is the same as the second value. The second determining module is used to determine the screen display effect currently enabled by the test device when the first value is different from the second value. The third acquisition module is used to acquire a screenshot of the test device and to acquire a returned image from the test device; the screenshot is an image directly captured from the memory of the test device and does not include the screen display effect; the returned image is an image that includes the screen display effect and is returned to the memory by the test device after image back-end processing by the display processor module. The third determining module is used to determine whether the screen display effect is displayed normally based on the image features of the screenshot and the returned image for any screen display effect currently enabled by the test device.

7. A screen display effect testing device, characterized in that, include: Processor, memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed, are used to implement the method described in any one of claims 1 to 5.

9. A computer program product, characterized in that, Includes a computer program that, when executed, implements the method described in any one of claims 1 to 5.

10. A chip, characterized in that, The chip stores a computer program, which, when executed by the chip, implements the method as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Abnormality test method, device and system for intelligent terminal

    CN111915601A

  • Interface testing method and device, electronic equipment and storage medium

    CN113407461A