Image display method and device, electronic equipment and storage medium

Abstract

The invention relates to an image display method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring an image sequence comprising multiple frames of images; wherein the image frames in the image sequence comprise image frames to be displayed; determining a target pixel area based on pixel information of each image frame in the image sequence; wherein the pixel points in the target pixel area are points with pixel value differences within a preset difference range in different image frames of the image sequence; and adjusting the display in the target pixel area in the image frame to be displayed, and displaying the adjusted image. Through the method, on one hand, the burn-in prevention accuracy and effect of the display screen are improved; and on the other hand, the condition of poor user experience caused by low screen brightness is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of image display technology, and in particular to an image display method and device, an electronic device, and a storage medium. Background Art

[0002] Organic Light-Emitting Diode (OLED) displays are widely used in various electronic devices for image display due to their advantages, including self-luminescence, clear and bright images, thinness, fast response time, wide viewing angle, and low power consumption. However, if an OLED display displays a static image for an extended period of time, the organic light-emitting diodes (OLEDs) within the display may experience varying degrees of wear and tear, easily causing brightness decay or image retention, a phenomenon known as screen burn-in. This, in turn, shortens the lifespan of the OLED display and reduces the user experience.

[0003] Therefore, how to provide an effective anti-burn-in solution is one of the technical problems that need to be solved urgently. Summary of the Invention

[0004] The present disclosure provides an image display method and device, an electronic device, and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an image display method, comprising:

[0006] Acquire an image sequence comprising a plurality of image frames; wherein the image frames in the image sequence include image frames to be displayed;

[0007] Determining a target pixel region based on pixel information of each image frame in the image sequence; wherein pixel points in the target pixel region are points whose pixel values ​​in different image frames of the image sequence differ within a preset difference range;

[0008] The display within the target pixel region in the image frame to be displayed is adjusted, and the adjusted image is displayed.

[0009] In some embodiments, determining the target pixel area based on pixel information of each image frame in the image sequence includes:

[0010] Based on the pixel values ​​of the pixels in each image frame in the image sequence, determining a point whose pixel value difference between different image frames in the image sequence is within the preset difference range as a target pixel point;

[0011] An area formed by pixel points having continuous pixel coordinates among the target pixel points is determined as the target pixel area.

[0012] In some embodiments, determining, based on the pixel values ​​of the pixels in each image frame in the image sequence, a point having a pixel value difference within a preset difference range between different image frames in the image sequence as a target pixel point includes:

[0013] Performing XOR on the pixel values ​​of the same pixel point in each adjacent image frame in the image sequence;

[0014] A pixel point whose XOR result of the same pixel point in each adjacent image frame is smaller than a preset XOR threshold is determined as the target pixel point.

[0015] In some embodiments, adjusting the display within the target pixel region in the image frame to be displayed and displaying the adjusted image includes:

[0016] Position adjustment and / or pixel value adjustment are performed on the pixel points within the target pixel area in the image frame to be displayed, and the image after the position adjustment and / or the pixel value adjustment is displayed.

[0017] In some embodiments, the method further comprises:

[0018] Detecting a target view layer to be refreshed in a view layer associated with a currently started application; wherein the target view layer is a layer of the image frame to be displayed;

[0019] The acquiring of an image sequence comprising multiple frames of images comprises:

[0020] Based on the target view layer, pixel information of each image frame in the multiple image frames including the image frame to be displayed is obtained.

[0021] In some embodiments, the method further comprises:

[0022] Adjusting the transparency of pixels within the target pixel area associated with a layer other than the target view layer; wherein the adjusted transparency is less than a preset transparency threshold, and the layer other than the target view layer is a layer that does not belong to the same application as the target view layer;

[0023] The adjusting the display within the target pixel area in the image frame to be displayed and displaying the adjusted image includes:

[0024] The display within the target pixel area in the image frame to be displayed corresponding to the target view layer is adjusted, and the adjusted target view layer of the image frame to be displayed is synthesized with the layer outside the target view layer after transparency adjustment and then displayed.

[0025] In some embodiments, the method further comprises:

[0026] Detect touch commands;

[0027] In response to not detecting the touch instruction within a predetermined time period, acquiring the image sequence.

[0028] According to a second aspect of an embodiment of the present disclosure, there is provided an image display device, including:

[0029] An acquisition module, configured to acquire an image sequence comprising a plurality of image frames; wherein the image frames in the image sequence include image frames to be displayed;

[0030] a determination module, configured to determine a target pixel region based on pixel information of each image frame in the image sequence; wherein pixel points in the target pixel region are points whose pixel values ​​in different image frames of the image sequence differ within a preset difference range;

[0031] The display module is used to adjust the display within the target pixel area in the image frame to be displayed and display the adjusted image.

[0032] In some embodiments, the determination module is also used to determine, based on the pixel values ​​of the pixel points in each image frame in the image sequence, points whose pixel value differences in different image frames of the image sequence are within the preset difference range as target pixel points; and determine the area formed by pixel points with continuous pixel coordinates in the target pixel points as the target pixel area.

[0033] In some embodiments, the determination module is also used to perform XOR on the pixel values ​​of the same pixel point in each adjacent image frame in the image sequence; and determine the pixel point whose XOR result of the same pixel point in each adjacent image frame is less than a preset XOR threshold as the target pixel point.

[0034] In some embodiments, the display module is further used to adjust the position and / or pixel value of the pixel points in the target pixel area in the image frame to be displayed, and display the image after the position adjustment and / or the pixel value adjustment.

[0035] In some embodiments, the apparatus further comprises:

[0036] A first detection module is configured to detect a target view layer to be refreshed in a view layer associated with a currently started application; wherein the target view layer is a layer of the image frame to be displayed;

[0037] The acquisition module is further used to acquire pixel information of each image frame in the multiple image frames including the image frame to be displayed based on the target view layer.

[0038] In some embodiments, the apparatus further comprises:

[0039] an adjustment module, configured to adjust the transparency of pixels within the target pixel area associated with a layer other than the target view layer; wherein the adjusted transparency is less than a preset transparency threshold, and the layer other than the target view layer is a layer that does not belong to the same application as the target view layer;

[0040] The display module is also used to adjust the display within the target pixel area in the image frame to be displayed corresponding to the target view layer, and synthesize the adjusted target view layer of the image frame to be displayed with the layer outside the target view layer with adjusted transparency and then display them.

[0041] In some embodiments, the apparatus further comprises:

[0042] The second detection module is configured to detect a touch instruction; and in response to not detecting the touch instruction within a predetermined time period, acquire the image sequence.

[0043] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0044] A processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the image display method as described in the first aspect above.

[0045] According to a fourth aspect of an embodiment of the present disclosure, there is provided a storage medium, including:

[0046] When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the image display method as described in the first aspect above.

[0047] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0048] In the disclosed embodiment, the electronic device determines the target pixel area formed by the pixel points whose differences are within a preset difference range based on the pixel differences between different image frames in the image sequence, that is, detects the display area where the display content of the display screen remains unchanged or changes very little for a long time (the area that is prone to burn-in), and adjusts the display of the target pixel area before displaying. On the one hand, the electronic device detects the target pixel area (the area that is prone to burn-in) and adjusts it for display, which is to specifically detect the local area of ​​the display screen that is prone to burn-in and adjust the display of the local area that is prone to burn-in, which is conducive to reducing the occurrence of local burn-in of the display screen and improving the accuracy and effectiveness of the display screen burn-in prevention. On the other hand, the electronic device does not need to reduce the overall screen brightness, which reduces the poor user experience caused by low screen brightness and improves the user experience.

[0049] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0051] Figure 1 This is an example flowchart of an image display method shown in an embodiment of the present disclosure.

[0052] Figure 2 This is an example diagram of pixel value data shown in an embodiment of the present disclosure.

[0053] Figure 3 This is an example diagram of pixel data comparison on an image frame shown in an embodiment of the present disclosure.

[0054] Figure 4 FIG. 1 is an example diagram of the architecture of a direct graphics manager shown in an embodiment of the present disclosure.

[0055] Figure 5 This is a flowchart of an image display method shown in an embodiment of the present disclosure.

[0056] Figure 6 FIG. 1 is a diagram of an image display device according to an embodiment of the present disclosure.

[0057] Figure 7 It is a block diagram of an electronic device shown in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0058] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0059] The present disclosure provides an image display method, the execution subject of which may be an electronic device including a display screen, such as a user equipment (UE), a mobile device, a user terminal, a mobile phone, a tablet computer, a television, a personal digital assistant (PDA), a handheld device, a computing device, an in-vehicle device, a wearable device, etc., wherein the display screen may be an OLED display screen. In some possible implementations, the image display method may be implemented by a processor in the electronic device calling computer-readable instructions stored in a memory.

[0060] It should be noted that an anti-burn-in mode can be set in the electronic device, and the image display method can be run in the anti-burn-in mode. The anti-burn-in mode of the electronic device can be turned on by the user's operation. For example, the user turns on the anti-burn-in mode in the general settings, and then the electronic device runs the image display method in the anti-burn-in mode; it can also be that the electronic device automatically turns on after detecting a predetermined running program. For example, the electronic device detects a video application, automatically turns on the anti-burn-in mode, and runs the image display method.

[0061] Figure 1 This is an example flow chart of an image display method shown in an embodiment of the present disclosure, Figure 1 It can be seen that the following steps are included:

[0062] S11, acquiring an image sequence including multiple image frames; wherein the image frames in the image sequence include image frames to be displayed;

[0063] S12. Determine a target pixel region based on pixel information of each image frame in the image sequence; wherein pixel points in the target pixel region are points whose pixel value differences between different image frames in the image sequence are within a preset difference range;

[0064] S13: Adjust the display within the target pixel area in the image frame to be displayed, and display the adjusted image.

[0065] In step S11, the electronic device may directly acquire an image sequence including multiple frames of images, or may acquire an image sequence including multiple frames of images when no touch instruction is detected within a predetermined time period, wherein the touch instruction may be triggered by a user's touch operation on the electronic device display screen.

[0066] In the embodiments of the present disclosure, there are multiple ways for an electronic device to obtain an image sequence including multiple frames of images. The method may be to obtain an image sequence associated with an application to be refreshed upon detecting an application to be refreshed; or it may be a preset application whitelist. When an application in the preset application whitelist is detected to be started, the image sequence associated with the application started in the preset application whitelist is obtained. The preset application whitelist may be set based on the application type; or it may be set based on the frequency of application use. For example, a whitelist of video applications including short video software (such as Tik Tok, Xiaohongshu), video software (such as Youku, iQiyi), etc.; another example is a whitelist of applications with high usage frequency including WeChat, Alipay, etc.

[0067] In the embodiment of the present disclosure, the image frames acquired by the electronic device may include image frames to be displayed and image frames that have been displayed. The image frames to be displayed may be image frames to be displayed in a to-be-refreshed application or a whitelisted application.

[0068] In step S12, the pixel points in the target pixel area are points whose pixel value differences in different image frames of the image sequence are within a preset difference range, that is, the area formed by pixel points representing a small degree of change in pixel value, wherein the target pixel area can be one or more. In the embodiment of the present disclosure, the electronic device can determine the area where the degree of change in pixel information in different image frames is less than a preset degree threshold as the target pixel area based on multiple image frames that have been displayed or are to be displayed in the image sequence. The pixel information may include the position and pixel value of the pixel point.

[0069] For example, when a user is using short video software, the content of the video area is frequently refreshed, and the pixel value of each pixel in the video area changes greatly; while the content of the navigation bar (such as "+") and the status bar (such as "search") remains unchanged for a long time, that is, the pixel value of each pixel in the navigation bar, status bar and other areas changes less, and multiple areas such as the status bar and navigation bar can be determined as target pixel areas. In the embodiment of the present disclosure, there are multiple ways for the electronic device to determine the target pixel area based on the pixel information of each image frame in the image sequence. The method can be to obtain the pixel value of the same pixel on each image frame in the image sequence, determine one or more target pixels with extremely small pixel value changes between each image frame, and determine the area formed by the target pixel points as the target pixel area; or the image frame can be pre-divided into multiple areas (composed of a predetermined number of pixels), and the pixel information of each area on different image frames is obtained. If the pixel value of each pixel in the area changes less, the area is determined as a target pixel area.

[0070] In step S13, the electronic device may adjust the display within the target pixel region of the image frame to be displayed in a variety of ways, including adjusting the position of the target pixel region or adjusting the pixel value of the target pixel region (for example, adjusting the color, transparency, etc. of the pixel points). In the disclosed embodiment, when there are one or more target pixel regions, position adjustment and / or pixel value adjustment may be performed for each target pixel region.

[0071] It should be noted that multiple applications can usually be launched in an electronic device, and the image frames corresponding to each application will be in different layers of the electronic device. For example, multiple applications such as short video software and video software are launched in the electronic device, and the image frame of the short video software currently in use is at the top layer of the layer, and the image frame of the video software is at the bottom layer of the short video software image frame; or when the user uses split-screen, floating window and other modes, the image frame of the short video software currently in use is at the top layer, and the image frame of the video software is at other layers.

[0072] In the disclosed embodiments, the electronic device adjusts the display within a target pixel region of an image frame to be displayed. This can be done directly within the target pixel region of the image frame to be displayed, or it can be done by adjusting the display of the image frame to be displayed and other image frames (typically, image frames located on other layers, such as the bottom layer of the image frame to be displayed) within the target pixel region. For example, the electronic device adjusts the display of an image frame to be refreshed in a short video application; in another example, the electronic device adjusts the display of target pixel regions of both the image frames of the short video application and the video application.

[0073] For example, after the short video software determines the target pixel area including the navigation bar, status bar and other areas, the pixel value of the navigation bar area can be adjusted, and the position of the status bar area can be adjusted. After completing the display adjustment of all target pixel areas of the short video software, the adjusted image frame to be displayed is displayed.

[0074] In related technologies, it is usually necessary to detect the application that the user is using and reduce the overall brightness of the visible area of ​​the current application to reduce the risk of screen burn-in. However, in some usage scenarios, such as when the user uses short video software, the video area will be frequently updated, while the content of the status bar, navigation bar and other areas will remain unchanged for a long time, resulting in image retention in some areas of the display (such as the "+" icon). On the one hand, the method of lowering the brightness of the visible area of ​​the application as a whole cannot process the areas where the content in the visible area remains unchanged for a long time, which makes local areas of the display prone to burn-in; on the other hand, the method of lowering the brightness of the visible area of ​​the application as a whole is not easy to meet the user's requirements for brightness, and the user experience is poor.

[0075] It should be noted that since the content of the display area remains unchanged for a long time, it usually causes the brightness of the pixels in the area to decay and / or image retention, which is the main factor causing display burn-in (image retention, brightness decay).

[0076] In this regard, in the embodiment of the present disclosure, the electronic device determines the target pixel area formed by the pixel points whose differences are within a preset difference range based on the pixel differences between different image frames in the image sequence, that is, detects the display area where the display content of the display screen remains unchanged or changes very little for a long time (the area that is prone to burn-in), and adjusts the display of the target pixel area before displaying. On the one hand, the electronic device detects the target pixel area (the area that is prone to burn-in) and adjusts it for display, which is to specifically detect the local area of ​​the display screen that is prone to burn-in, and adjust the display of the local area that is prone to burn-in, which is conducive to reducing the occurrence of local burn-in on the display screen and improving the accuracy and effectiveness of the display screen burn-in prevention. On the other hand, the electronic device does not need to reduce the overall screen brightness, which reduces the poor user experience caused by low screen brightness and improves the user experience.

[0077] In the embodiment of the present disclosure, determining the target pixel area based on the pixel information of each image frame in the image sequence includes:

[0078] Based on the pixel values ​​of the pixels in each image frame in the image sequence, determining a point whose pixel value difference between different image frames in the image sequence is within the preset difference range as a target pixel point;

[0079] An area formed by pixel points having continuous pixel coordinates among the target pixel points is determined as the target pixel area.

[0080] In the embodiment of the present disclosure, there are multiple ways for the electronic device to determine the target pixel point based on the pixel values ​​of the pixel points in each pixel frame in the image sequence. The method can be based on the difference in pixel values ​​of the same pixel point in adjacent image frames in the image sequence. If the difference in the same pixel points in adjacent image frames is within a preset difference range, the pixel point is determined as the target pixel point. The method can also be based on the pixel values ​​of adjacent pixel points on multiple image frames in the image sequence. The point with a larger or smaller pixel value among the adjacent pixel points (the point with a larger difference in pixel value from other pixel points in the adjacent pixel points) is determined as the target pixel point.

[0081] In the disclosed embodiments, the pixel value difference can be a difference value, a ratio value, an XOR value, or other types of difference values. The preset difference range is used to characterize the degree of difference between the pixels and can be adaptively set according to the type of pixel value difference. For example, when the pixel value difference is measured as a difference value (2, 3, 3), the preset difference range can be set to a pixel difference range of (10, 10, 10); for another example, when the pixel value difference is measured as a ratio value (0.01, 0.015, 0.015), the preset difference range can be set to a pixel ratio range of (0.2, 0.2, 0.2).

[0082] In an embodiment of the present disclosure, an electronic device determines an area formed by pixel points with continuous pixel coordinates among target pixel points as a target pixel area. The electronic device can obtain the coordinate data of the target pixel points, determine the pixel points with coordinate differences between the target pixel points that are less than a preset coordinate difference threshold as pixel points with continuous coordinates, and form a target pixel area based on the plurality of pixel points with continuous coordinates. For example, the electronic device obtains 50 pixel points, determines 15 of the 50 pixel points as pixel points with continuous coordinates based on the coordinates of the 50 pixel points, and forms a target pixel area including 15 pixels.

[0083] In the embodiment of the present disclosure, the electronic device determines the target pixel points with smaller pixel value differences based on the differences between the pixel values ​​of the pixel points in the image sequence, and forms a target pixel area based on the target pixel points with continuous coordinates. The pixel-level detection method is used to determine the target pixel area, thereby improving the accuracy of the target pixel area and further improving the accuracy and effect of the electronic device's anti-burn-in effect.

[0084] In the embodiment of the present disclosure, based on the pixel values ​​of the pixel points in each image frame in the image sequence, determining a point whose pixel value difference between different image frames in the image sequence is within the preset difference range as a target pixel point includes:

[0085] Performing XOR on the pixel values ​​of the same pixel point in each adjacent image frame in the image sequence;

[0086] A pixel point whose XOR result of the same pixel point in each adjacent image frame is smaller than a preset XOR threshold is determined as the target pixel point.

[0087] In an embodiment of the present disclosure, after acquiring image frames in an image sequence, the electronic device may obtain pixel values ​​for each image frame, perform an XOR operation on the pixel values ​​of the same pixel in each adjacent image frame in the image sequence, and determine the target pixel if the XOR result is less than a preset XOR threshold. For example, the electronic device may read the pixel value information of the pixel in each frame through the frame buffer (FB) of the system kernel layer, where the pixel value may be a pixel value in RGB mode or a pixel value in RGBA mode.

[0088] Figure 2 This is an example diagram of pixel value data shown in an embodiment of the present disclosure. Figure 2 As shown, taking 32-bit RGBA data as an example, the 32-bit data of RBG888 are A, R, G, and B, where A corresponds to the transparency (Alpha) element, R corresponds to the red element, G corresponds to the green element, and B corresponds to the blue element, and each element occupies 8 bits. In the embodiment of the present disclosure, the pixel values ​​of the same pixel point in each adjacent image frame are XORed, that is, the 32-bit RGBA data of the same pixel point in adjacent frames are XORed.

[0089] Figure 3 This is an example diagram of pixel data comparison on an image frame shown in an embodiment of the present disclosure. Figure 3 As shown, the electronic device obtains the pixel value of each pixel in the dirty region (Damage Region) to be refreshed on the N-1th frame and the Nth frame in the image sequence, and performs an XOR operation on the pixel values ​​of the same pixel in the adjacent N-1th frame and the Nth frame. If the XOR result is 0, it means that the pixel values ​​of the same pixel in the adjacent frames are exactly the same, and it can be determined as the target pixel. The target pixel is marked in the dirty region position array for recording, so that the target pixel region with continuous coordinates can be determined based on the coordinate information of the target pixel in the dirty region position array. The pixel value is pixel information in RGBA mode.

[0090] In the disclosed embodiment, the electronic device performs XOR based on the pixel values ​​of the same pixel in adjacent image frames. The method of determining the target pixel based on the XOR result is simple and easy to implement, and the XOR operation is a binary operation with fast operation speed and high efficiency, which is conducive to improving the efficiency of anti-burn-in.

[0091] In the embodiment of the present disclosure, adjusting the display within the target pixel region in the image frame to be displayed and displaying the adjusted image includes:

[0092] Position adjustment and / or pixel value adjustment are performed on the pixel points within the target pixel area in the image frame to be displayed, and the image after the position adjustment and / or the pixel value adjustment is displayed.

[0093] In the embodiment of the present disclosure, the electronic device adjusts the position and / or pixel value of the pixel points within the target pixel area in the image frame to be displayed. The adjustment may be performed by directly adjusting the pixel points within the target pixel area in all the image frames to be displayed; or the target frame that needs to be displayed adjusted is first determined in the image frame to be displayed, and the pixel points within the target pixel area in the target frame are adjusted.

[0094] In the disclosed embodiments, the electronic device can adjust the positions of pixels within a target pixel region in a variety of ways. The electronic device can offset the coordinates of all target pixels in the target pixel region based on the target pixel coordinates. Alternatively, the electronic device can extract a portion of target pixels for each image frame to be displayed and offset the coordinates of the extracted target pixels. The offset method can include the electronic device modifying the coordinate data in the frame buffer using property settings at the system kernel layer to offset the target pixel by n pixels.

[0095] In the embodiments of the present disclosure, there are multiple ways for the electronic device to adjust the pixel values ​​of the pixel points within the target pixel area in the image frame to be displayed. The methods may be to adjust the color data of the pixel points, such as adjusting the R, G, and B elements in the pixel values ​​to achieve color adjustment of the pixel points; or the methods may be to adjust the transparency of the pixel points, such as adjusting the A element in the pixel values ​​to achieve transparency adjustment of the pixel points.

[0096] In the disclosed embodiment, the electronic device adjusts the position and / or pixel value of the target pixel area in the image frame to be displayed, and displays the adjusted image. The display adjustment of the target pixel area (the area that is prone to screen burn-in) is performed in a variety of ways, thereby diversifying the anti-screen burn-in processing methods of the electronic device display screen, which is conducive to improving the intelligence of the electronic device.

[0097] In the embodiment of the present disclosure, the method further includes:

[0098] Detecting a target view layer to be refreshed in a view layer associated with a currently started application; wherein the target view layer is a layer of the image frame to be displayed;

[0099] The acquiring of an image sequence comprising multiple frames of images comprises:

[0100] Based on the target view layer, pixel information of each image frame in the multiple image frames including the image frame to be displayed is obtained.

[0101] As mentioned above, when an electronic device is running, multiple applications are usually started, and the view layers associated with the multiple started applications are arranged in different ways and displayed on the display screen of the electronic device, wherein the view layer can be the visible layer of each application, such as the video layer of a video application. For example, when a user has opened multiple applications, if the user uses the short video software (current application) in full-screen mode, the view layer of the short video software will be displayed at the top layer, while the view layers of other applications such as WeChat and Desktop will be displayed below the view layer of the short video software; when the user uses the short video software in split-screen mode, the view layer of the short video software occupies a larger area in the visible area of ​​the display screen, while the view layers of other applications such as WeChat and Desktop occupy a smaller area in the visible area of ​​the display screen, or are directly below the view layer of the short video software.

[0102] In an embodiment of the present disclosure, the electronic device detects the view layer associated with the currently started application, and may determine the view layer of the application associated with the view layer located at the top layer as the target view layer to be refreshed; or may determine the view layer of the application associated with the view layer that occupies a relatively large area in the visible area of ​​the display screen as the target view layer to be refreshed; or may determine the view layer of a predetermined type (for example, a video layer (surfaceview) type), or a view layer associated with an application in a preset application whitelist (for example, an application whitelist including short video software, video software, etc.).

[0103] In an embodiment of the present disclosure, the electronic device can use a graphics display framework to implement the image display method of the present disclosure, detect and adjust the target view layer, wherein the target view layer represents the layer of the image frame to be displayed, and the graphics display framework can be a direct rendering manager (DRM) architecture.

[0104] Figure 4 This is an example diagram of the architecture of a direct graphics manager shown in an embodiment of the present disclosure. Figure 4As shown, the DRM architecture includes user space and kernel space, wherein the user space includes software applications, the Android framework display subsystem (SurfaceFlinger), the display layer management subthread (Layer), the graphics processing service (HWC Service), and the user space function library (Libdrm); the kernel space includes the Graphics Execution Manager (GEM) for managing video memory, and the kernel display mode setting (KMS) for display control. Among them, KMS includes a frame buffer, a display controller (CRTC), an encoder (Encoder), a connector (Connector), and a hardware layer controller (Planes). Among them, the user space function library (Libdrm), users or applications can access the display resources of the electronic device and manage the display resources by calling the library functions provided by Libdrm in the user space.

[0105] In the disclosed embodiments, electronic devices can utilize the DRM architecture to detect target view layers. For example, a software application of the electronic device reads view layer information from the display layer management subthread through the Android framework display subsystem. If a view layer to be refreshed is detected in the display layer management subthread, the view layer to be refreshed is determined as the target view layer.

[0106] In the disclosed embodiments, the electronic device obtains pixel information for each image frame in a multi-frame image including image frames to be displayed based on a target view layer. For example, when the target view layer is a short video software view layer, pixel information for each image frame in a multi-frame image including image frames to be displayed associated with the short video software application is obtained to facilitate subsequent detection of target pixel areas and display adjustments for the short video software.

[0107] In an embodiment of the present disclosure, the electronic device may also utilize the DRM architecture to obtain pixel information of each image frame in a plurality of frames including an image frame to be displayed, and perform pixel detection and adjustment on the dirty area to be refreshed in the target view layer. Exemplarily, the electronic device reads the frame buffer information of the target view layer (for example, reads through the file node / dev / graphics / fb0), and compares the pixel values ​​(for example, RGBA data) of the same pixel in the dirty area of ​​adjacent image frames (for example, performing an XOR operation on the RGBA data of the two frames before and after). If the XOR of the RGBA data of the same pixel is 0, indicating that the color data of the same pixel in the adjacent image frames is the same, then the pixel is marked as an "unchanged" pixel. In an embodiment of the present disclosure, the electronic device may use the "unchanged" pixel in multiple consecutive image frames as the target pixel, and determine the area formed by the target pixel with continuous coordinates as the target pixel area, and modify the coordinates and / or pixel values ​​of each pixel in the target pixel area using attribute settings to achieve pixel position translation or color adjustment.

[0108] In the embodiment of the present disclosure, the electronic device detects the target view layer to be refreshed in the launched application, and specifically obtains the image sequence including the image frames to be displayed that are associated with the application corresponding to the target view layer to be refreshed, thereby improving the efficiency of image sequence acquisition and further improving the efficiency of image display of the electronic device.

[0109] In the embodiment of the present disclosure, the method further includes:

[0110] Adjusting the transparency of pixels within the target pixel area associated with a layer other than the target view layer; wherein the adjusted transparency is less than a preset transparency threshold, and the layer other than the target view layer is a layer that does not belong to the same application as the target view layer;

[0111] The adjusting the display within the target pixel area in the image frame to be displayed and displaying the adjusted image includes:

[0112] The display within the target pixel area in the image frame to be displayed corresponding to the target view layer is adjusted, and the adjusted target view layer of the image frame to be displayed is synthesized with the layer outside the target view layer after transparency adjustment and then displayed.

[0113] In an embodiment of the present disclosure, the electronic device adjusts the transparency of pixels within a target pixel area associated with layers other than the target view layer, so that the adjusted transparency is less than a preset transparency threshold (for example, reducing the transparency to 20% of the previous transparency). The electronic device may reduce the transparency by reducing the transparency of all pixels within the target pixel area or by extracting some pixels within the target pixel area and reducing the transparency of the extracted pixels.

[0114] In the disclosed embodiments, layers outside the target view layer are layers that do not belong to the same application as the target view layer. They can be view layers located below the target view layer or view layers located around the target view layer. For example, if the target view layer is a short video software view layer, the desktop view layer below the short video software view layer of the electronic device and the WeChat view layer located around the short video software view layer can both be understood as layers outside the target view layer.

[0115] In the embodiment of the present disclosure, the electronic device synthesizes the adjusted target view layer of the image frame to be displayed with the layers other than the target view layer with adjusted transparency, and then displays the synthesized layers.

[0116] As mentioned above, the embodiments of the present disclosure can utilize the DRM architecture for display control. For example, the electronic device utilizes a hardware layer controller to obtain the adjusted target view layer of the image frame to be displayed and the frame cache data of the layer outside the target view layer after transparency adjustment, and transmits the merged layer data to the display controller, and then utilizes an encoder to perform image encoding, and utilizes a connector to transmit the encoded image frame data to the electronic device for display.

[0117] It should be noted that when an electronic device has multiple applications launched, the current application usually only occupies a part of the display screen, or there are view layers of other applications below the current application. After adjusting the transparency of the target pixel area, the view layer of the application below the target pixel area may show through, affecting the user experience of the current application; or if the pixels of the view layer around the target pixel area do not change for a long time, it may also cause screen burn-in.

[0118] In the embodiment of the present disclosure, the electronic device further reduces the transparency of the pixel points within the target pixel area associated with the layers outside the target view layer, so as to reduce the show-through of the view layer applied below the target pixel area, or reduce the burn-in situation caused around the target pixel area, thereby improving the anti-burn-in effect of the electronic device and the user experience of using the electronic device in the anti-burn-in mode.

[0119] In the embodiment of the present disclosure, the method further includes:

[0120] Detect touch commands;

[0121] In response to not detecting the touch instruction within a predetermined time period, acquiring the image sequence.

[0122] In the disclosed embodiments, the electronic device can detect touch commands in a variety of ways, including direct detection via the electronic device's own operating system or by invoking a third-party screen detection application. The touch command can be triggered by a user touching the electronic device or by a predetermined test program running on the electronic device.

[0123] For example, the electronic device can download and use a third-party "touch test" application to detect touch instructions; for another example, the electronic device uses its own operating system to detect touch instructions by detecting whether there is a touch event reported by the touch driver (Touch Driver) at the kernel layer, and if so, determining that a touch instruction is detected.

[0124] In the disclosed embodiment, the electronic device first detects a touch command, and if no touch command is detected within a predetermined time period, an image sequence is acquired. The predetermined time period can be controlled by a timer in the operating system. For example, the electronic device starts a timer (TouchIdleTimer) in the application framework layer. If a touch event is detected within a predetermined time period (usually set to 3 seconds), the timer is reset; if no touch event is detected within the predetermined time period, the image sequence is acquired.

[0125] It should be noted that if an electronic device fails to detect a touch command within a predetermined period of time, it usually indicates that the user has not operated the electronic device for a long time, and the electronic device is likely to display a static image. If not processed, it is very likely to cause screen burn-in.

[0126] In this regard, in an embodiment of the present disclosure, when the electronic device does not detect a touch instruction within a predetermined time period, it obtains an image sequence so as to start running the image display method to prevent the electronic device display screen from burning in. Compared with turning on the anti-burn-in mode for a long time, it can appropriately save the resources of the electronic device and improve the intelligence of the electronic device.

[0127] Figure 5 is a flow chart of an image display method shown in an embodiment of the present disclosure. Figure 5 As shown, the image display method includes the following steps:

[0128] S501, the touch hardware abstraction layer notifies the touch driver to report the key value;

[0129] In this embodiment, the electronic device utilizes the touch hardware abstraction layer in the operating system to detect a touch instruction corresponding to a user's touch operation on the display screen. Upon detecting a user touch, the electronic device notifies the touch driver to report a key value. In other words, in this embodiment of the disclosure, the electronic device detects a touch instruction. The key value reported by the touch driver indicates the occurrence of a touch event.

[0130] S502, touch driver (report key value);

[0131] In this embodiment, the electronic device reports the key value using the touch driver of the operating system kernel layer.

[0132] S503: Call back the touch event through the touch driver;

[0133] In this embodiment, the electronic device uses onTouchHint of the operating system application framework layer to call back the touch event so that the timer (TouchIdleTimer) of the application framework layer can detect the touch event.

[0134] S504, timer detects touch event;

[0135] In this embodiment, the electronic device detects touch events using timer information of the operating system application framework layer.

[0136] S505: Is there a touch event within the predetermined time? If not, go to step S506.

[0137] In this embodiment, the timer of the electronic device determines whether there is a touch event within a predetermined time, wherein the predetermined time can be set using the timer, and the length of the predetermined time can be determined based on the model of the electronic device and the characteristics of commonly used applications. For example, for video applications, the predetermined time can be set to 3 seconds.

[0138] S506, the Android framework display subsystem performs data processing;

[0139] In this embodiment, the electronic device does not detect a touch instruction within a predetermined period of time (usually when the user has not operated the electronic device for a long time), and the electronic device processes data through the Android framework display subsystem (SurfaceFlinger), that is, in the embodiment of the present disclosure, pixel detection and adjustment are performed on the target view layer to be refreshed.

[0140] S507, obtaining and modifying pixel value data and coordinate information of the dirty area frame buffer;

[0141] In this embodiment, the electronic device, by installing a framework subsystem, utilizes the display layer management subthread to determine the dirty area in the layer to be refreshed. In this embodiment, the electronic device can access the pixel value data of the frame buffer of the dirty area through the aforementioned DRM architecture, and determine the "unchanged" pixel point (target pixel point) by comparing the differences between the same pixel points in the dirty areas of adjacent image frames. The differences between the same pixel points can be determined by performing an exclusive-OR operation on the pixel values ​​of the aforementioned pixel points.

[0142] In this embodiment, the electronic device marks the coordinates of "unchanged" pixels in the dirty region and uses attribute settings to modify the pixel values ​​and coordinate information of the dirty region data in the frame buffer. The pixel value modification can be to modify the color and transparency information. In other words, in this embodiment of the present disclosure, based on the pixel information of each image frame in the image sequence, a target pixel region is determined, and the display within the target pixel region in the image frame to be displayed is adjusted.

[0143] In addition, the electronic device may also perform hiding settings for visible layers of other applications other than the application currently being used by the user (eg, setting the transparency of visible layers of other applications to 0).

[0144] S508: The display layer management sub-thread reads and displays the pixel information of the dirty area after display adjustment.

[0145] In this embodiment, the electronic device uses the display layer management sub-thread in the DRM architecture to read the pixel information after the dirty area display adjustment and displays it, that is, in the embodiment of the present disclosure, displays the adjusted image.

[0146] In the disclosed embodiment, the electronic device utilizes the DRM architecture to perform pixel detection on pixel areas (target pixel areas) that have not been refreshed for a long time in the image frame through property settings (Property), operating the frame buffer (Frame Buffer) and the controller (CRTC), and then modifying the transparency, position and RGBA data of the pixels in the pixel areas that have not been refreshed for a long time, thereby achieving the pixel refresh function and screen burn-in prevention function. On the one hand, the pixel detection method can detect the areas where the pixels in the dirty area have not changed, achieving the effect of local burn-in prevention and improving the accuracy of the electronic device's burn-in prevention. On the other hand, the burn-in prevention is to adjust the pixel value, position, etc. of the local area without reducing the overall brightness of the electronic device, thereby improving the user experience of using the electronic device. On the other hand, the transparency under the visible layer of the user's current application is set to 0, thereby hiding the view layers other than the user's current application and realizing the immersive mode experience of the application.

[0147] Figure 6is a diagram of an image display device shown in an embodiment of the present disclosure, Figure 6 It is known that:

[0148] An acquisition module 601 is configured to acquire an image sequence comprising a plurality of image frames, wherein the image frames in the image sequence include image frames to be displayed;

[0149] A driving module 602 is configured to determine a target pixel region based on pixel information of each image frame in the image sequence; wherein the pixel points in the target pixel region are points whose pixel values ​​in different image frames of the image sequence differ within a preset difference range;

[0150] The display module 602 is configured to adjust the display within the target pixel region in the image frame to be displayed, and display the adjusted image.

[0151] In some embodiments, the driving module 602 is also used to determine, based on the pixel values ​​of the pixel points in each image frame in the image sequence, points whose pixel value differences in different image frames of the image sequence are within the preset difference range as target pixel points; and determine the area formed by pixel points with continuous pixel coordinates in the target pixel points as the target pixel area.

[0152] In some embodiments, the driving module 602 is further used to perform XOR on the pixel values ​​of the same pixel point in each adjacent image frame in the image sequence; and determine the pixel point whose XOR result of the same pixel point in each adjacent image frame is less than a preset XOR threshold as the target pixel point.

[0153] In some embodiments, the display module 602 is further used to adjust the position and / or pixel value of the pixel points in the target pixel area in the image frame to be displayed, and display the image after the position adjustment and / or pixel value adjustment.

[0154] In some embodiments, the apparatus further comprises:

[0155] A first detection module is configured to detect a target view layer to be refreshed in a view layer associated with a currently started application; wherein the target view layer is a layer of the image frame to be displayed;

[0156] The acquisition module 601 is further configured to acquire pixel information of each image frame in the multiple image frames including the image frame to be displayed based on the target view layer.

[0157] In some embodiments, the apparatus further comprises:

[0158] an adjustment module, configured to adjust the transparency of pixels within the target pixel area associated with a layer other than the target view layer; wherein the adjusted transparency is less than a preset transparency threshold, and the layer other than the target view layer is a layer that does not belong to the same application as the target view layer;

[0159] The display module 602 is also used to adjust the display within the target pixel area in the image frame to be displayed corresponding to the target view layer, and synthesize the adjusted target view layer of the image frame to be displayed with the layer outside the target view layer after transparency adjustment for display.

[0160] In some embodiments, the apparatus further comprises:

[0161] The second detection module is configured to detect a touch instruction; and in response to not detecting the touch instruction within a predetermined time period, acquire the image sequence.

[0162] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0163] Figure 7 8 is a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, the electronic device 800 may be a mobile phone, a mobile computer, etc.

[0164] Reference Figure 7 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0165] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0166] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0167] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0168] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0169] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0170] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0171] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor assembly 814 can also detect changes in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and temperature changes of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0172] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0173] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0174] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the electronic device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0175] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform the aforementioned image display method.

[0176] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0177] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image display method, characterized in that: The method comprises: Acquire an image sequence comprising a plurality of image frames; wherein the image frames in the image sequence include image frames to be displayed; Determining a target pixel region based on pixel information of each image frame in the image sequence; wherein pixel points in the target pixel region are points whose pixel values ​​in different image frames of the image sequence differ within a preset difference range; The display within the target pixel region in the image frame to be displayed is adjusted, and the adjusted image is displayed.

2. The method according to claim 1, wherein The determining of the target pixel area based on pixel information of each image frame in the image sequence includes: Based on the pixel values ​​of the pixels in each image frame in the image sequence, determining a point whose pixel value difference between different image frames in the image sequence is within the preset difference range as a target pixel point; An area formed by pixel points having continuous pixel coordinates among the target pixel points is determined as the target pixel area.

3. The method according to claim 2, characterized in that The step of determining, based on the pixel values ​​of the pixels in each image frame in the image sequence, a point whose pixel value difference between different image frames in the image sequence is within the preset difference range as a target pixel point includes: Performing XOR on the pixel values ​​of the same pixel point in each adjacent image frame in the image sequence; A pixel point whose XOR result of the same pixel point in each adjacent image frame is smaller than a preset XOR threshold is determined as the target pixel point.

4. The method according to claim 1, wherein The adjusting the display within the target pixel area in the image frame to be displayed and displaying the adjusted image includes: Position adjustment and / or pixel value adjustment are performed on the pixel points within the target pixel area in the image frame to be displayed, and the image after the position adjustment and / or the pixel value adjustment is displayed.

5. The method according to claim 1, characterized in that The method further comprises: Detecting a target view layer to be refreshed in a view layer associated with a currently started application; wherein the target view layer is a layer of the image frame to be displayed; The acquiring of an image sequence comprising multiple frames of images comprises: Based on the target view layer, pixel information of each image frame in the multiple image frames including the image frame to be displayed is obtained.

6. The method according to claim 5, characterized in that The method further comprises: Adjusting the transparency of pixels within the target pixel area associated with a layer other than the target view layer; wherein the adjusted transparency is less than a preset transparency threshold, and the layer other than the target view layer is a layer that does not belong to the same application as the target view layer; The adjusting the display within the target pixel area in the image frame to be displayed and displaying the adjusted image includes: The display within the target pixel area in the image frame to be displayed corresponding to the target view layer is adjusted, and the adjusted target view layer of the image frame to be displayed is synthesized with the layer outside the target view layer after transparency adjustment and then displayed.

7. The method according to claim 1, wherein The method further comprises: Detect touch commands; In response to not detecting the touch instruction within a predetermined time period, acquiring the image sequence.

8. An image display device, characterized in that: The device comprises: An acquisition module, configured to acquire an image sequence comprising a plurality of image frames; wherein the image frames in the image sequence include image frames to be displayed; a determination module, configured to determine a target pixel region based on pixel information of each image frame in the image sequence; wherein pixel points in the target pixel region are points whose pixel values ​​in different image frames of the image sequence differ within a preset difference range; The display module is used to adjust the display within the target pixel area in the image frame to be displayed and display the adjusted image.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method according to any one of claims 1 to 7.

Images