Display method and device, electronic equipment, storage medium and program product

Abstract

The invention relates to a display method and device, electronic equipment, a storage medium and a program product. The display method comprises the steps of obtaining a background layer and a content layer of a to-be-displayed picture; wherein the change frequency of the background image layer in an image sequence associated with the to-be-displayed image is smaller than the change frequency of the content image layer in the image sequence; determining the image brightness of the content image layer based on the pixel value of each pixel point in the content image layer; adjusting the image brightness of the background image layer based on the image brightness of the content image layer; performing synthesis based on the content image layer and the background image layer after image brightness adjustment to obtain a synthesized display picture and displaying the synthesized display picture; the burn-in phenomenon of the electronic equipment can be reduced.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and in particular to a display method and apparatus, electronic device, storage medium, and program product. Background Technology

[0002] With the rapid development of electronic devices, Organic Light-Emitting Diode (OLED) displays have advantages over Liquid Crystal Displays (LCDs), such as higher brightness, better saturation, thinner screens, and flexibility. Therefore, OLED displays have gradually replaced LCD displays. Each pixel in an OLED display is composed of multiple light-emitting organic particles, which emit light under the drive of an electric field, thus enabling the OLED display to emit light and display information.

[0003] However, when an OLED display on an electronic device shows the same image for an extended period, the limited lifespan of each light-emitting element leads to aging, which can cause image retention (burn-in). This results in a shorter lifespan for the OLED screen and a reduced user experience. Therefore, providing an effective burn-in prevention solution is one of the urgent technical problems to be solved. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a display method and apparatus, electronic device, storage medium, and program product that can reduce screen burn-in in electronic devices.

[0005] According to a first aspect of the present disclosure, a display method is provided, comprising:

[0006] Obtain the background layer and content layer of the image to be displayed; wherein the background layer changes less frequently in the image sequence associated with the image to be displayed than the content layer changes more frequently in the image sequence.

[0007] The image brightness of the content layer is determined based on the pixel values ​​of each pixel in the content layer;

[0008] Adjust the image brightness of the background layer based on the image brightness of the content layer;

[0009] The content layer and the background layer with adjusted image brightness are combined to obtain the composite display image, which is then displayed.

[0010] In some embodiments, the method further includes:

[0011] Obtain the screen brightness for displaying the image to be displayed;

[0012] Adjusting the image brightness of the background layer based on the image brightness of the content layer includes:

[0013] Adjust the image brightness of the background layer based on the screen brightness and the image brightness of the content layer.

[0014] In some embodiments, adjusting the image brightness of the background layer based on the screen brightness and the image brightness of the content layer includes:

[0015] Based on the screen brightness and the image brightness of the content layer, determine the display brightness of the content layer based on the screen brightness;

[0016] Adjust the image brightness of the background layer based on the screen brightness and the display brightness of the content layer.

[0017] In some embodiments, determining the display brightness of the content layer based on the screen brightness and the image brightness of the content layer includes:

[0018] The image brightness of the content layer is normalized to obtain the normalized image brightness of the content layer;

[0019] Based on the first preset mapping relationship and the normalized image brightness of the content layer, the normalized display brightness of the content layer is determined; wherein, the first preset mapping relationship includes a first correspondence between the normalized display brightness and the normalized image brightness;

[0020] The display brightness of the content layer is determined by multiplying the normalized display brightness of the content layer by the screen brightness.

[0021] In some embodiments, adjusting the image brightness of the background layer based on the screen brightness and the display brightness of the content layer includes:

[0022] The display brightness of the background layer is determined based on the display brightness of the content layer and a preset contrast weight value.

[0023] The ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer;

[0024] Based on the second preset mapping relationship and the normalized display brightness of the background layer, the normalized image brightness of the background layer is determined; wherein, the second preset mapping relationship includes a second correspondence between the normalized display brightness and the normalized image brightness;

[0025] The normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

[0026] In some embodiments, the step of compositing the content layer and the background layer with adjusted image brightness to obtain and display the composited display image includes:

[0027] Image post-processing is performed on the content layer and the background layer after image brightness adjustment, respectively, to obtain the post-processed content layer and the post-processed background layer;

[0028] The post-processed content layer and the post-processed background layer are composited to obtain the composite display image, which is then displayed.

[0029] In some embodiments, the background layer is the layer containing the toolbar and / or status bar of the screen to be displayed; the content layer is the layer containing the captured image.

[0030] According to a second aspect of the present disclosure, a display device is provided, comprising:

[0031] The first acquisition module is configured to acquire the background layer and content layer of the screen to be displayed; wherein the background layer changes less frequently in the screen sequence associated with the screen to be displayed than the content layer changes less frequently in the screen sequence.

[0032] The first determining module is configured to determine the image brightness of the content layer based on the pixel values ​​of each pixel in the content layer;

[0033] The first adjustment module is configured to adjust the image brightness of the background layer based on the image brightness of the content layer;

[0034] The compositing module is configured to composite the content layer and the background layer with adjusted image brightness to obtain and display the composited display image.

[0035] In some embodiments, the display device further includes:

[0036] The second acquisition module is configured to acquire the screen brightness for displaying the image to be displayed;

[0037] The first adjustment module further includes:

[0038] The second adjustment module is configured to adjust the image brightness of the background layer based on the screen brightness and the image brightness of the content layer.

[0039] In some embodiments, the second adjustment module further includes:

[0040] The second determining module is configured to determine the display brightness of the content layer based on the screen brightness and the image brightness of the content layer.

[0041] The third adjustment module is configured to adjust the image brightness of the background layer based on the screen brightness and the display brightness of the content layer.

[0042] In some embodiments, the second determining module is further configured to normalize the image brightness of the content layer to obtain the normalized image brightness of the content layer;

[0043] Based on the first preset mapping relationship and the normalized image brightness of the content layer, the normalized display brightness of the content layer is determined; wherein, the first preset mapping relationship includes a first correspondence between the normalized display brightness and the normalized image brightness;

[0044] The display brightness of the content layer is determined by multiplying the normalized display brightness of the content layer by the screen brightness.

[0045] In some embodiments, the third adjustment module is further configured to determine the display brightness of the background layer based on the display brightness of the content layer and a preset contrast weight value;

[0046] The ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer;

[0047] Based on the second preset mapping relationship and the normalized display brightness of the background layer, the normalized image brightness of the background layer is determined; wherein, the second preset mapping relationship includes a second correspondence between the normalized display brightness and the normalized image brightness;

[0048] The normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

[0049] In some embodiments, the compositing module is further configured to perform image post-processing on the content layer and the background layer after image brightness adjustment, respectively, to obtain a post-processed content layer and a post-processed background layer.

[0050] The post-processed content layer and the post-processed background layer are composited to obtain the composite display image, which is then displayed.

[0051] In some embodiments, the background layer is the layer containing the toolbar and / or status bar of the screen to be displayed; the content layer is the layer containing the captured image.

[0052] According to a third aspect of the present disclosure, an electronic device is provided, comprising:

[0053] processor;

[0054] Memory used to store processor-executable instructions;

[0055] The processor is configured to execute any of the display methods described in the first aspect above.

[0056] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, comprising:

[0057] When the computer program or instructions in the storage medium are executed by a processor, the steps of any of the display methods described in the first aspect above are implemented.

[0058] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising:

[0059] When the computer program or instructions are executed by the processor, they implement the steps of any of the display methods described in the first aspect above.

[0060] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0061] In this embodiment, when an electronic device continuously displays an image with a fixed brightness, the lifespan of the light-emitting organism used for display in the electronic device decreases, causing screen burn-in. Therefore, the image brightness of the background layer with a low change frequency is dynamically adjusted based on the image brightness of the content layer with a high change frequency. This ensures that the image brightness of the background layer also changes when the electronic device displays the image to be displayed, reducing the situation where the electronic device continuously displays the background layer with a low change frequency, thereby reducing the screen burn-in caused by the continuous operation of the light-emitting organism in the electronic device.

[0062] Furthermore, the image to be displayed on the electronic device is composed of a content layer and a background layer with adjusted image brightness. The image brightness of the background layer is adjusted based on the image brightness of the content layer. Compared with the display image composed of a background layer with fixed image brightness and a content layer with varying image brightness, the overall brightness of the image is more harmonious, which improves the visual effect of the composite image displayed on the electronic device.

[0063] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0064] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0065] Figure 1 This is a schematic diagram of an electronic device after screen burn-in, according to an exemplary embodiment.

[0066] Figure 2 This is a flowchart illustrating a display method according to an exemplary embodiment.

[0067] Figure 3 This is a framework diagram illustrating an electronic device performing a display method according to an exemplary embodiment.

[0068] Figure 4 This is a schematic diagram of an electronic device display screen according to an exemplary embodiment.

[0069] Figure 5 This is a partial schematic diagram illustrating an electronic device display screen according to an exemplary embodiment.

[0070] Figure 6 This is a schematic diagram illustrating the effect of adjusting a background layer according to an exemplary embodiment.

[0071] Figure 7 This is a structural diagram of a display device according to an exemplary embodiment.

[0072] Figure 8 This is a structural block diagram of an electronic device according to an exemplary embodiment. Detailed Implementation

[0073] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0074] Figure 1 This is a schematic diagram of an electronic device after screen burn-in, according to an exemplary embodiment. For example... Figure 1 As shown, after the electronic device 10 continuously displays the same image for a long time, the corresponding light-emitting organism works for an extended period of time, resulting in a reduction in the lifespan of the light-emitting organism. This causes a circular dark spot 11 to form on the screen of the electronic device 10, which is a screen burn-in phenomenon.

[0075] Based on this Figure 2This is a flowchart illustrating a display method according to an exemplary embodiment. For example... Figure 2 As shown, the display method mainly includes the following steps:

[0076] In step 201, the background layer and content layer of the image to be displayed are obtained; wherein, the background layer changes less frequently in the image sequence associated with the image to be displayed than the content layer changes less frequently in the image sequence.

[0077] In step 202, the image brightness of the content layer is determined based on the pixel values ​​of each pixel in the content layer;

[0078] In step 203, the image brightness of the background layer is adjusted based on the image brightness of the content layer;

[0079] In step 204, the content layer and the background layer with adjusted image brightness are composited to obtain the composite display image and then displayed.

[0080] It should be noted that the display method can be applied to electronic devices. Here, electronic devices can include terminal devices, such as mobile terminals or fixed terminals. Mobile terminals can include devices such as mobile phones, tablets, laptops, and wearable electronic devices. Fixed terminals can include desktop computers, smart TVs, and in-vehicle systems.

[0081] In this embodiment of the disclosure, the display method can be applied to any screen display scenario, such as e-reading and video playback scenarios. For example, a user may use an electronic device to read an e-book for an extended period of time, watch a live stream using video software, or browse short videos using a short video application.

[0082] For example, when a user reads an e-book using a reading application on an electronic device, the background layer of the image to be displayed in the reading application may include a static background, such as page numbers, borders, etc., and the content layer may include dynamically changing content, such as text, images, etc.; or, when a user watches a live stream using a video application, the background layer of the image to be displayed in the short video application may include the live stream background image, status bar, etc., and the content layer may include people, gift effects, bullet comments, etc.; or, when a user browses short videos using a short video application, the background layer may include a solid color background and status bar under landscape or portrait video, and the content layer may include people, scenery, dynamic comments, etc. in the short video. In this embodiment of the disclosure, the number of background layers may be one or more, and the number of content layers may also be one or more.

[0083] In step 201, the electronic device acquiring the background layer and content layer of the image to be displayed includes: after receiving the source data of the image to be displayed, the electronic device transmits the source data to the graphics processing unit (GPU); in the GPU, the source data of the image to be displayed is divided into multiple layers, including a background layer, a content layer, and an overlay effect layer, etc. Here, the GPU is a microprocessor on the electronic device that processes image-related operations, used to construct and render the video information input by the electronic device.

[0084] The background layer can be the bottom layer of the image to be displayed, used to provide the background for the image to be displayed; the content layer can be located on the background layer and contains characters, scenes, etc.; the overlay effect layer can be located on the content layer and used to add visual effects, such as filters and special effects.

[0085] It should be noted that electronic devices can employ image segmentation techniques, such as color-based segmentation, edge-based segmentation, or deep learning-based segmentation algorithms. Based on image segmentation techniques, electronic devices can accurately identify and extract different elements in the image, thereby generating independent background and content layers. Furthermore, in live streaming scenarios, the image captured by the camera can be directly used as the content layer, while preset toolbars and other elements can be used as the background layer.

[0086] It is understood that, in order to facilitate the differentiation and processing of each layer in the future, the GPU can identify the background layer based on the layer type, or it can identify each layer separately. This disclosure does not limit this.

[0087] In this embodiment of the disclosure, the frequency of change of a layer in a sequence of images associated with the images to be displayed is used to indicate how fast or slow the layer changes in the sequence of images based on time sequence.

[0088] In this context, a screen sequence refers to a collection of multiple consecutively displayed screens, each of which is a static image. A screen sequence associated with a screen to be displayed refers to a sequence of screens that are sequentially connected to the screen to be displayed.

[0089] It is understandable that, since the background layer changes less frequently than the content layer in the frame sequence, if the background layer is displayed on the screen of an electronic device for a long time, the light-emitting organism in the screen corresponding to the background layer will continue to work at the same light intensity, which can easily cause screen burn-in and leave a residual image of the background layer on the screen of the electronic device.

[0090] In step 202, after the electronic device layers the screen to be displayed via the GPU, it can transmit the content layer and the background layer to the display service (SurfaceFlinger) in the operating system of the electronic device. The display service then transmits the content layer and the background layer to the data processing unit (DPU). The electronic device analyzes the content layer through the DPU and determines the image brightness of the content layer based on the pixel values.

[0091] Among them, the DPU of electronic devices can be tightly integrated with GPU and central processing unit (CPU) to form a high-efficiency data processing system for specific types of data processing tasks, such as machine learning, deep learning and data analysis.

[0092] It should be noted that during image processing, electronic devices perform data processing based on the pixel values ​​of each pixel in the layer. Each pixel has one or more pixel values, which are used to indicate information such as the color and brightness of the corresponding pixel.

[0093] For example, for a grayscale image, each pixel has one pixel value, which represents the brightness of that pixel; for a color image, each pixel may have three or four pixel values, which are used to represent the intensity values ​​of the three color channels: red, green, and blue, or the intensity values ​​of the four channels: red, green, blue, and alpha.

[0094] The intensity value of each channel can be represented by an 8-bit binary number, meaning the value of each channel varies between 0 and 255. 0 indicates that the color channel has no intensity, and 255 indicates that the color channel has reached its maximum intensity. For example, in a grayscale image, a pixel with a value of 0 is black, and a pixel with a value of 255 is white.

[0095] It should be noted that the brightness of a pixel can be determined based on its pixel value.

[0096] For example, in a grayscale image, the pixel value of a pixel is equal to its brightness; in a color image, brightness can be obtained by calculating the weighted sum of the values ​​of the three RGB color channels, where the weight values ​​can be determined based on the differences in human eye sensitivity to different colors. For instance, if the human eye has a sensitivity of 0.3 to red, 0.59 to green, and 0.11 to blue, then the brightness of a pixel in a color image is equal to the sum of 0.3R, 0.59G, and 0.11B.

[0097] In this embodiment of the disclosure, the image brightness of the content layer is determined based on the pixel values ​​of each pixel in the content layer. This can be achieved by traversing each pixel in the content layer, determining the average pixel value of the content layer based on the total pixel value and the number of pixels, and then determining the average brightness based on the average pixel value. Alternatively, different content layers can be weighted, and the pixel value of each content layer can be calculated separately. The weighting can be based on the size of the pixel values ​​of each content layer, with larger pixel values ​​having greater weights. The pixel value of each layer is multiplied by the corresponding weight, and then the weighted average brightness is determined based on the weighted pixel values.

[0098] In step 203, adjusting the image brightness of the background layer based on the image brightness of the content layer can be done by directly adjusting the image brightness of the background layer based on the image brightness of the content layer; it can also be done by adjusting the image brightness of the background layer based on the image brightness of the content layer and the contrast between the content layer and the background layer; or it can be done by combining the image brightness of the content layer with the screen brightness, etc. This embodiment of the disclosure does not impose any limitations.

[0099] For example, adjusting the image brightness of the background layer directly based on the image brightness of the content layer includes: adjusting the image brightness of the background layer proportionally or by an equal amount based on the changes in image brightness of the content layer in different frame sequences. When the image brightness of the content layer increases, the image brightness of the background layer increases; when the image brightness of the content layer decreases, the image brightness of the background layer decreases.

[0100] Alternatively, based on the image brightness of the content layer and the preset contrast between the content layer and the background layer, adjusting the image brightness of the background layer includes: dividing the image brightness of the content layer by its contrast to equal the image brightness of the background layer.

[0101] Alternatively, determining the image brightness of the background layer based on the image brightness of the content layer and the screen brightness includes: setting different adjustment strategies based on the screen brightness, such as reducing the image brightness of the background layer according to the image brightness of the content layer when the screen brightness is lower than a preset brightness threshold (e.g., 50%); and increasing the image brightness of the background image according to the image brightness of the content layer when the screen brightness is higher than the preset brightness threshold.

[0102] In step 204, the compositing based on the content layer and the background layer after image brightness adjustment includes: overlaying the content layer on the background layer after image brightness adjustment; or, adjusting the transparency of the content layer and overlaying the adjusted content layer on the background layer after image brightness adjustment, so that the content layer and the background layer are partially blended to form a gradient effect, etc. The embodiments of this disclosure do not limit this.

[0103] The electronic device uses the display service in the operating system to composite the content layer and the background layer with adjusted image brightness to obtain the composite display image and then displays it.

[0104] For example, in the Android operating system, the display service is used to manage the graphics buffer, composite the layers of different applications into a display screen, and improve rendering performance using hardware acceleration; in the Windows operating system, the Desktop Window Manager (DWM) is responsible for compositing window displays, transparency effects, 3D visual effects, etc.

[0105] In this embodiment, when an electronic device continuously displays an image with a fixed brightness, the lifespan of the light-emitting organism used for display in the electronic device decreases, causing screen burn-in. Therefore, the image brightness of the background layer with a low change frequency is dynamically adjusted based on the image brightness of the content layer with a high change frequency. This ensures that the image brightness of the background layer also changes when the electronic device displays the image to be displayed, reducing the situation where the electronic device continuously displays the background layer with a low change frequency, thereby reducing the screen burn-in caused by the continuous operation of the light-emitting organism in the electronic device.

[0106] Furthermore, the image to be displayed on the electronic device is composed of a content layer and a background layer with adjusted image brightness. The image brightness of the background layer is adjusted based on the image brightness of the content layer. Compared with the display image composed of a background layer with fixed image brightness and a content layer with varying image brightness, the overall brightness of the image is more harmonious, which improves the visual effect of the composite image displayed on the electronic device.

[0107] In some embodiments, the display method further includes:

[0108] Get the screen brightness for displaying the image to be shown;

[0109] Adjust the image brightness of the background layer based on the image brightness of the content layer, including:

[0110] Adjust the image brightness of the background layer based on the screen brightness and the image brightness of the content layer.

[0111] In this embodiment of the disclosure, the screen brightness for displaying the image to be displayed refers to the light intensity emitted by the screen of the electronic device when displaying the image to be displayed. It can be set by the user or automatically adjusted by the electronic device according to the light intensity of the surrounding environment.

[0112] It should be noted that since screen brightness is related to the current controlling the light-emitting elements (such as LEDs), obtaining real-time brightness requires information from the hardware layer.

[0113] For example, screen brightness can be obtained through the interface provided by the Hardware Abstraction Layer (HAL), which is an intermediate layer between the operating system of an electronic device and the hardware, and is used to provide an interaction interface for the operating system; or, screen properties can be obtained through the operating system's Application Programming Interface (API).

[0114] Screen brightness can be expressed as a percentage or a specific value, such as 0% to 100%, 0 to 255, or 0 nits to 1000 nits.

[0115] In this embodiment of the disclosure, the image brightness of the background layer is adjusted based on the screen brightness and the image brightness of the content layer. This adjustment can be based on a learning model or a lookup table, etc.

[0116] For example, adjusting the image brightness of the background layer based on a learning model includes: preparing a dataset containing different screen brightness levels, the image brightness of the content layer, and the image brightness of the background layer; labeling the dataset to determine the required image brightness of the background image under different brightness conditions; performing feature extraction to extract brightness-related features from the image data of the displayed image, such as screen brightness, the brightness distribution of the content layer, and the brightness distribution of the background layer, and using these features as input to the model to train the learning model to learn the rules of brightness adjustment; selecting a machine learning model or deep learning model, such as a convolutional neural network or a regression model; and through iterative optimization, enabling the learning model to accurately predict and output the image brightness of the background layer based on the input screen brightness and the image brightness of the content layer.

[0117] Alternatively, adjusting the image brightness of the background layer based on a lookup table includes: generating a lookup table for the image brightness of the background layer based on the screen brightness and the image brightness of the content layer; transforming each pixel of the background layer using the lookup table to obtain a new pixel value; and determining the image brightness of the background layer based on the new pixel value corresponding to the background layer.

[0118] Here, a lookup table is a pre-computed mapping table used to map input pixel values ​​to output pixel values, where each input pixel value corresponds to one output pixel value. The transformation of pixel values ​​can be quickly achieved through the lookup table.

[0119] Understandably, electronic devices determine a brightness adjustment baseline based on the image brightness of the content layer, which can be achieved by calculating the average or weighted average of the pixel values ​​of the content layer. Then, combined with the current screen brightness settings, the image brightness of the background layer is adjusted.

[0120] In some embodiments, if the screen brightness and the image brightness of the content layer are low, the image brightness of the background layer can be increased to maintain the overall brightness of the screen; if the screen brightness and the image brightness of the content layer are high, the image brightness of the background layer can be reduced to reduce the impact of high brightness display on the user's vision.

[0121] In other embodiments, if the screen brightness and the image of the content layer are high, the image brightness of the background layer can be reduced to increase the contrast between the content layer and the background layer, thereby improving the user's visual experience; if the screen brightness and the image brightness of the content layer are low, the image brightness of the background layer can be increased, which can also increase the contrast between the content layer and the background layer, thereby improving the user's visual experience.

[0122] In this embodiment of the disclosure, since screen burn-in is caused by displaying the same image for a long time, the display time of static images (such as the background layer) in the screen can be reduced by dynamically adjusting the image brightness of the background layer, thereby reducing the risk of screen burn-in. Furthermore, by combining the screen brightness and the image brightness of the content layer to adjust the image brightness of the background layer, the influence of the screen brightness and the image brightness of the content layer on the image brightness of the background layer is taken into account. This adjusts the brightness of the screen to be displayed based on the content image and the background layer, which can also improve the display effect of the screen to be displayed and the user's visual experience.

[0123] In some embodiments, adjusting the image brightness of the background layer based on the screen brightness and the image brightness of the content layer includes:

[0124] Based on screen brightness and image brightness of the content layer, determine the display brightness of the content layer based on screen brightness;

[0125] Adjust the image brightness of the background layer based on the screen brightness and the display brightness of the content layer.

[0126] Understandably, since the image brightness of a content layer is a parameter corresponding to the pixel values ​​of the content layer, and the screen brightness affects the image brightness of the content layer when the content layer is displayed on the screen, for example, when the screen brightness decreases, the display brightness of the content layer based on the screen brightness will decrease; when the screen brightness increases, the display brightness of the content layer based on the screen brightness will increase.

[0127] It should be noted that the determination of the display brightness of the content layer based on the screen brightness and the image brightness of the content layer may be based on a learning model or a lookup table, etc., and this disclosure does not limit this.

[0128] For example, determining the display brightness of a content layer based on a learning model includes: preparing a dataset containing different screen brightness levels, the image brightness of the content layer, and the display brightness of the content layer; using features such as screen brightness, the brightness distribution of the content layer, and the brightness distribution of the background layer in the dataset as input to the model for training and adjusting the model to learn the rules of brightness adjustment; selecting a machine learning model or a deep learning model; and through iterative optimization, enabling the learning model to accurately predict and output the display brightness of the content layer based on the input screen brightness and the image brightness of the content layer.

[0129] Alternatively, determining the display brightness of the content layer based on a lookup table includes: generating a lookup table for the display brightness of the content layer based on the screen brightness and the image brightness of the content layer; transforming each pixel of the content layer using the lookup table to obtain a new pixel value; and determining the display brightness of the content layer based on the new pixel value corresponding to the content layer.

[0130] In this embodiment of the disclosure, adjusting the image brightness of the background image based on the screen brightness and the display brightness of the content layer includes: determining the image brightness of the background image based on a linear transformation, or determining the image brightness of the background image based on a nonlinear transformation.

[0131] For example, determining the image brightness of the background image based on a linear transformation includes: setting a linear transformation formula, such as Y = aX + b, where a is a contrast adjustment coefficient and b is a brightness adjustment coefficient. a can be set according to a preset contrast threshold between the image brightness of the content layer and the image brightness of the background image, and b can be set according to the screen brightness. X is the image brightness of the content layer, and Y is the image brightness of the background image. The image brightness of the background layer is determined based on the image brightness of the content layer and the background brightness.

[0132] Alternatively, determining the image brightness of the background image based on nonlinear transformation includes: transforming the image brightness of the content layer based on logarithmic or exponential functions, and determining the image brightness of the background image based on the screen brightness, the image brightness of the content layer, and the nonlinear function.

[0133] In this embodiment, the display time of static images is reduced: by dynamically adjusting the brightness of the background layer, the display time of static images (such as the background) in the screen can be indirectly reduced. This helps to reduce the risk of screen burn-in caused by displaying static images for extended periods. By combining screen brightness and content layer brightness to adjust the brightness of the background layer, it is possible to ensure that the overall brightness of the screen remains balanced. This not only reduces the risk of screen burn-in but also maintains a good visual effect under different brightness conditions, improving the display effect and user experience.

[0134] In some embodiments, determining the display brightness of the content layer based on the screen brightness and the image brightness of the content layer includes:

[0135] The image brightness of the content layer is normalized to obtain the normalized image brightness of the content layer;

[0136] Based on the first preset mapping relationship and the normalized image brightness of the content layer, the normalized display brightness of the content layer is determined; wherein, the first preset mapping relationship includes a first correspondence between the normalized display brightness and the normalized image brightness;

[0137] The display brightness of the content layer is determined by multiplying the normalized display brightness of the content layer by the screen brightness.

[0138] In this embodiment of the disclosure, the normalization processing of the brightness of the content layer image is intended to convert the brightness value of the content layer image into a standard range (such as 0 to 1 or 0 to 255) to facilitate subsequent processing and comparison.

[0139] For example, when the image brightness value of the content layer is represented based on an 8-bit binary number, it ranges from 0 to 255, and the normalized image brightness of the content layer ranges from 0 to 1.

[0140] It should be noted that the first preset mapping relationship is a predefined correspondence used to convert normalized image brightness into normalized display brightness. The first preset mapping relationship can be a lookup table, a mathematical function, or an algorithm. Electronic devices can convert the normalized image brightness of the content layer into the normalized display brightness of the background layer based on the first preset mapping relationship.

[0141] In this embodiment of the disclosure, the normalized display brightness of the content layer is determined based on the normalized image brightness of the content layer and a first preset mapping relationship. Then, the product of the normalized display brightness and the screen brightness is used as the display brightness of the content layer, that is, the normalized display brightness of the content image is reverse-normalized to determine the display brightness of the content layer under the influence of the screen brightness.

[0142] For example, when the first preset mapping relationship is an exponential function based on gamma values, the display brightness of the content layer is determined as shown in formula (1):

[0143]

[0144] In formula (1), Lv G Lv is the display brightness of the content layer; G is the screen brightness; N is the image brightness of the content layer; M is the maximum brightness value; and M is the gamma value. Normalize the display brightness for the content layer; Normalized image brightness for the content layer.

[0145] It should be noted that the maximum brightness value is determined based on the number of bits in the brightness value. For example, when the brightness value is represented by an 8-bit binary number, the maximum brightness value is 255; when the brightness value is represented by a 16-bit binary number, the maximum brightness value is 65535.

[0146] Gamma value is a physical property of a display, used to indicate the distortion of the input signal when the display of an electronic device outputs an image. Specifically, when the image brightness of the content layer is the input signal, the displayed brightness of the content layer will change non-linearly based on the gamma value due to distortion when the display outputs the image. Therefore, the displayed brightness of the content layer can be determined based on its image brightness and gamma value.

[0147] The gamma value of the display screen may vary between different electronic devices. For example, the gamma value may range from 0.1 to 5, but this disclosure does not limit this range.

[0148] In this embodiment of the disclosure, the electronic device normalizes the image brightness of the content layer to convert it into a relatively stable range, which facilitates the subsequent determination of the normalized display brightness of the content layer based on the normalized image brightness of the content layer. Furthermore, determining the display brightness of the content layer based on the normalized display brightness of the content layer can improve the accuracy of adjusting the image brightness of the background layer based on the display brightness of the content layer.

[0149] In some embodiments, adjusting the image brightness of the background layer based on the screen brightness and the display brightness of the content layer includes:

[0150] The display brightness of the background layer is determined based on the display brightness of the content layer and the preset contrast weight value;

[0151] The ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer.

[0152] Based on the second preset mapping relationship and the normalized display brightness of the background layer, the normalized image brightness of the background layer is determined; wherein, the second preset mapping relationship includes a second correspondence between the normalized display brightness and the normalized image brightness;

[0153] The normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

[0154] In this embodiment of the disclosure, a preset contrast weight value is used to adjust the contrast between the background layer and the content layer, and the display brightness of the background layer can be determined based on the product of the display brightness of the content layer and the preset contrast weight value.

[0155] The contrast weight value can be preset according to the characteristics of the display device and the user's visual preferences.

[0156] Since the display brightness of the background layer is the brightness of the background layer's image as displayed on the screen, the normalized display brightness of the background layer can be determined based on the ratio of the background layer's display brightness to the screen brightness. Normalized display brightness helps convert the background layer's display brightness into a relatively stable range, facilitating subsequent processing and comparison.

[0157] It should be noted that the second preset mapping relationship is a predefined correspondence used to convert normalized display brightness into normalized image brightness. The second preset mapping relationship can be a lookup table, a mathematical function, or an algorithm. Electronic devices can convert the normalized display brightness of the background layer into the normalized image brightness of the background layer based on the second preset mapping relationship.

[0158] The first preset mapping relationship and the second preset mapping relationship can be the same or different, and this embodiment does not impose any restrictions on this. When the first preset mapping relationship and the second preset mapping relationship are the same, the first correspondence relationship and the second correspondence relationship are the same; when the first preset mapping relationship and the second preset mapping relationship are different, the first correspondence relationship and the second correspondence relationship are different.

[0159] In some embodiments, the first preset mapping relationship and the second preset mapping relationship are different. Due to the influence of screen brightness, the display brightness of the background layer on the screen differs from the image brightness.

[0160] It is understandable that the degree to which the image brightness of the content layer is affected by the screen brightness may differ from that of the background layer. When the second preset mapping relationship better matches the second correspondence between the normalized display brightness and the normalized image brightness of the background layer, converting the display brightness of the background image to the image brightness of the background image based on the second preset mapping relationship can improve the accuracy of the conversion.

[0161] In other embodiments, the first preset mapping relationship and the second preset mapping relationship are the same. Then, the electronic device adjusts the image brightness of the background layer based on the screen brightness and the display brightness of the content layer, including: the electronic device determines the display brightness of the background layer based on the display brightness of the content layer and a preset contrast weight value; the ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer; the normalized image brightness of the background layer is determined based on the first preset mapping relationship and the normalized display brightness of the background layer; and the normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

[0162] Understandably, within the same electronic device, the normalized image brightness of the content layer is converted into the normalized display brightness of the background layer based on the same first preset mapping relationship. The display brightness of the content layer is then determined based on this normalized display brightness. Next, the display brightness of the background layer is determined based on the display brightness of the content layer, and its normalized display brightness is determined based on this display brightness. Finally, the normalized display brightness of the background layer is converted into the normalized image brightness of the background layer based on the first preset mapping relationship, and the image brightness of the background layer is determined based on this normalized image brightness. This improves the matching accuracy of determining the image brightness of the background layer based on the image brightness of the content layer.

[0163] In this embodiment of the disclosure, the denormalization process of the normalized image brightness of the background layer includes: multiplying the normalized image brightness of the background layer by the screen brightness to determine the image brightness of the background layer; or, multiplying the normalized image brightness of the background layer by the maximum screen brightness to determine the image brightness of the background layer.

[0164] It should be noted that once the electronic device obtains the image brightness of the background layer, it can use it for subsequent image display or processing.

[0165] In this embodiment of the disclosure, when the first preset mapping relationship and the second preset mapping relationship are the same and both are exponential functions based on gamma values, the image brightness of the background layer is determined as shown in formula (2):

[0166]

[0167] In formula (2), Lv G I is the display brightness of the content layer; Lv is the contrast weight value; J is the image brightness of the content layer; N is the maximum brightness value; M is the gamma value; Lv G *I represents the display brightness of the background layer; Normalize the display brightness of the background layer; This is the normalized image brightness of the background layer.

[0168] In formulas (1) and (2), the gamma value and the maximum brightness value are the same.

[0169] In this embodiment of the disclosure, the electronic device normalizes the screen brightness of the background layer to convert it into a relatively stable range, which facilitates the subsequent determination of the normalized image brightness of the background layer based on the normalized screen brightness of the background layer. Furthermore, determining the image brightness of the background layer based on the normalized image brightness of the background layer can improve the accuracy of subsequent adjustments to the background image brightness, effectively reduce screen burn-in caused by the electronic device continuously displaying the same image at the same brightness, and improve the screen lifespan of the electronic device.

[0170] In some embodiments, a composite image is obtained by combining a content layer and a background layer with adjusted image brightness, and then displayed, including:

[0171] Post-processing is performed on the content layer and the background layer after image brightness adjustment to obtain the post-processed content layer and the post-processed background layer.

[0172] The post-processed content layer and the post-processed background layer are composited to obtain the composite display image.

[0173] In this embodiment of the disclosure, the electronic device can perform image post-processing on the content layer and the background layer after image brightness adjustment in the DPU.

[0174] It should be noted that image post-processing includes image processing techniques such as Spatial Temporal Correction (STC). The image post-processing process performed on the content layer can be the same as or different from the image post-processing process performed on the background layer after adjusting the image brightness; this disclosure does not impose any limitations on this.

[0175] For example, image post-processing for the content layer includes: using a sharpening algorithm to enhance image edges and make the content stand out more; using a denoising algorithm to reduce noise in the image and improve clarity; and using a color correction algorithm to adjust the color balance and saturation of the image to make it more natural.

[0176] This enhances the image quality of the content layer, making it clearer and sharper, while reducing noise and distortion.

[0177] Post-processing of the background layer after adjusting the image brightness includes: further adjusting parameters such as contrast and color saturation of the background layer; and using smoothing algorithms to reduce details in the background layer and reduce the visual abruptness of the background layer.

[0178] This allows the background layer and content layer to be more coordinated, while reducing screen burn-in caused by displaying the same background layer for a long time.

[0179] In this embodiment of the disclosure, the post-processed content layer and the post-processed background layer are composited, including using techniques such as layer mixing and transparency adjustment to make the two layers visually blend together.

[0180] The composited display image is sent to a display service for display, allowing users to view the composited image on their electronic device screens.

[0181] In this embodiment of the disclosure, by post-processing the content layer and the background layer after adjusting the image brightness, not only can the quality of the displayed image be optimized, making it clearer, sharper and more natural, but also the screen burn-in phenomenon caused by displaying the same background layer for a long time can be reduced, thereby extending the service life of the electronic device's display screen.

[0182] In some embodiments, the background layer is the layer containing the toolbar and / or status bar of the screen to be displayed; the content layer is the layer containing the captured image.

[0183] In scenarios where users conduct live streaming using short video applications, the content layer is the layer containing images captured in real-time by the camera of the electronic device or an image acquisition device connected to the electronic device and transmitted to the short video application. This content layer is the display screen that needs to be shown in the live stream, used to display the user's real-time image.

[0184] The background layer is the layer containing the toolbar and / or status bar of the screen to be displayed. The toolbar layer contains buttons, menus, etc. that provide user interaction functions during the live broadcast. The status bar layer contains the layer that displays the live broadcast status, notification information, etc.

[0185] In this embodiment of the disclosure, the electronic device acquires images in real time, determines the image brightness of the acquired images based on the image data of the acquired images, adjusts the image brightness of the status bar and / or toolbar in real time based on the image brightness of the acquired images, and synthesizes the acquired images, status bar and toolbar to obtain the synthesized display screen for live broadcast.

[0186] Understandably, adjusting the brightness of the status bar and / or toolbar based on the brightness of the captured image ensures that the brightness of the status bar and / or toolbar changes even during extended live streaming on the electronic device, reducing screen burn-in. Furthermore, the live stream displayed on the electronic device is a composite of the captured image and the status bar and / or toolbar after brightness adjustments, resulting in more uniform overall brightness and improved visual quality.

[0187] To better understand the above one or more embodiments, examples of embodiments of this disclosure are as follows:

[0188] Figure 3 This is a framework diagram illustrating an electronic device performing a display method according to an exemplary embodiment. Figure 3 As shown, the electronic device acquires the video source 301 to be played from the short video application, transmits the video source 301 to the image processor 30, analyzes the data of the video source 301, determines the animation effects 302, buttons 303, and marks each layer 304, and renders each layer based on the analysis results to generate each layer 305, and transmits each layer 305 to the graphics buffer of the display service 31.

[0189] Display service 31 transmits the first content layer 306, the second content layer 307, and the background layer 308 to data processor 32.

[0190] Data processor 32 calculates the average grayscale value 309 of the first content layer 306 and the second content layer 307, obtains the screen brightness 310, and adjusts the grayscale value 311 of the background layer based on the average grayscale value 309 of the content layers and the screen brightness 310. Data processor 32 transmits the background layer and content layer with adjusted image grayscale values ​​to display service 31.

[0191] It should be noted that the data processor 32 can adjust the grayscale value 311 of the background layer based on the Piecewise Cubic Correction (PCC) module in the Color Lookup Table and Spatial Correction (CLSTC) module of the data processor 32.

[0192] Display service 31 composites the content layer and the background layer after adjusting the image brightness to obtain the composite display image and then displays it.

[0193] Figure 4 This is a schematic diagram of an electronic device display screen according to an exemplary embodiment. Figure 5 This is a partial schematic diagram illustrating a display screen of an electronic device according to an exemplary embodiment. For example... Figure 4 and Figure 5 As shown:

[0194] When a user browses short videos using a short video application, the background layer 402 of the image to be displayed may include: a solid color background in landscape mode, and a toolbar background; the content layer 401 of the image to be displayed may include: scenery such as mountains and flowers in the video, user avatars, like, comment, and share buttons, etc. The electronic device adjusts the brightness of the background layer 402 based on the brightness of the content layer 401.

[0195] It should be noted that electronic devices can adjust one of the background layers based on the identifiers of each background layer. For example, Figure 5 for Figure 4 A partial schematic diagram of the shooting button in the toolbar within the dashed box 403. Figure 4 In the middle, the shutter button is the background layer, and the grayscale (brightness) of the shutter button area 403 is 255, while... Figure 5 In the adjusted shooting button area 501, the grayscale relative Figure 4 The grayscale level is reduced.

[0196] Figure 6 This is a schematic diagram illustrating the effect of adjusting a background layer according to an exemplary embodiment. For example... Figure 6 As shown, the display screen includes a content layer (video image) as shown in 601 and a background layer as shown in 602. Because the brightness of the content layer is low, the brightness of the background layer is also reduced.

[0197] Figure 7 This is a structural diagram of a display device according to an exemplary embodiment. Figure 7 As shown, the display device 700 includes:

[0198] The first acquisition module 701 is configured to acquire the background layer and content layer of the screen to be displayed; wherein the background layer changes less frequently in the screen sequence associated with the screen to be displayed than the content layer changes less frequently in the screen sequence.

[0199] The first determining module 702 is configured to determine the image brightness of the content layer based on the pixel values ​​of each pixel in the content layer.

[0200] The first adjustment module 703 is configured to adjust the image brightness of the background layer based on the image brightness of the content layer.

[0201] Compositing module 704 is configured to composite based on the content layer and the background layer after image brightness adjustment, to obtain and display the composited display image.

[0202] In some embodiments, the display device 700 further includes:

[0203] The second acquisition module is configured to acquire the screen brightness of the image to be displayed;

[0204] The first adjustment module 703 also includes:

[0205] The second adjustment module is configured to adjust the image brightness of the background layer based on the screen brightness and the image brightness of the content layer.

[0206] In some embodiments, the second adjustment module further includes:

[0207] The second determining module is configured to determine the display brightness of the content layer based on the screen brightness and the image brightness of the content layer.

[0208] The third adjustment module is configured to adjust the image brightness of the background layer based on the screen brightness and the display brightness of the content layer.

[0209] In some embodiments, the second determining module is further configured to normalize the image brightness of the content layer to obtain the normalized image brightness of the content layer.

[0210] Based on the first preset mapping relationship and the normalized image brightness of the content layer, the normalized display brightness of the content layer is determined; wherein, the first preset mapping relationship includes a first correspondence between the normalized display brightness and the normalized image brightness;

[0211] The display brightness of the content layer is determined by multiplying the normalized display brightness of the content layer by the screen brightness.

[0212] In some embodiments, the third adjustment module is further configured to determine the display brightness of the background layer based on the display brightness of the content layer and a preset contrast weight value;

[0213] The ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer.

[0214] Based on the second preset mapping relationship and the normalized display brightness of the background layer, the normalized image brightness of the background layer is determined; wherein, the second preset mapping relationship includes a second correspondence between the normalized display brightness and the normalized image brightness;

[0215] The normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

[0216] In some embodiments, the compositing module 704 is further configured to perform image post-processing on the content layer and the background layer after image brightness adjustment, respectively, to obtain the post-processed content layer and the post-processed background layer.

[0217] The post-processed content layer and the post-processed background layer are composited to obtain the composite display image.

[0218] In some embodiments, the background layer is the layer containing the toolbar and / or status bar of the screen to be displayed; the content layer is the layer containing the captured image.

[0219] Figure 8This is a structural block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0220] Reference Figure 8 The electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input / output (I / O) interface 812, sensor component 814, and communication component 816.

[0221] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with at least one of display, telephone call, data communication, camera operation, and recording operation. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0222] Memory 804 is configured to store various types of data to support operation on electronic device 800. Examples of such data include at least one of the following: instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, and videos. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0223] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0224] Multimedia component 808 includes a screen that provides an output interface between electronic device 800 and user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen may be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When electronic device 800 is in an operating mode, such as a shooting mode or video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0225] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0226] Input / output interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, and buttons. These buttons may include, but are not limited to, home buttons, volume buttons, start buttons, and lock buttons.

[0227] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 may detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or one of its components, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include, but is not limited to, at least one of the following: an accelerometer, a gyroscope, a magnetometer, a pressure sensor, and a temperature sensor.

[0228] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as Wi-Fi, 4G, 5G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.

[0229] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0230] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including executable instructions or a computer program, which can be executed by a processor 820 of an electronic device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0231] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform any of the above-described methods for preventing accidental touches according to embodiments of this disclosure. For example, the method includes:

[0232] Obtain the background layer and content layer of the image to be displayed; wherein the background layer changes less frequently than the content layer in the image sequence associated with the image to be displayed; determine the image brightness of the content layer based on the pixel values ​​of each pixel in the content layer; adjust the image brightness of the background layer based on the image brightness of the content layer; composite the content layer and the background layer with adjusted image brightness to obtain the composite display image and display it.

[0233] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the display methods described above in this disclosure.

[0234] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0235] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A display method, characterized in that, include: Obtain the background layer and content layer of the image to be displayed; wherein the background layer changes less frequently in the image sequence associated with the image to be displayed than the content layer changes less frequently in the image sequence. The image brightness of the content layer is determined based on the pixel values ​​of each pixel in the content layer; Adjust the image brightness of the background layer based on the image brightness of the content layer; The content layer and the background layer with adjusted image brightness are combined to obtain the composite display image, which is then displayed.

2. The method according to claim 1, characterized in that, The method further includes: Obtain the screen brightness for displaying the image to be displayed; Adjusting the image brightness of the background layer based on the image brightness of the content layer includes: Adjust the image brightness of the background layer based on the screen brightness and the image brightness of the content layer.

3. The method according to claim 2, characterized in that, Adjusting the image brightness of the background layer based on the screen brightness and the image brightness of the content layer includes: Based on the screen brightness and the image brightness of the content layer, determine the display brightness of the content layer based on the screen brightness; Adjust the image brightness of the background layer based on the screen brightness and the display brightness of the content layer.

4. The method according to claim 3, characterized in that, Determining the display brightness of the content layer based on the screen brightness and the image brightness of the content layer includes: The image brightness of the content layer is normalized to obtain the normalized image brightness of the content layer; Based on the first preset mapping relationship and the normalized image brightness of the content layer, the normalized display brightness of the content layer is determined; wherein, the first preset mapping relationship includes a first correspondence between the normalized display brightness and the normalized image brightness; The display brightness of the content layer is determined by multiplying the normalized display brightness of the content layer by the screen brightness.

5. The method according to claim 3, characterized in that, Adjusting the image brightness of the background layer based on the screen brightness and the display brightness of the content layer includes: The display brightness of the background layer is determined based on the display brightness of the content layer and a preset contrast weight value. The ratio of the display brightness of the background layer to the screen brightness is determined as the normalized display brightness of the background layer; Based on the second preset mapping relationship and the normalized display brightness of the background layer, the normalized image brightness of the background layer is determined; wherein, the second preset mapping relationship includes a second correspondence between the normalized display brightness and the normalized image brightness; The normalized image brightness of the background layer is denormalized to obtain the image brightness of the background layer.

6. The method according to claim 1, characterized in that, The process of compositing the content layer and the background layer after adjusting the image brightness to obtain and display the composited display image includes: Image post-processing is performed on the content layer and the background layer after image brightness adjustment, respectively, to obtain the post-processed content layer and the post-processed background layer; The post-processed content layer and the post-processed background layer are composited to obtain the composite display image, which is then displayed.

7. The method according to any one of claims 1 to 6, characterized in that, The background layer is the layer containing the toolbar and / or status bar of the screen to be displayed; the content layer is the layer containing the captured image.

8. A display device, characterized in that, include: The first acquisition module is configured to acquire the background layer and content layer of the screen to be displayed; wherein the background layer changes less frequently in the screen sequence associated with the screen to be displayed than the content layer changes less frequently in the screen sequence. The first determining module is configured to determine the image brightness of the content layer based on the pixel values ​​of each pixel in the content layer; The first adjustment module is configured to adjust the image brightness of the background layer based on the image brightness of the content layer; The compositing module is configured to composite the content layer and the background layer with adjusted image brightness to obtain and display the composited display image.

9. An electronic device, characterized in that, The electronic device includes at least: processor; Memory used to store processor-executable instructions; The processor is configured to perform the display method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing a computer program or instructions, characterized in that, When the computer program or instructions in the storage medium are executed by a processor, the steps of the display method according to any one of claims 1 to 7 are implemented.

11. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, they implement the steps of the display method according to any one of claims 1 to 7.

Images