Display method and electronic equipment

Abstract

A display method and an electronic device relate to the technical field of terminals. In the method, the electronic equipment obtains interface content of a to-be-displayed target interface; wherein the target interface comprises a high dynamic range (HDR) region and a standard dynamic range (SDR) region. The electronic equipment obtains a system backlight value of the display screen, and the system backlight value is increased to the first backlight value; and the electronic equipment reduces the gray-scale value corresponding to the interface content in the SDR area to the first gray-scale value. And the electronic equipment maps the display parameters corresponding to the interface content in the HDR area to a reference display range of the HDR supported by the display screen. And the electronic equipment displays the target interface. By means of the method, the display effect of the interface content in the SDR area can be reserved, and the brightness and chromaticity advantages of the interface content in the HDR area can be exerted to the maximum extent. Meanwhile, the phenomenon of overexposure of the bright part of the interface content in the HDR area is avoided, and the visual experience of a user is improved.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a display method and an electronic device. Background Technology

[0002] Compared to the traditional Standard Dynamic Range (SDR), High Dynamic Range (HDR) images can provide more dynamic range and image details. HDR greatly enriches the details in the bright and dark parts of the image by expanding multiple dimensions such as brightness, color and contrast, thereby improving the overall image quality and presenting a better image effect.

[0003] HDR requires that every stage of content production, encoding, transmission, and final display must have corresponding HDR support capabilities. Specifically, on the hardware side, it requires high-performance chips, displays that support HDR display, and light sensors, among other components; on the software side, it involves the optimization and adaptation of the operating system (OS), media processing framework, and applications.

[0004] Currently, an increasing number of electronic devices, such as mobile phones, support HDR content display. In some cases, the display interface of an electronic device will simultaneously display HDR and SDR content. When displaying HDR and SDR content simultaneously, the current solution is to downgrade the HDR content to SDR content processing. This results in the HDR content's advantages in brightness and color, which cannot be fully utilized. At the same time, downgrading HDR to SDR processing often causes the brighter parts of the HDR content to become overexposed and cannot be displayed properly. Summary of the Invention

[0005] This application provides a display method and electronic device that can reduce the grayscale value of the interface content in the SDR area according to the system backlight value of the display screen, while mapping the display parameters of the interface content in the HDR area to the reference display range of the HDR supported by the display screen. This preserves the display effect of the interface content in the SDR area while maximizing the brightness and color advantages of the interface content in the HDR area. At the same time, it avoids overexposure in the brighter parts of the interface content in the HDR area, thus improving the user's visual experience.

[0006] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0007] In a first aspect, embodiments of this application provide a display method applied to an electronic device including a display screen. The method may include: the electronic device acquiring interface content of a target interface to be displayed. The target interface includes a High Dynamic Range (HDR) region and a Standard Dynamic Range (SDR) region. The electronic device acquires the system backlight value of the display screen. Then, the electronic device increases the system backlight value to a first backlight value. The electronic device decreases the grayscale value corresponding to the interface content in the SDR region to a first grayscale value. The electronic device maps the display parameters corresponding to the interface content in the HDR region to a reference display range of HDR supported by the display screen. The electronic device displays the target interface.

[0008] In the above display method, the electronic device acquires the interface content of the target interface to be displayed. The target interface includes a High Dynamic Range (HDR) region and a Standard Dynamic Range (SDR) region. The electronic device acquires the system backlight value of the display screen, increases the system backlight value to a first backlight value, and decreases the grayscale value corresponding to the interface content in the SDR region to the first grayscale value. The electronic device maps the display parameters of the interface content in the HDR region to the reference display range of HDR supported by the display screen. Simultaneously, it avoids overexposure of bright parts in the HDR video caused by downgrading the HDR video to SDR. In this method, the electronic device decreases the grayscale value corresponding to the interface content in the SDR region based on the system backlight value of the display screen, while simultaneously mapping the display parameters of the interface content in the HDR region to the reference display range of HDR supported by the display screen. This allows the SDR content to still display normally under brighter backlight, while the HDR content is presented with optimal brightness and color, maximizing the display effect of the HDR content and achieving high-quality display of interface content in both the HDR and SDR regions on the display screen. At the same time, it avoids overexposure of brighter parts of the interface content in the HDR region, improving the user's visual experience.

[0009] In one feasible approach, during the process of mapping the display parameters corresponding to the interface content within the HDR region to the reference display range of the HDR supported by the display screen, the electronic device maps the brightness corresponding to the interface content within the HDR region to a target brightness range. Here, the target brightness range is the HDR brightness range supported by the display screen. The electronic device also maps the chromaticity corresponding to the interface content within the HDR region to a target color gamut space. Here, the target color gamut space is the HDR color gamut space supported by the display screen.

[0010] In this implementation, the electronic device maps the brightness and chromaticity of the interface content within the HDR area to the HDR brightness range and HDR color gamut space supported by the display screen, respectively. This maximizes the advantages of HDR's brightness and wide color gamut, ensures high-fidelity display of HDR content, fully utilizes the HDR performance of the display screen, and avoids color distortion and overexposure, providing users with a more realistic and delicate visual experience.

[0011] In one feasible approach, during the process of mapping the brightness of interface content within an HDR region to a target brightness range, the electronic device acquires metadata obtained from decoding the interface content within the HDR region. Based on the brightness parameters in the metadata, it maps the brightness of the interface content within the HDR region to the target brightness range. This implementation utilizes the brightness parameters from the metadata obtained after decoding the interface content within the HDR region to achieve brightness mapping, ensuring accurate reproduction of the HDR content's brightness during display and avoiding overexposure.

[0012] In one feasible approach, the brightness parameters include the maximum brightness of the content, transfer function parameters, and a color conversion matrix. During the process of mapping the brightness of the interface content within the HDR region to the target brightness range based on the brightness parameters in the metadata, the electronic device determines the tone mapping curve based on the transfer function parameters and the color conversion matrix. Then, based on the tone mapping curve and the maximum brightness of the content, the electronic device maps the brightness of the interface content within the HDR region to the target brightness range. This implementation ensures that the interface content within the HDR region retains its original brightness and detail when displayed, while avoiding image distortion or overexposure caused by improper brightness mapping.

[0013] In one feasible approach, during the process of mapping the chromaticity of interface content within an HDR region to a target color gamut space, the electronic device acquires metadata obtained from decoding the interface content within the HDR region. The electronic device then uses the color gamut parameters from this metadata to indicate the original color gamut space corresponding to the interface content within the HDR region. Subsequently, based on the conversion relationship between the original and target color gamut spaces, the electronic device maps the chromaticity of the interface content within the HDR region to the target color gamut space. This implementation utilizes the color gamut parameters from the metadata obtained after decoding the interface content within the HDR region to achieve chromaticity mapping of the interface content within the HDR region. This ensures accurate color reproduction of the HDR content during display, avoids color distortion, improves the accuracy and richness of displayed colors, and enhances the user's visual experience.

[0014] In one possible approach, if the display does not support an HDR brightness range, the brightness of the interface content within the HDR area is mapped to the maximum brightness range supported by the display. Alternatively, if the display does not support an HDR color gamut, the chromaticity of the interface content within the HDR area is mapped to the highest color gamut supported by the display. In this implementation, HDR brightness values ​​exceeding the display's brightness capabilities are compressed or adjusted to suit the display's actual capabilities. If the display does not support an HDR color gamut, the electronic device maps the chromaticity of the interface content within the HDR area to the highest color gamut supported by the display to ensure that the interface content within the HDR area can still be displayed with the highest possible color gamut quality under limited conditions.

[0015] In one feasible implementation, during the process of increasing the system backlight value to a first backlight value, the electronic device increases the system backlight value by a factor of N to reach the first backlight value, where N is greater than 1. Then, during the process of decreasing the grayscale value corresponding to the interface content within the SDR area to the first grayscale value, the electronic device decreases the grayscale value corresponding to the interface content within the SDR area by a factor of K to reach the first grayscale value, where K is greater than 1. The difference between K and N is greater than or equal to 0 and less than or equal to a preset threshold. In this implementation, because the difference between K and N is less than or equal to the preset threshold, the display brightness, which is positively correlated with the system backlight size and the grayscale value of the interface content, can be restored as much as possible to the display brightness before the system backlight value was increased. This ensures that the restored display brightness matches the normal display brightness of the SDR, thereby guaranteeing the display effect of the SDR content.

[0016] In one possible implementation, a first backlight value is less than the peak brightness of the display device, where N is an integer, and the value of N is greater than or equal to the first value and less than or equal to a second value. The first value is obtained by rounding down the ratio of the monitor's brightness to the SDR reference white brightness during interface content capture, and the second value is obtained by rounding down the ratio of the display device's peak brightness to the SDR reference white brightness. Alternatively, the first value is obtained by rounding down the ratio of the display device's peak brightness to the real-time peak brightness of the display, and the second value is obtained by rounding down the ratio of the display device's peak brightness to the SDR reference white brightness. This implementation ensures that the brightness of the interface content does not exceed the hardware limitations of the display, allowing the interface content to be displayed normally.

[0017] In one feasible approach, when the electronic device obtains the system backlight value of the display, it acquires the ambient light brightness, determines the screen brightness based on the ambient light brightness, and then determines the system backlight value based on the screen brightness. Alternatively, the electronic device acquires the screen brightness set by the user and determines the system backlight value based on the screen brightness.

[0018] In one possible implementation, the target interface includes a first layer, which includes HDR regions and SDR regions.

[0019] Furthermore, the solution described in this application embodiment enables the application to display using only one layer, which includes both SDR and HDR areas. This allows the application to display the target interface content within the same layer, resulting in better performance and lower power consumption.

[0020] Furthermore, the solution described in this application embodiment can also be used when the electronic device displays using only one layer, which includes both HDR and SDR areas. This allows the electronic device to display the interface content of the target interface within the same layer, resulting in better performance and lower power consumption.

[0021] In one feasible approach, the target interface is an HDR video playback interface, with the HDR area used to play HDR video frames.

[0022] In one feasible approach, the target interface is the interface of a browser application.

[0023] In one possible implementation, the target interface includes a first layer and a second layer, the first layer including an HDR region and the second layer including an SDR region.

[0024] In one possible implementation, the target interface also includes a third layer, which comprises an SDR area.

[0025] In one feasible approach, the interface content of the HDR region is decoded to a Texture. During the process of mapping the display parameters corresponding to the interface content within the HDR region to the reference display range of the HDR supported by the display, the electronic device uses the Texture to map the display parameters corresponding to the interface content within the HDR region to the reference display range of the HDR supported by the display.

[0026] In a second aspect, an electronic device is provided, comprising: a memory and one or more processors; the memory and the processors are coupled; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the display method described in any of the first aspects above.

[0027] Thirdly, a computer-readable storage medium is provided, including computer instructions that, when executed on an electronic device, cause the electronic device to perform the display method described in any of the first aspects above.

[0028] Fourthly, a computer program product is provided that, when run on a computer, causes the computer to perform the display method described in any of the first aspects above.

[0029] Understandably, the beneficial effects that can be achieved by the second to fourth aspects provided above can be referred to the beneficial effects of the first aspect and any of its possible design methods, which will not be repeated here. Attached Figure Description

[0030] Figure 1 This is a schematic diagram of a display scenario provided in an embodiment of this application;

[0031] Figure 2 This is a schematic diagram of an HDR video display scene;

[0032] Figure 3 A schematic diagram of a system architecture provided for an embodiment of this application;

[0033] Figure 4 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0034] Figure 5 A schematic diagram of the software structure of an electronic device provided in an embodiment of this application;

[0035] Figure 6 A schematic flowchart illustrating a display method provided in an embodiment of this application;

[0036] Figure 7 A schematic diagram of interface content provided for an embodiment of this application;

[0037] Figure 8 A schematic diagram illustrating the correspondence between real-time peak brightness and system backlight value, provided for an embodiment of this application;

[0038] Figure 9 A schematic diagram of a brightness mapping curve provided in an embodiment of this application;

[0039] Figure 10 A schematic diagram of a mapping process provided in an embodiment of this application;

[0040] Figure 11 A flowchart illustrating another display method provided in an embodiment of this application;

[0041] Figure 12 This is a schematic diagram of another display scenario provided in an embodiment of this application;

[0042] Figure 13 Another system architecture diagram provided for an embodiment of this application;

[0043] Figure 14 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0044] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0045] Compared to the traditional Standard Dynamic Range (SDR), High Dynamic Range (HDR) images significantly enhance the dynamic range and image detail of an image. This is achieved by optimizing and expanding multiple dimensions such as brightness range, color saturation, and contrast. It not only greatly enriches the detail levels in both bright and dark areas of the image but also significantly improves the overall image quality, presenting a better image effect and providing users with a more delicate and realistic image effect.

[0046] Achieving a full display of HDR effects requires comprehensive HDR support at every stage of the entire chain, from content production, encoding, and transmission to terminal display. On the hardware side, this necessitates high-performance chips, displays capable of perfectly showcasing HDR effects, and components such as light sensors. On the software side, it encompasses the operating system (OS), media processing frameworks, and adaptation of various applications (APPs) to ensure that HDR content is presented to users with high fidelity.

[0047] With the continuous maturation and development of electronic technology, many electronic devices, especially portable devices such as mobile phones, have begun to support HDR content display. The target interface of an electronic device includes both HDR and SDR areas. For example, HDR and SDR areas may coexist within the same layer of the target interface. For instance, a layer on the target interface may include both an HDR area (such as a video playback window in an app) and an SDR area (such as a non-video playback window in an app). Alternatively, the target interface may contain multiple layers, namely a first layer and a second layer. The first layer includes the HDR area (such as a video playback window), corresponding to the display of HDR content (such as playing video frames); the second layer includes the SDR area, corresponding to the display of SDR content (such as a status bar, navigation bar, or bullet comments). Alternatively, the target interface may also include a third layer, where the first layer includes the HDR area, the second layer includes the SDR area, and the third layer includes the SDR area, or vice versa. For example, the first layer corresponds to the HDR video playback window, the second layer corresponds to the SDR status bar, and the third layer corresponds to the SDR navigation bar.

[0048] For example, let's take a mobile phone as an example to illustrate the target interface. Figure 1 (a) shows the target interface of the mobile phone, including a first layer and a second layer. The SDR area of ​​the first layer includes the status bar layer or the navigation bar layer, and the HDR area of ​​the second layer includes the HDR area in the application. The application includes the HDR area (corresponding to the playback window) and the SDR area (corresponding to the bullet comments). Figure 1 (b) shows the target screen of the mobile phone, where the first layer is the SDR area (corresponding to the status bar), the second layer is the HDR layer (corresponding to the HDR area in the application), and the third layer is the SDR area (corresponding to the bullet comments).

[0049] Understandably, HDR supports a wider color gamut and brightness range compared to SDR. Referring to Table 1, SDR has a color depth of 8 bits, where RGBA8888 indicates that 8 bits are used to record the A, R, G, and B data of each pixel; HDR has a color depth of 10 bits. Furthermore, in terms of color gamut, HDR's BT.2020 (or P3) has a higher color gamut than SDR's SGRB (or BT709), enabling it to display richer colors. Therefore, HDR's performance is more delicate and captivating.

[0050] Table 1

[0051]

[0052] In practical applications, when the target interface requires both HDR and SDR areas, especially when a single layer includes both HDR and SDR areas, the current solution is to downgrade the HDR to SDR for processing.

[0053] For example, when browser application A plays an HDR video on the display interface, the layer information corresponding to the current playback window, which is captured (dumpSF) from the display interface, still shows that the pixel format is RGBA8888. RGBA8888 is the RGB format, with a color gamut of 08810000. This means that the browser kernel maps the color space specified by HDR to sRGB, and the bit depth is also mapped from yuv10bit to 8bit. In other words, the browser kernel downgrades HDR to SDR for processing.

[0054] For example, the layer information corresponding to this display interface is as follows:

[0055] HWC2 display_id:0

[0056] layer:***z:***composition:***alpha:***format:RGBA_8888_UBWCdataspace:0x00000000transform:***buffer_id:***secure:***

[0057] layer:***z:***composition:***alpha:***format:RGBA_8888_UBWCdataspace:0x08810000transform:***buffer_id:***secure:***

[0058] For example, Figure 2The illustration shows a mixed display scene on a mobile phone target interface that includes both HDR and SDR areas. The interface content in the SDR area of ​​the target interface is displayed normally; the brighter parts of the interface content in the HDR area, such as sunrise, are overexposed and even appear as "white".

[0059] In summary, current technology downgrades HDR to SDR for processing, preventing the full utilization of the brightness and color advantages of HDR content. Furthermore, because the brightness range of HDR content far exceeds that of SDR, directly downgrading it to SDR may cause overexposure and loss of detail in brighter areas of the HDR content. These brighter areas may become excessively bright, even turning completely white, losing their original image details and failing to display properly, thus negatively impacting the user's visual experience.

[0060] To simultaneously display interface content in both the HDR and SDR regions with high quality and avoid overexposure in brighter areas of the interface content, this application provides a display method. In this method, an electronic device acquires the interface content of the target interface to be displayed. The electronic device acquires the system backlight value of the display screen, increases the system backlight value to a first backlight value, and decreases the grayscale value corresponding to the interface content in the SDR region to the first grayscale value. Simultaneously, the display parameters of the interface content in the HDR region are mapped to the reference display range of HDR supported by the display screen. The target interface includes a high dynamic range (HDR) region and a standard dynamic range (SDR) region.

[0061] In this method, the electronic device increases the system backlight value to a first backlight value based on the display's system backlight value to improve the overall display brightness and ensure the display effect of interface content in the HDR area. The electronic device reduces the grayscale value corresponding to the interface content in the SDR area, allowing the SDR content to still display correctly under brighter backlighting. The electronic device maps the display parameters of the interface content in the HDR area to the reference display range supported by the display for HDR, enabling the HDR content to be presented with optimal brightness and color, achieving high-quality display of interface content in both the HDR and SDR areas on the display. Simultaneously, it avoids overexposure in brighter parts of the HDR content caused by downgrading HDR to SDR, thus improving the user's visual experience.

[0062] The display method provided in this application embodiment can be applied to, for example, Figure 3The system architecture shown is as follows. This architecture includes one or more servers 300 and multiple electronic devices. The electronic devices provide users with display functions such as SDR or HDR video playback, live streaming, and video-on-demand. Server 300 carries HDR transcoding services, providing the live stream and background images to be displayed to the electronic devices via a network request stream interface. For example, server 300 may include a transcoding server 304 and a content delivery network server 305 (such as a CDN service). The transcoding server 304 receives SDR or HDR video, live streaming, or video-on-demand streams and carries out the transcoding of the interface content. After transcoding, the content delivery network server 305 distributes the transcoded stream to electronic devices 301, 302, 303, etc. The electronic devices include a video acquisition module, an encoding and streaming module, a receiving and decoding module 306, and a display module 307 (i.e., a rendering module). Among them, the video acquisition module is responsible for acquiring, encoding and streaming the interface content, the encoding and streaming module is responsible for the interface content, the receiving and decoding module 306 carries the download of the bitstream of the interface content distributed from the server and decodes the bitstream frame by frame to form an image sequence in chronological order, and the display module 307 is used to display the interface content on the target interface.

[0063] For example, taking the playback of HDR video by an electronic device through a browser application as an example, the system architecture of the display method provided in this application embodiment will be described. The browser application has only one layer for display. In response to the user's operation to play HDR video, the browser application sends a request to the server to obtain the HDR video. After receiving the request, the server 300 transcodes the HDR video using the transcoding service 304 and distributes it to multiple electronic devices 301, 302, and 303 through the content delivery network service 305. The electronic devices receive the bitstream of the HDR video distributed by the content delivery network service 305 through the video acquisition module. The receiving and decoding module 306 downloads the HDR video bitstream and decodes the bitstream frame by frame to form a time-ordered image sequence, decoding the HDR video onto the texture. The texture includes the image data of the HDR video. The display module 307 determines the display module's backlight value based on the display screen's backlight value. cur The decoded HDR video on the texture is processed, including increasing the system backlight value to a first backlight value and decreasing the grayscale value corresponding to the interface content in the SDR area to a first grayscale value. The electronic device maps the display parameters corresponding to the interface content in the HDR area to the reference display range of the HDR supported by the display screen.

[0064] For example, the electronic device may be a mobile phone, tablet computer, wearable device, television, augmented reality (AR) / virtual reality (VR) device, laptop computer, in-vehicle computer, personal computer, smart screen or smart home device, etc. The embodiments of this application do not impose special restrictions on the specific form of the electronic device.

[0065] The following are Figure 1 The hardware structure of the electronic device shown is described.

[0066] like Figure 4 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0067] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0068] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0069] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0070] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0071] Electronic device 100 can realize communication functions and resource acquisition functions through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, etc.

[0072] In this embodiment, the electronic device can receive video streams, video data, etc. sent by the server through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, etc.

[0073] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0074] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0075] In this embodiment, the display screen 194 can display HDR video content selected by the user on the electronic device 100, and can also display some function controls, function pages, etc.

[0076] For example, the interface content can be displayed on the display screen 194, and the interface content displayed on the display screen is mapped and rendered by the GPU.

[0077] The electronic device 100 can implement shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193, and the camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0078] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0079] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121.

[0080] For example, the processor 110 of the electronic device 100 can determine the system backlight value based on the current ambient light brightness by running instructions stored in the internal memory 121. At the same time, it can decode the interface content in the acquired HDR area and obtain the metadata, image data, etc. of the interface content.

[0081] The internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a given function (such as sound playback, image playback, etc.). The data storage area may store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.). Furthermore, the internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory, universal flash storage (UFS), etc.

[0082] Electronic device 100 can implement audio functions, such as music playback and recording, through the speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor in audio module 170.

[0083] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 may be located in processor 110, or some functional modules of audio module 170 may be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 100 can listen to music or hands-free calls through the speaker. Receiver 170B, also called a "handpiece," is used to convert audio electrical signals into sound signals. When electronic device 100 answers a phone call or voice message, the receiver can be brought close to the user's ear to receive the voice. Microphone 170C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can bring their mouth close to the microphone to input the sound signal. Electronic device 100 may have at least one microphone. Headphone jack 170D is used to connect wired headphones.

[0084] When the electronic device 100 displays video content, the audio module 170 can synchronously play the audio content corresponding to the video content.

[0085] For example, when the interface content displayed by the electronic device 100 is a video, the audio module 170 of the electronic device 100 can synchronously play the audio content corresponding to the video content.

[0086] The ambient light sensor 180L of the sensor module 180 is capable of sensing the light intensity of the surrounding environment.

[0087] For example, the ambient light sensor 180L in the sensor module 180 of the electronic device 100 is capable of acquiring the ambient light intensity. The ambient light sensor 180L outputs the light intensity of the current environment in lux and saves it to the internal memory 121.

[0088] based on Figure 4When the electronic device 100 implements the display method in this embodiment, it can send a request to the server to obtain interface content via antenna 1, antenna 2, mobile communication module 150, and wireless communication module 160. Upon receiving the request, the server sends the interface content to the electronic device. The electronic device displays the interface content of the target interface to be displayed via display screen 194. The target interface includes a High Dynamic Range (HDR) region and a Standard Dynamic Range (SDR) region. The electronic device 100 obtains the current ambient light brightness based on the ambient light sensor 180L of the sensor module 180. The processor 110 of the electronic device 100 determines the system backlight value based on the current ambient light brightness by running instructions stored in the internal memory 121, and decodes the interface content within the obtained HDR region to obtain metadata. Based on the system backlight value, the electronic device increases the system backlight value to a first backlight value. Then, the electronic device decreases the grayscale value corresponding to the interface content within the SDR region to the first grayscale value. Afterward, the electronic device maps the display parameters corresponding to the interface content within the HDR region to the reference display range of the HDR supported by the display screen. Finally, the electronic device displays the target interface via display screen 194.

[0089] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0090] Figure 5 This is a schematic diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0091] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0092] The application layer can include a series of application packages.

[0093] like Figure 5 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0094] For example, the application package in this application embodiment may include an application that supports display functions such as images and videos, an application that supports displaying images and videos, and an application for implementing image and video display functions, etc.

[0095] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0096] like Figure 5 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and display interface.

[0097] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0098] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0099] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0100] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0101] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0102] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0103] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0104] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0105] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0106] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), display modules, etc.

[0107] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0108] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0109] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0110] A 2D graphics engine is a graphics engine for 2D drawing.

[0111] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, sensor driver, graphics processor driver, and audio driver.

[0112] based on Figure 4 When the electronic device 100 shown implements the display method in the embodiments of this application, taking the above-mentioned interface content as an HDR video as an example, the software workflow of the electronic device during the display process is illustrated.

[0113] Electronic device 100 acquires the HDR video stream based on the application layer. Electronic device 100 acquires the current ambient light level based on the application layer and determines the system backlight value based on the current ambient light level. Electronic device 100 calls the system library through the display interface of the application framework layer to increase the system backlight value to a first backlight value. Electronic device 100 acquires the SDR and HDR regions in the target interface based on the window manager of the application framework layer. Electronic device 100 sends the target backlight value to the display module of the system library through the display interface of the application framework layer. Electronic device 100 reduces the grayscale value corresponding to the interface content in the SDR region to a first grayscale value based on the display module of the system library, and maps the display parameters corresponding to the interface content in the HDR region to the reference display range of HDR supported by the display screen. Electronic device 100 renders and displays the interface content of the target interface based on the display driver and graphics processor driver (GPU Driver) of the kernel layer.

[0114] The display method provided in this application embodiment will be described below with reference to the accompanying drawings, taking a mobile phone with the above-described electronic device as an example. See also Figure 6 The method may include steps S601-S606:

[0115] S601. The electronic device acquires the interface content of the target interface to be displayed.

[0116] The target interface can be any interface on an electronic device, such as any interface of any application. For example, in response to a user's trigger to display the target interface, the electronic device acquires the content of the target interface to be displayed. The target interface includes a High Dynamic Range (HDR) region and a Standard Dynamic Range (SDR) region. The content of the target interface includes the content of the HDR region and the content of the SDR region.

[0117] For example, the target interface could be the interface of a video playback application, or it could be the interface of a browser application. In some cases, a browser application can also play videos and can be considered a video playback application. For instance, this browser application could be based on... Applications implemented in the kernel.

[0118] The interface content may include images, videos (video frames), text, or other UI elements, without limitation. Among them, videos include, but are not limited to, HDR videos or SDR videos.

[0119] For example, in response to a user's action of playing an HDR video using a browser application, the target interface to be displayed is the interface used to play the HDR video. See also... Figure 7The target interface is the browser application's interface. Within this interface, a single layer includes an HDR area (corresponding to the video playback area) and an SDR area (corresponding to SDR area 1 and SDR area 2). The HDR area is where the HDR video playback window is located, and its content includes HDR video frames. The HDR area (corresponding to the video playback area) displays the images of the HDR video frames, while the rest of the browser application's target interface belongs to the SDR area (corresponding to SDR area 3 and SDR area 4). The SDR area's content can be a progress bar, toolbar, address bar, or tabs, etc.

[0120] As another example, the target interface can also be a video playback application other than a browser application. For instance, in response to a user's action of playing an HDR video using video playback application B, an electronic device displays a target interface for playing the HDR video. In this case, the target interface is the interface of video playback application B, the HDR area is the area where the HDR video playback window is located, and the content of the HDR area includes HDR video frames. In the target interface, the HDR area (corresponding to the video playback area) displays the image of the HDR video frames, while the other parts of the browser application's target interface belong to the SDR area, and the content of the SDR area can be pop-up comments, a time progress bar, a toolbar, an address bar, or tabs, etc.

[0121] For another example, when an electronic device responds to a user's operation of selecting an image from a gallery application for display, the target interface is an image display interface. In the target interface, the HDR area displays the image of an HDR video frame, while the other parts of the target interface belong to the SDR area. The interface content of the SDR area can be a bottom menu bar, an image preview area, etc.

[0122] In some embodiments, the target interface includes a layer (such as a first layer) that contains both HDR and SDR regions.

[0123] For example, the target interface is the interface of a browser application, which has only one layer, including HDR and SDR areas.

[0124] In other embodiments, the target interface includes multiple layers, with HDR and SDR areas located on different layers.

[0125] For example, the target interface includes a first layer and a second layer. The first layer contains an HDR area, and the second layer contains an SDR area. For instance, the HDR area of ​​the first layer is an HDR video playback window, and the SDR area of ​​the second layer includes the navigation bar, notification bar, etc.

[0126] For example, the target interface includes a first layer and one or more second layers. The first layer includes HDR and SDR areas, and the second layer includes SDR areas. The second layer includes SDR areas, such as bullet comments or other visual elements. Alternatively, the second layer includes HDR areas. For instance, the first layer corresponds to a browser application that has only one layer, including HDR areas (such as an HDR video playback window) and SDR areas. In addition to this first layer, the target interface may also include one or more second layers.

[0127] In other embodiments, the target interface may further include one or more third layers in addition to the first and / or second layers described above. The third layer may include SDR or HDR regions.

[0128] It is understandable that HDR regions on different layers can be different sub-regions of the HDR region on the target interface. Similarly, SDR regions on different layers can be different sub-regions of the SDR region on the target interface.

[0129] In some embodiments, the target interface includes multiple HDR regions and multiple SDR regions.

[0130] For example, the electronic device can construct an SDR region list from all the acquired SDR regions, or it can construct an SDR layer list from the SDR layers corresponding to all the acquired SDR regions. Alternatively, the electronic device can construct an HDR region list from all the acquired HDR regions, or it can construct an HDR layer list from the HDR layers corresponding to all the acquired HDR regions.

[0131] The following explanation uses an electronic device as an example, which includes a first layer and an HDR area and an SDR area.

[0132] In some embodiments, the electronic device initiates a request to the server to retrieve interface content via network communication. The server returns a portion of the target interface content to be displayed to the electronic device, such as HDR video frame content or SDR video frame content. Other interface content of the target interface is generated and displayed locally by the electronic device, such as navigation bars and status bars. Alternatively, the electronic device can directly retrieve other interface content of the target interface from its local storage, such as pre-installed UI elements or locally cached data, to complete the construction and display of the target interface.

[0133] In some embodiments, the electronic device acquires the interface content of the target interface to be displayed, decodes the interface content, and obtains metadata. The metadata is used to display HDR video frames within the HDR region. For example, the metadata includes brightness parameters and color gamut parameters.

[0134] For example, taking the playback of HDR10+ video in the interface content as an example, the brightness parameters of the metadata after decoding by the electronic device include the maximum content brightness max_content_light_level, the maximum average image brightness of the displayed content max_pic_average_light_level, transfer function parameters, color conversion matrix, and video image data, etc. The color gamut parameter is used to indicate the DCI-P3 color gamut space.

[0135] S602, The electronic device obtains the system backlight value of the display screen.

[0136] The system backlight value represents the overall screen brightness of the display. In some embodiments, the system backlight value is set from the upper-layer application and then passed to the display driver, thereby affecting the overall screen brightness. In some embodiments, the system backlight value can be automatically adjusted in real time based on the current ambient light level. Alternatively, users can manually adjust the screen brightness to obtain the optimal visual experience in different scenarios.

[0137] For example, see Figure 8 The electronic device obtains the current ambient light level and, according to Figure 8 The automatic brightness curve shown in (a) determines the real-time peak brightness, maxluma. cur (correspond Figure 8 The screen brightness is calculated using the vertical axis parameter of the automatic brightness curve (and then based on the real-time peak brightness, maxluma). cur ,based on Figure 8 The screen characteristic curve shown in (b) determines the normalized backlight level. The real-time peak brightness is used to represent the maximum brightness the display can achieve in the current environment. Alternatively, the electronic device detects a manual adjustment of the screen brightness by the user and, based on... Figure 8 The screen characteristic curve shown in (b) uses screen brightness to determine the normalized backlight level. Screen brightness can be understood as the peak brightness (maxluma) displayed in real time. cur .

[0138] In some embodiments, the normalized backlight level can be a value between 0 and 1, representing the ratio of the current backlight brightness to the maximum backlight brightness.

[0139] For example, if the current ambient light is 8000 lux, the corresponding screen brightness is determined to be 620 nits based on the automatic brightness curve. Then, according to the screen characteristic curve, the normalized backlight level corresponding to 620 nits is 0.9 (assuming the maximum backlight level is 1). Alternatively, if the electronic device detects that the user has adjusted the screen brightness to 200 nits, the normalized backlight level corresponding to 200 nits is 0.5 according to the screen characteristic curve.

[0140] After the electronic device obtains the normalized backlight level, it obtains the system backlight value. cur The correspondence between system backlight value and normalized backlight level is based on the display's device peak brightness (maxluma). disp The correspondence can be determined through a preset algorithm or calculation rules. The peak brightness of the display device is the maximum brightness that the display can achieve during its design, and it is usually a fixed hardware characteristic of the display.

[0141] S603, The electronic device increases the system backlight value to the first backlight value.

[0142] After the electronic device obtains the system backlight value, it increases the system backlight value to the first backlight value. tgt It can improve the brightness and color saturation of the display screen, ensuring the display effect of interface content in the HDR area.

[0143] In some embodiments, the electronic device increases the current system backlight value by a factor of N, where N is greater than 1, to a first backlight value. This first backlight value is less than the device peak brightness (maxluma) of the display screen. disp This is to ensure that the brightness of the interface content does not exceed the hardware limitations of the display screen, so that the interface content can be displayed normally.

[0144] In one possible design, the value of N is greater than or equal to a first value and less than or equal to a second value. For example, the first value is set based on the ratio of the monitor's brightness (e.g., 1000 nits) to the SDR reference white brightness (e.g., 203 nits) during interface content creation. The second value is set based on the ratio of the display device's peak brightness (e.g., 1600 nits) to the SDR reference white brightness (e.g., 203 nits). For instance, the first and second values ​​are rounded to obtain N ≤ 8. The monitor is used for dimming and color adjustment during interface content creation. The SDR reference white brightness can be understood as the SDR reference white brightness perceptible to the human eye. This approach is suitable for scenarios with relatively stable lighting (e.g., indoors).

[0145] For example, the first value is set based on the ratio of the display device's peak brightness (e.g., 1600 nits) to the real-time peak brightness of the display (500 nits). The second value is set based on the ratio of the display device's peak brightness (1600 nits) to the SDR reference white brightness (203 nits). For instance, 3 ≤ N ≤ 8. This approach is suitable for outdoor scenarios. In this scenario, the electronic device can also adjust the display brightness in real-time according to the current ambient light. When the ambient light is bright, the real-time peak brightness of the display increases, and the first value in the range of N decreases.

[0146] S604. The electronic device reduces the grayscale value corresponding to the interface content within the SDR area to the first grayscale value.

[0147] The grayscale value corresponding to the interface content refers to the grayscale value of each pixel within the interface content. The display brightness of the interface content within the SDR area is positively correlated with both the system backlight level and the grayscale value of the interface content.

[0148] When an electronic device increases its system backlight value, displaying SDR content at the first backlight value can cause overexposure and other issues due to altered brightness within the SDR area, affecting the display quality of the content. To allow the device to adjust the grayscale values ​​of pixels within the SDR area, the grayscale value is reduced to the first grayscale value. This offsets the brightness increase caused by the increased backlight value, restoring the brightness—which is directly correlated with the system backlight level and the grayscale values ​​of the content—to a level comparable to that before the increased backlight value. This ensures the restored brightness closely matches the normal SDR display brightness, guaranteeing optimal SDR content display quality.

[0149] In some embodiments, the electronic device reduces the grayscale value corresponding to the interface content within the SDR area by a factor of K, to a first grayscale value. Here, K is greater than 1, and the difference between K and N is greater than or equal to 0, and less than or equal to a preset threshold. For example, the preset threshold can be 1, 0.5, or 0.3, etc., and is not limited. Because the difference between K and N is less than or equal to the preset threshold, the display brightness, which is positively correlated with the system backlight size and the grayscale value of the interface content, can be restored as much as possible to the display brightness corresponding to the state before the system backlight value was increased. This ensures that the restored display brightness matches the normal display brightness of the SDR, thereby guaranteeing the display effect of the SDR content.

[0150] It is understandable that different pixels within the SDR area of ​​the interface content have different grayscale values, and the corresponding first grayscale value of that pixel is also different. The grayscale value is used to represent the brightness of a single pixel. For example, the system backlight value is 60, and after increasing it by N = 4 times, the first backlight value is 240. Before increasing the system backlight value, the grayscale value of a certain pixel in the SDR area of ​​the interface content is 255. The preset threshold is set to 1. To reduce the display brightness of this interface content and make it more compatible with the system backlight value before the increase, the difference between K and N should not exceed 1. After reducing the grayscale value by K = 3.8 times, the first grayscale value is 67.1. Therefore, the difference between K and N is |4 - 3.8| = 0.2, which is less than the preset threshold of 1. In this situation, the increase in display brightness caused by increasing the system backlight value can be offset by the decrease in display brightness caused by decreasing the grayscale value. This allows the display brightness, which is positively correlated with the system backlight size and the grayscale value of the interface content, to be restored as close as possible to the display brightness before the system backlight value was increased. This ensures that the restored display brightness matches the normal display brightness of SDR, thereby guaranteeing the display effect of SDR content.

[0151] In one possible design, the factor K by which the electronic device reduces the grayscale value in the SDR area is equal to the factor N by which the system backlight value is increased. This restores the display brightness, which is positively correlated with the system backlight size and the grayscale value of the interface content, to the display brightness before the system backlight value was increased. This ensures that the restored display brightness closely matches the normal display brightness of the SDR, thus maintaining the display effect of the SDR content. For example, if the system backlight value is 60, and the electronic device increases the system backlight value by N = 4, the first backlight value is 240. Before the system backlight value was increased, the grayscale value corresponding to the pixel in the SDR area was 255. After the electronic device reduces the grayscale value by K = 4, the first grayscale value is 63.75. At this point, K = N, satisfying the condition.

[0152] In one possible design, both K and N are integers.

[0153] In some embodiments, the electronic device acquires an SDR region and reduces the grayscale value corresponding to each pixel in the interface content within each SDR region to its corresponding first grayscale value.

[0154] S605. The electronic device maps the display parameters corresponding to the interface content within the HDR area to the reference display range of the HDR supported by the display screen.

[0155] The display parameters corresponding to the interface content represent the visual attributes of the interface content when displayed within the HDR area. These visual attributes determine the display effect of the interface content on the screen. For example, the display parameters corresponding to the interface content may include the brightness and chromaticity of the interface content.

[0156] The reference display range for HDR refers to the range of display parameters that ensure normal HDR display performance. The HDR reference display range includes the HDR brightness range and the HDR color gamut. For example, the HDR brightness range can include one or more brightness ranges specified by HDR-related protocols / standards; the HDR color gamut can include one or more color gamuts specified by HDR-related protocols / standards. For instance, the HDR brightness range can be 0-4000 nits, or 0-2000 nits, etc. The HDR color gamut can be BT.2020, Adobe RGB, or P3, etc.

[0157] In some embodiments, during the process of mapping the display parameters corresponding to the interface content within the HDR area to the reference display range of the HDR supported by the display, the electronic device can map the brightness of the interface content within the HDR area to the target brightness range, i.e., the HDR brightness range supported by the display; and map the chromaticity of the interface content within the HDR area to the target color gamut space supported by the display, i.e., the HDR color gamut space supported by the display.

[0158] For example, the display brightness range of the interface content within the HDR area is 0-4000 nits, and the target brightness range is 0-2000 nits. The electronic device can map 0-4000 nits to the 0-2000 nit range. This can be understood as the electronic device mapping 4000 nits to 2000 nits. Alternatively, the display color gamut range of the interface content within the HDR area is BT.2020, and the target color gamut range is P3. The electronic device can map BT.2020 to the P3 range.

[0159] Electronic devices maximize the brightness and wide color gamut advantages of HDR by mapping the brightness and chroma of the interface content within the HDR area to the HDR brightness range and HDR color gamut space supported by the display screen, respectively. This ensures high-fidelity display of HDR content, makes full use of the HDR performance of the display screen, and avoids color distortion and overexposure, providing users with a more realistic and delicate visual experience.

[0160] In some embodiments, the electronic device maps the brightness corresponding to the interface content within the HDR area to the maximum brightness range within the target brightness range; the electronic device maps the chromaticity corresponding to the interface content within the HDR area to the highest color gamut space within the target color gamut space, so as to maximize the display capability of the electronic device's display screen while ensuring the HDR display effect.

[0161] Because HDR brightness range and HDR color gamut are large, not all displays can support either. Therefore, in some embodiments, if the display does not support the HDR brightness range, the brightness corresponding to the interface content within the HDR area is mapped to the maximum brightness range supported by the display. That is, HDR brightness values ​​exceeding the display's brightness capability will be compressed or adjusted to suit the display's actual capabilities. If the display does not support the HDR color gamut, the electronic device maps the chromaticity corresponding to the interface content within the HDR area to the highest color gamut supported by the display to ensure that the interface content within the HDR area can still be displayed with the highest possible color gamut quality under limited conditions.

[0162] For example, when playing HDR video in the target interface, the minimum HDR brightness range is 0-2000 nits, but the maximum brightness supported by the display is only 500 nits. Since the display does not support the HDR brightness range, to ensure the HDR video displays correctly and without overexposure, all brightness values ​​exceeding 500 nits will be mapped to 500 nits, or compressed in some way to a range not exceeding 500 nits. In this case, each video frame or image in the interface content will undergo brightness mapping to ensure that the entire HDR video matches the display's brightness support capabilities during playback, providing the user with the best visual experience.

[0163] Alternatively, if the HDR video corresponds to BT.2020 chroma, but the display only supports P3 chroma, then the electronic device will map the HDR video's BT.2020 chroma to the display's P3 chroma.

[0164] The following section provides a detailed explanation of the brightness mapping and color gamut mapping processes for the interface content.

[0165] Electronic devices can map the brightness and chromaticity of the interface content corresponding to HDR based on the brightness and color gamut parameters in the metadata obtained from HDR decoding.

[0166] In some embodiments, the electronic device acquires metadata obtained from decoding the interface content within the HDR region, and maps the brightness of the interface content within the HDR region to a target brightness range based on the brightness parameters in the metadata. Decoding involves extracting a continuous, time-ordered sequence of images frame by frame from video data. By utilizing the brightness parameters in the metadata obtained after decoding the interface content within the HDR region, brightness mapping of the interface content within the HDR region is achieved, ensuring that the brightness of the HDR content is accurately reproduced during display and avoiding overexposure.

[0167] For details, see Figure 9The electronic device determines the tone mapping curve based on the transfer function parameters of the luminance parameter in the metadata and the color conversion matrix. The tone mapping curve is used to convert the input luminance value (cd / m²) into a color value. 2 ) is mapped to the output brightness value (cd / m 2 Electronic devices map the brightness of interface content within an HDR region to a target brightness range based on tone mapping curves and the maximum content light level (max_content_light_level). This can be understood as the electronic device mapping the interface content within the HDR region using a tone mapping operator (TMO) to ensure that the interface content within the HDR region retains its original brightness and detail when displayed, while avoiding image distortion or overexposure caused by improper brightness mapping.

[0168] In some embodiments, the tone mapping curve is generated from metadata, video image data, etc., obtained by decoding the interface content within the HDR region.

[0169] For example, the maximum brightness of the content obtained after decoding the interface is 4000 nits, which is the maximum brightness supported by the electronic device screen. disp If the peak brightness of the display device is 2000 nits, the electronic device will adjust the brightness of the interface content to be displayed from 4000 nits to 2000 nits.

[0170] Then, the electronic device performs color gamut mapping on the HDR layer for the video to be displayed.

[0171] The electronic device acquires color gamut parameters from the metadata of the decoded interface content within the HDR region. These parameters indicate the original color gamut space corresponding to the interface content within the HDR region. Based on the conversion relationship between the original color gamut space and the target color gamut space supported by the display, the electronic device maps the chromaticity of the interface content within the HDR region to the target color gamut space. Common HDR color gamut spaces supported by the display include P3, BT.2020, and Adobe RGB. By utilizing the color gamut parameters from the metadata obtained after decoding the interface content within the HDR region, chromaticity mapping of the interface content within the HDR region is achieved, ensuring accurate color reproduction of the HDR content during display, avoiding color distortion, improving the accuracy and richness of displayed colors, and enhancing the user's visual experience.

[0172] For example, taking the H.265 encoding standard as an example, and using the HDR color gamut space supported by the display as P3, if the HDR video is of the HLG standard and the corresponding color gamut space is BT.2020, then the color gamut space of the HDR video will be mapped from BT.2020 to the color gamut space P3 supported by the display. Alternatively, if the HDR video is of the HDR10 or HDR10+ standard and the corresponding color gamut space is BT.2020, then the color gamut space of the HDR video will be mapped from BT.2020 to the HDR color gamut space P3 supported by the display.

[0173] In some embodiments, after the electronic device acquires the interface content within the HDR region, it assigns the HDR region to the system decoding framework. The system decoding framework decodes the interface content within the HDR region to obtain the metadata of the interface content within the HDR region. The HDR region includes a surface, which can be assigned to the system decoding framework.

[0174] In some embodiments, the electronic device includes a SurfaceTexture, and the interface content of the HDR region of the electronic device is decoded to the Texture; the SurfaceTexture maps the decoded image data corresponding to the interface content in the HDR region on the texture to the reference display range of the HDR supported by the display screen according to the display parameters corresponding to the interface content in the HDR region.

[0175] For example, the same layer includes an HDR area and an SDR area. The electronic device decodes the interface content corresponding to the HDR area in the layer onto the texture. Based on the metadata of the decoded interface content in the HDR area, the GPU renders the video image data on the texture and then displays it.

[0176] Any global adjustments made to that layer by an electronic device (such as adjusting brightness or chroma) will affect all elements on that layer (such as images and text).

[0177] In some embodiments, when the electronic device detects a change in ambient light brightness and automatic backlight adjustment is enabled on the electronic device, the electronic device uses the system backlight value. cur The first backlight value determined tgt The brightness of the content within the SDR area will be adjusted accordingly. Simultaneously, the brightness of the content on the target screen will also be adjusted to maintain optimal display quality.

[0178] S606, Electronic device displays the target interface.

[0179] Electronic devices display the interface content, after brightness mapping and color gamut mapping, on the target interface.

[0180] In some embodiments, the interface content after brightness mapping and color gamut mapping is rendered onto the screen of an electronic device for display via a graphics processor driver (GPU).

[0181] For example, see Figure 10 For interface content displayed on the target interface that includes SDR and HDR areas, the electronic device increases the system backlight value to the first backlight value, reduces the grayscale value of the interface content in the SDR area to the first grayscale value, and maps the display parameters corresponding to the interface content in the HDR area to the reference display range of HDR supported by the display screen, and finally presents them on the display screen of the electronic device.

[0182] In some embodiments, when the same layer includes an HDR region and an SDR region, the electronic device performs a hole-punch operation on the HDR region, decodes the interface content to a texture, and then overlays it onto the HDR region. Subsequently, the electronic device renders the decoded metadata of the interface content in the HDR region using the GPU and displays it in the HDR region.

[0183] In some embodiments, in response to a user's operation to play an HDR video, the electronic device decodes the video and confirms that the video is in HDR format based on the metadata obtained after decoding. The electronic device determines that the target interface to be displayed includes both HDR and SDR areas. Furthermore, the electronic device confirms that the display supports HDR brightness range and color gamut. Therefore, during HDR video playback, the electronic device uses the display method provided in this application embodiment for rendering and displaying, so as to simultaneously ensure the display effect of both HDR and SDR in the case of mixed HDR and SDR display.

[0184] In some embodiments, the display screen shows the interface content of the target interface while also including the audio portion of the video being played synchronously.

[0185] In the scheme described in this application embodiment, the electronic device acquires the interface content of the target interface to be displayed. The target interface includes a High Dynamic Range (HDR) region and a Standard Dynamic Range (SDR) region. The electronic device acquires the system backlight value of the display screen, increases the system backlight value to a first backlight value, and decreases the grayscale value corresponding to the interface content in the SDR region to the first grayscale value. The electronic device maps the display parameters of the interface content in the HDR region to the reference display range of HDR supported by the display screen. Simultaneously, it avoids overexposure in brighter parts of the HDR video caused by downgrading the HDR video to SDR. In this method, the electronic device decreases the grayscale value corresponding to the interface content in the SDR region based on the system backlight value of the display screen, while simultaneously mapping the display parameters of the interface content in the HDR region to the reference display range of HDR supported by the display screen. This allows the SDR content to still display normally under brighter backlight, while the HDR content is presented with optimal brightness and color, maximizing the display effect of the HDR content and achieving high-quality display of interface content in both the HDR and SDR regions on the display screen. At the same time, it avoids overexposure in brighter parts of the interface content in the HDR region, improving the user's visual experience.

[0186] Furthermore, in the solution described in this embodiment, only one layer can be used for display in the application, and this layer includes both SDR and HDR areas. This allows the application to display interface content within the same layer, resulting in better performance and lower power consumption. It is understood that the target interface displayed / to be displayed by the electronic device may include only the application layer, or it may include both the application layer and other layers simultaneously; there is no limitation on this.

[0187] Another display method is also described in this application embodiment; see [link to relevant documentation] Figure 11 As shown, the method includes:

[0188] 1101. Electronic devices acquire the bitstream of interface content within the HDR region.

[0189] 1102. Electronic devices acquire the system backlight value of the display screen.

[0190] 1103. The electronic device increases the system backlight value to the first backlight value.

[0191] The specific implementation of steps 1101-1103 can be referred to the description in steps 601-603 above, and will not be repeated here.

[0192] 1104. The bitstream of the content on the decoding interface of electronic devices.

[0193] The specific implementation of step 1104 can be referred to the description in step 601 above, and will not be repeated here.

[0194] 1105. Electronic devices acquire SDR areas.

[0195] 1106. The electronic device reduces the grayscale value of the SDR area to the first grayscale value.

[0196] The specific implementation of steps 1105-1106 can be referred to the description in step 604 above, and will not be repeated here.

[0197] 1107. Electronic devices perform brightness mapping on interface content within the HDR area.

[0198] 1108. Electronic devices perform color gamut mapping on interface content within the HDR area.

[0199] The specific implementation of steps 1107-1108 can be referred to the description in step 605 above, and will not be repeated here.

[0200] 1109. The electronic device renders the interface content and displays the target interface.

[0201] The specific implementation of step 1109 can be referred to the description in step 606 above, and will not be repeated here.

[0202] In the solution described in this application embodiment, the electronic device increases the system backlight value to a first backlight value, then decreases the grayscale value corresponding to the interface content in the SDR area, while simultaneously mapping the display parameters of the interface content in the HDR area to the reference display range of HDR supported by the display screen. This preserves the display effect of the interface content in the SDR area while maximizing the brightness and color gamut advantages of the interface content in the HDR area, achieving high-quality display of interface content in both the HDR and SDR areas on the display screen. At the same time, it avoids overexposure in brighter parts of the interface content in the HDR area, improving the user's visual experience.

[0203] In summary, in the solution described in the embodiments of this application, the target interface includes an application interface, which has only one layer. This layer includes an HDR area and an SDR area. See [link to relevant documentation]. Figure 12 The browser application includes HDR areas (corresponding to the video playback window) and SDR areas (such as bullet comments, ad banners, menu items, etc.). Alternatively, the application interface includes multiple layers, with HDR and SDR areas located on different layers. Or, the target interface includes layers other than the application interface, including the application interface layer and other layers. The application interface layer includes both HDR and SDR areas, while the other layers can be either HDR or SDR areas. Layers in the target interface that mix HDR and SDR can also be distributed in other ways, without limitation.

[0204] This application's embodiments are also applicable to another system architecture, see [link to relevant documentation]. Figure 13 The system architecture includes: application scenarios, software, and hardware. Application scenarios include, but are not limited to, short videos, live streaming, video-on-demand, local playback, and video conferencing; software includes, but is not limited to, playback apps, display modules, CDN (Content Delivery Network) servers, and cloud-based HDR transcoding services (transcoding servers); hardware includes, but is not limited to, mobile phones, large-screen terminals, and tablets.

[0205] Meanwhile, the specific forms of HDR video included in the interface content described in the embodiments of this application include, but are not limited to, HDR10, HDR10+, HLG, Dolby Vision, and HDR Vivid, and are also applicable to possible future HDR formats.

[0206] It is understood that, in order to achieve the above functions, the electronic device includes hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0207] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0208] This application also provides an electronic device, such as... Figure 14 As shown, the electronic device may include one or more processors 1401, memory 1402 and communication interface 1403.

[0209] The memory 1402, communication interface 1403, and processor 1401 are coupled together. For example, the memory 1402, communication interface 1403, and processor 1401 can be coupled together via bus 1404.

[0210] The communication interface 1403 is used for data transmission with other devices. The memory 1402 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1401, cause the electronic device to perform the display method described in this embodiment.

[0211] The processor 1401 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0212] The bus 1404 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus 1404 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 14 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0213] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0214] This application also provides a computer program product that, when run on a computer, causes the computer to execute the relevant method steps described in the above method embodiments.

[0215] The electronic devices, computer storage media, or computer program products provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0216] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0217] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0218] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0219] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0220] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0221] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method characterized by comprising: Applied to an electronic device comprising a display screen, the method comprises: obtaining interface content of a target interface to be displayed, the target interface comprising a high dynamic range (HDR) region and a standard dynamic range (SDR) region; obtaining a system backlight value of the display screen; increasing the system backlight value to a first backlight value; decreasing a gray scale value corresponding to the interface content in the SDR region to a first gray scale value; mapping display parameters corresponding to the interface content in the HDR region to a reference display range of HDR supported by the display screen; displaying the target interface.

2. The method of claim 1, wherein, The mapping of the display parameters corresponding to the interface content in the HDR region to the reference display range of HDR supported by the display screen comprises: mapping luminance corresponding to the interface content in the HDR region to a target luminance range, the target luminance range being a luminance range of HDR supported by the display screen; mapping chrominance corresponding to the interface content in the HDR region to a target color gamut space, the target color gamut space being a color gamut space of HDR supported by the display screen.

3. The method of claim 2, wherein, The mapping of the luminance corresponding to the interface content in the HDR region to the target luminance range comprises: obtaining metadata decoded from the interface content in the HDR region; mapping the luminance corresponding to the interface content in the HDR region to the target luminance range based on a luminance parameter in the metadata.

4. The method of claim 3, wherein, The luminance parameter comprises a content maximum luminance, a transmission function parameter and a color conversion matrix; the mapping of the luminance corresponding to the interface content in the HDR region to the target luminance range based on the luminance parameter in the metadata comprises: determining a tone mapping curve based on the transmission function parameter and the color conversion matrix; mapping the luminance corresponding to the interface content in the HDR region to the target luminance range based on the tone mapping curve and the content maximum luminance.

5. The method of claim 2, wherein, The mapping of the chrominance corresponding to the interface content in the HDR region to the target color gamut space comprises: obtaining metadata decoded from the interface content in the HDR region, the metadata comprising a color gamut parameter used to indicate an original color gamut space corresponding to the interface content in the HDR region; mapping the chrominance corresponding to the interface content in the HDR region to the target color gamut space based on a conversion relationship between the original color gamut space and the target color gamut space.

6. The method according to any one of claims 2-5, characterized in that, The method further comprises: if the display screen does not support the HDR luminance range, mapping the luminance corresponding to the interface content in the HDR region to a maximum luminance range supported by the display screen; or if the display screen does not support the HDR color gamut space, mapping the chrominance corresponding to the interface content in the HDR region to a highest color gamut space supported by the display screen.

7. The method according to any one of claims 1 to 6, characterized in that, The increasing of the system backlight value to the first backlight value comprises: increasing the system backlight value by N times to increase to the first backlight value, N being greater than 1; The decreasing of the gray scale value corresponding to the interface content in the SDR region to the first gray scale value comprises: The gray scale value corresponding to the interface content in the SDR region is reduced by K times to reduce to the first gray scale value, K is greater than 1; wherein the difference between K and N is greater than or equal to 0, and less than or equal to a preset threshold.

8. The method of claim 7, wherein, The first backlight value is less than the device peak brightness of the display screen, N is an integer, and the value of N is greater than or equal to a first value and less than or equal to a second value. The first value is obtained by rounding the ratio of the brightness of the monitor during interface content production to the SDR reference white brightness, and the second value is obtained by rounding the ratio of the device peak brightness of the display screen to the SDR reference white brightness. Alternatively, the first value is obtained by rounding the ratio of the device peak brightness of the display screen to the real-time peak brightness, and the second value is obtained by rounding the ratio of the device peak brightness of the display screen to the SDR reference white brightness.

9. The method according to any one of claims 1 to 8, characterized in that, The system backlight value of the display screen is obtained, including: The ambient light brightness is obtained, the screen brightness is determined according to the ambient light brightness, and the system backlight value is determined according to the screen brightness; or, The screen brightness set by the user is obtained, and the system backlight value is determined according to the screen brightness.

10. The method according to any one of claims 1 to 9, characterized in that, The target interface includes a first layer, and the first layer includes an HDR region and an SDR region.

11. The method according to any one of claims 1 to 10, characterized in that, The target interface is an HDR video playing interface, and the HDR region is used for playing HDR video frames.

12. The method according to any one of claims 1 to 11, characterized in that, The target interface is an interface of a browser application.

13. An electronic device, comprising: Including: A memory and one or more processors; the memory is coupled with the processor; wherein the memory has computer program code stored therein, the computer program code includes computer instructions, when the computer instructions are executed by the processor, the electronic device executes the display method as claimed in any one of claims 1-12.

14. A computer-readable storage medium, characterized in that, Computer instructions, when the computer instructions run on an electronic device, make the electronic device execute the display method as claimed in any one of claims 1-12.

15. A computer program product, characterised in that, When the computer program product runs on a computer, the computer executes the display method as claimed in any one of claims 1-12.

Images