Image display method and electronic device

Abstract

Embodiments of the present application provide an image display method and an electronic device. The method is executed by an electronic device, and comprises: acquiring a first image, wherein the first image is any image to undergo enhanced display in the electronic device; processing the first image by means of a preset model to generate a pre-enhanced image corresponding to the first image; and calculating an information difference between the pre-enhanced image and the first image, and on the basis of the information difference and the first image, creating and displaying an enhanced image corresponding to the first image, wherein the displayed dynamic range of the enhanced image is greater than or equal to that of the first image. Therefore, the process can implement dynamic-range enhanced display on any image to display a corresponding enhanced image, without collecting scene brightness information or gain maps any more, thereby achieving high applicability.

Description

Image display method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on February 2, 2024, with application number 202410162375.1 and application name “Image Display Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing technology, and in particular to an image display method and electronic device. Background Art

[0003] With the continuous improvement of the performance of electronic devices, the displays of electronic devices can support the display of high dynamic range (HDR) images. Compared with traditional standard dynamic range (SDR) images, HDR images can obtain more picture details and display a wider brightness range.

[0004] In related technologies, if you want to display an HDR image, you usually need to collect scene brightness information or a gain map while collecting a base image (such as an SDR image). Then, based on the scene brightness information or the gain map, you can perform tone mapping on the base image to display the corresponding HDR image. However, because related technologies require collecting scene brightness information or a gain map, some electronic devices with weak hardware capabilities may not be able to collect this information, and thus cannot display the corresponding HDR image. Summary of the Invention

[0005] The present application provides an image display method and electronic device, which can realize dynamic range enhanced display of any image and display the corresponding enhanced image, and has strong applicability.

[0006] In a first aspect, the present application provides an image display method, which is performed by an electronic device and includes:

[0007] Acquire a first image, where the first image is any image to be enhanced and displayed in an electronic device; process the first image using a preset model to generate a pre-enhanced image corresponding to the first image; calculate the information difference between the pre-enhanced image and the first image, and create and display an enhanced image corresponding to the first image based on the information difference and the first image, wherein the display dynamic range of the enhanced image is greater than or equal to the display dynamic range of the first image.

[0008] Among them, the first image (also known as the basic image) can be any image stored in the electronic device, and the electronic device can enhance the display of any first image. For example, the first image can be an SDR image, and when the first image is enhanced and displayed, a higher dynamic range can be displayed, such as from a standard dynamic range SDR display to a high dynamic range HDR. In the implementation method of the present application, the electronic device can generate a pre-enhanced image by processing the first image, and then use the information difference between the pre-enhanced image and the first image as gain information (or gain map) to enhance the display of the first image. Therefore, the process no longer needs to collect scene brightness information or gain maps, and does not need to rely on the hardware acquisition capabilities of the electronic device, that is, it can realize dynamic range enhancement display of any image and display the corresponding enhanced image, which has strong applicability.

[0009] In combination with the first aspect, in some implementations of the first aspect, the above-mentioned creation and display of an enhanced image corresponding to the first image based on the information difference and the first image includes: creating an enhanced image based on the information difference, the display brightness of the electronic device and the first image, and displaying the enhanced image.

[0010] When displaying the enhanced image, in addition to considering the aforementioned information difference, the electronic device may also consider its own display brightness to make the enhanced image more suitable for the electronic device's display. Therefore, the electronic device can create an enhanced image based on the information difference, the current display brightness, and the first image, and display the resulting enhanced image.

[0011] In combination with the first aspect, in some implementations of the first aspect, the above-mentioned creation of an enhanced image based on the information difference, the display brightness of the electronic device and the first image includes: determining the creation of the enhanced image based on the information difference, the scalable dynamic range and the first image, wherein the scalable dynamic range is determined by the display brightness of the electronic device and the metadata corresponding to the information difference.

[0012] In some implementations, in order to maintain data uniformity of the first image during the calculation process, the electronic device may first map the first image to a linear space for normalization, and then perform enhanced display on the first image.

[0013] For example, assuming that the bit width of the first image (BaseImage or BI) is 8 bits and the transfer function is Gamma2.2, the electronic device can convert the first image to a linear space by BI_LINEAR=clip((BI / 255)**2.2, 0, 1) and normalize it to the interval [0, 1], where **2.2 represents the Gamma2.2 power of the pixel value in the image.

[0014] In combination with the first aspect, in some implementations of the first aspect, the above-mentioned creation of an enhanced image based on the information difference, the expandable dynamic range and the first image includes: creating an enhanced image based on a relationship including BaseImage*Gap*H / Hmax, BaseImage represents the first image, Gap represents the information difference, H represents the current expandable dynamic range of the electronic device, Hmax represents the maximum value of the expandable dynamic range of the first image (which can be included in the metadata corresponding to the information difference), H=Lheadroom / Lcurrent, Lheadroom represents the extended brightness that can be provided by the electronic device, Lcurrent represents the current display brightness of the electronic device, Lheadroom is greater than or equal to Lcurrent, and Lheadroom is less than or equal to the maximum display brightness that can be provided by the electronic device in the current state.

[0015] That is, assuming that the relationship between the display brightness of the electronic device and the current scalable dynamic range H of the electronic device can be expressed as: H = Lheadroom / Lcurrent, the electronic device can create an enhanced image according to the relationship formula including BaseImage*Gap*H / Hmax. In some implementations, after the electronic device creates the enhanced image (EnhancedImage or EI), it can also be normalized. For example, if the bit width of the enhanced image is 8 bits and the transfer function is Gamma2.2, it can be normalized by EI_Normalized = (clip((EI-EImin) / (EImax-EImin), 0, 1)**(1 / 2.2))*255, where EImax represents the maximum value of EI and EImin represents the minimum value of EI.

[0016] In combination with the first aspect, in some implementations of the first aspect, the preset model can be an artificial intelligence model, such as a neural network model, to achieve dynamic range enhancement of low dynamic range images and generate images with relatively high dynamic range.

[0017] In combination with the first aspect, in some implementations of the first aspect, the preset model includes a first model and a second model, the first model is used to perform color mapping on pixel points in the first image to generate a second image having a different display dynamic range from the first image, and the second model is used to perform detail enhancement on the second image to generate a pre-enhanced image.

[0018] For example, the first model can be a color mapping model, which can achieve a one-to-one color mapping relationship for each pixel through a convolutional neural network model. The second model can be a detail enhancement model, which can further enhance the output of the color mapping model, remove artifacts and faults, and reconstruct a higher-quality image. Then, after the electronic device inputs the first image into the preset model, it can process it through the color mapping model and the detail enhancement model, respectively, to output a pre-enhanced image.

[0019] In combination with the first aspect, in some implementations of the first aspect, the first model is an image pyramid structure, and the second model is an autoencoder structure.

[0020] Specifically, after the electronic device inputs a first image into the first model, it can use an image pyramid structure to incorporate color information from multiple scales as color prior information. The output of the color mapping model is then fine-tuned using a linear function to convert the first image into an initial pre-enhanced image. This initial pre-enhanced image can then be reconstructed using an autoencoder (i.e., an encoder-decoder structure). This reconstruction process also incorporates the color prior information, resulting in a more detailed and less artifact-free pre-enhanced image.

[0021] In combination with the first aspect, in some implementations of the first aspect, the above-mentioned calculation of the information difference between the pre-enhanced image and the first image includes: calculating the ratio between the value of the first channel of each pixel point in the pre-enhanced image and the value of the first channel of the corresponding pixel point in the first image, and determining the ratio of each pixel point as the information difference.

[0022] In some implementations, the electronic device may compare the pre-enhanced image and the first image pixel by pixel, and use the information difference between the pixels as the overall information difference.

[0023] In other implementations, the electronic device may compare the value of the first channel of each pixel in the pre-enhanced image with the value of the first channel of the corresponding pixel in the first image, and calculate the ratio corresponding to each pixel as the overall information difference.

[0024] When the first channel is the Y channel, the electronic device can define the ratio between the Y channel value of the pixel in the pre-enhanced image and the Y channel value of the corresponding pixel in the first image as the above-mentioned information difference. Exemplarily, information difference Gap = Y-HDR / Y-SDR, where Y-HDR represents the Y channel value of the pixel in the pre-enhanced image, and Y-SDR represents the Y channel value of the pixel in the first image.

[0025] When the first channel includes an R channel, a G channel, and a B channel, the electronic device may define the ratio between the values ​​of the R, G, and B channels of the pixels in the pre-enhanced image and the values ​​of the R, G, and B channels of the corresponding pixels in the first image as the above-mentioned information difference. For example, the information difference Gap(R)=R-HDR / R-SDR, Gap(G)=G-HDR / G-SDR, Gap(B)=B-HDR / B-SDR, R-HDR represents the value of the R channel of the pixel in the pre-enhanced image, R-SDR represents the value of the R channel of the pixel in the first image, G-HDR represents the value of the G channel of the pixel in the pre-enhanced image, G-SDR represents the value of the G channel of the pixel in the first image, B-HDR represents the value of the B channel of the pixel in the pre-enhanced image, and B-SDR represents the value of the B channel of the pixel in the first image.

[0026] In combination with the first aspect, in some implementations of the first aspect, after calculating the information difference between the pre-enhanced image and the first image, the method further includes: packaging the first image and the information difference and saving them into the same image file.

[0027] That is, after the electronic device calculates the information difference, it can encode and save the information difference, and encapsulate the saved information difference and the first image into the same image file for subsequent reading and display.

[0028] In combination with the first aspect, in some implementations of the first aspect, the above-mentioned creation and display of an enhanced image corresponding to the first image based on the information difference and the first image includes: decoding the image file to obtain the first image and the information difference; creating and displaying the enhanced image based on the information difference and the first image.

[0029] When the electronic device encapsulates the first image and the information difference and saves them in the same image file, during the process of displaying the enhanced image, the electronic device can decode the image file to obtain the above-mentioned first image and information difference, and then create and display the enhanced image through the information difference and the first image during the display process.

[0030] In combination with the first aspect, in some implementations of the first aspect, when the first image and the information difference package are saved in the same image file, the above method also includes: saving metadata corresponding to the information difference, the metadata including at least one of the maximum value of the information difference, the minimum value of the information difference, and the maximum value (Hmax) of the expandable dynamic range of the first image.

[0031] That is, in addition to storing the information difference corresponding to the first image, the electronic device may also store metadata corresponding to the information difference, so as to provide more data references when subsequently enhancing the first image and displaying a more enhanced image.

[0032] In a second aspect, the present application provides a device, which is included in an electronic device and has the function of implementing the electronic device behavior described in the first aspect and possible implementations of the first aspect. The function can be implemented through hardware or through hardware executing corresponding software implementations. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a receiving module or unit, a processing module or unit, etc.

[0033] In a third aspect, the present application provides an electronic device, the electronic device comprising: one or more processors, and a memory;

[0034] The memory is coupled to the one or more processors, and the memory is used to store computer program code, where the computer program code includes computer instructions. The one or more processors call the computer instructions to enable the electronic device to execute any one of the methods in the technical solution of the first aspect.

[0035] In a fourth aspect, the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions to enable the electronic device to execute the method in the first aspect and any possible implementation thereof.

[0036] Optionally, the chip system also includes a memory, and the memory is connected to the processor via circuits or wires.

[0037] Further optionally, the chip system also includes a communication interface.

[0038] In a fifth aspect, the present application provides a computer-readable storage medium, which includes instructions. When the instructions are executed on an electronic device, the electronic device executes any one of the methods in the technical solution of the first aspect.

[0039] In a sixth aspect, the present application provides a computer program product, which includes: a computer program code, which, when the computer program code runs on an electronic device, enables the electronic device to execute any one of the methods in the technical solution of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0041] FIG2 is a block diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0042] FIG3 is a schematic diagram of an example of enabling high dynamic range display of an HDR image provided in an embodiment of the present application;

[0043] FIG4 is a schematic diagram of another example of enabling high dynamic range display of an HDR image provided by an embodiment of the present application;

[0044] FIG5 is a schematic diagram of another example of enabling high dynamic range display of an HDR image provided by an embodiment of the present application;

[0045] FIG6 is a flow chart of an image display method according to an embodiment of the present application;

[0046] FIG7 is a schematic diagram of a processing process of a preset model provided in an embodiment of the present application;

[0047] FIG8 is a schematic diagram of an image pyramid structure provided by an embodiment of the present application;

[0048] FIG9 is a schematic diagram of an example of an autoencoder structure provided in an embodiment of the present application;

[0049] FIG10 is a schematic diagram of an example of determining an information difference based on a first image and a pre-enhanced image provided by an embodiment of the present application;

[0050] FIG11 is a flow chart of another image display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0052] In the following, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features indicated. Therefore, a feature specified as "first," "second," or "third" may explicitly or implicitly include one or more of the features.

[0053] In order to facilitate the understanding of the embodiments of the present application, the relevant concepts involved in the embodiments of the present application are first briefly described.

[0054] 1. Dynamic range (DR)

[0055] Dynamic range is the ratio of a signal's maximum to minimum values. For example, the DR value can be expressed as a logarithm with base 10. When the DR value is reflected in an image, it can be understood as the ratio of the brightness values ​​of the highlight areas to the brightness values ​​of the shadow areas.

[0056] 2. High Dynamic Range (HDR)

[0057] High dynamic range refers to a signal with a ratio between its highest and lowest values ​​(i.e., dynamic range) greater than or equal to a preset first threshold. When HDR is reflected in an image, it can be understood that the image contains both bright and dark areas. If the ratio between the brightness of the bright areas and the brightness of the dark areas exceeds the first threshold, the corresponding image can also be called an HDR image.

[0058] 3. Standard Dynamic Range (SDR)

[0059] Standard dynamic range means that the ratio between the maximum and minimum values ​​of the signal (i.e., the dynamic range) is less than a preset first threshold and greater than or equal to a preset second threshold (the second threshold is less than the first threshold). When SDR is reflected in an image, it can be understood that there are highlight areas and dark areas in the image, and the ratio between the brightness value of the highlight area and the brightness value of the dark area is less than the preset first threshold and greater than or equal to the preset second threshold. It should be understood that the corresponding image can also be called an SDR image.

[0060] 4. Red, green, blue (RGB)

[0061] RGB stands for red, green, and blue, the three basic color pigments used to reproduce color in displays, panels, projectors, printers, and other devices. The RGB color space is based on independent color coordinates, allowing colors to be transmitted and received using the same color coordinate system across different devices, regardless of the different color coordinates of each device.

[0062] 5. HDR transfer functions

[0063] When displaying HDR images, adjustments need to be made from the actual ambient brightness to the display brightness of the electronic device to achieve a better image quality. However, since human vision is nonlinear in its perception of brightness and is more sensitive to dark areas than bright areas, the adjustment process from the actual ambient brightness to the display brightness of the electronic device should also be nonlinear. This process requires a linear to nonlinear signal conversion, i.e., a conversion based on the HDR transfer function (also known as a transfer function). Currently, commonly used transfer functions include, but are not limited to, perceptual quantizer (PQ) and hybrid log-gamma (HLG).

[0064] 6. Metadata: Metadata is information attached to HDR images or videos that helps display devices better display the image content. Metadata content can include information such as the image's maximum brightness, minimum brightness, average brightness, and color gamut. HDR metadata can include static metadata and dynamic metadata. Static metadata defines a fixed brightness and contrast range for a series of images and can be applied to a video stream consisting of a series of images. Dynamic metadata is generated dynamically based on each frame of the image and can dynamically adjust the brightness and contrast for each frame.

[0065] With the continuous improvement of the performance of electronic devices, the display screens of electronic devices can now support the display of HDR images. From the above description, it can be seen that HDR images have a higher display dynamic range than traditional SDR images. Therefore, HDR images can obtain more picture details and display a wider brightness range.

[0066] In the related art, if you want to display an HDR image, it is usually necessary to simultaneously collect scene brightness information or a gain map while collecting a base image (such as an SDR image), and then perform tone mapping on the base image based on the scene brightness information or the gain map to display the corresponding HDR image. For example, an electronic device may have an HDR camera function. When the HDR camera function is turned on, the electronic device may collect the base image and scene brightness information at the same time, and save the base image and scene brightness information in an image file. If the user clicks to display the image, the electronic device may perform tone mapping on the base image based on the scene brightness information to display the corresponding HDR image.

[0067] From this, we can see that the relevant technology mainly uses the scene brightness information to enhance the basic image in the photo scene and display it as an HDR image. However, for some electronic devices with weak hardware capabilities (such as weak image acquisition capabilities), the scene brightness information may not be collected, and the corresponding HDR image cannot be displayed. Furthermore, for images not obtained in the photo scene in the electronic device, HDR display is also impossible due to the lack of corresponding scene brightness information or gain map.

[0068] In view of this, an embodiment of the present application provides an image display method, in which an electronic device pre-processes a base image to generate a pre-enhancement map, then generates a gain map based on the pre-enhancement map and the base image, and then enhances and displays the base image based on the generated gain map. This process no longer requires the acquisition of scene brightness information or gain maps, and does not rely on the hardware acquisition capabilities of the electronic device. That is, it can achieve dynamic range enhancement display of any image and display the corresponding enhanced image (such as an HDR image), which has strong applicability. It can be understood that the image display method provided in the embodiment of the present application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, personal computers (PCs), netbooks, personal digital assistants (PDAs), and other electronic devices with image processing capabilities. The embodiment of the present application does not impose any restrictions on the specific type of electronic device.

[0069] For example, FIG1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Taking the electronic device 100 as a mobile phone as an example, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0070] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0071] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0072] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0073] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0074] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0075] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0076] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0077] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0078] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0079] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0080] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0081] In the example where the electronic device 100 is a mobile phone, the software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to exemplify the software structure of the electronic device 100.

[0082] For example, FIG2 is a software structure diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer, from top to bottom. The application layer may include a series of application packages.

[0083] As shown in Figure 2, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message. It is understood that images captured by the user using the camera, images downloaded via the WLAN network, or images captured from videos can all be saved in the gallery application. When the user subsequently views the images through the gallery application, the electronic device can respond to the user's viewing operation and display the corresponding images.

[0084] In some implementations, when a user views an image in a gallery application, the gallery application may provide an HDR display entry corresponding to the image. If the user chooses to display it in HDR, the gallery application may perform dynamic range enhancement on the image and call the display driver to display the HDR image corresponding to the image.

[0085] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0086] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0087] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc. The content provider is used to store and obtain data and make this data accessible to applications. Data can include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The phone manager is used to provide communication functions for the electronic device 100. For example, the management of call status (including answering, hanging up, etc.). The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.

[0088] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0089] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0090] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0091] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0092] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0093] For ease of understanding, the following embodiments of the present application will take an electronic device having the structure shown in Figures 1 and 2 as an example, and combine the accompanying drawings and application scenarios to specifically explain the image display method provided in the embodiments of the present application.

[0094] In some scenarios, taking the electronic device as a mobile phone as an example, as shown in Figure 3, the user can click on the gallery application icon on the desktop interface to trigger the gallery application to run. On the running interface of the gallery application, a list of images and videos taken or downloaded is displayed. At the same time, a setting control 31 is also presented on the running interface. When the user clicks on the setting control 31, the electronic device can display the setting interface corresponding to the gallery application. On this setting interface, a switch control 32 for high dynamic display of HDR pictures is presented. If the user triggers the switch to turn on the high dynamic display of HDR pictures, when viewing a certain HDR image (for example, an image taken using the HDR camera function), the electronic device can display the image in HDR. However, for non-HDR images, under normal circumstances, the electronic device cannot perform HDR display. For this situation, an embodiment of the present application provides an HDR display entrance in the gallery application, so that the electronic device can display any image in HDR.

[0095] For example, as shown in Figure 4, when a user clicks on any image on the running interface of the gallery application, the electronic device can display the image in a large image, and multiple operation controls are presented at the bottom of the display interface, such as sharing, favorites, editing, and deletion controls. If the user clicks on the edit control 41, the electronic device can jump to the editing interface of the image, on which an HDR display control 42 is presented. If the user clicks on the HDR display control 42, the electronic device can perform dynamic range enhancement processing on the image to obtain and display the corresponding HDR image. The image processing process of the electronic device is described in detail in the following embodiment.

[0096] In other scenarios, for example, the electronic device is a PC. As shown in FIG5 , the electronic device's storage space (e.g., a hard disk) can store multiple images and videos. When a user clicks on an image, the electronic device can open the image using an installed image viewer. If the user wishes to display the image in HDR, they can click on an HDR display control 51 on the image display interface. The electronic device then performs dynamic range enhancement processing on the image, obtaining and displaying the corresponding HDR image. The image processing process of the electronic device is described in detail in the following embodiments.

[0097] It should be noted that the image display method provided in the embodiments of the present application is not only applicable to the above two scenarios, but also applicable to any scenario in which HDR display of images is required in electronic devices that support HDR display.

[0098] FIG6 is a flow chart of an image display method provided in an embodiment of the present application. The method may be executed by an electronic device and may specifically include:

[0099] S101, acquiring a first image.

[0100] The first image (i.e., the base image) may be any image stored in the electronic device. For example, if the electronic device is a mobile phone, the first image may be any image in a gallery application; if the electronic device is a PC, the first image may be any image stored in the hard disk of the PC.

[0101] In some implementations, the first image may be an SDR image. In some implementations, the electronic device may perform the following processing on the first image upon receiving a user-triggered HDR display operation.

[0102] S102: Process the first image using a preset model to generate a pre-enhanced image corresponding to the first image.

[0103] Among them, the purpose of using the preset model to process the first image to generate a pre-enhanced image is that subsequent electronic devices can generate an information difference (or gain map) based on the pre-enhanced image and the first image, that is, the information difference is obtained by the electronic device through the preset model and calculation, and no longer needs to be collected.

[0104] In some implementations, when the first image is an 8-bit SDR image, the pre-enhanced image may be a 10-bit HDR image. It is understood that an 8-bit image can provide 256 sampling points, while a 10-bit image can provide 1024 sampling points. The color accuracy and image quality of a 10-bit image are superior to those of an 8-bit image.

[0105] In some implementations, the preset model may be an artificial intelligence (AI) model, such as a neural network model, which may perform dynamic range enhancement on low dynamic range images to generate images with relatively high dynamic range.

[0106] In some implementations, the preset model may include a first model and a second model. The first model can be used to perform color mapping on pixels in the first image to generate an image having a different display dynamic range from the first image. The second model can be used to further enhance the result after color mapping of the first model.

[0107] Optionally, the first model can be a color mapping model, which can be a convolutional neural network model. That is, the electronic device can use the convolutional neural network model to achieve a one-to-one color mapping relationship for each pixel. The second model can be a detail enhancement model, which can further enhance the output of the color mapping model, remove artifacts and faults, and reconstruct a higher-quality image. Then, as shown in Figure 7, after the electronic device inputs the first image into the preset model, it can be processed by the color mapping model and the detail enhancement model respectively to output a pre-enhanced image.

[0108] Exemplarily, as shown in FIG8 , the color mapping model can be an image pyramid structure. The image pyramid is a type of multi-scale expression of an image and an effective structure for interpreting an image at multiple resolutions. The image pyramid of an image is a set of image resolutions that gradually decrease in a pyramid shape (from bottom to top) and originate from the same original image. The higher the level of the pyramid, the smaller the image and the lower the resolution. Therefore, after the electronic device inputs the first image into the color mapping model, it can combine color information of more scales as color prior information through the image pyramid structure, and fine-tune the output of the color mapping model according to a linear function to convert the first image into an initial pre-enhanced image. For example, an 8-bit SDR image is converted into an initial 10-bit HDR image.

[0109] As shown in Figure 9, the detail enhancement model can be an autoencoder (AE) structure. An autoencoder is a type of artificial neural network (ANN) used in semi-supervised and unsupervised learning. Its function is to represent input information by using it as a learning target. An autoencoder consists of two parts: an encoder and a decoder. Because the input and output data structures are essentially the same, the autoencoder's network structure exhibits "big-small-big" symmetry: the encoder is the network that goes from high to low dimensions, and the decoder is the network that goes from low to high dimensions. Therefore, after the electronic device outputs an initial pre-enhanced image using the aforementioned color mapping model, it can reconstruct the initial pre-enhanced image using an autoencoder (i.e., an encoder-decoder structure). The reconstruction process can also incorporate the color prior information obtained above to improve the details of the resulting pre-enhanced image and remove more artifacts and discontinuities.

[0110] S103: Calculate the information difference between the pre-enhanced image and the first image, and encapsulate the first image and the information difference into the same image file.

[0111] After the electronic device generates the above-mentioned pre-enhanced image, an information difference (Gap) between the pre-enhanced image and the first image (ie, the base image) may be calculated. The information difference may represent a pixel difference between the first image and the pre-enhanced image.

[0112] In some implementations, the electronic device may compare the pre-enhanced image and the first image pixel by pixel, and use the pixel information difference between the pixels as the overall information difference.

[0113] In other implementations, the electronic device may calculate the information difference between the pre-enhanced image and the first image in the following manner: assuming that the first image is an 8-bit SDR image with a YUV encoding format, the pre-enhanced image is a 10-bit HDR image with a PQ or HLG transfer function and a YUV encoding format, the electronic device may define the ratio between the value of the Y channel of the pixel in the pre-enhanced image and the value of the Y channel of the corresponding pixel in the first image as the above-mentioned information difference. Optionally, in the case where the value of the Y channel in the first image and the value of the Y channel in the pre-enhanced image can be converted to a linear domain, the information difference Gap = Y-HDR / Y-SDR, where Y-HDR represents the value of the Y channel of the pixel in the pre-enhanced image, and Y-SDR represents the value of the Y channel of the pixel in the first image. It can be understood that for each pixel in the first image, the information difference between it and the pixel at the corresponding position in the pre-enhanced image can be calculated.

[0114] Assuming that the first image is an 8-bit SDR image with an encoding format of RGB, the pre-enhanced image is a 10-bit HDR image with a transfer function of PQ or HLG and an encoding format of RGB, the electronic device can define the ratio between the values ​​of the R, G, and B channels of the pixels in the pre-enhanced image and the values ​​of the R, G, and B channels of the corresponding pixels in the first image as the above-mentioned information difference. Optionally, when the values ​​of each channel in the first image and the values ​​of each channel in the pre-enhanced image can be converted to a linear domain, the information difference Gap(R) = R-HDR / R-SDR, Gap(G) = G-HDR / G-SDR, Gap(B) = B-HDR / B-SDR, R-HDR represents the value of the R channel of the pixel in the pre-enhanced image, R-SDR represents the value of the R channel of the pixel in the first image, G-HDR represents the value of the G channel of the pixel in the pre-enhanced image, G-SDR represents the value of the G channel of the pixel in the first image, B-HDR represents the value of the B channel of the pixel in the pre-enhanced image, and B-SDR represents the value of the B channel of the pixel in the first image.

[0115] In some implementations, after the electronic device calculates the information difference, it can encode and save the information difference. Optionally, the electronic device can save the information difference in the form of an image (i.e., the image is composed of the information difference corresponding to each pixel). When saved in the form of an image, the information difference can be represented as a gain map. Exemplarily, the electronic device calculates the information difference based on the first image and the pre-enhanced image, and a schematic diagram of saving the information difference in the form of an image can be seen in Figure 10. At the same time, the electronic device can also encapsulate the saved information difference and the first image into the same image file for subsequent reading and display.

[0116] In some implementations, when encoding and storing the information difference, the electronic device may also store metadata corresponding to the information difference. Optionally, the metadata may include, but is not limited to, a maximum information difference value GapMax, a minimum information difference value GapMin, and a maximum value Hmax of the scalable dynamic range of the first image.

[0117] In some implementations, after calculating the information difference between the pre-enhanced image and the first image, the electronic device may further normalize the information difference (or perform other linear or nonlinear transformations) and then encode and store the normalized information difference to ensure uniformity of the information difference data. Optionally, the electronic device may normalize the information difference by: G_Normalized = (Gap - GapMin) / (GapMax - GapMin).

[0118] S104: Create and display an enhanced image corresponding to the first image based on the image file.

[0119] After the electronic device completes encapsulating the first image and the information difference, it can start creating and displaying an enhanced image corresponding to the first image, such as displaying an HDR image corresponding to the SDR image.

[0120] In some implementations, when displaying an enhanced image corresponding to a first image, the electronic device may first decode the image file to obtain the above-mentioned first image and information difference, and then create and display the enhanced image based on the information difference, the display brightness of the electronic device, and the first image during the display process.

[0121] Exemplarily, an electronic device may create an enhanced image in the following manner: assuming that the bit width of the first image (BaseImage or BI) is 8 bits and the transfer function is Gamma 2.2, the first image is first converted to linear space for normalization. For example, the first image may be converted to linear space and normalized to the interval [0, 1] by BI_LINEAR = clip((BI / 255)**2.2, 0, 1), where **2.2 represents the Gamma 2.2 power of the pixel value in the image. It is then assumed that the relationship between the display brightness of the electronic device and the current scalable dynamic range H of the electronic device can be expressed as: H = Lheadroom / Lcurrent, where Lcurrent is the current display brightness of the electronic device and Lheadroom is the scalable brightness that the electronic device can provide. Here, Lheadroom is greater than or equal to Lcurrent and less than or equal to the maximum display brightness that the electronic device can provide in its current state. Then, an enhanced image (EnhancedImage or EI) may be obtained by EI = BI_LINEAR*Gap*H / Hmax, where Hmax represents the maximum value of the scalable dynamic range of the first image contained in the metadata corresponding to the above information difference. Alternatively, without considering normalization of the first image, the enhanced image can also be obtained by using BaseImage*Gap*H / Hmax. Alternatively, if normalization is required to account for information difference, the enhanced image can also be obtained by using BI_LINEAR*G_Normalized*H / Hmax or BaseImage*G_Normalized*H / Hmax. Thus, after the electronic device creates the final enhanced image, it can be displayed on the display. For example, the enhanced image can be displayed with an 8-bit or 10-bit bit width.

[0122] Optionally, after the electronic device obtains the enhanced image (EI), it can also perform normalization processing on it. For example, if the bit width of the enhanced image is 8 bits and the transfer function is Gamma2.2, it can be normalized by EI_Normalized = (clip((EI-EImin) / (EImax-EImin), 0, 1)**(1 / 2.2))*255, where EImax represents the maximum value of EI and EImin represents the minimum value of EI.

[0123] In some implementations, if the display brightness of the electronic device is not affected, the electronic device may create an enhanced image based solely on the information difference and the first image. For example, the electronic device may create the enhanced image based on a product relationship between the information difference and the first image.

[0124] For the above implementation process, in some implementation methods, when the processing performance of the preset model is good enough, for example, the accuracy of the generated pre-enhanced image is high enough, the electronic device can also directly use the pre-enhanced image generated by the preset model as the final enhanced image, and no longer calculate the information difference, so as to improve image processing efficiency.

[0125] In the above-mentioned image display method, after the electronic device obtains any image, it can pre-process the image to generate a pre-enhanced image, and then calculate the information difference based on the pre-enhanced image and the basic image (for example, the information difference can be a gain image), and then create and display an enhanced image based on the information difference and the basic image (for example, an image with a higher dynamic range). This process no longer requires the collection of scene brightness information or gain maps, and does not need to rely on the hardware acquisition capabilities of the electronic device. That is, it can realize dynamic range enhancement display of any image and display the corresponding enhanced image, which has strong applicability.

[0126] Based on the process of the above embodiment, the image display method provided by the embodiment of the present application is described below using an application scenario as an example. For example, taking the scenario shown in FIG. 4 as an example, after the user clicks the HDR display control 42, the electronic device may start to perform the following image processing process, as shown in FIG. 11 , which may include:

[0127] S201: A gallery application receives a first operation on a first image.

[0128] Exemplarily, the first operation may be a click operation on the HDR display control 42 in FIG. 4 , that is, triggering HDR display of the first image (the image currently displayed by the gallery application).

[0129] S202: In response to the first operation, the gallery application calls a preset model to process the first image and generates a pre-enhanced image corresponding to the first image.

[0130] That is, after receiving the first operation, the gallery application can respond to the first operation and call the preset model to process the first image. For example, the gallery application can call the preset model through an interface provided by the preset model to generate a pre-enhanced image corresponding to the first image. The process of the gallery application processing the first image can be found in the description of S102 above and will not be repeated here.

[0131] S203: The image library application calculates the information difference between the pre-enhanced image and the first image, and encapsulates the first image and the information difference into the same image file.

[0132] The process of calculating the information difference by the gallery application can be found in the description of S103 above, which will not be repeated here.

[0133] S204: The gallery application decodes the image file to obtain a first image and an information difference.

[0134] S205 , the gallery application creates an HDR image according to the information difference, the display brightness of the electronic device, and the first image.

[0135] The implementation process of steps S204-S205 can refer to the description of S104 above.

[0136] In some implementations, because the current user triggers the gallery application to display the first image in HDR in real time, in actual scenarios, after calculating the information difference, the gallery application may not encapsulate and save the first image and the information difference first, but directly create an HDR image through the information difference, the display brightness of the electronic device and the first image to improve processing efficiency.

[0137] In other implementations, after creating the HDR image, the gallery application may save the HDR image. If the user triggers HDR display of the first image next time, the gallery application may directly obtain the saved HDR image for display.

[0138] S206 , the gallery application calls the display driver to display the HDR image.

[0139] That is, after the gallery application creates the HDR image, it can call the display driver through the interface provided by the system to display the HDR image.

[0140] In the above-mentioned image display method, when the user triggers HDR display for any image through the gallery application, the gallery application can pre-process the image to generate a pre-enhanced image, and then calculate the information difference based on the pre-enhanced image and the basic image, and then create and display the enhanced image based on the information difference and the basic image (for example, displaying an SDR image as an HDR image). This process no longer requires the collection of scene brightness information or gain maps, and is not limited to images taken by a camera. That is, it can realize dynamic range enhancement display of any image and display the corresponding enhanced image, which has strong applicability.

[0141] The above describes in detail an example of the image display method provided by the embodiment of the present application. It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. Those skilled in the art should easily appreciate that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0142] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each function can be divided into various functional modules, such as a detection unit, a processing unit, a display unit, etc., or two or more functions can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0143] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0144] The electronic device provided in this embodiment is used to execute the above-mentioned image display method, and thus can achieve the same effect as the above-mentioned implementation method.

[0145] When integrated, the electronic device may also include a processing module, a storage module, and a communication module. The processing module may be used to control and manage the operation of the electronic device. The storage module may be used to support the execution of program code and data stored in the electronic device. The communication module may be used to support communication between the electronic device and other devices.

[0146] The processing module may be a processor or a controller. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor (DSP) and a microprocessor, and so on. The storage module may be a memory. The communication module may specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, or a Wi-Fi chip.

[0147] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment may be a device having the structure shown in FIG. 1 .

[0148] The present application also provides a computer-readable storage medium that stores a computer program. When the computer program is executed by a processor, the processor executes the image display method of any of the above embodiments. The storage medium may include a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, among other media capable of storing program code.

[0149] An embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the image display method in the above-mentioned embodiment.

[0150] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the image display method in the above-mentioned method embodiments.

[0151] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0152] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0153] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0154] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. An image display method, the method being executed by an electronic device, characterized in that: The method comprises: Acquire a first image, where the first image is any image to be enhanced and displayed in the electronic device; Processing the first image using a preset model to generate a pre-enhanced image corresponding to the first image; An information difference between the pre-enhanced image and the first image is calculated, and an enhanced image corresponding to the first image is created and displayed based on the information difference and the first image, wherein a display dynamic range of the enhanced image is greater than or equal to a display dynamic range of the first image.

2. The method according to claim 1, characterized in that The creating and displaying an enhanced image corresponding to the first image according to the information difference and the first image includes: The enhanced image is created based on the information difference, the display brightness of the electronic device, and the first image, and the enhanced image is displayed.

3. The method according to claim 2, characterized in that The creating the enhanced image according to the information difference, the display brightness of the electronic device, and the first image includes: The enhanced image is created according to the information difference, a scalable dynamic range, and the first image, wherein the scalable dynamic range is determined by the display brightness of the electronic device and metadata corresponding to the information difference.

4. The method according to claim 3, characterized in that The creating the enhanced image according to the information difference, the scalable dynamic range, and the first image includes: The enhanced image is created according to a relationship including BaseImage*Gap*H / Hmax, where the BaseImage represents the first image, the Gap represents the information difference, the H represents the current expandable dynamic range of the electronic device, the Hmax represents the maximum value of the expandable dynamic range of the first image contained in the metadata, H=Lheadroom / Lcurrent, the Lheadroom represents the expanded brightness that the electronic device can provide, the Lcurrent represents the current display brightness of the electronic device, the Lheadroom is greater than or equal to the Lcurrent, and the Lheadroom is less than or equal to the maximum display brightness that the electronic device can provide in the current state.

5. The method according to any one of claims 1 to 4, characterized in that The preset model includes a first model and a second model. The first model is used to perform color mapping on the pixel points in the first image to generate a second image with a different display dynamic range from the first image. The second model is used to perform detail enhancement on the second image to generate the pre-enhanced image.

6. The method according to claim 5, characterized in that The first model is an image pyramid structure, and the second model is an autoencoder structure.

7. The method according to any one of claims 1 to 6, characterized in that The calculating the information difference between the pre-enhanced image and the first image includes: A ratio between a value of the first channel of each pixel in the pre-enhanced image and a value of the first channel of a corresponding pixel in the first image is calculated, and the ratio of each pixel is determined as the information difference.

8. The method according to claim 7, characterized in that The first channel is a Y channel.

9. The method according to claim 7, characterized in that The first channels include an R channel, a G channel, and a B channel.

10. The method according to any one of claims 1 to 9, characterized in that After calculating the information difference between the pre-enhanced image and the first image, the method further includes: The first image and the information difference are packaged and saved in the same image file.

11. The method according to claim 10, characterized in that The creating and displaying an enhanced image corresponding to the first image according to the information difference and the first image includes: Decoding the image file to obtain the first image and the information difference; The enhanced image is created and displayed based on the information difference and the first image.

12. The method according to claim 10 or 11, characterized in that In the case of encapsulating and saving the first image and the information difference into the same image file, the method further includes: Metadata corresponding to the information difference is saved, where the metadata includes at least one of a maximum value of the information difference, a minimum value of the information difference, and a maximum value of an expandable dynamic range of the first image.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors, and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program code, where the computer program code includes computer instructions. The one or more processors call the computer instructions to enable the electronic device to execute the method according to any one of claims 1 to 12.

14. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium comprises instructions, which, when executed on an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 12.

Images