Image display method and electronic device

Abstract

An image display method and an electronic device. The method comprises: acquiring a first image, wherein the first image comprises a first channel, and a channel value of each pixel in the first image in the first channel is related to the brightness; converting the first image into a second image, wherein a channel value interval of the second image in the first channel is greater than a channel value interval of the first image in the first channel; and displaying the second image. Embodiments of the present application can improve the display effect of the electronic device on a preview image.

Description

Image display method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on December 20, 2023, with application number 202311770399.7 and application name “Image Display Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image display technology, and in particular to an image display method and electronic equipment. Background Art

[0003] The dynamic range of an image refers to the grayscale ratio between the brightest and darkest parts of an image. In other words, it measures the range of brightness levels that can be displayed in an image. Generally speaking, the higher the dynamic range, the richer the image's detail and the closer it is to real life.

[0004] Currently, when using the camera of an electronic device to capture images (photos or videos), live broadcast, screen projection, etc., the electronic device provides a preview image for the user to refer to. However, the preview image provided by the electronic device to the user is quite different from the real environment, and the display effect is poor, which affects the user experience.

[0005] Application Contents

[0006] The present application provides an image display method and an electronic device, which can improve the display effect of the electronic device on the preview image and enhance the user experience.

[0007] In a first aspect, an embodiment of the present application provides an image display method, comprising: acquiring a first image, the first image including a first channel, the channel value of each pixel in the first channel being related to brightness; converting the first image into a second image; the channel value interval of the second image in the first channel being greater than the channel value interval of the first image in the first channel; and displaying the second image. For example, in a YUV format image, the first channel may be the Y channel. The second image generated in this method has a higher dynamic range than the first image, thereby improving the utilization rate of the display capacity of the display when the second image is displayed on the display, so that the display screen has a better display effect than the first image, thereby improving the user experience.

[0008] In a possible implementation, the first image is generated based on multiple frames of raw images with different exposures, and converting the first image into the second image includes: obtaining a third image; generating the third image based on at least one frame of the multiple frames of raw images with different exposures; and converting the first image into the second image based on the third image.

[0009] Optionally, to obtain more highlight details and a dynamic range of the highlight portion, the at least one raw image frame may be at least one raw image frame with relatively low exposure among multiple raw images with different exposures. For example, if the first image is generated based on two raw images (a long frame and a short frame), the third image may be generated based on the raw image frame with the short exposure.

[0010] In one possible implementation, converting a first image to a second image based on a third image includes: determining a first interval of the first image, the first interval being greater than a channel value interval of the first channel of the first image; converting the second image to a fourth image based on the first interval of the first image, the channel value of the first channel of each pixel in the fourth image being within the first interval; and generating the second image based on the third image and the fourth image. Optionally, when converting the second image to the fourth image based on the first interval of the first image, the pixel value of the first channel of each pixel in the second image can be converted to a pixel value within the first interval based on the first interval, and the pixel value of each pixel in the second image in channels other than the first channel can be converted based on the first interval or not, and this is not limited in this embodiment of the present application.

[0011] In one possible implementation, generating a second image based on a third image and a fourth image includes: determining a second interval of the third image based on the first interval and the maximum peak brightness of the display screen; converting a first channel value of a first channel of each pixel in the third image into a second channel value based on the second interval of the third image, the second channel value being within the second interval; and generating the second image based on the fourth image and the second channel value of the first channel of each pixel in the third image.

[0012] In one possible implementation, a second image is generated based on a fourth image and the second channel value of each pixel in the third image in the first channel, including: for each pixel in the fourth image, determining the fourth channel value of the pixel based on the third channel value of the pixel in the first channel and the second channel value of the pixel at the same position as the pixel in the third image in the first channel; and updating the third channel value of the pixel in the fourth image to the fourth channel value, to obtain the second image.

[0013] In a possible implementation, determining the first interval of the first image includes: obtaining ambient light brightness corresponding to the first image; and determining the first interval of the first image according to the ambient light brightness.

[0014] In a possible implementation, determining the first interval of the first image according to the ambient light brightness includes: determining a display screen brightness corresponding to the ambient light brightness; and determining the first interval of the first image according to the display screen brightness.

[0015] In a possible implementation, determining the first interval of the first image according to the display screen brightness includes: determining an average channel value and a maximum channel value of the first image on a first channel; and determining the first interval according to the display screen brightness, the average channel value, and the maximum channel value.

[0016] In a possible implementation, the method further includes: generating a first video based on multiple frames of first images; generating a second video based on a third image corresponding to the multiple frames of first images; and generating a video file based on the first video and the second video.

[0017] In a possible implementation, the method further includes storing the ambient light brightness corresponding to the first image in a video file. In some embodiments, the ambient light brightness corresponding to each frame of the first image may be stored in metadata of the frame of the first image.

[0018] In a second aspect, an embodiment of the present application provides an electronic device comprising: a processor and a memory; wherein one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the processor, enable the electronic device to execute any one of the methods of the first aspect.

[0019] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes any one of the methods of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0022] FIG2 is a schematic diagram of a software structure of an electronic device provided in an embodiment of the present application;

[0023] FIG3A is a schematic diagram of a UI interface provided in an embodiment of the present application;

[0024] FIG3B is a schematic diagram of another UI interface provided in an embodiment of the present application;

[0025] FIG4 is a schematic diagram of a flow chart of an image display method provided in an embodiment of the present application;

[0026] FIG5A is a schematic diagram of another UI interface provided in an embodiment of the present application;

[0027] FIG5B is another schematic flow chart of an image display method according to an embodiment of the present application;

[0028] FIG6A is a schematic diagram of a third flow chart of the image display method provided in an embodiment of the present application;

[0029] FIG6B is a schematic diagram of a fourth flow chart of the image display method provided in an embodiment of the present application;

[0030] FIG7 is a schematic diagram of a fifth flow chart of the image display method provided in an embodiment of the present application;

[0031] FIG8 is a schematic diagram of a process for generating a second image by combining ambient light brightness, a gain map, and a first image according to an embodiment of the present application;

[0032] FIG9 is a schematic diagram of a process for determining a grayscale value interval based on ambient light brightness according to an embodiment of the present application;

[0033] FIG10 is a schematic diagram of a brightness curve of an intermediate image on a display screen provided in an embodiment of the present application;

[0034] FIG11 is a schematic diagram of a brightness curve of a second image on a display screen provided in an embodiment of the present application;

[0035] FIG12 is a schematic diagram of a method for generating a video file provided in an embodiment of the present application;

[0036] FIG13 is a sixth flow chart of the image display method provided in an embodiment of the present application;

[0037] FIG14 is a seventh flow chart of the image display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.

[0039] The image display method of the embodiment of the present application can be applied to electronic devices, such as mobile phones, tablet computers (PADs), personal computers (PCs), wearable devices, AR devices, etc.

[0040] 1 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an internal memory 121, a camera 193, a display screen 194, a sensor module 180, etc. The sensor module 180 may be an ambient light sensor 180L.

[0041] Optionally, as shown in Figure 1, the electronic device 100 may also include: an external memory interface 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a button 190, a motor 191, an indicator 192, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0042] Optionally, the sensor module 180 may also include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, a bone conduction sensor 180M, and the like.

[0043] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0044] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0045] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0046] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0047] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0048] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0049] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0050] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0051] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0052] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0053] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0054] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0055] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0056] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light brightness. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.

[0057] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Taking the (Android) system as an example, the software structure of the electronic device 100 is exemplified.

[0058] FIG2 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0059] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: from top to bottom: the application layer, the application framework layer (also known as the system framework layer), the system library and Android runtime layer, the hardware abstraction layer (HAL), and the kernel layer.

[0060] The application layer may include several applications (hereinafter referred to as applications). In the embodiment of the present application, the application layer may include, for example: a camera application, a live broadcast application, a screen projection application, and the like.

[0061] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer, including various components and services to support developers' Android development. In the embodiment of the present application, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0062] The Android runtime layer includes the system libraries and the Android runtime. The system libraries include multiple functional modules, such as the surface manager and libc. The Android runtime is responsible for scheduling and managing the Android system, specifically including the core libraries and the virtual machine. The core libraries consist of two parts: one for Java-based functions and the other for the Android core libraries. The virtual machine is used to run Android applications developed in Java.

[0063] The HAL layer is the interface between the operating system kernel and the hardware circuitry. It includes, but is not limited to, the Camera Hardware Abstraction Layer (HAL) and the Hardware Composer HAL. The Camera HAL processes image streams, while the Hardware Composer HAL allows users to perform window (layer) synthesis and display.

[0064] The kernel layer is the layer between hardware and software. It includes drivers such as the camera driver, ambient light sensor driver, and display driver. The camera driver drives the camera. The ambient light sensor driver drives the ambient light sensor. The display driver drives the display.

[0065] Hereinafter, the image display method implemented in the present application will be described in conjunction with the structures of the electronic devices shown in FIG. 1 and FIG. 2 .

[0066] First, the nouns appearing in the embodiments of the present application are explained exemplarily.

[0067] The dynamic range of an image refers to the grayscale ratio between the brightest and darkest parts of an image. In other words, the dynamic range of an image is a measure of the brightness levels that can be displayed in the image. Generally speaking, the higher the dynamic range of an image, the richer the details and the closer it is to the real world.

[0068] YUV: It is a color encoding mode, in which Y represents brightness (Luminance), that is, grayscale value, U represents chrominance (Chrominance), and V represents concentration (Chroma). It is used to describe the color and saturation of the image and is used to specify the color of the pixel.

[0069] Raw image: An unprocessed and uncompressed photo format. In other words, a raw image is the original data obtained by converting the captured light source signal into a digital signal by the complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor in the camera. The raw image records the original information of the image sensor and can also record some metadata generated by the camera shooting, such as the sensitivity (ISO) setting, shutter speed, aperture value, white balance, etc. In some related technologies, the raw image can also be called Bayer raw or raw Bayer. The internal storage method of the raw image can be RGGB, BGGR, or GRBG based on different arrays.

[0070] Nit: It is a unit of brightness in the International System of Units. It is defined as the luminous flux intensity emitted per square meter per second. In layman's terms, nit is the intensity of light emitted per square meter per second.

[0071] When a user activates the camera application of an electronic device (such as a mobile phone) to capture images or videos, uses the live broadcast application of an electronic device (such as a mobile phone) to broadcast live, or projects the video image captured by the camera to the display screen of an augmented reality (AR) device, the video image displayed to the user for preview can be called a preview image stream.

[0072] The following first describes an example of a scenario in which a preview image stream may be used.

[0073] As shown in Figure 3A, taking the example of a user launching the camera application in the mobile phone to take photos or videos, after the camera application is launched, the user can enter the photo (or video) shooting interface. For example, interface 310 is the photo shooting interface, and the photo shooting interface includes a preview area 311. The preview area 311 displays the video image captured by the mobile phone's camera in real time. The above video image can be considered as a preview image stream.

[0074] In the photo shooting interface shown in, for example, interface 310, the user can select the video recording control 312 in interface 310 to switch the shooting mode from photo shooting to video shooting. At this time, the camera application displays a video shooting interface shown in, for example, interface 320. The video shooting interface also includes a preview area 321. The preview area 321 displays the video image captured by the mobile phone's camera in real time. The above video image can also be considered as a preview image stream.

[0075] The user selects the video shooting control 322 in the video shooting interface, such as shown in interface 320, and the camera application starts shooting video, such as shown in interface 330. At this time, the preview area 321 still displays the video image captured by the mobile phone's camera in real time, which can also be considered as a preview image stream.

[0076] As shown in Figure 3B, taking the example of a user using a live broadcast application in a mobile phone to broadcast live, the live broadcast application provides a live broadcast interface for the user, such as interface 340, which includes a preview area 341. The preview area 341 displays the video image captured by the mobile phone's camera in real time. The video image can be considered as a preview image stream.

[0077] In addition, when a user uses an AR device, if the video image captured by the camera in real time is directly displayed on the AR display screen, the video image can also be considered as a preview image stream.

[0078] The preview image stream may include one or more frames of images.

[0079] In one embodiment, a method for generating a preview image stream in an electronic device is shown in FIG4 , wherein:

[0080] The camera captures a raw image and sends it to the ISP. The ISP generates a single frame based on the raw image and sends it to the display processor, which drives the display screen for display. The camera continuously captures raw images, and the ISP generates multiple frames in response. These multiple frames form a preview image stream, which the display screen continuously displays based on the preview image stream, thereby displaying the preview video in the preview area of ​​the scene.

[0081] However, in the embodiment shown in FIG4 , when the ISP generates each frame of the preview image stream, it is implemented based on the standard dynamic range (SDR). In SDR, 8 bits are generally used to represent brightness and color. That is, each frame of the preview image stream is based on SDR. Although it can also be called a high dynamic range (HDR) image, since only a maximum of 8 bits can be used to represent brightness and color, there are only a maximum of 256 different brightness levels and color levels. The dynamic range of the image is limited, which is quite different from the dynamic range of the real world. Therefore, details such as highlights and shadows in the real world cannot be accurately restored, which will affect the display effect of the preview video.

[0082] Furthermore, many current electronic devices have displays that can display a dynamic range far exceeding that of the preview image. For example, the peak brightness of some displays can reach 1000 nits or even higher, as shown in Figure 4, while some better displays have already reached a peak brightness of 2000 nits. However, when electronic devices use displays to display the aforementioned 8-bit images generated based on the standard dynamic range (SDR), due to the image's low dynamic range, the image's display brightness can only reach the system brightness set by the electronic device, typically between 300 nits and 500 nits (for example, 300 nits is used as an example in Figure 4). This shows that displays have the ability to display images with a higher dynamic range, but the 8-bit images generated based on SDR technology have a limited dynamic range and cannot fully utilize the display capabilities of the display. This is another important reason for the poor preview video display quality.

[0083] To this end, the embodiments of the present application provide an image display method and an electronic device, which can solve the problem of poor preview video display effect caused by the above reasons, improve the display effect of the preview video, and enhance the user experience.

[0084] The image display method of the embodiment of the present application can be used as a preview video playback method provided by the camera application to the user. In the embodiment of the present application, the preview method is called HDR preview. It can be understood that the name of the above preview method can be implemented by other names, and the embodiment of the present application is not limited.

[0085] Assuming that the camera application uses the preview video playback mode shown in Figure 4 as the default mode, and the HDR preview in the embodiment of the present application as an optional playback mode, then referring to Figure 5A, the user starts the camera application in the mobile phone to take a photo or video. After the camera application is started, the user can enter the photo (or video) shooting interface. For example, interface 510 is a photo shooting interface, and the photo shooting interface includes a preview area 511. The preview area 511 uses the method shown in Figure 4 to display the video image captured in real time by the camera of the mobile phone. The photo shooting interface includes an "HDR preview" control 512. The user selects the "HDR preview" control 512. Accordingly, the camera application detects the user's selection operation for the HDR preview playback mode. Accordingly, the camera application is triggered to execute the image display method of the embodiment of the present application, so that the preview area 511 can display the preview video generated by the image display method of the embodiment of the present application. The preview video has a relatively better display effect.

[0086] In some embodiments, if the camera application does not provide a preview video playback method other than the HDR preview in the embodiment of the present application, or the camera application provides multiple playback methods for preview videos but the HDR preview is the default playback method, then after the camera application is started and enters the photo shooting interface, it can trigger the execution of the image display method in the embodiment of the present application, and display the preview video generated by the image display method in the embodiment of the present application in the preview area 511.

[0087] It is understandable that other preview scenes shown in Figures 3A and 3B, such as the video shooting interface 320 of the camera application, the interface 330 during video shooting, the live broadcast interface 340 of the live broadcast application, etc., can also add this control, so that users can choose how to play the preview video. They are not listed one by one here.

[0088] In the image display method of the embodiment of the present application, the dynamic range of each frame image in the preview image stream can be improved to narrow the difference between the dynamic range of each frame image and the dynamic range of the real world, and the display capabilities of the display screen can be more fully utilized, thereby presenting a dynamic range on the display screen that is closer to the real world, thereby improving the display effect of the preview video on the display screen.

[0089] In some embodiments, in the embodiments of the present application, the channel values ​​of the brightness-related channels of each frame image in the preview image stream can be mapped to channel values ​​within a larger channel value range, so that each frame image obtained after mapping has a larger dynamic range.

[0090] For ease of explanation, the following embodiments take the first image as an example to illustrate the method for processing each frame of the preview image stream. It is understandable that the first image can be any frame of the preview image stream.

[0091] Specifically, in an embodiment of the present application, a first target channel value range can be determined for the first image. Based on the first target channel value range, the first channel value of each pixel in the first image on the brightness-related channel is converted into a second channel value in the first target channel value range to obtain a second image. Through the above conversion, the channel value of the first image on the brightness-related channel is increased from a relatively small range to the first target channel value range, thereby improving the dynamic range of the second image relative to the first image.

[0092] Optionally, the first target channel value range is greater than the channel value range of the first channel related to brightness of the first image (hereinafter referred to as the original channel value range). For example, the first image may be an image in YUV format, wherein the Y channel represents brightness. Corresponding to the first channel related to brightness, the channel value of the pixel on the Y channel may be referred to as the grayscale value or grayscale value of the pixel. Assuming that the first image is an 8-bit image, the grayscale value of each pixel (i.e., the channel value of the Y channel) ranges from [0, 255]. Corresponding to the original channel value range, the first target channel value range of the first image may be greater than the original channel value range [0, 255], for example, [0, 600]. Since the minimum values ​​of the first target channel value range and the original channel value range are generally 0, it can also be said that the maximum value of the first target channel value range (e.g., 600 in [0, 600]) is greater than the maximum value of the original channel value range (e.g., 255 in [0, 255]).

[0093] Optionally, the first target channel value range of the first image may be related to or matched to the maximum peak brightness of the display screen, or in other words, the maximum value of the first target channel value range is less than or equal to the maximum peak brightness of the display screen. In some embodiments, to maximize the display capability of the display screen, the maximum value of the first target channel value range may be as close to or even equal to the maximum peak brightness of the display screen as possible. For example, if the maximum peak brightness of the display screen is 1000 nits, the first target channel value range of the first image may be [0, 1000].

[0094] It can be understood that due to the expansion of the first target channel value range, the number of bits of the channel value of each channel of the second image can increase accordingly. For example, when the first target channel value range is [0, 600] or [0, 1000], the number of bits of the channel value of each channel of the second image can be 10 bits.

[0095] Based on the above description, the maximum value of the above-mentioned first target channel value range (for example, 600 in the above example) can be determined based on the maximum channel value of the first image on the brightness-related channel (for example, the maximum value of 255 of the above-mentioned Y channel) and the maximum peak brightness of the display screen (for example, the above-mentioned 1000nit). The specific value is not limited in this embodiment of the application.

[0096] It should be noted that, in addition to mapping the first channel value of the pixel in the first channel in the first image to the second channel value, the channel value of the pixel in the first image on other channels (such as the U channel and the V channel) also needs to be mapped from the channel value of the low channel value range (such as [0, 255] when 8 bits) to the channel value of the high channel range (such as [0, 1023] or [0, 600] when 10 bits). The specific mapping method can refer to the mapping method of the channel value on the first channel, or other mapping methods can also be used. The embodiment of the present application does not limit this. It should be noted that when the first image performs channel value mapping on other channels (such as the U channel and the V channel), the value range of the maximum value of its target channel value range can be the same as the value range of the maximum value of the first target channel value range, but the specific target channel value range can be the same as or different from the first target channel value range. For example, in the method shown in Figure 6 below, the different value ranges of the two are taken as an example.

[0097] The image display method of the embodiment of the present application is described as follows:

[0098] As shown in Figure 5B, assuming that the bit number of the channel value of each channel in the first image is 8 bits and the first target channel value range of the first image is [0, 1000], after the ISP generates the first image, the display processor can map the channel value of each channel in the first image to a 10-bit channel value to obtain a second image with a channel value of 10 bits for each channel. Since the channel values ​​of the first channel related to brightness in the second image are distributed in the first target channel value range [0, 1000], the dynamic range is higher than that of the first image, and the display capacity of the display screen is more efficiently utilized, so that the second image displayed on the display screen is closer to the dynamic range of the real world. After each frame of the preview image stream is processed as described above, the display effect of the preview video on the display screen can be improved.

[0099] In another embodiment of the image display method provided by the present application, when the dynamic range of the first image is expanded to a higher dynamic range, it can be achieved based on the ambient light brightness and / or the gain map of the first image. The implementation of the image display method of the embodiment of the present application is further described below with reference to Figures 6A, 6B, and 7. The image display method of the embodiment of the present application may include:

[0100] Step S1: Acquire multiple frames of raw images with different exposure levels captured by a camera.

[0101] The number of frames of the raw image captured by the camera is not limited in this embodiment of the application, and can be, for example, 2 or more frames. For example, in FIG6 , the camera captures 2 frames of raw images, where the frame with high exposure is denoted as a long frame L, and the frame with low exposure is denoted as a short frame S.

[0102] In some embodiments, the camera may be equipped with an HDR sensor to capture multiple frames of raw images at different exposure levels. Optionally, the HDR sensor may capture multiple frames of raw images using interlaced HDR, staggered HDR, or dual-cell gain (DCG).

[0103] Optionally, in combination with the electronic device structure shown in FIG1 , the camera can send multiple frames of raw images to the ISP.

[0104] Optionally, in combination with the software structure shown in FIG2 , multiple frames of raw images captured by the camera can be transmitted to the camera HAL via the camera driver.

[0105] Step S2: Generate a first image according to multiple frames of raw images.

[0106] Optionally, in this step, a fusion process of multiple raw images can be implemented using a related algorithm to generate a first image. For example, as shown in FIG7 , a multi-scale feature extractor (MFE) algorithm is used to fuse multiple raw images to generate a first image.

[0107] Optionally, the first image may be an image in any format, such as an image in RGB format or an image in YUV format.

[0108] Optionally, in combination with the electronic device structure shown in FIG1 , this step may be performed by an ISP.

[0109] Optionally, in combination with the software structure shown in FIG2 , this step may be performed by the camera HAL of the HAL layer.

[0110] Step S3: generating a gain map corresponding to the first image according to at least one frame of the multiple frames of raw images.

[0111] The above-mentioned gain map is used as the gain map of the first image, and the gain map is used to gain the brightness of each pixel in the first image.

[0112] Optionally, the first image may be an image in any format, such as an image in RGB format or an image in YUV format.

[0113] Optionally, the gain image and the first image may be in the same or different formats. For example, if the first image frame is an image in YUV format, the gain image may be in YUV format or in other formats.

[0114] Optionally, generating a gain map based on at least one raw image frame can be implemented using a related conversion method, which is not limited in the present embodiment. For example, in the example shown in FIG7 , using the raw2YUV algorithm to generate a gain map based on at least one raw image frame is used as an example. In this case, the gain map can be an image in YUV format.

[0115] Optionally, at least one frame of the raw image with relatively low exposure among the multiple frames of raw images captured by the camera can be selected to generate a gain map. For example, if the camera captures a long frame L and a short frame S in step S1, the short frame S can be selected to generate a gain map. The gain map generated based on the raw image with low exposure (such as the short frame S) can obtain more highlight details and the dynamic range of the highlight part. In addition, by generating a gain map based on the raw image captured by the HDR sensor, the picture information of the gain map can be made more consistent with the picture information of the first image, which can effectively reduce the impact of camera shake and reduce the ghosting phenomenon in the second image generated in the embodiment of the present application.

[0116] Optionally, in combination with the electronic device structure shown in FIG1 , this step may be performed by an ISP.

[0117] Optionally, in combination with the software structure shown in FIG2 , this step may be performed by the camera HAL of the HAL layer.

[0118] Step S4: Obtaining the ambient light brightness corresponding to the first image.

[0119] Optionally, the real-time ambient light brightness can be acquired through an ambient light sensor.

[0120] Optionally, the time for acquiring the ambient light brightness and the time for the camera to capture multiple frames of raw images can be the same or close to each other, so that the image displayed on the display screen is closer to the real-world image viewed by the user.

[0121] Optionally, in the embodiment of the present application, there can be a corresponding relationship between the ambient light brightness and the first image, that is, when generating each frame image in the above-mentioned preview image stream, the ambient light brightness can be collected accordingly, so that each frame image of the preview video displayed on the display screen is closer to the real-world image viewed by the user, thereby improving the display effect of the display screen.

[0122] Optionally, in combination with the electronic device structure shown in FIG1 , this step may be performed by a display processor, and the display processor may specifically obtain real-time ambient light brightness from an ambient light sensor.

[0123] Optionally, in combination with the software structure shown in FIG2 , in this step, the hardware combination abstraction layer may be driven to obtain the ambient light brightness from the ambient light sensor.

[0124] Step S5: generating a second image according to the ambient light brightness, the gain map, and the first image.

[0125] The second image has a higher dynamic range than the first image.

[0126] Optionally, in combination with the electronic device structure shown in FIG1 , this step may be performed by a display processor.

[0127] Optionally, in combination with the software structure shown in FIG2 , this step may be performed by a hardware combination abstraction layer.

[0128] The implementation of the above step S5 is exemplarily described below with reference to FIG8 and FIG9 .

[0129] Specifically, step S5 may include the following steps S51 to S54.

[0130] Step S51: Determine the first screen brightness according to the ambient light brightness.

[0131] In the first instance, a lookup table of ambient light brightness to screen brightness can be preset based on the maximum peak brightness of the display screen of the electronic device, so that in this step, the screen brightness corresponding to the ambient light brightness can be found based on the lookup table as the above-mentioned first screen brightness.

[0132] Optionally, the above-mentioned lookup table can be obtained in advance based on statistics of human eye human factors experiments.

[0133] The above method of searching the screen brightness corresponding to the ambient light brightness based on the lookup table can be expressed by the following formula:

[0134] L env =Dict(Input sensor )

[0135] Among them, Input sensor Indicates the ambient light brightness, L env Indicates screen brightness. Dict() is a dictionary function that indicates searching in a lookup table from preset ambient light brightness to screen brightness.

[0136] In another example, the screen brightness corresponding to the ambient light brightness can be calculated using a preset formula based on the ambient light brightness as the first screen brightness. For example, the preset formula can be as follows:

[0137] Among them, Input sensor Indicates the ambient light brightness, L envrepresents the screen brightness, and γ is an adjustable parameter. The specific value of the adjustable parameter γ can be set independently in actual applications and is not limited in the embodiments of this application. In some embodiments, the value of the adjustable parameter γ is related to the maximum peak brightness of the display screen. The higher the maximum peak brightness of the display screen, the higher the value of the adjustable parameter γ.

[0138] It can be understood that the above preset formula is only an example, and there may be other variations or other calculation formulas for calculating the screen brightness corresponding to the ambient light brightness, and the embodiments of the present application are not limited thereto.

[0139] The purpose of determining the brightness of the first screen based on the ambient light brightness in this step is to make the average brightness of the dynamic range of the intermediate image after the channel value mapping in step S52 as close as possible to or equal to the real world, and thus make the dynamic range of the second image obtained by subsequent processing as close as possible to the dynamic range of the real world.

[0140] Step S52: determining the maximum screen brightness of the first image according to the first screen brightness, and determining the first channel value interval of the first image according to the maximum screen brightness of the first image.

[0141] In one example, the average grayscale value of the first image on the Y channel can be determined in this step. and the highest grayscale value Y max , and then according to the average grayscale value Maximum grayscale value Y max and the first screen brightness L env Determine the maximum screen brightness L of the first image image max Based on the maximum screen brightness L image max The first channel value range of the first image can be determined image =[0,L image,max ].

[0142] Specifically, the average grayscale value can be Maximum grayscale value Y max and the first screen brightness L env The maximum screen brightness L of the first image is calculated using the following formula image max :

[0143] It can be understood that if the maximum screen brightness of the first image is determined through the above example, the first image needs to be in YUV format. If the first image generated in step S2 is not an image in YUV format, the first image can be converted into an image in YUV format in this step.

[0144] It is understandable that the Y channel in the above example can also be extended to channels related to brightness in other image formats, and the embodiments of the present application will not list them one by one.

[0145] Step S53: determining a second channel value interval of the gain map of the first image according to the first channel value interval of the first image.

[0146] Optionally, the maximum value of the second channel value interval can be determined based on the maximum peak brightness of the display screen. For example, if the maximum peak brightness of the display screen is 1000 nit, the maximum value of the second channel value interval can be 1000. The second channel value interval of the gain map can be the remaining channel value interval in the interval [0, 1000] except the first channel value interval, that is, the second channel value interval Range. enhance =[L image,max ,1000].

[0147] Step S54: performing fusion processing on the first image and the gain map according to the first channel value interval of the first image and the second channel value interval of the gain map to obtain a second image.

[0148] In one example, assuming that the first image and the gain map are fused in YUV format, this step may include:

[0149] Mapping a first grayscale value of each pixel in the Y channel of the first image to a second grayscale value according to the first channel value interval;

[0150] Mapping the third grayscale value of each pixel in the Y channel of the gain map to a fourth grayscale value according to the second channel value interval;

[0151] For each pixel in the first image, the fifth grayscale value is calculated according to the second grayscale value of the pixel and the fourth grayscale value of the pixel at the same position in the gain map to obtain the second image. In other words, the grayscale value of each pixel in the second image in the Y channel is the corresponding fifth grayscale value.

[0152] Optionally, mapping the first grayscale value of each pixel in the Y channel of the first image to the second grayscale value according to the first channel value interval can be specifically implemented by the following formula:

[0153] Among them, Y image,10bit Indicates the second grayscale value, Y image,8bit Indicates the first grayscale value, 8bit and 10bit respectively indicate the number of bits of the grayscale value.

[0154] It is understandable that the above formula is only a mapping relationship from the first grayscale value to the second grayscale value. In practical applications, there may be other mapping methods, which are not limited in the embodiments of the present application.

[0155] Optionally, mapping the third grayscale value of each pixel in the Y channel of the gain map to a fourth grayscale value according to the second channel value interval can be specifically implemented by the following formula:

[0156] Among them, Y enhance,10bit Indicates the fourth grayscale value, Y enhance,8bit Indicates the third grayscale value.

[0157] It is understandable that the above formula is only a mapping relationship from the third grayscale value to the fourth grayscale value. In practical applications, there may be other mapping methods, which are not limited in the embodiments of the present application.

[0158] Optionally, the fifth grayscale value Y of each pixel display,screeen The specific calculation can be obtained through the following formula:

[0159] Among them, L display,max Indicates the maximum peak brightness of the display.

[0160] It is understandable that the above formula is only a method for determining the fifth grayscale value. In practical applications, there may be other calculation methods, which are not limited in the embodiments of the present application.

[0161] Optionally, for other channels (e.g., U and V channels) of each pixel in the first image, the same method as mapping the first grayscale value of the Y channel of each pixel in the first image to the second grayscale value can be used to map the channel value of each other channel to a new channel value, and the new channel value can be used as the channel value of the other channel for each pixel in the second image.

[0162] Continuing with the above example, the channel value U of the U channel in the second image is display,screeen The calculation formula can be:

[0163] Among them, U image,10bit Represents the channel value of the pixel in the first image after mapping in the U channel, that is, the new channel value mentioned above, U image,8bit Indicates the channel value of the pixel in the U channel in the first image before mapping.

[0164] The channel value V of the V channel in the second image display,screeen The calculation formula can be:

[0165] Among them, V image,10bit Represents the channel value of the pixel in the first image after mapping in the V channel, that is, the new channel value mentioned above, V image,8bit Indicates the channel value of the pixel in the first image in the V channel before mapping.

[0166] In this embodiment, the channel values ​​of each channel of each pixel in the first image frame are mapped based on the ambient light brightness, so that the brightness of the mapped image frame can be closer to the real world. The brightness of each pixel in the first image frame is gained using a gain map in order to give full play to the display capability of the display screen, make the brightness of the highlight area closer to the brightness of direct light source or mirror reflection, and improve the image display effect.

[0167] In other embodiments provided in the present application, step S4 can be omitted, that is, the ambient light brightness corresponding to the first image is not obtained, and the second image can be generated according to the gain map and the first image in step S5. Accordingly, in the above step S51, the first screen brightness can be determined not according to the ambient light brightness, but the first screen brightness can be directly set in advance according to the maximum peak brightness of the display screen. In other words, the first screen brightness may not change based on the ambient light brightness.

[0168] In other embodiments provided in the present application, step S3 can be omitted, that is, the gain map of the first image is not generated, and the second image can be generated according to the ambient light brightness and the first image in step S5. Accordingly, step S53 can be omitted, and the calculation related to the gain map in step S54 can be omitted. At this time, the dynamic range of the second image can be increased to [0, L image,max ].

[0169] The implementation of the above steps S51 to S54 is exemplified.

[0170] Referring to Figure 8, in an embodiment of the present application, the first channel value interval of the first image and the second channel value interval of the gain map can be determined based on the maximum peak brightness of the display screen and the ambient light brightness detected by the ambient light sensor. The first channel value interval is used to improve the dynamic range of the first image, and the second channel value interval is used to expand the highlight area of ​​the first image based on the gain map, thereby improving the dynamic range of the generated second image and being able to display the second image on the display screen to more fully utilize the display capability of the display screen.

[0171] Specifically, referring to FIG9 , assuming that the maximum peak brightness of the display is 1000 nit and the ambient light brightness is 1000 lux, the first channel value interval can be determined as [0,599] and the second channel value interval can be determined as [600,1000] based on the above two values. Thus, the display brightness interval of the first image on the display can be expanded to [0,599] through the first channel value interval [0,599]. Then, the brightness of the first image in the highlight interval [600,1000] is increased through the gain map, so that the dynamic range of the second image is further improved, and the display capability of the display can be more fully utilized when the second image is displayed on the display.

[0172] It should be noted that FIG5 takes the generation of the raw image based on the Bayer array RGGB as an example. In fact, the embodiment of the present application does not limit the structure of the Bayer array corresponding to the raw image. In other words, the embodiment of the present application does not limit the array structure of the CCD or CMOS sensor in the display screen, as long as the raw image can be collected.

[0173] It should be noted that the image display method of the embodiment of the present application can not only solve the problem of poor preview video display effect in the above-mentioned scenario, but can also be further extended to the problem of poor image or video image display effect caused by the dynamic range of the image or video frame sent for display being too low relative to the display capability of the display screen. The image display method of the embodiment of the present application is used to process the image or video frame sent for display to improve the dynamic range of the above-mentioned image or video frame and improve the display effect.

[0174] In some embodiments, as shown in Figure 12, in the image display method of the embodiment of the present application, video encoding processing can also be performed on each frame image in the preview image stream (for example, the aforementioned 8-bit intermediate image) and the gain map corresponding to each frame image to generate a video file. The video file includes a first video and a second video. The first video includes each frame image in the preview image stream (corresponding to the aforementioned first image), and the second video includes the gain map corresponding to each frame image in the preview image stream.

[0175] Furthermore, the video file may also include the ambient light brightness corresponding to each frame image in the preview image stream. The ambient light brightness may be specifically stored in metadata corresponding to the intermediate image.

[0176] In some embodiments, the above-mentioned video encoding process and display process can be performed in parallel. For example, as shown in Figure 13, after the ISP generates the first image and the gain map corresponding to the first image, it can send the first image and the gain map corresponding to the first image to the video codec processor. The video codec processor can obtain the ambient light brightness corresponding to the first image from the ambient light sensor or the display processor, and perform video encoding processing on the first image, the gain map corresponding to the first image, and the ambient light brightness to obtain a video file.

[0177] In other embodiments, the above-mentioned image display process and video encoding process can be executed serially. For example, as shown in Figure 14, each frame image (corresponding to the above-mentioned first image) in the preview image stream generated by the ISP and the gain map corresponding to each frame image are sent to the display processor. The display processor controls the display screen to display the preview video according to each frame image, the gain map corresponding to each frame image and the ambient light brightness. After the preview is completed, the display processor sends each frame image in the preview image stream, the gain map corresponding to each frame image and the ambient light brightness to the video codec processor. The video codec processor performs video encoding processing on each frame image in the preview image stream, the gain map corresponding to each frame image and the ambient light brightness to generate a video file.

[0178] When a user plays a video file through an application in an electronic device, such as a video playback application or a photo album application, the video playback application can decode the video file to obtain each frame image in the preview image stream and the gain map corresponding to each frame image. If the ambient light brightness corresponding to each frame image is stored, the ambient light brightness corresponding to each frame image can also be decoded. Afterwards, the application in the electronic device can use the image display method of the embodiment of the present application to play the video file, so that when the video playback application plays the video, the dynamic range of the video frame can be expanded and the display effect can be improved. At this time, Figure 6A can decode the first image, the gain map corresponding to the first image, and the ambient light brightness from the video file.

[0179] It is understandable that the electronic device and application that generates the video file using the image display method of the embodiment of the present application may be the same as or different from the electronic device and application that plays the video file. For example, when user A shoots a video in the camera application of electronic device 1, the camera application uses the image display method of the embodiment of the present application to display the preview video in the video shooting interface, and generates the corresponding video file 1 and stores it in the album application of electronic device 1. When user A plays the video file 1 in the album application of electronic device 1, the album application can play the video using the image display method of the embodiment of the present application. User A can also send the video file 1 to the electronic device 2 of user B, and user B can use the application in the electronic device 2 to play the video file, so that the application in the electronic device 2 can also use the image display method of the embodiment of the present application to play the video.

[0180] An embodiment of the present application also provides an electronic device, including a processor and a memory, wherein the processor is used to implement the method provided in the embodiment of the present application.

[0181] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer-readable storage medium is run on a computer, the computer executes the method provided by the embodiment of the present application.

[0182] An embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program product is run on a computer, it enables the computer to execute the method provided by the embodiment of the present application.

[0183] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can represent: a, b, c, a and b, a and c, b and c or a and b and c, where a, b, c can be single or multiple.

[0184] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented using a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0185] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0186] In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of this application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), magnetic disk or optical disk, and other media that can store program code.

[0187] The above description is merely a specific embodiment of the present application. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. The scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. An image display method, characterized in that: include: Acquire a first image, where the first image includes a first channel, and a channel value of each pixel in the first channel is related to brightness; converting the first image into a second image; the channel value interval of the second image in the first channel is greater than the channel value interval of the first image in the first channel; The second image is displayed.

2. The method according to claim 1, characterized in that The first image is generated according to a plurality of frames of raw images with different exposures, and the converting the first image into the second image includes: Obtaining a third image; wherein the third image is generated according to at least one frame of the raw images of the multiple frames with different exposures; The first image is converted into a second image based on the third image.

3. The method according to claim 2, characterized in that The converting the first image into a second image according to the third image comprises: Determine a first interval of the first image, where the first interval is greater than a channel value interval of the first image in the first channel; converting the second image into a fourth image according to the first interval, wherein a channel value of each pixel in the fourth image in the first channel is within the first interval; The second image is generated based on the third image and the fourth image.

4. The method according to claim 3, characterized in that The step of generating the second image according to the third image and the fourth image comprises: determining a second interval of the third image according to the first interval and the maximum peak brightness of the display screen; Converting a first channel value of each pixel in the third image in the first channel to a second channel value according to the second interval, wherein the second channel value is within the second interval; The second image is generated according to the fourth image and the second channel value of each pixel in the third image in the first channel.

5. The method according to claim 4, characterized in that The step of generating the second image according to the second channel value of each pixel in the first channel in the fourth image and the third image comprises: For each pixel in the fourth image, determining a fourth channel value of the pixel according to a third channel value of the pixel in the first channel and a second channel value of a pixel at the same position as the pixel in the third image in the first channel; The third channel value of the pixel in the fourth image is updated to the fourth channel value to obtain the second image.

6. The method according to claim 3, characterized in that The determining a first interval of the first image includes: Obtaining the ambient light brightness corresponding to the first image; A first interval of the first image is determined according to the ambient light brightness.

7. The method according to claim 6, characterized in that The determining a first interval of the first image according to the ambient light brightness includes: Determine the display screen brightness corresponding to the ambient light brightness; A first interval of the first image is determined according to the brightness of the display screen.

8. The method according to claim 7, characterized in that The determining the first interval of the first image according to the brightness of the display screen includes: Determine an average channel value and a maximum channel value of the first image on the first channel; The first interval is determined according to the display screen brightness, the average channel value and the maximum channel value.

9. The method according to any one of claims 2 to 8, characterized in that: Also includes: Generate a first video according to multiple frames of first images; Generate a second video according to a third image corresponding to a plurality of frames of the first image; A video file is generated according to the first video and the second video.

10. The method according to claim 9, characterized in that Also includes: The ambient light brightness corresponding to the first image is stored in the video file.

11. The method according to any one of claims 2 to 8, characterized in that: The at least one frame of raw image is at least one frame of raw image with relatively small exposure among the multiple frames of raw images with different exposures.

12. An electronic device, characterized in that: include: Processor, memory; One or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the processor, enable the electronic device to perform the method according to any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 11.

Images