Exposure control method, electronic device and storage medium in high dynamic range mode

Abstract

An exposure control method, electronic device and storage medium for a high dynamic range mode relate to the field of terminal technology. The method is applied to electronic devices that support multiple HDR modes, including: when it is determined to adopt the first HDR mode, the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, the brightness statistics represent the illumination of the environment, the exposure parameters corresponding to each frame are a type of exposure parameters in the exposure parameter category set, each type of exposure parameter in the exposure parameter category set corresponds to a different exposure range, and the exposure parameter category set includes at least three types of exposure parameters; the exposure parameters corresponding to each frame are sent to the exposure control interface of the photosensitive element that matches the category of each frame, so that the photosensitive element is exposed according to the exposure parameters corresponding to each frame. This solution can realize exposure control for multiple HDR modes, and also improves the compatibility with HDR modes, so that electronic devices can be compatible with new HDR modes.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an exposure control method, electronic device and storage medium in a high dynamic range mode. Background Art

[0002] Dynamic range (DR), also known as exposure range, refers to the range of light intensities captured by the camera. For image signals, it is the ratio of the maximum and minimum values ​​of the variable light signal.

[0003] As the terminal industry develops, many electronic devices support high dynamic range (HDR) mode in addition to normal mode. HDR mode can capture and display the huge dynamic range of the real world under the limited dynamic range available in typical imaging sensors and display devices.

[0004] However, current electronic devices only use one HDR mode, so the exposure control strategy of the electronic device can only distinguish between the normal mode and the HDR mode. When the number of HDR modes applied to electronic devices increases, current electronic devices cannot provide corresponding exposure control strategies for multiple HDR modes. Summary of the invention

[0005] In order to solve the above problems, the present application provides an exposure control method, electronic device and storage medium for a high dynamic range mode, which can realize exposure control of multiple HDR modes.

[0006] In a first aspect, the present application provides an exposure control method for a high dynamic range mode, the method being applied to an electronic device, the electronic device supporting multiple HDR modes. The method comprises: when it is determined to adopt a first HDR mode, determining the exposure parameters corresponding to each frame of the first HDR mode according to brightness statistics. The brightness statistics are used to characterize the illumination of the environment in which the electronic device is located, the exposure parameters corresponding to each frame are a type of exposure parameters in an exposure parameter category set, each type of exposure parameter in the exposure parameter category set corresponds to a different exposure range, and the exposure parameter category set includes at least three types of exposure parameters. The exposure parameters corresponding to each frame are sent to a photosensitive element exposure control interface that matches the category of each frame, so that the photosensitive element is exposed according to the exposure parameters corresponding to each frame.

[0007] By using the technical solution provided in the embodiment of the present application, the exposure parameter category set includes at least three types of exposure parameters, which can match the exposure parameters corresponding to each frame of multiple HDR modes supported by the electronic device, and expand the types of exposure parameters and the types of exposure control interfaces, so that when the electronic device performs exposure control, the exposure parameters corresponding to each frame of different types of HDR modes can be sent to the corresponding types of exposure control interfaces to achieve exposure control of different types of HDR modes. In addition, by expanding the types of exposure parameters and the types of exposure control interfaces, the compatibility of electronic devices with HDR modes can be improved. For example, if the electronic device currently supports several HDR modes, the electronic device can be made compatible with new HDR modes through system updates and system upgrades in the future.

[0008] In a possible implementation, before sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame, the method further includes:

[0009] Determine the sum of the exposure times of the frames in the first HDR mode according to the exposure times in the exposure parameters corresponding to the frames in the first HDR mode;

[0010] When the sum of the exposure times is greater than the first time length, the frame length in the exposure parameter is increased. The first time length is the difference between the frame length and the time offset parameter. The frame length is the time to display one frame during preview or video shooting.

[0011] When performing exposure control, this implementation method can realize the exposure parameter detection function. When the exposure time does not meet the requirements, the frame length can be increased to ensure that the images in different HDR modes are displayed normally. The exposure parameter detection function avoids the problem of abnormal images caused by the adjustment of exposure parameters when electronic devices switch between different HDR modes.

[0012] In a possible implementation, when it is determined to adopt the first HDR mode, determining the exposure parameters corresponding to each frame of the first HDR mode according to the brightness statistics includes:

[0013] Determine the image output mode of the photosensitive element of the electronic device according to the illumination and dynamic range of the environment in which the electronic device is currently located;

[0014] When the image output mode is the first HDR mode, obtaining brightness statistics;

[0015] The exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics.

[0016] In a possible implementation, obtaining brightness statistics includes:

[0017] When there is no brightness statistical value of the previous RAW image, a preset brightness statistical value of the first HDR mode is determined as the brightness statistical value, or the brightness statistical value is determined according to a detection result of a color temperature sensor of the electronic device;

[0018] When the brightness statistics value of the previous RAW image frame is acquired, the brightness statistics value of the previous RAW image frame is determined as the brightness statistics value.

[0019] In a possible implementation, the exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a three-frame SHDR mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, specifically including:

[0020] According to the brightness statistics, the first type of exposure parameters corresponding to the long frame, the second type of exposure parameters corresponding to the medium frame, and the third type of exposure parameters corresponding to the short frame of the three-frame SHDR mode are determined; the exposure parameters corresponding to each frame are sent to the photosensitive element exposure control interface that matches the category of each frame, specifically including: sending the first type of exposure parameters corresponding to the long frame to the long frame exposure control interface of the photosensitive element, sending the second type of exposure parameters corresponding to the medium frame to the medium frame exposure control interface of the photosensitive element, and sending the third type of exposure parameters corresponding to the short frame to the short frame exposure control interface of the photosensitive element.

[0021] In a possible implementation, the exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a dual conversion gain DCG mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, specifically including:

[0022] Determine the first type of exposure parameters corresponding to the long frame and the third type of exposure parameters corresponding to the medium frame of the DCG mode according to the brightness statistics; send the exposure parameters corresponding to each frame to the exposure control interface of the photosensitive element that matches the category of each frame, specifically including: sending the first type of exposure parameters corresponding to the long frame to the long frame exposure control interface of the photosensitive element, and sending the third type of exposure parameters corresponding to the medium frame to the medium frame exposure control interface of the photosensitive element.

[0023] In a possible implementation, the first HDR mode is an internal dual conversion gain combined with an IDCG mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to brightness statistics, specifically including: determining the first type of exposure parameters corresponding to the long frame and the third type of exposure parameters corresponding to the medium frame of the IDCG mode according to the brightness statistics; sending the exposure parameters corresponding to each frame to an exposure control interface of a photosensitive element matching the category of each frame, specifically including: sending the first type of exposure parameters corresponding to the long frame to the long frame exposure control interface of the photosensitive element, and sending the third type of exposure parameters corresponding to the medium frame to the medium frame exposure control interface of the photosensitive element.

[0024] In a possible implementation, the exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence. The first HDR mode is an internal dual conversion gain combined with IDCG and a very short VS exposure frame fusion mode. The exposure parameters corresponding to each frame of the first HDR mode are determined according to brightness statistics, specifically including:

[0025] Determine the first type of exposure parameters corresponding to the IDCG frame and the third type of exposure parameters corresponding to the VS frame in the IDCG and VS frame fusion mode according to the brightness statistics; send the exposure parameters corresponding to each frame to the exposure control interface of the photosensitive element matching the category of each frame, specifically including: sending the long frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the long frame exposure control interface of the photosensitive element; sending the short frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the medium frame exposure control interface of the photosensitive element; sending the third type of exposure parameters corresponding to the VS frame to the VS frame exposure control interface of the photosensitive element.

[0026] In a possible implementation, the exposure parameter category set includes at least a first exposure parameter, a second exposure parameter, a third exposure parameter, and a fourth exposure parameter whose exposure ranges decrease in sequence, and the first HDR mode is an internal dual conversion gain combined with IDCG and a very short VS frame fusion mode. The exposure parameters corresponding to each frame of the first HDR mode are determined according to brightness statistics, specifically including:

[0027] Determine the first type of exposure parameters corresponding to the IDCG frame and the fourth type of exposure parameters corresponding to the VS frame in the IDCG and VS frame fusion mode according to the brightness statistics; send the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame, specifically including: sending the long frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the long frame exposure control interface of the photosensitive element; sending the short frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the medium frame exposure control interface of the photosensitive element; sending the fourth type of exposure parameters corresponding to the VS frame to the VS frame exposure control interface of the photosensitive element.

[0028] In a possible implementation, the exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a dual analog gain DAG mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, specifically including:

[0029] Determine the first type of exposure parameters corresponding to the long frame and the third type of exposure parameters corresponding to the medium frame of the DAG mode according to the brightness statistics; send the exposure parameters corresponding to each frame to the exposure control interface of the photosensitive element that matches the category of each frame, specifically including: sending the first type of exposure parameters corresponding to the long frame to the long frame exposure control interface of the photosensitive element, and sending the third type of exposure parameters corresponding to the medium frame to the medium frame exposure control interface of the photosensitive element.

[0030] In a second aspect, the present application further provides an electronic device, comprising a processor and a memory, the memory being used to store a program, and when the program is executed by the processor, the exposure control method of the high dynamic range mode provided by the above first aspect and any one of the implementation methods of the first aspect is executed.

[0031] In a third aspect, the present application further provides a storage medium having a computer program stored thereon. When the computer program is executed by an electronic device, the exposure control method for the high dynamic range mode provided by the first aspect and any one of the implementation methods of the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 Schematic diagram of the principle provided for this application Figure 1 ;

[0033] Figure 2 Schematic diagram of the scenario provided for this application;

[0034] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0035] Figure 4 A flowchart of an exposure control method in a high dynamic range mode provided in an embodiment of the present application;

[0036] Figure 5 A flowchart of another high dynamic range mode exposure control method provided in an embodiment of the present application;

[0037] Figure 6 Schematic diagram of the exposure parameter allocation principle provided in the embodiment of the present application Figure 1 ;

[0038] Figure 7 Schematic diagram of the exposure parameter allocation principle provided in the embodiment of the present application Figure 2 ;

[0039] Figure 8 A schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0041] In order to make the technical personnel in this field understand the solution of this application more clearly, the application scenario of the technical solution of this application is first described below. The electronic device in the embodiment of this application can be a mobile phone, a tablet computer, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, and other electronic devices. The embodiment of this application does not impose any special restrictions on the specific form of the electronic device.

[0042] The exposure parameters in the following description of the embodiments of the present application may include exposure time and exposure gain.

[0043] When the exposure gain remains unchanged, the longer the exposure time, the more photons reach the charge coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) phototransistor, and the brighter the captured image will be.

[0044] Exposure gain includes analog gain and digital gain of digital image signals after the image signal processor (ISP) converts electrical signals into digital image signals. When the HDR mode is turned on in an electronic device, when the ambient light intensity decreases, the sensitivity of the photosensitive element to light will be increased by increasing the exposure gain.

[0045] The product of exposure gain and exposure time is the exposure. Generally, a frame with a large exposure is called a long exposure frame, or long frame for short; a frame with a small exposure is called a short exposure frame, or short frame for short.

[0046] Current electronic devices support binning mode and HDR mode. In binning mode, the charges induced in adjacent pixels are added together and read out in a pixel mode. Binning mode is a non-HDR mode, and the camera sensor reads out one frame of image at a time. Sensor is also called camera sensor.

[0047] When the HDR mode is used, multiple frames of images are read out from the sensor. The multiple frames of images use different exposure values. After being processed by a certain algorithm, one frame of image is generated. The HDR mode currently used on electronic devices is generally the stagger HDR (SHDR) mode, which can also be called digital overlap (DOL) technology. The camera sensor outputs two frames of images. First, a long-exposure frame image is exposed to focus on collecting dark information, and then a short-exposure frame image is exposed to focus on collecting bright information. The two frames of images are simultaneously input into the image processing module of the chip platform, and one frame of image is generated after being processed by a certain algorithm.

[0048] See also Figure 1 , which is a schematic diagram of the principle provided by this application Figure 1 .

[0049] When the user turns on the camera, the current image output mode is first determined.

[0050] When the image output mode is determined to be the binning mode, the exposure parameters of the next frame are determined according to the brightness statistics of the image output by the camera sensor of the previous frame. At this time, the exposure parameters only include the long frame exposure parameters.

[0051] When the image output mode is determined to be the HDR mode, the exposure parameters corresponding to the long frame and the short frame are determined according to the brightness statistics of the sensor output image of the previous frame. That is, the exposure parameters at this time include the long frame exposure parameters and the short frame exposure parameters.

[0052] According to the exposure parameters and the current output mode, the exposure parameters are configured to the sensor so that the sensor performs exposure according to the received exposure parameters and then outputs the corresponding image.

[0053] See also Figure 2 , which is a schematic diagram of the scenario provided by this application.

[0054] When a picture has both high-brightness and low-brightness parts, that is, when the dynamic range is large, the binning mode is difficult to ensure that the high-brightness parts are not overexposed and the low-brightness parts retain sufficient details. Therefore, in such shooting scenes, the HDR mode is needed. In order to make the camera have better imaging effects in different scenes, it is necessary to determine the most suitable mode for the current scene based on the ambient light intensity, dynamic range, and comprehensive consideration of the requirements for dark details in the picture, the requirements for not overexposing the bright part of the picture, and the noise requirements. At this time, the electronic device needs to support multiple HDR modes and be able to implement exposure control for multiple HDR modes.

[0055] For example, by using the three-frame overlapping exposure HDR (stagger HDR, SHDR) mode, a long frame 2-(a), a medium frame 2-(b) and a short frame 2-(c) with different exposure amounts can be obtained, and the three frames of images can be fused into one frame of image 2-(d) to obtain a more realistic, high dynamic range image.

[0056] But by Figure 1 From the corresponding description, it can be seen that currently electronic devices only support exposure control of binning mode and single HDR mode, and do not provide corresponding exposure control strategies for other HDR modes, so that electronic devices cannot use other HDR modes.

[0057] In order to solve the above problems, the present application provides an exposure control method, electronic device and storage medium for a high dynamic range mode. The solution of the present application expands the types of exposure parameters and exposure control interfaces, so that when the electronic device performs exposure control, the exposure parameters corresponding to different types of HDR modes can be sent to the corresponding types of exposure control interfaces to achieve exposure control of different types of HDR modes.

[0058] The implementation method of the technical solution of this application is described in detail below.

[0059] The embodiments of the present application are intended to enable electronic devices to implement exposure control for multiple HDR modes. The following first introduces the types of compatible HDR modes that can be implemented using the solutions of the present application.

[0060] Dual conversion gain (DCG) mode: The gain of each pixel of the camera sensor can be controlled independently. When working in DCG mode, only one exposure is performed, but the reading is divided into two times. One time, high conversion gain (HCG or High CG) is used to capture dark information, and the other time, low conversion gain (LCG or low CG) is used to capture bright information. The HCG and LCG images are simultaneously input into the chip platform image processing module, and one image is generated after being processed by a certain algorithm.

[0061] Intra dual conversion gain combine (IDCG combine) mode: referred to as IDCG mode. The difference from DCG mode is that in DCG, the camera sensor inputs two frames of HCG and LCG images into the chip platform at the same time, which are then fused into one frame of image by the chip platform; in IDCG mode, HCG and LCG are fused into one frame of image inside the camera sensor and then input into the chip platform.

[0062] IDCG and very short (VS) frame fusion mode: VS refers to a frame with a very short exposure time. This mode follows the SHDR frame output method, first exposing a long exposure frame (IDCG frame, which is the fusion of HCG and LCG), and then exposing a short exposure frame (VS). Short exposure can use high conversion gain. The two frames of images are simultaneously input into the chip platform image processing module, and a frame of image is generated after a certain algorithm processing.

[0063] Dual analog gain (DAG) HDR mode: perform one exposure and read out twice, the long and short frames are obtained through the same high conversion gain (HCG), and the long and short frames use different analog gains. One is processed with high analog gain (HAG), and the other is processed with low analog gain (LAG). The sensor inputs the two frames processed by HAG and LAG into the image processing module of the chip platform at the same time, and generates one frame of image after algorithm processing.

[0064] Three-frame overlapping exposure HDR (stagger HDR, SHDR) mode: The difference between the three-frame SHDR mode and the conventional SHDR mode is that the sensor outputs three frames of images, namely a long exposure frame that focuses on collecting dark information, a medium exposure frame that focuses on collecting middle bright information, and a short exposure frame that focuses on collecting higher bright information. The three frames of images are simultaneously input into the image processing module of the chip platform, and one frame of image is generated after being processed by a certain algorithm.

[0065] The detailed summary of the above modes can be found in Table 1 below.

[0066] Table 1: Schematic diagram of each HDR mode

[0067]

[0068] The output frame number in the table is the output frame number of the sensor. When the sensor outputs multiple frames in HDR mode, they need to be fused into one frame to form an image on the preview screen or a frame image in the video recording screen. In Table 1, for the same mode, the exposure ratio of the long frame is the largest, and the exposure ratio of the short frame is the smallest.

[0069] The above different HDR modes can be used in different scenarios, as shown below.

[0070] When the dynamic range of the environment is very small, the binning mode can be applied; when the ambient brightness is low and the ambient dynamic range is high, the ordinary SHDR mode can be used, and when the ambient dynamic range is further increased, the three-frame SHDR mode can be used; when the ambient brightness is moderate and the ambient dynamic range is large, the DCG mode can be used; when the ambient brightness is high and the ambient dynamic range is moderate, the DCG mode can be used; when the ambient brightness is high and the ambient dynamic range is large, the DCGcombine and short exposure frame fusion modes can be used.

[0071] The above application scenarios of the HDR mode are only examples and do not constitute a limitation on the technical solution of the present application.

[0072] See also Figure 3 and Figure 4 .in, Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application; Figure 4 A flowchart of an exposure control method in a high dynamic range mode provided in an embodiment of the present application.

[0073] The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device.

[0074] The application layer may include a series of application packages, such as a camera APP.

[0075] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The camera API of the application framework layer is used to provide camera services.

[0076] The Hardware Abstraction Layer (HAL) is a routine package of the software layer. It is an interface layer between the operating system kernel and the hardware circuit. Its purpose is to abstract the hardware and simulate the details of a specific system platform so that the program can directly access the hardware resources.

[0077] A pipeline is a collection of one or more nodes. The pipeline provides a collection of all resources for a single specific function and maintains the flow of all hardware resources and data.

[0078] The policy module is used to decide which camera to open and the camera's image output mode.

[0079] The Linux Kernel is a layer between hardware and software. The kernel layer contains at least Linux basic drivers and device drivers, such as camera drivers.

[0080] Figure 4 The method shown comprises the following steps:

[0081] S11: Launch the Camera APP.

[0082] The user clicks the camera APP icon on the user interface of the electronic device to start the camera APP. After the camera APP is started, it enters the normal photo mode by default. The user can further select a specific working mode in the camera APP, such as switching to a video mode, a portrait mode, a panoramic mode, etc.

[0083] S12: The camera APP notifies the camera service to start.

[0084] The camera app notifies the camera service to start and transmits the camera's working mode information, which indicates the current camera working mode.

[0085] S13: The camera service starts the camera process.

[0086] The camera service executes the camera opening process through the HAL layer, and HAL notifies the policy module to determine the image output mode.

[0087] S14: The policy module determines the image output mode of the camera.

[0088] In a possible implementation, the policy module determines the image output mode based on the dynamic range, ambient light brightness, and camera zoom ratio.

[0089] The output mode can be binning mode or HDR mode.

[0090] S15: policy notifies the pipeline of the current output mode.

[0091] S16: The pipeline notifies the exposure control node to perform exposure control.

[0092] The exposure control node is used to check the exposure parameters of the binning mode and different HDR modes, and to allocate the exposure parameters of the binning mode and different HDR modes.

[0093] See also Figure 5 , which is a flow chart of another exposure control method in high dynamic range mode provided in an embodiment of the present application.

[0094] S21: The AEC node determines exposure parameters according to the brightness statistics.

[0095] The automatic exposure control (AEC) node can determine the dynamic range of the current scene based on the brightness statistics. The AEC node can specifically implement light intensity determination, scene analysis, and exposure compensation, which are described below.

[0096] The process of determining light intensity is the process of obtaining current light intensity information by using the brightness statistics of the image.

[0097] Scene analysis refers to the processing performed to obtain special conditions of the current lighting, such as whether there is backlight or strong front light. The analysis of this information can improve the usability of the sensor and greatly improve the quality of the image. This is the most critical technology in automatic exposure.

[0098] After completing the light intensity measurement and scene analysis, it is necessary to control the corresponding parameters to make the exposure adjustment effective, which is mainly achieved by setting the exposure time and exposure gain.

[0099] When the camera APP is just opened, when the AEC node processes the request for the first frame image, there is no brightness statistics of the previous RAW image, that is, the brightness statistics of the previous RAW image are not obtained. The brightness statistics at this time can be the preset brightness statistics corresponding to the current output mode, or the brightness statistics can be determined according to the detection result of the color temperature sensor of the electronic device. For example, the brightness statistics are determined according to the luminance detected by the color temperature sensor.

[0100] When the camera sensor has completed at least one frame of image output, the AEC node can determine the brightness statistics based on the RAW image of the previous frame. The RAW image is the raw data that the CMOS or CCD image sensor converts the captured light source signal into a digital signal. It contains uncompressed raw image data, and the exposure and white balance can be adjusted using software that supports this format. The brightness statistics of the previous RAW image can be determined by the sensor node and sent to the AEC node, corresponding to Figure 3 The process in ①.

[0101] Brightness statistics are used to characterize the illumination of the environment in which the electronic device is located.

[0102] After obtaining the brightness statistics, the AEC node determines the exposure parameters based on the brightness statistics and the current output mode.

[0103] The categories of exposure parameters in the embodiments of the present application are no longer limited to long frame exposure parameters and short frame exposure parameters, but are further expanded.

[0104] When the image output mode is binning mode, the exposure parameters only include the first type of exposure parameters, that is, only long frame exposure parameters. When the image output mode is HDR mode, the solution of the present application is not to directly determine the long frame exposure parameters and the short frame exposure parameters, but to determine the corresponding category of exposure parameters according to the specific HDR mode and send them to the sensor node.

[0105] The following describes the exposure parameter distribution strategy and allocation strategy in detail with reference to the accompanying drawings.

[0106] See also Figure 6 , which is a schematic diagram of the principle of exposure parameter allocation provided in an embodiment of the present application Figure 1 .

[0107] The exposure parameter category set includes at least three categories of exposure parameters.

[0108] Figure 6 In the illustrated implementation, the exposure parameter category set includes first-category exposure parameters, second-category exposure parameters, and third-category exposure parameters.

[0109] The exposure range of the first type of exposure parameters is greater than the exposure range of the second type of exposure parameters, and the exposure range of the second type of exposure parameters is greater than the exposure range of the third type of exposure parameters. For example, the exposure range of the first type of exposure parameters is [a2, a3], and the exposure range of the second type of exposure parameters is [a1, a2).

[0110] The first type of exposure parameters may correspond to a long frame, or a long frame combined with an internal dual conversion gain.

[0111] The second type of exposure parameters may correspond to a mid-frame.

[0112] The third type of exposure parameters may correspond to short, medium or very short (VS) frames.

[0113] When the AEC node sends exposure parameters, when the control is to perform one-frame exposure, the first type of exposure parameters are sent; when the control is to perform two-frame exposure, the first type of exposure parameters and the second type of exposure parameters are sent; when the control is to perform three-frame exposure, the first type of exposure parameters, the second type of exposure parameters and the third type of exposure parameters are sent. Figure 3 The process in ②.

[0114] The AEC node will implement the corresponding exposure parameter allocation strategy according to the current output mode, as described below:

[0115] When the image output mode is binning mode, the AEC node sends the first type of exposure parameters.

[0116] When the output mode is 2-frame SHDR mode, DCG mode, IDCG mode, DAG mode, IDCG and VS frame fusion mode, the AEC node sends the first and third exposure parameters.

[0117] When the image output mode is 3-frame SHDR mode, the AEC node sends the first exposure parameters, the second exposure parameters and the third exposure parameters.

[0118] See also Figure 7 , which is a schematic diagram of the principle of exposure parameter allocation provided in an embodiment of the present application Figure 2 .

[0119] Figure 7 In the illustrated implementation, the exposure parameter category set includes first-category exposure parameters, second-category exposure parameters, third-category exposure parameters, and fourth-category exposure parameters.

[0120] Among them, the exposure range of the first type of exposure parameters is greater than the exposure range of the second type of exposure parameters, the exposure range of the second type of exposure parameters is greater than the third type of exposure parameters, and the exposure range of the third type of exposure parameters is greater than the fourth type of exposure parameters.

[0121] Figure 7 and Figure 6 The difference is that a fourth type of exposure parameter is added. The fourth type of exposure parameter has the smallest exposure amount and is used to correspond to the VS frame.

[0122] It can be understood that the above embodiments are explained by taking the electronic device supporting the above various HDR modes at the same time as an example. In actual applications, if the electronic device does not support some HDR modes, the corresponding schematic diagram can be adaptively adjusted. For example, when the electronic device does not support IDCG and VS frame fusion modes, there is no fourth type of exposure parameter, and there is no VS frame exposure control interface in the exposure control interface of the sensor.

[0123] In the embodiment of the present application, when the output mode remains unchanged, the type of exposure parameter remains unchanged, but the specific parameter value of the exposure parameter may change. For example, when the HDR mode is maintained in the DCG mode, the brightness statistics obtained by the AEC node may change due to environmental changes, and the exposure parameters determined according to the changed brightness statistics may change. The specific exposure parameters that change may include exposure gain and exposure time.

[0124] For example, when it is determined according to the brightness statistics that the illumination of the current environment decreases, the exposure gain and / or exposure time in the exposure parameters may be increased to increase the exposure amount and improve the imaging quality of the image.

[0125] When the image output mode is switched, the type of exposure parameter may also change. Usually, the specific parameter value of the exposure parameter will change. In order to avoid large changes in the display screen when the image output mode is switched, the AEC node will control the exposure ratio change of the two image output modes before and after the switch to be low.

[0126] S22: The AEC node sends the exposure parameters to the sensor node.

[0127] S23: sensor node calls sensor interface kit.

[0128] The sensor node calls the sensor interface kit for exposure control, corresponding to Figure 3 Processes ③ and ④ in the process.

[0129] The sensor interface kit supports exposure control paths for different HDR modes.

[0130] The sensor node calls the sensor interface kit to perform processing in parts S24 and S25.

[0131] S24: The sensor node performs exposure parameter check.

[0132] The exposure parameters include exposure time, exposure gain, and frame length. In a possible implementation, the exposure gain in the exposure parameters sent by the AEC node to the sensor node is an overall gain, and the AEC node can determine the specific analog gain and digital gain to be used according to the output mode and the exposure gain.

[0133] The sensor node calls the sensor interface kit to check the exposure parameters, and then determines whether the exposure time and frame length of the image output mode meet the requirements. The frame length here refers to the time it takes for the electronic device to display a preview frame or a video capture frame after the image output mode is adopted. For example, when the electronic device displays a photo preview screen, if the preview screen displays 30 frames per second (FPS), the frame length is about 33.33ms; for another example, when the electronic device records a screen with an FPS of 60, the frame length is about 16.67ms.

[0134] When the output mode is binning mode, one exposure is required in one frame, and the exposure time and frame length need to satisfy the following relationship:

[0135] expo L <frame_length-offset1 (1)

[0136] The expo in formula (1) L is the exposure time of the long frame in binning mode, frame_length is the current frame length, offset1 is the time offset parameter corresponding to the binning mode, and frame_length-offset1 is the first time length.

[0137] When Expo L When it is greater than or equal to frame_length-offset1, it is determined that the frame length of the binning mode needs to be increased, and the sensor node updates the frame length in the exposure parameter so that equation (1) is satisfied.

[0138] When the output mode is two-frame SHDR mode, two exposures are required in one frame, and the exposure time and frame length need to satisfy the following relationship:

[0139] expoL +expo s <frame_length-offset2 (2)

[0140] The expo in formula (2) L The exposure time of the long frame in two-frame SHDR mode, expo S is the exposure time of the short frame of the two-frame SHDR mode, frame_length is the current frame length, and offset2 is the time offset parameter corresponding to the two-frame SHDR mode. When formula (2) is not satisfied, the frame length of the two-frame SHDR mode needs to be increased, and the sensor node updates the frame length in the exposure parameter so that formula (2) is satisfied.

[0141] When the output mode is three-frame SHDR mode, three exposures are required in one frame, and the exposure time and frame length need to satisfy the following relationship:

[0142] expo L +expo M +expo s <frame_length-offset3 (3)

[0143] The expo in formula (3) L is the exposure time of the long frame in three-frame SHDR mode, expo M is the exposure time of the long frame in three-frame SHDR mode, expo S is the exposure time of the middle frame in the three-frame SHDR mode, frame_length is the current frame length, and offset3 is the time offset parameter corresponding to the three-frame SHDR mode. When formula (3) is not satisfied, the frame length of the three-frame SHDR mode needs to be increased, and the sensor node updates the frame length in the exposure parameter so that formula (3) is satisfied.

[0144] When the image output mode is DAG, IDCG, or DCG, one exposure is required within one frame. Two frames are generated through different gains. The exposure time and frame length need to satisfy the following relationship:

[0145] expo <frame_length-offset4 (4)

[0146] In formula (4), expo is the required exposure time, frame_length is the current frame length, and offset4 is the time offset parameter corresponding to the DAG, IDCG or DCG mode. When formula (4) is not satisfied, the frame length needs to be increased, and the sensor node updates the frame length in the exposure parameter so that formula (4) is satisfied.

[0147] When the image output mode is IDCG and VS frame fusion mode, two exposures are required in one frame, and the exposure time and frame length need to meet the following relationship:

[0148] expo L +expo vs <frame_length-offset5 (5)

[0149] The expo in formula (5) L is the exposure time of IDCG combine frame, expo vs is the exposure time of the VS frame, frame_length is the current frame length, and offset5 is the time offset parameter corresponding to the IDCG and VS frame fusion mode. When formula (5) is not satisfied, the frame length needs to be increased, and the sensor node updates the frame length in the exposure parameter so that formula (5) is satisfied.

[0150] The above time offset parameters can be obtained from the configuration file, and the time offset parameters can be provided by the device manufacturer.

[0151] In the embodiment of the present application, by detecting the relationship between the exposure time and the frame length, the exposure time can be made always less than the frame length to ensure that the picture will not be abnormal. The reason for adding the exposure parameter check in the embodiment of the present application is that the electronic device can support multiple HDR modes, and the frame types of the multiple HDR modes may have different exposure times. As a result, if the exposure time detection is not performed after the exposure parameters are allocated, the exposure time of the HDR mode may be greater than the frame length, causing the displayed preview picture or the captured picture to be abnormal.

[0152] S25: The sensor node distributes the exposure parameters to the corresponding exposure control interface.

[0153] After the sensor node completes the exposure parameter check and determines that the current frame rate meets the requirement or updates the frame rate, it sends different types of exposure parameters to different camera sensor exposure control interfaces according to the current camera output mode.

[0154] The exposure parameter sent by the AEC node to the sensor node is the first exposure parameter, and the exposure parameter sent by the sensor node to each exposure control interface is the second exposure parameter. When the exposure parameter check determines that the exposure time meets the requirements, the first exposure parameter is the second exposure parameter. When the exposure parameter check determines that the exposure time does not meet the requirements, the second exposure parameter is obtained by modifying the frame length based on the first exposure parameter. That is, the frame length parameter carried in the second exposure parameter is different from that in the first exposure parameter.

[0155] The exposure control interface set in the embodiment of the present application includes at least three types of exposure control interfaces.

[0156] When the first HDR mode is used, when allocating exposure parameters, the exposure parameters corresponding to each frame are sent to the exposure control interface of the photosensitive element that matches the category of each frame, so that the photosensitive element is exposed according to the exposure parameters corresponding to each frame of the first HDR mode. The category of each frame is determined by the current HDR mode. For example, in DCG mode,

[0157] The details are explained below.

[0158] Below Figure 6 The implementation shown is taken as an example for explanation.

[0159] When the sensor output mode is binning mode, the category of the first type of exposure parameters is long frame, and sensornode sends the first type of exposure parameters to the long frame exposure control interface of the camera sensor.

[0160] When the sensor output mode is the two-frame SHDR mode, the sensor node sends the first type of exposure parameters to the long-frame exposure control interface of the camera sensor, and sends the second type of exposure parameters to the medium-frame exposure control interface of the camera sensor.

[0161] When the sensor output mode is the three-frame SHDR mode, the sensor node sends the first type of exposure parameters to the long frame exposure control interface of the camera sensor, sends the second type of exposure parameters to the medium frame exposure control interface of the camera sensor, and sends the third type of exposure parameters to the short frame exposure control interface of the camera sensor.

[0162] When the sensor output mode is DCG mode, the sensor node sends the first type of exposure parameters to the long frame exposure control interface of the camera sensor, and sends the third type of exposure parameters to the medium frame exposure control interface of the camera sensor.

[0163] When the sensor output mode is IDCG mode, the sensor node sends the first type of exposure parameters to the long frame exposure control interface of the camera sensor, and sends the third type of exposure parameters to the medium frame exposure control interface of the camera sensor.

[0164] When the sensor output mode is IDCG and VS frame fusion mode, the sensor node sends the HCG frame in the first type of exposure parameters to the long frame exposure control interface of the camera sensor, sends the LCG frame in the first type of exposure parameters to the medium frame exposure control interface of the camera sensor, and sends the third type of exposure parameters to the VS frame exposure control interface of the camera sensor. It can be understood that if the sensor does not provide a VS frame exposure control interface, the third type of exposure parameters can also be sent to the short frame exposure control interface of the camera sensor.

[0165] Below Figure 7 The implementation shown is taken as an example for explanation.

[0166] Figure 7 The implementation shown is similar to Figure 6 The difference is that when the sensor output mode is IDCG and VS frame fusion mode, the sensor node sends the HCG frame in the first type of exposure parameters to the long frame exposure control interface of the camera sensor, sends the LCG frame in the first type of exposure parameters to the medium frame exposure control interface of the camera sensor, and sends the fourth type of exposure parameters to the VS frame exposure control interface of the camera sensor.

[0167] S26: The sensor node sends configuration instructions to the camera driver.

[0168] The configuration instruction carries configuration parameters, which can be used to indicate the image output mode adopted by the camera sensor, such as the configuration parameters corresponding to the binning mode or the specific HDR mode.

[0169] S27: The camera driver configures the camera sensor according to the configuration instructions.

[0170] The camera driver can configure the camera sensor through the inter-integrated circuit (I2C) interface. The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0171] S28: The camera sensor generates frames according to the mode corresponding to the configuration parameters.

[0172] After the camera sensor is configured, frame data is generated according to the corresponding output mode. The frame data is RAW image data.

[0173] S29: The camera sensor transmits the RAW image data to the camera driver.

[0174] The camera sensor transmits the RAW image to the camera driver through the mobile industry processor interface (MIPI) interface. The RAW image can be stored in a buffer.

[0175] The MIPI interface is used to connect the processor to peripheral devices such as display screens and cameras. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), etc. In some embodiments, the processor and the camera communicate through the CSI interface to realize the shooting function of the electronic device. The processor and the display communicate through the DSI interface to realize the display function of the electronic device.

[0176] S30: The camera driver transmits the RAW image data to the sensor node.

[0177] S31: The sensor node determines brightness statistics according to the RAW image data.

[0178] S32: The sensor node sends brightness statistics to the AEC node.

[0179] The brightness statistics are used by the AEC node to determine the exposure parameters for the next frame of image.

[0180] S33: The sensor node transmits the RAW image data to the IFE node for image processing.

[0181] The sensor node transmits the RAW image data to the image front-end (IFE) node for image processing.

[0182] S34: The IFE node sends the camera frame data to the camera service.

[0183] The IFE node sends the camera frame data to the camera service through the Camera HAL3 interface.

[0184] S35: The camera service sends the camera frame data to the camera APP.

[0185] The camera installation package (Android package, APK) receives the frame data transmitted by the camera service and sends it to the screen for display so that the user can see the picture appearing on the screen.

[0186] The above method steps of the embodiment of the present application are only for the convenience of explanation and do not constitute a limitation on the technical solution of the present application. In practical applications, the above steps can be adaptively adjusted. For example, the order of S32 and S33 can be swapped.

[0187] This application Figure 6 and Figure 7 The exposure parameter types shown are for convenience of explanation only and do not constitute a limitation on the technical solution of the present application. In actual applications, the exposure parameter type and the exposure control interface type can be set according to the specific type of HDR mode adopted to enable the electronic device to be compatible with more HDR modes.

[0188] In summary, by using the technical solution provided in the embodiment of the present application, the types of exposure parameters and exposure control interfaces are expanded, so that when the electronic device performs exposure control, the exposure parameters corresponding to different types of HDR modes can be sent to the corresponding types of exposure control interfaces to realize exposure control of different types of HDR modes. In addition, when performing exposure control, the exposure parameter detection function can also be realized. When the exposure time does not meet the requirements, the frame length can be increased to ensure that the images in different modes are displayed normally.

[0189] On the other hand, by expanding the types of exposure parameters and the types of exposure control interfaces, the compatibility of electronic devices with HDR modes can be improved. For example, when the HDR modes currently supported on electronic devices only include DCG mode and 2-frame SHDR mode, the second type of exposure parameters may not be generated during shooting. However, the software system can be updated later to make the electronic device compatible with the 3-frame HDR mode. The embodiments of the present application do not specifically limit the specific types of HDR modes used in electronic devices. The above types are only for illustration and do not constitute a limitation on the technical solution of the present application. It can be understood that the HDR modes in the above description are only the currently commonly used HDR modes. With the advancement of technology, new HDR modes may be used. At this time, the solution of the present application can be compatible with the new HDR mode.

[0190] Based on the exposure control method of the high dynamic range mode provided in the above embodiment, the embodiment of the present application further provides an electronic device. The electronic device provided in the embodiment of the present application can be a mobile phone, a laptop computer, a wearable electronic device (such as a smart watch, smart glasses), a tablet computer, an AR device or a VR device, etc., and the following description takes the electronic device as an example of a mobile phone.

[0191] See also Figure 8 , which is a schematic diagram of an electronic device provided in an embodiment of the present application.

[0192] The electronic device 100 includes: a processor 110, a camera 120, a display screen 130, a sensor module 140 and an internal storage area 150. The sensor module 140 may include a color temperature sensor 141, and may also include other types of sensors.

[0193] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU).

[0194] The electronic device 100 can realize the shooting function through the image ISP, the camera 120, the video codec, the GPU, the display screen 130 and the application processor.

[0195] The ISP is used to process the data fed back by the camera 120. For example, when shooting, the shutter is opened, and the light is transmitted to the camera sensor through the lens. The light signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the glasses. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 120.

[0196] The camera 120 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include multiple cameras.

[0197] The color temperature sensor 141 is used to sense the ambient color temperature and illumination, so that the electronic device can perform automatic exposure control according to the detection results.

[0198] The internal memory 150 can be used to store computer executable program codes, which include instructions. The internal memory 150 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, at least one application required for a function, etc. The data storage area may store data created during the use of the electronic device 100. In addition, the internal memory 150 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 implements the switching method of the high dynamic range mode in the above embodiment by running instructions stored in the internal memory 150, and / or instructions stored in a memory provided in the processor.

[0199] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0200] The electronic device supports multiple HDR modes and expands the types of exposure parameters. The register of the sensor of the electronic device can be expanded to support multiple exposure control interfaces, such as a long frame exposure control interface, a medium frame exposure control interface, a short frame exposure control interface, and a VS frame exposure control interface.

[0201] The electronic device can determine whether to start the HDR mode and determine the specific HDR mode to be enabled based on the light intensity and dynamic range of the current environment.

[0202] When the electronic device performs automatic exposure control, it can determine the exposure parameters according to the brightness statistics and the specific HDR mode, and can also implement the exposure parameter detection function to detect the exposure time in the exposure parameters. When the exposure time does not meet the requirements, the frame length can be increased to ensure that the images in different HDR modes are displayed normally. When the electronic device performs exposure control, the exposure parameters corresponding to different types of HDR modes can be sent to the corresponding types of exposure control interfaces to implement exposure control of different types of HDR modes.

[0203] An embodiment of the present application further provides a storage medium on which a program is stored. When the program is executed by a processor, the exposure control method of the high dynamic range mode in the above embodiment is implemented.

[0204] Readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, parameter random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically-erasable programmable read-only memory (EEPROM), flash memory or other memory technologies.

[0205] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An exposure control method in a high dynamic range mode, characterized in that: Applied to an electronic device, the electronic device supports multiple high dynamic range HDR modes, and the method includes: When it is determined to adopt the first HDR mode, determining an exposure parameter corresponding to each frame of the first HDR mode according to a brightness statistical value, the brightness statistical value is used to characterize the illumination of the environment in which the electronic device is located, the exposure parameter corresponding to each frame is a type of exposure parameter in an exposure parameter category set, each type of exposure parameter in the exposure parameter category set corresponds to a different exposure range, and the exposure parameter category set includes at least three types of exposure parameters; Determining a sum of exposure times of the frames in the first HDR mode according to the exposure times in the exposure parameters corresponding to the frames in the first HDR mode; When the sum of the exposure times is greater than a first time length, increasing the frame length in the exposure parameter, where the first time length is the difference between the frame length and a time offset parameter, and the frame length is the time for displaying one frame of an image during preview or video shooting; The exposure parameters corresponding to each frame are sent to a photosensitive element exposure control interface that matches the category of each frame, so that the photosensitive element is exposed according to the exposure parameters corresponding to each frame.

2. The method according to claim 1, characterized in that When it is determined to adopt the first HDR mode, determining the exposure parameters corresponding to each frame of the first HDR mode according to the brightness statistics specifically includes: Determining an image output mode of a photosensitive element of the electronic device according to the illumination and dynamic range of the environment in which the electronic device is currently located; When the image output mode is the first HDR mode, obtaining the brightness statistics; Determine exposure parameters corresponding to each frame of the first HDR mode according to the brightness statistics.

3. The method according to claim 2, characterized in that The obtaining of the brightness statistics specifically includes: When there is no brightness statistical value of the previous RAW image frame, determining a preset brightness statistical value of the first HDR mode as the brightness statistical value, or determining the brightness statistical value according to a detection result of a color temperature sensor of the electronic device; When the brightness statistics of the previous RAW image frame are acquired, the brightness statistics of the previous RAW image frame are determined as the brightness statistics.

4. The method according to claim 1, characterized in that: The exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a three-frame SHDR mode, and determining the exposure parameters corresponding to each frame of the first HDR mode according to the brightness statistics specifically includes: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to the long frame, a second type of exposure parameter corresponding to the medium frame, and a third type of exposure parameter corresponding to the short frame of the three-frame SHDR mode; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: The first type of exposure parameters corresponding to the long frame are sent to the long frame exposure control interface of the photosensitive element, the second type of exposure parameters corresponding to the medium frame are sent to the medium frame exposure control interface of the photosensitive element, and the third type of exposure parameters corresponding to the short frame are sent to the short frame exposure control interface of the photosensitive element.

5. The method according to claim 1, characterized in that The exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a dual conversion gain DCG mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, specifically including: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to a long frame and a third type of exposure parameter corresponding to a medium frame of the DCG mode; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: The first type of exposure parameters corresponding to the long frame are sent to the long frame exposure control interface of the photosensitive element, and the third type of exposure parameters corresponding to the medium frame are sent to the medium frame exposure control interface of the photosensitive element.

6. The method according to claim 1, characterized in that The first HDR mode is an internal dual conversion gain combined with an IDCG mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to the brightness statistics, specifically including: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to a long frame and a third type of exposure parameter corresponding to a medium frame of the IDCG mode; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: The first type of exposure parameters corresponding to the long frame are sent to the long frame exposure control interface of the photosensitive element, and the third type of exposure parameters corresponding to the medium frame are sent to the medium frame exposure control interface of the photosensitive element.

7. The method according to claim 1, characterized in that The exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is an internal dual conversion gain combined with IDCG and a very short VS exposure frame fusion mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to brightness statistics, specifically including: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to the IDCG frame and a third type of exposure parameter corresponding to the VS frame in the IDCG and VS frame fusion mode; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: Sending the long frame exposure parameter in the first type of exposure parameters corresponding to the IDCG frame to the long frame exposure control interface of the photosensitive element; Sending the short frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the medium frame exposure control interface of the photosensitive element; The third type of exposure parameters corresponding to the VS frame are sent to the VS frame exposure control interface of the photosensitive element.

8. The method according to claim 1, characterized in that The exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, a third type of exposure parameter, and a fourth type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is an internal dual conversion gain combined with IDCG and a very short VS frame fusion mode, and the exposure parameters corresponding to each frame of the first HDR mode are determined according to brightness statistics, specifically including: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to the IDCG frame of the IDCG and VS frame fusion mode and a fourth type of exposure parameter corresponding to the VS frame; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: Sending the long frame exposure parameter in the first type of exposure parameters corresponding to the IDCG frame to the long frame exposure control interface of the photosensitive element; Sending the short frame exposure parameters in the first type of exposure parameters corresponding to the IDCG frame to the medium frame exposure control interface of the photosensitive element; The fourth type of exposure parameters corresponding to the VS frame are sent to the VS frame exposure control interface of the photosensitive element.

9. The method according to claim 1, characterized in that: The exposure parameter category set includes at least a first type of exposure parameter, a second type of exposure parameter, and a third type of exposure parameter whose exposure ranges decrease in sequence, the first HDR mode is a dual analog gain DAG mode, and the exposure parameter corresponding to each frame of the first HDR mode is determined according to the brightness statistics, specifically including: Determine, according to the brightness statistics, a first type of exposure parameter corresponding to the long frame and a third type of exposure parameter corresponding to the medium frame of the DAG mode; The step of sending the exposure parameters corresponding to each frame to the photosensitive element exposure control interface matching the category of each frame specifically includes: The first type of exposure parameters corresponding to the long frame are sent to the long frame exposure control interface of the photosensitive element, and the third type of exposure parameters corresponding to the medium frame are sent to the medium frame exposure control interface of the photosensitive element.

10. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory is used to store a program, and when the program is executed by the processor, the exposure control method in the high dynamic range mode according to any one of claims 1 to 9 is executed.

11. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by an electronic device, the exposure control method of the high dynamic range mode described in any one of claims 1 to 9 is implemented.

Images