Method for shooting video and related equipment

Abstract

The present application provides a method for shooting videos and related equipment. In the method for shooting videos of the present application, the image sensor of the camera of the electronic device can be switched from dual-sensitivity mode / high-sensitivity mode to low-sensitivity mode in bright light scenes. In this way, in bright light scenes, images are collected in low-sensitivity mode by the image sensor. Since the sensitivity in low-sensitivity mode is relatively low, under the same ambient light brightness, compared with high-sensitivity mode or dual-sensitivity mode, if an image of the same brightness is to be obtained, the exposure time required in low-sensitivity mode is longer. That is to say, in bright light scenes, switching the image sensor of the electronic device from high-sensitivity mode or dual-sensitivity mode to low-sensitivity mode can extend the exposure time, and the captured image has natural motion blur. In the process of shooting the video, the preview picture is relatively smooth, and the final video frame is relatively smooth during playback.

Description

Technical Field

[0001] The present application relates to the field of photography, and in particular to a method for shooting videos and related equipment. Background Art

[0002] Frames per second, abbreviated as fps, stands for frames per second. A video is a series of images, each of which is a frame. The number of frames per second when shooting a video or playing a video is the fps. The human eye can process 10-12 still images per second. That is, below 12 fps, the human brain can quickly distinguish that each frame of the continuously played images is still. Once the frame rate (frames per second) reaches 16 fps or above, the brain will interpret the images as a continuously moving scene.

[0003] When an object moves quickly, the human eye can retain the image for approximately 0.1-0.4 seconds after the image disappears. This phenomenon is known as persistence of vision. For moving objects, persistence of vision creates motion blur, which enhances the sense of reality. In the film era, the film industry's frame rate specification was 24fps, with a shutter speed of 1 / 48s, meaning an exposure time of 1 / 48s. This produced a natural motion blur when shooting moving objects, resulting in a smooth viewing experience during playback. Summary of the Invention

[0004] The present application provides a method for shooting video and related equipment. In bright light scenes, a low-sensitivity mode can be used for exposure. In low-sensitivity mode, the sensitivity of the image sensor is low, and a longer exposure time is required to obtain an image with the same brightness as in high-sensitivity mode, so that the exposure time meets the requirement of obtaining motion blur when shooting moving scenes.

[0005] In a first aspect, the present application provides a method for shooting a video, applied to an electronic device, the method comprising:

[0006] In response to a user operation, the electronic device activates a video capture function of a camera application and displays a first interface on a display screen. The first interface includes a first control and a first preview frame, and the first preview frame is used to display an image captured in real time by the electronic device through the camera.

[0007] receiving a first operation on a first control;

[0008] In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video; wherein the first video includes the first image and the second image, and the capture time of the first image is earlier than the capture time of the second image;

[0009] The first image is an image captured by the electronic device under a first ambient light brightness by using a first exposure time, where the first exposure time is determined by the electronic device according to the first ambient light brightness;

[0010] The second image is an image captured by the electronic device using a second exposure time under a second ambient light brightness, where the second exposure time is determined by the electronic device according to the second ambient light brightness;

[0011] The second ambient light brightness is greater than or equal to the first ambient light brightness, and the second exposure time is greater than the first exposure time.

[0012] By using the video shooting method of the embodiment of the present application, the exposure time can be extended in bright light scenes (second ambient light brightness) to meet the requirement of obtaining motion blur when shooting moving scenes. Since the captured video image has natural motion blur, the playback is smoother.

[0013] In one possible implementation, the first video also includes a third image, where the third image is captured earlier than the first image. The third image is captured by the electronic device using a third exposure time under a third ambient light brightness, where the third exposure time is determined by the electronic device based on the third ambient light brightness. The third ambient light brightness is lower than the first ambient light brightness, and the third exposure time is longer than the first exposure time. In low ambient light conditions, using a longer exposure time can make the brightness of the captured image more stable.

[0014] In one possible implementation, the camera includes an image sensor. In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video, including:

[0015] When acquiring the first image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image;

[0016] When acquiring the second image, the image sensor of the electronic device is in the second light-sensitive mode; in the second light-sensitive mode, the electronic device controls the image sensor to use the second gain to process the acquired image to obtain the second image; wherein the first gain is greater than the second gain.

[0017] In one possible implementation, the camera includes an image sensor.

[0018] In response to the first operation, the electronic device continuously captures multiple frames of images through a camera to obtain a first video, including:

[0019] When acquiring the first image and the third image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the third image;

[0020] When acquiring the second image, the image sensor of the electronic device is in the second light-sensitive mode; in the second light-sensitive mode, the electronic device controls the image sensor to use the second gain to process the acquired image to obtain the second image; wherein the first gain is greater than the second gain.

[0021] Electronic devices with dual-gain capabilities can switch between dual-sensitivity mode, high-sensitivity mode, and low-sensitivity mode. According to this method, in bright light scenes, low-sensitivity mode can be used for exposure. In low-sensitivity mode, the image sensor's sensitivity is low, and obtaining an image with the same brightness as in high-sensitivity mode requires a longer exposure time, so that the exposure time meets the requirements for obtaining motion blur when shooting moving scenes. In low-light scenes, electronic devices can perform exposure in dual-sensitivity mode or high-sensitivity mode to obtain better image details.

[0022] In a possible implementation, in the first light sensing mode, the electronic device controls the image sensor to use the first gain to process the captured image to obtain the first image or the third image, including:

[0023] In the first light sensing mode, the electronic device controls the image sensor to process the collected fourth image using the first gain to obtain a first sub-image, and to process the collected fifth image using the second gain to obtain a second sub-image;

[0024] The electronic device processes the first sub-image and the second sub-image to obtain a first image or a third image.

[0025] In a possible implementation, the fourth image and the fifth image are images of the same frame captured at the same time.

[0026] In a possible implementation, the fourth image and the fifth image are images captured at different times.

[0027] In one possible implementation, the method further includes: in response to the first operation, the electronic device displays a second interface; the second interface includes a second preview frame, and the second preview frame is used to preview the image frames of the first video captured by the electronic device in real time, and the image frames of the first video include: a first image, a second image, and a third image. The first video can be previewed in real time during the process of shooting the first video, that is, during the shooting process, the previewed image frames include the first image, the second image, and the third image. In other words, the method of the embodiment of the present application can also be applied to the previewed image frames during the process of shooting a video, so that the real-time preview of the shooting scene is smoother.

[0028] In one possible implementation, the second interface includes a second control; the second control includes a first state and a second state, the first state indicates that the high dynamic range HDR function is turned on, and the second state indicates that the HDR function is turned off; when the first image is displayed on the second interface, the second control is in the second state; when the second image or the third image is displayed on the second interface, the second control is in the first state.

[0029] According to the method of this embodiment, the user is reminded of the change of the shooting mode in real time during the shooting process, so that the user can obtain a better shooting experience.

[0030] In a possible implementation, after the electronic device captures the first image, the method further includes:

[0031] The electronic device calculates the brightness of the fourth ambient light based on the first image and the first exposure parameter when capturing the first image; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when capturing the first image; when the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensitivity mode.

[0032] In an embodiment of the present application, the current ambient light brightness is estimated based on the captured image and exposure parameters to obtain a more accurate ambient light brightness, so that the timing of adjusting the exposure mode is more accurate and the video effect obtained is better.

[0033] In a possible implementation, before the electronic device captures the first image, the method further includes:

[0034] The electronic device uses a light metering system in a camera to measure light in real time to obtain a first ambient light brightness;

[0035] When the image sensor of the electronic device operates in a first light-sensing mode, the electronic device searches a first configuration file according to the first ambient light brightness to obtain a first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

[0036] In one possible implementation, after controlling the image sensor to switch to the second light-sensing mode, the method further includes: the electronic device uses the light-metering system in the camera to measure light in real time to obtain a second ambient light brightness; when the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches for a second configuration file based on the second ambient light brightness to obtain second exposure parameters; the second exposure parameters include a second exposure time and a second ISO; wherein the second configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameters in the second light-sensing mode.

[0037] By configuring the exposure parameters in different modes through the configuration file, especially adding the exposure parameters in the low-sensitivity mode in bright light scenes, the electronic device can quickly find and obtain the corresponding exposure parameters after switching to the second sensitivity mode and expose an image that meets the requirements according to the exposure parameters.

[0038] In a possible implementation, after the electronic device captures the third image, the method further includes:

[0039] The electronic device calculates a fifth ambient light brightness based on the third image and a third exposure parameter when the third image is acquired; wherein the third exposure parameter includes a third exposure time and a third ISO when the third image is acquired;

[0040] When the electronic device determines that the brightness of the fifth ambient light is less than the second preset brightness threshold, the electronic device controls the image sensor to switch to the first light sensing mode;

[0041] The second preset brightness threshold is less than or equal to the first preset brightness threshold.

[0042] In one possible implementation, the function of shooting video is one of the following functions: movie mode, video recording mode, and time-lapse photography mode; wherein, in the movie mode, the frame rate of the image captured by the electronic device when shooting video is 24fps.

[0043] In one possible implementation, the first interface is a preview interface after starting to shoot a video. The first interface includes time information, which is used to record the length of the shot video. In other words, the method of the embodiment of the present application can also be applied to previewing image frames during the process of shooting a video, making the real-time preview of the shooting scene smoother.

[0044] In one possible implementation, when the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode, including:

[0045] When the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold and the electronic device meets the preset shooting scene, the electronic device controls the image sensor to switch to the second light sensing mode;

[0046] The preset shooting scene includes a scene in which the electronic device is in a moving state or an image captured by a camera includes a moving object.

[0047] In one possible implementation, the first video does not include the second image, and the first video includes a fourth image, which is: an image captured by the electronic device by exposing according to a fourth exposure time when the electronic device is under a second ambient light brightness and does not meet a preset shooting scene, and the fourth exposure time is less than or equal to the first exposure time.

[0048] According to the exposure mode switching method of the above embodiment of the present application, the electronic device determines whether the preset shooting scene is met. For example, the electronic device itself is in motion, or the object photographed by the electronic device is in motion, which can be collectively referred to as a motion scene.

[0049] When the TV device determines that a motion scene is met and the ambient light brightness is relatively bright, the electronic device switches the camera to a low-sensitivity mode and can perform exposure according to the exposure mode of the low-sensitivity mode with a long exposure time, which can produce natural motion blur for the motion scene.

[0050] If the electronic device is not in the above-mentioned motion scene when shooting, in order to obtain a larger dynamic range, in a scene with relatively bright ambient light, the camera can also be controlled to continue working in dual-sensitivity mode, using the same or shorter exposure time to capture the above-mentioned fourth image.

[0051] In a second aspect, the present application provides a method for shooting a video, applied to an electronic device, the method comprising:

[0052] In response to a user operation, the electronic device activates a video capture function of a camera application and displays a first interface on a display screen. The first interface includes a first control and a first preview frame, and the first preview frame is used to display an image captured in real time by the electronic device through the camera.

[0053] receiving a first operation on a first control;

[0054] In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video;

[0055] The first video includes a first image, a second image, and a third image, and the second image is located between the first image and the third image;

[0056] The first image is an image captured by the electronic device under a first ambient light brightness, the second image is an image captured by the electronic device under a second ambient light brightness, and the third image is an image captured by the electronic device under a third ambient light brightness;

[0057] The third ambient light brightness is greater than or equal to the second ambient light brightness, the second ambient light brightness is greater than the first ambient light brightness, the signal-to-noise ratio of the first image is less than the signal-to-noise ratio of the second image, and the signal-to-noise ratio of the second image is greater than the signal-to-noise ratio of the third image.

[0058] Since the signal-to-noise ratio is linearly related to the gain, the sudden decrease in the signal-to-noise ratio under the third ambient light brightness is due to the change in gain in the embodiment of the present application. In a bright light environment, reducing the gain is equivalent to reducing the sensitivity of the image processor when the camera captures the image. After the sensitivity is reduced, if you need to obtain an image of the same brightness, you need to extend the exposure time. Therefore, in the method for shooting video in the above embodiment of the present application, in a bright light scene, the exposure time can be extended so that the exposure time meets the requirement of obtaining motion blur when shooting a moving scene. Because the image of the captured video produces natural motion blur, it is smoother when played.

[0059] In a possible implementation, the acquisition time of the first image is earlier than the acquisition time of the second image, and the acquisition time of the second image is earlier than the acquisition time of the third image.

[0060] In a possible implementation, the acquisition time of the first image is later than the acquisition time of the second image, and the acquisition time of the second image is later than the acquisition time of the third image.

[0061] In one possible implementation, the camera includes an image sensor. In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video, including:

[0062] When acquiring the first image and the second image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the second image;

[0063] When acquiring the third image, the image sensor of the electronic device is in the second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use the second gain to process the acquired image to obtain the third image;

[0064] The first gain is greater than the second gain.

[0065] In a possible implementation, in the first light sensing mode, the electronic device controls the image sensor to use the first gain to process the captured image to obtain the first image or the second image, including:

[0066] In the first light sensing mode, the electronic device controls the image sensor to process the collected fourth image using the first gain to obtain a first sub-image, and to process the collected fifth image using the second gain to obtain a second sub-image;

[0067] The electronic device processes the first sub-image and the second sub-image to obtain a first image or a second image.

[0068] Electronic devices with dual-gain capabilities can switch between dual-sensitivity mode, high-sensitivity mode, and low-sensitivity mode. According to this method, in bright light scenes, low-sensitivity mode can be used for exposure. In low-sensitivity mode, the image sensor's sensitivity is low, and obtaining an image with the same brightness as in high-sensitivity mode requires a longer exposure time, so that the exposure time meets the requirements for obtaining motion blur when shooting moving scenes. In low-light scenes, electronic devices can perform exposure in dual-sensitivity mode or high-sensitivity mode to obtain better image details.

[0069] In a possible implementation, after the electronic device captures the second image, the method further includes:

[0070] The electronic device calculates the brightness of the fourth ambient light based on the second image and the first exposure parameter when the second image is acquired; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when the second image is acquired;

[0071] When the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode.

[0072] In a possible implementation, before the electronic device captures the second image, the method further includes:

[0073] The electronic device calculates a fifth ambient light brightness based on the fourth image and the second exposure parameter when the fourth image is acquired; wherein the fourth image is an image frame located before the second image in the first video;

[0074] When the image sensor of the electronic device operates in the first light-sensing mode, the electronic device searches for the first configuration file according to the fifth ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

[0075] In one possible implementation, after controlling the image sensor to switch to the second light sensing mode, the method further includes:

[0076] When the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches the second configuration file based on the fourth ambient light brightness to obtain third exposure parameters; wherein the third exposure parameters include a third exposure time and a third ISO, and the second configuration file records: a relationship between the ambient light brightness and the corresponding exposure parameters in the second light-sensing mode;

[0077] The electronic device performs exposure according to the third exposure parameter to capture a third image.

[0078] The exposure mode switching method of this embodiment does not cause the exposure time to be suddenly shortened near the preset brightness threshold, resulting in a sharp image being captured. Instead, as the ambient light brightness changes from dark to bright, the exposure parameters can be quickly adjusted as the exposure mode is switched. When switching from dual-sensitivity mode to low-sensitivity mode, the exposure time is maintained at around 1 / 48s. When shooting motion scenes, each frame can obtain natural motion blur, and the playback is smoother.

[0079] In a third aspect, the present application provides a method for shooting a video, the method being applied to an electronic device, the electronic device including a display screen and a camera, the method comprising:

[0080] The electronic device, in response to a user operation, activates a video shooting function of a camera application and displays a first interface on the display screen, wherein the first interface includes a preview frame, and the preview frame is used to display an image captured by the electronic device in real time through the camera;

[0081] The electronic device determines a first ambient light brightness, determines a first exposure time according to the first ambient light brightness, performs exposure according to the first exposure time to acquire a first image, and displays the first image in the preview frame;

[0082] The electronic device determines a second ambient light brightness, determines a second exposure time according to the second ambient light brightness, performs exposure according to the second exposure time to acquire a second image, and displays the second image in the preview frame;

[0083] The second ambient light brightness is greater than or equal to the first ambient light brightness, and the second exposure time is greater than the first exposure time.

[0084] By using the video shooting method of the embodiment of the present application, the exposure time can be extended in bright light scenes (second ambient light brightness) to meet the requirement of obtaining motion blur when shooting moving scenes. Because the captured video image has natural motion blur, the preview during the video shooting process is smoother.

[0085] In a possible implementation, after the electronic device enables a video capture function of a camera application and before acquiring the first image, the method further includes:

[0086] The electronic device determines a third ambient light brightness, determines a third exposure time according to the third ambient light brightness, performs exposure according to the third exposure time to acquire a third image, and displays the third image in the preview frame;

[0087] Wherein, the third ambient light brightness is lower than the first ambient light brightness, and the third exposure time is longer than the first exposure time. In the case of low ambient brightness, using a longer exposure time can make the brightness of the captured image more stable.

[0088] In a possible implementation, the camera includes an image sensor.

[0089] When acquiring the first image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image;

[0090] When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image;

[0091] The first gain is greater than the second gain.

[0092] In a possible implementation, the camera includes an image sensor.

[0093] When acquiring the first image and the third image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the third image;

[0094] When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image;

[0095] The first gain is greater than the second gain.

[0096] Electronic devices with dual-gain capabilities can switch between dual-sensitivity mode, high-sensitivity mode, and low-sensitivity mode. According to this method, in bright light scenes, low-sensitivity mode can be used for exposure. In low-sensitivity mode, the image sensor's sensitivity is low, and obtaining an image with the same brightness as in high-sensitivity mode requires a longer exposure time, so that the exposure time meets the requirements for obtaining motion blur when shooting moving scenes. In low-light scenes, electronic devices can perform exposure in dual-sensitivity mode or high-sensitivity mode to obtain better image details.

[0097] In a possible implementation, in the first light sensing mode, the electronic device controls the image sensor to use a first gain to process the captured image to obtain the first image or the third image, including:

[0098] In the first light sensing mode, the electronic device controls the image sensor to process the acquired fourth image using the first gain to obtain a first sub-image, and to process the acquired fifth image using the second gain to obtain a second sub-image;

[0099] The electronic device processes the first sub-image and the second sub-image to obtain the first image or the third image.

[0100] In a possible implementation, the fourth image and the fifth image are images of the same frame captured at the same time.

[0101] In a possible implementation manner, the fourth image and the fifth image are images captured at different times.

[0102] In the first photosensitivity mode, the captured images are processed and fused using dual-gain capability to obtain a synthesized image with rich details in highlights and less noise in dark areas.

[0103] In one possible implementation, the electronic device determines a second ambient light brightness, determines a second exposure time according to the second ambient light brightness, performs exposure according to the second exposure time to acquire a second image, and displays the second image in the preview frame, including:

[0104] The electronic device determines that a preset shooting scene is satisfied, wherein the preset shooting scene includes a scene in which the electronic device is in a moving state or an image captured by the camera includes a moving object;

[0105] The electronic device determines a second ambient light brightness, searches a second configuration file based on the second ambient light brightness, and obtains the second exposure time; wherein the second configuration file records the relationship between the ambient light brightness and the corresponding exposure parameters in the second light sensing mode.

[0106] In a possible implementation, the method further includes:

[0107] The electronic device determines that a preset shooting scene is not satisfied;

[0108] The electronic device determines a second ambient light brightness, searches a first configuration file based on the second ambient light brightness, and obtains a fourth exposure time; wherein the first configuration file records a relationship between the ambient light brightness and the corresponding exposure parameter in the first light sensing mode;

[0109] The electronic device performs exposure according to a fourth exposure time to acquire a second image, and the fourth exposure time is less than or equal to the first exposure time.

[0110] According to the exposure mode switching method of the above embodiment of the present application, the electronic device determines whether a preset shooting scene is satisfied. For example, the electronic device itself is in motion, or the object photographed by the electronic device is in motion, which can be collectively referred to as a motion scene. When the television device determines that a motion scene is satisfied and the ambient light brightness is relatively bright, the electronic device switches the camera to a low-sensitivity mode, and can perform exposure according to the exposure mode of the low-sensitivity mode. The exposure time is long, and natural motion blur can be produced for the motion scene. If the electronic device is not in the above-mentioned motion scene when shooting, in order to obtain a larger dynamic range, in a scene where the ambient light brightness is relatively bright, the camera can also be controlled to continue to work in the dual-sensitivity mode to improve the quality of the captured image.

[0111] In a possible implementation, after the electronic device captures the first image, the method further includes:

[0112] The electronic device calculates the brightness of the fourth ambient light according to the first image and a first exposure parameter when the first image is acquired; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when the first image is acquired;

[0113] When the electronic device determines that the brightness of the fourth ambient light is greater than a first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode.

[0114] In a possible implementation, the method further includes:

[0115] The electronic device uses the light metering system in the camera to measure light in real time to obtain the brightness of the first ambient light;

[0116] When the image sensor of the electronic device operates in the first light-sensing mode, the electronic device searches a first configuration file according to the first ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

[0117] In a possible implementation, after controlling the image sensor to switch to the second light sensing mode, the method further includes:

[0118] The electronic device uses the light metering system in the camera to measure light in real time to obtain the second ambient light brightness;

[0119] When the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches a second configuration file according to the second ambient light brightness to obtain second exposure parameters; the second exposure parameters include the second exposure time and the second ISO;

[0120] The second configuration file records the relationship between the ambient light brightness and the corresponding exposure parameters in the second light-sensing mode.

[0121] By configuring the exposure parameters in different modes through the configuration file, especially adding the exposure parameters in the low-sensitivity mode in bright light scenes, the electronic device can quickly find and obtain the corresponding exposure parameters after switching to the second sensitivity mode and expose an image that meets the requirements according to the exposure parameters.

[0122] In a possible implementation, after the electronic device captures the third image, the method further includes:

[0123] The electronic device calculates a fifth ambient light brightness based on the third image and a third exposure parameter when acquiring the third image; wherein the third exposure parameter includes the third exposure time and a third ISO when acquiring the third image;

[0124] When the electronic device determines that the brightness of the fifth ambient light is less than a second preset brightness threshold, the electronic device controls the image sensor to switch to the first light sensing mode;

[0125] The second preset brightness threshold is less than or equal to the first preset brightness threshold.

[0126] In a possible implementation, the first interface is a preview interface before starting to shoot a video, the first interface includes a first control, the first control includes a first state and a second state, the first state indicates that a high dynamic range (HDR) function is turned on, and the second state indicates that the HDR function is turned off;

[0127] When the first image is displayed on the first interface, the first control is in the second state;

[0128] When the second image or the third image is displayed on the first interface, the first control is in the first state.

[0129] According to the method of this embodiment, the user is reminded of the change of the shooting mode in real time during the shooting process, so that the user can obtain a better shooting experience.

[0130] In one possible implementation, the first interface is a preview interface after video capture begins, and the first interface includes time information, which is used to record the duration of the captured video. In other words, the method of the embodiment of the present application can also be applied to previewing image frames during video capture, making the real-time preview of the captured scene smoother.

[0131] In a fourth aspect, the present application provides an electronic device, comprising: a processor, a memory for storing instructions executable by the processor, and when the processor is configured to execute the instructions, the electronic device implements the method described above.

[0132] In a fifth aspect, the present application provides a computer-readable storage medium, comprising: computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0133] Figure 1 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application.

[0134] Figure 2 A software structure block diagram of an electronic device 100 provided in an embodiment of the present application.

[0135] Figure 3A A schematic diagram illustrating an application scenario according to an embodiment of the present application.

[0136] Figure 3B The relationship between two adjacent frames in the video acquired at different frame rates is shown.

[0137] Figure 3C This figure shows the relationship between different exposure times and motion blur when capturing video at the same frame rate.

[0138] Figure 4 A schematic diagram illustrating the collaboration of software and hardware to implement exposure mode switching according to an embodiment of the present application is shown.

[0139] Figure 5 A schematic diagram illustrating an application scenario according to an embodiment of the present application.

[0140] Figure 6A A schematic diagram of a module of an image sensor with dual conversion gain capability according to an embodiment of the present application is shown.

[0141] Figure 6B A schematic diagram of a module of an image sensor with dual native ISO according to an embodiment of the present application is shown.

[0142] Figure 7A A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0143] Figure 7B A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0144] Figure 7C A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0145] Figure 8A A schematic diagram illustrating application scenarios according to some embodiments of the present application.

[0146] Figure 8B-Figure 8D A schematic diagram showing an electronic device interface during exposure mode switching according to Example 1.

[0147] Figure 8E A schematic diagram showing an electronic device interface during exposure mode switching according to Example 2.

[0148] Figure 9A A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0149] Figure 9B A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0150] Figure 10 A schematic diagram illustrating an application scenario according to an embodiment of the present application.

[0151] Figure 11A and Figure 11B Schematic diagrams of application scenarios of the exposure mode switching method according to an embodiment of the present application are respectively shown.

[0152] Figure 12 A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0153] Figure 13 A schematic diagram illustrating an application scenario according to an embodiment of the present application.

[0154] Figure 14A and Figure 14B A flow chart of an exposure mode switching method according to another embodiment of the present application is shown.

[0155] Figure 14C A schematic diagram illustrating a process of shooting a video according to an embodiment of the present application.

[0156] Figure 15A A schematic diagram illustrating the relationship between the signal-to-noise ratio (SNR) of an image, the exposure mode, and the ISO according to an embodiment of the present application.

[0157] Figures 15B-15DSchematic diagrams respectively show curves of changes in the signal-to-noise ratio of an image captured according to an embodiment of the present application as the ambient light brightness changes. DETAILED DESCRIPTION

[0158] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0159] It should be understood that the terms "first," "second," and the like in the specification, claims, and drawings of this application are used to distinguish between different objects, rather than to describe a particular order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0160] References to "embodiments" in this application mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0161] It is understood that the term "user interface" in the specification, claims, and drawings of this application refers to the media interface for interaction and information exchange between an application or operating system and a user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed graphically. It can be an interface element such as an icon, window, or control displayed on the display of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0162] Figure 1 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application.

[0163] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a camera 193, a display screen 194, and a Subscriber Identification Module (SIM) card interface 195, etc.

[0164] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0165] The processor 110 may include one or more processing units, for example, an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0166] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0167] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0168] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0169] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image and video playback function, etc.). The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.).

[0170] In an embodiment of the present application, the internal memory 121 may store codes related to automatic exposure control (AEC) and exposure mode switching methods. The processor may implement the automatic exposure control process by running the AEC-related codes, and may implement the switching of the exposure mode of the image sensor in the camera by running the exposure mode switching method-related codes.

[0171] In some embodiments of the present application, the AEC module may include an AEC algorithm module and an AEC statistics module. The AEC statistics module is used to perform statistical analysis on parameters in the captured image, such as image brightness. The AEC algorithm module can automatically adjust the camera's exposure parameters based on the statistical results. The AEC algorithm module can also estimate the ambient light brightness based on the statistical results.

[0172] In some embodiments, the processor 110 may include one or more interfaces. The USB interface 130 is an interface that complies with USB standards and specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other electronic devices 100, such as AR devices.

[0173] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0174] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.

[0175] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1.

[0176] The wireless communication module 160 can provide wireless communication solutions including Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0177] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0178] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0179] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.

[0180] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0181] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0182] The microphone 170C, also called a "microphone" or "speaker", is used to convert sound signals into electrical signals. The electronic device 100 may be provided with at least one microphone 170C.

[0183] The headphone jack 170D is used to connect a wired headphone.

[0184] The sensor module 180 may include one or more sensors, which may be of the same type or different types. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an acceleration sensor, a distance sensor, a proximity sensor, a fingerprint sensor, a touch sensor, an ambient light sensor, and the like.

[0185] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0186] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED), Mini LED, Micro LED, Micro-OLED, quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0187] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0188] The electronic device 100 can realize the function of acquiring images through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0189] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image or video. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0190] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then passed to the ISP for conversion into a digital image or video signal. The ISP outputs the digital image or video signal to the DSP for processing. The DSP converts the digital image or video signal into an image or video signal in a standard format such as RGB or YUV.

[0191] In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. For example, in some embodiments, the electronic device 100 may use the N cameras 193 to acquire images with multiple exposure coefficients. Then, in video post-processing, the electronic device 100 may synthesize an HDR image based on the images with multiple exposure coefficients using a High Dynamic Range (HDR) technique.

[0192] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0193] The NPU is a neural network (NN) computing processor that rapidly processes input information and continuously self-learns by drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain. The NPU enables intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0194] The SIM card interface 195 is used to connect a SIM card. A SIM card can be connected to and disconnected from the electronic device 100 by inserting or removing it from the SIM card interface 195. The electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, or embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0195] Figure 2 This is a software structure diagram of an electronic device 100 provided in an embodiment of the present application. Figure 2 The figure also shows an implementation method of the exposure mode control switching method according to an embodiment of the present application.

[0196] In some embodiments, a layered architecture divides software into several layers, each with distinct roles and divisions of labor. Layers communicate with each other via software interfaces. In embodiments of the present application, specifically, the system of the present application may include, from top to bottom, an application layer, a hardware abstraction layer, and a kernel layer. Between the application layer and the hardware abstraction layer may also include an application framework layer, system libraries, a runtime, and the like.

[0197] The application layer can include a series of application packages. Figure 2 As shown, the application package may include camera, gallery, music, video, call and other applications (also referred to as applications).

[0198] The hardware abstraction layer shields the differences between different hardware devices and provides a standard interface for the system, such as Figure 2As shown in Figure 1, the Hardware Abstraction Layer (HAL) transmits data to the kernel layer through a standard HAL interface and receives data uploaded by the kernel layer. The HAL can contain multiple library modules, each of which implements a set of interfaces for a specific type of hardware component, such as a Wi-Fi / Bluetooth module or a camera module. When the application framework layer API requests access to device hardware, the system loads the corresponding library module for that hardware.

[0199] In an embodiment of the present application, the camera module of the hardware abstraction layer may include the AEC module as described above. The AEC module is used to implement automatic exposure control. Specifically, the AEC module can obtain exposure parameters from a system configuration file and configure the exposure parameters to the image sensor. The image sensor captures images based on the exposure parameters. The AEC statistics module in the AEC module can statistically analyze the parameters in the captured image, such as image brightness, etc. The AEC algorithm module can also estimate the ambient light brightness based on the above-mentioned exposure parameters and image brightness used when capturing the image.

[0200] In an embodiment of the present application, the camera module may further include an exposure mode control module configured to control the exposure mode of the camera's image sensor based on the estimated ambient light level. Specifically, in brightly lit scenes, the image sensor may be controlled to operate in a low-light-sensitivity mode, thereby extending the exposure time to meet the exposure time requirements for filming.

[0201] The kernel layer is the layer between hardware and software. It includes at least the display driver, camera driver, and sensor driver. The exposure mode control module can control the exposure mode of the camera's image sensor through the camera driver, and the AEC module can configure exposure parameters for the camera through the camera driver.

[0202] The following describes the workflow of the software and hardware of the electronic device 100 in conjunction with capturing a photo scene.

[0203] When the touch sensor receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a single-click operation and the control affected by the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. The image is captured by the camera 193, and the display screen 194 displays the camera preview interface, which displays the captured image.

[0204] Application scenarios and problems

[0205] Figure 3A A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Figure 3A The user interface 50 shown in a in FIG is a page in the main interface of the mobile phone. The current main interface displays multiple applications, and the dock bar includes an icon 501 of the camera application. When the touch sensor receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into raw input events (including touch coordinates, timestamp of the touch operation and other information). The raw input events are stored in the kernel layer. The application framework layer obtains the raw input events from the kernel layer and identifies the control corresponding to the input event. Assuming that the touch operation is a single-click operation, the control affected by the single-click operation is Figure 3A Taking the camera application icon 501 in a as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer, captures the image through the camera 193, and the display screen 194 displays the preview interface of the camera, and the captured image is displayed in the preview interface, such as Figure 3A As shown in b in FIG. 5 , the camera preview interface 51 is displayed in the camera user interface.

[0206] The preview interface 51 includes a navigation bar 511 for multiple camera modes. Users can switch between different camera modes by sliding or clicking their fingers. For example, the camera modes may include large aperture, night scene, portrait, photo, video, movie, professional and other modes.

[0207] After opening the camera, the default display is the preview interface of the photo function. If the user clicks the "movie" control to open the camera's movie mode, the electronic device displays the following Figure 3A The interface 52 shown in c in FIG. Figure 3A As shown in FIG. 5A , the interface 52 further includes a navigation bar 521, through which the user can switch between different functions of the camera. The interface 52 further includes a first control 522, and the electronic device can start shooting a video in response to the user's operation on the first control 522.

[0208] When shooting video in movie mode on a phone, the frame rate is set to 24fps or 30fps. However, the photosensitive element on a phone camera is relatively small, and therefore the pixels are relatively small. In bright outdoor scenes, the light is strong, and the photodiode in the photosensitive element is excited to generate a large number of electrons, which easily reaches full potential well capacity, resulting in a short exposure time, far less than 1 / 48 second. The shorter the exposure time, the better it can capture the momentary state of a moving object. Therefore, images captured in bright outdoor scenes are very sharp and have minimal motion blur. Moreover, the short exposure time results in a long interval between frames, making the captured motion more discontinuous. These two reasons can cause playback to experience lag.

[0209] The following describes the relationship between frame rate, exposure time, motion blur, and playback smoothness, as well as the reasons for the technical problems to be solved by this application.

[0210] Figure 3B The relationship between two adjacent frames in the video acquired at different frame rates is shown in FIG. Figure 3B As shown in (1), if the same exposure time is used, the smaller the frame rate, the longer the interval between two adjacent frames. In a motion scene, for example, when capturing moving objects, the smaller the frame rate, the greater the distance between the moving objects in the two adjacent frames. When the frame rates are 24fps and 60fps, and the exposure time is the same, the distance between the moving objects in the two adjacent frames is farther when the frame rate is 24fps.

[0211] For example, if Figure 3B As shown in (2), it is assumed that the process of a falling football is being filmed. The upper figure shows three image frames 301 to 303 captured at a frame rate of 24fps, and the lower figure shows three image frames 304 to 306 captured at a frame rate of 60fps. Assuming that the distance d1 of the football captured in image frame 302 compared to the football in image frame 301 is fallen, and the distance d2 of the football captured in image frame 304 compared to the football in frame 305 is fallen, it can be seen from the figure that d1>d2. Similarly, the distance d3 of the football in frame 303 compared to the football in frame 302 is greater than the distance d4 of the football in frame 306 compared to the football in frame 306. This will result in a more obvious sense of stuttering when playing a video captured at a frame rate of 24fps compared to a video captured at a frame rate of 60fps.

[0212] according to Figure 3B It can be seen that the larger the frame rate used when capturing the video, the less likely it is to experience a sense of lag during playback. Conversely, the smaller the frame rate used when capturing the video, the more likely it is to experience a sense of lag during playback.

[0213] like Figure 3CThis figure shows the relationship between different exposure times and motion blur when capturing video at the same frame rate. Persistence of vision causes motion blur, and the exposure time of each frame captured by the camera affects the resulting blur.

[0214] like Figure 3C As shown in , it is assumed that the video is captured at a frame rate of 24fps. Figure 3C As shown in Example a in the figure, the exposure time is short, and the motion blur of the moving objects in the captured image is very small. The moving objects seen by the human eye lack the motion blur of real moving objects. In addition, the interval between two consecutive frames is long, which means that the moving objects in the two captured frames are far apart in their motion trajectories. As a result, the motion process of the moving objects in the two frames is inconsistent, which will cause a sense of lag during playback.

[0215] exist Figure 3C In example b, the exposure time is longer than that of example a. In the captured image, the moving object has natural motion blur, and the moving object seen by the human eye is closer to the motion blur of the real moving object. In addition, the interval between two consecutive frames is shorter than that of example a. Figure 3C As shown in the figure, image frames 310 to 312 have a long exposure time, which produces natural ghosting. When playing image frames 310 to 312, compared with image frames 307 to 309, the moving objects in the two adjacent frames are better "connected", and the movement process of the moving objects in the two frames is more coherent, and the playback is smoother.

[0216] The frame rate used when shooting movies is 24fps. If the exposure time is too short, each picture taken will be a clear moment, and the time interval between two frames will be relatively large, which will cause a sense of lag during playback.

[0217] In order to solve the above technical problems, the present application provides an exposure mode switching method. Figure 4 A schematic diagram illustrating the collaboration of software and hardware to implement exposure mode switching according to an embodiment of the present application is shown.

[0218] Exposure is a crucial aspect of photography, determining how much light the sensor captures when capturing an image. In other words, exposure determines the brightness (brightness or darkness) of an image. During the exposure process, exposure time (shutter speed), aperture size, and ISO sensitivity (ISO) specifically affect image brightness. These three factors that influence exposure are collectively referred to as exposure parameters.

[0219] Exposure time, also known as shutter speed, can be expressed in seconds (s). Shorter exposure times result in darker images. Longer exposure times result in brighter images. Aperture, the aperture in a lens, controls the size of the hole that allows light to enter the camera. It's denoted by F. The number following F is inversely proportional to the aperture size. A larger aperture increases the aperture, allowing more light to enter, resulting in brighter images. Conversely, a smaller aperture reduces the amount of light entering, resulting in lower image brightness.

[0220] It is understandable that the aperture size in electronic devices such as mobile phones is usually fixed. Therefore, electronic devices can change the brightness of the exposed image by adjusting the exposure time and ISO.

[0221] like Figure 4 As shown, the camera captures image frames through exposure. When the reflected light of the subject passes through the lens, it converges on the image sensor. The image sensor can convert the light signal into an analog electrical signal. This analog electrical signal is bypassed from the sensor front-end (SFE, not shown in the figure) and then output through the digital-to-analog converter. It can be understood that the output of the digital-to-analog sensor is the original digital image captured by the camera, that is, the RAW image.

[0222] The Image Signal Processor (ISP) processes the RAW image from the camera and generates the image to be displayed, which is then sent to the display screen for display or storage. The ISP includes an image processor front-end, an image processor back-end, and an I / O control interface.

[0223] The image processor front-end includes a global tone mapping (GTM) module, while the image processor back-end includes a local tone mapping (LTM) module. Both the GTM and LTM modules are used to brighten dark areas of an image, but the former operates globally, while the latter operates locally.

[0224] Combine Figure 2 and Figure 4 As shown, the hardware abstraction layer of the system framework of the embodiment of the present application may include an AEC module and an exposure mode control module. Among them, the AEC module is used to adjust the exposure parameters, and the exposure parameters may include the above-mentioned exposure time and ISO. In some embodiments of the present application, the technician calibrates the exposure of the electronic device 100 in advance, obtains the calibration information, and pre-stores the calibration information in the electronic device. Specifically, when calibrating, the technician can record the exposure time and ISO of the electronic device 100 when it is in different ambient light brightness as calibration information, and store the calibration information in the electronic device 100.

[0225] For example, in an embodiment of the present application, technicians calibrate the electronic device 100 before it leaves the factory: when the ambient brightness is L1 lux, the electronic device 100 can normally expose with exposure parameters of 1 / 50s (exposure time) and ISO 100 (sensitivity); when the ambient brightness is L2 lux, the electronic device 100 can normally expose with exposure parameters of 1 / 50s (exposure time) and ISO 200. L1 lux and L2 lux can be brightness values ​​or brightness ranges, and the electronic device 100 can record the ambient brightness during calibration and the corresponding exposure parameters.

[0226] In some embodiments of the present application, the electronic device 100 can measure the amount of incoming light using a light metering system. The light metering system works similarly to an image sensor, that is, converting light signals into electronic signals, which are then transmitted to a chip processor for calculation.

[0227] In some embodiments of the present application, the electronic device 100 may be provided with a photometric system. The photometric system can be used to measure the brightness of light reflected from a subject, i.e., reflective photometry. The photometric system may include a photometric element, through which the electronic device 100 can automatically measure the amount of incoming light, thereby obtaining the ambient light brightness. The device 100 then searches calibration information to select exposure parameters corresponding to the ambient light brightness, and performs exposure according to the exposure parameters.

[0228] The exposure mode control module is used to switch the exposure mode according to the current ambient light brightness. Among them, the exposure mode may include: dual-sensitivity mode, high-sensitivity mode and low-sensitivity mode, among which the low-sensitivity mode is less sensitive to light than the high-sensitivity mode. Specifically, the low-sensitivity mode has lower sensitivity than the high-sensitivity mode. To obtain an image of the same brightness, the low-sensitivity mode requires a longer exposure time than the high-sensitivity mode. Dual-sensitivity mode refers to a method of capturing images through two sensitivity modes at the same time. In order to ensure the quality of the captured image, the dual-sensitivity mode usually adopts the same exposure strategy as the high-sensitivity mode. That is to say, the strategy for determining parameters such as exposure time and ISO in the dual-sensitivity mode is the same as that in the high-sensitivity mode.

[0229] The following describes in detail the specific implementation of the exposure mode switching method according to the embodiment of the present application:

[0230] like Figure 4As shown, the process mainly includes: 1. Measuring the ambient light brightness; 2. Obtaining exposure parameters based on the ambient light brightness; 3. Exposing and capturing image frames based on the exposure parameters; 4. Outputting the captured image frames to the AEC module; 5. The AEC module estimates the ambient light brightness based on the captured image frames and the exposure parameters, and outputs the estimated ambient light brightness to the exposure mode control module; 6. The exposure mode control module switches the image sensor's exposure mode based on the estimated ambient light brightness and the switching conditions. Steps 1 to 6 can then be repeated until the capture is complete.

[0231] The exposure mode switching method of the embodiment of the present application can be applied to the preview process before starting to shoot a video and during the process of shooting a video. In either of the above two processes, the electronic device can perform automatic exposure when starting the camera. Specifically, the electronic device can determine the ambient light brightness (light metering) based on the amount of incoming light, select exposure parameters (lookup table) based on the ambient light brightness and calibration information, capture the image according to the exposure parameters and display the captured image frame in the preview box. If it is in the process of shooting a video, the electronic device can also save the captured image frame.

[0232] In an embodiment of the present application, the electronic device 100 can store the exposure time and ISO corresponding to the dual-sensitivity mode and the low-sensitivity mode under different ambient brightness. Table 1 and Table 2 are examples provided in an embodiment of the present application. Table 1 is an exposure table for the dual-sensitivity mode, and Table 2 is an exposure table for the low-sensitivity mode, wherein the exposure strategy adopted by the dual-sensitivity mode is the same as that of the high-sensitivity mode. Lum, ET and ISO in Tables 1 and 2 respectively represent the ambient light brightness, exposure time and sensitivity. Among them, the unit of ambient light brightness is lux (Lux, legal symbol lx). The unit of Lum is Lux. The unit of ET is s. The standard adopted for the sensitivity represented by ISO is the ISO standard.

[0233] Table 1

[0234]

[0235] Table 2

[0236]

[0237] It should be noted that the exposure time and ISO corresponding to the dual-sensitivity mode and the low-sensitivity mode under different ambient brightness can be obtained by exposure calibration by technicians. In some embodiments of the present application, technicians can calibrate the electronic device 100 in the dual-sensitivity mode, and then set the exposure time and ISO corresponding to different ambient brightness in the low-sensitivity mode based on the relationship between the photosensitivity properties of the dual-sensitivity mode and the low-sensitivity mode. Similarly, technicians can also calibrate the electronic device 100 in the low-sensitivity mode, and then set the exposure time and ISO corresponding to different ambient brightness in the dual-sensitivity mode based on the relationship between the photosensitivity properties of the dual-sensitivity mode and the low-sensitivity mode. Of course, technicians can calibrate the electronic device 100 in the dual-sensitivity mode and the low-sensitivity mode.

[0238] It is understandable that the relationship between the photosensitivity properties of the dual-sensitivity mode and the low-sensitivity mode mentioned here refers to the photosensitivity of the electronic device 100 in the dual-sensitivity mode being four times that in the low-sensitivity mode. The photosensitivity here may refer to the gain size in the two modes. For example, in the dual-sensitivity mode, the conversion gain (generally referring to the analog gain Conversion Gain, CG) of the image sensor of the electronic device is 4 times that of the CG in the low-sensitivity mode. In some embodiments of the present application, under the same ambient brightness, the exposure time in the low-sensitivity mode of the electronic device 100 may be four times the exposure time corresponding to the dual-sensitivity mode, and the ISO in the two modes is the same, so images of the same brightness can be obtained.

[0239] It should be noted that the exposure time and ISO corresponding to the dual-sensitivity mode and low-sensitivity mode under different ambient brightness can be stored in a configuration file, which can be called.

[0240] After capturing an image, the camera can send the captured RAW image to the image processor front-end in the ISP. The GTM module in the image processor front-end can brighten the dark areas of the RAW image and send the processed image to the AEC module. The AEC statistics module and the AEC algorithm module determine (estimate) the current ambient light brightness and send the current ambient light brightness to the exposure mode control module. The exposure mode control module can determine whether to switch the exposure mode based on the ambient light brightness, a preset brightness threshold (or a first brightness threshold and a second brightness threshold) and the current exposure mode of the camera. The exposure mode control module can send a switching instruction to the image sensor to switch the exposure mode based on the judgment result and synchronize the camera's exposure mode with the AEC module.

[0241] The AEC module then searches the configuration file for corresponding exposure parameters based on the camera's exposure mode and the ambient light brightness measured by the camera's light metering system. The AEC module then configures the camera's exposure parameters accordingly. For example, suppose the AEC module previously estimated the ambient light brightness to be 290 Lux. The exposure mode control module controls the image sensor to operate in dual-light-sensitivity mode. Now, suppose the ambient light brightness increases to 310 Lux. The camera's light metering system measures the incoming light to determine the ambient light brightness. Based on the measured ambient light brightness, the camera searches Table 1 to obtain the exposure parameters: exposure time 1 / 100s, ISO 100. The camera exposes and captures the image according to the exposure parameters, and then processes the image through the ISP and outputs it to the AEC module. The AEC module estimates the ambient light brightness to be 310 Lux, which is greater than the preset ambient light threshold of 300 Lux. The exposure mode control module then controls the image sensor to switch to low-light-sensitivity mode. Next time, assuming the ambient light brightness remains above 300 Lux, the camera's metering system measures the amount of light entering to obtain the ambient light brightness. Based on the measured ambient light brightness, Table 2 is searched to obtain an exposure time of 1 / 50s and an ISO of 200. The camera then exposes and captures the image based on the exposure parameters. In this way, when the ambient light brightness is strong, the camera can switch to low-sensitivity mode, extend the exposure time, and shoot motion scenes to obtain natural motion blur, making the video playback smoother.

[0242] It should be noted that after the RAW image is processed in the image processor front end, it can also be processed in the image processor back end. For example, the LTM module in the image processor back end can brighten the local dark parts of the image. For another example, the gamma correction module in the image processor back end can process the brightness of the image to compensate for the brightness drop caused by the display. Figure 4 As shown, the image processing backend can include two modules: one for processing the image output by the image processing frontend to obtain a preview stream, and the other for processing the image output by the image processing frontend to obtain a video stream. The ISP can output the processed preview stream to the display screen through the I / O control interface for display, allowing users to preview it in real time. If the video is being captured, the ISP can also output the processed video stream through the I / O control interface and save it to a storage device.

[0243] The image sensor of the electronic device of the embodiment of the present application can have multiple gains, and different gains correspond to different sensitivity modes. The electronic device can control the image sensor to switch between different sensitivity modes when shooting a video. The specific switching method may include: in a bright light scene, a low sensitivity mode can be used for exposure. In the low sensitivity mode, the sensitivity of the image sensor is low, and a longer exposure time is required to obtain an image with the same brightness as the high sensitivity mode, so that the exposure time meets the exposure time requirements for shooting a movie. In a dark light scene, the electronic device can perform exposure in a dual sensitivity mode or a high sensitivity mode.

[0244] Figure 5 A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Figure 5 The following is the preview interface of the movie mode before starting to shoot video. Figure 5 As shown in Example a, in order to obtain high-quality images in dark scenes, the camera's image sensor can work in dual-sensitivity mode or high-sensitivity mode. If the environment in which the electronic device is located changes from a dark scene to a bright scene, such as Figure 5 As shown in Example b, if the camera's image sensor continues to work in dual-sensitivity mode or high-sensitivity mode, due to the high ambient light brightness, the exposure time when capturing images will be shortened for the high-sensitivity mode with higher sensitivity, and the captured image will not produce natural motion blur, as shown in the following example. Figure 5 As shown in the interface 54 of the example b, the football is clear in the image captured in the preview interface.

[0245] In an embodiment of the present application, in bright light scenes, the image sensor of the camera of the electronic device can be switched from the dual-sensitivity mode / high-sensitivity mode to the low-sensitivity mode. In this way, in bright light scenes, images are captured by the image sensor in the low-sensitivity mode. Since the sensitivity in the low-sensitivity mode is relatively low, under the same ambient light brightness, compared with the high-sensitivity mode or the dual-sensitivity mode, if an image of the same brightness is to be obtained, the exposure time required in the low-sensitivity mode is longer. That is to say, in bright light scenes, switching the image sensor of the electronic device from the high-sensitivity mode or the dual-sensitivity mode to the low-sensitivity mode can extend the exposure time, and the captured image has natural motion blur, such as Figure 5 As shown in interface 55 in example b.

[0246] It should be noted that Figure 5 The example shown is a preview scene. The embodiment of the present application can also be applied to the process of shooting a video. In the process of shooting a video, the preview picture and the final video frame have the same effect when playing. Figure 5 The examples shown are the same.

[0247] In order to facilitate understanding of the method provided in this application, some terms in the field of photography are introduced.

[0248] 1. ISO, Full-Well Capacity (FWC)

[0249] In the film era, ISO (International Standards Organization) sensitivity was an internationally standardized measure of the speed of film used in traditional cameras. This sensitivity was determined by the film purchased, and the value was fixed, a property of the film itself. Digital cameras and mobile phone cameras, on the other hand, use electronic image sensors (CCDs) or CMOS to detect the intensity of incoming light. To unify the measurement units with the film used in traditional cameras, the ISO sensitivity concept was introduced. Therefore, the ISO value of a digital camera also reflects its speed. A higher ISO number indicates greater sensitivity to light, while a lower ISO number indicates less sensitivity.

[0250] Taking CMOS as an example, the working principle of CMOS includes the following steps: (1) photons enter the photodiode, and the photodiode absorbs the energy of the photons and is excited to generate electrons; (2) the electrons are output to the potential well; (3) an analog voltage signal is generated at both ends of the potential well; (4) the analog voltage signal is analog-amplified to obtain an amplified voltage signal; (5) the amplified voltage signal is analog-to-digital converted to obtain a digital signal.

[0251] The amplification factor of the analog voltage signal in step (4) is the conversion gain (CG). The amplification factor during the analog-to-digital conversion in step (5) can be understood as the digital gain. ISO generally adjusts the CG and digital gain. Typically, the voltage swing and gain allowed in the pixel are determined during sensor design. After that, the voltage swing and gain are fixed. In this case, adjusting ISO is adjusting the digital gain.

[0252] Full well capacity refers to the total number of electrons that a single pixel's potential well can accommodate. When full well capacity is reached, an overexposed image will result. A larger full well capacity means a greater number of electrons can be accommodated in a single pixel's potential well, making overexposition less likely.

[0253] As mentioned above, after the sensor is designed, the voltage swing and gain are fixed. Therefore, ISO can have a significant impact on the sensor's full well capacity. Specifically, assuming the pixel's allowable voltage swing is Vmax, Vmax = G*ISO*V, where V represents the voltage generated across the potential well. With Vmax and G fixed, the larger ISO is, the smaller the analog voltage V allowed across the potential well. In other words, the number of electrons that the potential well can accommodate, Q = C*V, and the smaller the full well capacity. C represents the capacitance of the potential well, which is usually constant.

[0254] In other words, the full well capacity will be affected by ISO. The smaller the ISO, the larger the full well capacity, and the larger the ISO, the smaller the full well capacity.

[0255] 2. Dynamic range (DR)

[0256] The dynamic range is defined as the ratio between the full well capacity and the background noise, where the background noise refers to the noise generated by the readout circuit. Taking CMOS as an example, the background noise is determined by the amplifier inside the pixel, and the amplifier can be the amplifier in step (4) as described above. The background noise can be estimated differently according to different readout circuits. It can be estimated according to the thermal noise formula or the 1 / f noise formula, where 1 / f represents low-frequency noise and the noise power is inversely proportional to the signal fluctuation frequency. Any contact surface of the output circuit will have conductivity fluctuations, for example, conductor-conductor, conductor-semiconductor, semiconductor-semiconductor and other contact surfaces will have conductivity fluctuations. The conductivity fluctuations of the contact surface in the amplifier circuit lead to 1 / f noise. At low frequencies, 1 / f noise is the main component of the background noise, while at high frequencies, 1 / f noise will be reduced to a level smaller than thermal noise, so that thermal noise becomes the main component of the background noise. Thermal noise is white noise, a type of random noise.

[0257] Therefore, for the same CMOS image sensor, the background noise is related to the readout circuit. Since the readout circuit in a designed image sensor is fixed, the dynamic range is related to the full well capacity. The larger the full well capacity, the larger the dynamic range.

[0258] 3. Gain

[0259] When taking actual photos, the larger the dynamic range, the larger the range of brightest and darkest colors that the captured image can contain.

[0260] In real-world photography, the ambient lighting of the scene often changes, and the image sensor may need to capture both very bright and very dark scenes. To capture images of bright scenes, the image sensor's full well capacity is as large as possible. To better capture details in dark scenes, the image sensor is expected to have a higher sensitivity. In other words, image sensors are generally expected to have both a larger full well capacity and higher sensitivity. However, as shown above, the higher the sensitivity, the smaller the full well capacity, and the lower the dynamic range.

[0261] For example, in bright light scenes, image sensors require a larger full-well capacity. This is because a larger full-well capacity allows the sensor to accommodate a greater number of electrons, preventing information loss due to digital overflow caused by excessive multiplication when adjusting the gain. This translates to less overexposure during capture. However, a larger full-well capacity results in lower sensitivity, and in dimly lit scenes, images captured lack detail in dark areas. In low-light scenes, image sensors require even higher sensitivity—in other words, greater light sensitivity. However, higher sensitivity limits the full-well capacity. In other words, as sensitivity increases, the full-well capacity decreases, making overexposure more likely in bright light. Furthermore, since dynamic range = full-well capacity / noise floor, a reduced full-well capacity also reduces dynamic range.

[0262] Related technologies address this issue by introducing different gains, which translates to image sensors with dual gain (DG). There are two approaches to designing dual gain in CMOS image sensors: one incorporates the dual gain into the pixel, and the other incorporates it into the circuit. The first approach is also called dual conversion gain, while the second is also called dual circuit gain or dual native ISO technology.

[0263] Figure 6AA schematic diagram of a module of an image sensor with dual conversion gain capability according to an embodiment of the present application is shown. In an image sensor with dual conversion gain (DCG) capability, one pixel has two charge-voltage amplifiers, corresponding to different full well capacities and different conversion gains (CG): a large full well capacity corresponds to a low conversion gain (LCG) and low sensitivity, and a small full well capacity corresponds to a high conversion gain (HCG) and high sensitivity. The sensitivity here can refer to the size of the gain. In this way, the sensor can use two gains in the same scene, acquiring an image in high sensitivity mode and an image in low sensitivity mode through at least two exposures, that is, capturing images in dual sensitivity mode. The electronic device then synthesizes the acquired images into one image, which is high dynamic range imaging (HDR) technology. Among them, the image in high sensitivity mode refers to the image obtained by using a potential well with high sensitivity and small full well capacity, and the image in low sensitivity mode refers to the image obtained by using a potential well with low sensitivity and large full well capacity.

[0264] Figure 6B FIG2 shows a block diagram of an image sensor with dual native ISO according to an embodiment of the present application. The dual circuit gain or dual native ISO technology has one potential well, but the readout circuit has two gains, such as Figure 6B The first gain unit 12 and the second gain unit 22 are shown. The two gain types are LCG and HCG. LCG corresponds to a large full well capacity, while HCG corresponds to a small full well capacity. The dual-circuit gain can simultaneously acquire images corresponding to two different gains in one exposure, that is, an image in high-sensitivity mode and an image in low-sensitivity mode can be acquired in one exposure.

[0265] However, image sensors generally only expose in one light sensitivity mode. To better capture dark details in an image, image sensors are usually exposed in a high-light sensitivity mode. In this high-light sensitivity mode, the full well capacity of the potential well is relatively small. Under the same light source, to ensure stable brightness of the captured image, the shutter speed in the high-light sensitivity mode is faster than that in the low-light sensitivity mode, meaning the exposure time is shorter.

[0266] The inventors discovered that when shooting in movie mode on a mobile phone, since the frame rate specification for movie mode is 24fps or 30fps, in high-sensitivity mode, if the scene is brightly lit, the exposure time is likely to be shorter than 1 / 48s. The resulting images are very sharp with minimal motion blur. However, playback can produce a sense of stuttering, and the resulting video lacks the visual quality of a movie.

[0267] In order to solve the above technical problems, the present application proposes an exposure mode switching method and related devices. The exposure mode switching method of the present application can be applied to electronic devices with dual gain (DG) capability or dual circuit gain.

[0268] During the video shooting process or the preview process before shooting, electronic devices with dual gain (DG) capability can switch between dual sensitivity mode, high sensitivity mode and low sensitivity mode. According to this method, in bright light scenes, low sensitivity mode can be used for exposure. In low sensitivity mode, the sensitivity of the image sensor is low, and a longer exposure time is required to obtain an image with the same brightness as the high sensitivity mode, so that the exposure time meets the exposure time requirements for shooting movies. In dark light scenes, electronic devices can be exposed in dual sensitivity mode or high sensitivity mode.

[0269] Since it is applied to electronic devices with DG capabilities, the dual-sensitivity mode of the camera working of electronic devices supporting DG capabilities is first introduced below.

[0270] Figure 6A A schematic diagram showing a module within a pixel of an example image sensor is shown, Figure 6A As described above, there are two charge-voltage amplifiers in one pixel. One of the charge-voltage amplifiers 1 is connected to the potential well and the readout circuit, corresponding to a higher gain (HCG) and a small full well capacity. This mode corresponds to the high-sensitivity mode. If the charge output by the potential well is output to the readout circuit through two charge-voltage amplifiers, it corresponds to a lower gain (LCG) and a large full well capacity. This mode corresponds to the low-sensitivity mode. The dual-sensitivity mode requires reading the image once in the high-sensitivity mode and once in the low-sensitivity mode respectively. The image in the dual-sensitivity mode can be obtained by fusing the readout images.

[0271] Therefore, in Figure 6A In the example, the exposure mode control module determines the target exposure mode based on the estimated ambient light level, sends a switch instruction to the image sensor based on the target exposure mode, and synchronizes the exposure mode with the AEC module. The AEC module searches the configuration file for the corresponding exposure parameters based on the exposure mode and the ambient light level measured by the light metering system, and configures the camera's exposure parameters accordingly.

[0272] Figure 6B A schematic diagram illustrating a module within a pixel of an image sensor according to an embodiment of the present application is shown. Figure 6BThe relationship between the modules in the pixel of the image sensor with dual circuit gain can be illustrated, wherein the gain value corresponding to the first gain unit 12 is different from the gain value corresponding to the second gain unit 22, and the gain of the first gain unit 12 is smaller than the gain of the second gain unit 22. By controlling the on-off of the two paths or controlling the readout, the exposure mode of the pixel point can be controlled to switch between the dual sensitivity mode, high sensitivity mode and low sensitivity mode. It should be noted that Figure 6A and Figure 6B What is shown is merely a schematic diagram of the pixel structure of a photosensitive element supporting DG capability, and the present application is not limited thereto.

[0273] The above are different examples of controlling the image sensor to implement exposure mode switching in the exposure mode switching method in the embodiments of the present application, and the present application is not limited thereto.

[0274] In order to more clearly illustrate the switching logic of the exposure mode switching method of the embodiment of the present application, the exposure mode switching method of the embodiment of the present application is further described below in different scenarios. That is, the exposure mode switching module determines whether to switch according to the ambient light brightness input by the AEC module, and the exposure mode to be switched is described in detail. In the following scenario, the switching between the dual-sensitivity mode and the low-sensitivity mode is used as an example for description, but the present application is not limited to this. The electronic device can also control the image sensor to switch between the high-sensitivity mode and the low-sensitivity mode, or between the high-sensitivity mode and the dual-sensitivity mode.

[0275] Scenario 1

[0276] Figure 7A A flow chart of an exposure mode switching method according to an embodiment of the present application is shown. The exposure mode switching method according to the embodiment of the present application can be applied during video shooting or during preview before starting to shoot a video.

[0277] like Figure 7A As shown, the exposure mode switching method of the embodiment of the present application includes the following steps:

[0278] Step S501: The electronic device receives an instruction to start a camera application, starts the camera and opens the camera application. In response to the user's operation, the electronic device switches the camera to a video shooting function.

[0279] After the electronic device switches the camera to the video shooting function in response to the user's operation, the image sensor in the camera works in the dual-sensitivity mode by default. The camera captures images in the dual-sensitivity mode and displays the images captured by the camera in the preview box of the camera application.

[0280] For a specific example of the electronic device switching the camera to the function of shooting a video in response to a user's operation, see the above Figure 5The introduction of this part will not be repeated here.

[0281] In step S502 , the electronic device performs AEC statistics on the image captured by the camera to obtain statistical results, and determines the current ambient light brightness according to the statistical results.

[0282] Before step S502, as mentioned above Figure 4 As described in the previous section, the electronic device can capture images through steps such as light metering, table lookup, and exposure, and output the captured images to the AEC module. The AEC module then obtains statistical results based on the images and determines the current ambient light brightness based on the statistical results.

[0283] The current ambient light brightness may refer to the brightness of the ambient light when the electronic device captures the image.

[0284] In the embodiments of the present application, obtaining the ambient light brightness through a light metering system can be used as an example of obtaining the ambient light brightness. The ambient light brightness measured by the light metering system is generally the brightness of light reflected from the subject, which may deviate from the actual ambient light brightness. Therefore, in the embodiments of the present application, the current ambient light brightness can also be estimated based on the captured image and exposure parameters.

[0285] Specifically, the electronic device can perform AEC statistics on the captured image to obtain statistical results, and determine the current ambient light brightness based on the statistical results. The statistical results can be the average brightness of the captured image. AEC statistics can adopt statistical methods in related technologies. For example, the electronic device calculates the brightness of the captured image through the AEC statistics module in the AEC module. Specifically, the brightness of the image can be calculated by the average brightness method, the weighted average method, etc., wherein the average brightness method can refer to calculating the average brightness of the entire image, and the weighted average method can refer to calculating the brightness of the image, and the proportion of the entire image from the center area to the edge area becomes smaller and smaller.

[0286] Electronic devices can estimate the current ambient light brightness using the following formula (1):

[0287]

[0288] Among them, lv represents the estimated current ambient light brightness, A represents the aperture value, avg Luma represents the average brightness of the image, that is, the average brightness of the image captured above; Exposure Time represents the exposure time in seconds; ISO represents the sensitivity; C is a constant, the specific value is 100 / 46. Exposure time and ISO can refer to the Figure 4 The exposure parameters obtained in steps 1 and 2 are the exposure parameters used when taking the above image.

[0289] In step S503, the electronic device switches the exposure mode of the camera and adjusts exposure parameters according to the relationship between the current ambient light brightness and the preset brightness threshold, wherein the exposure parameters include exposure time and sensitivity.

[0290] The preset brightness threshold may be a fixed value, or may include two brightness thresholds: a first brightness threshold and a second brightness threshold.

[0291] The embodiments of the present application are introduced by taking the preset brightness threshold as a fixed value as an example. Figure 7B A flow chart of an exposure mode switching method according to an embodiment of the present application is shown. Specifically, in one possible implementation, step S503 may include:

[0292] S5031: The electronic device determines whether the current ambient light brightness is greater than or equal to a preset brightness threshold.

[0293] If the current ambient light brightness is greater than or equal to the preset brightness threshold, the electronic device can execute steps S5033-S5034. If the current ambient light brightness is not greater than the preset brightness threshold, the electronic device can execute step S5032. The preset brightness threshold can be 300 Lux. The preset brightness threshold can be determined based on the relationship between the calibrated ambient light brightness and the exposure time. For example, as shown in Table 1, if the calibration result shows that when the ambient light brightness is greater than 300 Lux, the exposure time is 1 / 100s, which is much less than the 1 / 48s required by the movie mode. That is to say, when the ambient light brightness is greater than 300 Lux, the exposure time needs to be adjusted, and the preset brightness threshold can be set to 300 Lux. Of course, the relationship between the ambient light brightness and the exposure parameters corresponding to different photosensitive elements may be different, so the size of the preset brightness threshold may also be different. The 300 Lux in the embodiment of the present application is only an example.

[0294] Step S5032: The electronic device controls the camera to continue operating in the dual-light-sensing mode.

[0295] For example, the electronic device determines based on exposure parameters that the current ambient light brightness is less than a preset brightness threshold. Assume that the current ambient light brightness determined by the electronic device is 200 Lux and the electronic device operates in dual-sensitivity mode. As shown in Table 1, the exposure parameters used are: exposure time 1 / 50s, ISO 200. With an exposure time close to 1 / 48s, moving objects in the preview frame can produce natural motion blur.

[0296] In step S5033, the electronic device switches the exposure mode of the camera from the dual-light-sensitivity mode to the low-light-sensitivity mode.

[0297] Specifically, the processor of the electronic device can send a mode switching signal to the camera, and after the camera receives the switching signal, it can switch to the low-sensitivity mode. Figure 6A and Figure 6B Example shown.

[0298] In step S5034, the electronic device adjusts exposure parameters according to the current ambient light brightness.

[0299] Based on the current ambient light level, the electronic device can search the configuration file for the relationship between ambient light level and exposure parameters to determine the exposure parameters corresponding to the current ambient light level in low-sensitivity mode. As shown in Table 1, assuming the current ambient light level is 500 Lux, the corresponding exposure parameters for low-sensitivity mode are: exposure time 1 / 50s, ISO 100. After obtaining the exposure parameters corresponding to the current ambient light level from the configuration file, the electronic device can adjust the camera's exposure time and sensitivity. After these adjustments, the camera operates in low-sensitivity mode with a shutter speed of 1 / 50s.

[0300] Figure 7C FIG. 1 is a flow chart showing a method for switching exposure modes according to an embodiment of the present application. Figure 7C As shown, in one possible implementation, Figure 7B After step S5034 shown, the electronic device can continue to execute step S502 to perform AEC statistics on the image captured by the camera to obtain statistical results, and determine the current ambient light brightness based on the statistical results. The electronic device can continue to execute step S5031, compare the current ambient light brightness with the preset brightness threshold, and determine whether the current ambient light brightness is greater than or equal to the preset brightness threshold: if the current ambient light brightness is greater than or equal to the preset brightness threshold, the electronic device can execute step S5035 to control the camera to continue working in low-sensitivity mode; if the current ambient light brightness is less than the preset brightness threshold, the electronic device can execute steps S5036 and S5037, and the electronic device can switch the exposure mode of the camera from low-sensitivity mode to dual-sensitivity mode, and adjust the exposure parameters according to the current ambient light brightness.

[0301] According to the above Figures 7A-7C As can be seen from the exposure mode switching method in the example, the exposure mode switching method in the embodiment of the present application may include the following steps:

[0302] After the video recording function of the camera application is turned on, the electronic device captures an image through the camera, performs AEC statistics on the image to obtain the image brightness, and determines the current ambient light brightness based on the image brightness;

[0303] The electronic device may determine a target exposure mode of the camera under the current ambient light brightness based on a relationship between the current ambient light brightness and a preset brightness threshold. Specifically: if the electronic device determines that the current ambient light brightness is greater than or equal to the preset brightness threshold, the exposure mode of the camera under the current ambient light brightness is a low-sensitivity mode; if the electronic device determines that the current ambient light brightness is less than the preset brightness threshold, the exposure mode of the camera under the current ambient light brightness is a dual-sensitivity mode;

[0304] The electronic device can determine whether to switch the exposure mode of the camera based on the current exposure mode and the target exposure mode of the camera. Specifically: if the electronic device determines that the current exposure mode of the camera is the same as the target exposure mode, the electronic device can control the camera to continue working in the current exposure mode; if the electronic device determines that the current exposure mode of the camera is different from the target exposure mode, the electronic device can switch the exposure mode of the camera from the current exposure mode to the target exposure mode.

[0305] Figure 8A A schematic diagram illustrating application scenarios according to some embodiments of the present application.

[0306] Figure 8A A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Figure 8A As shown in the figure, the horizontal axis of the coordinate axis can represent time, and the vertical axis can represent the change of ambient light brightness over time. The two curves respectively represent two examples of the change of ambient light brightness after the video shooting function of the camera application is turned on; the lower half of the figure can represent the process of switching the exposure mode of the camera in the two examples. In the lower half, the example corresponding to the solid line 1 is the switching process corresponding to the above curve 1, and the example corresponding to the dotted line 2 is the switching process corresponding to the above curve 2.

[0307] Example 1

[0308] In Example 1, if Figure 8A As shown, before t1, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold. The target exposure mode of the electronic device is dual-light mode. After the electronic device opens the camera application and switches to the video capture function, the image sensor in the camera defaults to dual-light mode. Therefore, before t1, the electronic device controls the camera image sensor to operate in dual-light mode. Because the ambient light brightness before t1 is less than the preset brightness threshold, the exposure time is relatively long, close to 1 / 48 second, and moving objects can produce natural motion blur. The effect presented in the preview frame is close to a real motion scene. The motion process of the moving objects in the two frames is relatively coherent, and the playback is relatively smooth.

[0309] At t1, the electronic device determines, based on the captured image, that the current ambient light brightness is equal to the preset brightness threshold, and that the target exposure mode of the electronic device is low-sensitivity mode. Prior to t1, the image sensor of the electronic device's camera operates in dual-sensitivity mode. That is, the current exposure mode of the camera's image sensor differs from the target exposure mode. If the exposure mode is not switched, the image captured by the electronic device has minimal motion blur and is relatively sharp.

[0310] Since the current exposure mode of the camera's image sensor is different from the target exposure mode, the electronic device may switch the exposure mode of the camera's image sensor from the current dual-sensitivity mode to the low-sensitivity mode. Figure 8A As shown by the solid line 1 in the figure, after t1, the image sensor of the camera of the electronic device switches to the low-sensitivity mode. As mentioned above, the electronic device can also look up the table to determine the current ambient light brightness to determine the exposure parameters and adjust the exposure parameters of the camera. Taking the current ambient light brightness as 400Lux, the corresponding exposure parameters in the low-sensitivity mode are: exposure time 1 / 50s, ISO 100. After the electronic device obtains the exposure parameters corresponding to the current ambient light brightness from the configuration file, it can adjust the exposure time and sensitivity of the camera. After the adjustment, the camera works in the low-sensitivity mode and uses a shutter speed of 1 / 50s for exposure. Close to 1 / 48s, moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene.

[0311] After t2, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold based on the captured image, and the target exposure mode of the electronic device is the dual-light-sensitivity mode. When the ambient brightness is low, if the image sensor operates in the low-light-sensitivity mode, the dark details in the captured image are lost, and a high-quality image cannot be obtained. Therefore, when the ambient light brightness is less than the preset brightness threshold, the target exposure mode is the dual-light-sensitivity mode. Before t2, the exposure mode of the image sensor of the electronic device's camera is the low-light-sensitivity mode, that is, the current exposure mode is different from the target sensitivity mode. The electronic device can switch the exposure mode of the camera's image sensor from the current low-light-sensitivity mode to the dual-light-sensitivity mode, and search the configuration file to obtain exposure parameters, and adjust the camera's exposure time and sensitivity. Figure 8A In the solid line 1, after t2, the image sensor of the electronic device's camera switches to the dual-sensitivity mode. The camera works in the dual-sensitivity mode and uses a shutter speed of 1 / 50s for exposure, which is close to 1 / 48s. Moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene.

[0312] Figure 8B-Figure 8DA schematic diagram of an electronic device interface during the exposure mode switching process according to Example 1 is shown. The exposure mode switching method of the embodiment of the present application can be applied to the preview process before starting to shoot a video, and can also be applied to the process of shooting a video. Figure 8B-Figure 8D The following describes how to switch exposure modes during video shooting as an example.

[0313] The electronic device can respond to the user's operation to open the camera's movie mode, or it can also open the camera's video recording, time-lapse photography and other video shooting functions. Figure 8B As shown in a, Figure 8B The a in the Figure 3A Example c in the example is an example of rotating the electronic device 90 degrees to the left and holding it horizontally, and the camera of the electronic device operates in dual-sensing mode.

[0314] When the electronic device receives a click operation on the first control 522 by the user, it can display Figure 8B The interface shown in b in the figure. Figure 8B As shown in b, the current ambient light brightness is 200 Lux. Assuming that the preset brightness threshold is 300 Lux, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold, and the image sensor of the camera of the electronic device operates in dual-sensing mode.

[0315] like Figure 8B As shown in c in the figure, the image sensor of the electronic device's camera works in dual-sensitivity mode. The current ambient light brightness is 300 Lux, which is a bright light scene. The electronic device obtains the exposure parameters by measuring light and looking up Table 1: exposure time 1 / 100s, ISO 100. The image acquired by exposure according to the exposure parameters is as follows Figure 8B As shown in Example c in Figure 1, if the exposure mode is not switched, the image captured by the electronic device has less motion blur and is relatively sharp.

[0316] Figure 8B Figure d shows a schematic diagram of dual-circuit gain in dual-sensitivity mode. When the image sensor of the electronic device in examples a, b, and c operates in dual-sensitivity mode, the electronic device can simultaneously read out two images in high-sensitivity mode and low-sensitivity mode from the readout circuit of the image sensor, merge the two images into one image, display it in the preview box, and save it.

[0317] The electronic device estimates that the current ambient light brightness is 300 Lux, which is equal to the preset brightness threshold. The image sensor of the camera of the electronic device switches from the dual-light-sensing mode to the low-light-sensing mode. Figure 8CExamples c to d in the figure use a dual-circuit gain image sensor as an example to illustrate the changes in the image sensor's operating mode before and after switching. After switching, due to the use of low-sensitivity mode, the electronic device's image sensor uses a shutter speed of 1 / 50s for exposure, close to 1 / 48s. The image in low-sensitivity mode is read from one channel and displayed in the preview frame. Moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene, such as Figure 8C As shown in Example a to Example b.

[0318] If the ambient light brightness becomes dim and is less than 300 Lux, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold based on the captured image, and the target exposure mode of the electronic device is the dual-sensitivity mode. In the case of low ambient brightness, if the image sensor works in the low-sensitivity mode, the dark details in the captured image will be lost, and a high-quality image cannot be obtained. Therefore, when the ambient light brightness is less than the preset brightness threshold, the target exposure mode is the dual-sensitivity mode, such as Figure 8D As shown in b in FIG, the electronic device can simultaneously read out two images in high-sensitivity mode and low-sensitivity mode from the readout circuit of the image sensor, merge the two images into one image, display it in the preview box and save it, as shown in FIG. Figure 8D As shown in a in .

[0319] It should be noted that Figure 8B-Figure 8D Although the preview interface is shown in the figure, according to this application Figure 4 In the embodiment shown, the electronic device can simultaneously save the captured image frames to obtain a video, and the saved video includes Figure 8B-Figure 8D Video frames in the example shown.

[0320] Example 2

[0321] In Example 2, if Figure 8A As shown by the dotted line in , after the camera application is turned on, the electronic device captures an image through the camera, performs AEC statistics on the image to obtain exposure parameters, and determines the current ambient light brightness based on the exposure parameters. At t3, assuming that the electronic device can determine that the current ambient light brightness is 550 Lux, which is greater than the preset brightness threshold of 300 Lux, the electronic device can determine that the target exposure mode is a low-sensitivity mode. The current exposure mode of the image sensor is a dual-sensitivity mode, and the current ambient light brightness is greater than the preset brightness threshold. As shown in Table 1, the current exposure time is 1 / 200s, which is much less than 1 / 48s. The exposure time is short, and the image captured by the electronic device has less motion blur and is relatively sharp.

[0322] Since the current exposure mode of the image sensor is different from the target exposure mode, the electronic device can switch the exposure mode of the camera's image sensor from the current dual-sensitivity mode to the low-sensitivity mode. Figure 8A As shown by the dotted line 2 in the figure, within a certain period of time after t3, the image sensor of the electronic device's camera switches to low-sensitivity mode. As mentioned above, the electronic device can also look up the table to determine the current ambient light brightness to determine the exposure parameters and adjust the exposure parameters of the camera. Taking the current ambient light brightness as 550Lux, the corresponding exposure parameters in low-sensitivity mode are: exposure time 1 / 50s, ISO 100. After the electronic device obtains the exposure parameters corresponding to the current ambient light brightness from the configuration file, it can adjust the exposure time and sensitivity of the camera. After the adjustment, the camera works in low-sensitivity mode and uses a shutter speed of 1 / 50s for exposure. The exposure time after adjustment is close to 1 / 48s, and moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene.

[0323] After t4, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold of 300Lux based on the captured image, and the target exposure mode of the electronic device is the dual-light-sensitivity mode. When the ambient brightness is low, if the image sensor works in the low-light-sensitivity mode, the dark details in the captured image will be lost, and a high-quality image cannot be obtained. Therefore, when the ambient light brightness is less than the preset brightness threshold, the target exposure mode is the dual-light-sensitivity mode. Before t4, the exposure mode of the image sensor of the electronic device's camera is the low-light-sensitivity mode, that is, the current exposure mode is different from the target sensitivity mode. The electronic device can switch the exposure mode of the camera's image sensor from the current low-light-sensitivity mode to the dual-light-sensitivity mode, and search the configuration file to obtain the exposure parameters, and adjust the camera's exposure time and sensitivity. Figure 8A In the dotted line 2, after t4, the image sensor of the electronic device's camera switches to the dual-sensitivity mode. The camera works in the dual-sensitivity mode and uses a shutter speed of 1 / 50s for exposure, which is close to 1 / 48s. Moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene.

[0324] At t5, the electronic device determines, based on the captured image, that the current ambient light brightness is equal to the preset brightness threshold, and that the target exposure mode of the electronic device is low-sensitivity mode. Prior to t5, the image sensor of the electronic device's camera operates in dual-sensitivity mode. That is, the current exposure mode of the camera's image sensor is different from the target exposure mode. If the exposure mode is not switched, the image captured by the electronic device has minimal motion blur and is relatively sharp.

[0325] Since the current exposure mode of the camera's image sensor is different from the target exposure mode, the electronic device may switch the exposure mode of the camera's image sensor from the current dual-sensitivity mode to the low-sensitivity mode. Figure 8AAs shown by the dashed line 2 in the figure, after t5, the electronic device's camera's image sensor switches to low-sensitivity mode. As described above, the electronic device can also use a table to determine the current ambient light brightness and exposure parameters, thereby adjusting the camera's exposure parameters. When the camera operates in low-sensitivity mode, it uses a shutter speed of 1 / 50s, close to 1 / 48s, to produce natural motion blur on moving objects, resulting in a preview effect that resembles a realistic motion scene.

[0326] It should be noted that the electronic device can continuously execute the processes of steps S502 and S503, perform AEC statistics on the image captured by the camera to obtain the brightness of the image, determine the current ambient light brightness based on the brightness of the image, and compare the current ambient light brightness with the preset brightness threshold. Based on the comparison result, it switches between the dual-sensitivity mode and the low-sensitivity mode, and adjusts the exposure parameters according to the current ambient light brightness until the shooting is completed, or the user is detected to turn off the camera, or it is detected that the user switches the camera to a mode other than taking pictures, portraits, and other video recording modes.

[0327] Figure 8E A schematic diagram of an electronic device interface during the exposure mode switching process according to Example 2 is shown. The exposure mode switching method of the embodiment of the present application can be applied to the preview process before starting to shoot a video, and can also be applied to the process of shooting a video. Figure 8E The following describes how to switch exposure modes during video shooting as an example.

[0328] exist Figure 8E In the example, it is assumed that the preset brightness threshold is 300 Lux.

[0329] The electronic device responds to the user's operation to open the camera's movie mode, or it can also open the camera's video recording, time-lapse photography and other video shooting functions. After opening the camera application, such as Figure 8E As shown in a, the camera of the electronic device works in a dual-sensing mode.

[0330] When the electronic device receives a click operation on the first control 522 by the user, it can display Figure 8E The interface shown in b in the figure. Figure 8E As shown in b in the figure, the current ambient light brightness is 550 Lux, which is greater than the preset brightness threshold of 300 Lux. The electronic device can determine that the target exposure mode is low-sensitivity mode. The image sensor's current exposure mode is dual-sensitivity mode. The current ambient light brightness is greater than the preset brightness threshold. As shown in Table 1, the current exposure time is 1 / 200s, which is much shorter than 1 / 48s. The short exposure time allows the electronic device to capture a sharper image with minimal motion blur.

[0331] Since the current exposure mode of the image sensor is different from the target exposure mode, the electronic device may switch the exposure mode of the image sensor of the camera from the current dual-sensitivity mode to the low-sensitivity mode, such as Figure 8E As shown in c in . The electronic device can also look up the table to determine the current ambient light brightness to determine the exposure parameters and adjust the exposure parameters of the camera. Assuming the current ambient light brightness is 550Lux, the corresponding exposure parameters in low-sensitivity mode are: exposure time 1 / 50s, ISO 100. After the electronic device obtains the exposure parameters corresponding to the current ambient light brightness from the configuration file, it can adjust the exposure time and sensitivity of the camera. After the adjustment, the camera works in low-sensitivity mode and uses a shutter speed of 1 / 50s for exposure. The exposure time after adjustment is close to 1 / 48s, and moving objects can produce natural motion blur, such as Figure 8C As shown in c in FIG, the effect presented in the preview box is close to a real motion scene.

[0332] like Figure 8E As shown in d, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold 300Lux based on the captured image, and the target exposure mode of the electronic device is the dual-sensitivity mode, so it switches to the dual-sensitivity mode.

[0333] like Figure 8E As shown in Figure e, the current ambient light brightness is 300 Lux. The image sensor of the electronic device's camera operates in dual-sensitivity mode. If the exposure mode is not switched, the image captured by the electronic device has minimal motion blur and is relatively sharp.

[0334] like Figure 8E As shown in f, the current ambient light brightness is greater than or equal to the preset brightness threshold, and the image sensor of the camera of the electronic device has switched from dual-sensitivity mode to low-sensitivity mode, using a shutter speed of 1 / 50s for exposure. Close to 1 / 48s, moving objects can produce natural motion blur, and the effect presented in the preview frame is close to a real motion scene. The above-mentioned preset brightness threshold is 300Lux. The ambient light brightness values ​​and times in Examples 1 and 2 are merely some examples of the embodiments of the present application and do not limit the scope of the present application in any way.

[0335] To prevent ping-pong switching between the dual-light-sensing mode and the low-light-sensing mode, in one possible implementation, the preset brightness threshold in the embodiment of the present application may also include a first brightness threshold and a second brightness threshold, wherein the first brightness threshold is greater than the second brightness threshold. In one possible implementation, the first brightness threshold may be 350 Lux, and the second brightness threshold may be 250 Lux.

[0336] Figure 9A FIG. 1 is a flow chart showing a method for switching exposure modes according to an embodiment of the present application. Figure 9A As shown, the exposure mode switching method of the embodiment of the present application may include the following steps:

[0337] S701: The electronic device receives an instruction to start a camera application, starts the camera and opens the camera application. In response to the user's operation, the electronic device switches the camera to a video shooting function.

[0338] After the electronic device switches the camera to the video shooting function in response to the user's operation, the camera works in the dual-sensing mode by default.

[0339] The camera captures images in dual-sensor mode, and the images captured by the camera are displayed in the preview box of the camera application.

[0340] In step S702 , the electronic device performs AEC statistics on the image captured by the camera to obtain statistical results, and determines the current ambient light brightness according to the statistical results.

[0341] The specific processes of steps S701 and S702 can be found in the relevant introduction of steps S501 and S502, which will not be repeated here.

[0342] In step S703, the electronic device determines whether to switch the camera's exposure mode based on the relationship between the current ambient light brightness and the first brightness threshold, the second brightness threshold, and the camera's current exposure mode. If the camera's exposure mode does not need to be switched, the process returns to step S702. If the camera's exposure mode needs to be switched, the process proceeds to step S704.

[0343] In step S704, the electronic device switches the exposure mode of the camera and adjusts the exposure parameters of the camera according to the current ambient light brightness. Return to step S702.

[0344] Figure 9B A flow chart of an exposure mode switching method according to an embodiment of the present application is shown.

[0345] like Figure 9B As shown, after determining the current ambient light brightness, the electronic device may execute step S7031.

[0346] S7031, determine whether the current ambient light brightness is greater than the second brightness threshold and less than the first brightness threshold.

[0347] If yes, the electronic device may execute step S7032; if no, the electronic device may execute step S7033.

[0348] S7032: The electronic device controls the camera to continue operating in the current exposure mode.

[0349] In other words, by setting two ambient light brightness thresholds, the camera's exposure mode won't be switched when the current ambient light brightness falls between the two thresholds. Only when the ambient light brightness is greater than or equal to the first brightness threshold or less than or equal to the second brightness threshold is the camera's exposure mode switched based on the current exposure mode and the current ambient light brightness. This prevents frequent exposure mode switching when the ambient light brightness varies within the range from the first brightness threshold to the second brightness threshold.

[0350] For example, in the example above, a preset brightness threshold of 300 Lux is set. If the ambient light brightness fluctuates around 300 Lux, frequent exposure mode switching may occur. In this embodiment, by setting two brightness thresholds, frequent exposure mode switching can be prevented when the brightness ranges from the first to the second threshold.

[0351] S7033, the electronic device may determine whether the current ambient light brightness is greater than or equal to a first brightness threshold.

[0352] Since it has been determined in step S7031 that the current ambient light brightness is not between the second brightness threshold and the first brightness threshold, in one possible implementation, in step S7033, the electronic device may determine whether the current ambient light brightness is greater than or equal to the first brightness threshold. If so, the electronic device may execute step S7034; if not (that is, the electronic device may determine that the current ambient light brightness is less than or equal to the second brightness threshold), the electronic device may execute step S7037.

[0353] S7034, the electronic device can determine whether the current exposure mode of the camera is a low-sensitivity mode.

[0354] Since the current ambient light brightness is greater than or equal to the first brightness threshold, the dual-sensitivity mode is exposed in high-sensitivity mode, and the exposure time is short, which makes it difficult to produce a natural motion pattern. It is necessary to control the camera's exposure mode to low-sensitivity mode. The electronic device can first determine whether the camera's current exposure mode is low-sensitivity mode. If the camera's current exposure mode is low-sensitivity mode, the electronic device does not need to switch the camera's exposure mode, that is, execute step S7035 and control the camera to continue working in the current low-sensitivity mode. If the camera's current exposure mode is not low-sensitivity mode, the electronic device can execute steps S7036 and S704.

[0355] S7036, the electronic device may switch the exposure mode of the camera from the dual-sensitivity mode to the low-sensitivity mode.

[0356] For the specific switching method, please refer to the description above. After switching to low-sensitivity mode, the electronic device can expose according to the exposure mode of low-sensitivity mode when the ambient light brightness is greater than or equal to the first brightness threshold. The exposure time is long, which can produce natural motion blur for moving scenes.

[0357] S7037, the electronic device can determine whether the current exposure mode of the camera is the dual-sensitivity mode.

[0358] In step S7033, the electronic device determines that the current ambient light brightness is not greater than or equal to the first brightness threshold. In step S7031, the electronic device determines that the current ambient light brightness is not greater than the second brightness threshold and is less than the first brightness threshold. Therefore, the electronic device can determine that the current ambient light brightness is less than or equal to the second brightness threshold.

[0359] In this case, the electronic device can determine whether the current exposure mode of the camera is the dual-sensitivity mode. If the current exposure mode of the camera is the dual-sensitivity mode, the electronic device can execute step S7038.

[0360] S7038, the electronic device continues to control the camera to operate in the current exposure mode.

[0361] If the current exposure mode of the camera is not the dual-sensitivity mode, the electronic device may execute step S7039.

[0362] S7039, the electronic device switches the exposure mode of the camera from the low-sensitivity mode to the dual-sensitivity mode.

[0363] In another possible implementation, in step S7033, the electronic device may also determine whether the current ambient light brightness is less than or equal to a second brightness threshold.

[0364] If the current ambient light brightness is less than or equal to the second brightness threshold: In step S7034, the electronic device may continue to determine whether the current exposure mode of the camera is the dual-light-sensing mode. If so, the electronic device executes step S7035. If not, in step S7036, the electronic device may switch the exposure mode of the camera from the low-light-sensing mode to the dual-light-sensing mode. Of course, in step S7034, it is also possible to continue to determine whether the current exposure mode of the camera is the low-light-sensing mode. However, if the determination is yes, the electronic device executes step S7036 to switch the exposure mode of the camera from the low-light-sensing mode to the dual-light-sensing mode. If the determination is no, the electronic device executes step S7035.

[0365] If the current ambient light brightness is not less than or equal to the second brightness threshold, according to the previous judgment condition, the current ambient light brightness is greater than or equal to the first brightness threshold. In step S7037, the electronic device can determine whether the current exposure mode of the camera is the low-light mode. If it is the low-light mode, the electronic device can execute step S7038 to control the camera to continue operating in the current exposure mode. If it is not the low-light mode, the electronic device can execute step S7039. In step S7039, the electronic device can switch the exposure mode of the camera from the dual-light mode to the low-light mode. Of course, in step S7037, the electronic device can also determine whether the current exposure mode of the camera is the dual-light mode. The specific process will not be repeated here.

[0366] like Figure 9B As shown, after executing step S7036 or S7039, the electronic device can execute step S7041, and the electronic device adjusts the exposure parameters of the camera according to the current ambient light brightness. Specifically, the electronic device searches for a configuration file according to the current ambient light brightness and the exposure mode after switching, determines the exposure parameters corresponding to the current ambient light brightness and the exposure mode after switching, and adjusts the exposure parameters of the camera according to the found exposure parameters.

[0367] It should be noted that after step S7041 and S7032, S7035 and S7038 in step S703, the electronic device can continue to execute step S702 until the shooting is completed, or the user is detected to turn off the camera, or the user is detected to switch the camera to a mode other than recording video such as taking pictures, portraits, etc.

[0368] Figure 10 A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Figure 10 As shown, the horizontal axis of the coordinate axis in the figure can represent time, and the vertical axis can represent the change of ambient light brightness over time. The three curves respectively represent examples of changes in ambient light brightness after the video shooting function of the camera application is turned on; the lower half of the figure can represent the process of switching the exposure mode of the camera image sensor in the three examples. In the lower half, the example corresponding to the solid line 3 is the switching process corresponding to the above curve 3, the example corresponding to the dotted line 4 is the switching process corresponding to the above curve 4, and the example corresponding to the dotted line 5 is the switching process corresponding to the above curve 5.

[0369] The following combination Figure 9A 、 Figure 9B 、 Figure 10 The exposure mode switching method of the embodiment of the present application is introduced with reference to specific application scenarios.

[0370] Example 3

[0371] like Figure 10 As shown in curve 3 in Figure 3, when an electronic device opens a video recording or movie recording function in the camera application, the camera defaults to dual-light-sensitivity mode. The current ambient light brightness is relatively low, approximately 150 Lux, which is lower than the second brightness threshold. The electronic device does not switch the camera's exposure mode. When the ambient light brightness approaches 250 Lux (the second brightness threshold), the electronic device does not switch the camera's exposure mode. Until t1, when the ambient light brightness approaches 350 Lux (the first brightness threshold), the electronic device switches the camera's exposure mode from dual-light-sensitivity mode to low-light-sensitivity mode.

[0372] After t1, the ambient light brightness continues to change and exceeds the first brightness threshold. Before t2, when the ambient light brightness approaches the first brightness threshold, the electronic device does not switch the camera exposure mode, and the camera's image sensor continues to operate in low-light-sensitivity mode. Until t2, the ambient light brightness continues to decrease and approaches the second brightness threshold. When the ambient light brightness falls below the second brightness threshold, the electronic device switches the camera's exposure mode from low-light-sensitivity mode to dual-light-sensitivity mode.

[0373] Example 4

[0374] like Figure 10 As shown in curve 4 in Figure 3, when an electronic device opens a video recording or movie recording function in the camera application, the camera defaults to dual-light-sensitivity mode. At t3, the current ambient light brightness is relatively high, about 500 Lux, which is greater than the first brightness threshold. The electronic device switches the camera's exposure mode from dual-light-sensitivity mode to low-light-sensitivity mode. When the ambient light brightness approaches 350 Lux (the first brightness threshold), the electronic device does not switch the camera's exposure mode. Until t4, when the ambient light brightness approaches 250 Lux (the second brightness threshold), the electronic device switches the camera's exposure mode from low-light-sensitivity mode to dual-light-sensitivity mode.

[0375] After t7, when the ambient light brightness of curve 4 approaches 250Lux (the second brightness threshold) again, the electronic device switches the exposure mode of the camera. Until t5, when the ambient light brightness approaches 350Lux (the first brightness threshold), the electronic device switches the exposure mode of the camera from dual-sensitivity mode to low-sensitivity mode.

[0376] Example 5

[0377] like Figure 10As shown in curve 5, when the electronic device turns on the video recording or movie shooting function of the camera application, the camera works in dual-sensitivity mode by default. Before t6, when the ambient light brightness of curve 5 is close to 250Lux (the second brightness threshold), the electronic device does not switch the exposure mode of the camera. Until t6, when the ambient light brightness of curve 5 is close to 350Lux (the first brightness threshold), the electronic device switches the exposure mode of the camera from dual-sensitivity mode to low-sensitivity mode. At t7, when the ambient light brightness of curve 5 is close to 350Lux (the first brightness threshold), and then it is less than 350Lux (the first brightness threshold), the electronic device does not switch the exposure mode of the camera. Until t8, when the ambient light brightness of curve 5 is close to 350Lux (the first brightness threshold), and then it is greater than 350Lux (the first brightness threshold), the electronic device switches the exposure mode of the camera from low-sensitivity mode to dual-sensitivity mode.

[0378] according to Figures 7A-7C In the embodiment, only the preset brightness threshold is set, such as Figure 10 The dotted line 6 is between the first brightness threshold and the second brightness threshold. Curve 5 changes near the dotted line 6 and crosses the dotted line 6 three times. Figures 7A-7C In the embodiment of the embodiment, the electronic device can control the image sensor of the camera to switch the exposure mode three times. In Example 5, by setting two brightness thresholds, the electronic device can control the image sensor of the camera to switch the exposure mode twice. Therefore, Figure 9A and Figure 9B The exposure mode switching method in the embodiment shown can reduce the number of switching times and prevent frequent switching of exposure modes. Figure 10 In the illustrated embodiment, the electronic device may determine corresponding exposure parameters by looking up a table according to the ambient light brightness, and adjust the exposure time and ISO value of the camera according to the found exposure parameters.

[0379] In the dual-sensitivity mode, the electronic device obtains images through HDR technology, and in the low-sensitivity mode, the electronic device captures images through a low-conversion-gain LCG image sensor.

[0380] As described above, the electronic device can switch exposure modes in real time during the preview process before starting to shoot a video or during the video shooting process. When switching exposure modes, the display interface of the electronic device can also prompt the user in real time the current exposure mode of the image sensor. For example, when the electronic device switches to dual-sensitivity mode, the electronic device interface can display the HDR logo.

[0381] Figure 11A and Figure 11BSchematic diagrams of application scenarios of the exposure mode switching method according to an embodiment of the present application are respectively shown. The exposure mode switching method of the embodiment of the present application is described by taking the preview process before starting to shoot a video as an example.

[0382] like Figure 11A As shown, after the electronic device switches the camera to the video shooting function in response to the user's operation, the image sensor in the camera works in the dual-sensing mode by default. Assuming that at this time, the ambient light brightness is 200 Lux, which is less than the preset brightness threshold, the electronic device does not switch the camera's exposure mode and can also obtain an image with natural motion blur, and Figure 11A In the interface shown, control 91 indicates that the HDR function is turned on, and the electronic device can obtain images (videos) with a high dynamic range.

[0383] like Figure 11B As shown in FIG, if the ambient light brightness changes, assuming that the ambient light brightness changes to 400 Lux, the electronic device controls the image sensor of the camera to switch to low-sensitivity mode. After the switch, the electronic device can obtain an image with natural motion blur. Figure 11B In the interface shown, control 91 indicates that the HDR function is turned off.

[0384] That is, during the preview process before starting to shoot a video, the state of the first control in the preview box of the display interface of the electronic device can change as the exposure mode changes.

[0385] Similarly, during the video shooting process, the preview frame of the display interface of the electronic device may also display the first control, and the state of the first control may change with the change of the exposure mode. Figure 8B In the example, the state of "HDR" changes as the exposure mode changes.

[0386] In some embodiments of the present application, the electronic device 100 can use active disturbance rejection control (ADRC) technology to adjust the dynamic range, that is, the above-mentioned GTM module and LTM module can use ADRC to process the RAW image so that the dynamic range before and after the exposure mode switching is as close as possible.

[0387] It should be noted that the data throughput rate in dual-light-sensitivity mode and low-light-sensitivity mode is the same, and the byte depth format of the data is the same, so that the ISP can complete the switch without restarting the stream. In other words, the data throughput rate and byte depth format of the dual-light-sensitivity mode and low-light-sensitivity mode saved in the configuration file are the same. In this way, when the ISP controls the camera to switch between the two modes, it can ensure that the configured data throughput rate and byte depth are the same, so there is no need to stop the original data stream and start a new data stream. From the display point of view, when switching between the two modes, it can ensure smooth and uninterrupted images.

[0388] The present application also provides another embodiment of an exposure mode switching method. In this embodiment, when determining that the current ambient light brightness is greater than or equal to a preset threshold, the electronic device may further determine whether a preset shooting scene is satisfied. The preset shooting scene may include a scene in which the electronic device is in motion or an image captured by the camera includes a moving object. If the electronic device determines that the preset shooting scene is satisfied, the image sensor of the camera may be controlled to operate in a low-sensitivity mode. If the preset shooting scene is not satisfied, the electronic device may control the image sensor of the camera to continue to maintain the dual-sensitivity mode.

[0389] In a possible implementation, the electronic device may use a motion sensor to detect whether the electronic device itself is in motion. The motion sensor may be a sensor capable of detecting the motion state of an object, such as the gyroscope sensor or acceleration sensor described above.

[0390] In one possible implementation, the electronic device in the embodiment of the present application may further include a motion detection module. The motion detection module may be a software program module that may be provided in the hardware abstraction layer described above, for example, a submodule of a camera module. The motion detection module may detect the motion state of a subject based on images captured by a camera. For example, the electronic device may detect the motion state of a subject based on multiple frames of images continuously captured by the camera.

[0391] Figure 12 FIG. 1 is a flow chart showing a method for switching exposure modes according to an embodiment of the present application. Figure 12 As shown, the exposure mode switching method of the embodiment of the present application may include the following steps:

[0392] In step S110 , the electronic device performs AEC statistics on the image captured by the camera to obtain statistical results, and determines the current ambient light brightness according to the statistical results.

[0393] In step S111, the electronic device determines whether the current ambient light brightness is greater than or equal to a preset brightness threshold. If the electronic device determines that the current ambient light brightness is less than the preset brightness threshold, the electronic device may execute step S112. If the electronic device determines that the current ambient light brightness is greater than or equal to the preset brightness threshold, the electronic device may execute step S113.

[0394] In step S112, the electronic device controls the camera's image sensor to operate in dual-light-sensing mode. Specifically, the electronic device may determine whether the camera's current exposure mode is dual-light-sensing mode. If the electronic device determines that the camera's current exposure mode is not dual-light-sensing mode, the electronic device switches the image sensor from low-light-sensing mode to dual-light-sensing mode and executes step S115 to adjust the camera's exposure parameters. The specific adjustment process can be found in the description above. The electronic device determines that the camera's current exposure mode is dual-light-sensing mode and controls the camera to continue operating in dual-light-sensing mode.

[0395] Step S113 : The electronic device determines whether the electronic device meets a preset shooting scenario.

[0396] As described above, the electronic device can detect whether the electronic device itself is in motion or whether the object being photographed by the electronic device is in motion. If any of the shooting scenarios of the electronic device itself being in motion or the object being photographed (subject) being in motion is satisfied, the electronic device can execute step S114. If the preset shooting scenario is not satisfied, that is, the electronic device itself is in a stable state and the object being photographed is also in a stable state, the electronic device can execute step S112.

[0397] In step S114, the electronic device controls the camera to operate in a low-sensitivity mode.

[0398] Specifically, it can be determined whether the current exposure mode of the camera is the low-light-sensitivity mode. If the electronic device determines that the current exposure mode of the camera is not the low-light-sensitivity mode, the electronic device switches the image sensor from the dual-light-sensitivity mode to the low-light-sensitivity mode and executes step S115 to adjust the exposure parameters of the camera. The specific adjustment process can be found in the description above. The electronic device determines that the current exposure mode of the camera is the low-light-sensitivity mode and controls the camera to continue operating in the low-light-sensitivity mode.

[0399] In step S115, the electronic device adjusts the exposure parameters of the camera. The specific process can be found in the above description.

[0400] Figure 13 A schematic diagram showing an application scenario according to an embodiment of the present application is shown in FIG. Figure 13 As shown in a in FIG, the current ambient light brightness is 200 Lux, which is less than the preset brightness threshold, and the image sensor of the electronic device is in dual-photosensitive mode. Figure 13As shown in b, the current ambient light brightness is 350 Lux, which is greater than the preset brightness threshold. The image sensor of the electronic device determines that the electronic device does not meet the preset shooting scene. For example, the electronic device determines that the electronic device is currently in a basically stationary state based on the motion sensor. The electronic device performs motion detection on the object in the image and determines that the object is in a stationary state, which does not meet the preset shooting scene. The electronic device controls the image sensor to continue working in the dual-sensitivity mode and does not need to switch modes.

[0401] and Figure 8C Comparing the examples shown, it can be seen that according to the exposure mode switching method of the above embodiment of the present application, the electronic device determines whether the preset shooting scene is satisfied. For example, the electronic device itself is in motion, or the object photographed by the electronic device is in motion, which can be collectively referred to as a motion scene. When the television device determines that the motion scene is satisfied and the ambient light brightness is relatively bright, the electronic device switches the camera to a low-sensitivity mode, and can perform exposure according to the exposure mode of the low-sensitivity mode. The exposure time is long, and natural motion blur can be produced for the motion scene. If the electronic device is not in the above-mentioned motion scene when shooting, in order to obtain a larger dynamic range, in a scene where the ambient light brightness is relatively bright, the camera can also be controlled to continue to work in the dual-sensitivity mode to improve the quality of the captured image.

[0402] Figure 14A and Figure 14B A flow chart of an exposure mode switching method according to another embodiment of the present application is shown. The method of this embodiment can still be applied to the process of shooting a video and the process of previewing before shooting a video. As shown in the figure, the exposure mode switching method of the embodiment of the present application may include the following processes: 1. Measuring the ambient light brightness, 2. Looking up the table according to the ambient light brightness to obtain exposure parameters, 3. Exposing and capturing image frames according to the exposure parameters, 4. Outputting the captured image frames to the AEC module, 5. The AEC module estimates the ambient light brightness based on the captured image frames and the exposure parameters, and outputs the estimated ambient light brightness to the exposure mode control module, 6. The exposure mode control module switches the exposure mode of the image sensor according to the estimated ambient light brightness and the switching conditions. Figure 14A and Figure 14B The "light measurement" step is marked with a dotted line. In this embodiment, light measurement can be performed once at the beginning of the method. Thereafter, the light measurement step can be omitted. Instead, the ambient light brightness output in step 5 is used as a table lookup basis to obtain exposure parameters through the table lookup, and the next round of exposure and image acquisition can be performed. That is, during the next round of capture, the electronic device can use the ambient light brightness output in step 5 to perform a table lookup to obtain exposure parameters in step 2, and then perform steps 3-6. Thereafter, steps 1-6 can be continued until the capture is complete. Thereafter, step 1 uses the ambient light brightness obtained in step 5 to obtain exposure parameters.

[0403] By adopting the exposure mode switching method of the above embodiment, the influence of bright light environment on shooting motion scenes can be further reduced.

[0404] Figure 14C Schematic diagram showing the process of shooting a video according to an embodiment of the present application. Figure 14C As shown, Figure 14C The a in the Figure 3A Example c in the example is an example of rotating the electronic device 90 degrees to the left and holding it horizontally, and the camera of the electronic device operates in dual-sensing mode.

[0405] When the electronic device receives a click operation on the first control 522 by the user, it can display Figure 14C The interface shown in b in the figure. Figure 14C As shown in b, the current ambient light brightness is 200 Lux. Assuming that the preset brightness threshold is 300 Lux, the electronic device can determine that the current ambient light brightness is less than the preset brightness threshold, and the image sensor of the camera of the electronic device operates in dual-sensing mode.

[0406] like Figure 14C As shown in c, the image sensor of the electronic device's camera operates in dual-sensitivity mode. The current ambient light brightness is 299 Lux. The electronic device obtains the exposure parameters by looking up Table 1: exposure time 1 / 50 s, ISO 100, and captures the next frame of image according to the exposure parameters.

[0407] Based on the next frame of image, the electronic device estimates that the current ambient light brightness is 300 Lux. Figure 14C As shown in d in , the estimated ambient light brightness is equal to the preset brightness threshold, and the image sensor of the electronic device's camera switches from dual-sensitivity mode to low-sensitivity mode. After switching, due to the use of low-sensitivity mode, the electronic device looks up Table 2 to obtain the exposure parameters: exposure time 1 / 50s, ISO 200. The image sensor of the electronic device uses a shutter speed of 1 / 50s to expose and capture the next frame of image. The exposure time is close to 1 / 48s, and moving objects can produce natural motion blur. The effect presented in the preview frame is close to a real motion scene, as shown in the following figure. Figure 14C As shown in e.

[0408] and Figure 8B-Figure 8D From the examples shown, it can be seen that the exposure mode switching method of this embodiment does not cause the exposure time to be suddenly shortened near the preset brightness threshold, resulting in a sharp image being captured. Instead, as the ambient light brightness changes from dark to bright, the exposure parameters can be quickly adjusted as the exposure mode is switched. When switching from dual-sensitivity mode to low-sensitivity mode, the exposure time is maintained at around 1 / 48s. When shooting motion scenes, each frame can obtain natural motion blur, and the playback is smoother.

[0409] In the embodiments of the present application, the signal-to-noise ratio of the image captured is linearly related to the exposure mode and ISO. Figure 15A A schematic diagram illustrating the relationship between the signal-to-noise ratio (SNR) of an image, the exposure mode, and the ISO according to an embodiment of the present application. Figure 15A In the figure, the horizontal axis represents ISO, the vertical axis represents signal-to-noise ratio SNR, the solid line is the curve of signal-to-noise ratio changing with ISO in DCG mode, and the dotted line is the curve of signal-to-noise ratio changing with ISO in LCG mode.

[0410] Figure 15B and Figure 15C Schematic diagrams respectively show curves of changes in the signal-to-noise ratio of an image captured according to an embodiment of the present application as the ambient light brightness changes.

[0411] like Figure 15B The curve 1502 shown in FIG. 1 shows the direction indicated by the arrow. When the camera application is opened in low light and switched to the video shooting mode, when the ambient light brightness is less than 300 Lux, the image sensor is in the dual-light sensing mode. As the ambient light brightness changes from dark to bright, the image sensor is in the dual-light sensing mode. Figure 15A The curve of the relationship between ISO and SNR in DCG mode is shown in Figure 1. As ISO decreases, SNR increases. When the ambient light brightness reaches 300 Lux, the image sensor switches to low-sensitivity mode. Figure 15A The curve of the relationship between ISO and signal-to-noise ratio in LCG mode is shown. The SNR drops suddenly, as shown in the figure. Figure 15B In the position circled by the oval dotted frame, in dual-sensitivity mode, when the ambient light brightness is 300 Lux, the corresponding ISO is 100. Figure 15A As shown in the DCG curve, the signal-to-noise ratio of ISO100 is 70. When switching to low-sensitivity mode, the corresponding ISO is 200 when the ambient light brightness is 300 Lux. Figure 15A As shown in the LCG curve, the signal-to-noise ratio corresponding to ISO200 is 64. When switching modes, the signal-to-noise ratio suddenly drops. When the ambient light brightness is near the preset brightness threshold, when the environment changes from dark to bright, the image frame captured has a sudden drop in SNR. Figure 15B As shown in curve 1501, if the exposure mode is not switched, according to Table 1, after the ambient light brightness is greater than 300 Lux, the ISO does not change and the SNR of the captured image does not change either.

[0412] In another possible implementation, Figure 15CThe curve 1504 shown in FIG. 1 shows the direction indicated by the arrow. When the camera application is opened in bright light and switched to the video shooting mode, the image sensor defaults to the dual-sensitivity mode or high-sensitivity mode. The ambient light brightness is greater than 300 Lux, assuming it is 400 Lux. Combined with Table 1 and Figure 15A As shown in the figure, in dual-sensing mode, when the ambient light brightness is 400 Lux, the ISO is 100. Figure 15A As shown in the DCG curve, the signal-to-noise ratio corresponding to ISO100 is 70. At the beginning, in the dual-sensitivity mode, the SNR of the acquired image is high. Subsequently, the image sensor switches to the low-sensitivity mode. According to Table 2, the ISO corresponding to 400 Lux in the low-sensitivity mode is 200. Therefore, Figure 15A In the LCG curve shown, when ISO is 200, the SNR of the image captured is 64. Then, as the ambient light brightness drops below 300 Lux, the image sensor switches to dual-sensitivity mode. 300 Lux corresponds to ISO 100. Figure 15A It can be seen that the SNR of the acquired image is 70. According to the above analysis process, we can get Figure 15C The curve shown in FIG. 1 shows that, in this scenario, when the ambient light changes from bright to dark, the SNR of the captured image also changes suddenly (increases). Figure 15C As shown in curve 1503, if the exposure mode is not switched, according to Table 1, when the ambient light brightness is greater than 300 Lux, the ISO does not change, and the SNR of the captured image does not change. Until the ambient light brightness is less than 300 Lux, the ISO begins to increase, and then the SNR of the captured image begins to decrease.

[0413] like Figure 15D As shown in the curve 1505, after the camera's video shooting function is turned on, the image sensor can also default to low-sensitivity mode. In this case, the ISO corresponding to 400 Lux in low-sensitivity mode is 200. Therefore, Figure 15A In the LCG curve shown, when ISO is 200, the SNR of the image captured is 64. Then, as the ambient light brightness drops below 300 Lux, the image sensor switches to dual-sensitivity mode or high-sensitivity mode. 300 Lux corresponds to ISO 100. Figure 15A It can be seen that the SNR of the captured image is 70. That is to say, in this scenario, when the ambient light brightness changes from bright to dark, the SNR of the captured image also has a sudden change (increase). Figure 15DAs shown in curve 1503, if the exposure mode is not switched, according to Table 1, when the ambient light brightness is greater than 300 Lux, the ISO does not change, and the SNR of the captured image also does not change. Until the ambient light brightness is less than 300 Lux, the ISO begins to increase, and then the SNR of the captured image begins to decrease.

[0414] Based on the above embodiments, the present application further provides a method for shooting a video, which is applied to an electronic device and includes:

[0415] The electronic device, in response to a user operation, activates a video shooting function of a camera application and displays a first interface on the display screen, the first interface including a first control and a first preview frame, the first preview frame being used to display an image captured in real time by the electronic device through the camera;

[0416] receiving a first operation on the first control;

[0417] In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video; wherein the first video includes a first image and a second image, and a capture time of the first image is earlier than a capture time of the second image;

[0418] The first image is an image captured by the electronic device using a first exposure time under a first ambient light brightness, where the first exposure time is determined by the electronic device according to the first ambient light brightness;

[0419] The second image is an image captured by the electronic device using a second exposure time under a second ambient light brightness, where the second exposure time is determined by the electronic device according to the second ambient light brightness;

[0420] The second ambient light brightness is greater than or equal to the first ambient light brightness, and the second exposure time is greater than the first exposure time.

[0421] Specifically, if Figure 8B-Figure 8D The first video can be obtained by shooting in the process of the second ambient light brightness of 300 Lux or greater, and the first ambient light brightness can be less than 300 Lux, such as 200 Lux. After the first ambient light brightness changes to the second ambient light brightness, the electronic device uses a second, longer exposure time for exposure under the second ambient light brightness. In a bright light environment, the exposure time is extended so that when the electronic device shoots a moving scene, natural motion blur can still be obtained under the second ambient light brightness, making the captured video smoother during playback.

[0422] Specifically, after the ambient light brightness changes from the first to the second, the electronic device controls the image sensor to switch the exposure mode, switching to the low-sensitivity mode under the second ambient light brightness. In the low-sensitivity mode, the image sensor's sensitivity to light is reduced, that is, the exposure time can be extended to obtain natural motion blur, so that the captured video is smoother when played.

[0423] In one possible implementation, the first video also includes a third image, and the acquisition time of the third image is earlier than the acquisition time of the first image. The third image is: under a third ambient light brightness, the electronic device uses a third exposure time to capture the image, and the third exposure time is determined by the electronic device according to the third ambient light brightness; wherein the third ambient light brightness is less than the first ambient light brightness, and the third exposure time is greater than the first exposure time.

[0424] like Figure 8B As shown in Table 1, the third ambient light brightness may be 100 Lux or 50 Lux, and the third exposure time may be less than or equal to the first exposure time. For example, the third exposure time may be 1 / 50 s or 1 / 33 s.

[0425] In one possible implementation, the camera includes an image sensor, and in response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video, including:

[0426] When acquiring the first image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image;

[0427] When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image;

[0428] The first gain is greater than the second gain.

[0429] Among them, the first light-sensing mode can be a dual light-sensing mode or a high light-sensing mode, and the second light-sensing mode can be a low light-sensing mode.

[0430] In one possible implementation, the camera includes an image sensor, and in response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video, including:

[0431] When acquiring the first image and the third image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the third image;

[0432] When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image;

[0433] The first gain is greater than the second gain.

[0434] Specifically, if Figure 8B and Figure 8C In an embodiment, after the ambient light brightness changes from the first ambient light brightness to the second ambient light brightness, the electronic device controls the image sensor to switch the exposure mode, switching to the low-sensitivity mode under the second ambient light brightness. In the low-sensitivity mode, the image sensor's sensitivity to light is reduced, that is, the exposure time can be extended to obtain natural motion blur, so that the captured video is smoother when played.

[0435] In a possible implementation, in the first light sensing mode, the electronic device controls the image sensor to use a first gain to process the captured image to obtain the first image or the third image, including:

[0436] In the first light sensing mode, the electronic device controls the image sensor to process the acquired fourth image using the first gain to obtain a first sub-image, and to process the acquired fifth image using the second gain to obtain a second sub-image;

[0437] The electronic device processes the first sub-image and the second sub-image to obtain the first image or the third image.

[0438] like Figure 6A and Figure 6B In the embodiment shown, in the dual-sensitivity mode, images in the high-sensitivity mode and the low-sensitivity mode are read out respectively, and the read-out images are fused to obtain an image in the dual-sensitivity mode.

[0439] In a possible implementation, the fourth image and the fifth image are images of the same frame captured at the same time. Figure 6B The dual circuit gain shown can obtain the fourth image and the fifth image in one exposure, and then process the fourth image and the fifth image to obtain the first sub-image and the second sub-image, and then process the first sub-image and the second sub-image to obtain the first image or the third image.

[0440] In a possible implementation, the fourth image and the fifth image are images captured at different times. Figure 6A The dual conversion gain shown can obtain the fourth image and the fifth image respectively through two exposures, then process the fourth image and the fifth image to obtain the first sub-image and the second sub-image, and then process the first sub-image and the second sub-image to obtain the first image or the third image.

[0441] In one possible implementation, the method further includes: in response to the first operation, the electronic device displays a second interface; the second interface includes a second preview box, and the second preview box is used to preview the image frames of the first video captured by the electronic device in real time, and the image frames of the first video include: the first image, the second image and the third image.

[0442] like Figure 8B-Figure 8D In the embodiment shown, the first video can be previewed in real time during the shooting process. That is, during the shooting process, the previewed image frames include the first image, the second image, and the third image. In other words, the method of the embodiment of the present application can also be applied to previewing image frames during the shooting process of a video.

[0443] In one possible implementation, the second interface includes a second control; the second control includes a first state and a second state, the first state indicates that the high dynamic range (HDR) function is turned on, and the second state indicates that the HDR function is turned off; when the first image is displayed on the second interface, the second control is in the second state; when the second image or the third image is displayed on the second interface, the second control is in the first state.

[0444] For details, please refer to Figure 8B-Figure 8D The state of the HDR controls in the .

[0445] In a possible implementation, after the electronic device captures the first image, the method further includes:

[0446] The electronic device calculates the brightness of the fourth ambient light based on the first image and the first exposure parameter when the first image is acquired; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when the first image is acquired; when the electronic device determines that the brightness of the fourth ambient light is greater than a first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensitivity mode.

[0447] In a possible implementation, before the electronic device captures the first image, the method further includes:

[0448] The electronic device uses the light metering system in the camera to measure light in real time to obtain the brightness of the first ambient light;

[0449] When the image sensor of the electronic device operates in the first light-sensing mode, the electronic device searches a first configuration file based on the first ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

[0450] In a possible implementation, after controlling the image sensor to switch to the second light sensing mode, the method further includes:

[0451] The electronic device uses the light metering system in the camera to measure light in real time to obtain the second ambient light brightness;

[0452] When the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches a second configuration file based on the second ambient light brightness to obtain second exposure parameters; the second exposure parameters include the second exposure time and the second ISO; wherein the second configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameters in the second light-sensing mode.

[0453] In a possible implementation, after the electronic device captures the third image, the method further includes:

[0454] The electronic device calculates a fifth ambient light brightness based on the third image and a third exposure parameter when acquiring the third image; wherein the third exposure parameter includes the third exposure time and a third ISO when acquiring the third image;

[0455] When the electronic device determines that the brightness of the fifth ambient light is less than a second preset brightness threshold, the electronic device controls the image sensor to switch to the first light sensing mode;

[0456] The second preset brightness threshold is less than or equal to the first preset brightness threshold.

[0457] The above Figure 4 The embodiments shown will not be described in detail.

[0458] In one possible implementation, the function of shooting video is one of the following functions: movie mode, video recording mode, and time-lapse photography mode; wherein, in the movie mode, the frame rate of the image captured by the electronic device when shooting video is 24fps.

[0459] In a possible implementation, the first interface is a preview interface after starting to shoot a video, and the first interface includes time information, and the time information is used to record the length of the shot video.

[0460] In a possible implementation, when the electronic device determines that the brightness of the fourth ambient light is greater than a first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode, including:

[0461] When the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold and the electronic device meets the preset shooting scene, the electronic device controls the image sensor to switch to the second light sensing mode; wherein, the preset shooting scene includes a scene in which the electronic device is in a moving state or the image captured by the camera includes a moving object.

[0462] In a possible implementation, the first video does not include the second image, and the first video includes a fourth image, which is an image captured by the electronic device according to a fourth exposure time when the second ambient light brightness is reached and the electronic device does not meet the preset shooting scene, and the fourth exposure time is less than or equal to the first exposure time. Figure 13 The embodiments shown will not be described in detail.

[0463] The present application also provides a method for shooting a video, which is applied to an electronic device and includes:

[0464] The electronic device, in response to a user operation, activates a video shooting function of a camera application and displays a first interface on the display screen, the first interface including a first control and a first preview frame, the first preview frame being used to display an image captured in real time by the electronic device through the camera;

[0465] receiving a first operation on the first control;

[0466] In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video;

[0467] The first video includes a first image, a second image, and a third image, and the second image is located between the first image and the third image;

[0468] The first image is an image captured by the electronic device under a first ambient light brightness, the second image is an image captured by the electronic device under a second ambient light brightness, and the third image is an image captured by the electronic device under a third ambient light brightness;

[0469] The third ambient light brightness is greater than or equal to the second ambient light brightness, the second ambient light brightness is greater than the first ambient light brightness, the signal-to-noise ratio of the first image is less than the signal-to-noise ratio of the second image, and the signal-to-noise ratio of the second image is greater than the signal-to-noise ratio of the third image.

[0470] Specific as Figure 15B and Figure 15C The embodiments shown will not be described in detail.

[0471] In a possible implementation, the acquisition time of the first image is earlier than the acquisition time of the second image, and the acquisition time of the second image is earlier than the acquisition time of the third image. Figure 15B shown.

[0472] In a possible implementation, the acquisition time of the first image is later than the acquisition time of the second image, and the acquisition time of the second image is later than the acquisition time of the third image. Figure 15C shown.

[0473] In one possible implementation, the camera includes an image sensor, and in response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video, including:

[0474] When acquiring the first image and the second image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the second image;

[0475] When acquiring the third image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the third image;

[0476] The first gain is greater than the second gain.

[0477] In a possible implementation, in the first light sensing mode, the electronic device controls the image sensor to use a first gain to process the captured image to obtain the first image or the second image, including:

[0478] In the first light sensing mode, the electronic device controls the image sensor to process the acquired fourth image using the first gain to obtain a first sub-image, and to process the acquired fifth image using the second gain to obtain a second sub-image;

[0479] The electronic device processes the first sub-image and the second sub-image to obtain the first image or the second image.

[0480] like Figure 14A and Figure 14B In the embodiment shown, in one possible implementation, after the electronic device captures the second image, the method further includes: the electronic device calculates the brightness of the fourth ambient light based on the second image and the first exposure parameter when capturing the second image; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when capturing the second image; when the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensitivity mode.

[0481] In one possible implementation, before the electronic device captures the second image, the method further includes: the electronic device calculating the fifth ambient light brightness based on the fourth image and the second exposure parameter when capturing the fourth image; wherein the fourth image is an image frame in the first video that is located before the second image; when the image sensor of the electronic device operates in the first light-sensing mode, the electronic device searches a first configuration file based on the fifth ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

[0482] In one possible implementation, after controlling the image sensor to switch to the second light-sensitive mode, the method further includes: when the image sensor of the electronic device operates in the second light-sensitive mode, the electronic device searches for a second configuration file based on the fourth ambient light brightness to obtain third exposure parameters; wherein the third exposure parameters include the third exposure time and third ISO, and the second configuration file records: in the second light-sensitive mode, the relationship between the ambient light brightness and the corresponding exposure parameters; the electronic device exposes and captures the third image according to the third exposure parameters.

[0483] An embodiment of the present application provides an electronic device, comprising: a processor, and a memory for storing instructions executable by the processor, wherein when the processor is configured to execute the instructions, the electronic device implements the above-mentioned method.

[0484] An embodiment of the present application provides a computer-readable storage medium, characterized by comprising: computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method described above.

[0485] An embodiment of the present application provides a method for shooting a video, the method being applied to an electronic device, the electronic device including a display screen and a camera, the method comprising:

[0486] The electronic device, in response to a user operation, activates a video shooting function of a camera application and displays a first interface on the display screen, wherein the first interface includes a preview frame, and the preview frame is used to display an image captured by the electronic device in real time through the camera;

[0487] The electronic device determines a first ambient light brightness, determines a first exposure time according to the first ambient light brightness, performs exposure according to the first exposure time to acquire a first image, and displays the first image in the preview frame;

[0488] The electronic device determines a second ambient light brightness, determines a second exposure time according to the second ambient light brightness, performs exposure according to the second exposure time to acquire a second image, and displays the second image in the preview frame;

[0489] The second ambient light brightness is greater than or equal to the first ambient light brightness, and the second exposure time is greater than the first exposure time.

[0490] Specifically, if Figure 8B-Figure 8D The first video can be obtained by shooting in the process of the second ambient light brightness of 300 Lux or greater, and the first ambient light brightness can be less than 300 Lux, such as 200 Lux. After the first ambient light brightness changes to the second ambient light brightness, the electronic device uses a second, longer exposure time for exposure under the second ambient light brightness. In a bright light environment, the exposure time is extended so that when the electronic device shoots a moving scene, natural motion blur can still be obtained under the second ambient light brightness, making the captured video smoother during playback.

[0491] In a possible implementation, after the electronic device turns on the video shooting function of the camera application and before acquiring the first image, the method further includes: the electronic device determining a third ambient light brightness, determining a third exposure time according to the third ambient light brightness, exposing according to the third exposure time to acquire a third image, and displaying the third image in the preview frame; wherein the third ambient light brightness is less than the first ambient light brightness, and the third exposure time is greater than or equal to the first exposure time. Figure 8B As shown in Table 1, the third ambient light brightness may be 100 Lux or 50 Lux, and the third exposure time may be less than or equal to the first exposure time. For example, the third exposure time may be 1 / 50 s or 1 / 33 s.

[0492] In one possible implementation, the camera includes an image sensor. When acquiring the first image, the image sensor of the electronic device is in a first light-sensitive mode; in the first light-sensitive mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image; when acquiring the second image, the image sensor of the electronic device is in a second light-sensitive mode; in the second light-sensitive mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image; wherein the first gain is greater than the second gain.

[0493] In one possible implementation, the camera includes an image sensor. When acquiring the first image and the third image, the image sensor of the electronic device is in a first light-sensitive mode; in the first light-sensitive mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the third image; when acquiring the second image, the image sensor of the electronic device is in a second light-sensitive mode; in the second light-sensitive mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image; wherein, the first gain is greater than the second gain.

[0494] Specifically, if Figure 8B and Figure 8C In an embodiment, after the ambient light brightness changes from the first ambient light brightness to the second ambient light brightness, the electronic device controls the image sensor to switch the exposure mode, switching to the low-sensitivity mode under the second ambient light brightness. In the low-sensitivity mode, the image sensor's sensitivity to light is reduced, that is, the exposure time can be extended to obtain natural motion blur, so that the captured video is smoother when played.

[0495] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for shooting a video, characterized in that: The method is applied to an electronic device, and includes: In response to a user operation, the electronic device activates a video shooting function of a camera application and displays a first interface on a display screen, the first interface including a first control and a first preview frame, the first preview frame being used to display an image captured in real time by the electronic device through the camera; receiving a first operation on the first control; In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video; wherein the first video includes a first image and a second image, and a capture time of the first image is earlier than a capture time of the second image; The first image is an image captured by the electronic device using a first exposure time under a first ambient light brightness, where the first exposure time is determined by the electronic device according to the first ambient light brightness; The second image is an image captured by the electronic device using a second exposure time under a second ambient light brightness, where the second exposure time is determined by the electronic device according to the second ambient light brightness; The second ambient light brightness is greater than or equal to the first ambient light brightness, and the second exposure time is greater than the first exposure time.

2. The method according to claim 1, characterized in that The first video also includes a third image, and the acquisition time of the third image is earlier than the acquisition time of the first image. The third image is an image captured by the electronic device using a third exposure time under a third ambient light brightness, where the third exposure time is determined by the electronic device according to the third ambient light brightness; The third ambient light brightness is smaller than the first ambient light brightness, and the third exposure time is larger than the first exposure time.

3. The method according to claim 1 or 2, characterized in that The camera includes an image sensor, In response to the first operation, the electronic device continuously captures multiple frames of images through a camera to obtain a first video, including: When acquiring the first image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image; When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image; The first gain is greater than the second gain.

4. The method according to claim 2, characterized in that The camera includes an image sensor, In response to the first operation, the electronic device continuously captures multiple frames of images through a camera to obtain a first video, including: When acquiring the first image and the third image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the third image; When acquiring the second image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the second image; The first gain is greater than the second gain.

5. The method according to claim 4, characterized in that In the first light sensing mode, the electronic device controls the image sensor to use a first gain to process the captured image to obtain the first image or the third image, including: In the first light sensing mode, the electronic device controls the image sensor to process the acquired fourth image using the first gain to obtain a first sub-image, and to process the acquired fifth image using the second gain to obtain a second sub-image; The electronic device processes the first sub-image and the second sub-image to obtain the first image or the third image.

6. The method according to claim 5, characterized in that The fourth image and the fifth image are images of the same frame captured at the same time.

7. The method according to claim 5, characterized in that The fourth image and the fifth image are images captured at different times.

8. The method according to claim 2, characterized in that The method further comprises: In response to the first operation, the electronic device displays a second interface; the second interface includes a second preview box, which is used to preview the image frames of the first video taken by the electronic device in real time, and the image frames of the first video include: the first image, the second image and the third image.

9. The method according to claim 8, characterized in that The second interface includes a second control; the second control includes a first state and a second state, the first state indicates that the high dynamic range (HDR) function is turned on, and the second state indicates that the HDR function is turned off; When the first image is displayed on the second interface, the second control is in the second state; When the second image or the third image is displayed on the second interface, the second control is in the first state.

10. The method according to claim 3, characterized in that After the electronic device captures the first image, the method further includes: The electronic device calculates the brightness of the fourth ambient light according to the first image and a first exposure parameter when the first image is acquired; wherein the first exposure parameter includes the first exposure time and the first sensitivity ISO when the first image is acquired; When the electronic device determines that the brightness of the fourth ambient light is greater than a first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode.

11. The method according to claim 10, characterized in that Before the electronic device captures the first image, the method further includes: The electronic device uses the light metering system in the camera to measure light in real time to obtain the brightness of the first ambient light; When the image sensor of the electronic device operates in the first light-sensing mode, the electronic device searches a first configuration file based on the first ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

12. The method according to claim 10, characterized in that After controlling the image sensor to switch to the second light sensing mode, the method further includes: The electronic device uses the light metering system in the camera to measure light in real time to obtain the second ambient light brightness; When the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches a second configuration file according to the second ambient light brightness to obtain second exposure parameters; the second exposure parameters include the second exposure time and the second ISO; The second configuration file records the relationship between the ambient light brightness and the corresponding exposure parameters in the second light-sensing mode.

13. The method according to claim 10, characterized in that After the electronic device captures the third image, the method further includes: The electronic device calculates a fifth ambient light brightness based on the third image and a third exposure parameter when acquiring the third image; wherein the third exposure parameter includes the third exposure time and a third ISO when acquiring the third image; When the electronic device determines that the brightness of the fifth ambient light is less than a second preset brightness threshold, the electronic device controls the image sensor to switch to the first light sensing mode; The second preset brightness threshold is less than or equal to the first preset brightness threshold.

14. The method according to any one of claims 1-2 and 4-13, characterized in that: The video shooting function is one of the following functions: movie mode, video mode, time-lapse photography mode; Wherein, in the movie mode, the frame rate of the image captured by the electronic device when shooting video is 24fps.

15. The method according to any one of claims 1-2 and 4-13, characterized in that: The first interface is a preview interface after starting to shoot a video. The first interface includes time information, and the time information is used to record the length of the shot video.

16. The method according to claim 11, characterized in that When the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold, the electronic device controls the image sensor to switch to the second light sensing mode, including: When the electronic device determines that the brightness of the fourth ambient light is greater than the first preset brightness threshold and the electronic device meets the preset shooting scene, the electronic device controls the image sensor to switch to the second light sensing mode; The preset shooting scene includes a scene in which the electronic device is in a moving state or an image captured by the camera includes a moving object.

17. The method according to claim 16, characterized in that The first video does not include the second image, and the first video includes a fourth image, which is an image captured by the electronic device according to a fourth exposure time under the second ambient light brightness and when the electronic device does not meet the preset shooting scene, and the fourth exposure time is less than or equal to the first exposure time.

18. A method for shooting a video, characterized in that: The method is applied to an electronic device, and includes: In response to a user operation, the electronic device activates a video shooting function of a camera application and displays a first interface on a display screen, the first interface including a first control and a first preview frame, the first preview frame being used to display an image captured in real time by the electronic device through the camera; receiving a first operation on the first control; In response to the first operation, the electronic device continuously captures multiple frames of images through the camera to obtain a first video; The first video includes a first image, a second image, and a third image, and the second image is located between the first image and the third image; The first image is an image captured by the electronic device under a first ambient light brightness, the second image is an image captured by the electronic device under a second ambient light brightness, and the third image is an image captured by the electronic device under a third ambient light brightness; In which, the brightness of the third ambient light is greater than or equal to the brightness of the second ambient light, the brightness of the second ambient light is greater than the brightness of the first ambient light, the signal-to-noise ratio of the first image is less than the signal-to-noise ratio of the second image, the signal-to-noise ratio of the second image is greater than the signal-to-noise ratio of the third image, and the exposure time used by the electronic device when capturing the third image is greater than the exposure time used by the electronic device when capturing the second image.

19. The method according to claim 18, characterized in that The acquisition time of the first image is earlier than the acquisition time of the second image, and the acquisition time of the second image is earlier than the acquisition time of the third image.

20. The method according to claim 18, wherein The acquisition time of the first image is later than the acquisition time of the second image, and the acquisition time of the second image is later than the acquisition time of the third image.

21. The method according to any one of claims 18 to 20, characterized in that: The camera includes an image sensor, In response to the first operation, the electronic device continuously captures multiple frames of images through a camera to obtain a first video, including: When acquiring the first image and the second image, the image sensor of the electronic device is in a first light-sensing mode; in the first light-sensing mode, the electronic device controls the image sensor to use a first gain to process the acquired image to obtain the first image or the second image; When acquiring the third image, the image sensor of the electronic device is in a second light-sensing mode; in the second light-sensing mode, the electronic device controls the image sensor to use a second gain to process the acquired image to obtain the third image; The first gain is greater than the second gain.

22. The method according to claim 21, characterized in that In the first light sensing mode, the electronic device controls the image sensor to use a first gain to process the captured image to obtain the first image or the second image, including: In the first light sensing mode, the electronic device controls the image sensor to process the acquired fourth image using the first gain to obtain a first sub-image, and to process the acquired fifth image using the second gain to obtain a second sub-image; The electronic device processes the first sub-image and the second sub-image to obtain the first image or the second image.

23. The method according to claim 19, wherein The camera includes an image sensor. After the electronic device captures the second image, the method further includes: The electronic device calculates the brightness of the fourth ambient light based on the second image and a first exposure parameter when acquiring the second image; wherein the first exposure parameter includes a first exposure time and a first sensitivity ISO when acquiring the second image; When the electronic device determines that the brightness of the fourth ambient light is greater than a first preset brightness threshold, the electronic device controls the image sensor to switch to a second light sensing mode.

24. The method according to claim 23, wherein Before the electronic device captures the second image, the method further includes: The electronic device calculates a fifth ambient light brightness based on a fourth image and a second exposure parameter when the fourth image is acquired; wherein the fourth image is an image frame in the first video that is located before the second image; When the image sensor of the electronic device operates in a first light-sensing mode, the electronic device searches a first configuration file based on the fifth ambient light brightness to obtain the first exposure parameter; wherein the first configuration file records: the relationship between the ambient light brightness and the corresponding exposure parameter in the first light-sensing mode.

25. The method according to claim 23, wherein After controlling the image sensor to switch to the second light sensing mode, the method further includes: When the image sensor of the electronic device operates in the second light-sensing mode, the electronic device searches a second configuration file based on the fourth ambient light brightness to obtain third exposure parameters; wherein the third exposure parameters include a third exposure time and a third ISO, and the second configuration file records: a relationship between ambient light brightness and corresponding exposure parameters in the second light-sensing mode; The electronic device performs exposure according to the third exposure parameter to capture the third image.

26. An electronic device, characterized in that: The electronic device comprises: a processor and a memory for storing instructions executable by the processor, wherein when the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 1 to 17.

27. A computer-readable storage medium, characterized in that include: Computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 17.

28. An electronic device, characterized in that: The electronic device comprises: a processor and a memory for storing instructions executable by the processor, wherein when the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 18 to 25.

29. A computer-readable storage medium, characterized in that include: Computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 18 to 25.

Images