A shooting method and related equipment

Abstract

The present application discloses a shooting method and related equipment. According to the method, after starting to record a video, the electronic device can continuously capture multiple frames of images. During the process of the electronic device continuously capturing multiple frames of images, on the one hand, the electronic device can maintain the exposure time at half of the frame interval corresponding to the first frame rate, without changing, wherein the first frame rate is the frame rate at which the electronic device captures video frames during the video recording process. On the other hand, the electronic device can adjust the sensitivity and / or pixel sensitivity according to the ambient brightness. Through this method, the electronic device can maintain the image capture based on the appropriate exposure time, so that when the image captured by the electronic device is not overexposed or underexposed, the video recorded by the electronic device is played more smoothly, avoiding the sense of stuttering caused by the lack of motion blur.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a shooting method and related equipment. Background Art

[0002] Video is a continuous picture composed of a series of images, and each of these images is called a frame, also known as a video frame. When the human eye watches a video, each frame of the video will have visual afterimages. Visual afterimage is a special phenomenon of the human eye and brain processing light signals, which allows the image seen by the human eye to remain for a period of time after it disappears.

[0003] When shooting a video of a fast-moving or changing object, the captured image may have blurred dragging traces, that is, motion blur. When watching the captured video later, the blurred dragging traces in the images that make up the video will improve the smoothness of watching the video. Motion blur is related to the exposure time used when capturing the image. Too long exposure time will cause a sense of dragging, and too short exposure time will cause a sense of lag. That is, the length of exposure time will affect the subsequent user experience when watching the video. The exposure time needs to be set to an appropriate value to give users a smooth experience when watching the video. Summary of the invention

[0004] The present application provides a shooting method and related equipment. According to the shooting method, in a bright light scene, the electronic device can avoid overexposure of the captured image by reducing the photoelectric conversion rate of the image sensor of the camera instead of reducing the exposure time, while keeping the exposure time unchanged so that there is natural motion blur in the captured image, thereby improving the smoothness of the captured video.

[0005] In a first aspect, the present application provides a shooting method. The method can be applied to an electronic device provided with a camera. The method may include: the electronic device may receive a first instruction, and in response to the first instruction, the electronic device may continuously capture multiple frames of images through the camera; the electronic device may receive a second instruction, and in response to the second instruction, the electronic device may save a first video. The first video may include a first image and a second image. The first image is: an image captured by the electronic device based on a first exposure time, a first sensitivity and a first pixel sensitivity under a first ambient brightness. The second image is: an image captured by the electronic device based on a first exposure time, a second sensitivity and a second pixel sensitivity under a second ambient brightness. Among them, the first ambient brightness is less than the second ambient brightness; the first exposure time is half of the frame interval corresponding to the first frame rate; the first frame rate is the frame rate used by the electronic device when capturing images constituting the first video; the first pixel sensitivity is greater than the second pixel sensitivity; the pixel sensitivity is used to characterize the photoelectric conversion rate of the image sensor in the camera.

[0006] In the solution provided by the present application, the electronic device can keep the exposure time at half of the frame interval corresponding to the frame rate used to capture the video frame during the video recording process, and when the ambient brightness changes, the captured image can be neither overexposed nor underexposed by adjusting the sensitivity and / or pixel sensitivity. Among them, the pixel sensitivity can be used to characterize the photoelectric conversion rate of the image sensor in the camera.

[0007] It can be understood that the images constituting the first video are the video frames collected during this shooting process. The first frame rate can also be understood as the frame rate used by the electronic device when collecting video frames during this shooting process.

[0008] It is understandable that the first instruction can be used to trigger the electronic device to start recording a video. In some embodiments of the present application, the electronic device receives the first instruction, which can specifically include: the electronic device detects that the control acting on the video start control (for example, Figure 4C In some other embodiments of the present application, the electronic device receives the first instruction, which may specifically include: the electronic device detects that the user operates on the time-lapse photography start control (for example, Figure 5B User operation on the time-lapse photography start control 119) in the user interface 1e shown.

[0009] It is understandable that the second instruction is used to trigger the electronic device to stop recording the video. In some embodiments of the present application, the electronic device receives the second instruction, which may specifically include: the electronic device detects that the control acting on the video end (for example, Figure 4D In some other embodiments of the present application, the electronic device receives the second instruction, which may specifically include: the electronic device detects that the user operates on the time-lapse photography end control (for example, Figure 5E 122).

[0010] In some embodiments of the present application, the first exposure time may be ET1, and the first frame rate may be F1.

[0011] It is understandable that the present application does not limit the order in which the electronic device captures the first image and the second image. In some embodiments of the present application, the electronic device captures the first image earlier than the second image. After the electronic device captures the first image, it can determine the target sensitivity and target pixel sensitivity for capturing the second image as the second sensitivity and the second pixel sensitivity, respectively, based on the current ambient brightness, and capture the second image based on the first exposure time, the second sensitivity, and the second pixel sensitivity. Specifically, the electronic device can capture the original image based on the first exposure time, the second sensitivity, and the second pixel sensitivity, and obtain the second image after processing the original image.

[0012] In some embodiments of the present application, the first video may be a video captured in a normal frame rate video recording scenario. For example, Video1. In this case, the first image and the second image may be V1 and V2. In a case where the electronic device captures the first image earlier than the second image, the first image may be V1, the second image may be V2, the first exposure time, the first sensitivity, and the first pixel sensitivity may be ET1, ISO1, and U1, respectively, and the second sensitivity and the second pixel sensitivity may be the first target ISO and the first target pixel sensitivity, respectively.

[0013] In some other embodiments of the present application, the first video may be a video captured in a low frame rate video recording scenario. For example, Video 2. In this case, at the moment of capturing the first image, shooting parameter 1 includes a first exposure time, a first sensitivity, and a first pixel sensitivity, and at the moment of capturing the second image, shooting parameter 1 includes a first exposure time, a second sensitivity, and a second pixel sensitivity.

[0014] In some embodiments of the present application, the first sensitivity and the second sensitivity are the same.

[0015] In combination with the first aspect, in a possible implementation manner, the second environment brightness is not less than the first environment brightness threshold, and the second sensitivity is not greater than the first sensitivity.

[0016] In some embodiments provided in the present application, in bright light scenes, the electronic device can keep the exposure time and sensitivity unchanged, and control the collected image to be not overexposed by adjusting the pixel sensitivity. In this way, the collected image is not overexposed and has less noise.

[0017] In some embodiments of the present application, the second environment brightness is not less than the first environment brightness threshold, and the first environment brightness is not less than the first environment brightness threshold, and the second sensitivity is the same as the first sensitivity.

[0018] In some embodiments of the present application, the second environment brightness is not less than the first environment brightness threshold, and the first environment brightness is less than the first environment brightness threshold, and the second sensitivity is less than the first sensitivity.

[0019] In some embodiments of the present application, the first ambient brightness threshold may be ambient brightness threshold 2.

[0020] In combination with the first aspect, in a possible implementation, the first video may further include a third image. The third image may be: an image captured by the electronic device under a third ambient brightness by exposure based on the first exposure time, the third sensitivity, and the third pixel sensitivity. The third ambient brightness is less than the first ambient brightness, the first ambient brightness is less than the first ambient brightness threshold, the third sensitivity is greater than the first sensitivity, and the third pixel sensitivity is the same as the first pixel sensitivity.

[0021] In some embodiments provided in the present application, in a non-bright light scene (for example, a dark light scene), the electronic device can keep the exposure time and pixel sensitivity unchanged, and control the captured image to avoid underexposure by adjusting the sensitivity.

[0022] In combination with the first aspect, in a possible implementation, the first frame rate is not less than the first frame rate threshold. The electronic device continuously captures multiple frames of images through a camera, which may specifically include: under a first ambient brightness, the electronic device may acquire a first original image through a camera based on a first exposure time, a first sensitivity, and a first pixel sensitivity; under a second ambient brightness, the electronic device may acquire a second original image through a camera based on a first exposure time, a second sensitivity, and a second pixel sensitivity. After the electronic device acquires the first original image, the method may further include: the electronic device may process the first original image to obtain a first image and a fourth image, save the first image, and display the fourth image on a display screen; after the electronic device acquires the second original image, the method may further include: the electronic device may process the second original image to obtain a second image and a fifth image, save the second image, and display the fifth image on a display screen.

[0023] In some embodiments provided in the present application, in a normal frame rate video recording scenario, after the electronic device captures a frame of original image, a preview frame and a video frame can be obtained respectively. In this case, the electronic device only needs to adjust the shooting parameters used when capturing the original image to control the electronic device.

[0024] In some embodiments of the present application, each time an electronic device captures a frame of original image, it can process a frame of video frame, but not each time an original image frame is captured, it can process a frame of preview frame. The frame rate at which the electronic device displays the preview frame on the display screen can be lower than the frame rate at which the electronic device captures the original image. This approach can reduce power consumption.

[0025] In some embodiments of the present application, the first original image may be RAW1, the first image may be V1, the fourth image may be Y1, the second original image may be RAW2, the second image may be V2, and the fifth image may be Y2.

[0026] In some embodiments of the present application, the first frame rate threshold may be frame rate threshold 1.

[0027] In combination with the first aspect, in a possible implementation, the first frame rate is less than the second frame rate threshold. The electronic device continuously acquires multiple frames of images through a camera, which may specifically include: the electronic device may acquire S frames of original images based on the second exposure time between each acquisition of two adjacent frames of images in the first video. In the process of acquiring images constituting the first video, under the first ambient brightness, the electronic device may acquire the first original image through the camera based on the first exposure time, the first sensitivity and the first pixel sensitivity, and under the second ambient brightness, the electronic device may acquire the second original image through the camera based on the first exposure time, the second sensitivity and the second pixel sensitivity. The method may also include: after the electronic device acquires the first original image, the first original image may be processed to obtain and save the first image; after the electronic device acquires the second original image, the second original image may be processed to obtain and save the second image; after the electronic device acquires each frame of the S frame original image, each frame of the S frame original image may be processed, and the processed image may be displayed on the display screen. Among them, the second exposure time is half of the frame interval corresponding to the second frame rate, and the second frame rate is the frame rate at which the electronic device displays the image on the display screen. S is an integer greater than 1.

[0028] In some embodiments provided in the present application, the electronic device can capture video frames based on a set of shooting parameters (for example, shooting parameter 1), and capture preview frames based on another set of shooting parameters (for example, shooting parameter 2) in the interval between capturing two adjacent video frames, and the two sets of shooting parameters include different exposure times. In other words, between each capture of two adjacent frames of images in the first video by the electronic device, S frames of original images can be acquired based on other exposure times, and then S frames of preview frames can be obtained. In this way, the electronic device can capture video frames at a suitable exposure time so that there is natural motion blur in the video frames, thereby making the captured video play smoothly, and can also capture preview frames at a suitable exposure time so that the electronic device can smoothly display the preview frames on the display screen.

[0029] In some embodiments of the present application, the second frame rate threshold may be frame rate threshold 1. In some further embodiments of the present application, the second frame rate threshold may be frame rate threshold 2.

[0030] In some embodiments of the present application, the second exposure time may be ET2, and the second frame rate may be F2.

[0031] In some embodiments of the present application, the second exposure time may be a preview frame rate of 3.

[0032] In some embodiments of the present application, after the electronic device captures the first original image based on the shooting parameter 1, it can determine the shooting parameter 2 according to the current ambient brightness, and capture S frames of original images based on the shooting parameter 2. In the process of capturing the S frames of original images based on the shooting parameter 2, the electronic device can adjust the sensitivity and pixel sensitivity in the shooting parameter 2 according to the ambient brightness.

[0033] In some embodiments of the present application, when the electronic device captures one or more frames of images in the first video, the pixel sensitivity used has reached the minimum pixel sensitivity, that is, the minimum value of the pixel sensitivity range. In this case, when the ambient brightness continues to increase, the electronic device can reduce the exposure time and capture the video frame with an exposure time lower than the second exposure time.

[0034] It is understandable that after the electronic device captures the first original image, it can capture S frames of original images. Each time the electronic device captures one frame of the S frames of original images, it can process the frame of original image to obtain a preview frame, and send it to the display screen for display. After capturing the last frame of the S frames of original images (i.e., the Sth frame of original image), the electronic device can display the preview frame obtained by processing the Sth frame of original image, and capture the second original image. It is understandable that in the process of capturing the second original image, the electronic device can always display the preview frame obtained by processing the Sth frame of original image on the display screen.

[0035] In combination with the first aspect, in a possible implementation, when the first remainder is not less than 0.5, S may be the sum of the first value and 1, and when the first remainder is less than 0.5, S may be the first value. The first remainder is the remainder obtained by dividing the first exposure time by the frame interval corresponding to the second frame rate. The first value is the quotient obtained by dividing the first exposure time by the frame interval corresponding to the second frame rate.

[0036] In some embodiments provided in the present application, the electronic device may capture preview frames based on the second frame rate between capturing two adjacent video frames. Specifically, the electronic device may determine the number of preview frames (i.e., S) that can be captured within the frame interval by capturing the frame interval between two adjacent video frames.

[0037] It can be understood that the first remainder is the remainder obtained by dividing the first duration by the frame interval corresponding to the second frame rate. The first duration is the difference between the frame interval of two adjacent video frames collected by the electronic device and the first exposure time. Since the first exposure time is half of the frame interval of two adjacent video frames collected, the first duration is equal to the first exposure time.

[0038] In combination with the first aspect, in a possible implementation, the z1th frame original image among the S frame original images acquired by the electronic device through the camera based on the second exposure time is: the original image acquired by the electronic device based on the second exposure time, the fourth sensitivity and the fourth pixel sensitivity under the fourth ambient brightness. The z2th frame original image among the S frame original images acquired by the electronic device through the camera based on the second exposure time is: the original image acquired by the electronic device based on the second exposure time, the fifth sensitivity and the fifth pixel sensitivity under the fifth ambient brightness. It can be understood that the z1th frame original image is any frame image among the S frame original images. z1 is a positive integer not greater than S. The z2th frame original image is any frame image among the S frame original images. z2 is a positive integer not greater than S, and z1 is not equal to z2. The fourth ambient brightness is less than the fifth ambient brightness, and the fourth pixel sensitivity is greater than the fifth pixel sensitivity.

[0039] In some embodiments provided in the present application, in a low frame rate video recording scenario, when the electronic device collects S-frame preview frames, the sensitivity and pixel sensitivity in shooting parameter 2 can be adjusted based on the current ambient brightness, so that the collected preview frames are not overexposed. It can be understood that the adjustment method for the sensitivity and pixel sensitivity in shooting parameter 1 can refer to the adjustment method for the sensitivity and pixel sensitivity in a normal frame rate video recording scenario, and the details can be referred to in the afternoon, which will not be repeated here.

[0040] It can be understood that the sensitivity and pixel sensitivity in the shooting parameters (for example, shooting parameter 2) adopted by the electronic device when capturing the z1th original image in the S frame original image are the fourth sensitivity and the fourth pixel sensitivity, respectively, and the sensitivity and pixel sensitivity in the shooting parameters adopted by the electronic device when capturing the z2th original image in the S frame original image are the fifth sensitivity and the fifth pixel sensitivity, respectively.

[0041] It can be understood that the present application does not limit the order in which the electronic device collects the z1th frame original image and the z2th frame original image in the S frame original image. In some embodiments of the present application, the electronic device collects the z1th frame original image earlier than the z2th frame original image. In this case, the fifth sensitivity can be the third target ISO, and the fifth pixel sensitivity can be the third target pixel sensitivity. In some other embodiments of the present application, the electronic device collects the z1th frame original image later than the z2th frame original image. In this case, the fourth sensitivity can be the third target ISO, and the fourth pixel sensitivity can be the third target pixel sensitivity.

[0042] In combination with the first aspect, in a possible implementation manner, the fifth environment brightness is not less than the second environment brightness threshold, and the fourth sensitivity is not less than the fifth sensitivity.

[0043] In some embodiments provided in the present application, during the process of the electronic device capturing the S-frame original image, if the ambient brightness is less than a second ambient brightness threshold, the electronic device can keep the exposure time and sensitivity unchanged, and control the captured preview frame to be neither overexposed nor underexposed by adjusting the pixel sensitivity.

[0044] In some embodiments of the present application, the second ambient brightness threshold may be ambient brightness threshold 3.

[0045] In combination with the first aspect, in a possible implementation, the z3th frame original image in the S frame original image acquired by the electronic device through the camera based on the second exposure time is: the original image acquired by the electronic device based on the second exposure time, the sixth sensitivity and the sixth pixel sensitivity under the sixth ambient brightness. The z3th frame original image is any frame image in the S frame original image. z3 is a positive integer not greater than S, and z3 is not equal to the z2, and z3 is not equal to z1. The sixth ambient brightness is less than the fourth ambient brightness, and the fourth ambient brightness is less than the second ambient brightness threshold, the sixth sensitivity is greater than the fourth sensitivity, and the sixth pixel sensitivity is the same as the fourth pixel sensitivity.

[0046] In some embodiments provided in the present application, during the process of the electronic device capturing the S-frame original image, if the ambient brightness is less than a second ambient brightness threshold, the electronic device can keep the exposure time and pixel sensitivity unchanged, and control the captured preview frame to be neither overexposed nor underexposed by adjusting the sensitivity.

[0047] In combination with the first aspect, in a possible implementation, the first instruction is an instruction for the first control. Before the electronic device receives the first instruction, the method may further include: the electronic device may receive a third instruction, and in response to the third instruction, the electronic device may open a camera application and start the camera to display the first interface. The first interface may include a preview window and a first control, and the preview window displays the sixth image and the seventh image in sequence. The sixth image is: an image captured by the electronic device based on the third exposure time, the seventh sensitivity and the seventh pixel sensitivity under the seventh ambient brightness. The seventh image is: an image captured by the electronic device based on the third exposure time, the eighth sensitivity and the eighth pixel sensitivity under the eighth ambient brightness. Among them, the seventh ambient brightness is less than the eighth ambient brightness, the third exposure time is half of the frame interval corresponding to the third frame rate, the third frame rate is the frame rate at which the electronic device displays the image on the display screen, and the seventh pixel sensitivity is greater than the eighth pixel sensitivity.

[0048] In some embodiments provided in the present application, the electronic device may also maintain an exposure time of half the frame interval corresponding to the preview frame rate in a preview scenario, so that there is natural motion blur in the captured preview frame, thereby making the picture displayed on the display screen of the electronic device smoother.

[0049] In some embodiments of the present application, the first control may be a control for starting recording. Figure 4C The video recording start control 107 in the user interface 1c shown. In some other embodiments of the present application, the first control may be a time-lapse photography start control. Figure 5B A time-lapse photography start control 119 is shown in the user interface 1e.

[0050] It is understandable that the third instruction can be used to trigger the electronic device to open the camera application and start the camera. In some embodiments of the present application, the electronic device receives the third instruction, which can specifically include: the electronic device detects that the camera application icon (for example, Figure 4A User operation on the camera application icon 101) shown.

[0051] In some embodiments of the present application, the preview window may be as follows: Figure 4C-4D , Figure 5B-5E Preview window 106 is shown.

[0052] In some embodiments of the present application, the third exposure time may be ET3, and the third frame rate may be F3. It is understandable that the second frame rate and the third frame rate may be frame rates at which the electronic device displays images on the display screen in different scenarios. For example, the second frame rate may be the frame rate at which the electronic device displays images on the display screen after the electronic device starts recording, i.e., the preview frame rate in the recording scenario, and the third frame rate may be the frame rate at which the electronic device displays images on the display screen before the electronic device starts recording, i.e., the preview frame rate in the preview scenario.

[0053] In some embodiments of the present application, the third exposure time may be a preview frame rate of 1. In some further embodiments of the present application, the third exposure time may be a preview frame rate of 2.

[0054] In some embodiments of the present application, the eighth sensitivity may be the fourth target ISO, and the eighth pixel sensitivity may be the fourth target pixel sensitivity.

[0055] In combination with the first aspect, in a possible implementation, when the second environment brightness is greater than the first environment brightness threshold, the electronic device, in the process of acquiring the second image, may specifically include: the electronic device may acquire a fifth original image based on the first exposure time, the second sensitivity, and the second pixel sensitivity after one exposure, and acquire a sixth original image based on the fourth exposure time, the second sensitivity, and the second pixel sensitivity; the electronic device may process the fifth original image and the sixth original image to acquire the second image. The ratio of the first exposure time to the fourth exposure time is e, and e is an integer greater than 1.

[0056] In some embodiments provided in the present application, when the electronic device adopts the SHDR mode, the sensitivity and pixel sensitivity used when capturing long exposure frames and short exposure frames can be kept the same, and the exposure time ratio is e, so as to obtain motion blur information from the long exposure frames while ensuring the dynamic range, thereby making the final video smoother during playback.

[0057] In some embodiments of the present application, the first image may be a long exposure frame, and the second image may be a short exposure frame.

[0058] In combination with the first aspect, in a possible implementation, after the electronic device saves the first video, the method may further include: the electronic device receives a fourth instruction, and in response to the fourth instruction, the electronic device plays the first video at a first frame rate.

[0059] In some embodiments provided in the present application, the frame rate at which the electronic device captures video frames is equal to the frame rate at which the video captured and played by the electronic device is captured.

[0060] In the second aspect, the present application provides a shooting method. The method can be applied to an electronic device provided with a camera. The method may include: the electronic device may receive a third instruction, and in response to the third instruction, the electronic device may open a camera application and start the camera to display a first interface. The first interface may include a preview window and a first control, and the preview window displays a sixth image and a seventh image in sequence. The sixth image is: an image captured by the electronic device based on the third exposure time, the seventh sensitivity and the seventh pixel sensitivity under the seventh ambient brightness. The seventh image is: an image captured by the electronic device based on the third exposure time, the eighth sensitivity and the eighth pixel sensitivity under the eighth ambient brightness. Among them, the seventh ambient brightness is less than the eighth ambient brightness, the third exposure time is half of the frame interval corresponding to the third frame rate, the third frame rate is the frame rate at which the electronic device displays the image on the display screen, and the seventh pixel sensitivity is greater than the eighth pixel sensitivity.

[0061] In combination with the second aspect, in a possible implementation manner, the eighth ambient brightness is not less than the third ambient brightness threshold, and the eighth sensitivity is not greater than the seventh sensitivity.

[0062] In some embodiments provided in the present application, in a bright light scene under a preview scene, the electronic device can adjust the pixel sensitivity to ensure that the captured image is neither overexposed nor underexposed.

[0063] In some embodiments of the present application, the third ambient brightness threshold may be ambient brightness threshold 1.

[0064] In combination with the second aspect, in a possible implementation, the method may further include: the electronic device displays an eighth image through a preview window. The eighth image is: an image captured by the electronic device under a ninth ambient brightness by exposure based on a third exposure time, a ninth sensitivity, and a ninth pixel sensitivity. The ninth ambient brightness is less than the seventh ambient brightness, and the seventh ambient brightness is less than the third ambient brightness threshold, the ninth sensitivity is greater than the seventh sensitivity, and the ninth pixel sensitivity is the same as the seventh pixel sensitivity.

[0065] In some embodiments provided in the present application, in a non-bright light scene under a preview scene, the electronic device can adjust the sensitivity to ensure that the captured image is neither overexposed nor underexposed.

[0066] In a third aspect, the present application provides an electronic device, comprising: a camera, one or more processors, and one or more memories; the camera is coupled to the one or more memories and the one or more processors, the photoelectric conversion rate of the image sensor in the camera is adjustable, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method described in the first aspect or any one of the implementations of the first aspect.

[0067] In a fourth aspect, the present application provides an electronic device, comprising: a camera, one or more processors, and one or more memories; the camera is coupled to the one or more memories and the one or more processors, the photoelectric conversion rate of the image sensor in the camera is adjustable, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method described in the second aspect or any one of the implementations of the second aspect.

[0068] In a fifth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0069] In a sixth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the second aspect or any one of the implementations of the second aspect.

[0070] In the seventh aspect, an embodiment of the present application provides a chip, which can be applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0071] In an eighth aspect, an embodiment of the present application provides a chip, which can be applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute the method described in the second aspect or any one of the implementations of the second aspect.

[0072] In a ninth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0073] In the tenth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the second aspect or any one of the implementations of the second aspect.

[0074] It can be understood that the electronic device provided in the third aspect, the computer storage medium provided in the fifth aspect, the chip provided in the seventh aspect, and the computer program product provided in the ninth aspect are all used to execute the method described in the first aspect or any one of the implementations of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation of the first aspect, which will not be repeated here. The electronic device provided in the fourth aspect, the computer storage medium provided in the sixth aspect, the chip provided in the eighth aspect, and the computer program product provided in the tenth aspect are all used to execute the method described in the second aspect or any one of the implementations of the second aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation of the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] Figure 1A A relationship between adjacent images acquired at different frame rates and the same exposure time provided in an embodiment of the present application;

[0076] Figure 1B A relationship between adjacent images acquired at the same frame rate and different exposure times provided in an embodiment of the present application;

[0077] Figure 2A A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0078] Figure 2B A schematic diagram of the structure and working principle of a pixel in the image sensor provided in an embodiment of the present application;

[0079] Figure 3 A schematic diagram of a preview frame acquisition frame rate and a video frame acquisition frame rate provided in an embodiment of the present application;

[0080] Figure 4A-4F A set of user interface schematic diagrams provided for embodiments of the present application;

[0081] Figure 5A-5F A set of user interface schematic diagrams provided for embodiments of the present application;

[0082] Figure 6 A flowchart of a shooting method provided in an embodiment of the present application;

[0083] Fig. 7A A flowchart of a specific implementation method of a shooting method provided in an embodiment of the present application;

[0084] Figure 7B A flowchart of a specific implementation method of another shooting method provided in an embodiment of the present application;

[0085] Fig. 8A A schematic diagram of an image captured by an electronic device provided in an embodiment of the present application;

[0086] Figure 8B An enlarged view of an image captured by an electronic device provided in an embodiment of the present application;

[0087] Fig. 9A A schematic diagram of an image captured by another electronic device provided in an embodiment of the present application;

[0088] Fig. 9B An enlarged view of an image captured by another electronic device provided in an embodiment of the present application;

[0089] Fig.10 A schematic diagram of a process flow in a low frame rate video recording scenario provided in an embodiment of the present application;

[0090] Fig.11 A flowchart of another shooting method provided in an embodiment of the present application;

[0091] Fig.12 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0092] Fig.13 A software and hardware interaction diagram provided for an embodiment of the present application. DETAILED DESCRIPTION

[0093] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0094] It should be understood that the terms "first", "second", etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0095] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0096] It is understood that the term "user interface" in the specification, claims and drawings of this application refers to the medium interface for interaction and information exchange between an application or operating system and a user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where a control may include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0097] The following describes the relationship between the frame rate used to capture images, exposure time, motion blur, and playback smoothness.

[0098] 1. The relationship between frame rate and playback smoothness (or stuttering)

[0099] If an electronic device uses the same exposure time to shoot a video, the smaller the frame rate used when capturing images, the longer the time from the completion of the exposure of one frame to the start of the exposure of the next frame. This means that in adjacent images captured by the electronic device, the distance between moving subjects will be larger, resulting in a sense of stuttering when playing the captured video.

[0100] It is understood that the subject refers to the object of the photo (e.g., an object, a person, etc.). The subject involved in this application refers to the subject of the photo, and does not necessarily include all the content that the electronic device can capture. In some embodiments of this application, the subject may be an object or a person in motion. For example, a falling football, a moving vehicle, a person walking or running, etc.

[0101] It can be understood that the unit of frame rate is fps, which stands for frames per second, and its Chinese meaning is frames per second.

[0102] See also Figure 1A , Figure 1A An embodiment of the present application provides a relationship between adjacent images captured at different frame rates and the same exposure time.

[0103] like Figure 1A As shown in (1), when the frame rate used by the electronic device to capture images when shooting a video is 8fps, 24fps, and 60fps, the frame intervals are 1 / 8s, 1 / 24s, and 1 / 60s, respectively, and the intervals between the moment when each frame image is exposed and the moment when the next frame image begins to be exposed are t1, t2, and t3, respectively. If the exposure time used by the electronic device at the above different frame rates is the same, then t1>t2>t3, which means that when the frame rate used to capture images when shooting a video is 8fps, the distance between the subjects in the adjacent images captured by the electronic device on their motion trajectory is farther.

[0104] Take the example of an electronic device using different frame rates (the frame rate here refers to the frame rate used to collect images) and the same exposure time to shoot the falling process of a football, such as Figure 1A As shown in (2), when the electronic device shoots video at a frame rate of 8fps, based on the first and second frames of images captured by the electronic device, it can be obtained that during the process of the electronic device capturing the first and second frames of images, the distance the football falls is d1. Similarly, when the frame rate used by the electronic device to shoot video is 24fps, based on the first and second frames of images captured by the electronic device, it can be obtained that during the process of the electronic device capturing the first and second frames of images, the distance the football falls is d2. Similarly, when the frame rate used by the electronic device to shoot video is 60fps, based on the first and second frames of images captured by the electronic device, it can be obtained that during the process of the electronic device capturing the first and second frames of images, the distance the football falls is d3. According to Figure 1A In (2), d1>d2>d3. This means that compared with the stuttering sensation when playing videos captured at 60fps and 24fps, the stuttering sensation when the electronic device plays videos captured at 8fps is more obvious.

[0105] according to Figure 1A When the frame rate used by the electronic device to capture images when shooting video is equal to the frame rate of the captured video when it is played, the greater the frame rate used by the electronic device to capture images when shooting video, the greater the frame rate of the captured video when it is played, and the smoother the video is played, and the less likely it is to experience a sense of stuttering. Conversely, the smaller the frame rate used by the electronic device to capture images when shooting video, the smaller the frame rate of the captured video when it is played, and the less smooth the video is played, and the more likely it is to experience a sense of stuttering.

[0106] 2. The relationship between exposure time, motion blur and smooth playback (or stuttering)

[0107] Persistence of vision causes motion blur. When the camera captures each frame, the exposure time will affect the blur effect of the captured image. If the electronic device uses the same frame rate to capture images when shooting a video, the longer the exposure time, the greater the motion blur, that is, the longer the blur traces in the image captured by the electronic device. A certain degree of motion blur can improve the smoothness of video playback.

[0108] See also Figure 1B , Figure 1B An embodiment of the present application provides a relationship between adjacent images captured at the same frame rate and different exposure times.

[0109] like Figure 1B As shown in (1), when the frame rate used by the electronic device to shoot a video is 24fps, the frame interval is 1 / 24s. The electronic device can use different exposure times to shoot the video at this frame rate. For example, Figure 1B As shown in (1), the electronic device can shoot video at a frame rate of 24fps using two exposure times, 1 / 100s and 1 / 50s.

[0110] Take the example of an electronic device using the same frame rate (the frame rate here refers to the frame rate used to collect images) and different exposure times to shoot the falling process of a football, such as Figure 1B As shown in (2), when the electronic device uses a 24fps frame rate to shoot a video, compared with the image captured with an exposure time of 1 / 100s, the falling football in the image captured with an exposure time of 1 / 50s has natural motion blur, that is, a natural trailing image is produced. This means that in the video shot with an exposure time of 1 / 50s, the falling footballs in adjacent images are better "connected", and the falling process of the footballs in adjacent images is more coherent. When playing the video shot with an exposure time of 1 / 50s, the falling football in the video seen by the human eye is closer to the falling football seen by the real human eye, with no obvious sense of lag, and is relatively smooth.

[0111] It is understandable that the smoothness of video playback is related to the frame rate and exposure time used to capture the image. Using a suitable frame rate and exposure time to capture images can make the captured video play smoothly without lag.

[0112] According to the above, when users use electronic devices such as mobile phones and tablets to shoot videos, using appropriate exposure time to shoot can increase the smoothness of the video taken. However, in bright light scenes (i.e., the ambient brightness is large), in order to ensure normal exposure and avoid overexposure, the electronic device will shorten the exposure time, resulting in the exposure time being much less than the above-mentioned appropriate exposure time. Exemplarily, Table 1 shows the shooting parameters corresponding to different ambient brightness in a 25fps video recording scene. As shown in Table 1, once the ambient brightness reaches 300 lux, the electronic device no longer maintains the exposure time at 1 / 50s, but shortens the exposure time to 1 / 200s, and, when the ambient brightness continues to increase from 300lux, the exposure time will become shorter and shorter. According to the above, the shorter the exposure time, the more it can capture the instantaneous state of the moving object, and the smaller the motion blur. Therefore, the motion blur of the image collected in the bright light scene is small, that is, the blurred dragging traces of the image collected in the bright light scene are not obvious. Moreover, according to the above, due to the short exposure time, the image captured by the electronic device when shooting the video reflects the motion state of the subject in a short time, so when the frame interval used when capturing the image remains unchanged, the motion state of the subject reflected by the adjacent images captured by the electronic device is the motion state of the subject with a longer interval. The above reasons will cause the video shot in bright light scenes to play unsmoothly, or even produce a sense of freeze.

[0113] Table 1

[0114]

[0115] Based on the above, the present application provides a shooting method. The shooting method can be applied to an electronic device including one or more cameras. The image sensor in the one or more cameras may include a photoelectric conversion module with an adjustable photoelectric conversion rate. According to the shooting method, in a bright light scene, the electronic device can reduce the photoelectric conversion rate through the image sensor in the camera, so that while avoiding overexposure, the exposure time can be kept at a suitable value without changing, so that there is natural motion blur in the captured image. This method can improve the smoothness of the video captured and reduce the sense of freeze.

[0116] The following first introduces the hardware structure of the electronic device involved in this application.

[0117] Figure 2A A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0118] like Figure 2A As shown, the electronic device may include: a processor, a mobile communication module, a wireless communication module, an audio module, a speaker, a receiver, a microphone, an earphone interface, an internal memory, an external memory interface, a sensor module, a Subscriber Identity Module (SIM) card slot, a display screen, a camera, a button, and a Universal Serial Bus (USB) interface, etc. Among them, the sensor module may include: a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0119] The structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device. In some embodiments of the present application, the electronic device may include more components than those shown in the figure. For example, other types of sensors. For example, a charging management module, a power management module, a battery, a motor, an indicator, etc. In some embodiments of the present application, the electronic device may include fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device.

[0120] The processor may include one or more processing units, for example, the processor may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a codec (e.g., a video codec), a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, a codec (codec) can be used to transform a signal or a data stream. A memory may also be provided in the processor for storing instructions and data.

[0121] The electronic device can realize the display function through a GPU, a display screen, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor may include one or more GPUs, which execute program instructions to generate or change display information. The display screen is used to display images, videos, etc. In some embodiments, the electronic device may include one or more display screens.

[0122] The camera is used to capture static images or videos. The ISP is used to process the data fed back by the camera. The camera may include a lens and an image sensor. The image sensor is a photosensitive element. Light is transmitted to the image sensor through the lens, and the light signal is converted into an electrical signal. The image sensor then transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0123] It is understandable that the image sensor mentioned in the present application may be a semiconductor chip, including but not limited to a charge coupled device (CCD) and a complementary metal oxide (CMOS).

[0124] To facilitate understanding of the present application, the structure of the image sensor and pixel involved in the present application, as well as their working principle are described in detail below.

[0125] The image sensor may include a pixel array and a readout circuit. The pixel array is composed of individual pixels, which correspond to the individual pixels in the image captured by the camera that the user sees. The readout circuit may include an analog to digital converter (ADC). The analog to digital converter can be used to convert an analog signal into a digital signal.

[0126] Taking CMOS as an example, the working principle of CMOS is as follows: (1) Photons enter the photodiode, and the photodiode absorbs the energy of the photons and is excited to produce electrons; (2) The electrons are output to the potential well; (3) An analog voltage signal is generated at both ends of the potential well; (4) The analog voltage signal is analog-amplified using a programmable gain amplifier to obtain an amplified voltage signal; (5) The amplified voltage signal is input into the analog circuit, and the amplified voltage signal is further amplified based on the analog gain (Analog Gain, AG) in the analog circuit; (6) The further amplified voltage signal is converted into analog-to-digital; (7) The digital signal is input into the digital circuit, and the digital signal is amplified based on the digital gain (Digital Gain, DG) in the digital circuit.

[0127] See also Figure 2B , Figure 2B The structure and working principle of a pixel in an image sensor are shown.

[0128] like Figure 2B As shown, the pixel may include a photoelectric conversion module, a potential well and a signal amplifier. The photoelectric conversion module may be used to convert photons into electrons. These electrons are output to the potential well, and voltage signals are generated at both ends of the potential well. The signal amplifier may be used to further amplify the voltage signal generated at both ends of the potential well. The gain generated by the signal amplifier inside the pixel may be understood as the conversion gain inside the pixel.

[0129] like Figure 2B As shown, photons can be converted into electrons through the photoelectric conversion module, and the electrons are then output to the potential well, and a voltage signal is generated at both ends of the potential well. The voltage signal is an analog signal. The voltage signal is amplified by the signal amplifier and output to the readout circuit, and is converted into a digital signal by the analog-to-digital converter in the readout circuit.

[0130] In some embodiments of the present application, the photoelectric conversion module in the pixel can adjust the photoelectric conversion rate, that is, the ratio of photons converted to electrons. The greater the photoelectric conversion rate, the higher the sensitivity of the image sensor. In the present application, the photoelectric conversion rate is characterized by pixel sensitivity. The greater the pixel sensitivity, the greater the photoelectric conversion rate.

[0131] In some embodiments of the present application, the photoelectric conversion rate may refer to quantum efficiency (QE). Quantum efficiency is the ratio of the average number of photoelectrons generated per unit time to the number of incident photons at a specific wavelength (e.g., 520 nanometers). It is understood that the present application may also use other parameters to describe the photoelectric conversion capability of the image sensor, and the present application does not limit this.

[0132] In some embodiments of the present application, the photoelectric conversion module may be a photodiode.

[0133] It should be noted that each pixel in the pixel array of the image sensor can be Figure 2B In some embodiments of the present application, a single pixel in a pixel array can be read out. In some embodiments of the present application, the pixel array can be read out by row / column. It is understood that the present application does not impose any specific restrictions on the readout method of the pixel array.

[0134] It is understandable that the electronic device may include one or more cameras. In some embodiments of the present application, the electronic device may include a main camera (i.e., main camera) and a secondary camera. In simple terms, the main camera refers to the camera that is mainly responsible for shooting, which is generally used to capture the subject (i.e., the subject of shooting) for daily shooting. The main camera has a wide range of applications and can be used in most shooting scenes. The secondary camera is generally used to assist in shooting, and the secondary camera can be used to supplement the image brightness and details, as well as special shooting scenes such as long-distance shooting and wide-angle shooting. In one possible implementation, the main camera may be a wide-angle camera (wide camera), and the secondary camera may be a telephoto camera (tele camera) or an ultra-wide camera. A wide camera usually refers to a wide-angle lens, which refers to a lens with a larger field of view. Shooting with a wide camera can capture a wide picture. A tele camera usually refers to a telephoto lens, which refers to a lens with a smaller field of view. Shooting with a tele camera can make the subject look farther and magnified. An ultra-wide camera is a lens with a larger field of view than a wide-angle camera, and an ultra-wide camera is usually used to shoot scenes within a wider field of view.

[0135] In some embodiments of the present application, the photoelectric conversion module in the main camera of the electronic device can adjust the photoelectric conversion rate, while the photoelectric conversion rate of the photoelectric conversion module in the secondary camera is certain. In this case, when the electronic device uses the main camera to capture images, it can change its corresponding pixel sensitivity, that is, to achieve the adjustment of the photoelectric conversion rate, and when the electronic device uses the secondary camera to capture images, it cannot change its corresponding pixel sensitivity, and its corresponding pixel sensitivity is a fixed value (for example, 1). In some embodiments of the present application, the photoelectric conversion modules in the main camera and the secondary camera of the electronic device can adjust the photoelectric conversion rate. In this case, whether the electronic device uses the main camera to capture images or the secondary camera to capture images, the electronic device can change the corresponding pixel sensitivity to achieve the adjustment of the photoelectric conversion rate.

[0136] The internal memory may include one or more RAMs and one or more non-volatile memories (NVMs). The RAM can be directly read and written by the processor, and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, and can also be used to store user and application data, etc. The NVM can also store executable programs and user and application data, etc., and can be loaded into the RAM in advance for direct reading and writing by the processor.

[0137] In the embodiment of the present application, the code for implementing the shooting method described in the embodiment of the present application may be stored in a non-volatile memory. When running the camera application, the electronic device may load the executable code stored in the non-volatile memory into the random access memory.

[0138] The external memory interface can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device.

[0139] Electronic devices can implement audio functions through audio modules, speakers, receivers, microphones, headphone jacks, and application processors.

[0140] The audio module is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal. The speaker, also known as the "horn", is used to convert audio electrical signals into sound signals. The receiver, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack is used to connect wired headphones.

[0141] A touch sensor is also called a "touch control device". The touch sensor can be set on a display screen. The touch sensor and the display screen form a touch screen, also called a "touch control screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen. In other embodiments, the touch sensor can also be set on the surface of the electronic device, which is different from the position of the display screen.

[0142] It is understandable that the meaning and function of other sensors can be referred to the relevant technical documents and will not be elaborated here.

[0143] The electronic device can realize the communication function with other devices through the mobile communication module and the wireless communication module.

[0144] The mobile communication module can provide wireless communication solutions including 2G / 3G / 4G / 5G, etc. applied in electronic devices.

[0145] The wireless communication module can provide wireless communication solutions including wireless local area network (WLAN) (for example, wireless fidelity network, referred to as Wi-Fi network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc., which are applied to electronic devices. The wireless communication module can be one or more devices integrating at least one communication processing module. The wireless communication module can receive electromagnetic waves via antenna 2, or convert signals into electromagnetic waves for radiation.

[0146] In some embodiments of the present application, the electronic device can measure the amount of incoming light through a light metering system. The light metering system works similarly to an image sensor, that is, converting light signals into electronic signals, which are then transmitted to a chip processor for calculation.

[0147] In some embodiments of the present application, the electronic device may be provided with a light metering system. The light metering system may be used to determine the ambient brightness and the ambient dynamic range. The light metering system may be used to measure the brightness of light reflected by the subject, i.e., reflective light metering. The light metering system may include a light metering element, and the electronic device may automatically measure the amount of light entering through the light metering element to obtain the ambient brightness.

[0148] In order to facilitate understanding of the embodiments of the present application, the shooting parameters involved in the present application are introduced below.

[0149] 1. Exposure time and sensitivity

[0150] Exposure is a very important part of photography. It determines how much light the photosensitive element can capture when acquiring an image. In other words, exposure determines the brightness (brightness and darkness) of the image. During the exposure process, the exposure time (shutter speed), aperture size, and sensitivity will specifically affect the brightness of the image. These three factors that affect exposure can be called exposure parameters.

[0151] Exposure time, also known as shutter speed, can be measured in seconds (s). The shorter the exposure time, the darker the image. The longer the exposure time, the brighter the image. Aperture is a device in the lens that controls the size of the hole that allows light to enter the camera, represented by F. The number after F is inversely proportional to the aperture size. The larger the aperture, the larger the aperture, so the amount of light entering will increase, so the brightness of the picture will increase. On the contrary, the smaller the aperture, the less light enters, so the brightness of the picture will decrease.

[0152] In the film era, ISO (International Standards Organization) is an internationally unified indicator for measuring the speed of film used in traditional cameras. The sensitivity is determined by the film purchased, and the value is fixed. It is a property of the film itself. In other words, in the film era, ISO is used to reflect the sensitivity of film to light. It can be considered that ISO affects the intensity of ambient light obtained by the photosensitive element. However, the photosensitive elements of electronic devices such as digital cameras and mobile phones (for example, image sensors CCD or COMS) do not change after packaging. For these electronic devices, ISO no longer represents the sensitivity of the photosensitive element to light, but the electronic signal amplification gain value. When ISO increases, the amplification gain of the electronic signal increases, the original signal is amplified, and the image becomes brighter.

[0153] It is understandable that the aperture size in electronic devices such as mobile phones is usually fixed. Therefore, electronic devices can change the brightness of the image obtained by exposure by adjusting the exposure time and ISO.

[0154] It should be noted that the ISO value that can be set by the electronic device is limited by the hardware (for example, the image sensor), that is, the ISO value that can be set by the electronic device is within a certain range. For the sake of ease of description, this application refers to the range of ISO that can be set by the electronic device as the sensitivity range. It is understandable that the sensitivity range can be set according to actual needs and hardware level, and this application does not limit this. For example, the sensitivity range can be: 100 to 25600 (including 100 and 25600).

[0155] 2. Pixel sensitivity

[0156] Pixel sensitivity can be used to characterize the photoelectric conversion rate. The greater the pixel sensitivity, the greater the photoelectric conversion rate.

[0157] It is understood that the maximum value of the pixel sensitivity can be 1, and the minimum value is determined by the photoelectric conversion module in the electronic device. For example, the minimum value of the pixel sensitivity can be 1 / 1000. In some embodiments of the present application, the photosensitive material in the photoelectric conversion module can determine the range of the pixel sensitivity that can be adjusted by the electronic device.

[0158] In some embodiments of the present application, the electronic device may set the default pixel sensitivity to 1. The default pixel sensitivity is the pixel sensitivity used by the electronic device by default after the camera application is turned on.

[0159] In one possible implementation, the pixel sensitivity is the photoelectric conversion rate. For example, when the pixel sensitivity is 1, the photoelectric conversion rate is 1. In another possible implementation, there is a certain conversion relationship between the pixel sensitivity and the photoelectric conversion rate. For example, the pixel sensitivity is proportional to the photoelectric conversion rate. Of course, the conversion relationship can also be other, and the present application does not limit this.

[0160] It should be noted that the value of the pixel sensitivity that can be set by the electronic device is also limited by the hardware (for example, the photosensitive material in the photoelectric conversion module), that is, the value of the pixel sensitivity that can be set by the electronic device is within a certain range. For the sake of ease of description, this application refers to the range of pixel sensitivity that can be set by the electronic device as the pixel sensitivity range. It can be understood that the pixel sensitivity range can be set according to actual needs and hardware level, and this application does not limit this. For example, the pixel sensitivity range can be: 1 / 1000 to 1 (including 1 / 1000 and 1).

[0161] To facilitate understanding of the embodiments of the present application, several frame rates with different meanings involved in the present application are introduced below.

[0162] 1. The frame rate of the original image captured during shooting, the frame rate of the preview frame captured during shooting, and the frame rate of the video frame captured during shooting

[0163] The frame rate of the original image captured during shooting refers to: the frame rate used by the electronic device to capture the original image during shooting, that is, the number of original images obtained by the electronic device through exposure per second.

[0164] It can be understood that the original image refers to the RAW image. The RAW image is the original data that the image sensor such as CMOS or CCD converts the captured light source signal into a digital signal, also known as the original image file.

[0165] In some embodiments of the present application, after an electronic device obtains a frame of original image after one exposure, it can process the frame of original image to obtain a preview frame and / or a video frame. The preview frame refers to an image displayed on a display screen for user viewing during shooting, and the video frame refers to an image saved in the video obtained by shooting.

[0166] In some embodiments of the present application, a preview frame and a video frame can be obtained from a frame of the original image. In this case, the frame rate at which the electronic device captures the preview frame when shooting (i.e., the number of preview frames captured by the electronic device per unit time) and the frame rate at which the electronic device captures the video frame when shooting (i.e., the number of video frames captured by the electronic device per unit time) are the same, and are both equal to the frame rate at which the electronic device captures the original image.

[0167] In a possible implementation, the preview frame and the video frame obtained by processing a frame of original image are not completely the same. In this case, the processing performed by the electronic device on the frame of original image is two not completely the same processing. For example, after the electronic device performs different processing on the original image, it can obtain an image with a resolution of 720px*720px and an image with a resolution of 1080px*1080px, and send the image with a resolution of 720px*720px to the display screen for display, while saving the image with a resolution of 1080px*1080px. Among them, the image with a resolution of 720px*720px is a preview frame, and the image with a resolution of 1080px*1080px is a video frame. It can be understood that the full name of px is Pixel, which means pixel in Chinese and is the smallest unit for representing a picture or graphic.

[0168] In a possible implementation, the preview frame obtained by processing a frame of original image is the same as the video frame. Specifically, after the electronic device obtains a frame of original image through one exposure, it can process the frame of original image to obtain a processed image, send the processed image to a display screen for display, and save the processed image as an image in the captured video.

[0169] In some embodiments of the present application, only one preview frame or one video frame can be obtained from one original image frame. In this case, the frame rate of the preview frame captured by the electronic device when shooting is not necessarily the same as the frame rate of the video frame captured by the electronic device when shooting, but both are less than the frame rate of the original image captured by the electronic device.

[0170] In a possible implementation, within a period of time, the electronic device can collect m frames of original images, and the (m-1) frame of the original image in the m frames can be sent to the display screen for display after processing, and the other 1 frame of the original image in the m frames can be saved after processing as an image in the captured video. It can be understood that m is an integer not less than 2. Among them, the (m-1) frame of the original image and the other 1 frame of the original image in the m frames are images captured based on different shooting parameters.

[0171] 2. Preview frame rate during shooting (can be referred to as preview frame rate for short)

[0172] The preview frame rate during shooting refers to: the frame rate at which the image is displayed through the display screen while the corresponding interface of the camera application is displayed after the electronic device opens the camera application, that is, the number of frames of the image (i.e., preview frames) displayed on the display screen per second while the corresponding interface of the camera application is displayed after the electronic device opens the camera application.

[0173] It should be noted that, in some embodiments of the present application, the preview frame rate of the electronic device when shooting is the frame rate at which the preview frames are captured when the electronic device is shooting. That is, the number of preview frames captured per second when the electronic device is shooting is the same as the number of images displayed on the display screen when shooting.

[0174] It can be understood that the preview frame rate during shooting can include preview frame rates in two scenarios, one is the preview frame rate after recording starts, and the other is the preview frame rate before recording starts, that is, the frame rate of the image displayed on the display screen in the preview scenario.

[0175] 3. Frame rate of video playback (can be referred to as video playback frame rate, or video frame rate)

[0176] The frame rate during video playback refers to: the frame rate used by an electronic device to play a video, that is, the number of images (ie, video frames) displayed on a display screen per second when the electronic device plays a video.

[0177] It is understandable that the frame rate of the video during playback may be the same as or different from the frame rate of the video frames captured by the electronic device during shooting. In other words, the number of images saved per second in the video during shooting by the electronic device may be the same as or different from the number of images displayed per second during playback of the captured video. The images saved in the video mentioned in this application may also be understood as images saved in the corresponding video file.

[0178] It is understandable that the frame rate of the original image captured by the electronic device during shooting can be the same as or different from the frame rate of the video during playback. It is understandable that the frame rate of the original image captured by the electronic device during shooting can be the same as or different from the preview frame rate during shooting.

[0179] For example, Figure 3 As shown, the frame rate of the original image captured by the electronic device during shooting can be 60fps. That is, the electronic device can capture 60 frames of original images within 1 second, and the difference between the exposure time of the electronic device when capturing adjacent original images is 1 / 60 second, that is, the frame interval of the original image captured by the electronic device is 1 / 60 second.

[0180] In one possible implementation, Figure 3As shown in (1), the electronic device collects 60 frames of original images per second, and processes each frame of original images after collecting them, and can obtain a preview frame (i.e., an image sent to the display screen for display) and a video frame (i.e., an image that constitutes the video). This means that the electronic device can transmit 60 frames of images to the display screen for display per second, that is, the preview frame rate of the electronic device when shooting is 60fps, and the electronic device can save 60 frames of images per second as images in the captured video. If the video captured by the electronic device is played at the frequency when the video frame is saved, the frame rate of the captured video when it is played is also 60fps.

[0181] In another possible implementation, Figure 3 As shown in (2), the electronic device collects 60 frames of original images per second, and processes each frame of original image after collecting it to obtain a frame of video frame. However, not every frame of original image can obtain a frame of preview frame. Specifically, after the electronic device processes the collected i-th frame of original image, it can obtain a frame of preview frame and a frame of video frame. After the electronic device processes the collected i+1-th frame of original image, it only obtains a frame of video frame. After the electronic device processes the collected i+2-th frame of original image, it can obtain a frame of preview frame and a frame of video frame. It can be understood that i is a positive integer not less than 1. This means that the electronic device can transmit 30 frames of images per second to the display screen for display, that is, the preview frame rate of the electronic device when shooting is 30fps, and the electronic device can save 60 frames of images per second as images in the captured video. If the video captured by the electronic device is played at the frequency when the video frame is saved, the frame rate of the captured video when playing is 60fps.

[0182] In another possible implementation, Figure 3 As shown in (3), the electronic device collects 60 frames of original images per second. After collecting each frame of original image, it processes it to obtain a preview frame. However, not every frame of original image can obtain a video frame. Specifically, after the electronic device processes the collected i-th frame of original image, it can obtain a preview frame and a video frame. After the electronic device processes the collected i+1-th frame of original image, it only obtains a preview frame. After the electronic device processes the collected i+2-th frame of original image, it can obtain a preview frame and a video frame. This means that the electronic device can transmit 60 frames of images per second to the display screen for display, that is, the preview frame rate of the electronic device when shooting is 60fps, and the electronic device can save 30 frames of images per second as images in the captured video. If the video captured by the electronic device is played at the frequency when the video frame is saved, the frame rate of the captured video when playing is 30fps.

[0183] The following introduces two shooting scenes provided by this application.

[0184] 1. Normal frame rate video recording scenario

[0185] The normal frame rate video recording scenario refers to: video recording performed when the frame rate of the video frames captured by the electronic device during shooting is not less than the frame rate threshold 1.

[0186] In some embodiments of the present application, in a normal frame rate video recording scenario, the frame rate of the video frames captured by the electronic device when shooting is equal to the frame rate of the captured video when it is played.

[0187] It can be understood that the normal frame rate video recording scene may include a video recording scene in a normal video recording mode.

[0188] The following introduces the normal frame rate video recording scenario involved in this application by taking the example of shooting the falling process of a football in normal video recording mode.

[0189] (1) The electronic device enters normal recording mode (such as Figure 4A-4C shown).

[0190] See also Figure 4A , Figure 4A A schematic diagram of a user interface with application icons provided in an embodiment of the present application.

[0191] like Figure 4A As shown, the user interface 1a displays a page with application icons, which may include multiple application icons (for example, weather application icon, calendar application icon, album application icon, note application icon, email application icon, application store application icon, setting application icon, etc.). A page indicator may also be displayed below the multiple application icons to indicate the positional relationship between the currently displayed page and other pages. There are multiple tray icons (for example, camera application icon 101, browser application icon, information application icon, dial application icon) below the page indicator. The tray icon can remain displayed when the page is switched.

[0192] It is understandable that the camera application icon 101 is an icon of a camera application (which may be referred to as a camera application or a camera). The camera application icon 101 may be used to trigger the start of a camera application. A camera application is an application for taking pictures on electronic devices such as smartphones and tablets, and this application does not limit the name of the application.

[0193] The electronic device may detect a user operation on the camera application icon 101. In response to the user operation, the electronic device may start the camera application and display a Figure 4BThe user interface 1 b shown in FIG. 1 may include a navigation bar 102 , an album shortcut control 103 , a camera flip control 104 , and a shutter control 105 .

[0194] The navigation bar 102 may display one or more shooting mode options. The one or more shooting mode options may include: a night scene mode option, a portrait mode option, a photo mode option, a video mode option 1021, and a more mode option 1022. Among them, the shooting mode corresponding to the photo mode option is the photo mode, the shooting mode corresponding to the video mode option 1021 is the normal video mode, and the more mode option 1022 may include more shooting mode options. It is understandable that the one or more shooting mode options may be displayed as text information on the interface, such as "night scene", "portrait", "photo", "video", "more", and may also be displayed as icons or other forms of interactive elements (IE), which are not limited in this application.

[0195] It is understandable that after the camera application is turned on, the electronic device may display the preview interface in the photo mode by default (such as Figure 4B User interface 1b) shown.

[0196] The album quick control 103 can be used to open the album application. The camera flip control 104 can be used to switch the camera used for shooting, for example, switching the rear camera to the front camera, or switching the front camera to the rear camera. The shutter control 105 can be used to monitor the user operation that triggers the photo.

[0197] Electronic devices can detect the effects of Figure 4B In response to the user operation, the electronic device may display the following information: Figure 4C The user interface 1c shown in (1) in FIG. 1 is a preview interface in the normal video recording mode before recording is started. The user interface 1c may include a preview window 106, a video recording start control 107, and a setting option control 108. The preview window 106 may be used to display a preview frame captured by the electronic device. The video recording start control 107 may be used to trigger video recording. The setting option control 108 may be used to trigger the electronic device to display setting options related to video recording (such as Figure 4F For example, video resolution, video frame rate, etc.

[0198] (2) In normal video recording mode, when recording has not started, the electronic device maintains the exposure time at half the frame interval corresponding to the preview frame rate 1, and adjusts the pixel sensitivity according to the ambient brightness, so that the image displayed on the display screen is smooth and not overexposed (e.g. Figure 4C). Preview frame rate 1 is the preview frame rate in normal video mode before recording starts.

[0199] When the electronic device has entered the normal recording mode but has not started recording (that is, the electronic device is in the preview state in the normal recording mode), the electronic device can maintain the exposure time as half of the frame interval corresponding to the preview frame rate 1, and based on the exposure time, collect preview frames, and then display the collected preview frames on the display screen. It can be understood that the electronic device collects preview frames, which can specifically include: the electronic device can collect original images, and process the original images to obtain preview frames. It can be understood that the preview frame rate 1 is the frame rate of the image displayed on the display screen when the electronic device is in the normal recording mode and has not started recording.

[0200] In some embodiments of the present application, when the electronic device has entered the normal video recording mode but has not started recording, the electronic device can keep the exposure time unchanged, that is, keep the exposure time still half of the frame interval corresponding to the preview frame rate 1, determine the current ambient brightness, and determine the target ISO and target pixel sensitivity based on the current ambient brightness, and then capture the preview frame based on the exposure time, target ISO and target pixel sensitivity. In this way, regardless of whether the ambient brightness increases or decreases, the preview frames captured by the electronic device can contain natural motion blur, and there will be no lack of motion blur in the captured preview frames due to shortening the exposure time due to increased ambient brightness, and the picture displayed on the display screen will not be stuck due to lack of motion blur. It can be understood that the frame interval corresponding to the frame rate refers to the reciprocal of the frame rate.

[0201] It can be understood that there is a corresponding relationship between ambient brightness, ISO and pixel sensitivity.

[0202] In some embodiments of the present application, the corresponding relationship includes a corresponding relationship between a specific brightness value and a pixel sensitivity. In this case, the target pixel sensitivity refers to the pixel sensitivity corresponding to the specific brightness value closest to the current ambient brightness in the corresponding relationship. In some embodiments of the present application, the corresponding relationship includes a corresponding relationship between a brightness range and a pixel sensitivity. In this case, the target pixel sensitivity refers to the pixel sensitivity corresponding to the brightness range to which the current ambient brightness belongs.

[0203] Similarly, in some embodiments of the present application, the corresponding relationship includes a corresponding relationship between a specific brightness value and an ISO. In this case, the target ISO refers to the ISO corresponding to the specific brightness value closest to the current ambient brightness in the corresponding relationship. In some embodiments of the present application, the corresponding relationship includes a corresponding relationship between a brightness range and an ISO. In this case, the target ISO refers to the ISO corresponding to the brightness range to which the current ambient brightness belongs.

[0204] For example, in the normal video recording mode, when recording is not started, the electronic device may first display the following Figure 4C The preview frame displayed in the preview window 106 in the user interface 1c has natural motion blur. If the ambient brightness increases, and the increased ambient brightness is not less than the ambient brightness threshold 1, the electronic device can keep the exposure time unchanged and determine the pixel sensitivity and ISO corresponding to the increased ambient brightness. The electronic device can capture the preview frame based on the unchanged exposure time and the pixel sensitivity and ISO corresponding to the increased ambient brightness. Figure 4C As shown in (2), after the ambient brightness increases, the preview frame displayed by the electronic device in the preview window 106 still has natural motion blur.

[0205] It is understandable that the ambient brightness threshold 1 can be set according to actual needs, and the present application does not limit this. In some embodiments of the present application, the ambient brightness threshold 1 is at least 300 lux.

[0206] In some embodiments of the present application, when the electronic device has entered the normal video recording mode but has not started recording, if the current ambient brightness is less than the ambient brightness threshold 1, the electronic device can keep the exposure time and pixel sensitivity unchanged, that is, the exposure time is still half of the frame interval corresponding to the preview frame rate 1, and the pixel sensitivity is still the default pixel sensitivity (for example, 1), and the electronic device can determine the target ISO according to the current ambient brightness, and then capture the preview frame based on the unchanged exposure time, the unchanged pixel sensitivity and the target ISO.

[0207] In some embodiments of the present application, when the electronic device has entered the normal video recording mode but has not started recording, if the current ambient brightness is not less than the ambient brightness threshold 1, the electronic device can keep the exposure time and ISO unchanged, that is, the exposure time is still half of the frame interval corresponding to the preview frame rate 1, and the ISO is still the ISO used by the electronic device when originally capturing the preview frame, and the electronic device can determine the target pixel sensitivity according to the current ambient brightness, and then capture the preview frame based on the unchanged exposure time, the unchanged ISO and the target pixel sensitivity.

[0208] It should be noted that in some embodiments of the present application, when the electronic device has entered the normal video recording mode but has not started recording, the electronic device can obtain a preview frame for each frame of original image captured. In some other embodiments of the present application, when the electronic device has entered the normal video recording mode but has not started recording, the number of original images captured by the electronic device per unit time (for example, 1s) is greater than the number of preview frames obtained. In other words, after the electronic device captures a portion of the original image, it does not process it to obtain a preview frame.

[0209] It should also be noted that, according to the above, when the electronic device is in the preview state under the normal video recording mode, the electronic device can maintain the exposure time at half of the frame interval corresponding to the preview frame rate (i.e., preview frame rate 1) under the normal video recording mode, and adjust the ISO and / or pixel sensitivity when the current ambient brightness changes to ensure that the brightness of the captured preview frame does not jump. Similarly, when the electronic device is in the preview state under other shooting modes (for example, night scene mode, portrait mode, etc.), the electronic device can also maintain the exposure time at half of the frame interval corresponding to the preview frame rate under the other shooting mode, capture preview frames based on the exposure time, and adjust the ISO and / or pixel sensitivity when the current ambient brightness changes to ensure that the brightness of the captured preview frame does not jump.

[0210] It is understandable that the preview frame rates in different shooting modes may be the same or different, and this application does not impose any restrictions on this.

[0211] (3) After recording begins in normal video recording mode, the electronic device maintains the exposure time at half the frame interval corresponding to the target video frame rate and adjusts the pixel sensitivity according to the ambient brightness, so that the final recorded video is played smoothly and with a smooth brightness (e.g. Figure 4D-Figure 4E shown).

[0212] Electronic devices can detect the effects of Figure 4C A user operation on the video recording start control 107 in the user interface 1c shown in (1) in FIG. In response to the user operation, the electronic device can start recording a video.

[0213] When the electronic device has entered the normal video recording mode and has started recording a video (i.e., the electronic device is in the recording state in the normal video recording mode), the electronic device can maintain the exposure time at half the frame interval corresponding to the target video frame rate, and capture the original image based on the exposure time. It can be understood that the target video frame rate refers to the video frame rate corresponding to the video that the electronic device needs to capture. In some embodiments of the present application, the target video frame rate is the same as the frame rate at which the electronic device captures the video frame.

[0214] In some embodiments of the present application, when the electronic device has entered the normal video recording mode and has started recording a video, the electronic device can keep the exposure time unchanged, that is, keep the exposure time still half of the frame interval corresponding to the target video frame rate, determine the current ambient brightness, and determine the target ISO and target pixel sensitivity based on the current ambient brightness, and then capture the original image based on the exposure time, target ISO and target pixel sensitivity. In this way, regardless of whether the ambient brightness increases or decreases, the original image captured by the electronic device can contain natural motion blur, and the original image captured will not lack motion blur due to shortening the exposure time due to increased ambient brightness.

[0215] It is worth noting that in a normal frame rate recording scenario, on the one hand, the electronic device can process the collected original image and send it to the display screen for display, and on the other hand, the electronic device can process the collected original image and save it as the image in the captured video. In other words, the preview frame and the video frame can be obtained from the original image.

[0216] It is understandable that, since the original image captured by the electronic device can be processed to obtain a preview frame and a video frame, if the original image captured by the electronic device contains natural motion blur, then the preview frame sent to the display screen by the electronic device and the saved video frame will also contain natural motion blur accordingly. In some embodiments of the present application, during the process of recording a video in normal recording mode, the ambient brightness increases, and the increased ambient brightness is not less than the ambient brightness threshold 2. In this case, the electronic device can keep the exposure time unchanged and determine the pixel sensitivity and ISO corresponding to the increased ambient brightness. The electronic device can record the video based on the unchanged exposure time, and the pixel sensitivity and ISO corresponding to the increased ambient brightness.

[0217] For example, during the process of recording a video in the normal video recording mode, the electronic device may display the following Figure 4D Specifically, Figure 4D As shown in (1) in FIG. 1 , at the first second of the recorded video, the preview frame displayed by the electronic device in the preview window 106 has natural motion blur, and the subsequent ambient brightness increases, such as Figure 4D As shown in (2) in FIG. 5 , at the 5th second of the recorded video, the preview frame displayed by the electronic device in the preview window 106 still has natural motion blur. The electronic device can detect the effect of Figure 4D In response to the user operation on the video recording end control 109 in the user interface shown in (2) in FIG. 1 , the electronic device can end the video recording and save the video. In the process of playing the saved video, the electronic device can display the video as shown in FIG. Figure 4E The user interface shown in (2) in FIG. Figure 4E The user interface shown in (2) in FIG. 1 may include a progress bar 111. The user may drag the progress bar 111 to view the multiple video frames constituting the above-mentioned saved video. The electronic device may detect a user operation of sliding the progress bar 111 to the left and pausing, and in response to the user operation, the electronic device may display a video such as Figure 4E The user interface shown in (3) in FIG. It can be understood that according to the above, the electronic device collects Figure 4E During the video frames (2) and (3) shown in FIG, the ambient brightness changes, but Figure 4DThe preview frames shown are similar, although the ambient brightness increases during the video recording process, and the electronic device captures Figure 4E The video frames shown in (2) and (3) still have natural motion blur.

[0218] It is understood that the ambient brightness threshold 2 can be set according to actual needs, and the present application does not limit this. In some embodiments of the present application, the ambient brightness threshold 2 is at least 300 lux. It is understood that the ambient brightness threshold 1 and the ambient brightness threshold 2 can be the same or different.

[0219] In some embodiments of the present application, the user can trigger the electronic device to play the above-mentioned saved video by clicking the album application icon in the user interface 1a. For example, the electronic device can detect the user operation on the album application icon, and in response to the user operation, the electronic device can open the album application and display the video as shown in the figure. Figure 4E The user interface shown in (1) in FIG. Figure 4E The user interface shown in (1) may include a thumbnail 110. The electronic device may detect a user operation on the thumbnail 110, and in response to the user operation, the electronic device may play the stored video.

[0220] In some embodiments of the present application, the user can trigger the electronic device to play the above-mentioned saved video by clicking the album shortcut control 103. Specifically, after the electronic device finishes recording the video, it can display a preview interface similar to the user interface 1c, and the preview interface can include the album shortcut control 103. In this case, the user can trigger the electronic device to play the above-mentioned saved video by clicking the album shortcut control 103 in the preview interface.

[0221] (4) Set the target video frame rate ( Figure 4F ).

[0222] In some embodiments of the present application, the target video frame rate may be a default video frame rate. The default video frame rate is the default video frame rate used when a user triggers an electronic device to record a video. For example, Figure 4F As shown in (1), the default video frame rate may be 30 fps.

[0223] In some other embodiments of the present application, the user can set the target video frame rate by himself.

[0224] For example, the electronic device can detect the effect of Figure 4C In response to a user operation on the setting option control 108 in the user interface 1c shown in (1) in FIG. 1 , the electronic device may display a Figure 4F The user interface shown in (1) in FIG. Figure 4FThe user interface shown in (1) in FIG. 1 may include a display area 112. The display area 112 may be used to display the video frame rate used by the currently recorded video, that is, 30fps. The electronic device may detect a user operation on the display area 112, and in response to the user operation, the electronic device may display a video frame rate of 30fps. Figure 4F The user interface shown in (2) in FIG. Figure 4F The user interface shown in (2) may include a display area 113. The display area 113 may be used to display several video frame rate options. For example, 24fps, 30fps, 60fps. The user may trigger the electronic device to change the video frame rate used for recording the video by clicking on the corresponding video frame rate option in the display area 113.

[0225] In some embodiments of the present application, when the electronic device is in the preview state of the normal video recording mode, if the ambient brightness changes, the electronic device can adjust the exposure time and ISO without adjusting the pixel sensitivity (for example, keeping the pixel sensitivity at the default pixel sensitivity). Only when the electronic device is in the recording state of the normal video recording mode, the exposure time is kept unchanged and the ISO and pixel sensitivity are adjusted.

[0226] 2. Low frame rate video recording scenarios

[0227] The normal frame rate video recording scenario refers to: video recording performed when the frame rate of the video frames captured by the electronic device is less than the frame rate threshold 2.

[0228] In some embodiments of the present application, in a low frame rate video recording scenario, the frame rate of the video frames captured by the electronic device when shooting is lower than the frame rate when the video is played.

[0229] It is understandable that the frame rate threshold 1 is not less than the frame rate threshold 2. The specific values ​​of the frame rate threshold 1 and the frame rate threshold 2 can be set according to actual needs, and the present application does not limit this. For example, the frame rate threshold 1 and the frame rate threshold 2 can be 24fps.

[0230] It is understandable that the low frame rate video recording scene may include a video recording scene in a time-lapse photography mode.

[0231] The following introduces the low frame rate video recording scenario involved in this application by taking the example of shooting cars and people in time-lapse photography mode.

[0232] (1) Enter the time-lapse mode ( Figure 4B , Figure 5A-5D ).

[0233] Electronic devices can detect the effects of Figure 4B In response to the user operation, the electronic device may display the following: Figure 5A The user interface 1d shown. The user interface 1d may display more shooting mode options, such as a time-lapse shooting option 114, a continuous shooting option, and a professional photography option.

[0234] Electronic devices can detect the effects of Figure 5A In response to the user operation, the electronic device may display the following information: Figure 5B The user interface 1e shown. The user interface 1e is a preview interface in the time-lapse photography mode before recording starts. The user interface 1e may include a preview window 106, a scene recognition control 115, a display area 116, a setting option control 117, a scene option control 118, and a time-lapse photography start control 119.

[0235] Among them, the scene recognition control 115 can be used to trigger the electronic device to recognize the current scene, so as to select the corresponding shooting parameters for shooting. The display area 116 can display the current scene recognized by the electronic device. The display area 116 may include a cancel control 1161. The cancel control 1161 can be used to cancel the current scene displayed by the display area 116. The setting option control 117 can be used to trigger the electronic device to display several setting options (for example, the duration of time-lapse photography, the interval between the captured video frames and the video frame rate, etc.). The scene option control 118 can be used to trigger the electronic device to display several scene options (for example, mobile delay options, traffic / pedestrian options, cloud delay options, sunrise / sunset / day and night conversion options and starry sky options, etc.). The time-lapse photography start control 119 can be used to trigger the electronic device to start time-lapse photography.

[0236] In some embodiments of the present application, after the electronic device detects the user operation on the time-lapse photography option 114, it can identify the current scene by itself without the user manually triggering the electronic device to identify the current scene. In this case, the electronic device can display the current scene it identifies in the display area 116. For example, Figure 5B As shown, the electronic device recognizes that the current scene is a traffic / pedestrian scene.

[0237] In some embodiments of the present application, after the electronic device detects a user operation on the time-lapse photography option 114, the user is required to manually trigger the electronic device to recognize the current scene by clicking on the scene recognition control 115 or other means.

[0238] In some embodiments of the present application, if the electronic device fails to successfully identify the current scene, the electronic device may use default shooting parameters to shoot. In this case, the electronic device cannot display the current scene it identifies in the display area 116. It is understandable that the default shooting parameters are pre-set shooting parameters. The default shooting parameters in different shooting modes may be the same or different.

[0239] In some embodiments of the present application, the user can select the current scene by clicking the scene option control 118. For example, the electronic device can detect the current scene. Figure 5B In response to a user operation on the scene option control 118 in the user interface 1e shown in FIG. 1 , the electronic device may display a Figure 5C The user interface 1f shown in FIG. 1 may include a display area 120. The display area 120 may include a motion delay option, a traffic / pedestrian option, a cloud delay option, a sunrise / sunset / day / night conversion option, and a starry sky option. Among them, the traffic / pedestrian option is in a selected state. It can be understood that the several scene options displayed in the display area 120 correspond to corresponding shooting parameters (for example, Figure 5D The shooting parameters in the display area 121 shown are shooting parameters corresponding to the traffic / pedestrian options). It is understandable that the shooting parameters corresponding to different scene options may be the same or different. The user can switch the current scene by clicking the scene option in the display area 120, and switch to the corresponding shooting parameters for shooting.

[0240] In some embodiments of the present application, after the electronic device recognizes the current scene or the user selects the current scene, the user can cancel the selection of the recognized or selected scene (i.e., the scene displayed in the display area 116) by clicking the cancel control 1161. In this case, the electronic device can use the default shooting parameters to shoot.

[0241] In some embodiments of the present application, the user can set the shooting parameters in the time-lapse photography mode by himself. For example, the user can click the setting option control 117 in the user interface 1e, and accordingly, the electronic device can detect the user operation on the setting option control 117 in the user interface 1e, and in response to the user operation, the electronic device can display the following information: Figure 5DThe user interface 1g shown. The user interface 1g may include a display area 121. The display area 121 may include an interval duration control 1211, a frame number control 1212, a shutter speed control 1213, a recording duration control 1214, and a video frame rate control 1215. Among them, the interval duration control 1211 is used to adjust the interval duration between adjacent video frames collected by the electronic device (i.e., the frame interval of the collected video frames). The frame number control 1212 is used to adjust the number of video frames collected by the electronic device. The shutter speed control 1213 is used to adjust the shutter speed (also known as the exposure time) of the electronic device to collect video frames. The recording duration control 1214 is used to adjust the total recording duration of the electronic device in the time-lapse photography mode. The video frame rate control 1215 is used to adjust the frame rate of the video recorded by the electronic device when it is played. It is understandable that the user can specifically adjust the shooting parameters (e.g., interval duration, number of video frames, exposure time, recording duration, and video frame rate, etc.) by triggering the setting option control.

[0242] It should be noted that after some shooting parameters are determined, other shooting parameters can also be determined accordingly. Figure 5D As shown, after the interval duration, the number of frames and the exposure time are determined, the electronic device can directly determine the recording duration without the user having to adjust the recording duration.

[0243] (2) When recording is not started in the time-lapse photography mode, the electronic device maintains the exposure time at half the frame interval corresponding to the preview frame rate 2, and adjusts the pixel sensitivity according to the ambient brightness, so as to ensure that the image displayed on the display screen is smooth and not overexposed. The preview frame rate 2 is the preview frame rate when recording is not started in the time-lapse photography mode.

[0244] When the electronic device is in the preview state of the time-lapse photography mode, the electronic device can maintain the exposure time at half of the frame interval corresponding to the preview frame rate (i.e., preview frame rate 2) in the time-lapse photography mode, and adjust the ISO and / or pixel sensitivity when the current ambient brightness changes to ensure that the brightness of the collected preview frame does not jump. For details, please refer to the above-mentioned method of adjusting the shooting parameters when the electronic device is in the preview state of the normal recording mode, and this application will not go into details here.

[0245] It can be understood that preview frame rate 2 is the frame rate at which the image is displayed on the display screen when the electronic device is in time-lapse photography mode and has not started recording.

[0246] It can be understood that the preview frame rate 1 and the preview frame rate 2 may be the same or different.

[0247] (3) After starting recording in the time-lapse photography mode, the electronic device maintains the exposure time used when capturing preview frames at half the frame interval corresponding to the preview frame rate 3, and maintains the exposure time used when capturing video frames at half the frame interval corresponding to the target video frame capture frame rate, and adjusts the pixel sensitivity according to the ambient brightness, so that the image displayed on the display screen is smooth and not overexposed, and the video finally recorded is played smoothly and with smooth brightness ( Figure 5E-5F ). The preview frame rate 3 is the preview frame rate when recording has started in the time-lapse photography mode, and the preview frame rate 3 is greater than the target video frame acquisition frame rate.

[0248] Electronic devices can detect the effects of Figure 5B The user interface 1e shows a user operation on the time-lapse photography start control 119. In response to the user operation, the electronic device may start recording a video.

[0249] Since time-lapse photography is a low-frame-rate video recording, the interval between video frames collected by electronic devices is relatively long. Therefore, in order to ensure that the preview window (for example, Figure 5B-5E The preview window 106 shown can display a smooth picture without causing the picture displayed in the preview window to freeze due to the long interval between the captured video frames. In the process of recording a video in the time-lapse photography mode, the electronic device can use different shooting parameters (for example, exposure time, ISO and pixel sensitivity, etc.) to respectively capture preview frames and video frames, so that the preview window can display a smooth picture during the recording process, and the motion blur in the captured video frames can well increase the smoothness of the video playback. In this way, recording a video in the time-lapse photography mode involves switching between different shooting parameters corresponding to the preview frames and the video frames. That is, in the process of recording a video in the time-lapse photography mode, when the electronic device captures the preview frames, it will switch to the shooting parameters corresponding to the preview stream for shooting, and when capturing the video frames, it will switch to the shooting parameters corresponding to the video stream for shooting.

[0250] Specifically, the electronic device may use the shooting parameters corresponding to the preview stream to capture the original image, and after processing the captured original image, a preview frame may be obtained. Similarly, the electronic device may use the shooting parameters corresponding to the video stream to capture the original image, and after processing the captured original image, a video frame may be obtained. It should be noted that because the shooting parameters corresponding to the preview stream are different from the shooting parameters corresponding to the video stream, the electronic device cannot process the original image captured using the shooting parameters corresponding to the preview stream to obtain a video frame. Similarly, the electronic device cannot process the original image captured using the shooting parameters corresponding to the video stream to obtain a preview frame.

[0251] It can be understood that the preview stream refers to a preview frame sequence, which is composed of a number of preview frames. Similarly, the video stream refers to a video frame sequence, which is composed of a number of video frames.

[0252] It is understandable that the present application does not restrict the order in which the electronic device captures preview frames and captures video frames.

[0253] In some embodiments of the present application, after the electronic device captures S preview frames based on the shooting parameters corresponding to the preview stream, it switches from the shooting parameters corresponding to the preview stream to the shooting parameters corresponding to the video stream, and captures 1 video frame based on the shooting parameters corresponding to the video stream. It is understandable that after the electronic device captures 1 video frame, it can switch from the shooting parameters corresponding to the video stream to the shooting parameters corresponding to the preview stream, and capture S preview frames again. It is understandable that the above process can be repeated until the electronic device stops recording. It is understandable that S is a positive integer.

[0254] In some other embodiments of the present application, after the electronic device captures one frame of video based on the shooting parameters corresponding to the video stream, it can switch from the shooting parameters corresponding to the video stream to the shooting parameters corresponding to the preview stream, and before the next video frame is captured, S frames of preview frames are captured based on the shooting parameters corresponding to the preview stream. It is understandable that after the electronic device captures S frames of preview frames, it can switch from the shooting parameters corresponding to the preview stream to the shooting parameters corresponding to the video stream, and capture one frame of video again. It is understandable that the above process can be repeated until the electronic device stops recording.

[0255] It is worth noting that when capturing preview frames in the time-lapse photography mode, the electronic device can maintain the exposure time used as half of the frame interval corresponding to the preview frame rate 3, and when capturing video frames in the time-lapse photography mode, the electronic device can maintain the exposure time used as half of the frame interval corresponding to the target video frame capture frame rate. In other words, the exposure time included in the shooting parameters corresponding to the preview stream can be half of the frame interval corresponding to the preview frame rate 3, and the exposure time included in the shooting parameters corresponding to the video stream can be half of the frame interval corresponding to the frame rate of the video frames captured in the time-lapse photography mode.

[0256] It can be understood that the preview frame rate 3 and the preview frame rate 1 may be the same or different, and the preview frame rate 3 and the preview frame rate 2 may be the same or different.

[0257] In some embodiments of the present application, the preview frame rate 3 is greater than the frame rate threshold 1, and the target video frame acquisition frame rate is less than the frame rate threshold 2.

[0258] In some embodiments of the present application, when the electronic device has entered the time-lapse photography mode and has started recording a video, the electronic device can keep the exposure time unchanged when collecting preview frames, that is, keep the exposure time still half of the frame interval corresponding to the preview frame rate 3, determine the current ambient brightness, and determine the corresponding target ISO and target pixel sensitivity based on the current ambient brightness, and then collect preview frames based on the exposure time, the corresponding target ISO and the target pixel sensitivity. Similarly, when the electronic device collects video frames, the exposure time can be kept unchanged, that is, keep the exposure time still half of the frame interval corresponding to the target video frame acquisition frame rate, determine the current ambient brightness, and determine the corresponding target ISO and the target pixel sensitivity based on the current ambient brightness, and then collect video frames based on the exposure time, the corresponding target ISO and the target pixel sensitivity. In this way, regardless of whether the ambient brightness increases or decreases, the preview frames and video frames collected by the electronic device can contain natural motion blur, and the collected preview frames and video frames will not lack motion blur due to shortening the exposure time due to increased ambient brightness.

[0259] It should be noted that, when the current ambient brightness is the same, the target ISO determined by the electronic device based on the current ambient brightness when capturing preview frames and the target ISO determined by the electronic device based on the current ambient brightness when capturing video frames can be the same (for example, both are 100) or different (for example, the former is 200 and the latter is 100). Similarly, when the current ambient brightness is the same, the target pixel sensitivity determined by the electronic device based on the current ambient brightness when capturing preview frames and the target pixel sensitivity determined by the electronic device based on the current ambient brightness when capturing video frames can be the same (for example, both are 1 / 4) or different (for example, the former is 1 and the latter is 1 / 4).

[0260] For example, during the video recording process in the time-lapse photography mode, the electronic device may display the following Figure 5E Specifically, Figure 5E As shown in (1), at the 30th second of the recorded video, the preview frame displayed by the electronic device in the preview window 106 still has natural motion blur. If the ambient brightness increases, and the increased ambient brightness is not less than the ambient brightness threshold 3, the electronic device can keep the exposure time of the preview frame unchanged when capturing the preview frame, and determine the pixel sensitivity and ISO corresponding to the increased ambient brightness. The electronic device can capture the preview frame based on the unchanged exposure time, and the pixel sensitivity and ISO corresponding to the increased ambient brightness, and display the captured preview frame on the display screen. Figure 5E As shown in (2), at the 15th minute (min) of the recorded video, the preview frame displayed by the electronic device in the preview window 106 still has natural motion blur.

[0261] It is understandable that the ambient brightness threshold 3 can be set according to actual needs, and the present application does not limit this. In some embodiments of the present application, the ambient brightness threshold 3 is at least 300 lux. It is understandable that the ambient brightness threshold 3 and the ambient brightness threshold 1 can be the same or different, and the ambient brightness threshold 3 and the ambient brightness threshold 2 can be the same or different.

[0262] Similarly, if the ambient brightness changes, when the electronic device captures the video frame, it can keep the exposure time of the captured video frame unchanged and determine the pixel sensitivity and ISO corresponding to the changed ambient brightness. The electronic device can capture the video frame based on the unchanged exposure time and the pixel sensitivity and ISO corresponding to the changed ambient brightness, and save the captured video frame.

[0263] For example, the electronic device can detect the effect of Figure 5E In response to the user operation on the time-lapse photography end control 122 in the user interface shown in (2) in FIG. 1 , the electronic device can end the video recording and save the video. The user can trigger the electronic device to play the video recorded and saved in the time-lapse photography mode. During the playback of the saved video, the electronic device can display the following Fig. 5F Specifically, Fig. 5F The user interface shown in (1) may include a progress bar 123. The user may drag the progress bar 123 to view the multiple video frames constituting the above-mentioned saved video. The electronic device may detect a user operation of sliding the progress bar 123 to the left and pausing, and in response to the user operation, the electronic device may display a video such as Fig. 5F The user interface shown in (2) in FIG. It can be understood that according to the above, the electronic device collects Fig. 5F During the video frames (1) and (2) shown in FIG, the ambient brightness changes, but Figure 5E The preview frames shown are similar, although the ambient brightness increases during the video recording process, and the electronic device captures Fig. 5F The video frames shown in (1) and (2) still have natural motion blur.

[0264] It is understandable that the specific method in which the user triggers the electronic device to play the video recorded and saved in the above-mentioned time-lapse photography mode can be referred to above, and this application will not repeat it here.

[0265] It is understood that the user operations mentioned in this application may include but are not limited to touch (e.g., click, etc.), voice control, gestures, etc., and this application does not limit this. The schematic diagram of the user interface provided in this application is only an example and should not be regarded as a limitation of this application.

[0266] A shooting method provided by an embodiment of the present application is introduced below based on the above shooting scenario.

[0267] See also Figure 6 , Figure 6 A shooting method is provided in an embodiment of the present application. The shooting method may include but is not limited to the following steps:

[0268] S101: The electronic device receives an instruction to start a camera application. In response to the instruction to start the camera application, the electronic device starts a camera and opens the camera application.

[0269] The user can touch the camera application icon (e.g. Figure 4A The electronic device may be triggered to start the camera application by a camera application icon 101 shown in the figure, or by voice control or gesture. Accordingly, the electronic device may receive an instruction to start the camera application. In response to the instruction to start the camera application, the electronic device may start the camera and open the camera application.

[0270] The electronic device receives an instruction to switch to the video shooting function, and in response to the instruction to switch to the video shooting function, the electronic device switches the camera application to the video shooting function.

[0271] It is understood that the video shooting function may include video shooting at a normal frame rate (i.e., normal frame rate video recording) and video shooting at a low frame rate (i.e., low frame rate video recording). Exemplarily, video shooting at a normal frame rate may include video shooting in a normal video recording mode. In this case, the instruction to switch to the video shooting function may be an instruction to act on the video recording device such as Figure 4B 1a. The user operation on the video recording mode option 1021 in the user interface 1b shown in FIG. 1b. Exemplarily, the video shooting at a low frame rate may include the video shooting in a time-lapse photography mode. In this case, the instruction to switch to the video shooting function may be an instruction to act on the video recording mode such as Figure 5A User operation on the time-lapse photography option 114 in the user interface 1d is shown.

[0272] In some embodiments of the present application, when the electronic device has not started recording a video, a preview interface may be displayed. The preset interface may display an image captured by the electronic device using a preset exposure time and a default pixel sensitivity. It is understandable that the preset exposure time and the default pixel sensitivity may be set according to actual needs, and the present application does not limit this. In one possible implementation, the preset exposure time is half of the frame interval corresponding to the frame rate at which the image is displayed on the display screen when the electronic device displays the preview interface.

[0273] S102: The electronic device receives an instruction to start recording a video, and in response to the instruction to start recording a video, the electronic device starts recording a video.

[0274] The user can start recording by touching the control (e.g. Figure 4C The video start control 107 shown, such as Figure 5B The electronic device may be triggered to start recording a video by means of a time-lapse photography start control 119 shown in the figure, or by voice control or gestures. Accordingly, the electronic device may receive an instruction to start recording a video, and in response to the instruction to start recording a video, the electronic device may start recording a video.

[0275] In some embodiments of the present application, the electronic device may use the shooting parameters used to capture the last preview frame before starting to record the video to capture the first frame of the original image after starting to record the video. It can be understood that the shooting parameters involved in the present application mainly include exposure time, ISO and pixel sensitivity.

[0276] In some embodiments of the present application, the electronic device may use the default shooting parameters when recording a video to collect the first frame of the original image after starting to record the video. The exposure time in the default shooting parameters may be ET1.

[0277] S103: During the video recording process, the electronic device maintains the exposure time used for capturing video frames at ET1, and adjusts the ISO and pixel sensitivity used for capturing video frames according to the change in ambient brightness. ET1 is half of the frame interval corresponding to the frame rate F1. F1 is the frame rate of the video frames captured by the electronic device during this video recording process.

[0278] It is understandable that after the electronic device starts recording a video, it can collect the original image and process the original image to obtain a preview frame and / or a video frame. Once the preview frame is obtained, the electronic device can send the preview frame to the display screen for display, and once the video frame is obtained, the electronic device can save the video frame.

[0279] During the video recording process, for the original image of the video frame obtained after subsequent processing, the exposure time used by the electronic device when collecting the original image remains unchanged and remains at ET1, and the ISO and pixel sensitivity used when collecting the original image can be adjusted according to the current ambient brightness. Among them, ET1 can be understood as half of the interval time between two adjacent video frames collected by the electronic device during this video recording process.

[0280] In some embodiments of the present application, the frame rate at which the electronic device captures video frames during this video recording (i.e., the target video frame capture frame rate) is the same as the frame rate during video playback required for this video recording (i.e., the target video frame rate).

[0281] In some embodiments of the present application, the electronic device adjusts the ISO and pixel sensitivity used for capturing video frames according to changes in ambient brightness, which may specifically include: the electronic device may determine the current ambient brightness, and when the current ambient brightness changes, the electronic device may determine the ISO and pixel sensitivity corresponding to the current ambient brightness, adjust the ISO used for capturing video frames to the ISO corresponding to the current ambient brightness, and adjust the pixel sensitivity used for capturing video frames to the pixel sensitivity corresponding to the current ambient brightness.

[0282] In some embodiments of the present application, the electronic device stores a correspondence between ambient brightness, ISO, and pixel sensitivity. After the electronic device determines the current ambient brightness, it can search for the ISO and pixel sensitivity corresponding to the current ambient brightness in the stored correspondence between ambient brightness, ISO, and pixel sensitivity.

[0283] In some embodiments of the present application, a technician may perform exposure calibration on the electronic device in advance, obtain calibration information, and pre-store the calibration information in the electronic device. Specifically, when performing calibration, a technician may record the exposure time, ISO, and pixel sensitivity of the electronic device when it is in different ambient brightnesses as calibration information, and store the calibration information in the electronic device. It can be understood that normal exposure means that the brightness of the dark and bright parts of the image captured by the electronic device is appropriate, and both display image details (for example, grayscale changes such as isolated points in the image, texture features, and sudden changes in the picture), without overexposure or underexposure. The calibration information can also be understood as the correspondence between ambient brightness, exposure time, ISO, and pixel sensitivity.

[0284] For example, in the embodiment of the present application, technicians calibrate the electronic device before it leaves the factory: when the ambient brightness is L1 lux, the shooting parameters that the electronic device can normally expose include: exposure time 1 / 50s, ISO 400, pixel sensitivity 1; when the ambient brightness is L2 lux, the shooting parameters that the electronic device can normally expose include: exposure time 1 / 50s, ISO 100, pixel sensitivity 1 / 4. Among them, L1 lux and L2 lux can be brightness values ​​or brightness ranges, and the electronic device can record the ambient brightness during calibration and the corresponding shooting parameters.

[0285] In some embodiments of the present application, the electronic device can record videos in multiple scenarios. In this case, when the technician performs exposure calibration on the electronic device in advance, the exposure calibration can be performed for the multiple scenarios to obtain calibration information corresponding to the multiple scenarios. The electronic device can store the calibration information corresponding to the multiple video recording scenarios in the electronic device.

[0286] In some embodiments of the present application, the electronic device can determine the ambient brightness based on the light metering system. The ambient brightness measured by the light metering system is usually the brightness of the light reflected by the object being photographed, which may deviate from the actual ambient brightness. Therefore, in some embodiments of the present application, the electronic device can also estimate the current ambient brightness based on the collected image and shooting parameters (e.g., exposure time and ISO).

[0287] Specifically, the electronic device can perform AEC statistics on the collected image to obtain statistical results, and determine the current ambient light brightness according to the statistical results. Among them, the statistical results can be the average brightness of the collected image. AEC statistics can adopt statistical methods in related technologies. For example, the electronic device can calculate the brightness of the image collected by the electronic device through the AEC statistical module in the AEC module, and specifically calculate the brightness of the image through the average brightness method, the weighted average method, and the like. Among them, the average brightness method can refer to calculating the average brightness of the entire image, and the weighted average method can refer to calculating the brightness of the image, and the proportion of the entire image from the center area to the edge area becomes smaller and smaller.

[0288] Electronic devices can estimate the current ambient brightness using the following formula:

[0289]

[0290] Among them, lv represents the estimated current ambient brightness, A represents the aperture value, avg Luma represents the average brightness of the image, that is, the average brightness of the above-collected image; Exposure Time represents the exposure time in seconds; ISO represents the sensitivity; C is a constant, and its specific value is 100 / 46. Exposure time and ISO are the exposure time and ISO used when collecting the above-mentioned image.

[0291] According to the above, the shooting scenarios involved in the embodiments of the present application may include normal frame rate video recording scenarios and low frame rate video recording scenarios, and the specific implementation methods of the above shooting methods applied in these two shooting scenarios may be different.

[0292] Combine the following Figure 7A-7B The specific implementation methods of the above shooting method in normal frame rate video recording scenarios and low frame rate video recording scenarios are introduced respectively.

[0293] 1. Normal frame rate video recording scenario

[0294] In some embodiments of the present application, in a normal frame rate video recording scenario, the frame rate at which the electronic device captures video frames is the same as the frame rate at which the electronic device captures original images, and is not less than the frame rate at which the electronic device captures preview frames. Specifically, in one possible implementation, each time the electronic device captures a frame of original image, it can process the frame of original image to obtain a preview frame and a video frame, respectively. In this case, the frame rate at which the electronic device captures video frames is the same as the frame rate at which the electronic device captures original images, and is the same as the frame rate at which the electronic device captures preview frames. In another possible implementation, each time the electronic device captures a frame of original image, it can process the frame of original image to obtain a video frame, and the number of preview frames obtained by the electronic device based on the original image is less than the number of video frames obtained. In this case, the frame rate at which the electronic device captures video frames is the same as the frame rate at which the electronic device captures original images, and is greater than the frame rate at which the electronic device captures preview frames.

[0295] The following takes the first implementation method as an example and combines Fig. 7A To introduce the specific implementation method of the above shooting method.

[0296] S201: During video recording, the electronic device uses a camera to collect an original image RAW1 based on exposure time ET1, sensitivity ISO1, and pixel sensitivity U1.

[0297] During video recording, the electronic device may collect raw images through the camera based on shooting parameters. For example, the electronic device may collect RAW1 through the camera based on ET1, ISO1, and U1.

[0298] It is understandable that F1 may be the target video frame rate mentioned above. In some embodiments of the present application, in a normal frame rate video recording scenario, the target video frame rate is equal to the target video frame acquisition frame rate.

[0299] It is understandable that ISO1 is within the sensitivity range and U1 is within the pixel sensitivity range. According to the above, the sensitivity range and the pixel sensitivity range can be set according to actual needs and hardware level, and this application does not limit this. For example, the sensitivity range can be 100 to 25600, and the pixel sensitivity range can be 1 / 4 to 1.

[0300] In some embodiments of the present application, before executing step S201, the electronic device may further execute step S101-step S102.

[0301] S202: The electronic device processes RAW1 to obtain a preview frame Y1 and a video frame V1, and displays Y1 on a display screen.

[0302] After the electronic device acquires RAW1, it can process RAW (for example, image format conversion, denoising, contrast adjustment, etc.) to obtain Y1 and V1 respectively. The electronic device can send Y1 to the display screen for display, save V1, send it to the video encoder for encoding, and put it into the corresponding video file. In some embodiments of the present application, the resolutions of Y1 and V1 may be different.

[0303] S203: The electronic device determines the current ambient brightness.

[0304] After the electronic device collects RAW1, it can determine the current ambient brightness. According to the above, the electronic device can determine the current ambient brightness through the light metering system, and can also obtain statistical information based on RAW1 and determine the current ambient brightness based on the statistical information. The specific implementation method can be referred to above, and this application will not be repeated here.

[0305] In some embodiments of the present application, the electronic device may determine the current ambient brightness once each time a frame of original image is captured.

[0306] In some other embodiments of the present application, the electronic device may determine the current environment brightness once every time it collects at least x frames of original images. It is understandable that x may be a positive integer.

[0307] It is understandable that the present application does not limit the execution order of step S202 and step S203.

[0308] S204: The electronic device determines a first target ISO and a first target pixel sensitivity according to the current ambient brightness.

[0309] In some embodiments of the present application, when the current ambient brightness changes, the electronic device may determine the first target ISO and the first target pixel sensitivity. In some other embodiments of the present application, the electronic device may perform the above-mentioned step of determining the first target ISO and the first target pixel sensitivity according to the current ambient brightness once every x frames of images (original images or preview frames) are collected. It is understood that x may be a positive integer.

[0310] In some embodiments of the present application, the electronic device determines the first target ISO and the first target pixel sensitivity according to the current ambient brightness, which may specifically include: the electronic device may search the first corresponding relationship for the ISO and pixel sensitivity corresponding to the ambient brightness being the current ambient brightness, wherein the ISO is the first target ISO, and the pixel sensitivity is the first target pixel sensitivity.

[0311] It can be understood that the first correspondence is the correspondence between the ambient brightness and the shooting parameters (including exposure time, ISO and pixel sensitivity) in the normal frame rate video recording scene. In some embodiments of the present application, the electronic device may store the first correspondence. In some other embodiments of the present application, the electronic device may obtain the first correspondence from other devices (e.g., a cloud server).

[0312] In some embodiments of the present application, the electronic device determines the first target ISO and the first target pixel sensitivity according to the current ambient brightness, which may specifically include: the electronic device may determine whether the current ambient brightness is not less than the ambient brightness threshold 2, and when the current ambient brightness is not less than the ambient brightness threshold 2, the electronic device may not adjust the ISO, that is, the electronic device may determine that the first target ISO is ISO1, and search the pixel sensitivity corresponding to the ambient brightness of the current ambient brightness in the first corresponding relationship, and the pixel sensitivity is the first target pixel sensitivity, however, when the current ambient brightness is less than the ambient brightness threshold 2, the electronic device may not adjust the pixel sensitivity, that is, the electronic device may determine that the first target pixel sensitivity is U1, and search the ISO corresponding to the ambient brightness of the current ambient brightness in the first corresponding relationship, and the ISO is the first target ISO. In a possible implementation, when the current ambient brightness is not less than the ambient brightness threshold 2, the ISO used by the electronic device when capturing an image is the minimum ISO in the sensitivity range, and the ISO cannot be adjusted to a smaller value. In a possible implementation, when the current ambient brightness is less than the ambient brightness threshold 2, the pixel sensitivity used by the electronic device when capturing an image is the maximum pixel sensitivity in the pixel sensitivity range.

[0313] In some embodiments of the present application, when the current ambient brightness changes, the electronic device may determine whether the current ambient brightness is not less than the ambient brightness threshold 2. In some other embodiments of the present application, the electronic device may perform the above step of determining whether the current ambient brightness is not less than the ambient brightness threshold 2 once every x frames of images (original images or preview frames) are captured.

[0314] In some embodiments of the present application, when the current ambient brightness is not less than the ambient brightness threshold 2, ISO1 may be the minimum ISO (eg, 100) in the sensitivity range.

[0315] In some embodiments of the present application, when the current environment brightness is less than the environment brightness threshold 2, U1 may be the maximum pixel sensitivity (eg, 1) in the pixel sensitivity range. The maximum pixel sensitivity may be the default pixel sensitivity.

[0316] It should be noted that, in some embodiments of the present application, if the first target pixel sensitivity is different from U1, the electronic device may gradually adjust the pixel sensitivity until the pixel sensitivity reaches the first target pixel sensitivity, rather than directly adjusting the pixel sensitivity to the first target pixel sensitivity.

[0317] In some embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the brightness range to which the current ambient brightness belongs. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the brightness range to which the current ambient brightness belongs.

[0318] For example, please refer to Table 2, which is an example of the first correspondence provided in an embodiment of the present application. Table 2 shows the first correspondence when F1 is 25fps. The shooting parameters in the first correspondence shown in Table 2 may include exposure time, sensitivity (ISO) and pixel sensitivity. Among them, the unit of exposure time is s. The unit of ambient brightness is lux. The standard adopted by the sensitivity represented by ISO is the ISO standard. The first correspondence involved in Table 2 is the correspondence between the ambient brightness range and the shooting parameters.

[0319] Table 2

[0320]

[0321] It should be noted that in some embodiments of the present application, the brightness range to which the current ambient brightness belongs does not correspond to a specific pixel sensitivity, but a pixel sensitivity range. In this case, the electronic device can determine the pixel sensitivity of the corresponding position in the pixel sensitivity range corresponding to the brightness range based on the position of the current ambient brightness in the brightness range to which it belongs. The pixel sensitivity is the pixel sensitivity corresponding to the current ambient brightness.

[0322] Exemplarily, as shown in Table 2, after the current ambient brightness is greater than 200 lux, the electronic device can start to adjust the pixel sensitivity. In this case, the ambient brightness range no longer corresponds to a specific pixel sensitivity, but a pixel sensitivity range. The electronic device can determine the specific value of the pixel sensitivity at the corresponding position in the pixel sensitivity range corresponding to the brightness range based on the position of the current ambient brightness in the brightness range to which it belongs. Take the current ambient brightness of 150 lux as an example. As shown in Table 2, the brightness range to which it belongs is (200, 300], and the pixel sensitivity range corresponding to this brightness range is [1 / 4, 1]. In this case, the electronic device can determine that the current ambient brightness is the middle value in the brightness range to which it belongs, thereby determining that the middle value of the pixel sensitivity range corresponding to the brightness range is 5 / 8. The electronic device can determine that the pixel sensitivity corresponding to the current ambient brightness is 5 / 8.

[0323] In some embodiments of the present application, when the current ambient brightness is greater than the ambient brightness threshold 4, and the brightness range to which the current ambient brightness belongs corresponds to a pixel sensitivity range rather than a specific pixel sensitivity, if the difference between the current ambient brightness and the ambient brightness threshold 4 is not greater than the difference 1, the electronic device can adopt the above method to determine the specific value of the pixel sensitivity corresponding to the current ambient brightness, that is, the electronic device can determine the specific value of the pixel sensitivity at the corresponding position in the pixel sensitivity range corresponding to the brightness range based on the position of the current ambient brightness in the brightness range to which it belongs, and if the difference between the current ambient brightness and the ambient brightness threshold 4 is greater than the difference 1, the electronic device can determine that the pixel sensitivity corresponding to the current ambient brightness is the minimum value in the pixel sensitivity range corresponding to the brightness range to which it belongs.

[0324] It is understandable that the ambient brightness threshold 4 and the difference 1 can be set according to actual needs, and the present application does not limit this. For example, the ambient brightness threshold 4 can be 1000 lux, and the difference 1 can be 200 lux.

[0325] Exemplarily, as shown in Table 2, when the current ambient brightness is greater than 1000 lux, the corresponding pixel sensitivity range is [1 / 40, 1 / 20). When the difference 1 is 200 lux, determine whether the current ambient brightness is greater than 1000 lux and not greater than 1200 lux, that is, determine whether the current ambient brightness is within the range of (1000 lux, 1200 lux). When the current ambient brightness is greater than 1000 lux and not greater than 1200 lux, the electronic device can determine the specific value of the pixel sensitivity of the corresponding position in [1 / 40, 1 / 20) based on the position of the current ambient brightness in (1000 lux, 1200 lux). When the current ambient brightness is greater than 1200 lux, the electronic device can determine that the pixel sensitivity corresponding to the current ambient brightness is 1 / 40.

[0326] It should also be noted that, as shown in Table 2, in some embodiments of the present application, when the current ambient brightness is less than 10 lux, the electronic device can adjust the sensitivity to a larger value (for example, 3200).

[0327] It should also be noted that the ISO shown in Table 2 increases gradually in the form of a geometric progression, and the present application may also use other standards to adjust the ISO, which is not limited by the present application. For example, the ISO does not have to increase in multiples strictly in a geometric progression of 100, and may also use values ​​such as 60, 120, etc.

[0328] In some embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the ambient brightness closest to the current ambient brightness in the first corresponding relationship. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the ambient brightness closest to the current ambient brightness in the first corresponding relationship.

[0329] Exemplarily, as shown in Table 3, when the current ambient brightness is 310 lux, the electronic device can search for the ambient brightness closest to 310 lux in the first corresponding relationship, that is, 300 lux. The electronic device can then determine the ISO and pixel sensitivity corresponding to 300 lux as the ISO and pixel sensitivity corresponding to the current ambient brightness, that is, the first target ISO and the first target pixel sensitivity.

[0330] It can be understood that Table 3 is an example of the first correspondence provided in the embodiment of the present application. Similar to Table 2, Table 3 shows the first correspondence when F1 is 25fps, and the shooting parameters in the first correspondence shown in Table 3 may include exposure time, sensitivity (ISO) and pixel sensitivity. Among them, the unit of exposure time is s. The unit of ambient brightness is lux. The standard adopted by the sensitivity represented by ISO is the ISO standard. The first correspondence involved in Table 2 is the correspondence between the specific ambient brightness and the shooting parameters.

[0331] Table 3

[0332]

[0333] In a possible implementation, if there are two ambient brightnesses closest to the current ambient brightness in the first correspondence, the electronic device can arbitrarily select the ISO and pixel sensitivity corresponding to one of the ambient brightnesses as the ISO and pixel sensitivity corresponding to the current ambient brightness.

[0334] In another possible implementation, if there are two ambient brightnesses closest to the current ambient brightness in the first corresponding relationship, the electronic device may select the ISO and pixel sensitivity corresponding to one of the ambient brightnesses as the ISO and pixel sensitivity corresponding to the current ambient brightness according to the change in ambient brightness. Specifically, when the current ambient brightness increases compared to the original ambient brightness, the electronic device may select the ISO and pixel sensitivity corresponding to the larger of the two ambient brightnesses as the ISO and pixel sensitivity corresponding to the current ambient brightness, and when the current ambient brightness decreases compared to the original ambient brightness, the electronic device may select the ISO and pixel sensitivity corresponding to the smaller of the two ambient brightnesses as the ISO and pixel sensitivity corresponding to the current ambient brightness.

[0335] In some embodiments of the present application, when the current environment brightness increases compared to the original environment brightness, the ISO corresponding to the current environment brightness may specifically be: the ISO corresponding to the environment brightness that is closest to the current environment brightness and smaller than the current environment brightness in the first corresponding relationship. When the current environment brightness decreases compared to the original environment brightness, the ISO corresponding to the current environment brightness may specifically be: the ISO corresponding to the environment brightness that is closest to the current environment brightness and larger than the current environment brightness in the first corresponding relationship.

[0336] Similarly, when the current environment brightness increases compared to the original environment brightness, the pixel sensitivity corresponding to the current environment brightness may specifically be: the pixel sensitivity corresponding to the environment brightness that is closest to the current environment brightness and smaller than the current environment brightness in the first corresponding relationship. When the current environment brightness decreases compared to the original environment brightness, the pixel sensitivity corresponding to the current environment brightness may specifically be: the pixel sensitivity corresponding to the environment brightness that is closest to the current environment brightness and larger than the current environment brightness in the first corresponding relationship.

[0337] Specifically, if the ISO and pixel sensitivity corresponding to the current ambient brightness do not exist in the first corresponding relationship, the electronic device can search for the ambient brightness closest to the current ambient brightness in the first corresponding relationship. For ease of description, the present application records the ambient brightness closest to the current ambient brightness in the first corresponding relationship as L3 and L4. Among them, L3 is less than the current ambient brightness, and the current ambient brightness is less than L4. The electronic device can determine the change in ambient brightness, that is, determine whether the current ambient brightness is increased or decreased compared to the original ambient brightness. If the current ambient brightness is greater than the original ambient brightness, the electronic device can determine that the ISO corresponding to the current ambient brightness is the ISO corresponding to L3, and determine that the pixel sensitivity corresponding to the current ambient brightness is the pixel sensitivity corresponding to L3. If the current ambient brightness is less than the original ambient brightness, the electronic device can determine that the ISO corresponding to the current ambient brightness is the ISO corresponding to L4, and determine that the pixel sensitivity corresponding to the current ambient brightness is the pixel sensitivity corresponding to L4.

[0338] Exemplarily, as shown in Table 3, when the current ambient brightness changes from 250 lux to 350 lux, the electronic device can use the ambient brightness closest to 350 lux in the first correspondence, namely 300 lux and 500 lux. Since the current ambient brightness is increased compared to the original ambient brightness, the electronic device can determine the ISO and pixel sensitivity corresponding to 300 lux as the ISO and pixel sensitivity corresponding to the current ambient brightness, namely the first target ISO and the first target pixel sensitivity.

[0339] It is worth noting that in the normal frame rate video recording scenario, F1 may be different for different recording requirements. The first correspondence may include the relationship between ET1 and shooting parameters corresponding to different F1s. For example, the first correspondence shown in Tables 2 and 3 only shows the correspondence between ET1 and shooting parameters when F1 is 25fps. The first correspondence stored in the electronic device may also include the correspondence between ET1 and shooting parameters when F1 is other values ​​(for example, 24fps, 30fps, etc.). The electronic device may also obtain the correspondence between ET1 and shooting parameters when F1 is other values ​​(for example, 24fps, 30fps, etc.) from other devices. The application does not limit this.

[0340] S205: The electronic device collects a raw image RAW2 through a camera based on ET1, the first target ISO and the first target pixel sensitivity.

[0341] After the electronic device determines the first target ISO and the first target pixel sensitivity, it can collect RAW2 based on ET1, the first target ISO and the first target pixel sensitivity.

[0342] S206: The electronic device processes RAW2 to obtain a preview frame Y2 and a video frame V2, and displays Y2 on a display screen.

[0343] After the electronic device captures RAW2, it can process RAW2 (for example, image format conversion, denoising, contrast adjustment, etc.) to obtain Y2 and V2. The electronic device can send Y2 to the display screen for display, save V2, send it to the video encoder for encoding, and put it into the corresponding video file. In some embodiments of the present application, the resolutions of Y2 and V2 may be different.

[0344] S207: The electronic device receives an instruction to end video recording, and in response to the instruction to end video recording, the electronic device ends video recording and saves video Video1. Video1 includes V1 and V2.

[0345] It is understandable that during the subsequent video recording process, the user can end the video recording by touching the control (for example, Figure 4D The video recording end control 109 shown, such as Figure 5E The electronic device may be triggered to stop recording the video by means of a time-lapse photography end control 122 shown in the figure, or by voice control or gesture. Accordingly, the electronic device may receive an instruction to end video recording, and in response to the instruction to end video recording, the electronic device may stop video recording and save video Video1. The images constituting Video1 include V1 and V2.

[0346] For example, Fig. 8AAs shown, during the above video recording process, the ambient brightness continues to increase, and the electronic device collects N frames of original images. Where N is a positive integer. Each time the electronic device collects a frame of original image, it can process it to obtain a preview frame and a video frame. On the one hand, the electronic device can send the obtained preview frame to the display screen for display, and on the other hand, the electronic device can save the obtained video frame so that it can be combined with other video frames to form a video later. Figure 8B As shown in (1), according to the enlarged football images in the first preview frame and the Nth preview frame obtained by the electronic device, it can be concluded that the preview frame displayed on the display screen by the electronic device during the process of increasing ambient brightness has appropriate natural blur. It can be understood that during the above video recording process, the electronic device can display the picture smoothly on the display screen without causing the picture to freeze due to insufficient motion blur. Figure 8B As shown in (2), according to the enlarged image of the football in the first video frame and the Nth video frame saved by the electronic device, it can be concluded that there is appropriate natural blur in the video frames saved by the electronic device when the ambient brightness increases. It can be understood that after the electronic device saves the video (for example, Video1) obtained by the recording, the video can be played smoothly without playback jamming due to insufficient motion blur.

[0347] 2. Low frame rate video recording scenarios

[0348] In some embodiments of the present application, in a low frame rate video recording scenario, the frame rate at which the electronic device captures video frames is lower than the frame rate at which the electronic device captures preview frames, and is lower than the frame rate at which the electronic device captures original images. Figure 7B The specific implementation of the above shooting method in this case is introduced.

[0349] S301: During the process of recording a video, the electronic device collects S+1 frames of original images through a camera. The S+1th original image in the S+1 frames is the original image collected by the electronic device based on shooting parameter 1. The first S frames of original images in the S+1 frames are the original images collected by the electronic device based on shooting parameter 2. Shooting parameter 1 is the shooting parameter corresponding to the video stream. The exposure time in shooting parameter 1 is ET1, and the ISO and pixel sensitivity in shooting parameter 1 are adjusted according to the current ambient brightness. Shooting parameter 2 is the shooting parameter corresponding to the preview stream. The exposure time in shooting parameter 2 remains ET2, and the ISO and pixel sensitivity in shooting parameter 2 are adjusted according to the current ambient brightness. ET2 is half of the frame interval corresponding to the frame rate F2. F2 is the preview frame rate of the electronic device during this video recording process.

[0350] During the video recording process, every time the electronic device acquires S frames of original images based on the shooting parameter 2, the shooting parameter is switched from the shooting parameter 2 to the shooting parameter 1, and one frame of original image is acquired based on the shooting parameter 1. That is, after the electronic device acquires the S+1 frame of original image through the camera, the above step of the electronic device acquiring the S+1 frame of original image through the camera can be repeated.

[0351] It is understandable that F1 may be the target video frame acquisition frame rate mentioned above, and F2 may be the preview frame rate 3 mentioned above. In some embodiments of the present application, in a low frame rate video recording scenario, the target video frame acquisition frame rate is less than the target video frame rate.

[0352] In some embodiments of the present application, before executing step S301, the electronic device may further execute step S101-step S102.

[0353] S302: After the electronic device acquires the S+1th frame of original image based on shooting parameter 1, it processes the S+1th frame of original image to obtain a video frame, and saves the obtained video frame. After the electronic device acquires each frame of original image in the first S frames of original image based on shooting parameter 2, it processes each frame of original image to obtain a preview frame, and displays the obtained preview frame on the display screen.

[0354] It can be understood that shooting parameter 1 is a shooting parameter corresponding to the video stream, and shooting parameter 1 is used to capture video frames. Shooting parameter 2 is a shooting parameter corresponding to the preview stream, and shooting parameter 2 is used to capture preview frames.

[0355] In the S+1 frames of original images captured by the electronic device through the camera, the first S frames of original images are used to obtain preview frames, and the S+1th frame of original images is used to obtain video frames. Specifically, each time the electronic device captures any one of the first S frames of original images based on shooting parameter 2, the original image will be processed to obtain a preview frame, and the preview frame will be sent to the display screen for display, and each time the electronic device captures the S+1th frame of original image based on shooting parameter 1, the original image will be processed to obtain a video frame, and the video frame will be saved. In this case, the video saved by the electronic device after the video recording ends is composed of the video frames saved by it.

[0356] It can be understood that the present application does not limit the order of the electronic device collecting preview frames and collecting video frames. In some embodiments of the present application, after the electronic device starts recording a video, it can first collect 1 frame of original image based on shooting parameter 1, and obtain 1 frame of video frame after processing the original image, and then collect S frame original image based on shooting parameter 2, and obtain S frame preview frame after processing, and then repeat this process. In some embodiments of the present application, after the electronic device starts recording a video, it can first collect S frame original image based on shooting parameter 2, and obtain S frame preview frame after processing, and then collect 1 frame original image based on shooting parameter 1, and obtain 1 frame of video frame after processing the original image, and then repeat this process. It is worth noting that the electronic device collects S frame original image based on shooting parameter 2, and obtains S frame preview frame after processing, which can specifically refer to: the electronic device continuously collects S frame original image based on shooting parameter 2, and in the process of continuously collecting the S frame original image, the electronic device can process the original image after collecting each frame of original image, so as to obtain 1 frame of preview frame, and output it to the display screen for display. In this way, the electronic device can continuously display S frame preview frames on the display screen.

[0357] In some embodiments of the present application, after the electronic device executes step S301-step S302, it may receive an instruction to end video recording. In response to the instruction to end video recording, the electronic device may end video recording and save video Video2. Video2 includes video frames obtained by the electronic device after processing the original image captured based on shooting parameter 1 during this video recording process.

[0358] For example, Fig. 9A As shown, during the above-mentioned video recording process, the ambient brightness continues to increase, and the electronic device collects N frames of original images. The electronic device obtains R*S frames of preview frames and R frames of video frames from the N frames of original images. Finally, the video saved by the electronic device may include the R frames of video frames. Among them, R is a positive integer. Taking the electronic device collecting S+1 frames of original images for the first time (i.e., the 1st frame of original image to the S+1th frame of original image) as an example, the process after the electronic device collects S+1 frames of original images is described. Specifically, in the process of the electronic device collecting the 1st frame of original image to the Sth frame of original image, each time a frame of original image is collected, the original image can be processed to obtain a corresponding preview frame, and it is sent to the display screen for display, and after the electronic device collects the S+1th frame of original image, the original image can be processed to obtain a frame of video frame, i.e., the 1st frame of video frame, and it is saved. For example, after the electronic device collects the 1st frame of original image, the original image can be processed to obtain the 1st frame of preview frame. Similarly, after the electronic device collects the Sth frame of original image, the original image can be processed to obtain the Sth frame of preview frame. As Fig. 9A As shown, after the electronic device collects S+1 frames of original images for the first time (i.e., the 1st frame of original image to the S+1th frame of original image), it can start collecting S+1 frames of original images for the second time (i.e., the S+2th frame of original image to the 2S+2th frame of original image). The electronic device can also obtain S preview frames (i.e., the S+1th frame preview frame to the 2Sth frame preview frame) and 1 video frame (i.e., the 2nd frame of video frame) when collecting S+1 frames of original images for the second time, which is the same as the processing process of collecting S+1 frames of original images for the first time. It can be understood that the processing process of the electronic device collecting S+1 frames of original images each time can refer to the process of collecting S+1 frames of original images for the first time.

[0359] like Fig. 9B As shown in (1), according to the enlarged images of pedestrians and vehicles in the first preview frame and the R*S preview frame obtained by the electronic device, it can be concluded that the preview frames displayed on the display screen by the electronic device during the process of increasing ambient brightness have appropriate natural blur. It can be understood that during the above video recording process, the electronic device can display the picture smoothly on the display screen without causing the picture to freeze due to insufficient motion blur. Fig. 9B As shown in (2), according to the enlarged image of pedestrians and vehicles in the first video frame and the Rth video frame saved by the electronic device, it can be concluded that there is appropriate natural blur in the video frames saved by the electronic device when the ambient brightness increases. It can be understood that after the electronic device saves the video (e.g., Video2) obtained by the recording, the video can be played smoothly without playback jamming due to insufficient motion blur.

[0360] It should be noted that, in some embodiments of the present application, the last frame of original image captured by the electronic device before ending video recording can be any frame of original image in the S+1 frame of original image captured for the Rth time, and is not necessarily the S+1th frame of original image in the S+1 frame of original image captured for the Rth time. The present application does not impose any restrictions on this.

[0361] In some embodiments of the present application, during the process of the electronic device capturing the S+1th frame of the original image based on shooting parameter 1, the electronic device always displays on the display screen the last preview frame (i.e., the preview frame obtained by processing the Sth frame of the original image captured based on shooting parameter 2) displayed by the electronic device on the display screen before the S+1th frame of the original image is captured based on shooting parameter 2.

[0362] It should be noted that in some embodiments of the present application, before starting to record a video, the electronic device can identify the current scene and determine F1 based on the identified current scene, thereby determining ET1. In some other embodiments of the present application, before starting to record a video, the user can select a scene by himself, and the electronic device can determine F1 based on the scene selected by the user, thereby determining ET1. In some other embodiments of the present application, before starting to record a video, the user can set F1 or ET1 by himself. This part of the content can be referred to Figure 5B-5D and related descriptions.

[0363] Exemplarily, as shown in Table 4, when the scene is motion delay, the corresponding frame rate, frame interval and exposure time are 1fps, 1s and 1 / 2s respectively; when the scene is traffic / pedestrians, the corresponding frame rate, frame interval and exposure time are 1 / 4fps, 4s and 2s respectively; when the scene is cloud delay, the corresponding frame rate, frame interval and exposure time are 1 / 4fps, 4s and 2s respectively; when the scene is sunrise / sunset / day and night conversion, the corresponding frame rate, frame interval and exposure time are 1 / 6fps, 6s and 3s respectively; when the scene is the starry sky, the corresponding frame rate, frame interval and exposure time are 1 / 30fps, 30s and 15s respectively. It can be understood that before the video recording starts, if the current scene determined by the electronic device or the current scene selected by the user is motion delay, then F1=1fps, ET1=1 / 2s; if the current scene determined by the electronic device or the current scene selected by the user is traffic / pedestrians, then F1=1 / 4fps, ET1=2s; if the current scene determined by the electronic device or the current scene selected by the user is cloud delay, then F1=1 / 4fps, ET1=2s; if the current scene determined by the electronic device or the current scene selected by the user is sunrise / sunset / day and night conversion, then F1=1 / 6fps, ET1=3s; if the current scene determined by the electronic device or the current scene selected by the user is the starry sky, then F1=1 / 30fps, ET1=15s.

[0364] Table 4

[0365] Scenario Frame rate Frame interval Exposure time Mobile Delay 1fps 1s 1 / 2s Traffic / Pedestrians 1 / 4fps 4s 2s Cloud Time-lapse 1 / 4fps 4s 2s Sunrise / Sunset / Day / Night Switch 1 / 6fps 6s 3s Starry Sky 1 / 30fps 30s 15s

[0366] It is understandable that Table 4 is only an example provided in the embodiment of the present application and should not be regarded as a limitation of the present application. In the embodiment of the present application, there may be other scenes, and the frame rate, frame interval and exposure time corresponding to each scene may also adopt other values, which are not limited in the present application.

[0367] For example, Fig.10 As shown, the electronic device enters the time-lapse photography mode and displays a preview interface of the time-lapse photography mode (such as Figure 5BAs shown), in this case, the electronic device can automatically identify the current scene, or the user can select the scene by himself, or the user can set the shooting parameters by himself. After the electronic device determines the current scene, or the user selects the current scene by himself, the electronic device can determine the corresponding shooting parameters (including exposure time) based on the scene. After the electronic device determines the shooting parameters, or the user sets the shooting parameters by himself, the electronic device can automatically load the shooting parameters so that the loaded shooting parameters can be directly used when the video is recorded later. The user triggers the electronic device to start recording the video by clicking the time-lapse photography start control (for example, the time-lapse photography start control 119). The electronic device can capture preview frames at the preview frame rate, pause the capture of preview frames at the time point when the video frames need to be captured according to the frame interval corresponding to the frame rate of the captured video frames, and switch to the corresponding shooting parameters (for example, shooting parameter 1) to capture the video frames. After the capture is completed, the preview is resumed and the preview is switched to the corresponding shooting parameters (for example, shooting parameter 2) to capture the preview frames. After the electronic device captures the video frames, the video frames can be sent to the codec for video encoding so that the video can be obtained after the subsequent video recording is completed.

[0368] The following is a detailed description of how to adjust ISO and pixel sensitivity in shooting parameter 1.

[0369] It can be understood that each time the electronic device captures the S+1th frame of the original image based on the shooting parameter 1, the exposure time in the shooting parameter 1 is kept unchanged at ET1, while the ISO and pixel sensitivity in the shooting parameter 1 may change.

[0370] It can be understood that in the process of the electronic device capturing the S+1th frame of original image for the K+1th time, after the electronic device captures the Sth frame of original image based on the shooting parameter 2, it can switch to the shooting parameter 1 to capture the S+1th frame of original image. Wherein, K is a positive integer.

[0371] In some embodiments of the present application, during the process of the electronic device capturing the original image of the S+1 frame for the K+1th time, before the electronic device switches the shooting parameter from shooting parameter 2 to shooting parameter 1, the shooting parameter 1 used when capturing the original image of the S+1 frame for the Kth time can be adjusted, and the original image of the S+1 frame can be captured based on the adjusted shooting parameter 1.

[0372] Specifically, the shooting parameter 1 adopted by the electronic device when collecting the S+1th frame of the original image for the Kth time includes the exposure time ET1, the sensitivity ISO2 and the pixel sensitivity U2. It can be understood that ISO2 is within the sensitivity range and U2 is within the pixel sensitivity range. Before collecting the S+1th frame of the original image for the K+1th time, the electronic device can determine the current ambient brightness, and determine the second target ISO and the second target pixel sensitivity according to the current ambient brightness. The electronic device can adjust the shooting parameter 1 based on the second target ISO and the second target pixel sensitivity. Specifically, when the second target ISO is different from ISO2, the electronic device can adjust the sensitivity in the shooting parameter 1 from ISO2 to the second target ISO. Similarly, when the second target pixel sensitivity is different from U2, the pixel sensitivity in the shooting parameter 1 is adjusted from U2 to the second target pixel sensitivity. When the electronic device collects the S+1th frame of the original image for the K+1th time, the adjusted shooting parameter 1 can be adopted, that is, the shooting parameter 1 obtained after adjustment based on the second target ISO and the second target pixel sensitivity.

[0373] It can be understood that if the second target ISO is the same as ISO2, the electronic device may not adjust the ISO in the shooting parameter 1, and still use the previously used ISO, that is, ISO2. Similarly, if the second target pixel sensitivity is the same as U2, the electronic device may not adjust the pixel sensitivity in the shooting parameter 1, and still use the previously used pixel sensitivity, that is, U2.

[0374] The second target ISO can be understood as the target value of ISO to be adjusted in shooting parameter 1, and the second target pixel sensitivity can be understood as the target value of pixel sensitivity to be adjusted in shooting parameter 1. It can be understood that the target value can specifically represent the level and degree that each target should achieve.

[0375] In some embodiments of the present application, during the process of the electronic device capturing the original image of the S+1 frame for the K+1th time, before the electronic device switches the shooting parameter from shooting parameter 2 to shooting parameter 1, the electronic device can directly determine the ISO and pixel sensitivity in shooting parameter 1 according to the current ambient brightness, without having to adjust based on shooting parameter 1 adopted when capturing the original image of the S+1 frame for the Kth time.

[0376] Specifically, before capturing the S+1th frame of the original image for the K+1th time, the electronic device may determine the current ambient brightness, and determine the second target ISO and the second target pixel sensitivity according to the current ambient brightness. The electronic device may determine that the ISO in the shooting parameter 1 used in capturing the S+1th frame of the original image for the K+1th time is the second target ISO, and the pixel sensitivity in the shooting parameter 1 used in capturing the S+1th frame of the original image for the K+1th time is the second target pixel sensitivity.

[0377] In some embodiments of the present application, after the electronic device determines the current ambient brightness, it can determine whether the current ambient brightness has changed, that is, whether the current ambient brightness is different from the original ambient brightness. In the case where the current ambient brightness has changed, the electronic device can perform the above steps of determining the second target ISO and the second target pixel sensitivity according to the current ambient brightness.

[0378] It should be noted that the original ambient brightness mentioned here may refer to the ambient brightness when the electronic device captures the S+1th frame of original image for the Kth time, or may refer to the ambient brightness when the electronic device captures a certain frame of original image (for example, the Sth frame of original image) among the previous S frames of original image for the K+1th time.

[0379] In some other embodiments of the present application, the electronic device may perform the above step of adjusting the ISO and pixel sensitivity in the shooting parameter 1 according to the current ambient brightness once every x frames of images (original images or preview frames or video frames) are collected. It is understood that x may be a positive integer.

[0380] In some embodiments of the present application, the electronic device determines the second target ISO and the second target pixel sensitivity according to the current ambient brightness, which may specifically include: the electronic device may search the second corresponding relationship for the ISO and pixel sensitivity corresponding to the ambient brightness being the current ambient brightness, wherein the ISO is the second target ISO, and the pixel sensitivity is the second target pixel sensitivity.

[0381] It can be understood that the second corresponding relationship is the corresponding relationship between the ambient brightness in the low frame rate video recording scene and the shooting parameters (including exposure time, ISO and pixel sensitivity) corresponding to the video stream. In some embodiments of the present application, the electronic device may store the second corresponding relationship. In some other embodiments of the present application, the electronic device may obtain the second corresponding relationship from other devices (e.g., a cloud server).

[0382] Similar to step S204, in some embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the brightness range to which the current ambient brightness belongs. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the brightness range to which the current ambient brightness belongs. In some other embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the ambient brightness closest to the current ambient brightness in the second corresponding relationship. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the ambient brightness closest to the current ambient brightness in the second corresponding relationship.

[0383] The following is a detailed description of how to adjust ISO and pixel sensitivity in shooting parameter 2.

[0384] It can be understood that each time the electronic device acquires the previous S frames of original images based on shooting parameter 2, the exposure time in shooting parameter 2 is kept unchanged as ET2, while the ISO and pixel sensitivity in shooting parameter 2 may change.

[0385] In some embodiments of the present application, during each process of capturing the first S-1 frames of original images and the S+1th frame of original images, the electronic device adjusts the ISO and pixel sensitivity in shooting parameter 2 according to the current ambient brightness each time a frame of original image is captured.

[0386] Specifically, the shooting parameter 2 adopted by the electronic device when acquiring the zth frame of the original image in the S frames before the K-th acquisition includes the exposure time ET2, the sensitivity ISO3 and the pixel sensitivity U3. It can be understood that ISO3 is within the sensitivity range and U3 is within the pixel sensitivity range. Wherein, z is a positive integer and z is less than S. Before the z+1th frame of the original image in the S frames before the K-th acquisition, the electronic device can determine the current ambient brightness, and determine the third target ISO and the third target pixel sensitivity according to the current ambient brightness. The electronic device can adjust the shooting parameter 2 based on the third target ISO and the third target pixel sensitivity. Specifically, when the third target ISO is different from ISO3, the electronic device can adjust the sensitivity in the shooting parameter 2 from ISO3 to the third target ISO. Similarly, when the third target pixel sensitivity is different from U3, the pixel sensitivity in the shooting parameter 2 is adjusted from U3 to the third target pixel sensitivity. When the electronic device acquires the z+1th frame of the original image in the S frames before the K-th acquisition, the adjusted shooting parameter 2, that is, the shooting parameter 2 obtained after adjustment based on the third target ISO and the third target pixel sensitivity.

[0387] It can be understood that if the third target ISO is the same as ISO3, the electronic device may not adjust the ISO in the shooting parameter 2, and still use the previously used ISO, that is, ISO3. Similarly, if the third target pixel sensitivity is the same as U3, the electronic device may not adjust the pixel sensitivity in the shooting parameter 2, and still use the previously used pixel sensitivity, that is, U3.

[0388] The third target ISO may be understood as the target value of ISO to be adjusted in shooting parameter 2 , and the third target pixel sensitivity may be understood as the target value of pixel sensitivity to be adjusted in shooting parameter 2 .

[0389] In some embodiments of the present application, in each process of capturing the first S-1 frames of original images and the S+1th frame of original images, the electronic device will adjust the ISO and pixel sensitivity in shooting parameter 2 according to the current ambient brightness only after capturing multiple frames of original images.

[0390] Specifically, before the z+xth frame of the original image in the S frames of original images before the K-th acquisition, the electronic device may determine the current ambient brightness, and determine the third target ISO and the third target pixel sensitivity according to the current ambient brightness. The electronic device may adjust the shooting parameter 2 based on the third target ISO and the third target pixel sensitivity. Specifically, when the third target ISO is different from ISO3, the electronic device may adjust the sensitivity in the shooting parameter 2 from ISO3 to the third target ISO, otherwise, the electronic device may not adjust the sensitivity in the shooting parameter 2. Similarly, when the third target pixel sensitivity is different from U2, the pixel sensitivity in the shooting parameter 2 is adjusted from U3 to the third target pixel sensitivity, otherwise, the electronic device may not adjust the pixel sensitivity in the shooting parameter 2. When the electronic device acquires the z+1th frame of the original image in the S frames of original images before the K-th acquisition, the electronic device may adopt the adjusted shooting parameter 2, that is, the shooting parameter 2 obtained after adjustment based on the third target ISO and the third target pixel sensitivity.

[0391] In some embodiments of the present application, in each process of capturing the first S-1 frames of original images and the S+1th frame of original images, the electronic device determines the current ambient brightness after capturing x frames of original images. When the difference between the current ambient brightness and the original ambient brightness is not greater than the difference 2, the electronic device may not perform the above-mentioned steps of adjusting the ISO and pixel sensitivity in the shooting parameter 2 according to the current ambient brightness. Otherwise, the electronic device may perform the above-mentioned steps of adjusting the ISO and pixel sensitivity in the shooting parameter 2 according to the current ambient brightness.

[0392] It is understandable that the difference 2 can be set according to actual needs, and the present application does not limit this. For example, the difference 2 can be 100 lux.

[0393] In some embodiments of the present application, in each process of capturing the first S-1 frames of original images and the S+1 frame of original images, the electronic device determines the current ambient brightness after capturing each frame of original images. If the number of original images captured after the last adjustment of shooting parameter 2 reaches x, or the difference between the current ambient brightness and the original ambient brightness is not greater than the difference 2, the electronic device may not perform the above-mentioned steps of adjusting the ISO and pixel sensitivity in shooting parameter 2 according to the current ambient brightness. Otherwise, the electronic device may perform the above-mentioned steps of adjusting the ISO and pixel sensitivity in shooting parameter 2 according to the current ambient brightness.

[0394] Similar to the above-mentioned adjustment of ISO and pixel sensitivity in shooting parameter 1, in some embodiments of the present application, after the electronic device determines the current ambient brightness, it can determine whether the current ambient brightness has changed, that is, whether the current ambient brightness is different from the original ambient brightness. In the case where the current ambient brightness has changed, the electronic device can perform the above-mentioned steps of determining the third target ISO and the third target pixel sensitivity according to the current ambient brightness. It can be understood that the original ambient brightness mentioned here may refer to the ambient brightness obtained when the electronic device last determined the current ambient brightness, for example, the ambient brightness when the electronic device captured the previous frame of the original image.

[0395] In some other embodiments of the present application, the electronic device may perform the above step of adjusting the ISO and pixel sensitivity in shooting parameter 2 according to the current ambient brightness once every x frames of images (original images or preview frames or video frames) are captured.

[0396] In some embodiments of the present application, the electronic device determines the third target ISO and the third target pixel sensitivity according to the current ambient brightness, which may specifically include: the electronic device may search the third corresponding relationship for the ISO and pixel sensitivity corresponding to the ambient brightness being the current ambient brightness, wherein the ISO is the third target ISO, and the pixel sensitivity is the third target pixel sensitivity.

[0397] It can be understood that the third correspondence is the correspondence between the ambient brightness in the low frame rate video recording scene and the shooting parameters (including exposure time, ISO and pixel sensitivity) corresponding to the preview stream. In some embodiments of the present application, the electronic device may store the third correspondence. In some other embodiments of the present application, the electronic device may obtain the third correspondence from other devices (e.g., a cloud server).

[0398] It can be understood that the third corresponding relationship may be the same as the first corresponding relationship, or may be different from the first corresponding relationship.

[0399] Similar to step S204, in some embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the brightness range to which the current ambient brightness belongs. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the brightness range to which the current ambient brightness belongs. In some other embodiments of the present application, the ISO corresponding to the current ambient brightness may specifically be: the ISO corresponding to the ambient brightness closest to the current ambient brightness in the third corresponding relationship. Similarly, the pixel sensitivity corresponding to the current ambient brightness may specifically be: the pixel sensitivity corresponding to the ambient brightness closest to the current ambient brightness in the third corresponding relationship.

[0400] For example, please refer to Table 5 and Table 6, which are examples of the second correspondence and the third correspondence provided in the embodiments of the present application. Table 5 and Table 6 show the second correspondence when F1 is 1 / 4fps, and the third correspondence when F2 is 25fps. The shooting parameters in the second correspondence and the third correspondence shown in Table 5 and Table 6 may include exposure time, sensitivity (ISO) and pixel sensitivity. Among them, the unit of exposure time is s. The unit of ambient brightness is lux. The standard adopted for the sensitivity represented by ISO is the ISO standard. The second correspondence and the third correspondence involved in Table 5 are the correspondences between the ambient brightness range and the shooting parameters, while the second correspondence and the third correspondence involved in Table 6 are the correspondences between the specific ambient brightness and the shooting parameters.

[0401] It can be understood that the relevant description of the second corresponding relationship shown in Table 5 and Table 6, and the relevant description of the third corresponding relationship shown in Table 5 and Table 6 can all refer to the relevant description of step S204, Table 2 and Table 3, and this application will not repeat them here.

[0402] Table 5

[0403]

[0404] Table 6

[0405]

[0406]

[0407] In some embodiments of the present application, when the current ambient brightness is not less than the ambient brightness threshold 5, the second target pixel sensitivity obtained according to the second corresponding relationship is the minimum value of the pixel sensitivity range. In this case, in order to ensure that the image captured by the electronic device is not overexposed, the electronic device can reduce the exposure time. Specifically, the exposure time corresponding to the current ambient brightness can be found in the second corresponding relationship, and the exposure time in the shooting parameter 1 can be adjusted from ET1 to the exposure time corresponding to the current ambient brightness found. It can be understood that the ambient brightness threshold 5 can be set according to actual needs, and the present application does not limit this. For example, the ambient brightness threshold 5 can be 500 lux. When the current ambient brightness is not less than 500 lux, the second target pixel sensitivity determined by the electronic device according to the second corresponding relationship shown in Table 6 is 1 / 1000, that is, the second target pixel sensitivity is the minimum pixel sensitivity in the pixel sensitivity range.

[0408] In some embodiments of the present application, if the pixel sensitivity in shooting parameter 1 used by the electronic device when last capturing the S+1th frame of the original image has reached the minimum value of the pixel sensitivity range, and the current ambient brightness continues to increase, the electronic device can reduce the exposure time to ensure that the captured image is not overexposed. Specifically, the exposure time corresponding to the current ambient brightness can be searched in the second corresponding relationship, and the exposure time in shooting parameter 1 can be adjusted from ET1 to the exposure time corresponding to the current ambient brightness found.

[0409] Exemplarily, as shown in Table 6, ET1=2s. The ambient brightness when the electronic device last captured the S+1th frame of the original image was 500lux, and the shooting parameter 1 used when capturing the original image included an exposure time of 2s, a sensitivity of 100, and a pixel sensitivity of 1 / 1000. It can be understood that 1 / 1000 is the minimum value of the pixel sensitivity range. If the electronic device determines that the current ambient brightness is 1000lux, the electronic device can determine to adjust the exposure time in shooting parameter 1 from 2s to 1s according to the second corresponding relationship shown in Table 6, and continue to maintain the sensitivity and pixel sensitivity in shooting parameter 2 as 100 and 1 / 1000 respectively.

[0410] According to the above, the embodiment of the present application also relates to a preview scene before recording starts in one or more shooting modes. Based on the preview scene, another shooting method provided by the embodiment of the present application is introduced below.

[0411] See also Fig.11 , Fig.11 Another shooting method provided in the embodiment of the present application. The shooting method may include but is not limited to the following steps:

[0412] S401: The electronic device receives an instruction to start a camera application. In response to the instruction to start the camera application, the electronic device starts a camera and opens the camera application.

[0413] It is understandable that the specific implementation of step S401 can refer to the relevant description of step S101.

[0414] In some embodiments of the present application, after the electronic device opens the camera application, it can display a preview interface (for example, Figure 4B User interface 1b) is shown, in this case, the electronic device may execute subsequent step S402.

[0415] In some embodiments of the present application, after the electronic device opens the camera application, the user can trigger the electronic device to switch the shooting mode and display a preview interface in the switched shooting mode (for example, Figure 4C The user interface 1c shown, Figure 5BUser interface 1e) is shown, in this case, the electronic device can execute subsequent step S402.

[0416] S402: In the preview scenario, the electronic device maintains the exposure time used for collecting preview frames at ET3, and adjusts the ISO and pixel sensitivity used for collecting preview frames according to the change in ambient brightness. ET3 is half of the frame interval corresponding to the frame rate F3. F3 is the preview frame rate of the electronic device in the preview scenario.

[0417] It is understood that the preview scene involved in this application refers to the preview state of the electronic device when it enters different shooting modes but does not start recording or taking pictures. For example, the preview state in the normal video mode, the preview state in the time-lapse photography mode, etc.

[0418] It is understandable that F3 may be the preview frame rate 1 mentioned above, or may be the preview frame rate 2 mentioned above.

[0419] In some embodiments of the present application, in a preview scenario, each frame of the original image captured by the electronic device can be processed to obtain a preview frame.

[0420] In some embodiments of the present application, when the current ambient brightness is not less than the ambient brightness threshold 1, the electronic device can keep the exposure time and sensitivity unchanged and adjust the pixel sensitivity; when the current ambient brightness is less than the ambient brightness threshold 1, the electronic device can keep the exposure time and pixel sensitivity unchanged and adjust the sensitivity.

[0421] In some embodiments of the present application, the electronic device adjusts the ISO and pixel sensitivity used for capturing preview frames according to changes in ambient brightness, which may specifically include: the electronic device may determine the current ambient brightness, and determine the fourth target ISO and fourth target pixel sensitivity based on the current ambient brightness, and adjust the ISO and pixel sensitivity used for capturing preview frames to the fourth target ISO and fourth target pixel sensitivity, respectively.

[0422] Similar to step S204, in some embodiments of the present application, when the current ambient brightness changes, the electronic device may determine the fourth target ISO and the fourth target pixel sensitivity. In some other embodiments of the present application, the electronic device may perform the above step of determining the fourth target ISO and the fourth target pixel sensitivity according to the current ambient brightness once every x frames of images (original images or preview frames) are collected.

[0423] In some embodiments of the present application, the electronic device determines the fourth target ISO and the fourth target pixel sensitivity according to the current ambient brightness, which may specifically include: the electronic device may search the fourth corresponding relationship for the ISO and pixel sensitivity corresponding to the ambient brightness being the current ambient brightness, wherein the ISO is the fourth target ISO, and the pixel sensitivity is the fourth target pixel sensitivity.

[0424] It can be understood that the fourth corresponding relationship is the corresponding relationship between the ambient brightness and the shooting parameters (including exposure time, ISO and pixel sensitivity) in the preview scene. In some embodiments of the present application, the electronic device may store the fourth corresponding relationship. In some other embodiments of the present application, the electronic device may obtain the fourth corresponding relationship from other devices (e.g., a cloud server).

[0425] In some embodiments of the present application, the fourth corresponding relationship may be the same as the first corresponding relationship, or may be different from the first corresponding relationship.

[0426] It is understandable that the specific manner in which the electronic device determines the fourth target ISO and the fourth target pixel sensitivity according to the fourth corresponding relationship can refer to the relevant description above (for example, the description of step S204). The meaning and specific use of the fourth corresponding relationship can refer to the description of other corresponding relationships (for example, the first corresponding relationship, the second corresponding relationship, and the third corresponding relationship) above.

[0427] In some embodiments of the present application, after the electronic device opens the camera application, the electronic device can capture preview frames based on default shooting parameters (including default exposure time, default ISO and default pixel sensitivity), and display the captured preview frames on the display screen. Then, the electronic device can determine the preview frame rate (i.e., F3) under the current ambient brightness and the current preview scene, determine the fourth target ISO and the fourth target pixel sensitivity according to the current ambient brightness, and determine ET3 according to F3, and adjust the shooting parameters used for capturing the preview frame from the default shooting parameters to ET3, the fourth target ISO and the fourth target pixel sensitivity.

[0428] In some other embodiments of the present application, after the electronic device opens the camera application, it can first determine the current ambient brightness and the preview frame rate (i.e., F3) in the current preview scene, determine the fourth target ISO and the fourth target pixel sensitivity according to the current ambient brightness, and determine ET3 according to F3, and capture the preview frame based on ET3, the fourth target ISO and the fourth target pixel sensitivity, and then display the preview frame on the display screen.

[0429] In some embodiments of the present application, the electronic device can determine the ambient brightness through the captured image. Specifically, after the electronic device opens the camera application and starts the camera, it can capture the original image based on the default shooting parameters (including the default ISO, the default exposure time and the default pixel sensitivity), and determine the ambient brightness based on the histogram of the captured original image. It is understandable that the electronic device can process the original image captured based on the default shooting parameters and send it to the display screen for display, or it may not send it to the display screen for display.

[0430] In some embodiments of the present application, the electronic device can directly determine the current ambient brightness through a sensor or other module (for example, a light metering sensor) without first capturing an image. Specifically, after the electronic device turns on the camera application and starts the camera, it can directly determine the current ambient brightness through a sensor or other module, and determine the fourth target ISO and the fourth target pixel sensitivity based on the current ambient brightness, and then capture a preview frame based on ET3, the fourth target ISO and the fourth target pixel sensitivity, and display the preview frame on the display.

[0431] It is understandable that the specific method for the electronic device to determine the ambient brightness can refer to the relevant description above, and this application will not go into details here.

[0432] In some embodiments of the present application, the user can adjust the preview frame rate by himself. In some embodiments of the present application, although the user does not adjust the preview frame rate by himself, the preview frame rate may also change because the user triggers the electronic device to execute other strategies (for example, energy saving and power saving strategies). For example, when the user triggers the electronic device to execute strategies such as energy saving and power saving or power consumption reduction, the electronic device can reduce the preview frame rate. It is understandable that when the preview frame rate (i.e., F3) in the preview scenario changes, the electronic device can adjust ET3 according to the changed F3.

[0433] It is worth noting that in the actual shooting process, in order to obtain an image containing more details, the electronic device can adopt different image readout modes (ie, output modes) to improve the dynamic range.

[0434] It can be understood that the image output mode refers to the mode in which the photosensitive element in the image sensor collects charge and reads out and outputs the image data in the form of pixels. The image output modes that the electronic device can use may include one or more of the following: binning, dual conversion gain (DCG), intra-scene dual conversion gain (Intra-scene Dual Convert Gain), dual analog gain (DAG), full pixel (remosaic), in-sensor zoom, staggered high dynamic range (SHDR).

[0435] It can be understood that the shooting method provided in the embodiment of the present application can be applied to electronic devices that adopt the above-mentioned image output mode. However, it should be noted that when the electronic device adopts the DCG mode or the SHDR mode, the electronic device will output two frames of images from the image sensor after one exposure.

[0436] When the electronic device adopts the DCG mode, the electronic device can obtain an LCG image from the low conversion gain (LCG) path and an HCG image from the high conversion gain (HCG) path after one exposure. Since the exposure time for obtaining the LCG image and the HCG image is the same, the shooting method when the electronic device adopts the DCG mode can be directly referred to above.

[0437] When the electronic device adopts the SHDR mode, the electronic device can take multiple frames of images with different exposure times after one exposure. Taking the output of two frames of images from the sensor in one exposure as an example, when the electronic device adopts the SHDR mode, after one exposure, the electronic device can obtain a long exposure frame based on a longer exposure time and a short exposure frame based on a shorter exposure time.

[0438] It should be noted that the electronic device will adopt the SHDR mode only in bright light scenes. For example, when the current ambient brightness is not less than the ambient brightness threshold 2, the electronic device can adopt the SHDR mode.

[0439] It should be noted that motion blur information mainly comes from the midtones and dark parts of the image, and the midtones and dark parts are mainly obtained from long exposure frames. Therefore, the exposure time used by the electronic device in acquiring long exposure frames can remain unchanged according to the shooting method described above, and according to the needs of dynamic range, the exposure time used in acquiring short exposure frames needs to be shortened.

[0440] Understandably, midtones refer to the area between the brightness of the bright parts (highlights) and the dark parts (shadows).

[0441] It is worth noting that after shortening the exposure time used when collecting short exposure frames, the sensitivity ratio between long exposure frames and short exposure frames is still maintained at e:1. Among them, e is a positive number, and its specific value can be set according to actual needs, and this application is not limited to this. For example, e can be 8. It can be understood that the sensitivity ratio refers to the ratio of the product of exposure time, ISO and pixel sensitivity. The sensitivity ratio is related to the dynamic range. In an embodiment of the present application, the electronic device can maintain the dynamic range by maintaining the sensitivity ratio, thereby avoiding obvious changes in the brightness of the picture due to fluctuations in the dynamic range.

[0442] Exemplarily, as shown in Table 7, the frame rate of the currently captured video frames can be 25fps, and the sensitivity ratio of the long exposure frame and the short exposure frame can be 8:1. In this case, the exposure time of the long exposure frame remains unchanged at 1 / 50s. When the ambient brightness is not less than 300lux, the electronic device switches to the SHDR mode. After switching to the SHDR mode, the electronic device can capture one long exposure frame and one short exposure frame for each exposure. Since the ISO and pixel sensitivity used for capturing long exposure frames and short exposure frames are the same, the exposure time used by the electronic device when capturing short exposure frames should be 1 / 8 of the exposure time used when capturing long exposure frames, that is, the exposure time used by the electronic device when capturing short exposure frames is 1 / 400s.

[0443] Table 7

[0444]

[0445] It can be understood that the shooting parameters shown in Table 7 when the ambient brightness is less than 300 lux are shooting parameters that can be used when the electronic device adopts other image output modes, rather than shooting parameters used in the SHDR mode.

[0446] The software structure of the electronic device involved in this application is introduced below.

[0447] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a microservice architecture, or a cloud architecture. Among them, the layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device.

[0448] Fig.12 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0449] like Fig.12As shown, the software framework of the electronic device may include an application layer, an application framework layer, a system library, a runtime (Runtime), a hardware abstraction layer (HAL) and a kernel layer.

[0450] The application layer may include a series of application packages. Generally speaking, the application layer may include system applications and third-party applications. System applications are a series of core applications that come with the Android system. For example, system applications may include applications such as camera, music, calendar, short message, WLAN, call, and gallery. Third-party applications are applications that users can choose to install. In some embodiments of the present application, users can download and install third-party applications in the application store.

[0451] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer can include a series of system services. System services are modular components that focus on specific functions. The functions provided by the application framework API can communicate with system services to access the underlying hardware.

[0452] like Fig.12As shown, the application framework layer may include a content provider, a window manager, a resource manager, a phone manager, a notification manager, and a view system. The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for electronic devices. For example, the management of call status (including connected, hung up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the top status bar of the system in the form of an icon or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0453] The system library can include multiple functional modules. For example: Surface Manager, Media Libraries, 3D graphics processing library (for example, OpenGL ES), 2D graphics engine (for example, SGL), etc. The specific meanings and functions of these functional modules can be referred to in the relevant technical documents, which will not be described in detail here. The specific meanings and functions of these functional modules can be referred to in the relevant technical documents, which will not be described in detail here.

[0454] The runtime is responsible for the scheduling and management of the system. The runtime includes the core library and the virtual machine.

[0455] The hardware abstraction layer (HAL) is an interface layer between the operating system kernel and the upper software, and its purpose is to abstract the hardware. The hardware abstraction layer is an abstract interface driven by the device kernel, which is used to implement the application programming interface that provides access to the underlying device to the higher-level Java API framework. HAL can provide a standard interface to display the device hardware functions to the higher-level Java API framework. HAL contains multiple library modules, such as perception modules and AEC modules. Each library module implements an interface for a specific type of hardware component. When the system framework layer API requires access to the hardware of the portable device, the operating system will load the library module for the hardware component. In some embodiments of the present application, the perception module and the AEC module are submodules in the camera HAL. The camera HAL is located between the camera driver and the higher-level Android framework, and can define the interface of the relevant implementation so that the camera application can correctly operate the camera hardware.

[0456] The perception module can be used to identify the current scene (for example, motion delay, traffic / pedestrians, cloud delay, sunrise / sunset / day / night transition and starry sky options, etc.).

[0457] In some embodiments of the present application, the AEC module may include an AEC algorithm module and an AEC statistics module. The AEC statistics module is used to statistically analyze the parameters in the collected image, such as image brightness, etc. The AEC algorithm module can automatically adjust the exposure parameters of the camera according to the statistical results, and the AEC algorithm module can also estimate the ambient brightness according to the statistical results.

[0458] It is understandable that the camera HAL may also include related modules for pre-processing and post-processing the images captured by the camera, so as to obtain corresponding processed images, for example, preview images and recorded images in the video recording mode.

[0459] In some embodiments of the present application, the hardware abstraction layer may further include an ISP control module. The ISP control module is a software processing module corresponding to the ISP. The ISP control module may be used to transmit images processed by the ISP to other software modules (e.g., a perception module, a camera application, etc.) so that the other software modules may perform subsequent processing.

[0460] The kernel layer is the layer between hardware and software. The kernel layer is the foundation of the Android system. The kernel layer is responsible for hardware drivers, networking, power, system security, and memory management. The kernel layer is an intermediate layer between hardware and software, and its role is to pass application requests to the hardware. The kernel layer can include display drivers, camera drivers, audio drivers, and sensor drivers.

[0461] It should be noted that the application provides Fig.12The software architecture diagram of the electronic device shown is only an example and does not limit the specific module division in different layers of the Android system. For details, please refer to the introduction of the Android system software architecture in conventional technology. In addition, the display method provided by this application can also be implemented based on other operating systems, and this application will not cite examples one by one.

[0462] The following is based on Figure 2A and Fig.12 The software and hardware structure of the electronic device shown introduces a shooting method provided by an embodiment of the present application from the perspective of software and hardware interaction.

[0463] See also Fig.13 , Fig.13 A software and hardware interaction diagram provided for an embodiment of the present application.

[0464] like Fig.13 As shown, the acquisition and processing process of the preview stream may specifically include: (1) the electronic device outputs the original image (i.e., RAW image) through the image sensor in the camera, and outputs the original image to the image processor front end in the ISP included in the electronic device; (2) the image processor front end processes the original image to obtain a processed image, and transmits it to the spatial alignment transform (SAT) module (also known as the multi-camera smooth switching module) in the ISP; (3) the SAT module can process the image transmitted from the image processor front end to obtain a processed image, and transmit it to the image processor back end in the ISP; (4) the image processor back end can process the image transmitted from the SAT module to obtain a processed image, and transmit it to the image processing module 1 in the ISP; (5) the image processing module 1 can process the image transmitted from the image processor back end to obtain a processed image, and transmit the processed image to the display screen through the I / O control interface for display.

[0465] Among them, the SAT module can be used to achieve a smooth transition of the picture when multiple cameras are switched, and the image processing module 1 can be used to perform denoising and contrast adjustment on the image. In some embodiments of the present application, the image processing module 1 can achieve denoising and contrast adjustment through a YUV algorithm. It can be understood that YUV is a format of an image (similar to the RGB format / mode of an image).

[0466] like Fig.13As shown, the video stream acquisition and processing process may specifically include: (1) the electronic device outputs the original image through the image sensor in the camera, and outputs the original image to the image processor front end; (2) the image processor front end processes the original image to obtain a processed image, and transmits it to the Bayer image processor in the ISP; (3) the Bayer image processor can process the image transmitted from the image processor front end to obtain a processed image, and transmit it to the image processing module 2 in the ISP; (4) the image processing module 2 can process the image transmitted from the Bayer image processor to obtain a processed image, and transmit it to the image processor back end; (5) the image processor back end can process the image transmitted from the SAT module to obtain a processed image, and transmit it to the image processing module 3; (6) the image processing module 3 can process the image transmitted from the image processor back end to obtain a processed image, and transmit it to the codec (for example, a video codec); (7) the codec can perform video encoding on the image transmitted from the image processing module 3, and then put it into the memory (for example, as Figure 2A to a specific file in the internal memory (as shown).

[0467] Among them, the Bayer image processor can be used to obtain the color information of the image, thereby obtaining a color image, and the image processing module 2 and the image processing module 3 can be used to perform denoising on the image, adjust the contrast, etc. In some embodiments of the present application, the image processing module 2 can implement denoising through the RAW algorithm, and the image processing module 3 can implement denoising and contrast adjustment through the YUV algorithm.

[0468] like Fig.13 As shown, the scene recognition process may specifically include: (1) the electronic device outputs the original image through the image sensor in the camera, and outputs the original image to the image processor front end; (2) the image processor front end processes the original image to obtain a processed image, and transmits it to the image processor back end; (3) the image processor back end can process the image transmitted from the image processor front end to obtain a processed image, and transmit it to the ISP control module of the HAL layer; (4) the ISP control module can transmit the image transmitted from the image processor back end to the perception module; (5) the perception module can perform scene recognition based on the image transmitted from the ISP control module, obtain a scene recognition result, and transmit the scene recognition result to the AEC module; (6) the AEC module can determine the corresponding shooting parameters based on the scene recognition result.

[0469] like Fig.13As shown, the shooting parameter adjustment process may specifically include: (1) the electronic device outputs the original image through the image sensor in the camera, and outputs the original image to the image processor front end; (2) the image processor front end processes the original image to obtain a histogram corresponding to the image, and transmits the histogram to the ISP control module; (3) the ISP control module may send the histogram transmitted from the image processor front end to the AEC module; (4) the AEC module may statistically analyze the brightness and other parameters in the collected image based on the histogram, and then estimate the current ambient brightness based on the shooting parameters currently used by camera 1, and then determine the shooting parameters such as the target ISO and the target pixel sensitivity based on the current ambient brightness, and transmit the shooting parameters to the image sensor in camera 1; (5) after the image sensor receives the shooting parameters such as the target ISO and the target pixel sensitivity transmitted from the AEC module, it may adjust the shooting parameters and output the image based on the adjusted shooting parameters.

[0470] The ISP is used to process the RAW image from the camera and generate an image to be displayed, and send the image to be displayed to the display screen for display. In the video recording scenario, the image to be displayed can be an image in YUV (or understood as brightness and chrominance) format. In this case, the image signal processor can send the image in YUV format to the display screen for display.

[0471] The role of the image processor front end in the ISP (i.e., the pre-processing process) includes one or more, for example: bad pixel correction processing, RAW domain noise reduction processing, black level correction processing, optical shading correction processing, automatic white balance processing, color interpolation processing, color correction processing, global tone mapping processing, or image conversion processing, etc. It can be understood that the image pre-processing process is not limited in the embodiments of the present application.

[0472] The image processor backend in the ISP can post-process the pre-processed image. The role of the image processor backend in the ISP (i.e., the post-processing process) includes one or more steps, such as image correction and adjustment processing, local tone mapping processing, and gamma correction processing. In the image correction and adjustment processing, IPE can perform anti-shake processing on the image. In the local tone mapping processing, IPE can adjust the overall brightness of the image so that the picture after brightness adjustment can be closer to the brightness presented in the real world. In the gamma correction processing, IPE can adjust the brightness of the image so that it can retain more details in the bright and dark parts, compress the contrast, and retain more color information.

[0473] On the one hand, the image processor backend can use the post-processed image sequence as a preview stream or a video stream. The preview stream can be displayed on the display screen through the input / output (I / O) control interface, and the video stream can be saved in the corresponding file after video encoding via the codec. On the other hand, the image processor backend can send the post-processed image sequence to the perception module, so that the perception module can perform scene recognition based on the post-processed image sequence. The perception module then sends the scene recognition result to the AEC module. The AEC module can determine the corresponding shooting parameters based on the scene recognition result.

[0474] Optionally, the electronic device may further include a light metering sensor, which may monitor the ambient brightness and the ambient dynamic range. In some embodiments of the present application, the light metering sensor is integrated inside the camera.

[0475] In some embodiments of the present application, if the user triggers the end of recording, the electronic device can save the recorded video frames in the form of video in a gallery.

[0476] In some embodiments of the present application, during the process of recording a video, a user can trigger the saving of a video frame during the process of recording a video. In this case, the electronic device can save the video frame that the user triggers to save in a gallery.

[0477] It is understandable that the electronic device may also include more cameras. The process of switching to other cameras to collect images can refer to Fig.13 The process of camera 1 capturing images is shown.

[0478] Understandable, Fig.13 The SAT module, Bayer image processor, image processing module 1, image processing module 2 and image processing module 3 in the ISP shown are optional.

[0479] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A shooting method, characterized in that: The method is applied to an electronic device provided with a camera, and the method comprises: The electronic device receives a first instruction; In response to the first instruction, the electronic device continuously captures multiple frames of images through the camera; The electronic device receives a second instruction; In response to the second instruction, the electronic device saves a first video; the first video includes a first image and a second image; The first image is: an image captured by the electronic device through exposure based on a first exposure time, a first sensitivity, and a first pixel sensitivity under a first ambient brightness; The second image is: an image captured by the electronic device under a second ambient brightness by exposure based on the first exposure time, the second sensitivity and the second pixel sensitivity; Among them, the first ambient brightness is less than the second ambient brightness; the first exposure time is half of the frame interval corresponding to the first frame rate; the first frame rate is the frame rate used by the electronic device when collecting images constituting the first video; the first pixel sensitivity is greater than the second pixel sensitivity; the pixel sensitivity is used to characterize the photoelectric conversion rate of the image sensor in the camera.

2. The method according to claim 1, characterized in that The second environment brightness is not less than the first environment brightness threshold, and the second sensitivity is not greater than the first sensitivity.

3. The method according to claim 1 or 2, characterized in that The first video also includes a third image; the third image is: an image captured by the electronic device through exposure based on the first exposure time, the third sensitivity and the third pixel sensitivity under a third ambient brightness; The third environment brightness is lower than the first environment brightness, and the first environment brightness is lower than the first environment brightness threshold; the third sensitivity is higher than the first sensitivity; The third pixel sensitivity is the same as the first pixel sensitivity.

4. The method according to claim 1 or 2, characterized in that: The first frame rate is not less than a first frame rate threshold; the electronic device continuously acquires multiple frames of images through the camera, specifically comprising: under the first ambient brightness, the electronic device acquires a first original image through the camera based on the first exposure time, the first sensitivity and the first pixel sensitivity; under the second ambient brightness, the electronic device acquires a second original image through the camera based on the first exposure time, the second sensitivity and the second pixel sensitivity; After the electronic device acquires the first original image, the method further includes: the electronic device processes the first original image to obtain the first image and a fourth image, saves the first image, and displays the fourth image on a display screen; After the electronic device acquires the second original image, the method further includes: the electronic device processes the second original image to obtain the second image and a fifth image, saves the second image, and displays the fifth image on the display screen.

5. The method according to claim 1, characterized in that The first frame rate is less than the second frame rate threshold; the electronic device continuously acquires multiple frames of images through the camera, specifically including: the electronic device acquires S frames of original images based on the second exposure time between each acquisition of two adjacent frames of images in the first video; The second exposure time is half of the frame interval corresponding to the second frame rate; the second frame rate is the frame rate at which the electronic device displays an image on the display screen; S is an integer greater than 1; in the process of acquiring images constituting the first video, under the first ambient brightness, the electronic device acquires a first original image through the camera based on the first exposure time, the first sensitivity and the first pixel sensitivity, and acquires a second original image through the camera based on the first exposure time, the second sensitivity and the second pixel sensitivity under the second ambient brightness; The method further comprises: After acquiring the first original image, the electronic device processes the first original image to obtain and save the first image; After acquiring the second original image, the electronic device processes the second original image to obtain and save the second image; After acquiring each of the S frames of original images, the electronic device processes each of the S frames of original images and displays the processed images on the display screen.

6. The method according to claim 5, characterized in that When the first remainder is not less than 0.5, S is the sum of the first value and 1; when the first remainder is less than 0.5, S is the first value; the first remainder is the remainder obtained by dividing the first exposure time by the frame interval corresponding to the second frame rate; the first value is the quotient obtained by dividing the first exposure time by the frame interval corresponding to the second frame rate.

7. The method according to claim 5, characterized in that The z1th original image of the S frames of original images acquired by the electronic device through the camera based on the second exposure time is: the original image acquired by the electronic device based on the second exposure time, the fourth sensitivity and the fourth pixel sensitivity under the fourth ambient brightness; The z1th original image frame is any one of the S original images; z1 is a positive integer not greater than S; The z2th original image of the S frames of original images acquired by the electronic device through the camera based on the second exposure time is: the original image acquired by the electronic device based on the second exposure time, the fifth sensitivity and the fifth pixel sensitivity under the fifth ambient brightness; The z2th original image frame is any one of the S original images; z2 is a positive integer not greater than S, and z1 is not equal to z2; The fourth environment brightness is lower than the fifth environment brightness; and the fourth pixel sensitivity is higher than the fifth pixel sensitivity.

8. The method according to claim 7, characterized in that The fifth environment brightness is not less than the second environment brightness threshold, and the fourth sensitivity is not less than the fifth sensitivity.

9. The method according to claim 7 or 8, characterized in that The z3th original image among the S original images acquired by the electronic device through the camera based on the second exposure time is: an original image acquired by the electronic device based on the second exposure time, the sixth sensitivity and the sixth pixel sensitivity under the sixth ambient brightness; the z3th original image is any one of the S original images; z3 is a positive integer not greater than S, and z3 is not equal to z2, and z3 is not equal to z1; The sixth environment brightness is lower than the fourth environment brightness, and the fourth environment brightness is lower than the second environment brightness threshold; the sixth sensitivity is higher than the fourth sensitivity; the sixth pixel sensitivity is the same as the fourth pixel sensitivity.

10. The method according to any one of claims 1, 2, 5-8, characterized in that: The first instruction is an instruction for the first control; Before the electronic device receives the first instruction, the method further includes: The electronic device receives a third instruction; In response to the third instruction, the electronic device opens a camera application and starts the camera to display a first interface; the first interface includes a preview window and the first control; the preview window displays the sixth image and the seventh image in sequence; The sixth image is: an image captured by the electronic device through exposure based on the third exposure time, the seventh sensitivity and the seventh pixel sensitivity under the seventh ambient brightness; The seventh image is: an image captured by the electronic device through exposure based on the third exposure time, the eighth sensitivity and the eighth pixel sensitivity under the eighth ambient brightness; Among them, the seventh ambient brightness is smaller than the eighth ambient brightness; the third exposure time is half of the frame interval corresponding to the third frame rate; the third frame rate is the frame rate at which the electronic device displays an image on the display screen; and the seventh pixel sensitivity is greater than the eighth pixel sensitivity.

11. The method according to claim 1, characterized in that When the second environment brightness is greater than the first environment brightness threshold, the electronic device, in a process of acquiring the second image, specifically includes: The electronic device acquires a fifth original image based on the first exposure time, the second sensitivity and the second pixel sensitivity after one exposure, and acquires a sixth original image based on the fourth exposure time, the second sensitivity and the second pixel sensitivity; The electronic device processes the fifth original image and the sixth original image to obtain the second image; Among them, the ratio of the first exposure time to the fourth exposure time is e; and e is an integer greater than 1.

12. The method according to any one of claims 1 to 2 and 11, characterized in that: After the electronic device saves the first video, the method further includes: The electronic device receives a fourth instruction; In response to the fourth instruction, the electronic device plays the first video at the first frame rate.

13. A shooting method, characterized in that: The method is applied to an electronic device provided with a camera, and the method comprises: The electronic device receives a third instruction; In response to the third instruction, the electronic device opens a camera application and starts the camera to display a first interface; the first interface includes a preview window and a first control; the preview window displays the sixth image and the seventh image in sequence; The sixth image is: an image captured by the electronic device through exposure based on the third exposure time, the seventh sensitivity and the seventh pixel sensitivity under the seventh ambient brightness; The seventh image is: an image captured by the electronic device through exposure based on the third exposure time, the eighth sensitivity and the eighth pixel sensitivity under the eighth ambient brightness; Among them, the seventh ambient brightness is less than the eighth ambient brightness; the third exposure time is half of the frame interval corresponding to the third frame rate; the third frame rate is the frame rate at which the electronic device displays an image on the display screen; the seventh pixel sensitivity is greater than the eighth pixel sensitivity; the pixel sensitivity is used to characterize the photoelectric conversion rate of the image sensor in the camera.

14. The method according to claim 13, characterized in that The eighth ambient brightness is not less than a third ambient brightness threshold, and the eighth sensitivity is not greater than the seventh sensitivity.

15. The method according to claim 13 or 14, characterized in that The method further comprises: The electronic device displays an eighth image through the preview window; The eighth image is: an image captured by the electronic device through exposure based on the third exposure time, the ninth sensitivity and the ninth pixel sensitivity under a ninth ambient brightness; Among them, the ninth ambient brightness is less than the seventh ambient brightness, and the seventh ambient brightness is less than the third ambient brightness threshold; the ninth sensitivity is greater than the seventh sensitivity; and the ninth pixel sensitivity is the same as the seventh pixel sensitivity.

16. An electronic device, characterized in that: The electronic device includes a camera, a memory and a processor; the camera is coupled to the memory and the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and the processor calls the computer instructions to execute the method described in any one of claims 1-12 or the method described in any one of claims 13-15.

17. A computer-readable storage medium, characterized in that: Used to store computer instructions, when the computer instructions are executed on an electronic device, the electronic device executes the method described in any one of claims 1 to 12 or the method described in any one of claims 13 to 15.

Images