Photographing parameter setting method and electronic equipment

Abstract

The invention provides a photographing parameter setting method and electronic equipment. In the method, the electronic equipment issues exposure parameters to hardware at the SOF of the Nth frame, so that new exposure parameters begin to take effect at the (N + 2) th frame. Moreover, a new aperture parameter starts to take effect at the EOF of the Nth frame, so that the influence of aperture adjustment on the image frame is effectively reduced.

Description

Technical Field

[0001] The present application relates to the field of terminal devices, and in particular to a method for setting photographing parameters and an electronic device. Background Art

[0002] With the development of terminal technology, the application scenarios of terminal devices are becoming more and more extensive. For example, users can use mobile phones to take pictures to meet the user's need to use photos to record daily needs. In terminal devices, the aperture is a component used to control the size of the lens aperture to control the depth of field, control the lens imaging quality, and work with the shutter to control the amount of light entering. However, due to the size of the mobile phone, the camera of the terminal device usually uses a fixed aperture to take pictures. Due to the limitation of the fixed aperture, the user's experience of taking pictures and videos is average. Accordingly, the existing technology uses a camera module with a variable aperture, which can control the amount of light entering by adjusting the size of the variable aperture, thereby improving the user's experience of taking pictures and videos. Summary of the Invention

[0003] The present application provides a method for setting photographing parameters and an electronic device. In this method, aperture parameters are adjusted based on the EOF of an image frame to reduce the impact of the aperture parameter adjustment on the exposure of the image frame.

[0004] In a first aspect, the present application provides a method for setting photographing parameters, the method comprising: at a first moment, the electronic device obtains a first exposure parameter and a first aperture parameter of the Nth frame. At a second moment, the electronic device sends the first exposure parameter to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter. At a third moment, the aperture component of the electronic device adjusts the aperture based on the first aperture parameter. The first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the Nth frame. In this way, the present application sends the exposure parameter at the moment corresponding to the SOF of the Nth frame, and takes effect on the aperture parameter at the moment corresponding to the EOF of the Nth frame, so that in the N+2 frame, the aperture parameter and the exposure parameter can match each other, thereby reducing the range of influence of the aperture parameter adjustment on the image frame.

[0005] In one possible implementation, the method further includes: during the display duration corresponding to the N+2th frame, the electronic device displays the image corresponding to the N+2th frame based on the first exposure parameter and the first aperture parameter. In this way, the exposure parameter and the aperture parameter of the N+2th frame are matched, thereby obtaining a properly exposed image frame, and the N+2th frame is displayed during the corresponding display duration.

[0006] In one possible implementation, the method further includes: displaying the image corresponding to the Nth frame based on a second exposure parameter and a second aperture parameter during a display duration corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; and displaying the image corresponding to the Nth frame during a display duration corresponding to the N+1th frame. In this way, during the exposure process, the electronic device only discards one frame (i.e., the N+1th frame), shortening the duration of the freeze and reducing the visual impact on the user.

[0007] In one possible implementation, obtaining the first exposure parameter and the first aperture parameter of the Nth frame at a first moment includes: the electronic device obtaining the first exposure parameter and the first aperture parameter in response to a received user operation; determining, via an automatic exposure module, that the first exposure parameter and the first aperture parameter are applied to the Nth frame; and caching the first exposure parameter and the first aperture parameter in the camera driver. In this way, the electronic device caches the capture parameters before the Nth frame and can send them to the corresponding hardware upon subsequent triggering.

[0008] In one possible implementation, sending the first exposure parameter to the camera sensor at the second moment includes: at the second moment, the image front-end (IFE) module, in response to a first SOF signal output by the camera sensor, instructs the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; and the camera sensor, in response to the received first exposure parameter, performs exposure based on the first exposure parameter, starting from the N+2th frame. In this way, the IFE can monitor a designated pin of the camera sensor to obtain the SOF signal output by the camera sensor, thereby triggering the exposure parameter sending process.

[0009] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the second moment, the IFE module, in response to the first SOF signal output by the camera sensor, instructs the camera driver to send the first aperture parameter to the aperture image stabilization (OIS) module; the OIS module receives the first aperture parameter sent by the camera driver; at the third moment, the OIS module receives the first OIS pin signal output by the camera sensor and sends the first aperture parameter to the aperture assembly, whereupon the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the end of frame (EOF) of the Nth frame. In this way, the OIS module can determine the end of frame (EOF) of the Nth frame by monitoring the sensor using the OIS pin signal. This allows the aperture parameter to take effect at the EOF.

[0010] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the third moment, the camera driver receives a first OIS pin signal output by the camera sensor and sends the first aperture parameter to the OIS module; the OIS module, in response to the first aperture parameter sent by the camera driver, sends the first aperture parameter to the aperture assembly, and the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the end of frame (EOF) of the Nth frame. This eliminates the need for the OIS to pre-cache the aperture parameter, saving memory resources.

[0011] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter. This includes: at the third moment, the IFE module, in response to a first EOF signal output by the camera sensor, instructs the camera driver to send the first aperture parameter to the OIS module; the first EOF signal is used to indicate the EOF of the Nth frame; the OIS module, in response to the first aperture parameter sent by the camera driver, sends the first aperture parameter to the aperture assembly, and the aperture assembly adjusts the aperture based on the first aperture parameter. This eliminates the need for pre-caching the OIS, conserving memory resources. The IFE can directly obtain the EOF signal, enabling accurate detection of the EOF of the Nth frame.

[0012] In a second aspect, the present application provides a method for setting photographic parameters, characterized in that it is applied to an electronic device, and the method includes: at a first moment, obtaining a first exposure parameter and a first aperture parameter of the Nth frame; at a second moment, sending the first exposure parameter to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; at a third moment, the aperture component adjusts the aperture based on the first aperture parameter; wherein the first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the N+1th frame. In this way, the present application sends the exposure parameter at the moment corresponding to the SOF of the Nth frame, and takes effect on the aperture parameter at the moment corresponding to the EOF of the N+1th frame, so that in the N+3 frame, the aperture parameter and the exposure parameter can match each other, thereby reducing the range of influence of the aperture parameter adjustment on the image frame.

[0013] In a possible implementation, the method further includes: displaying an image corresponding to the N+3th frame based on the first exposure parameter and the first aperture parameter within a display duration corresponding to the N+3th frame.

[0014] In one possible implementation, the method further includes: displaying the image corresponding to the Nth frame based on the second exposure parameter and the second aperture parameter within the display time corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; displaying the image corresponding to the N+1th frame based on the second exposure parameter and the second aperture parameter within the display time corresponding to the N+1th frame; and displaying the image corresponding to the N+1th frame within the display time corresponding to the N+2th frame.

[0015] In one possible implementation, at a first moment, a first exposure parameter and a first aperture parameter of the Nth frame are obtained, including: obtaining the first exposure parameter and the first aperture parameter in response to a received user operation; determining, through an automatic exposure module, that the first exposure parameter and the first aperture parameter act on the Nth frame; and caching the first exposure parameter and the first aperture parameter in a camera driver.

[0016] In one possible implementation, the first exposure parameter is sent to the camera sensor, including: at the second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor, instructing the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; the camera sensor responds to the received first exposure parameter, and starts exposing based on the first exposure parameter from the N+2th frame.

[0017] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the second moment, the IFE module responds to the first SOF signal output by the camera sensor, instructing the camera driver to send the first aperture parameter to the aperture anti-shake OIS module; the OIS module receives the first aperture parameter sent by the camera driver; at the third moment, the OIS module obtains the first OIS pin signal output by the camera sensor, sends the first aperture parameter to the aperture assembly, and the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

[0018] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the third moment, the camera driver obtains the first OIS pin signal output by the camera sensor and sends the first aperture parameter to the OIS module; the OIS module sends the first aperture parameter to the aperture assembly in response to the first aperture parameter sent by the camera driver, and the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

[0019] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the third moment, the IFE module responds to the first EOF signal output by the camera sensor, instructing the camera driver to send the first aperture parameter to the OIS module; the first EOF signal is used to indicate the EOF of the N+1th frame; the OIS module responds to the first aperture parameter sent by the camera driver, sends the first aperture parameter to the aperture assembly, and the aperture assembly adjusts the aperture based on the first aperture parameter.

[0020] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.

[0021] In a third aspect, the present application provides an electronic device comprising: one or more processors, a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: at a first moment, obtaining the first exposure parameter and the first aperture parameter of the Nth frame; at a second moment, sending the first exposure parameter to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; at a third moment, the aperture component adjusts the aperture based on the first aperture parameter; wherein the first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the Nth frame.

[0022] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: within the display time corresponding to the N+2 frame, based on the first exposure parameter and the first aperture parameter, display the image corresponding to the N+2 frame.

[0023] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: within the display time corresponding to the Nth frame, based on the second exposure parameter and the second aperture parameter, displaying the image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; within the display time corresponding to the N+1th frame, displaying the image corresponding to the Nth frame.

[0024] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a received user operation, obtaining a first exposure parameter and a first aperture parameter; determining, through an automatic exposure module, that the first exposure parameter and the first aperture parameter are applied to the Nth frame; and caching the first exposure parameter and the first aperture parameter in a camera driver.

[0025] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor, instructing the camera driver to send a first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; the camera sensor responds to the received first exposure parameter, and starts exposing based on the first exposure parameter from the N+2th frame.

[0026] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a second moment, the IFE module responds to the first SOF signal output by the camera sensor and instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module; the OIS module receives the first aperture parameter sent by the camera driver; at a third moment, the OIS module obtains the first OIS pin signal output by the camera sensor and sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

[0027] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a third moment, the camera driver obtains a first OIS pin signal output by the camera sensor and sends a first aperture parameter to the OIS module; the OIS module sends the first aperture parameter to the aperture assembly in response to the first aperture parameter sent by the camera driver, and the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

[0028] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a third moment, the IFE module responds to the first EOF signal output by the camera sensor, instructing the camera driver to send a first aperture parameter to the OIS module; the first EOF signal is used to indicate the EOF of the Nth frame; the OIS module responds to the first aperture parameter sent by the camera driver, sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter.

[0029] In a fourth aspect, the present application provides an electronic device comprising: one or more processors, a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: at a first moment, obtaining the first exposure parameter and the first aperture parameter of the Nth frame; at a second moment, sending the first exposure parameter to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; at a third moment, the aperture component adjusts the aperture based on the first aperture parameter; wherein the first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the N+1th frame.

[0030] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: within the display time corresponding to the N+3 frame, based on the first exposure parameter and the first aperture parameter, display the image corresponding to the N+3 frame.

[0031] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: within the display time corresponding to the Nth frame, based on the second exposure parameter and the second aperture parameter, displaying the image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; within the display time corresponding to the N+1th frame, based on the second exposure parameter and the second aperture parameter, displaying the image corresponding to the N+1th frame; within the display time corresponding to the N+2th frame, displaying the image corresponding to the N+1th frame.

[0032] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a received user operation, obtaining a first exposure parameter and a first aperture parameter; determining, through an automatic exposure module, that the first exposure parameter and the first aperture parameter are applied to the Nth frame; and caching the first exposure parameter and the first aperture parameter in a camera driver.

[0033] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor, instructing the camera driver to send a first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; the camera sensor responds to the received first exposure parameter, and starts exposing based on the first exposure parameter from the N+2th frame.

[0034] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a second moment, the IFE module responds to the first SOF signal output by the camera sensor and instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module; the OIS module receives the first aperture parameter sent by the camera driver; at a third moment, the OIS module obtains the first OIS pin signal output by the camera sensor and sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

[0035] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: at a third moment, the camera driver obtains a first OIS pin signal output by the camera sensor and sends a first aperture parameter to the OIS module; the OIS module sends the first aperture parameter to the aperture assembly in response to the first aperture parameter sent by the camera driver, and the aperture assembly adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

[0036] In one possible implementation, at the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: at the third moment, the IFE module responds to the first EOF signal output by the camera sensor, instructing the camera driver to send the first aperture parameter to the OIS module; the first EOF signal is used to indicate the EOF of the N+1th frame; the OIS module responds to the first aperture parameter sent by the camera driver, sends the first aperture parameter to the aperture assembly, and the aperture assembly adjusts the aperture based on the first aperture parameter.

[0037] In a fifth aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0038] In a sixth aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the second aspect or any possible implementation of the second aspect.

[0039] In a seventh aspect, the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0040] In an eighth aspect, the present application provides a computer program comprising instructions for executing the method in the second aspect or any possible implementation of the second aspect.

[0041] In a ninth aspect, the present application provides a chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the first aspect or any possible implementation of the first aspect to control the receive pin to receive a signal and to control the transmit pin to send a signal.

[0042] In a tenth aspect, the present application provides a chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the second aspect or any possible implementation of the second aspect to control the receive pin to receive a signal and to control the transmit pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 Schematic diagram of aperture change shown as an example

[0044] Figure 2a is a schematic diagram of an exemplary manual exposure;

[0045] Figure 2b is a schematic diagram of automatic exposure shown as an example;

[0046] Figure 3 is a schematic diagram of the hardware structure of an electronic device shown as an example;

[0047] Figure 4 is a schematic diagram of an exemplary camera module;

[0048] Figure 5 is a schematic diagram of the software structure of an electronic device shown as an example;

[0049] Figure 6 FIG1 is an exemplary image frame exposure timing diagram;

[0050] Figure 7 FIG1 is an exemplary image frame exposure timing diagram;

[0051] Figure 8 Schematic diagram of hardware connection shown as an example;

[0052] Figure 9 is a schematic diagram of signal output shown as an example;

[0053] Figure 10 FIG1 is an exemplary image frame exposure timing diagram;

[0054] Figure 11 is a schematic diagram of module interaction shown as an example;

[0055] Figure 12 is a flowchart illustrating an exemplary method for setting photographing parameters;

[0056] Figure 13 FIG1 is an exemplary image frame exposure timing diagram;

[0057] Figure 14 Schematic diagram of hardware connection shown as an example;

[0058] Figure 15 is a flowchart illustrating an exemplary method for setting photographing parameters;

[0059] Figure 16 FIG1 is an exemplary image frame exposure timing diagram;

[0060] Figure 17 is a flowchart illustrating an exemplary method for setting photographing parameters;

[0061] Figure 18 FIG1 is a schematic diagram of an exposure timing sequence of an image frame shown as an example;

[0062] Figure 19 Schematic diagram of the structure of the device shown as an example. DETAILED DESCRIPTION

[0063] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0064] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0065] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.

[0066] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0067] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0068] To facilitate understanding, the technical terms involved in the embodiments of the present application are first explained.

[0069] Exposure parameters: The exposure parameters during video recording determine the brightness of the image. Exposure parameters include at least one of the following parameters: shutter time, gain, etc.

[0070] Shutter time (ST), also known as exposure time, is the valve that controls the amount of light entering the camera. A longer shutter time means more light enters, resulting in a brighter image. A shorter shutter time means less light enters, resulting in a darker image.

[0071] Gain: The process of amplifying or reducing the electrical or digital signal after photoelectric conversion. Increasing the gain makes the captured image brighter than the actual scene; decreasing the gain makes the captured image darker than the actual scene.

[0072] Aperture: A component on a camera that controls the size of the lens's aperture. It's used to control depth of field, image quality, and, in conjunction with the shutter, the amount of light entering. The aperture size is typically expressed in terms of the f-number (referred to as the aperture parameter in this application), which is equal to the lens' focal length divided by the lens's effective aperture diameter.

[0073] In some embodiments, the aperture range includes one or more of the following ranges: f / 1.0, f / 1.4, f / 2.0, f / 2.8, f / 4.0, f / 5.6, f / 8.0, f / 11, f / 16, f / 22, f / 32, f / 44, and f / 64. The smaller the f-number, the larger the aperture range, and vice versa. With the shutter speed unchanged, the smaller the f-number, the larger the lens aperture, the larger the aperture (i.e., the aperture range), the more light enters, the brighter the image, the narrower the focal plane, and the more blurred the background of the subject; the larger the f-number, the smaller the lens aperture, the smaller the aperture, the less light enters, the darker the image, the wider the focal plane, and the clearer the front and back of the subject.

[0074] For example, Figure 1 For an exemplary diagram of aperture change, please refer to Figure 1 The aperture settings from left to right are F1.4, F2.3, F2.8, and F11. Accordingly, as the f-number increases, the lens aperture gradually decreases, allowing less light to enter. Furthermore, the background blur around the subject gradually decreases, while the background becomes clearer and clearer.

[0075] Optionally, the aperture parameter can also be understood as one of the exposure parameters. In the embodiment of the present application, in order to better illustrate the correspondence between the aperture parameter and other exposure parameters, the description is expanded only by taking the difference between the exposure parameter and the aperture parameter as an example.

[0076] Optionally, aperture parameters and exposure parameters may also be collectively referred to as photographing parameters (or shooting parameters), which is not limited in this application.

[0077] Depth of Field (DOF): There is an allowable circle of confusion before and after the focal point. The distance between these two circles of confusion is called the depth of field. The relatively clear imaging range before and after the focal point (i.e., the focus point) is the depth of field. The foreground depth of field includes the clear range before the focus point, and the background depth of field includes the clear range after the focus point. Important factors affecting the depth of field include aperture size, focal length, and shooting distance. The larger the aperture (the smaller the aperture value f), the shallower the depth of field, and the smaller the aperture (the larger the aperture value f), the deeper the depth of field; the longer the focal length, the shallower the depth of field, and the shorter the focal length of the lens, the deeper the depth of field; the greater the shooting distance to the subject, the deeper the depth of field, and the smaller the shooting distance, the shallower the depth of field.

[0078] Optical image stabilization (OIS): By adjusting the angle and position of the lens relative to the image sensor, instrument jitter that occurs during optical signal capture can be reduced, thereby improving image quality.

[0079] Manual Exposure: It is an exposure method that manually sets the camera's exposure parameters (shutter time, gain, aperture). Figure 2a For an exemplary diagram of manual exposure, please refer to Figure 2a The shooting preview interface 200 includes an image preview window 201 and other controls. The image preview window 201 includes an image captured by the camera and exposure parameters 202 (also referred to as exposure parameter controls or exposure parameter options). For example, the image includes a person 201-1 and an object 201-2. Person 201-1 is closer to the camera, and its depth of field is smaller than that of object 201-2. For example, the exposure parameters 202 include, but are not limited to, ISO parameters and aperture parameters 202-1.

[0080] For example, the user can manually adjust the value in the aperture parameter 202-1 to adjust the aperture parameter when the camera captures the image. For example, the user adjusts the aperture parameter from F11 to F1.4. As the aperture value decreases, as described above, the aperture becomes larger, and the depth of field in the image captured by the camera becomes shallower, such as Figure 2a In (2), the image of object 201-2 is Figure 2a (1) is even more ambiguous.

[0081] Automatic Exposure: The camera automatically adjusts exposure parameters (shutter time, gain, and aperture) based on ambient brightness data through an algorithm to ensure that the brightness of the captured object is normal. Figure 2b For an exemplary diagram of automatic exposure, please refer to Figure 2b The image preview window 201 in the photo preview interface 200 displays the image captured by the camera. For other descriptions, please refer to Figure 2a , no further details will be given here. For example, Figure 2b In (1), the aperture value of the camera is F11. During the process of capturing an image, the camera recognizes the image and recognizes that the image includes a person 201-1. The camera can convert the shooting mode to the portrait mode, and the "Portrait" option 203 is displayed in the image preview interface 201 to indicate that the current mode is portrait. Accordingly, the camera can determine that the aperture parameter corresponding to the portrait mode is F1.4 based on the correspondence between the shooting mode and the aperture parameter that has been pre-cached. The camera can adjust the aperture so that other images in the picture (such as the image of the object 201-2) other than the image of the person 201-1 are blurred.

[0082] In the embodiments of the present application, the terminal device may be a mobile terminal with a shooting function, such as a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or other professional shooting equipment such as a digital camera, a SLR camera / micro-single camera, a sports camera, a gimbal camera, and a drone. The embodiments of the present application do not limit the specific type of the terminal device.

[0083] Figure 3 1 shows a schematic diagram of the structure of the electronic device 100. It should be understood that, Figure 3 The illustrated electronic device 100 is merely one example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. Figure 3 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0084] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0085] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0086] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0087] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0088] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0089] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, processor 110 may include multiple I2C busses. Processor 110 can couple touch sensors, chargers, flashlights, cameras 193, and the like via different I2C bus interfaces. For example, processor 110 (e.g., an AP) can couple to camera 193 via an I2C interface, enabling communication between the AP and camera 193 via the I2C bus interface, thereby enabling the camera function of electronic device 100.

[0090] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0091] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0092] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0093] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0094] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0095] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0096] Still refer to Figure 3 The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0097] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0098] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0099] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0100] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0101] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0102] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0103] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0104] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element (also known as the camera's sensor. The sensors involved in the embodiments of this application all refer to sensors in the camera). The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on the image's noise, brightness, and skin color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0105] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0106] Figure 4For an exemplary schematic diagram of a camera module, please refer to Figure 4 , Figure 4 (a) and (b) schematically illustrate the front and back of the electronic device 100. The front of the electronic device 100 may be understood as the side facing the user when the user uses the electronic device 100, and the back of the electronic device 100 may be understood as the side facing away from the user when the user uses the electronic device 100.

[0107] The camera module 102 is used to capture still images or videos. The camera module 102 can be set on the front and / or back of the electronic device 100. When the camera module 102 is set on the front of the electronic device 100, the front camera 102-1 can be used to shoot the scene on the front side of the electronic device 100, such as for selfies, and in some embodiments it can be referred to as a front camera. When the camera module 102 is set on the back of the electronic device 100, the rear camera 102-2 can be used to shoot the scene on the back side of the electronic device 100, and in some embodiments it can be referred to as a rear camera. When shooting, the user can select the corresponding camera module according to the shooting requirements.

[0108] It should be noted that the embodiment of the present application does not limit the number of camera modules 102 provided, and can be one, two, four, or even more. For example, one or more camera modules 102 can be provided on the front of the electronic device 100, and / or one or more camera modules 102 can be provided on the back of the electronic device 100. When multiple camera modules 102 are provided, the multiple camera modules 102 can be completely identical or different, for example, the multiple camera modules 102 have different lens optical parameters, different lens installation positions, different lens shapes, etc. The embodiment of the present application also does not impose any restrictions on the relative positions of the multiple camera modules when they are provided.

[0109] For example, Figure 4 As shown, any camera in the camera module 102 includes but is not limited to: a lens, an image sensor component, an aperture component, an OIS and other components or devices.

[0110] The lens may include but is not limited to one or more lenses. The concept of OIS can be referred to above and will not be repeated here.

[0111] The image sensor component is mainly used for imaging. Specifically, the image sensor component captures images and exposes image frames. When exposing image frames, the image sensor outputs a pulse signal. Specifically, when the image sensor starts exposing the current frame, it can output a pulse signal "1", that is, a high level, through the first pin (referred to as the OIS Pin pin in the embodiment of the present application) to indicate the start of exposure of the current frame. Correspondingly, when the first pin outputs a low level "0", it indicates that the exposure of the current frame is completed. In the embodiment of the present application, the signal output by the first pin can also be referred to as the OIS Pin signal, which is used to indicate the start and end time of exposure of the image frame.

[0112] Exemplarily, the image sensor is further configured to output a start of frame delimiter (SOF) signal based on the image frame through the second pin to identify the frame head of the current frame, and output an end of frame delimiter (EOF) signal based on the second pin to identify the frame end of the current frame. Exemplarily, the FrameTime (frame length) of each frame is the length between SOF and the next SOF, including the effective frame length between SOF and EOF and the non-exposure blank line (vertical blank, vblank, also known as blank invalid line time, vertical blanking or field blanking) in each frame. The specific corresponding relationship will be described in Figure 6 Instructions.

[0113] In the embodiments of the present application, the aperture assembly is a variable aperture (VA) structure, comprising an aperture motor and multiple blades. The aperture motor controls the arrangement of the multiple blades, thereby adjusting the size of the light-entering aperture to vary the amount of light entering. External light enters the lens through the aperture of the aperture assembly. The light passing through the lens ultimately reaches the image sensor assembly, where it is developed and imaged.

[0114] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0115] Figure 5 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0116] The layered architecture of electronic device 100 divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other via software interfaces. In some embodiments, the Android system is divided into the application layer, framework layer, hardware abstraction layer (HAL), and kernel layer from top to bottom.

[0117] The application layer can include a series of application packages.

[0118] like Figure 5 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0119] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0120] like Figure 5 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0121] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0122] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0123] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0124] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0125] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0126] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0127] The HAL layer abstracts the hardware and provides a virtual hardware platform for the operating system. The HAL layer includes but is not limited to: camera sensor HAL and Auto Exposure (AE).

[0128] The camera sensor HAL is used to obtain exposure parameters and call the camera driver.

[0129] The camera sensor HAL includes but is not limited to the aperture HAL. The aperture HAL is used to obtain aperture parameters and call the aperture motor driver.

[0130] The AE algorithm module is used to obtain exposure parameters based on the AE algorithm, wherein the exposure parameters include but are not limited to: the exposure parameters include one or more parameters such as shutter time, gain size or aperture size.

[0131] The kernel layer is the layer between hardware and software. The kernel layer includes at least the display driver and camera driver.

[0132] Exemplarily, the camera driver includes but is not limited to: an aperture motor driver, a camera request management module, a camera instruction issuing module, and a sensor driver (also referred to as an image sensor driver or an image sensor component driver, which is not limited in this application).

[0133] The hardware includes a camera (the description can be found above and will not be repeated here) and a display screen.

[0134] It is understandable that Figure 5 The layers in the illustrated software structure and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0135] Figure 6 For an exemplary image frame exposure timing diagram, please refer to Figure 6 Exemplarily, the image frames in this example include the N-1th frame, the Nth frame, the N+1th frame, the N+2th frame, and the N+3th frame.

[0136] The following uses frame N as an example to explain in detail the various time points involved in the embodiments of this application. At time T3, the sensor (referring to the image sensor component, which will not be repeated below) begins exposing the image of frame N. In the embodiments of this application, the exposure time of each image frame can be the same or different, and this application does not limit it.

[0137] For example, SOF is used to identify the beginning of the Nth frame, and EOF is used to identify the end of the Nth frame. The length (i.e., the duration) between the SOF of the Nth frame and the next SOF (i.e., the SOF of the N+1th frame) is the Frame Time of the Nth frame. The effective length of the Nth frame is the length between the SOF and EOF of the Nth frame, and the length between the EOF of the Nth frame and the next SOF is vblank (the concept is discussed above and will not be repeated here).

[0138] Exemplarily, the moment when the sensor ends exposure of the image frame corresponds to the EOF of the image frame.

[0139] In the embodiment of the present application, the sensor outputs a SOF signal (eg, a high level) through the second pin to indicate the beginning of the Nth frame. The sensor outputs an EOF signal (eg, a low level) through the second pin to indicate the end of the frame.

[0140] In this example, assume that the electronic device adjusts the exposure and aperture parameters of frame (N+1) at any time between T4 and T5 (this can be any time before the SOF of frame (N+1), not limited in this application). Assume that the exposure parameter before adjustment is exposure parameter 1 and the aperture parameter is aperture parameter 1. Assume that the exposure parameter after adjustment is exposure parameter 2 and the aperture parameter is aperture parameter 2.

[0141] For example, based on hardware constraints, the exposure parameters take effect on the second frame after adjustment (i.e., after the hardware receives the new exposure parameters, they will not take effect immediately, but will take effect after an interval of 1 frame). That is, the new exposure parameters are issued after the SOF of the Nth frame and will take effect on the N+2th frame. Figure 6 As shown in FIG, the new exposure parameter (i.e., exposure parameter 2) will take effect at frame N+2. That is, at time T9, when the sensor starts exposing frame N+2, the sensor exposes frame N+2 with exposure parameter 2.

[0142] For example, the aperture parameter is typically adjusted by the aperture driver sending the new aperture parameter (i.e., aperture parameter 2) to the aperture motor, which then controls the movement of the blades in the lens to adjust the aperture size. The aperture motor typically takes about 20ms to adjust the aperture size.

[0143] Please continue to refer to Figure 6Based on the aperture parameter (i.e., aperture parameter 2), the aperture component begins adjusting the aperture size, taking the SOF of frame N+1 as the basis. This adjustment takes approximately 20ms. It should be noted that the SOF of frame N+1 mentioned above means that, ideally, the aperture component begins adjusting the aperture size from the SOF of frame N+1. However, the actual adjustment start time may have a delay from the SOF of frame N+1. For example, the aperture component begins adjusting the aperture size at time T7-1. Furthermore, at time T9-1, the aperture adjustment is complete, i.e., the aperture is adjusted to the size indicated by aperture parameter 2.

[0144] For example, Figure 6 As shown, from time T6 to T8, the sensor exposes the N+1th frame. From T6 to T7-1, the exposure parameter corresponding to the N+1th frame is exposure parameter 1, and the aperture parameter is aperture parameter 1. From time T7-1 to T8, the exposure parameter corresponding to the N+1th frame is exposure parameter 1 (i.e., the new exposure parameter has not yet taken effect), and the aperture parameter is between aperture parameter 1 and aperture parameter 2 (i.e., the aperture parameter is being adjusted, and the specific adjustment value can be determined according to actual needs and is not limited in this application).

[0145] For example, the exposure parameters and aperture parameters are calculated by the AE, and the two parameters have a corresponding relationship, meaning they match each other. A mismatch between the exposure parameters and aperture parameters will result in image exposure anomalies (e.g., abnormal brightness in parts of the image). Therefore, between T7-1 and T8, the mismatch between the exposure parameters of frame N+1 (i.e., exposure parameter 1) and the aperture parameters (i.e., not reaching the specified aperture parameter 2) will cause image N+1 to have an exposure anomaly. To prevent display artifacts caused by exposure anomalies, the AP typically discards image frames with an exposure anomaly. Specifically, after receiving the N+1 frame exposed by the sensor, the AP discards the N+1 frame. The "old" frame, i.e., the image corresponding to frame N, will be displayed within the frame time (also understood as the display duration) that was originally intended to be displayed in the capture preview interface. From the user's perspective, the capture preview interface will experience a lag effect, with the same image frame displayed in two adjacent frame times.

[0146] Please continue to refer to Figure 6, from T9 to T11, the Sensor exposes the N+2 frame. Exemplarily, as described above, at the start time of exposure of N+2 (i.e., T9), the new exposure parameter (i.e., exposure parameter 2) takes effect. Correspondingly, from T9 to T9-1, the exposure parameter corresponding to the N+2 frame is exposure parameter 2. However, since the aperture has not yet changed to aperture parameter 2, the exposure parameter of N+2 still does not match the aperture parameter from T9 to T9-1, which is the same as the N+1 frame. The AP will discard the N+2 frame. In other words, the Frame Time that originally displayed the N+2 frame will continue to display the image of the N frame. The principle can be referred to the N+1 frame and will not be repeated here.

[0147] At time T12, the sensor begins exposing frame N+3. Because the aperture has already been adjusted, the exposure parameters for frame N+3 (i.e., exposure parameter 2) and the aperture parameters (i.e., aperture parameter 2) match at time T12. The sensor exposes frame N+3 based on exposure parameter 2 and aperture parameter 2, resulting in a normal image frame. The shooting preview screen displays the image corresponding to frame N+3.

[0148] In summary, in the above embodiment, the exposure parameters are set based on the SOF of frame N, while the aperture parameters are set based on the SOF of frame N+1 (i.e., the setting takes effect starting at the SOF of frame N+1). This will result in exposure anomalies in at least two frames. Alternatively, if the AP discards image frames with exposure anomalies, it will cause image freezes.

[0149] To solve the above problems, an embodiment of the present application provides a method for setting photographing parameters. In this method, the electronic device can adjust the aperture parameters based on the EOF of the image frame without changing the hardware structure of the electronic device, so as to reduce the impact of the aperture parameter adjustment on the image frame.

[0150] Figure 7 Please refer to the image frame exposure timing diagram corresponding to the photographing parameter setting method provided in the embodiment of this application. Figure 7In an embodiment of the present application, the electronic device sends the exposure parameters and aperture parameters of the Nth frame to the camera at the SOF of the Nth frame. At the EOF of the Nth frame, the aperture begins to adjust, and the adjustment time is about 20ms. And, according to the protocol, the new exposure parameters will take effect at the exposure time point of the N+2th frame (i.e., time T9). During the aperture adjustment process from T5 to T7-1, the aperture parameters do not match the exposure parameters, and accordingly, the image frame N+1 will be discarded (the principle can be referred to above). At the exposure time of the N+2th frame, i.e., time T9, the new exposure parameters take effect, and the aperture has been adjusted to the specified value, i.e., the exposure parameters of the N+2th frame match the aperture parameters, and the N+2th frame is exposed normally. In other words, the camera parameter setting method in the embodiment of the present application only discards one image frame to shorten the freezing time and improve the user experience.

[0151] Figure 8 For an example hardware connection diagram, please refer to Figure 8 For example, the AP is connected to the OIS, the OIS is connected to the VA (which can also be understood as an aperture component and will not be repeated below), the AP is connected to the Sensor (i.e., the image sensor component), and the Sensor is connected to the OIS. Figure 8 The connection here refers to a physical connection. For example, each module can be connected via an I2C bus, which is not limited in this application.

[0152] For example, the OIS can monitor the OIS pin (also called the first pin) of the sensor through the connection between the OIS and the sensor. The AP can monitor the SOF+EOF pin (also called the second pin) of the sensor through the connection between the AP and the sensor.

[0153] Figure 9 For an exemplary signal output diagram, please refer to Figure 9 In the embodiment of the present application, taking the Nth frame as an example, the moment when the sensor starts to expose the Nth frame is time T3, and the sensor outputs the first OIS pin signal (for example, a high level "1", which is not limited in this application) through the OIS pin pin, that is, the level of the OIS pin pin is pulled high.

[0154] Exemplarily, the sensor exposes the Nth frame at time T3 to T5. Correspondingly, at time T3 to T5, the OIS pin of the sensor outputs the first OIS pin signal, that is, the OIS pin continuously outputs a high level.

[0155] At time T5, the exposure of the Nth frame is completed, and the sensor outputs a second OIS pin signal (for example, a low level “0”) through the pin, that is, the level of the OIS pin is pulled low.

[0156] During time T5 to T6, the sensor does not expose the image frame, and the OIS pin signal of the sensor outputs the second OISpin signal, that is, the OIS pin pin continuously outputs a low level.

[0157] At time T6, the sensor begins exposing frame N+1, and the OIS pin is pulled high to indicate the start of image frame exposure. Similar to frame N, the sensor can adjust the output signal of the OIS pin based on the exposure time of the image frame.

[0158] It should be noted that the exposure time of each image frame may be the same or different.

[0159] Still refer to Figure 9 For example, at the moment corresponding to the frame header of the image frame, for example, at time T4, the sensor outputs a SOF signal (for example, a high level "1") through the SOF+EOF pin to identify the frame header of the image frame. At the moment corresponding to the end of the Nth frame, for example, at time T5, the sensor outputs an EOF signal (for example, a low level "0") through the SOF+EOF pin to identify the end of the image frame. The SOF signal and EOF signal in the embodiments of the present application are only illustrative examples and are not limited to these in this application.

[0160] For example, the length (time length) between the SOF of the Nth frame and the next SOF (i.e., the SOF of the N+1th frame) is the Frame Time of the Nth frame. The effective length of the Nth frame is between the SOF and the EOF of the Nth frame, and the time between the EOF of the Nth frame and the next SOF is vblank (the concept can be referred to above and will not be repeated here).

[0161] In the embodiment of the present application, there may be multiple modules monitoring the SOF signal and EOF signal output by the sensor to determine the frame head and frame tail of the image frame based on the SOF signal and EOF signal. Figure 8 As shown, the AP monitors the SOF+EOF pins of the sensor, thereby obtaining the SOF signal or EOF signal output by the SOF+EOF pins of the sensor. For example, at time T4, the AP can monitor the SOF+EOF pins of the sensor outputting the SOF signal, and at time T5, the AP can monitor the SOF+EOF pins of the sensor outputting the EOF signal.

[0162] Exemplarily, as described above, the exposure end time of the image frame is aligned with the EOF of the image frame, that is, the exposure end time of the image frame is the EOF of the image frame, for example, both are T5. Therefore, in an embodiment of the present application, the moment when the level of the OIS pin is pulled low, the exposure end time of the image frame, and the moment when the sensor starts to output the EOF signal are the same moment. For example, the exposure end time of the Nth frame is T5, at which moment the sensor outputs the second OIS pin through the OIS pin (that is, the pin level is pulled low), and the sensor outputs the EOF signal. It can be understood that, in an embodiment of the present application, the level of the OIS pin of the sensor is pulled low, which can also be used to identify the EOF of the image frame and the exposure end time of the image frame. The description of other frames is the same as that of the Nth frame and will not be repeated here.

[0163] For example, Figure 8 As shown, the OIS monitors the output of the sensor's OIS pin. Accordingly, the OIS can determine the exposure start time, exposure end time, and image frame end of frame based on the level of the sensor's OIS pin (which can also be understood as the output signal).

[0164] For example, Figure 9 As shown, taking frame N as an example, at time T3, the OIS detects that the sensor's OIS pin has gone high, indicating that the sensor has begun exposing frame N. If the OIS detects that the OIS pin remains high, it indicates that the sensor is currently exposing frame N. At time T5, the OIS detects that the sensor's OIS pin has gone low, indicating that the sensor has finished exposing frame N. Furthermore, the current moment is the end of frame N.

[0165] The following combination Figure 10 The image frame exposure timing diagram shown in FIG. 1 is a detailed description of the method for setting the photographic parameters in the embodiment of the present application. Figure 10 For example, assuming that at time T2-1, the user manually triggers the adjustment of the aperture parameters, the triggering method can refer to Figure 2a Of course, this example only uses the manual adjustment method as an example for explanation, and the process can also be applied to the scene of the automatic adjustment method, and this application does not limit it.

[0166] Figure 11 For an exemplary diagram of module interaction, please refer to Figure 11In response to the received user operation (i.e., the user's operation of adjusting the aperture parameter), the camera application sends adjustment instruction information to the viewing system. The adjustment instruction information may include but is not limited to aperture parameter adjustment instruction information. The aperture parameter adjustment instruction information includes the aperture parameter to be adjusted, such as F1.4. The aperture parameter adjustment instruction information is used to instruct the adjustment of the aperture parameter.

[0167] For example, the viewing system responds to the instruction of the camera application and sends the aperture parameter to be adjusted to the AE algorithm module. The AE algorithm module can determine the exposure parameters that match the aperture parameter to be adjusted and the corresponding image frame. For example, Figure 10 As shown, the camera application optionally receives a user trigger operation at time T2-1 and executes Figure 11 The process in [ 2 ] is followed so that the AE algorithm module obtains the aperture parameter to be adjusted. At time T2-2, the AE algorithm module may determine the corresponding exposure parameter and image frame based on the aperture parameter to be adjusted. For example, the AE algorithm module may determine that the corresponding image frame is frame N, the aperture parameter is F1.4, and the exposure parameter is exposure parameter 2 (this is only an illustrative example and is not limited in this application).

[0168] It should be noted that the time interval between the user triggering and the AE algorithm determining the exposure parameters is only an illustrative example and is not limited in this application.

[0169] It should be further explained that the image frame determined by the AE algorithm module is also an illustrative example. Generally, the image frame determined by the AE algorithm module can be a frame that is two image frames away from the decision moment of the AE algorithm module (for example, moment T2-2). Figure 10 In the example, the current cycle is the cycle corresponding to image frame N-1, that is, between the SOF of frame N-1 and the next SOF. Accordingly, the AE algorithm module can assign new exposure parameters and aperture parameters to frame N+1. In the embodiment of the present application, the AE algorithm module only determines the Nth frame, that is, assigns new exposure parameters and aperture parameters to frame N as an example for explanation.

[0170] Still refer to Figure 11 The AE algorithm module outputs the aperture parameters, exposure parameters, and identification information of the Nth frame to the camera sensor HAL. Optionally, the identification information of the Nth frame is used to instruct the AE algorithm module to assign new aperture parameters and exposure parameters to the Nth frame. It can also be understood that the camera component will adjust the aperture parameters and exposure parameters in the Nth frame.

[0171] It should be noted that, in the embodiment of the present application, the adjustment of the aperture parameters and exposure parameters includes two aspects, one of which is parameter delivery (referring to delivering the parameters to the camera component), and the other is parameter effectiveness. Taking the exposure parameter as an example, the exposure parameter may be adjusted at the first moment (e.g. Figure 10 However, the camera component takes effect after two frames of the new exposure parameters (for example, Figure 10 In the embodiment of the present application, the time between the issuance of the exposure parameters and the effective time can be understood as the exposure parameter adjustment time. The aperture parameters are the same and will not be repeated below.

[0172] Please continue to refer to Figure 11 The camera sensor HAL obtains the aperture parameters, exposure parameters, and identification information of the Nth frame input by the AE algorithm module, and determines that the aperture parameters and exposure parameters of the Nth frame need to be adjusted. This can also be understood as the need to start adjusting the aperture parameters and exposure parameters within the Frame Time of the Nth frame.

[0173] For example, combined Figure 10 and Figure 11 As shown, after time T2-2 and before time T4, the camera sensor HAL obtains the aperture parameters, exposure parameters, and identification information of the Nth frame input by the AE algorithm module.

[0174] Exemplarily, the camera sensor HAL caches the exposure parameters. Furthermore, the camera sensor HAL sends the aperture parameters to the aperture HAL. The aperture HAL caches the aperture parameters input by the camera sensor HAL.

[0175] Exemplarily, the electronic device exposes the Nth frame and at least one frame before the Nth frame based on exposure parameter 1 and aperture parameter 1, and displays the image of the exposed image frame within the corresponding display Frame Time, which will not be repeated below.

[0176] Figure 12 This is a flow chart showing an exemplary method for setting photographic parameters. Figure 12 , specifically including but not limited to the following steps:

[0177] S1201-1, the camera sensor HAL sends exposure parameters to the sensor driver.

[0178] For example, combined Figure 10 and Figure 11 As shown, after time T2-2 and before time T4, the camera sensor HAL obtains the aperture parameters, exposure parameters, and identification information of the Nth frame input by the AE algorithm module.

[0179] The camera sensor HAL may start executing S1201 - 1 and S1201 - 2 at any time before time T4 .

[0180] Exemplarily, the camera sensor HAL sends the exposure parameter and identification information of the Nth frame to the sensor driver, to instruct to update the exposure parameter in the Nth frame.

[0181] S1202-1, the sensor drives the cache exposure parameters.

[0182] Exemplarily, the sensor driver sends exposure parameters and identification information of the Nth frame.

[0183] In this embodiment of the present application, after the sensor driver caches the exposure parameters, it can determine that the exposure parameters are set for frame N based on the identification information of frame N. Therefore, the sensor driver waits for the SOF of frame N to arrive (i.e., S1205 to S1207-1) before sending the cached exposure parameters to the hardware (specifically, the sensor) to execute the exposure parameter distribution process.

[0184] S1201 - 2 : The camera sensor HAL sends an aperture parameter request to the aperture HAL.

[0185] Exemplarily, the camera sensor HAL sends an aperture parameter request to the aperture HAL. The request may include identification information of the Nth frame, which is used to indicate that the update of the aperture parameters is triggered at the Nth frame.

[0186] It should be noted that the execution order of S1201-1 and S1201-2 is not specific and this application does not limit it.

[0187] S1202-2, the aperture HAL obtains aperture parameters.

[0188] Exemplarily, as described above, the aperture HAL has obtained the aperture parameters sent by the camera sensor HAL, and the aperture HAL may extract the cached aperture parameters.

[0189] S1203-2, the aperture HAL sends aperture parameters to the aperture motor driver.

[0190] Exemplarily, the aperture HAL calls an aperture parameter method function, and converts the aperture parameter into a variable aperture parameter value (VA code) through this method function.

[0191] The aperture HAL sends a request message to the camera command issuing module. The request message includes the aperture parameters (i.e., VAcode, not repeated below) and the identification information of the Nth frame. The camera command issuing module forwards (or transparently transmits) the aperture parameters and the identification information of the Nth frame to the aperture motor driver.

[0192] S1204-2, the aperture motor drives the cached aperture parameters.

[0193] Exemplarily, the aperture motor caches the aperture parameters and identification information of the Nth frame.

[0194] That is to say, combined Figure 10 , before the SOF of the Nth frame, that is, time T4, the aperture motor driver has cached the aperture parameters, and the sensor driver has cached the exposure parameters.

[0195] In this embodiment of the present application, after the aperture motor driver caches the aperture parameters, the aperture motor driver can determine that the aperture parameters are set for the Nth frame based on the identification information of the Nth frame. Therefore, the aperture motor driver waits for the SOF of the Nth frame to arrive (i.e., S1205 to S1207-2) before sending the cached aperture parameters to the hardware (specifically, the OIS) to execute the aperture parameter sending process.

[0196] S1205, IFE (Image Front End) monitors SOF from Sensor.

[0197] For example, Figure 8 As shown in the figure, the AP and Sensor are physically connected. The IFE on the AP side can be used to monitor the SOF+EOF pins of the Sensor.

[0198] Still refer to Figure 10 At time T4, the sensor outputs the SOF signal through the SOF+EOF pin to identify the frame header of the Nth frame.

[0199] IFE monitors the SOF+EOF pins and detects the SOF signal output by the sensor, and determines that the current time (i.e., time T4) is the frame header of the Nth frame.

[0200] S1206, the IFE sends SOF indication information to the camera request management module.

[0201] For example, after the IFE detects the SOF signal of the Nth frame, it sends SOF indication information to the camera request management module to indicate the arrival of the SOF of the Nth frame. Specifically, the IFE can call the interface function of the camera request management module to send the SOF identifier to the camera request management module (the specific identifier can be set according to actual needs and is not limited by this application).

[0202] Exemplarily, the AP side starts to execute the exposure parameter setting (which can also be understood as exposure parameter delivery) process and the aperture parameter setting (which can also be understood as aperture parameter delivery) process.

[0203] The exposure parameter setting process includes:

[0204] S1207-1, the camera request management module sends an exposure parameter setting request to the sensor driver.

[0205] Exemplarily, after the camera request management module receives the SOF indication information sent by the AP, it determines that the exposure parameters need to be adjusted for the Nth frame. The camera request management module sends an exposure parameter sending indication message (also called an exposure parameter setting request) to the sensor driver. The indication message includes the identification information of the Nth frame and the exposure parameter sending indication information, which is used to indicate the sending of the exposure parameters.

[0206] It should be noted that the "download" action involved in the embodiment of the present application refers to the module on the AP side sending the exposure parameters or aperture parameters to the corresponding hardware module so that the hardware module executes the corresponding parameters, which will not be repeated below.

[0207] S1208-1, the sensor driver sends exposure parameters to the sensor.

[0208] Exemplarily, the sensor driver extracts the exposure parameter corresponding to the identification information of the Nth frame buffered in S1202 - 1 in response to the instruction of the camera request module.

[0209] The sensor driver sends exposure parameters to the sensor.

[0210] S1209-1, Sensor adjusts exposure parameters.

[0211] For example, after receiving the exposure parameters, the sensor adjusts (also understood as taking effect) the exposure parameters at the exposure moment of the specified image frame according to the protocol.

[0212] Please refer to Figure 10 In this embodiment of the present application, at time T4, after the sensor receives the exposure parameters sent by the upper layer (i.e., the AP), the new exposure parameters take effect at the exposure time of the N+2th frame (i.e., time T9), according to the exposure parameter validity interval specified in the protocol. In other words, at time T9, the sensor exposes the N+2th frame according to the new exposure parameters (e.g., exposure parameter 2).

[0213] For example, at time T4, after the sensor obtains the exposure parameter, it is not yet effective. Therefore, from time T6 to T8, the sensor exposes the N+1th frame based on the "old" exposure parameter (for example, exposure parameter 1).

[0214] It should be noted that in the embodiment of the present application, the issuance of exposure parameters and aperture parameters is executed starting at time T4. However, due to the corresponding duration of interaction between modules, there may be a certain delay between the time when the hardware receives the exposure parameters and aperture parameters and time T4 (i.e., the time when the parameters are issued), which will not be repeated below.

[0215] The aperture parameter setting process includes:

[0216] S1207-2, the camera request management module sends an aperture setting request to the aperture motor driver.

[0217] Exemplarily, after the camera request management module receives the SOF indication information sent by the AP, it determines that the aperture parameter adjustment needs to be performed on the Nth frame. The camera request management module sends an aperture parameter sending indication message (also called an aperture parameter setting request) to the aperture motor driver. The indication message includes the identification information of the Nth frame and the aperture parameter sending indication information, which is used to indicate the aperture parameters.

[0218] S1208-2: The aperture motor drives and sends aperture parameters to the OIS.

[0219] The exemplary aperture motor driver extracts the aperture parameters corresponding to the identification information of the Nth frame buffered in S1204 - 2 in response to the instruction of the camera request module, and sends the aperture parameters to the OIS.

[0220] S1209-2, OIS caches aperture parameters.

[0221] In the embodiment of the present application, after receiving the aperture parameters, the OIS caches the aperture parameters to a specified location in the memory. When the OIS waits for the EOF of the Nth frame to arrive, it controls the aperture motor to adjust the aperture.

[0222] Exemplarily, after the electronic device executes the aperture parameter setting process, in an embodiment of the present application, the electronic device will start adjusting the aperture at the moment corresponding to the EOF of the image frame, that is, the aperture parameters will be effective, wherein the aperture effectiveness process includes S1210-2 to S1212-2.

[0223] S1210-2, OIS monitors from the sensor that the OIS pin is pulled low.

[0224] For example, Figure 8 As shown, OIS is physically connected to the sensor and monitors the OIS pin of the sensor. Please refer to Figure 10At time T3, the OIS pin level is "high", which can also be understood as the sensor outputting the first OIS pin signal (i.e., high level) through the OIS pin. At time T5, the sensor recognizes the end of the Nth frame and outputs the EOF signal through the SOF+EOF pin while outputting the second OIS pin signal (i.e., low level) through the OIS pin. Accordingly, the OIS pin level is pulled low at time T5.

[0225] OIS monitors the OIS pin and determines that the level of the OIS pin is pulled low, and can determine that the current moment is the EOF of the Nth frame.

[0226] S1211-2, the OIS sends aperture parameters to the aperture motor.

[0227] For example, after detecting that the level of the OIS pin is pulled low, the OIS sends the aperture parameter to the aperture motor to control the aperture motor to adjust the aperture of the lens.

[0228] S1212-2, the aperture motor adjusts the aperture.

[0229] For example, the aperture motor can adjust the aperture size based on the aperture parameters. Figure 10 For example, at the end of frame N, or time T5, the OIS executes the aperture validation process, sending the aperture parameters to the aperture motor. The aperture motor begins adjusting the aperture size at T5 (which may be subject to a certain delay), and takes approximately 20ms to reach the specified aperture size (i.e., the aperture size corresponding to the aperture parameters). For example, this takes place from time T5 to time T7-1.

[0230] As described above, the exposure parameters take effect at time T9. However, during the exposure time of frame N+1 (from T6 to T8), the sensor continues to expose frame N+1 with the "old" exposure parameters (e.g., exposure parameter 1). Furthermore, the aperture is in the process of being adjusted from T6 to T7-1. Furthermore, from T7-1 to T8, the aperture has been adjusted to the new aperture parameter (e.g., f1.4), which does not match the current exposure parameter corresponding to time N+1 (i.e., exposure parameter 1). Therefore, during the exposure time of frame N+1 (from T6 to T8), the exposure parameters and aperture parameters do not match, and the image of frame N+1 will be abnormal. As described above, after the sensor transmits the exposed frame N+1 to the AP, the AP discards the abnormally exposed frame N+1. Accordingly, during the display frame time corresponding to frame N+1, the capture preview interface of the electronic device will display the "old" image frame, e.g., frame N.

[0231] Still refer to Figure 10 At time T9, the new exposure parameters (e.g., exposure parameter 2) take effect, and the sensor exposes frame N+2 using the new exposure parameters. Furthermore, since the aperture parameters were already adjusted at time T7-1 (e.g., to f1.4), they match the current exposure parameters. Therefore, the exposure of frame N+2 is normal. Accordingly, within the display frame time corresponding to frame N+2, the image of frame N+2 will be displayed on the shooting preview interface of the electronic device.

[0232] That is to say, in the embodiment of the present application, Figure 13 As shown, the electronic device sets (can also be understood as sending) exposure parameters and aperture parameters based on the SOF of the image frame (taking the Nth frame as an example), that is, at the SOF of the image frame, the Sensor obtains the exposure parameters, and the OIS obtains the aperture parameters. In addition, the electronic device takes effect on the aperture parameters based on the EOF of the image frame, that is, at the EOF of the image frame, the OIS controls the aperture motor to adjust the aperture size. Based on the method in the embodiment of the present application, only the exposure of one image frame (for example, N+1) is affected, that is, the AP side only discards one image frame, which is compared with Figure 6 The method shown in (i.e., discarding at least two image frames) can effectively reduce the impact of aperture adjustment on image frames, thereby shortening the duration of image freezes and improving user experience.

[0233] It should be noted that, based on the current frame rate, the minimum Frame Time of an image frame is 33.3 ms. Therefore, the method in the embodiment of the present application affects at most one image frame.

[0234] Figure 14 For an example hardware connection diagram, please refer to Figure 14 , , ,examination, , ,the AP ,can ,also ,monitor ,the ,OIS ,pin ,of ,the ,Sensor ,through ,the ,hardware ,connection ,between ,the ,AP ,and ,the ,Sensor.

[0235] Combine Figure 14 , Figure 15 This is a flow chart showing an exemplary method for setting photographic parameters. Figure 15 , specifically including but not limited to the following steps:

[0236] S1501 to S1506 can refer to S1201 to S1206 and will not be repeated here.

[0237] S1507-1 to S1509-1 can refer to S1207-1 to S1209-1 and will not be repeated here.

[0238] S1507-2, the aperture motor driver is monitored from the sensor and the OIS pin is pulled low.

[0239] For example, Figure 14 As shown, the AP is physically connected to the Sensor and monitors the OIS pin of the Sensor. Please refer to Figure 10 At time T3, the OIS pin level is "high", which can also be understood as the sensor outputting the first OIS pin signal (i.e., high level) through the OIS pin. At time T5, the sensor recognizes the end of the Nth frame and outputs the EOF signal through the SOF+EOF pin while outputting the second OIS pin signal (i.e., low level) through the OIS pin. Accordingly, the OIS pin level is pulled low at time T5.

[0240] The aperture motor driver in the AP monitors the OIS pin and determines whether the level of the OIS pin is pulled low, thereby determining that the current moment is the EOF of the Nth frame.

[0241] S1508-2: The aperture motor drives and sends aperture parameters to the OIS.

[0242] Exemplarily, the aperture motor driver extracts the aperture parameters corresponding to the identification information of the Nth frame buffered in S1504-2 in response to the detected low level of the OIS pin, and sends the aperture parameters to the OIS.

[0243] S1509-2, the OIS sends aperture parameters to the aperture motor.

[0244] Exemplarily, after receiving the aperture parameters sent by the aperture motor, the OIS sends the aperture parameters to the aperture motor to control the aperture motor to adjust the aperture of the lens.

[0245] S1510-2, the aperture motor adjusts the aperture.

[0246] For detailed description, please refer to S1212-2, which will not be repeated here.

[0247] like Figure 16 As shown, in Figure 15 In the example shown, the electronic device sets (can also be understood as sending) exposure parameters based on the SOF of the image frame (taking the Nth frame as an example), that is, at the SOF of the image frame, the Sensor obtains the exposure parameters. In addition, the electronic device sets the aperture parameters based on the EOF of the image frame, that is, the OIS obtains the aperture parameters. In addition, the electronic device sets the effective aperture parameters based on the EOF of the image frame, that is, at the EOF of the image frame, the OIS controls the aperture motor to adjust the aperture size. Based on the method in the embodiment of the present application, only the exposure of one image frame (for example, N+1) is affected, that is, the AP side only discards one image frame, which is compared with Figure 6The method shown in (i.e., discarding at least two image frames) can effectively reduce the impact of aperture adjustment on image frames, thereby shortening the duration of image freezes and improving user experience.

[0248] In an embodiment of the present application, the IFE on the AP side can also trigger the aperture motor drive based on the monitored EOF signal to execute the aperture parameter setting process. Figure 17 This is a flow chart showing an exemplary method for setting photographic parameters. Figure 17 , specifically including but not limited to the following steps:

[0249] S1701 to S1706 can refer to S1201 to S1206 and will not be repeated here.

[0250] S1707-1 to S1709-1 can refer to S1207-1 to S1209-1 and will not be repeated here.

[0251] S1707-2, IFE detects EOF from the sensor.

[0252] For example, Figure 8 As shown in the figure, the AP and Sensor are physically connected. The IFE on the AP side can be used to monitor the SOF+EOF pins of the Sensor.

[0253] Still refer to Figure 10 At time T4, the sensor outputs the SOF signal through the SOF+EOF pin to identify the frame header of the Nth frame.

[0254] IFE monitors the SOF+EOF pins and detects the SOF signal output by the sensor, and determines that the current time (i.e., time T4) is the frame header of the Nth frame.

[0255] S1708-2, the IFE sends EOF indication information to the camera request management module.

[0256] For example, after the IFE detects the EOF signal of the Nth frame, it sends EOF indication information to the camera request management module to indicate that the EOF of the Nth frame has been reached. Specifically, the IFE can call the interface function of the camera request management module to send an EOF identifier to the camera request management module (the specific identifier can be set according to actual needs and is not limited in this application).

[0257] S1709-2, the camera request management module sends an aperture setting request to the aperture motor driver.

[0258] Exemplarily, after the camera request management module receives the EOF indication information sent by the AP, it determines that the aperture parameter adjustment needs to be performed on the Nth frame. The camera request management module sends an aperture parameter sending indication message (also called an aperture parameter setting request) to the aperture motor driver. The indication message includes the identification information of the Nth frame and the aperture parameter sending indication information, which is used to indicate the aperture parameters.

[0259] S1710-2: The aperture motor drives the OIS to send aperture parameters.

[0260] The exemplary aperture motor driver extracts the aperture parameters corresponding to the identification information of the Nth frame buffered in S1204 - 2 in response to the instruction of the camera request module, and sends the aperture parameters to the OIS.

[0261] S1711-2, the OIS sends aperture parameters to the aperture motor.

[0262] Exemplarily, the OIS responds to the aperture parameter sent by the aperture motor driver and sends the aperture parameter to the aperture motor to control the aperture motor to adjust the aperture of the lens.

[0263] S1712-2, aperture motor adjusts the aperture.

[0264] For detailed description, please refer to S1212-2, which will not be repeated here.

[0265] like Figure 16 As shown, in Figure 17 In the example shown, the electronic device sets (can also be understood as sending) the exposure parameters based on the SOF of the image frame (taking the Nth frame as an example), that is, at the SOF of the image frame, the Sensor obtains the exposure parameters. Moreover, the AP side can set the aperture parameters based on the EOF of the image frame by monitoring the EOF signal, that is, the OIS obtains the aperture parameters. And it can set the effective aperture parameters based on the EOF of the image frame, that is, at the EOF of the image frame, the OIS controls the aperture motor to adjust the aperture size. Based on the method in the embodiment of the present application, only the exposure of one image frame (for example, N+1) is affected, that is, the AP side only discards one image frame, compared with Figure 6 The method shown in (i.e., discarding at least two image frames) can effectively reduce the impact of aperture adjustment on image frames, thereby shortening the duration of image freezes and improving user experience.

[0266] In each of the examples described above, the aperture parameters are adjusted based on the EOF of the Nth frame. In a possible implementation, the electronic device may also start adjusting the aperture parameters based on the EOF of the N+1th frame. Figure 18 For an exemplary diagram showing the exposure timing of an image frame, please refer to Figure 18Specifically, the exposure parameters and aperture parameters of the Nth frame can be referred to as follows: Figure 10 、 Figure 12 、 Figure 15 and Figure 17 , I will not go into details here.

[0267] Still refer to Figure 18 At the SOF of the Nth frame, that is, time T4, the exposure parameters and aperture parameters are sent to the hardware. Figure 12 For example, the electronic device executes S1205 to S1206 and S1207-1 to S1209-1, and S127-2 to S1209-2. That is, in this example, the exposure parameters are sent to the sensor at the SOF of the Nth frame, and the exposure parameters take effect at the exposure time of the N+2th frame (for example, time T9). For detailed description, please refer to the above and will not be repeated here. Figure 18 At time T5, OIS detects that the OIS pin is pulled low and determines that it is the EOF of frame N, and no processing is performed. At time T8, OIS detects that the OIS pin is pulled low again and determines that it corresponds to the EOF of frame N+1. The hardware starts to execute S1210-2 to S1212-2 to adjust the aperture. Figure 18 The aperture component begins adjusting the aperture at the end of frame N+1, at time T8 (a possible delay), and completes adjustment at time T10-1. In this example, the exposure parameters and aperture parameters of frames N and N+1 are identical. During the exposure of frame N+2, the aperture is being adjusted from time T8 to T10-1. Therefore, the aperture parameters do not match the exposure parameters (the specific reasons are described above and are not repeated here). Therefore, the AP discards frame N+2. In other words, the image corresponding to frame N+1 is displayed within the display frame time corresponding to frame N+2 (which can also be understood as the display duration of frame N+2). In this example, since the exposure and aperture parameters of frame N match those of frame N+1 and at least one previous frame, the image corresponding to that frame can be displayed within the corresponding display frame time. For example, the image corresponding to frame N+1 is displayed within the display frame time of frame N+1. Among them, the image corresponding to the N+1th frame is obtained after exposure based on exposure parameter 1 and aperture parameter 1, and will not be repeated below. When the N+3th frame is exposed (i.e. starting from time T12), the aperture parameter has been adjusted and the exposure parameter has also taken effect. Therefore, the aperture parameter and the exposure parameter are matched. Accordingly, within the display Frame Time corresponding to the N+th frame, the image corresponding to the N+3th frame is displayed. For the undescribed part, please refer to Figures 12 and 13 , I will not go into details here.

[0268] by Figure 15For example, the electronic device executes S1507-1 to S1509-1. At time T5, the aperture motor driver detects that the OIS pin is pulled low, determines that the EOF corresponds to the Nth frame, and does not process it. At time T8, the aperture motor driver detects that the OIS pin is pulled low again, determines that the EOF corresponds to the N+1th frame. The hardware starts to execute S1507-2 to S1509-2 to adjust the aperture. Figure 18 , the aperture component starts adjusting the aperture from the EOF of the N+1 frame, that is, at time T8 (there may be a certain delay), until the adjustment is completed at time T10-1. In this example, the exposure parameters of the Nth frame and the N+1th frame are the same, and the aperture parameters are the same. When the N+2 frame is exposed, the aperture is being adjusted from time T8 to T10-1, so the aperture parameters do not match the exposure parameters (the specific reasons can be found above and will not be repeated here). Therefore, the AP side discards the N+2 frame. When the N+3 frame is exposed (that is, starting from time T12), the aperture parameters have been adjusted and the exposure parameters have also taken effect, so the aperture parameters match the exposure parameters. For the undescribed part, please refer to Figures 14 to 16 , I will not go into details here.

[0269] by Figure 17 For example, the electronic device executes S1707-1 to S1709-1. At time T5, IFE detects that OIS pin is pulled low, determines that EOF corresponds to frame N, and does not process. At time T8, IFE detects that OIS pin is pulled low again, determines that EOF corresponds to frame N+1. The electronic device starts to execute S1707-2 to S1712-2 to adjust the aperture. Figure 18 , the aperture component starts adjusting the aperture from the EOF of the N+1 frame, that is, at time T8 (there may be a certain delay), until the adjustment is completed at time T10-1. In this example, the exposure parameters of the Nth frame and the N+1th frame are the same, and the aperture parameters are the same. When the N+2 frame is exposed, the aperture is being adjusted from time T8 to T10-1, so the aperture parameters do not match the exposure parameters (the specific reasons can be found above and will not be repeated here). Therefore, the AP side discards the N+2 frame. When the N+3 frame is exposed (that is, starting from time T12), the aperture parameters have been adjusted and the exposure parameters have also taken effect, so the aperture parameters match the exposure parameters. For the undescribed part, please refer to Figure 17 , I will not go into details here.

[0270] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0271] In one example, Figure 19 A schematic block diagram of a device 1900 according to an embodiment of the present application is shown. The device 1900 may include: a processor 1901 and a transceiver / transceiver pin 1902 , and optionally, a memory 1903 .

[0272] The various components of the device 1900 are coupled together via a bus 1904, wherein the bus 1904 includes, in addition to a data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clarity, all buses are referred to as bus 1904 in the figure.

[0273] Optionally, the memory 1903 may be used for instructions in the aforementioned method embodiment. The processor 1901 may be used to execute instructions in the memory 1903 and control the receiving pin to receive a signal and control the transmitting pin to send a signal.

[0274] The apparatus 1900 may be the electronic device or a chip of the electronic device in the above method embodiment.

[0275] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0276] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.

[0277] This embodiment further provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the method in the above-mentioned embodiment.

[0278] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the methods in the above-mentioned method embodiments.

[0279] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0280] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for setting photographing parameters, characterized in that: Applied to electronic equipment, the method comprises: At a first moment, obtaining a first exposure parameter and a first aperture parameter of the Nth frame; At a second moment, the first exposure parameter is sent to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; At a third moment, the aperture assembly adjusts the aperture based on the first aperture parameter; The first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the Nth frame.

2. The method according to claim 1, characterized in that The method further comprises: Within the display time period corresponding to the N+2th frame, the image corresponding to the N+2th frame is displayed based on the first exposure parameter and the first aperture parameter.

3. The method according to claim 2, characterized in that The method further comprises: within a display duration corresponding to the Nth frame, based on a second exposure parameter and a second aperture parameter, displaying an image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; The image corresponding to the Nth frame is displayed within the display duration corresponding to the N+1th frame.

4. The method according to claim 1, characterized in that The step of obtaining the first exposure parameter and the first aperture parameter of the Nth frame at the first moment includes: In response to the received user operation, acquiring the first exposure parameter and the first aperture parameter; Determine, by an automatic exposure module, that the first exposure parameter and the first aperture parameter act on the Nth frame; The first exposure parameter and the first aperture parameter are cached in a camera driver.

5. The method according to claim 4, characterized in that At the second moment, sending the first exposure parameter to the camera sensor includes: At the second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor to instruct the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; In response to the received first exposure parameter, the camera sensor performs exposure based on the first exposure parameter starting from the (N+2)th frame.

6. The method according to claim 5, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the second moment, the IFE module instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module in response to the first SOF signal output by the camera sensor; The OIS module receives the first aperture parameter sent by the camera driver; At the third moment, the OIS module obtains the first OIS pin signal output by the camera sensor, sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

7. The method according to claim 5, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the third moment, the camera driver obtains the first OIS pin signal output by the camera sensor, and sends the first aperture parameter to the OIS module; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

8. The method according to claim 5, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the third moment, the IFE module instructs the camera driver to send the first aperture parameter to the OIS module in response to the first EOF signal output by the camera sensor; the first EOF signal is used to indicate the EOF of the Nth frame; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter.

9. A method for setting photographing parameters, characterized in that: Applied to electronic equipment, the method comprises: At a first moment, obtaining a first exposure parameter and a first aperture parameter of the Nth frame; At a second moment, the first exposure parameter is sent to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; At a third moment, the aperture assembly adjusts the aperture based on the first aperture parameter; The first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the N+1th frame.

10. The method according to claim 9, characterized in that The method further comprises: Within a display time period corresponding to the N+3th frame, the image corresponding to the N+3th frame is displayed based on the first exposure parameter and the first aperture parameter.

11. The method according to claim 10, characterized in that The method further comprises: within a display duration corresponding to the Nth frame, based on a second exposure parameter and a second aperture parameter, displaying an image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; Displaying the image corresponding to the N+1th frame based on the second exposure parameter and the second aperture parameter within the display duration corresponding to the N+1th frame; The image corresponding to the N+1th frame is displayed within the display duration corresponding to the N+2th frame.

12. The method according to claim 9, characterized in that The step of obtaining the first exposure parameter and the first aperture parameter of the Nth frame at the first moment includes: In response to the received user operation, acquiring the first exposure parameter and the first aperture parameter; Determine, by an automatic exposure module, that the first exposure parameter and the first aperture parameter act on the Nth frame; The first exposure parameter and the first aperture parameter are cached in a camera driver.

13. The method according to claim 12, characterized in that At the second moment, sending the first exposure parameter to the camera sensor includes: At the second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor to instruct the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; In response to the received first exposure parameter, the camera sensor performs exposure based on the first exposure parameter starting from the (N+2)th frame.

14. The method according to claim 13, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the second moment, the IFE module instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module in response to the first SOF signal output by the camera sensor; The OIS module receives the first aperture parameter sent by the camera driver; At the third moment, the OIS module obtains the first OIS pin signal output by the camera sensor, sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

15. The method according to claim 13, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the third moment, the camera driver obtains the first OIS pin signal output by the camera sensor, and sends the first aperture parameter to the OIS module; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

16. The method according to claim 13, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the third moment, the IFE module instructs the camera driver to send the first aperture parameter to the OIS module in response to the first EOF signal output by the camera sensor; the first EOF signal is used to indicate the EOF of the N+1th frame; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter.

17. An electronic device, characterized in that: include: One or more processors, memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: At a first moment, obtaining a first exposure parameter and a first aperture parameter of the Nth frame; At a second moment, the first exposure parameter is sent to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; At a third moment, the aperture assembly adjusts the aperture based on the first aperture parameter; The first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the Nth frame.

18. The electronic device according to claim 17, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: Within the display time period corresponding to the N+2th frame, the image corresponding to the N+2th frame is displayed based on the first exposure parameter and the first aperture parameter.

19. The electronic device according to claim 18, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: within a display duration corresponding to the Nth frame, based on a second exposure parameter and a second aperture parameter, displaying an image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; The image corresponding to the Nth frame is displayed within the display duration corresponding to the N+1th frame.

20. The electronic device according to claim 17, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to the received user operation, acquiring the first exposure parameter and the first aperture parameter; Determine, by an automatic exposure module, that the first exposure parameter and the first aperture parameter act on the Nth frame; The first exposure parameter and the first aperture parameter are cached in a camera driver.

21. The electronic device according to claim 20, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor to instruct the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; In response to the received first exposure parameter, the camera sensor performs exposure based on the first exposure parameter starting from the (N+2)th frame.

22. The electronic device according to claim 21, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the second moment, the IFE module instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module in response to the first SOF signal output by the camera sensor; The OIS module receives the first aperture parameter sent by the camera driver; At the third moment, the OIS module obtains the first OIS pin signal output by the camera sensor, sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

23. The electronic device according to claim 21, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the third moment, the camera driver obtains the first OIS pin signal output by the camera sensor, and sends the first aperture parameter to the OIS module; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the Nth frame.

24. The electronic device according to claim 21, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the third moment, the IFE module instructs the camera driver to send the first aperture parameter to the OIS module in response to the first EOF signal output by the camera sensor; the first EOF signal is used to indicate the EOF of the Nth frame; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter.

25. An electronic device, characterized in that: include: One or more processors, memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: At a first moment, obtaining a first exposure parameter and a first aperture parameter of the Nth frame; At a second moment, the first exposure parameter is sent to the camera sensor, and starting from the N+2th frame, the camera sensor performs exposure based on the first exposure parameter; At a third moment, the aperture assembly adjusts the aperture based on the first aperture parameter; The first moment is before the second moment, the second moment is the moment corresponding to the start of frame delimiter SOF of the Nth frame, and the third moment is the moment corresponding to the end of frame delimiter EOF of the N+1th frame.

26. The electronic device according to claim 25, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: Within a display time period corresponding to the N+3th frame, the image corresponding to the N+3th frame is displayed based on the first exposure parameter and the first aperture parameter.

27. The electronic device according to claim 26, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: within a display duration corresponding to the Nth frame, based on a second exposure parameter and a second aperture parameter, displaying an image corresponding to the Nth frame, wherein the second exposure parameter is different from the first exposure parameter, and the second aperture parameter is different from the first aperture parameter; Displaying the image corresponding to the N+1th frame based on the second exposure parameter and the second aperture parameter within the display duration corresponding to the N+1th frame; The image corresponding to the N+1th frame is displayed within the display duration corresponding to the N+2th frame.

28. The electronic device according to claim 27, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to the received user operation, acquiring the first exposure parameter and the first aperture parameter; Determine, by an automatic exposure module, that the first exposure parameter and the first aperture parameter act on the Nth frame; The first exposure parameter and the first aperture parameter are cached in a camera driver.

29. The electronic device according to claim 28, characterized in that When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the second moment, the image front-end IFE module responds to the first SOF signal output by the camera sensor to instruct the camera driver to send the first exposure parameter to the camera sensor; the first SOF signal is used to indicate the SOF of the Nth frame; In response to the received first exposure parameter, the camera sensor performs exposure based on the first exposure parameter starting from the (N+2)th frame.

30. The electronic device according to claim 29, characterized in that When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the second moment, the IFE module instructs the camera driver to send the first aperture parameter to the aperture anti-shake OIS module in response to the first SOF signal output by the camera sensor; The OIS module receives the first aperture parameter sent by the camera driver; At the third moment, the OIS module obtains the first OIS pin signal output by the camera sensor, sends the first aperture parameter to the aperture component, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

31. The electronic device according to claim 29, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: At the third moment, the camera driver obtains the first OIS pin signal output by the camera sensor, and sends the first aperture parameter to the OIS module; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter; the first OIS pin signal is used to indicate the EOF of the N+1th frame.

32. The electronic device according to claim 29, characterized in that At the third moment, the aperture assembly adjusts the aperture based on the first aperture parameter, including: At the third moment, the IFE module instructs the camera driver to send the first aperture parameter to the OIS module in response to the first EOF signal output by the camera sensor; the first EOF signal is used to indicate the EOF of the N+1th frame; The OIS module sends the first aperture parameter to the aperture component in response to the first aperture parameter sent by the camera driver, and the aperture component adjusts the aperture based on the first aperture parameter.

33. A computer storage medium, characterized in that The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 16.

34. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 16.

35. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor, the signal comprising a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device executes the method described in any one of claims 1 to 16.

Images