Image sensor, camera module, electronic device and shooting method

Abstract

The present application discloses an image sensor, a camera module, an electronic device and a shooting method, which belongs to the field of optical instrument technology. The image sensor includes: a plurality of photodiodes distributed in an array; M light shielding plates, located on the light incident side of the plurality of photodiodes, and each light shielding plate is arranged opposite to at least one of the plurality of photodiodes; M driving mechanisms, avoiding the light incident channels of the plurality of photodiodes, and each driving mechanism is connected to one of the M light shielding plates; each driving mechanism drives the connected light shielding plate to rotate, so as to change the angle between the connected light shielding plate and the target plane where the plurality of photodiodes are located, and to change the light transmittance of at least one target photodiode arranged opposite to the connected light shielding plate among the plurality of photodiodes; the light transmittance of the at least one target photodiode is positively correlated with the angle between the connected light shielding plate and the target plane, and M is an integer greater than 1.

Description

Technical Field

[0001] The present application belongs to the technical field of optical instruments, and specifically relates to an image sensor, a camera module, an electronic device and a shooting method. Background Art

[0002] Currently, it is possible to capture images with high dynamic range using electronic devices.

[0003] Specifically, during a shooting process, the electronic device can collect multiple images with different exposures, and merge the images with different exposure levels together to obtain an image with a high dynamic range; if the shooting scene has a large contrast between light and dark, the effect of the high dynamic range image is enhanced color contrast and better detail performance, that is, it has the characteristics of "no overexposure of highlights and no underexposure of low lights".

[0004] However, since fusing multiple images together amplifies color noise, the resulting high dynamic range image has poor quality. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an image sensor, a camera module, an electronic device and a shooting method, which can differentially control the light transmittance of each photodiode of the image sensor during the image shooting process, so as to achieve brightness adjustment of different image areas on a single image, thereby improving the image quality on the basis of expanding the image dynamic range.

[0006] In a first aspect, an embodiment of the present application provides an image sensor, which includes: a plurality of photodiodes distributed in an array; M light shielding plates, located on the light incident side of the plurality of photodiodes, and each light shielding plate is arranged opposite to at least one of the plurality of photodiodes; M driving mechanisms, avoiding the light incident channels of the plurality of photodiodes, and each driving mechanism is connected to one of the M light shielding plates; each driving mechanism drives the connected light shielding plate to rotate, so as to change the angle between the connected light shielding plate and the target plane where the plurality of photodiodes are located, and to change the light transmittance of at least one target photodiode among the plurality of photodiodes that is arranged opposite to the connected light shielding plate; the light transmittance of the at least one target photodiode is positively correlated with the angle between the connected light shielding plate and the target plane, and M is an integer greater than 1.

[0007] In a second aspect, an embodiment of the present application provides a camera module, comprising the image sensor as described in the first aspect.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, comprising the camera module as described in the second aspect.

[0009] In a fourth aspect, an embodiment of the present application provides a shooting method, which is applied to an electronic device, wherein the electronic device includes an image sensor as described in the first aspect, and the method includes: obtaining driving information of each driving mechanism of the image sensor; in the process of the image sensor capturing a first image, based on the driving information of each driving mechanism, controlling each driving mechanism to drive the connected shading plate to rotate, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light transmittance of at least one target photodiode arranged opposite to each shading plate is changed to the target light transmittance corresponding to each target angle; wherein the target plane is the plane where all photodiodes of the image sensor are located, and M is an integer greater than 1.

[0010] In a fifth aspect, an embodiment of the present application provides a shooting device, which may include: an acquisition module and a control module. The acquisition module is used to acquire the driving information of each driving mechanism of the M driving mechanisms of the image sensor; the control module is used to control each driving mechanism to drive the connected shading plate to rotate based on the driving information of each driving mechanism acquired by the acquisition module during the process of the image sensor capturing the first image, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light flux of at least one target photodiode arranged opposite to each shading plate is changed to the target light flux corresponding to each target angle; wherein the target plane is the plane where all the photodiodes of the image sensor are located, and M is an integer greater than 1.

[0011] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the fourth aspect.

[0012] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the fourth aspect are implemented.

[0013] In an eighth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the fourth aspect.

[0014] In the embodiment of the present application, each light shielding plate of the image sensor is arranged opposite to at least one photodiode of the image sensor, each light shielding plate is connected to a driving mechanism, and each driving mechanism can drive the connected light shielding plate to rotate relative to the target plane where all the photodiodes of the image sensor are located, so that the light flux of the photodiode arranged opposite to each light shielding plate can change with the change of the angle between each light shielding plate and the target plane. Since different driving mechanisms can drive different light shielding plates to rotate, and different light shielding plates are arranged opposite to different photodiodes, regional control of the light flux of the image sensor can be achieved through M driving mechanisms and M light shielding plates, so that the brightness of different image areas can be adjusted on a single image, and the image quality can be improved on the basis of expanding the dynamic range of the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is one of the structural schematic diagrams of the image sensor provided in the embodiment of the present application;

[0016] Figure 2 This is the second structural schematic diagram of the image sensor provided in the embodiment of the present application;

[0017] Figure 3 is a schematic diagram of the working principle of the first driving member and the second driving member;

[0018] Figure 4 is a structural schematic diagram of a shooting method provided in an embodiment of the present application;

[0019] Figure 5 It is a schematic diagram of the exposure timing process of a rolling shutter sensor in the related art;

[0020] Figure 6 This is one of the process schematic diagrams of the exposure timing of the image sensor provided in the embodiment of the present application;

[0021] Figure 7 This is the second process schematic diagram of the exposure timing of the image sensor provided by the embodiment of the present application;

[0022] Figure 8 A possible schematic diagram of a tone mapping curve used in an embodiment of the present application;

[0023] Fig. 9 is a schematic diagram of the structure of a photographing device provided in an embodiment of the present application;

[0024] Fig.10 It is one of the structural schematic diagrams of the electronic device provided in the embodiment of the present application;

[0025] Fig.11 This is the second structural diagram of the electronic device provided in the embodiment of the present application;

[0026] in, Figures 1 to 3 The reference numerals in the drawings are:

[0027] 100-image sensor; 10-photodiode; 20-shading plate; 30-driving mechanism; 31-first driving member; 32-second driving member; 33-elastic member; 34-heightening member; 40-microlens array; 50-color filter array; 51-color filter unit; 60-support structure; 70-metal wiring layer; 80-power supply. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0030] First, some nouns or terms involved in the claims and description of this application are explained below.

[0031] Image sensor is a device that converts optical images into electronic signals and is widely used in electronic optical devices such as digital cameras and smart phones. Today, image sensors are mainly divided into two types: charge-coupled device (CCD) and complementary metal oxide semiconductor (CMOS) active pixel sensor. CMOS active pixel sensor can be referred to as CMOS sensor.

[0032] CMOS sensor is a type of active pixel sensor that uses CMOS semiconductors. There is a corresponding circuit near each photoelectric sensor to directly convert light energy into a voltage signal. Unlike CCD, it does not involve signal charge. An analog-to-digital converter may also be required on the motherboard to convert its output signal into a digital signal. Camera modules with miniaturized and low-power CMOS image sensors as the core have become the mainstream configuration of smartphone products.

[0033] Color Filter Array (CFA): It is a mosaic layer above the pixel sensor, used to collect / filter the color information of the image. General photoelectric sensors can only sense the intensity of light, but cannot distinguish the wavelength (color) of light. Therefore, the image sensor needs to pass through a color filter to obtain the color information of the pixel. The color filter filters the light according to the wavelength, and a specific color filter only allows light of a specific wavelength to pass through.

[0034] Traditional image sensors obtain the intensity information of red, green and blue light on pixels through Bayer filters, and then use the demosaicing algorithm to calculate the color value of the pixel.

[0035] The spectral filtering characteristics and color restoration algorithm of CFA determine the color acquisition capability of CFA. Usually, the photon passband of the image sensor and the spectral response range of CFA are larger than the visible light spectrum range, thus ensuring that the image sensor can capture all color information in the visible light range.

[0036] Bayer filter: The CFA arrangement of CMOS sensors used in traditional mobile phones is usually Bayer filter, that is, a single color red (Red, R) / green (Green, G) / blue (Blue, B) filter is placed on each pixel at intervals, that is, RGB pixel arrangement. Therefore, Bayer filter is also called RGGB filter.

[0037] Invented in 1976, Bayer Filter is the most widely used CFA on the market. The Bayer Filter CFA configuration includes 1 red light, 1 blue light and 2 green light filters (25% Red, 25% Blue, 50% Green). Since the human eye is naturally more sensitive to green, the Bayer Filter is designed to have better green light transmittance than the other two colors. Compared with the equivalent processing of RGB colors, this processing method restores images with lower noise and clearer details in the eyes of the human eye.

[0038] Red, green, blue, and white (write, W) pixel arrangement: also known as RGBW pixel arrangement, is to remove the "green filter" on the green pixel in the Bayer Filter. Then the green pixel receives the entire "white light" information, and the intensity will be greater than the reduced green light, and the low-light shooting capability will be better than the traditional RGB pixel arrangement.

[0039] Color restoration algorithm, also known as demosaic algorithm, de-mosaicing algorithm, demosaicking algorithm or debayering algorithm. Demosaic algorithm is a digital image processing algorithm that aims to reconstruct a full-color image from the incomplete color sampling output by a photosensitive element (such as an image sensor) covered with a CFA. This method is also called color filter array interpolation (CFA interpolation) or color reconstruction (Color reconstruction).

[0040] Micro Electro Mechanical Systems (MEMS): A micron-sized mechanical system that operates within the micron scale. For example, it can perform actions by integrating actuators and sensors on a microchip to achieve specific functions.

[0041] In other words, any mechanical system whose operating range is within the micrometer scale and whose mechanical size is also within the micrometer scale can be called a micro-electric system.

[0042] High Dynamic Range Imaging (HDRI or HDR): In computer graphics and cinematography, high dynamic range imaging is a set of technologies used to achieve a larger exposure dynamic range (i.e., a greater difference between light and dark) than ordinary digital imaging technology. The purpose of high dynamic range imaging is to correctly represent the brightness of the real world, from direct sunlight to the darkest shadow.

[0043] It can be understood that an image captured by a high dynamic range can be called an image with a high dynamic range.

[0044] Aperture: It is a component on a camera module or camera that controls the size of the lens aperture, so as to control the depth of field of the camera module, the image quality of the lens, and the shutter to control the amount of light passing through. For a manufactured lens, the diameter of the lens cannot be changed at will, but the amount of light passing through the lens can be controlled by adding an aperture inside the lens. The aperture can be a polygonal or circular hole-shaped grating with a variable area.

[0045] Dark current: refers to the tiny current that is still generated on the light sensor (also called a photosensitive element, such as a photomultiplier tube, photodiode, and photocoupler) when no photons pass through the light sensor.

[0046] In non-optical devices, this is called reverse bias leakage current, which exists in all diodes. Dark current is caused by the random generation of electrons and holes in the depletion layer of the device.

[0047] Dark current is one of the main noise sources of image sensors. Different dark current models will form fixed pattern noise. The average fixed pattern can be estimated and removed by dark frame subtraction.

[0048] Bad pixel: The array formed by the light collection points (pixels) on the image sensor has process defects, or errors occur in the process of converting light signals into electrical signals, which will cause incorrect pixel information on the image and inaccurate pixel values ​​in the image. These defective pixel values ​​are bad pixels.

[0049] Due to different process technologies and sensor manufacturers, especially for some low-cost, consumer sensors, there will be a lot of bad pixels. In addition, if the sensor is used for a long time or is in a high temperature environment for a long time, the number of bad pixels in the image sensor will increase, thus destroying the clarity and integrity of the image. The purpose of bad pixel correction is to repair such problems.

[0050] The image sensor, camera module, electronic device and shooting method provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios in combination with the accompanying drawings.

[0051] In related technologies, due to the limitation of space size and complex mechanical structure, electronic devices are usually equipped with fixed aperture lenses, which cannot realize dynamic control of light transmission. In photo taking applications, when the camera of the electronic device is set to high sensitivity mode to obtain better dark area image content, the highlight content in the captured image is usually overexposed, that is, the dynamic range of the highlight part is sacrificed.

[0052] Therefore, when a high dynamic range image is required, it is usually obtained by collecting multiple images with different exposures in one shooting process, and then selectively integrating the images with different exposure levels through an algorithm to obtain a high dynamic range image. When the shooting scene has a large contrast between light and dark, the effect of a high dynamic range image is enhanced color contrast and better detail performance, that is, "highlights are not overexposed and low light is not underexposed."

[0053] However, when the image sensor uses an RGB array (RGB pattern) CFA, the tiny details in the image close to the resolution of the digital sensor will cause problems for the color restoration algorithm, which is easy to produce results that do not look like the original image. The most common noise is Moire pattern, which refers to the possibility of repeated patterns, color artifacts, or pixels arranged in an unrealistic pattern like a maze.

[0054] Compared with the traditional RGB pattern, the RGBW pattern will improve the photosensitivity, but due to its lower color sampling density, problems such as erroneous color noise will become more serious after algorithm interpolation.

[0055] There are also other dual-camera fusion technology solutions, which use a monochrome contact image sensor (CIS) camera + an RGB CIS camera to capture images at the same time, and then align and fuse the images captured by the two cameras to obtain images with a high dynamic range. However, on the one hand, dual cameras add additional pressure on the stacking space and power consumption of mobile phones and other applications. On the other hand, the dual-camera solution involves the matching and alignment of the dual image content, which will also introduce side effects on the image quality.

[0056] It can be seen that since fusing multiple images together will amplify color noise, the quality of the resulting high dynamic range image is poor.

[0057] In the image sensor provided in the embodiment of the present application, each light shielding plate of the image sensor is arranged opposite to at least one photodiode of the image sensor, each light shielding plate is connected to a driving mechanism, and each driving mechanism can drive the connected light shielding plate to rotate relative to the target plane where all the photodiodes of the image sensor are located, so that the light flux of the photodiode arranged opposite to each light shielding plate can change with the change of the angle between each light shielding plate and the target plane. Since different driving mechanisms can drive different light shielding plates to rotate, and different light shielding plates are arranged opposite to different photodiodes, regional control of the light flux of the image sensor can be achieved through M driving mechanisms and M light shielding plates, so that the brightness adjustment of different image areas can be achieved on a single image, and then the image quality can be improved on the basis of expanding the dynamic range of the image.

[0058] Optionally, in the embodiment of the present application, each driving mechanism (also called MEMS mechanism) is driven to cause the corresponding micro baffle (i.e., the light shielding plate in the embodiment of the present application) to tilt and deform relative to the light incident surface (i.e., the plane where all the photodiodes of the image sensor are located), thereby achieving regional and dynamic adjustment of the light transmittance of the corresponding photodiode. For example, a single image captured by the image sensor can be an image with a higher dynamic range, thereby improving the image quality of the image with a dynamic range.

[0059] In addition, by controlling all the shading plates to be fully raised, the light transmission of all the photodiodes in the image sensor is maximized, and the image sensor collects a natural exposure image (i.e., the exposure level is the same as that of the image collected in the related art), and / or, by controlling all the shading plates to be fully closed, the light transmission of all the photodiodes in the image sensor is minimized, for example, the light transmission is 0, and the image sensor collects a completely black image. Therefore, in the subsequent shooting process, the dynamic range compression of a single image can be achieved in combination with the naturally exposed image; and / or, the noise compensation of a single image can be achieved in combination with the completely black image.

[0060] The present application embodiment provides an image sensor, Figure 1 A possible structural diagram of an image sensor provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the image sensor 100 provided in the embodiment of the present application may include: a plurality of photodiodes 10 distributed in an array, M light shielding plates 20, and M driving mechanisms 30. The M light shielding plates 20 are located on the light incident side of the plurality of photodiodes 10, and each light shielding plate 20 is arranged opposite to at least one photodiode 10 among the plurality of photodiodes 10; the M driving mechanisms 30 avoid the light incident channels of the plurality of photodiodes 10, and each driving mechanism 30 is connected to one of the M light shielding plates 20.

[0061] Among them, each driving mechanism 30 drives the connected shading plate 20 to rotate, so as to change the angle between the connected shading plate 20 and the target plane where the multiple photodiodes 10 are located, and change the light transmittance of at least one target photodiode 10 among the multiple photodiodes 10 that is arranged opposite to the connected shading plate 20; the light transmittance of the at least one target photodiode 10 is positively correlated with the angle between the connected shading plate 20 and the target plane, and M is an integer greater than 1.

[0062] In the embodiment of the present application, the plurality of photodiodes are all the photodiodes of the image sensor.

[0063] In the embodiment of the present application, all photodiodes of the image sensor constitute M photosensitive areas, each of which includes at least one photodiode. The M photosensitive areas correspond one-to-one to the M light shielding plates, and the M light shielding plates correspond one-to-one to the M driving mechanisms.

[0064] Each driving mechanism can drive a light shielding plate to rotate, and when the light shielding plate rotates, the angle between the light shielding plate and the target plane also changes accordingly. When the angle changes, the amount of light transmitted in the photosensitive area opposite to the light shielding plate also changes synchronously; and the larger the angle between the light shielding plate and the target plane, the greater the amount of light transmitted in the photosensitive area.

[0065] In the embodiment of the present application, by controlling the opening or closing of the shading plate relative to the target plane, at least one photodiode corresponding to the shading plate can be made to sense light or shield black.

[0066] In the embodiment of the present application, each driving mechanism drives the connected shading plate to rotate to change the degree to which the shading plate blocks the light entrance channel of at least one target photodiode arranged opposite to the shading plate, thereby adjusting the light transmittance of the at least one target photodiode.

[0067] It should be noted that the above-mentioned M driving mechanisms can work independently, and different driving mechanisms drive different shading plates to rotate without interfering with each other. In this way, the light transmittance of different photodiodes of the image sensor can be dynamically adjusted through the M driving mechanisms and the M shading plates, so that the single image captured by the image sensor can be an image with a high dynamic range.

[0068] In the embodiment of the present application, “each shading plate is arranged opposite to at least one photodiode among the multiple photodiodes” can be understood as: the relative position relationship between the shading plate and the at least one photodiode before the driving mechanism connected to the shading plate drives the shading plate to rotate.

[0069] In the embodiment of the present application, “M driving mechanisms avoid the light entrance channels of the multiple photodiodes” can be understood as: the projection areas of the driving mechanisms and the multiple photodiodes along the light entrance directions of the multiple photodiodes do not overlap. In this way, the driving mechanisms can be prevented from blocking the light entrance channels or light entrance surfaces of the multiple photodiodes.

[0070] In the embodiment of the present application, the photodiode is used to sense light and convert the light information into electrical information.

[0071] Optionally, the photodiode may also be referred to as a photosensitive element, such as a photomultiplier tube, a photodiode, and a photosensitive coupling element, etc., which may be specifically determined according to actual use requirements.

[0072] Optionally, the at least one photodiode (i.e., the photodiode disposed opposite to each shading plate) may include 1, 2, 4 or 6 photodiodes, etc. Of course, in actual implementation, the at least one photodiode may also include 3, 5 or 7 photodiodes. The specific number may be determined according to actual use requirements.

[0073] In the embodiment of the present application, each driving mechanism may also be referred to as a MEMS structure.

[0074] For ease of understanding, the driving mechanism is described in detail below.

[0075] Alternatively, if Figure 2 As shown, each of the M driving mechanisms may include: a first driving member 31, a second driving member 32 and an elastic member 33. The first driving member 31 is disposed on the light incident side of at least one photodiode 10 among the plurality of photodiodes 10; the second driving member 32 is disposed opposite to the first driving member 31, and the second driving member 32 is connected to a light shielding plate 20; the elastic member 33 is disposed between the first driving member 31 and the second driving member 32, and the two ends of the elastic member 33 are respectively connected to the edge of the first driving member 31 and the edge of the second driving member 32.

[0076] When a voltage or current is applied to at least one of the first driver 31 and the second driver 32, a repulsive force is generated between the first driver 31 and the second driver 32, driving the second driver 32 and the shading plate 20 connected to the second driver 32 to rotate around the elastic member 33, changing the angle between the shading plate 20 connected to the second driver 32 and the target plane, so as to change the light transmission amount of at least one target photodiode 10. Here, "at least one target photodiode 10" refers to the photodiode 10 arranged opposite to the shading plate 20 connected to the second driver 32.

[0077] It should be noted that, in actual implementation, when the second driving member drives the connected shading plate to rotate, the elastic member also undergoes elastic deformation synchronously. In this way, when the voltage and current are stopped from being applied to the first driving member and the second driving member, the elastic member can drive the second driving member and the shading plate connected to the second driving member to rotate in the opposite direction, so that the shading plate connected to the second driving member is reset.

[0078] For each light shield, when a light shield is reset, the angle between the light shield and the target plane is within the second preset range. At this time, the light shield blocks the light entrance channel of a photosensitive area corresponding to the light shield to the maximum extent, so that the light transmission of at least one target photodiode in the photosensitive area is minimized. When a light shield rotates, the degree of blocking of the light shield by the light shield on the light entrance channel of the photosensitive area corresponding to the light shield becomes smaller, so that the light transmission of at least one target photodiode in the photosensitive area is increased.

[0079] In the embodiment of the present application, for each driving mechanism, the angle between the shading plate connected to the second driving member in one driving mechanism and the target plane is positively correlated with the light transmittance of at least one target photodiode corresponding to the shading plate.

[0080] Specifically, the light flux of the at least one photodiode is positively correlated with the voltage or current applied to at least one of the first driver and the second driver.

[0081] In the embodiment of the present application, when no voltage or current is applied to the first driver and the second driver, the shading plate connected to the second driver is arranged opposite to the at least one photodiode, so as to block the light incident surface or light incident channel of the at least one photodiode to the greatest extent, so that the light transmittance of the at least one photodiode is minimized; and when a voltage or current is applied to at least one of the first driver and the second driver, since the movable structure rotates relative to the light incident surface (parallel to the target plane) of the at least one photodiode, the overlapping size of the shading plate and the at least one photodiode in the light incident direction of the at least one photodiode is reduced, that is, the degree of blocking of the light incident channel of the at least one photodiode by the shading plate is reduced, so that the light transmittance of the at least one photodiode is increased.

[0082] In the embodiment of the present application, the second driving member and the light shielding plate connected to the second driving member do not overlap in the light incident direction.

[0083] Further optionally, the size of the first driving member may be the same as the size of the second driving member.

[0084] For example, the first driving member and the second driving member are both frame-shaped, and the shading plate connected to the second driving member is embedded in the second driving member. For another example, the first driving member and the second driving member are both L-shaped, and the inner edge of the L-shaped second driving member is fixedly connected to the shading plate connected thereto. For another example, the first driving member and the second driving member are both straight-line-shaped, and the long side of the second driving member is fixedly connected to the shading plate connected thereto.

[0085] It should be noted that the above examples are only examples of the shapes of the first driving member and the second driving member. In actual implementation, the first driving member and the second driving member may also be any other possible shapes.

[0086] Optionally, the elastic member may be a reset spring or a reset column, etc., which are components that can automatically return without external force. In this way, the sunshade can be reset by the elastic member.

[0087] Optionally, the elastic member is an insulating elastic member, such as an insulating spring sheet, so that the first driving member and the second driving member can be prevented from being connected, thereby achieving independent driving of the first driving member and the second driving member.

[0088] In the embodiment of the present application, since the angle between the shading plate connected to the second driver and the target plane can be changed by applying a voltage or current to at least one of the first driver and the second driver to change the light transmission of at least one target photodiode arranged opposite to the shading plate, the at least one target photodiode can have different light transmissions by adjusting the different voltages or currents applied to at least one of the first driver and the second driver. In this way, dynamic adjustment of the light transmission of the at least one target photodiode can be achieved.

[0089] Furthermore, since the first driving member and the second driving member are connected by an elastic member, when the voltage and current are stopped from being applied to the first driving member and the second driving member, the elastic member can drive the shading plate connected to the second driving member and the second elastic member to rotate in the opposite direction to restore it to a state opposite to at least one target photodiode.

[0090] The image sensor provided in the embodiment of the present application is described in detail below in combination with two implementation modes (i.e., the first implementation mode and the second implementation mode).

[0091] A first implementation manner: applying a voltage to at least one of the first driving member and the second driving member to generate a mutually repulsive force between the first driving member and the second driving member.

[0092] Optionally, the first driving member and the second driving member are both capacitor plates.

[0093] In the embodiment of the present application, when the voltages applied to the first driver and the second driver are different, a mutually repulsive electrostatic force is generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, thereby changing the angle between the shading plate connected to the second driver and the target plane, so as to change the light transmittance of at least one target photodiode arranged opposite to the shading plate connected to the second driver.

[0094] In the embodiment of the present application, the electrostatic force between the first driving member and the second driving member is positively correlated with the voltage difference between the first driving member and the second driving member, that is, the greater the voltage difference between the first driving member and the second driving member, the greater the electrostatic force between the first driving member and the second driving member.

[0095] It should be noted that when there is no voltage difference between the first driving member and the second driving member, for example, when no voltage is applied to the first driving member and the second driving member, the elastic member can be reset under the action of its elastic force, driving the second driving member and the shading plate to rebound until the first driving member is parallel to the second driving member, thereby achieving the reset of the shading plate.

[0096] In the embodiment of the present application, the first driving element and the second driving element can form a flat plate capacitor.

[0097] The following is combined with Figure 3 The working principle of the driving mechanism in the first implementation is described in detail.

[0098] like Figure 3 As shown, when a positive voltage is applied to the first driving member 31 and the second driving member 32 respectively through the power supply 80, that is, the voltages applied to the first driving member 31 and the second driving member 32 are different, a mutually repulsive electrostatic force is generated between the first driving member 31 and the second driving member 32; thereby driving the second driving member 32 to move in a direction away from the first driving member 31. After the movement, the second driving member 32 is as shown in FIG. Figure 3 32' shown.

[0099] Specifically, refer to Figure 3 , the electrostatic force F between the first driving member 31 and the second driving member 32 can be expressed by the following formula:

[0100]

[0101] Among them, ε0 and ε1 are the dielectric constants of the media in the first driving member 31 and the second driving member 32 respectively, A is the overlapping area of ​​the first driving plate 31 and the second driving plate 32, V is the voltage difference between the first driving member 31 and the second driving member 32, d0 is the initial distance between the first driving member 31 and the second driving member 32, that is, the distance between the two when no potential is applied, and △d is the distance after the second driving member 32 moves relative to the first driving member 31 after voltage is applied to the first driving member 31 and the second driving member 32.

[0102] It should be noted that Figure 3 This is a schematic diagram of the relative movement of the first driving member and the second driving member when no elastic member is provided between them. In actual implementation, when an elastic member is provided between the first driving member and the second driving member, when a mutually repulsive electrostatic force is generated between the first driving member and the second driving member, due to the constraint of the elastic member, the side of the second driving member away from the elastic member will be lifted relative to the first driving member, that is, rotated; and when no positive voltage is applied to the first driving member and the second driving member, for example, no voltage is applied to the two or the voltage applied to the two is the same, the elastic force of the insulating spring causes the second driving member and the shading plate to return to the reset state.

[0103] It can be understood that since the edge of the second driving member is connected to the edge of the first driving member through the insulating spring sheet, the second driving member and the shading plate connected to the second driving member can rotate around the insulating spring sheet.

[0104] In the embodiment of the present application, voltage is applied to two capacitor plates, namely, a first driving member and a second driving member, which are relatively arranged in each driving mechanism, so that a voltage difference exists between the two, thereby generating a mutually repulsive electrostatic force between the two, and then the second driving member and the shading plate connected to the second driving member can be rotated relative to the first driving member or the target plane under the action of the electrostatic force, so that the light transmittance of at least one target photodiode arranged opposite to the shading plate can be flexibly and accurately adjusted, thereby improving the accuracy of adjusting the light transmittance.

[0105] A second implementation manner: applying current to at least one of the first driving member and the second driving member to generate a mutually repulsive force between the first driving member and the second driving member.

[0106] Optionally, at least one of the first driving member and the second driving member is an electromagnet. Specifically, one of the first driving member and the second driving member is an electromagnet, and the other of the first driving member and the second driving member is a permanent magnet (method 1); or, both the first driving member and the second driving member are electromagnets (method 2).

[0107] The following describes method 1 and method 2 in detail respectively.

[0108] Optionally, in mode 1, one of the first driver and the second driver is an electromagnet, and the other of the first driver and the second driver is a permanent magnet. When current is applied to the electromagnet, a mutually repulsive Lorentz force is generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, changing the angle between the shading plate connected to the second driver and the target plane, so as to change the light transmission amount of at least one target photodiode arranged opposite to the shading plate connected to the second driver.

[0109] Optionally, in method 2, both the first driver and the second driver are electromagnets; when currents in opposite directions are applied to the first driver and the second driver, mutually repelling Lorentz forces are generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, thereby changing the angle between the shading plate connected to the second driver and the target plane, so as to change the light transmittance of at least one target photodiode arranged opposite to the shading plate connected to the second driver.

[0110] It should be noted that in Mode 1 and Mode 2, the greater the current passing through the first driving member and / or the second driving member, the greater the repulsive Lorentz force between the first driving member and the second driving member, that is, the two are positively correlated.

[0111] In the embodiment of the present application, by applying current to at least one of the first driving member and the second driving member in each driving mechanism, a mutually repulsive Lorentz force can be generated between the first driving member and the second driving member, so that the second driving member and the shading plate connected to the second driving member can be rotated under the action of the Lorentz force, thereby achieving flexible and accurate adjustment of the light transmittance of at least one target photodiode arranged opposite to the shading plate, thereby improving the accuracy of adjusting the light transmittance.

[0112] It should be noted that, Figure 2 The power supply 80 applies current or voltage to the driving mechanism in the first and second implementations described above. It can be understood that different driving mechanisms may correspond to different power supplies.

[0113] It can be understood that the first possible implementation and the second possible implementation are examples of the driving mechanism for the image sensor provided in the embodiment of the present application. In actual implementation, the driving mechanism can also be any other structure capable of driving the light shielding plate to rotate, for example, the driving mechanism can also be a mechanical structure including a micro motor. The specific details can be determined according to actual use requirements and are not limited in the embodiment of the present application.

[0114] In the image sensor provided in the embodiment of the present application, each light shielding plate of the image sensor is arranged opposite to at least one photodiode of the image sensor, each light shielding plate is connected to a driving mechanism, and each driving mechanism can drive the connected light shielding plate to rotate relative to the target plane where all the photodiodes of the image sensor are located, so that the light flux of the photodiode arranged opposite to each light shielding plate can change with the change of the angle between each light shielding plate and the target plane. Since different driving mechanisms can drive different light shielding plates to rotate, and different light shielding plates are arranged opposite to different photodiodes, regional control of the light flux of the image sensor can be achieved through M driving mechanisms and M light shielding plates, so that the brightness adjustment of different image areas can be achieved on a single image, and then the image quality can be improved on the basis of expanding the dynamic range of the image.

[0115] Alternatively, if Figure 2 As shown, each driving mechanism may further include a padding member 34. The padding member 34 is disposed on the edge of the surface of the first driving member 31 facing the second driving member 32; wherein both ends of the elastic member 33 are connected to the edge of the second driving member 32 and the padding member 34 respectively.

[0116] In the embodiment of the present application, the raising member is used to raise the second driving member and the shading plate connected to the second driving member.

[0117] Optionally, the raising member may be a rectangular raising block.

[0118] In the embodiment of the present application, the cushioning member in each driving mechanism can ensure that when no voltage and current are applied to the first driving member and the second driving member, the second driving member and the shading plate connected to the second driving member are parallel to the target plane, thereby ensuring that at least one photodiode arranged opposite to the shading plate is in a completely blacked-out state.

[0119] Alternatively, if Figure 1 As shown, the image sensor 100 provided in the embodiment of the present application may further include: a color filter array 50 arranged opposite to the plurality of photodiodes 10. The color filter array 50 is arranged on the light incident side of the plurality of photodiodes 10, and each color filter unit 51 in the color filter array 50 is arranged one-to-one with a photodiode 10 in the plurality of photodiodes 10.

[0120] It can be understood that the number of the color filter units 51 in the color filter array 50 is the same as the number of the photodiodes in the plurality of photodiodes.

[0121] Optionally, for each color filter unit 51 in the color filter array 50 , a color filter unit may be: a red filter unit, a green filter unit, a blue filter unit, or a white filter unit.

[0122] Among them, the red filter unit only allows red light to pass through, the blue filter unit only allows blue light to pass through, the green filter unit only allows green light to pass through, and the white filter unit allows natural light to pass through.

[0123] Optionally, the color filter array may be any possible array such as an RGB array, an RGBW array, etc., which is not specifically limited.

[0124] In the embodiment of the present application, the image sensor can obtain intensity information of multiple lights (such as red light, green light and blue light) through the color filter array, so as to determine the color value corresponding to each photodiode based on the intensity information.

[0125] In the embodiment of the present application, the image sensor implements light filtering through a color filter array.

[0126] Alternatively, if Figure 1 As shown, the image sensor 100 provided in the embodiment of the present application may further include: a microlens array 40. The microlens array 40 is arranged on the light incident side of the plurality of photodiodes 10, and each microlens in the microlens array 40 is arranged one-to-one with a photodiode 10 in the plurality of photodiodes 10.

[0127] In the embodiment of the present application, the image sensor can achieve light focusing through a microlens array.

[0128] Further optionally, the color filter array can be arranged on the microlens array, for example, the color filter array is arranged on the surface of the microlens array facing the multiple photodiodes, or the color filter array is arranged on the surface of the microlens array facing away from the multiple photodiodes.

[0129] Further optionally, each color filter unit in the color filter array may be arranged on a light incident surface of a photodiode.

[0130] Optionally, when each color filter unit is arranged on a light incident surface of a photodiode, Figure 1 As shown, each color filter unit 51 and the corresponding first driving member 31 may overlap in a first direction, and the first direction is perpendicular to the light incident direction of the image sensor, so as to reduce the size of the image sensor along the light incident direction.

[0131] In the embodiment of the present application, since the color filter array can be arranged on the light incident surface of the microlens array or the plurality of photodiodes, the arrangement flexibility of the color filter array can be improved.

[0132] Alternatively, if Figure 1As shown, the image sensor 100 may further include: a support structure 60, which may include a plurality of hollow holes, each of which is provided with one of the plurality of photodiodes 10. The photodiodes 10 are provided one to one with the hollow holes.

[0133] Alternatively, if Figure 1 As shown, each first driving member 31 may be disposed on a supporting structure, so that each first driving member 31 is supported and fixed by the supporting structure 60 .

[0134] Of course, in actual implementation, each first driving member can be mounted on at least one photodiode disposed opposite to the shading plate connected to each first driving member, or each first driving member can be mounted on the outside of all microlenses disposed opposite to the at least one photodiode.

[0135] Alternatively, if Figure 1 As shown, the image sensor 100 may further include: a metal wiring layer 70 , which is disposed on a surface of the support structure 60 facing away from the plurality of photodiodes 10 , and is used to output electrical signals obtained by the plurality of photodiodes 10 from sensing light.

[0136] In the embodiment of the present application, the image sensor may include a plurality of pixels, each pixel including: a photodiode, a color filter unit, a microlens and corresponding metal wiring.

[0137] The embodiment of the present application also provides a camera module, which includes the image sensor in the above embodiment. The camera module provided in the embodiment of the present application can achieve the same technical effect as the above image sensor, and will not be described here to avoid repetition.

[0138] An embodiment of the present application also provides an electronic device, which may include the camera module in the above embodiment.

[0139] The electronic device provided in the embodiment of the present application can achieve the same technical effect as the above-mentioned image sensor, and will not be described again here to avoid repetition.

[0140] The present application also provides a shooting method. Figure 4 A possible structural schematic diagram of a shooting method provided in an embodiment of the present application is shown. The shooting method is applied to the electronic device in the above embodiment. The electronic device may include the image sensor in the above embodiment, such as Figure 4 As shown, the shooting method may include the following steps A and B. The shooting method is exemplarily described below by taking an electronic device executing the shooting method as an example.

[0141] Step A: The electronic device obtains driving information of each driving mechanism of the M driving mechanisms of the image sensor.

[0142] Step B: During the process of the image sensor of the electronic device capturing the first image, the electronic device controls each driving mechanism to drive the connected shading plate to rotate based on the driving information of each driving mechanism, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light transmittance of at least one target photodiode arranged opposite to each shading plate is changed to the target light transmittance corresponding to each target angle.

[0143] The target plane is the plane where all photodiodes of the image sensor are located, and M is an integer greater than 1.

[0144] In the embodiment of the present application, the electronic device can obtain M driving information, and the M driving information corresponds one-to-one to the M driving mechanisms.

[0145] In the embodiment of the present application, the driving information of different driving mechanisms may be the same or different, and may be determined according to actual usage requirements.

[0146] In the embodiment of the present application, for two driving mechanisms with different driving information, when the two driving mechanisms are controlled by their respective driving information to drive the light shielding plates connected to them to rotate, the rotation angles of the two light shielding plates are also different. As a result, the light flux of the photodiodes arranged opposite to the two light shielding plates is also different. In this way, the light flux of the photodiode of the image sensor can be adjusted by region.

[0147] Alternatively, if Figure 2 As shown, each driving mechanism may include: a first driving member 31, a second driving member 32 and an elastic member 33. The first driving member 31 is disposed on the light incident side of at least one photodiode 10 among the plurality of photodiodes 10; the second driving member 32 is disposed opposite to the first driving member 31, and the second driving member 32 is connected to a light shielding plate 20; the elastic member 33 is disposed between the first driving member 31 and the second driving member 32, and the two ends of the elastic member 33 are respectively connected to the edge of the first driving member 31 and the edge of the second driving member 32.

[0148] When a voltage or current is applied to at least one of the first driver 31 and the second driver 32, a repulsive force is generated between the first driver 31 and the second driver 32, driving the second driver 32 and the shading plate 20 connected to the second driver to rotate around the elastic member 33, changing the angle between the shading plate 20 connected to the second driver and the target plane, so as to change the light transmission amount of at least one target photodiode 10. Here, "at least one target photodiode 10" refers to the photodiode 10 arranged opposite to the shading plate 20 connected to the second driver 32.

[0149] It can be seen that the driving information of the driving mechanism may be: a voltage or a current applied to at least one of the first driving member and the second driving member.

[0150] Taking the driving information as current as an example, different currents represent different driving information.

[0151] For other descriptions of step A and step B, please refer to the relevant descriptions in the above-mentioned image sensor. In order to avoid repetition, they will not be repeated here.

[0152] In the embodiment of the present application, since the driving information of each driving mechanism can be obtained, and based on the driving information, the driving mechanism is controlled to drive the connected shading plate to rotate so as to change the light transmittance of the photodiode arranged opposite to the shading plate, and different driving mechanisms are connected to different shading plates, and different shading plates are arranged opposite to different photodiodes, the light transmittance of the photodiodes arranged opposite to all the shading plates of the image sensor can be adjusted and controlled respectively through M driving mechanisms; that is, the regional control of the light transmittance of the image sensor can be achieved through M driving mechanisms and all the shading plates of the image sensor, so that the brightness of different image areas can be adjusted on a single image, and then the image quality can be improved on the basis of expanding the dynamic range of the image.

[0153] Optionally, in an embodiment of the present application, the above step A can be specifically implemented through the following steps A1 and A2.

[0154] Step A1: The electronic device determines a light flux adjustment coefficient of at least one target photodiode arranged opposite to each shading plate according to the hue information of the second image and the reference hue information.

[0155] The light flux adjustment coefficient of the at least one target photodiode indicates the target light flux. The second image is an image acquired when the angles between all the shading plates of the image sensor and the target plane are within the first preset angle range; when the angles between all the shading plates of the image sensor and the target plane are within the first preset angle range, the light flux of all the photodiodes is the maximum.

[0156] It should be noted that the electronic device can obtain M light flux adjustment coefficients, each of which is a light flux adjustment coefficient of at least one target photodiode arranged opposite to a shading plate.

[0157] In the embodiment of the present application, the first preset angle range may be [(90-a)°, 90°], where a is greater than or equal to 0. For example, 0≤a≤1.

[0158] Optionally, the second image may be an image captured by the image sensor when the angles between all shading plates of the image sensor and the target plane are maximized, that is, when all photodiodes of the image sensor have maximum light transmittance.

[0159] In the embodiment of the present application, the second image may be an image captured by the image sensor in a natural exposure state, and the exposure effect of the image is the same as the exposure effect of the image captured by the shutter image sensor in the related art.

[0160] Step A2: The electronic device determines the driving information corresponding to each light flux adjustment coefficient according to the preset correspondence between the light flux coefficient and the driving information.

[0161] In the embodiment of the present application, each reference color tone information corresponds to a shooting effect.

[0162] Optionally, in the embodiment of the present application, a plurality of reference tone information may be pre-set, and different tone reference information corresponds to different shooting effects.

[0163] For example, reference color tone information corresponding to the effect of highlighting the subject (such as the obvious contrast between the subject and the background), reference color tone information corresponding to the background darkening effect (such as the background brightness is lower than the brightness of the subject), reference color tone information corresponding to the background brightening effect (such as increasing the background brightness higher than the brightness of the subject), and color tone reference information corresponding to the high dynamic range effect (such as suppressing the highlight area) can be pre-set.

[0164] It can be understood that in the embodiment of the present application, each reference color tone information is the color tone information of a reference image having a corresponding shooting effect.

[0165] Optionally, the electronic device may first perform production line calibration on the image sensor to obtain the corresponding relationship between the driving information (such as voltage or current) and the light flux coefficient of the photodiode.

[0166] Then, after obtaining the second image, the highlight pixel values ​​in the second image can be adjusted based on a preset tone mapping curve (i.e., reference tone information), for example, by using a tone mapping curve to perform a dynamic range compression (DRC) process to reduce the dynamic range, so as to calculate the required transmittance adjustment coefficient for at least one target photodiode arranged opposite to each shading plate, that is, M transmittance adjustment coefficients can be obtained. That is, the embodiment of the present application calculates the transmittance adjustment coefficient by region. Then, according to the correspondence between the preset transmittance coefficient and the driving information, the driving information corresponding to each transmittance adjustment coefficient is determined. For example, Figure 8 A possible diagram of a tone mapping curve is shown in Figure 2. Figure 8As shown, the tone mapping curve is a gamma curve, which can be selected Figure 8 The gamma curve with Y greater than 1 is used for tone mapping to suppress the bright pixel values ​​in the second image.

[0167] In the embodiment of the present application, by controlling the degree of opening and closing or the degree of lifting of the driving mechanism (determined by the driving information), a high dynamic range image can be obtained in a single frame image during the photosensitization process of multiple photodiodes, that is, in scenes with a large contrast between light and dark, the color contrast is enhanced and the detail performance is better, that is, the effect of "no overexposure of highlights and no underexposure of low lights" is achieved.

[0168] Optionally, after outputting the first image, the electronic device may further perform dynamic range compression processing on the first image, and finally obtain an image with a high dynamic range and rich content.

[0169] In the embodiment of the present application, since the M driving information of the M driving mechanisms can be determined based on the reference hue information and the hue information of the image collected in the natural exposure state, it can be ensured that after the corresponding driving mechanism is controlled to drive the connected shading plate to rotate based on these driving information, the light transmittance of the image sensor can meet the reference hue information, so that the first image can have the shooting effect corresponding to the reference hue information. In this way, the image quality of the image captured by the electronic device can be improved.

[0170] Optionally, the above step B can be specifically implemented through the following step B1. After step B1, the shooting method provided in the embodiment of the present application can also include the following step C and step D.

[0171] Step B1, after the exposure reset of all the photodiodes is completed, based on the driving information of each driving mechanism, each driving mechanism is controlled to drive the connected shading plate to rotate, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light transmittance of at least one target photodiode arranged opposite to each shading plate is changed to the target light transmittance corresponding to each target angle.

[0172] Step C: After the exposure of the first row of photodiodes in all the photodiodes of the image sensor is completed, the electronic device stops applying the driving information to all the driving mechanisms.

[0173] Step D: the electronic device controls all the shading plates of the image sensor to reset so that the angles between all the shading plates and the target plane are within a second preset angle range, so that all the photodiodes stop sensing light.

[0174] Wherein, when the angles between all the shading plates of the image sensor and the target plane are within the second preset angle range, the light flux of all the photodiodes is minimum. The first image is a global exposure image.

[0175] In the embodiment of the present application, after step B1, the electronic device may output a first image, and the first image may be a high dynamic range image after suppressing highlight areas.

[0176] It should be noted that in the embodiment of the present application, when the photographed object moves, compared with the related art, after the electronic device executes step A (or step A1 and step A2) B1, step C and step D, the first image obtained can overcome the jello effect.

[0177] The following is a comparative analysis of the exposure timing process of the rolling shutter image sensor in the related art and the exposure timing process of the image sensor in the embodiment of the present application.

[0178] Figure 5 FIG. 1 is a schematic diagram of the exposure timing process of a rolling shutter sensor in the related art. Figure 5 As shown in FIG. 1 , R is the reset time of the image sensor row by row in the related art, that is, the time to reset the pixels and restart the light-sensing accumulation of photoelectrons. O is the completion time of the integration time (exposure) of each row, and the sensed electrical signal is read out row by row by the readout circuit. Figure 5 It can be seen that the exposure start and end times of each row of the image sensor in the related art are all different, so when the photographed object moves, the image 50 of the photographed object may have a jello effect.

[0179] Figure 6 A schematic diagram of the exposure timing of the image sensor in the shooting method provided in an embodiment of the present application.

[0180] Combination Figure 6 , the exposure process of the image sensor in the embodiment of the present application includes:

[0181] Step 1: Before starting to take pictures, control the M driving mechanisms to remain in a fully closed state, that is, the M shading plates are parallel to the plane where the photodiodes are located, that is, all the photodiodes are in a black-shielded state.

[0182] Step 2: All photodiodes begin to reset row by row. From the reset of the photodiodes in the first row to the reset of the photodiodes in the last row, the M driving mechanisms remain in a fully closed state. At this time, all photodiodes of the image sensor are in a blacked-out state as shown in 60.

[0183] Step 3, namely step B1: when all the photodiodes have finished resetting, namely at time T1, driving information is applied to the M driving mechanisms so that the active structure in each driving mechanism is quickly lifted, so that all the photodiodes start to be exposed at the same time.

[0184] Step 4, i.e., the above-mentioned step C: when the photodiodes of the first row of all the photodiodes reach the preset shutter (exposure) end time, i.e., time T2, stop applying driving information (such as voltage) to the M driving mechanisms, so that each light shielding plate is quickly reset under the elastic force of each insulating spring sheet, so that all the photodiodes stop sensing light at the same time, so that all the photodiodes are in the black shielding state shown in 61. Then, the readout circuit starts to read out the sensed electrical signals of each row.

[0185] Step 5: Complete the readout line by line to obtain a frame of global exposure image, that is, the first image mentioned above.

[0186] It can be seen that Figure 6 The image 62 of the photographed object in the image is not deformed, that is, no jello effect is produced, wherein the jello effect refers to the deformation or distortion of the moving photographed object in the photographed image, for example, Figure 5 The deformation shown in 50.

[0187] Furthermore, if Figure 7 As shown, for an image sensor that supports global reset, step 2 can configure all photodiodes to be globally reset once. In this way, compared with the traditional solution of resetting row by row, the sacrifice of frame rate is smaller.

[0188] The following is an illustrative description of steps 1 to 5 with reference to specific examples.

[0189] Exemplarily, in step 1, when no shooting instruction is received, the electronic device does not apply driving information to the M driving mechanisms, so that the M driving mechanisms remain in a fully closed state, so that the M light shielding plates are parallel to the target plane where the photodiodes are located, that is, all photodiodes are in a black shielding state, that is, not sensitive to light. This can save power consumption of the electronic device.

[0190] In step 2, when the electronic device receives a shooting instruction, the electronic device may first control all photodiodes to reset, and not apply driving information to the M driving mechanisms during the resetting process, thereby ensuring that all photodiodes are in a blacked-out state during the resetting process.

[0191] In step 3, when it is determined that all photodiodes have been reset, that is, at time T1, the electronic device can apply driving information to M driving mechanisms at the same time to control the M driving mechanisms to drive the light shielding plates connected to them to rotate quickly, so as to change the angle between the M light shielding plates 20 and the target plane, so that all photodiodes are exposed at the same time, thereby ensuring that all photodiodes start to be exposed at the same time.

[0192] In step 4, when the photodiodes in the first row of all the photodiodes reach the preset shutter (exposure) end time, i.e., time T2, the electronic device stops applying driving information (such as voltage) to the M driving mechanisms, so that each light shielding plate is quickly reset under the elastic force of each insulating spring sheet, so that all the photodiodes stop sensing light at the same time, so that all the photodiodes are in the black shielding state shown in 61. Then the readout circuit starts to read out the sensed electrical signals of each row.

[0193] In step 5, the electronic device reads out the electrical information collected by the image sensor line by line, and generates a frame global exposure image based on the electrical information, that is, the first image mentioned above.

[0194] It should be noted that, in step 3, the driving information applied by the electronic device to different driving mechanisms may be the same or different, and the specific information may be determined according to actual use requirements.

[0195] In the embodiment of the present application, the effect of a mechanical shutter is achieved by controlling the complete lifting and closing of the driving mechanism. The expensive global exposure function can be realized by cooperating with a conventional global reset sensor, which greatly improves the adverse effects encountered in high-speed motion scene shooting.

[0196] Furthermore, the shooting method provided by the embodiment of the present application can obtain images with high dynamic range within a single frame image, that is, in scenes with large contrast between light and dark, the color contrast is enhanced and the detail performance is better, that is, the effect of "highlights are not overexposed and low lights are not underexposed" is achieved.

[0197] In the embodiment of the present application, by controlling the opening and closing degree or lifting degree of the driving mechanism, in the process of collecting the first image through the image sensor, all the photodiodes of the image sensor are controlled to start and end the photosensitivity at the same time, so that the first image can be a global exposure image. Furthermore, since the photosensitivity time period of all the photodiodes is the same, the jello effect of the moving object can be avoided. In this way, the quality of the image captured by the electronic device can be further improved.

[0198] Optionally, in the embodiment of the present application, the shooting method provided in the embodiment of the present application may further include the following step E.

[0199] Step E: After acquiring the first image, the electronic device performs noise compensation processing on the first image based on the calibration data of the third image.

[0200] In an embodiment of the present application, the third image is an image captured by the image sensor when the angles between all shading plates of the image sensor and the target plane are within a second preset angle range; when the angles between all shading plates and the target plane are within the second preset angle range, the light transmittance of all photodiodes is the minimum, for example, 0; wherein the above-mentioned calibration data includes at least one of the following: dark current data corresponding to the third image, and coordinate information of bad pixels in the third image.

[0201] It can be understood that in the embodiment of the present application, the coordinate information of the bad line in the third image can be determined based on the coordinate information of the bad points in the third image. It can be seen that the "bad line" is a straight line where multiple bad points are located.

[0202] In the embodiment of the present application, the electronic device can still keep the M driving mechanisms completely closed after the multiple photodiodes are reset, that is, no driving information is applied to the M driving mechanisms, so that the electronic device can collect a dark frame image, that is, a third image, through the image sensor. Then, based on the third image, the dark frame self-calibration of the image sensor is realized, that is, the calibration data of the third image is obtained. It can be seen that by controlling the opening and closing degree of the M driving mechanisms, the dark frame self-calibration of the image sensor can be realized.

[0203] The process of implementing dark frame self-calibration of the image sensor is described in detail below.

[0204] Step 6: Prepare for the photo-taking stage. Before starting exposure, control the M drive mechanisms to be completely closed.

[0205] Step 7: Multiple photodiodes start to expose and output a first frame of completely blacked-out image, i.e., the third image), and based on the background signal value of each pixel of the third image, determine the dark current data corresponding to the third image and the coordinate information of the bad pixels in the third image.

[0206] Step 8: The electronic device determines the dark current distribution in the image sensor (ie, the dark current data corresponding to the third image) and the coordinate information of the bad pixels in the third image based on the background signal value of each pixel.

[0207] Step A is performed after step 8. After obtaining the first image, the electronic device may perform noise compensation processing on the first image based on the calibration data of the third image.

[0208] Optionally, the electronic device can compensate for bad pixels, bad lines and dark currents at specific coordinates in the first image by a density peaks clustering algorithm based on grid screening (SDPC) based on the calibration data of the third image, so as to obtain a high-quality image with consistent dark current and no influence of bad pixels / lines. For the description of "bad pixels", "bad lines" and "dark currents", please refer to the relevant descriptions of "bad pixels", "bad lines" and "dark currents" in the glossary section. In order to avoid repetition, they will not be repeated here.

[0209] The following is an illustrative description of steps 6 to 8 with reference to specific examples.

[0210] For example, after the electronic device receives the shooting instruction, the electronic device does not apply driving information to the M driving mechanisms, so that the M driving mechanisms remain in a fully closed state, so that the M light shielding plates are parallel to the target plane where the photodiodes are located, that is, all the photodiodes are in a black shielding state, that is, not sensitive to light. This can save power consumption of the electronic device.

[0211] In step 7, the electronic device controls the image sensor to capture the third image while keeping all photodiodes in a black-out state. Since all photodiodes are not sensitive to light, the third image is a completely black image. If there are no bad pixels (damaged photodiodes) and abnormal dark currents in the image sensor, the pixel values ​​of all pixels in the completely black image are (255, 255, 255); if there are damaged photodiodes or dark currents in the image sensor, there will be abnormal pixel values ​​in the completely black image, that is, pixel values ​​different from (255, 255, 255).

[0212] In step 8, the electronic device can determine the dark current data corresponding to the third image and the coordinate information of the bad pixel in the third image based on the pixel value of each pixel in the third image. Then, the electronic device can execute the above steps A and B to obtain the first image. Thus, on the one hand, the electronic device can compensate the dark current data in the first image based on the dark current data corresponding to the third image. Specifically, the electronic device can determine the photodiode that generates dark current in the image sensor based on the dark current data corresponding to the third image, and then the electronic device can determine the pixels corresponding to the photodiode that generates dark current in the first image, so that the electronic device can perform dark current compensation processing on these pixels. For example, the background signal value of these pixels can be subtracted from the corresponding dark current value to solve the color cast and other problems caused by the inconsistent dark current distribution of the image sensor.

[0213] On the other hand, the electronic device can determine the coordinate information of the bad pixel in the first image based on the coordinate information of the bad pixel in the third image. And perform compensation processing based on the pixel value of the bad pixel in the first image. For example, for each bad pixel in the first image, the electronic device can update the pixel value of a bad pixel to the pixel value of the pixel of the bad pixel. In this way, the influence of the inherent noise of the image sensor on the image effect of the first image can be avoided.

[0214] In the embodiment of the present application, on the one hand, the electronic device can realize real-time dark frame background data calibration of the image sensor based on the calibration data of the third image collected when the angle between all the shading plates and the target plane is within the second preset angle range, and solve the problems such as color cast caused by the inconsistent dark current distribution of the image sensor; on the other hand, the electronic device can accurately compensate for the bad pixel of the first image based on the bad pixel coordinates of the third image. In this way, the influence of the inherent noise of the image sensor on the image effect of the first image can be avoided, thereby improving the image quality of the first image.

[0215] It should be noted that the shooting method provided in the embodiment of the present application can be executed by a shooting device or a control module in the shooting device for executing the shooting method. In the embodiment of the present application, the shooting device provided in the embodiment of the present application is described by taking the shooting method executed by the shooting device as an example.

[0216] The embodiment of the present application also provides a photographing device, Fig. 9 A possible structural diagram of a photographing device provided in an embodiment of the present application is shown. Fig. 9 As shown, the photographing device 90 may include: an acquisition module 91 and a control module 92 .

[0217] The acquisition module 91 is used to acquire the driving information of each of the M driving mechanisms of the image sensor; the control module 92 is used to control each driving mechanism to drive the connected shading plate to rotate based on the driving information of each driving mechanism acquired by the acquisition module 91 during the process of the image sensor capturing the first image, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light flux of at least one target photodiode arranged opposite to each shading plate is changed to the target light flux corresponding to each target angle; wherein the target plane is the plane where all the photodiodes of the image sensor are located, and M is an integer greater than 1.

[0218] In a possible implementation, the acquisition module 91 is specifically used to determine the light flux adjustment coefficient of at least one target photodiode arranged opposite to each shading plate according to the hue information of the second image and the reference hue information; and determine the driving information corresponding to each light flux adjustment coefficient according to the corresponding relationship between the preset light flux coefficient and the driving information;

[0219] Among them, each light transmittance adjustment coefficient indicates a target light transmittance, and the second image is an image captured when the angles between all light shielding plates and the target plane of the image sensor are within a first preset angle range; when the angles between all light shielding plates and the target plane are within the first preset angle range, the light transmittance of all photodiodes is the largest; and each reference hue information corresponds to a shooting effect.

[0220] In a possible implementation, the control module 92 is specifically configured to control each driving mechanism to drive the connected shading plate to rotate based on the driving information of each driving mechanism after all the photodiodes are exposed and reset.

[0221] The control module 92 is further used to stop applying driving information to all driving mechanisms after the exposure of the first row of photodiodes among all the photodiodes is completed; and to control all the light shielding plates of the image sensor to reset so that the angles between all the light shielding plates and the target plane are within the second preset angle range, so that all the photodiodes stop sensing light;

[0222] When the angles between all the shading plates and the target plane are within the second preset angle range, the light flux of all the photodiodes is minimum; and the first image is a global exposure image.

[0223] In a possible implementation, the control module 92 is further configured to perform noise compensation processing on the first image based on calibration data of a third image after the image sensor captures the first image, the third image being an image captured when the angles between all shading plates and the target plane are within a second preset angle range; when the angles between all shading plates and the target plane are within the second preset angle range, the light transmittance of all photodiodes is minimum;

[0224] The calibration data includes at least one of the following: dark current data corresponding to the third image, and coordinate information of bad pixels in the third image.

[0225] In the shooting device provided in the embodiment of the present application, since the driving information of each driving mechanism can be obtained, and based on the driving information, the driving mechanism is controlled to drive the connected shading plate to rotate so as to change the light transmittance of the photodiode arranged opposite to the shading plate, and different driving mechanisms are connected to different shading plates, and different shading plates are arranged opposite to different photodiodes, the light transmittance of the photodiodes arranged opposite to all the shading plates of the image sensor can be adjusted and controlled respectively through M driving mechanisms; that is, the regional control of the light transmittance of the image sensor can be achieved through M driving mechanisms and all the shading plates of the image sensor (specifically M, and the M shading plates are respectively connected to the M driving mechanisms), so that the brightness adjustment of different image areas can be achieved on a single image, and then the image quality can be improved on the basis of expanding the dynamic range of the image.

[0226] The photographing device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0227] The shooting device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0228] The shooting device provided in the embodiment of the present application can achieve Figure 4 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0229] like Fig.10 As shown, an embodiment of the present application provides an electronic device 900, which includes a processor 902, a memory 901, and a computer program stored in the memory 901 and executable on the processor 902, and the computer program implements the steps of the above-mentioned physiological parameter measurement method when executed by the processor 902.

[0230] Fig.11 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0231] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009 and at least some of the components in the processor 1010.

[0232] Those skilled in the art will appreciate that the terminal 1000 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.11 The structure of the electronic device shown in the figure does not constitute a limitation of the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0233] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0234] The image capturing device in the embodiment of the present application may include the image sensor in the above embodiment.

[0235] Specifically, Figure 1As shown, the image sensor may include: a plurality of photodiodes 10 distributed in an array, M light shielding plates 20, and M driving mechanisms. The M light shielding plates 20 are located on the light incident side of the plurality of photodiodes 10, and each light shielding plate 20 is arranged opposite to at least one of the plurality of photodiodes 10; the M driving mechanisms 30 avoid the light incident channels of the plurality of photodiodes 10, and each driving mechanism 30 is connected to one of the M light shielding plates 20;

[0236] Among them, each driving mechanism 30 drives the connected shading plate 20 to rotate so as to change the angle between the connected shading plate 20 and the target plane where the multiple photodiodes 10 are located, and to change the light transmittance of at least one target photodiode 10 among the multiple photodiodes 10 that is arranged opposite to the connected shading plate 20; the light transmittance of the at least one target photodiode 10 is positively correlated with the angle between the connected shading plate 20 and the target plane, and M is an integer greater than 1.

[0237] In one possible implementation, Figure 2 As shown, each of the M driving mechanisms may include: a first driving member 31, a second driving member 32 and an elastic member 33. The first driving member 31 is disposed on the light incident side of at least one photodiode 10 among the plurality of photodiodes 10; the second driving member 32 is disposed opposite to the first driving member 31, and the second driving member 32 is connected to a light shielding plate 20; the elastic member 33 is disposed between the first driving member 31 and the second driving member 32, and the two ends of the elastic member 33 are respectively connected to the edge of the first driving member 31 and the edge of the second driving member 32.

[0238] When a voltage or current is applied to at least one of the first driver 31 and the second driver 32, a repulsive force is generated between the first driver 31 and the second driver 32, driving the second driver 32 and the shading plate 20 connected to the second driver 32 to rotate around the elastic member 33, changing the angle between the shading plate 20 connected to the second driver 32 and the target plane, so as to change the light transmission amount of at least one target photodiode 10. Here, "at least one target photodiode 10" refers to the photodiode 10 arranged opposite to the shading plate 20 connected to the second driver 32.

[0239] In a possible implementation, the first driver and the second driver are both capacitor plates. When the voltages applied to the first driver and the second driver are different, a mutually repulsive electrostatic force is generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, changing the angle between the shading plate connected to the second driver and the target plane, so as to change the light transmittance of at least one target photodiode arranged opposite to the shading plate connected to the second driver.

[0240] In a possible implementation, one of the first driver and the second driver is an electromagnet, and the other of the first driver and the second driver is a permanent magnet. When current is applied to the electromagnet, a mutually repulsive Lorentz force is generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, and changes the angle between the shading plate connected to the second driver and the target plane, so as to change the light flux of at least one target photodiode arranged opposite to the shading plate connected to the second driver. Alternatively, both the first driver and the second driver are electromagnets; when currents in opposite directions are applied to the first driver and the second driver, a mutually repulsive Lorentz force is generated between the first driver and the second driver, so that the second driver drives the shading plate and the elastic member connected to the second driver to rotate relative to the target plane, and changes the angle between the shading plate connected to the second driver and the target plane, so as to change the light flux of at least one target photodiode arranged opposite to the shading plate connected to the second driver.

[0241] In a possible implementation, each driving mechanism may further include a padding member 34. The padding member 34 is disposed on the edge of the surface of the first driving member 31 facing the second driving member 32; wherein two ends of the elastic member 33 are respectively connected to the edge of the second driving member 32 and the padding member 34.

[0242] In one possible implementation, Figure 1 As shown, the image sensor 100 may further include: a color filter array 50 arranged opposite to the plurality of photodiodes 10. The color filter array 50 is arranged on the light incident side of the plurality of photodiodes 10, and each color filter unit 51 in the color filter array 50 is arranged one-to-one with a photodiode 10 in the plurality of photodiodes 10.

[0243] In one possible implementation, Figure 1 As shown, the image sensor 100 may further include: a microlens array 40. The microlens array 40 is disposed on the light incident side of the plurality of photodiodes 10, and each microlens in the microlens array 40 is disposed one-to-one with a photodiode 10 in the plurality of photodiodes 10.

[0244] In a possible implementation, the color filter array is disposed on the microlens array; or, the color filter array is disposed on the light incident surfaces of the plurality of photodiodes.

[0245] In this way, each light shielding plate of the image sensor is arranged opposite to at least one photodiode of the image sensor, each light shielding plate is connected to a driving mechanism, and each driving mechanism can drive the connected light shielding plate to rotate relative to the target plane where all the photodiodes of the image sensor are located, so that the light flux of the photodiode arranged opposite to each light shielding plate can change with the change of the angle between each light shielding plate and the target plane. Since different driving mechanisms can drive different light shielding plates to rotate, and different light shielding plates are arranged opposite to different photodiodes, regional control of the light flux of the image sensor can be achieved through M driving mechanisms and M light shielding plates, so that the brightness of different image areas can be adjusted on a single image, and the image quality can be improved on the basis of expanding the dynamic range of the image.

[0246] In the embodiment of the present application, after receiving downlink data from the network side device, the RF unit 1001 can transmit the data to the processor 1010 for processing; in addition, the RF unit 1001 can send uplink data to the network side device. Generally, the RF unit 1001 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc.

[0247] The memory 1009 can be used to store software programs or instructions and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0248] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0249] The processor 1010 is used to obtain driving information of each of the M driving mechanisms of the image sensor; and in the process of the image sensor capturing the first image, based on the driving information of each driving mechanism, control each driving mechanism to drive the connected shading plate to rotate, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light transmittance of at least one target photodiode arranged opposite to each shading plate is changed to the target light transmittance corresponding to each target angle; wherein the target plane is the plane where all the photodiodes of the image sensor are located, and M is an integer greater than 1.

[0250] In a possible implementation, the processor 1010 is specifically used to determine the light transmittance adjustment coefficient of at least one target photodiode arranged opposite to each shading plate according to the hue information of the second image and the reference hue information; and determine the driving information corresponding to each light transmittance adjustment coefficient according to the corresponding relationship between the preset light transmittance coefficient and the driving information; wherein each light transmittance adjustment coefficient indicates a target light transmittance, and the second image is an image captured when the angles between all shading plates of the image sensor and the target plane are within a first preset angle range; when the angles between all shading plates and the target plane are within the first preset angle range, the light transmittance of all photodiodes is the largest; and each reference hue information corresponds to a shooting effect.

[0251] In a possible implementation, the processor is specifically configured to control each driving mechanism to drive the connected shading plate to rotate based on driving information of each driving mechanism after all the photodiodes are exposed and reset.

[0252] The processor 1010 is further configured to stop applying driving information to all driving mechanisms after the exposure of the first row of photodiodes among all the photodiodes is completed; and control all the light shielding plates of the image sensor to reset so that the angles between all the light shielding plates and the target plane are within a second preset angle range, so that all the photodiodes stop sensing light;

[0253] When the angles between all the shading plates and the target plane are within the second preset angle range, the light flux of all the photodiodes is minimum; and the first image is a global exposure image.

[0254] In one possible implementation, the processor 1010 is further used to perform noise compensation processing on the first image based on calibration data of a third image after the image sensor captures the first image, the third image being an image captured when the angles between all shading plates and the target plane are within a second preset angle range; when the angles between all shading plates and the target plane are within the second preset angle range, the light transmittance of all photodiodes is minimum; wherein the calibration data includes at least one of the following: dark current data corresponding to the third image, and coordinate information of bad pixels in the third image.

[0255] In the electronic device provided in the embodiment of the present application, since the driving information of each driving mechanism can be obtained, and based on the driving information, the driving mechanism is controlled to drive the connected shading plate to rotate so as to change the light transmittance of the photodiode arranged opposite to the shading plate, and different driving mechanisms are connected to different shading plates, and different shading plates are arranged opposite to different photodiodes, the light transmittance of the photodiodes arranged opposite to all the shading plates of the image sensor can be adjusted and controlled respectively through M driving mechanisms; that is, the regional control of the light transmittance of the image sensor can be achieved through M driving mechanisms and all the shading plates of the image sensor (specifically M, and the M shading plates are respectively connected to the M driving mechanisms), so that the brightness adjustment of different image areas can be achieved on a single image, and then the image quality can be improved on the basis of expanding the dynamic range of the image.

[0256] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned shooting method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0257] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0258] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0259] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0260] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0261] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0262] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image sensor, characterized in that: include: A plurality of photodiodes arranged in an array; M light shielding plates are located at the light incident side of the plurality of photodiodes, and each light shielding plate is arranged opposite to at least one photodiode among the plurality of photodiodes; M driving mechanisms, avoiding light entrance channels of the plurality of photodiodes, each driving mechanism being connected to one of the M light shielding plates; Each driving mechanism drives the connected shading plate to rotate, so as to change the angle between the connected shading plate and the target plane where the plurality of photodiodes are located, and to change the light transmission amount of at least one target photodiode among the plurality of photodiodes that is arranged opposite to the connected shading plate; The light flux of the at least one target photodiode is positively correlated with the angle between the connected shading plate and the target plane, and M is an integer greater than 1.

2. The image sensor according to claim 1, characterized in that Each of the driving mechanisms comprises: A first driving element is disposed on a light incident side of at least one photodiode among the plurality of photodiodes; A second driving member, arranged opposite to the first driving member, the second driving member being connected to a light shielding plate; an elastic member, disposed between the first driving member and the second driving member, and two ends of the elastic member are respectively connected to an edge of the first driving member and an edge of the second driving member; Wherein, when a voltage or current is applied to at least one of the first driving member and the second driving member, a repulsive force is generated between the first driving member and the second driving member, driving the second driving member and the connected shading plate to rotate around the elastic member, changing the angle between the connected shading plate and the target plane, so as to change the light transmittance of the at least one target photodiode.

3. The image sensor according to claim 2, characterized in that The first driving member and the second driving member are both capacitor plates; When different voltages are applied to the first driving member and the second driving member, a mutually repulsive electrostatic force is generated between the first driving member and the second driving member, so that the second driving member drives the connected shading plate and the elastic member to rotate relative to the target plane, thereby changing the angle between the connected shading plate and the target plane, so as to change the light transmittance of the at least one target photodiode.

4. The image sensor according to claim 2, characterized in that: One of the first driving member and the second driving member is an electromagnet, and the other of the first driving member and the second driving member is a permanent magnet; when current is applied to the electromagnet, a mutually repulsive Lorentz force is generated between the first driving member and the second driving member, so that the second driving member drives the connected shading plate and the elastic member to rotate relative to the target plane, thereby changing the angle between the connected shading plate and the target plane, so as to change the light transmission amount of the at least one target photodiode; Alternatively, both the first driving member and the second driving member are electromagnets; when currents in opposite directions are applied to the first driving member and the second driving member, mutually repelling Lorentz forces are generated between the first driving member and the second driving member, so that the second driving member drives the connected shading plate and the elastic member to rotate relative to the target plane, thereby changing the angle between the connected shading plate and the target plane, so as to change the light transmittance of the at least one target photodiode.

5. The image sensor according to claim 2, characterized in that: Each of the driving mechanisms further comprises a padding member, wherein the padding member is arranged at an edge of a surface of the first driving member facing the second driving member; Wherein, two ends of the elastic member are respectively connected to the edge of the second driving member and the raising member.

6. The image sensor according to claim 1, characterized in that: The image sensor further includes a color filter array disposed opposite to the plurality of photodiodes; The color filter array is arranged on the light incident side of the plurality of photodiodes, and each color filter unit in the color filter array is arranged one-to-one with a photodiode in the plurality of photodiodes.

7. The image sensor according to claim 6, characterized in that: The image sensor also includes a microlens array; The microlens array is arranged on the light incident side of the plurality of photodiodes, and each microlens in the microlens array is arranged one-to-one with a photodiode in the plurality of photodiodes.

8. The image sensor according to claim 7, characterized in that: The color filter array is disposed on the microlens array; or, the color filter array is disposed on the light incident surfaces of the plurality of photodiodes.

9. A camera module, characterized in that: Comprising the image sensor as claimed in any one of claims 1 to 8.

10. An electronic device, characterized in that: Comprising the camera module as claimed in claim 9.

11. A shooting method, applied to an electronic device, characterized in that: The electronic device comprises an image sensor as claimed in any one of claims 1 to 8, and the method comprises: Acquiring driving information of each driving mechanism of the M driving mechanisms of the image sensor; In the process of the image sensor capturing the first image, based on the driving information of each driving mechanism, controlling each driving mechanism to drive the connected shading plate to rotate, so that the angle between each shading plate and the target plane is adjusted to the target angle corresponding to the driving information of each driving mechanism, so that the light flux of at least one target photodiode arranged opposite to each shading plate is changed to the target light flux corresponding to each target angle; The target plane is the plane where all photodiodes of the image sensor are located, and M is an integer greater than 1.

12. The method according to claim 11, characterized in that The acquiring driving information of each driving mechanism of the M driving mechanisms of the image sensor includes: Determining, according to the hue information of the second image and the reference hue information, a light flux adjustment coefficient of the at least one target photodiode arranged opposite to each of the shading plates, wherein the light flux adjustment coefficient indicates the target light flux; Determine the driving information corresponding to each light flux adjustment coefficient according to the preset correspondence between the light flux coefficient and the driving information; The second image is an image acquired when the angles between all the shading plates of the image sensor and the target plane are within a first preset angle range; when the angles between all the shading plates and the target plane are within the first preset angle range, the light transmittance of all the photodiodes is the largest; Each reference color tone information corresponds to a shooting effect.

13. The method according to claim 11, characterized in that The controlling each driving mechanism to drive the connected shading plate to rotate based on the driving information of each driving mechanism comprises: After all the photodiodes have finished resetting their exposure, each of the driving mechanisms is controlled to drive the connected light shielding plate to rotate based on the driving information of each driving mechanism; The method further comprises: After the exposure of the first row of photodiodes among all the photodiodes is completed, stopping applying the driving information to all the driving mechanisms; Controlling all the light shielding plates of the image sensor to reset so that the angles between all the light shielding plates and the target plane are within a second preset angle range, so that all the photodiodes stop sensing light; Wherein, when the angles between all the shading plates and the target plane are within the second preset angle range, the light transmittance of all the photodiodes is minimum; and the first image is a global exposure image.

14. The method according to any one of claims 11 to 13, characterized in that The method further comprises: After the first image is acquired, noise compensation processing is performed on the first image based on calibration data of a third image, wherein the third image is an image acquired when the angles between all the shading plates and the target plane are within a second preset angle range; when the angles between all the shading plates and the target plane are within the second preset angle range, the light transmittance of all the photodiodes is minimum; The calibration data includes at least one of the following: dark current data corresponding to the third image, and coordinate information of bad points in the third image.

Images