Camera module, control method of camera module, and electronic device

Abstract

Embodiments of the present application disclose an imaging module, a control method for the imaging module, and an electronic device; wherein, the imaging module includes a pixel unit and a color filter unit; the pixel unit includes at least two stacked photosensitive devices, and each photosensitive device is used to receive light in a wavelength band corresponding to the photosensitive device; the color filter unit is disposed on the pixel unit, and the color filter unit is switchable between a light filtering state and a full light transmission state; when the color filter unit is in the light filtering state, it is used to transmit light in a wavelength band corresponding to the color filter unit, and the transmitted light can be received by the photosensitive device in the corresponding wavelength band; when the color filter unit is in the full light transmission state, it is used to transmit light of different wavelength bands, and the transmitted light of different wavelength bands can be received by the respective photosensitive devices in the corresponding wavelength bands one by one.

Description

Technical Field

[0001] This application belongs to the technical field of terminal devices, and particularly relates to an imaging module, a control method for the imaging module, and an electronic device. Background Art

[0002] In an electronic device, an RGB Bayer array sensor is mostly used for the camera. Each pixel is composed of a microlens, a color filter, a photodiode, etc. One pixel can only present one color information. Pixels with three different color filters are arranged on a plane, and after the signal is collected, a color pixel is formed through "demosaicing" processing. However, it is found in applications that the disadvantages of the RGB Bayer arrangement are obvious. Since each pixel can only capture one color, if normal colors are to be presented, four pixels RGGB are required to work together. When the pixel area needs to be enlarged, the size of the entire sensor will also increase accordingly, which makes it impossible to be used in electronic devices that pursue thinness and lightness.

[0003] Taking a common smart phone as an example, due to the requirement of the body thickness, the size of the photosensitive sensor cannot be enlarged. Under the condition that the size of the photosensitive sensor is limited, if a higher resolution is to be achieved, the number of photosensitive pixels needs to be increased, but this will reduce the size of a single photosensitive pixel, thereby resulting in a decrease in photosensitive performance and affecting the imaging quality. In particular, the imaging quality is not good in low-light or high-brightness environments. Summary of the Invention

[0004] This application aims to provide an imaging module, a control method for the imaging module, and an electronic device, which solve the problem that the existing imaging module is limited by the photosensitive performance, resulting in poor imaging quality in low-light shooting environments or high-brightness shooting environments.

[0005] In a first aspect, an embodiment of this application provides an imaging module, which includes:

[0006] A pixel unit, the pixel unit includes at least two stacked photosensitive devices, and each photosensitive device is used to receive light corresponding to the wavelength band of this photosensitive device; and

[0007] A color filter unit, the color filter unit is arranged on the pixel unit, and the color filter unit is switchable between a light filtering state and a full light transmission state;

[0008] When the color filter unit is in the light filtering state, it is used to transmit light corresponding to the wavelength band of this color filter unit, and the transmitted light can be received by the corresponding photosensitive device;

[0009] When the color filter unit is in the full light transmission state, it is used to transmit light of different wavelength bands, and the transmitted light of different wavelength bands can be received by the corresponding photosensitive devices one by one.

[0010] Second aspect, an embodiment of the present application provides a control method for an imaging module, and the control method includes:

[0011] When all the color filter units are in the light filtering state, obtain a first image;

[0012] According to the first image, obtain the brightness data of all pixel points in the first image;

[0013] When the brightness data of all pixel points in the first image is greater than a first brightness threshold, adjust all the color filter units to the fully transparent state;

[0014] Obtain a second image;

[0015] According to the second image, output a target image.

[0016] Third aspect, an embodiment of the present application provides a control method for an imaging module, and the control method includes:

[0017] When all the color filter units are in the light filtering state, obtain a first image;

[0018] According to the first image, obtain the brightness data of all pixel points in the first image;

[0019] According to the brightness data of all pixels in the first image, obtain the high-brightness area and the low-brightness area on the first image;

[0020] When the brightness data of the high-brightness area is greater than a second brightness threshold, adjust each of the color filter units corresponding to the high-brightness area to the fully transparent state, and adjust each of the color filter units corresponding to the low-brightness area to the light filtering state;

[0021] Obtain a second image;

[0022] According to the second image, output a target image.

[0023] Fourth aspect, an embodiment of the present application provides an electronic device, and the electronic device includes the imaging module as described above.

[0024] In the embodiments of the present application, the pixel units of the stacked structure are combined with the color filter units capable of adjusting spectral transmission. In a low-light environment, a single large-sized pixel unit is used to achieve higher sensitivity, thereby ensuring the shooting image quality in low-light scenes; in a high-brightness environment, each pixel unit itself is a stacked structure, so that each pixel unit includes photosensitive colors in multiple bands, enabling the optical signal entering each pixel unit to be split into multiple bands and then read by different photosensitive devices respectively, avoiding the overflow problem caused by excessive photo-generated electrons, avoiding the risk of overexposure in highlights, and improving the imaging quality in high-brightness environments.

[0025] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the description of the embodiments in conjunction with the following drawings, where:

[0027] Figure 1 is a schematic structural diagram of a pixel array of an imaging module according to an embodiment of the present application;

[0028] Figure 2 is one of the schematic structural diagrams of an imaging module according to an embodiment of the present application;

[0029] Figure 3 is another schematic structural diagram of an imaging module according to an embodiment of the present application;

[0030] Figure 4 is a schematic diagram of the working principle of an imaging module according to an embodiment of the present application;

[0031] Figure 5 is a schematic structural diagram of a color filter unit of an imaging module according to an embodiment of the present application;

[0032] Figure 6 is one of the flowcharts of a control method of an imaging module according to an embodiment of the present application;

[0033] Figure 7 is another flowchart of a control method of an imaging module according to an embodiment of the present application;

[0034] Figure 8 is a third flowchart of a control method of an imaging module according to an embodiment of the present application;

[0035] Figure 9 is a fourth flowchart of a control method of an imaging module according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0036] Embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the accompanying drawings are exemplary and are only used to explain the present application and should not be construed as a limitation of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without making creative efforts belong to the scope of protection of the present application.

[0037] The terms "first" and "second" in the description and claims of the present application may explicitly or implicitly include one or more of such features. In the description of the present application, unless otherwise specified, the meaning of "a plurality" is two or more. In addition, "and / or" in the description and claims means at least one of the connected objects. The character " / " generally means an "or" relationship between the associated objects before and after.

[0038] In the description of the present application, it should be understood that the orientation or positional relationship indicated by the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. is based on the orientation or positional relationship shown in the accompanying drawings, and is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation of the present application.

[0039] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "mounted", "connected" and "connected" should be understood in a broad sense. For example, it may be a fixed connection, a detachable connection or an integral connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific situations.

[0040] The camera module, the control method of the camera module and the electronic device provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0041] The camera module provided by the embodiments of the present application, see Figures 1 to 3, the camera module includes a pixel unit 1 and a color filter unit 2; the pixel unit 1 includes at least two stacked photosensitive devices, and each photosensitive device can be used to receive light in a corresponding wavelength band; the color filter unit 2 is disposed above the pixel unit 1, and the color filter unit 2 can be switched between a light filtering state and a fully transparent state; when the color filter unit 2 is in the light filtering state, it is used to transmit light in a corresponding wavelength band of the color filter unit 2, and the transmitted light can be received by the photosensitive device corresponding to the wavelength band; when the color filter unit is in the fully transparent state, it is used to transmit light of different wavelength bands, and the light of different wavelength bands transmitted can be received by each photosensitive device corresponding to the corresponding wavelength band one by one.

[0042] In the embodiments of the present application, the pixel unit 1 designed with a stacked structure is combined with the color filter unit 2 capable of adjusting spectral transmission. In a low-light environment, a single large-sized pixel unit 1 is used to achieve higher sensitivity, thereby ensuring the shooting image quality in a low-light scene; in a high-brightness environment, since the single pixel unit 1 itself has a stacked structure, each pixel unit 1 includes photosensitive colors in multiple wavelength bands, so that the optical signal entering each pixel unit 1 can be split into multiple wavelength bands and then read by different photosensitive devices respectively, avoiding the overflow problem caused by too many photo-generated electrons, avoiding the risk of high-light overexposure, and improving the imaging quality in a high-brightness environment.

[0043] In the embodiments of the present application, photosensitive devices of color pixels in multiple different wavelength bands (such as commonly used red, green, and blue, i.e., RGB) are designed to be stacked in sequence, thereby forming a pixel unit 1 with a stacked structure. This is completely different from the traditional situation where a single pixel unit can only present one color information.

[0044] For example, refer to Figure 1 , multiple pixel units 1 are arranged in a matrix to form a set pixel array 100. Each pixel unit 1 includes three different photosensitive devices, namely a first photosensitive device, a second photosensitive device, and a third photosensitive device. In this way, the set pixel array 100 forms three photosensitive layers, which are the first photosensitive layer 10, the second photosensitive layer 11, and the third photosensitive layer 12 from bottom to top. The first photosensitive layer 10 includes multiple first photosensitive devices, the second photosensitive layer 11 includes multiple second photosensitive devices, and the third photosensitive layer 12 includes multiple third photosensitive devices. This design can achieve a balance between a large number of single pixel units and a large area of a single pixel unit under the condition that the size of the photosensitive sensor is limited; at the same time, a single large pixel unit design is realized, which is beneficial to improving the photosensitive performance.

[0045] That is to say, the pixel unit 1 provided in the embodiment of the present application can include colors of multiple bands, which forms color sensing channels of multiple band spectra. This enables each pixel unit 1 to simultaneously obtain the light intensities of three real wavelengths of light at the pixel unit 1. Therefore, when restoring the color information at the pixel unit 1, that is, performing three-color synthesis, there is no need for algorithmic filtering interpolation, which can reduce false colors and can display the real color information at the pixel unit 1. Compared with the conventional RGB pixel structure, it has better resolution.

[0046] It can be understood that for the pixel unit 1 in the embodiment of the present application, since there is no need for color difference calculation to obtain more real colors, the difference calculation is reduced, and the power consumption will be greatly reduced; on the other hand, due to the design of the stacked structure not requiring algorithmic interpolation, the resolution will also be significantly improved.

[0047] See Figure 4 , which shows the internal circuit schematic diagram of the 4T pixel unit 1 in the embodiment of the present application. The pixel unit 1 includes, for example, three stacked photosensitive devices (respectively used to sense red light, green light, and blue light in visible light), and four transistors; among them, these four transistors are a reset transistor Reset, a switch TG (including TG1, TG2, and TG3 that respectively control each photosensitive device), a row selector Row SEL, and a signal amplifier SF.

[0048] In the embodiment of the present application, a color filter unit 2 capable of adjusting spectral transmission is also adopted.

[0049] For example, multiple color filter units 2 can be set and arranged in an array to form a set filter array 200 (or called a filter layer). Each color filter unit 2 can be switched between a light filtering state and a fully transparent state under the control of voltage, which makes the formed set filter array 200 different from the color filter (Color Filter, CF) used in a traditional camera module.

[0050] The set filter array 200 formed in the embodiment of the present application is actually a dynamically changing filter layer, which can adjust the filtering band according to needs to respectively meet the shooting requirements in high-light environments and low-light environments, so that better imaging quality can be obtained in both high-light environments and low-light environments.

[0051] See Figure 2 , on the set filter array 200, when all the color filter units 2 are in the light filtering state, each color filter unit 2 thereon can be used to transmit light of a band corresponding to the color filter unit 2.

[0052] For example, it is assumed that the filter array 200 has a plurality of first color filter units 20, a plurality of second color filter units 21, and a plurality of third color filter units 22. The first color filter unit 20 can only transmit red light in visible light, the second color filter unit 22 can only transmit green light in visible light, and the third color filter unit 23 can only transmit blue light in visible light.

[0053] See Figure 3 , on the set filter array 200, at least some of the color filter units 2 thereon can be decolorized and transformed into transparent ones. In this way, the color filter units 2 transformed into transparent ones can be used as fully transmissive sheets.

[0054] For example, see Figure 3 , all the color filter units 2 are adjusted to the fully transmissive state. At this time, each color filter unit 2 allows visible light to pass through.

[0055] When the color filter unit 2 is in the fully transmissive state, its function of filtering light is cancelled. For example, visible light can pass through the color filter unit 2 and reach the pixel unit 1 below. In this way, the optical signal entering each pixel unit 1 is split into multiple different wavelength bands and then read by the corresponding photosensitive devices respectively, avoiding the overflow problem caused by excessive photo-generated electrons and also avoiding the overexposure risk in the high-light area.

[0056] In some examples of the present application, the imaging module further includes a controller, which is electrically connected to the color filter unit 2. The controller is used to apply different voltages to the color filter unit 2 to drive the color filter unit 2 to be switchable between the light filtering state and the fully transmissive state.

[0057] That is to say, by controlling the voltage applied to the color filter unit 2, the selective transmission of the color filter unit 2 to the spectrum can be realized. Based on the electro-optic characteristics, the design of the color filter unit 2 is different from that of the conventional color filter, and it needs to be connected to a controller that drives its state change.

[0058] Among them, the controller can be directly disposed on the color filter unit 2 to provide different driving voltages for the electrically connected color filter unit 2, so that the color filter unit 2 can be adjusted from the light filtering state to the fully transmissive state, or from the fully transmissive state to the light filtering state.

[0059] Of course, the controller can also be installed at other positions in the imaging module and then electrically connected to the color filter unit 2.

[0060] In addition, in the embodiments of the present application, each color filter unit 2 can be provided with a controller. Of course, it is also possible that a plurality of color filter units 2 with the same light filtering band share a controller. Those skilled in the art can make flexible adjustments according to specific situations, and the embodiments of the present application do not make specific limitations here.

[0061] In some examples of the present application, a plurality of the pixel units 1 are provided, and the plurality of pixel units 1 are arranged into a set pixel array 100; a plurality of the color filter units 2 are provided, and the plurality of color filter units 2 are arranged into a set light filtering array 200; wherein, the pixel units 1 and the color filter units 2 are provided in one-to-one correspondence.

[0062] In an embodiment of the present application, a certain voltage can be applied to the color filter units 2 in a partial area on the set light filtering array 200, so that these color filter units 2 to which the voltage is applied are changed into a fully light-transmitting state and can transmit visible light, while the other color filter units 2 on the set light filtering array 200 can be in a light filtering state. In this way, a partial fully light-transmitting area and a partial color filtering area are formed on the set light filtering array 200.

[0063] In some examples of the present application, the pixel unit 1 includes three photosensitive devices arranged in a stacked manner;

[0064] When the color filter unit 2 is in the light filtering state, it is used to transmit light in a corresponding wavelength band to this color filter unit 2, and the transmitted light can be received by a photosensitive device in a corresponding wavelength band below this color filter unit 2;

[0065] When the color filter unit 2 is in the fully light-transmitting state, it is used to transmit visible light, and the red light, green light, and blue light in the transmitted visible light can be respectively received by the three photosensitive devices in one-to-one correspondence.

[0066] That is to say, the pixel unit 1 in the embodiment of the present application may include three photosensitive devices arranged in a stacked manner, and each photosensitive device is, for example, a photosensitive diode made of silicon material. That is, each pixel unit 1 includes three different photosensitive channels.

[0067] For example, each pixel unit 1 is composed of a red light photosensitive device at the bottom layer, a green light photosensitive device in the middle layer, and a blue light photosensitive device at the upper layer. This stacking order utilizes the principle that lights with different wavelengths have different penetration depths, and the longer the wavelength, the greater the penetration depth. According to the penetration depth: red light > green light > blue light, this enables each pixel unit 1 to simultaneously obtain the light intensities of the true red, green, and blue wavelengths at this pixel unit. Therefore, when restoring the color information of this sub-pixel point, that is, performing three-color synthesis, there is no need to perform algorithmic filtering interpolation, which can reduce false colors and can display the true color information at this pixel unit.

[0068] When the color filter unit 2 is in a fully transparent state, visible light can directly pass through the color filter unit 2 and enter the underlying pixel unit 1. At this time, the red light in the visible light can be received by the red light photosensitive device at the bottom layer in the pixel unit 1, the green light in the visible light can be received by the green light photosensitive device in the middle layer in the pixel unit 1, and the blue light in the visible light can be received by the blue light photosensitive device in the upper layer in the pixel unit 1. The visible light entering each pixel unit 1 is split into multiple bands and read by photosensitive devices in different layers respectively, avoiding the overflow problem caused by excessive photo-generated electrons and the risk of high-light overexposure, which can improve the imaging quality in a high-brightness shooting environment.

[0069] In some examples of the present application, the material of the color filter unit 2 is an electrochromic material.

[0070] See Figure 5 , the color filter unit 2 in the embodiment of the present application is a multi-layer structure, including an electrolyte layer 211, an electrochromic layer 212, an ion storage layer 213, and two transparent conductive layers 214; the electrochromic layer 212 and the ion storage layer 213 are respectively arranged on two surfaces of the electrolyte layer 211, and the two transparent conductive layers 214 respectively cover the electrochromic layer 212 and the ion storage layer 213.

[0071] The color filter unit 2 is an electrochromic material, which can undergo an oxidation-reduction reaction under the drive of an applied voltage, thereby changing the color of the material, and the color tends to be stable after the reaction reaches equilibrium.

[0072] Optionally, the material of the color filter unit 2 is tungsten oxide (WO3).

[0073] The process of the color filter unit 2 coloring and transitioning to the light filtering state is as follows:

[0074] Applying a negative voltage to the color filter unit 2, the ions and electrons in the ion storage layer 213 enter the electrochromic layer 212, and the chemical valence state of part of W changes from +6 to +5, causing light absorption, thereby making the color darker, which is manifested as coloring on the color filter unit 2, so that the color filter unit 2 is in the light filtering state.

[0075] The process of the color filter unit 2 transitioning to the fully transparent state is as follows:

[0076] Applying a positive voltage to the color filter unit 2, the ions and electrons in the ion storage layer 213 migrate out of the electrochromic layer 212, and the chemical valence state of part of W changes from +5 to +6, thereby making the color lighter, which is manifested as decolorization to form a transparent state on the color filter unit 2, so that the color filter unit 2 is in the fully transparent state.

[0077] Among them, the control of the working state of the color filter unit 2 can be achieved by the controller applying a positive voltage or a negative voltage to it.

[0078] In some examples of the present application, referring to Figure 2 and Figure 3 , the camera module further includes a microlens layer 300, an infrared filter 400, and an image processor; the microlens layer 300 covers the set filter array 200; the infrared filter 400 is disposed on the microlens layer 300; the image processor is electrically connected to the set pixel array 100.

[0079] Among them, the microlens layer (Micro Lens) 300 is used to converge light to obtain more incident light.

[0080] For example, the microlens layer 300 includes a plurality of microlens units 3. The microlens units 3 and the color filter units 2 are arranged in a one-to-one pairing. In this way, a color filter unit 2 and a microlens unit 3 are sequentially stacked on each pixel unit 1.

[0081] Among them, the infrared filter 400 can be used to filter the incident light to filter out infrared light, but does not affect the transmission of visible light. After filtering out the infrared light through the infrared filter 400, it is possible to avoid the situation where the photos taken under visible light are reddish.

[0082] In addition, the infrared filter 400 may include a plurality of infrared filter units. In this way, a color filter unit 2, a microlens unit 3, and an infrared filter unit are sequentially stacked on each pixel unit 1.

[0083] Among them, the image processor includes components such as an analog-to-digital converter (ADC) and an image signal processor (ISP, Image Signal Processing). After each pixel unit 1 receives a light signal for photosensing, the light signal can be converted into a photosensitive electrical signal, and then a digital signal matrix, that is, an image, is formed through the analog-to-digital converter, and then processed by the image signal processor.

[0084] In addition, the camera module further includes at least one camera lens.

[0085] The camera module provided by the embodiments of the present application can be applied to various forms of electronic devices, and can achieve high pixel and high photosensitivity performance of the camera module without increasing the size of the photosensitive sensor, that is, it can improve the imaging quality of the photos taken.

[0086] The camera module provided by the embodiments of the present application is, for example, a CMOS camera module (CMOS Camera Module, CCM), which is a camera module widely used on current intelligent mobile terminal devices.

[0087] Of course, the camera module provided by the embodiments of the present application includes, but is not limited to, the above-mentioned CMOS camera module, and the embodiments of the present application do not make any limitations here.

[0088] The embodiments of the present application also provide a control method for the camera module, and this control method is based on the above-mentioned camera module.

[0089] A control method for the camera module provided by the embodiments of the present application is shown in Figure 6 , and it includes:

[0090] Step S601: When all the color filter units are in the light filtering state, obtain a first image.

[0091] Among them, before obtaining the first image, a negative voltage can be applied through a controller to drive all the color filter units 2 on the set filter array 200 to be in the light filtering state. That is to say, the first image is captured and obtained when all the color filter units 2 are in the light filtering state.

[0092] Step S602: According to the first image, obtain the brightness data of all pixel points in the first image.

[0093] Step S603: When the brightness data of all pixel points in the first image is greater than a first brightness threshold, adjust all the color filter units to the fully transparent state.

[0094] Step S604: Obtain a second image.

[0095] Step S605: Output a target image according to the second image.

[0096] It should be noted that after obtaining the second image, when performing subsequent processing on it, the demosaicing algorithm does not need to guess colors and directly applies the three-color signals read out in each pixel unit.

[0097] In some examples of the present application, step S603 may further include the following steps:

[0098] When the brightness data of all pixel points in the first image is less than the first brightness threshold, adjust all the color filter units to the light filtering state;

[0099] Obtain a third image; and

[0100] Output a target image according to the third image.

[0101] It should be noted that after obtaining the third image, the Bayer array demosaicing algorithm is applied to perform subsequent processing on it to form a target image.

[0102] In the design of the embodiments of the present application, when it is found that the brightness of the acquired first image is too high, it is considered that the application scenario of the camera module is a high-brightness environment. At this time, it is controlled to adjust all the color filter units 2 on the set filter array 200 to a fully transparent state. Since each pixel unit 1 located below includes photosensitive channels in three bands such as RGB, the signal entering each pixel unit 1 is split into three bands and read separately, avoiding the overflow phenomenon caused by too many photo-generated electrons and avoiding the problem of overexposure in photos in a high-brightness environment. Better imaging quality can be obtained when shooting in a high-brightness scene.

[0103] In a specific example of the present application, refer to Figure 7 , the control method of the camera module includes:

[0104] Step S701: Turn on the camera module;

[0105] Step S702: Make all the color filter units on the set filter array be in the color filtering state under the control of a negative voltage;

[0106] Step S703: Start the first exposure to obtain the first image;

[0107] Step S704: Obtain the brightness data of all pixel points in the first image;

[0108] Step S705: Execute one of the following steps according to the brightness data of all pixel points in the first image:

[0109] Step S7051: When the brightness data of all pixel points in the first image is greater than the first brightness threshold, adjust all the color filter units on the set filter array to a fully transparent state under the control of a positive voltage;

[0110] Step S7052: When the brightness data of all pixel points in the first image is less than the first brightness threshold, adjust all the color filter units on the set filter array to the color filtering state under the control of a negative voltage;

[0111] Step S706: Obtain the second image according to Step S7051;

[0112] Or, obtain the third image according to Step S7052;

[0113] Step S707: Output the target image according to the second image;

[0114] Or, output the target image according to the third image.

[0115] In the step S704, the brightness data of all pixel points in the first image can be obtained by a brightness sensor, for example.

[0116] In step S705, if the brightness of all pixel points in the obtained first image is greater than a certain threshold (for example, the first brightness threshold), all color filter units 2 are applied with a positive voltage for color removal. When reading pixels, TG1 / TG2 / TG3 are respectively turned on, and the B / G / R signals of each pixel unit 1 are all obtained to get a second image. In a high-brightness environment, on the premise that the pixel unit 1 outputs a photosensitive electrical signal to ensure a sufficient signal-to-noise ratio, the resolution is improved.

[0117] In an embodiment of the present application, there is also a situation that when the brightness data of all pixel points in the first image is less than the first brightness threshold, all color filter units 2 continue to be maintained in the light filtering state under the control of a negative voltage.

[0118] That is to say, if the brightness of all pixel points in the obtained first image is less than a certain threshold (for example, the first brightness threshold), all color filter units 2 continue to be applied with a negative voltage to maintain the light filtering state. When reading pixels, TG1 / TG1 / TG3 are simultaneously turned on, and only one fusion signal of each pixel unit 1 is read to get a third image. In a low-light environment, the photosensitivity of the pixels is improved as much as possible, the signal-to-noise ratio is improved, and the low-light image quality is guaranteed.

[0119] Another control method of the camera module provided by the embodiment of the present application, see Figure 8 This control method includes:

[0120] Step S801: Obtain a first image when all the color filter units are in the light filtering state.

[0121] Among them, before obtaining the first image, a negative voltage can be applied through a controller to drive all color filter units 2 on the set light filter array 200 to be in the light filtering state. That is to say, the first image is taken and obtained when all color filter units 2 are in the light filtering state.

[0122] Step S802: Obtain the brightness data of all pixel points in the first image according to the first image.

[0123] Step S803: Obtain the high-brightness area and low-brightness area on the first image according to the brightness data of all pixels in the first image.

[0124] Step S804: When the brightness data of the high-brightness area is greater than the second brightness threshold, adjust the color filter units corresponding to the high-brightness area to the fully transparent state, and adjust the color filter units corresponding to the low-brightness area to the light filtering state.

[0125] Step S805: Obtain a second image.

[0126] Step S806: Output a target image according to the second image.

[0127] Among them, when it is found that there is a highlighted area on the obtained first image, the highlighted area uses stacked pixel units 1 to output photosensitive signals. Since each sub-pixel contains the necessary RGB three-band colors, no noise of detailed color information is introduced during the demosaicing operation, thereby improving the resolution of the highlight area. And because the signals entering the sub-pixels are read out separately in three bands, the overflow problem caused by excessive photogenerated electrons is avoided, and the saturation risk of the highlight area is avoided. For the low-brightness area (dark-light area), the fusion reading method is adopted, and the obtained signal intensity is greater, which can ensure the signal-to-noise ratio of the dark-light area and ensure the dark-light image quality.

[0128] In a specific example of the present application, refer to Figure 9 , the control method of the camera module includes:

[0129] Step S901: Turn on the camera module;

[0130] Step S902: Make all the color filter units on the set filter array be in the color filtering state under the control of a negative voltage;

[0131] Step S903: The first exposure is started to obtain a first image;

[0132] Step S904: Obtain the brightness data of all pixel points in the first image, and obtain the highlighted area and the low-brightness area on the first image according to the brightness data of all pixels in the first image;

[0133] Step S905: When the brightness data of the highlighted area is greater than the second brightness threshold, adjust each of the color filter units corresponding to the highlighted area to the fully transparent state, and adjust each of the color filter units corresponding to the low-brightness area to the color filtering state;

[0134] Step S906: The exposure is started again to obtain a second image;

[0135] Step S907: Output a target image according to the second image;

[0136] Perform operations such as demosaicing on the second image to complete image output, so as to output a target image.

[0137] In the step S904, the brightness data of all pixel points in the first image can be obtained by a brightness sensor, for example.

[0138] When applying the above specific embodiments, when demosaicking the highlighted area, signals of three spectra, namely R, G, and B, exist simultaneously in each pixel unit 1. Therefore, there is no need to perform color guessing. The demosaicking algorithm for the dark area is the same as that of the Bayer array demosaicking algorithm.

[0139] According to another embodiment of the present application, an electronic device is provided.

[0140] The electronic device includes the camera module as described above.

[0141] The electronic device can be a terminal or other devices other than the terminal. Exemplarily, the electronic device can be, for example, a mobile phone, a tablet computer, a notebook computer, a handheld computer, an in-vehicle electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It can also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations here.

[0142] Other configurations and operations of the electronic device according to the embodiments of the present application are known to those of ordinary skill in the art and will not be described in detail here.

[0143] In the description of this specification, the descriptions with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0144] Although the embodiments of the present application have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and purposes of the present application. The scope of the present application is defined by the claims and their equivalents.

Claims

1. An imaging module, characterized in that, Comprising: A pixel unit (1), the pixel unit (1) including three stacked photosensitive devices, each of the photosensitive devices being configured to receive light in a wavelength band corresponding to the photosensitive device; and A color filter unit (2), the color filter unit (2) being disposed above the pixel unit (1), the color filter unit (2) being switchable between a light filtering state and a fully transmissive state; When the color filter unit (2) is in the light filtering state, it is configured to transmit light in a wavelength band corresponding to the color filter unit (2), and the transmitted light can be received by the photosensitive device corresponding to the wavelength band; When the color filter unit (2) is in the fully transmissive state, it is configured to transmit light of different wavelength bands, and the light of different wavelength bands transmitted can be received by each of the photosensitive devices corresponding to the wavelength bands one by one; The pixel units (1) are provided in a plurality, and the plurality of pixel units (1) are arranged in a set pixel array (100); The color filter units (2) are provided in a plurality, and the plurality of color filter units (2) are arranged in a set light filtering array (200); Wherein, the pixel units (1) and the color filter units (2) are provided in a one-to-one correspondence; When all of the color filter units (2) are in the light filtering state, a first image is acquired through the imaging module; and based on the first image, the brightness data of all pixel points in the first image is acquired; When the brightness data of all pixel points in the first image is greater than a first brightness threshold, all of the color filter units (2) are adjusted to the fully transmissive state; when the brightness data of all pixel points in the first image is less than the first brightness threshold, all of the color filter units (2) are adjusted to the light filtering state; Or, Based on the brightness data of all pixel points in the first image, a high-brightness area and a low-brightness area on the first image are acquired; when the brightness data in the high-brightness area is greater than a second brightness threshold, the corresponding color filter units (2) in the high-brightness area are adjusted to the fully transmissive state, and the corresponding color filter units (2) in the low-brightness area are adjusted to the light filtering state.

2. The camera module according to claim 1, wherein, The imaging module further includes a controller, the controller being electrically connected to the color filter unit (2), and the controller being configured to apply different voltages to the color filter unit (2) to drive the color filter unit (2) to be switchable between the light filtering state and the fully transmissive state.

3. The camera module according to claim 1, wherein, When the color filter unit (2) is in the light filtering state, it is configured to transmit light in a wavelength band corresponding to the color filter unit (2), and the transmitted light can be received by one photosensitive device corresponding to the wavelength band below the color filter unit (2); When the color filter unit (2) is in the fully transmissive state, it is configured to transmit visible light, and the red, green, and blue light in the transmitted visible light can be received by the three photosensitive devices one by one.

4. The camera module according to claim 1, characterized in that, The material of the color filter unit (2) is an electrochromic material.

5. The camera module according to claim 1, wherein The imaging module further includes: a microlens layer (300), an infrared filter (400), and an image processor; The microlens layer (300) covers the set light filtering array (200); The infrared filter (400) is disposed above the microlens layer (300); The image processor is electrically connected to the set pixel array (100).

6. A control method for a camera module according to any one of claims 1-5, characterized in that, Comprising: When all of the color filter units are in the light filtering state, acquiring a first image; According to the first image, acquiring luminance data of all pixel points in the first image; When the luminance data of all pixel points in the first image is greater than a first luminance threshold, adjusting all of the color filter units to a fully transmissive state; Acquiring a second image; According to the second image, outputting a target image.

7. The control method of the camera module according to claim 6, characterized in that, Further comprising: When the luminance data of all pixel points in the first image is less than the first luminance threshold, adjusting all of the color filter units to the light filtering state; Acquiring a third image; And According to the third image, outputting a target image.

8. A control method for an imaging module according to any one of claims 1-5, characterized in that, Comprising: When all of the color filter units are in the light filtering state, acquiring a first image; According to the first image, acquiring luminance data of all pixel points in the first image; According to the luminance data of all pixel points in the first image, acquiring a high-brightness region and a low-brightness region on the first image; When the luminance data of the high-brightness region is greater than a second luminance threshold, adjusting each of the color filter units corresponding to the high-brightness region to the fully transmissive state, and adjusting each of the color filter units corresponding to the low-brightness region to the light filtering state; Acquiring a second image; According to the second image, outputting a target image.

9. An electronic device, characterized in that, Comprising the imaging module according to any one of claims 1-5.

Images