Camera module, electronic equipment and image acquisition method

Abstract

The invention discloses a camera module, electronic equipment and an image acquisition method, and belongs to the technical field of image acquisition devices. The shooting module comprises at least two pixel units, and each pixel unit comprises a photosensitive element, a light-emitting element and a light-emitting element, the optical filter is arranged at the light incident end of the photosensitive element; and the liquid crystal assembly is arranged on the light incident side of the optical filter and is used for adjusting the light transmittance of the optical filter.

Description

Technical Field

[0001] The present application belongs to the technical field of image acquisition devices, and specifically relates to a camera module, an electronic device and an image acquisition method. Background Art

[0002] With the development of mobile terminal technology, the image quality signal-to-noise ratio and dynamic range of mobile terminal images have been greatly improved. The real world dynamic range is very high, often as high as 300dB, and the dynamic range of the human eye is about 100dB to 180dB, but the dynamic range of the camera module is only about 60dB. In order to make the photos taken more realistic and closer to what the human eye sees, it is necessary to improve the camera module's sensitivity to dark scenes, improve the signal-to-noise ratio, and have a high dynamic range for bright scenes.

[0003] In the related art, the camera module cannot have both the photosensitivity for dark scenes and the high dynamic range capability for bright scenes in the same frame of image. Summary of the invention

[0004] The present application aims to provide a camera module, an electronic device and an image acquisition method, which can individually control the amount of light entering the pixel units corresponding to the overexposed image area and the underexposed image area in the captured image, thereby improving the dynamic range of a single-frame image.

[0005] In a first aspect, an embodiment of the present application proposes a camera module, comprising: at least two pixel units, each pixel unit comprising: a photosensitive element; a filter, arranged at the light incident end of the photosensitive element; a liquid crystal component, arranged on the light incident side of the filter, and the liquid crystal component is used to adjust the light transmittance of the filter.

[0006] In a second aspect, an embodiment of the present application provides an electronic device, comprising: the camera module in the first aspect.

[0007] In a third aspect, an embodiment of the present application provides an image acquisition method, which is executed by the electronic device in the second aspect, and the image acquisition method includes: determining an exposure parameter range of a first image according to a first exposure parameter when the light transmittance of at least two liquid crystal components corresponding to at least two pixel units is an initial transmittance; determining at least two transmittance adjustment values ​​corresponding to at least two liquid crystal components according to the exposure parameter range; adjusting the transmittance of at least two liquid crystal components according to the at least two transmittance adjustment values; and controlling at least two pixel units to capture a second image according to the first exposure parameter.

[0008] In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores programs or instructions that can be executed on the processor, and when the programs or instructions are executed by the processor, the steps of the method of the third aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the third aspect are implemented.

[0010] In a sixth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method of the third aspect.

[0011] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method of the third aspect.

[0012] In the embodiment of the present application, the camera module includes a plurality of pixel units, and a photosensitive element and a filter with a liquid crystal component are separately provided in each pixel unit. The light transmittance of the filter in each pixel unit can be separately controlled through the liquid crystal component, and the photosensitivity of each pixel unit can be separately adjusted. In the process of shooting an image by the camera module, the control parameters of the liquid crystal component corresponding to each pixel unit can be generated according to the brightness of the shooting scene, and the photosensitivity of each pixel unit can be separately adjusted. The amount of light entering the pixel units corresponding to the overexposed image area and the underexposed image area in the shot image can be separately controlled, thereby improving the dynamic range of a single-frame image. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a cross-sectional view of a camera module provided in some embodiments of the present application;

[0014] Figure 2 is a cross-sectional view of a camera module provided in some embodiments of the present application;

[0015] Figure 3 is a schematic diagram of the structure of the filter and liquid crystal assembly provided in some embodiments of the present application;

[0016] Figure 4 is a cross-sectional view of a camera module provided in some embodiments of the present application;

[0017] Figure 5 is a cross-sectional view of a diffraction grating provided in some embodiments of the present application;

[0018] Figure 6 is a diffraction schematic diagram of a diffraction grating provided in some embodiments of the present application;

[0019] Figure 7 is a cross-sectional view of a diffraction component and an optical filter provided in some embodiments of the present application;

[0020] Figure 8 is a schematic diagram of an arrangement of pixel units provided in some embodiments of the present application;

[0021] Fig. 9 is a schematic diagram of an arrangement of pixel units provided in some embodiments of the present application;

[0022] Fig.10 is a circuit diagram of a camera module provided in some embodiments of the present application;

[0023] Fig.11 is a structural block diagram of an electronic device provided in some embodiments of the present application;

[0024] Fig.12 is a flowchart of an image acquisition method provided in some embodiments of the present application;

[0025] Fig.13a is a schematic diagram of captured images provided in some embodiments of the present application;

[0026] Fig.13b is a schematic diagram of captured images provided in some implementations of the present application;

[0027] Fig.14 is a schematic diagram of the structure of the optical filter provided in some embodiments of the present application;

[0028] Fig.15 is a structural block diagram of an image acquisition device provided in some embodiments of the present application;

[0029] Fig.16 is a structural block diagram of an electronic device according to an embodiment of the present application;

[0030] Fig.17 It is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0031] Description of reference numerals:

[0032] 10-camera module, 100-pixel unit, 110-photosensitive element, 120-filter, 122-first area, 124-second area, 130-liquid crystal component, 132-liquid crystal structure, 134-electrically controlled drive unit, 136-analyzer, 138-polarization polarizer, 140-diffraction component, 142-nanometal rod, 144-diffraction grating, 150-lens group, 160-voice coil motor, 170-base, 180-microlens, 190-color filter, 20-incident light, 21-diffracted light, 22-emitted light, TG-switch, FD-parasitic capacitance, RST-reset transistor, SF-signal amplifier, SET-row selector, VDD-power supply. DETAILED DESCRIPTION

[0033] The embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and should not be construed as limitations on the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0034] The term "first" or "second" in the specification and claims of this application may include one or more of the features explicitly or implicitly. In the description of this application, unless otherwise specified, "plurality" means two or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means that the objects connected before and after are in an "or" relationship.

[0035] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0036] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0037] The following is an explanation of the special terms in this application:

[0038] Overexposure: Overexposure refers to the situation where the brightness of the picture is too high and the photo is white due to reasons such as too large an aperture or too slow a shutter speed when shooting.

[0039] Underexposure: Underexposure means that the brightness of the photo is insufficient, causing the shadow part to appear dead black, that is, the brightness of the photo does not reach the brightness range that the captured picture should have.

[0040] RGB: The RGB color model is a color standard in the industry, where R stands for red, B stands for blue, and G stands for green.

[0041] Analyzer: Analyzer is also called polarizer. Its main function is to convert incident light into linearly polarized light.

[0042] Polarization polarizer: Polarization polarizer is a device that obtains polarized light from natural light emitted by an ordinary light source.

[0043] Combine the following Figures 1 to 17 A camera module, an electronic device and an image acquisition method according to an embodiment of the present application are described.

[0044] In some embodiments of the present application, a camera module is provided. Figure 1 is a cross-sectional view of a camera module provided in some embodiments of the present application, Figure 2 is a cross-sectional view of a camera module provided in some embodiments of the present application, Figure 3 is a schematic diagram of the structure of the filter and liquid crystal components provided in some embodiments of the present application, such as Figure 1 , Figure 2 and Figure 3 As shown, the camera module 10 includes: at least two pixel units 100, each pixel unit 100 includes: a photosensitive element 110; a filter 120, arranged at the light incident end of the photosensitive element 110; a liquid crystal component 130, arranged on the light incident side of the filter 120, and the liquid crystal component 130 is used to adjust the light transmittance of the filter 120.

[0045] In some embodiments of the present application, the photosensitive component includes at least two pixel units 100, and the at least two pixel units 100 are arranged in an array to form a photosensitive component. Each pixel unit 100 can be individually photosensitive, so as to sample and obtain a corresponding photosensitive signal, and the photosensitive signal is processed by an ISP (Image Signal Processor) to form an image.

[0046] like Figure 2As shown, the camera module includes a lens group 150, a voice coil motor 160, a base 170 and a filter 120. Among them, the lens group 150 is used for focusing and focusing. The lens group 150 is wrapped and fixed by the voice coil motor 160. The upper and lower ends of the voice coil motor 160 are connected to the spring. The voice coil motor 160 is energized to generate an electromagnetic force, and the electromagnetic force generated is finally balanced with the elastic force of the spring, so that the lens group 150 is pushed to the focusing position through the voice coil motor 160. The light gathered on the lens module is projected to the filter for filtering. The filter can filter out unnecessary light projected to the photosensitive component, and the photosensitive component is placed to produce false color and ripples, thereby improving the effective resolution and color reproduction of the photosensitive element 110. The light after passing through the filter can be sensed by the photosensitive component. The electronic components of the electronic device are arranged in the base 170.

[0047] In some embodiments of the present application, each pixel unit 100 includes a photosensitive element 110, which may be a photosensitive semiconductor. A filter 120 is provided at the light incident end of each photosensitive element 110, which may be an IR Filter (Infrared Filter). When the pixel unit 100 collects photosensitive signals in the camera module, light is transmitted to the light incident end of the photosensitive element 110 through the filter 120, so that the photosensitive element 110 can collect the photosensitive signals in the light. The liquid crystal component 130 is provided on the filter 120, and the liquid crystal component 130 can adjust the transmittance of the filter 120. When the camera module 10 captures an image, the transmittance of the filter 120 can be adjusted according to the brightness of the captured scene to change the photosensitivity of the pixel unit 100.

[0048] It should be noted that if Figure 1 As shown, a microlens 180 and a color filter 190 are sequentially arranged at the light incident end of the photosensitive element 110, and the color filter 190 can be a CFA (Color Filter Array). Specifically, the incident light 20 passes through the diffraction component 140, the liquid crystal component 130, the filter 120, and the color filter 190 in sequence and is incident to the light incident end of the photosensitive element 110.

[0049] Specifically, the camera module 10 includes at least two pixel units 100, and a filter 120 with a liquid crystal component 130 is separately provided in each pixel unit 100, and the filter 120 of each pixel unit 100 can adjust the amount of light entering the respective pixel unit 100. When the camera module 10 captures the first image, the liquid crystal component 130 in the pixel unit 100 located in each area can be controlled based on the brightness of each image area in the first image, so as to adjust the photosensitivity of the pixel unit 100 in each area separately, increase the amount of light entering the pixel unit 100 in the darker area of ​​the first image, and reduce the amount of light entering the pixel unit 100 in the brighter area of ​​the first image, thereby realizing the function of improving the dynamic range of a single frame, which helps to greatly improve the camera's photo and video recording experience.

[0050] It should be noted that the photosensitive signals collected by the photosensitive elements 110 in at least two pixel units 100 may be different. Specifically, the photosensitive elements 110 in at least two pixel units 100 collect a total of three photosensitive signals, namely, R signal, G signal, and B signal, wherein the R signal is a red light signal, the G signal is a green light signal, and the B signal is a blue light signal.

[0051] In some embodiments of the present application, the camera module includes a plurality of pixel units 100, and a photosensitive element 110 and a filter 120 with a liquid crystal component 130 are separately provided in each pixel unit 100. The light transmittance of the filter 120 in each pixel unit 100 can be separately controlled through the liquid crystal component 130, and the photosensitivity of each pixel unit 100 can be separately adjusted. In the process of capturing images by the camera module, the control parameters of the liquid crystal component 130 corresponding to each pixel unit 100 can be generated according to the brightness of the captured scene, and the photosensitivity of each pixel unit 100 can be separately adjusted, so as to separately control the amount of light entering the pixel unit 100 corresponding to the overexposed image area and the underexposed image area in the captured image, thereby improving the dynamic range of a single frame image without additionally setting a variable aperture, and solving the problem that it is difficult to improve the dynamic range of a single frame image without affecting the optical quality of the camera module 10.

[0052] like Figure 2 and Figure 3As shown, in some embodiments of the present application, the filter 120 includes at least two filtering areas, and the liquid crystal component 130 includes: at least two liquid crystal structures 132, which are flatly arranged on the filter, and each filtering area corresponds to a liquid crystal structure; at least two electrically controlled driving units 134, which are electrically connected to the at least two liquid crystal structures 132, and the electrically controlled driving units 134 are used to adjust the polarization state of the liquid crystal structure 132; wherein the polarization state includes a first polarization state and a second polarization state, when the liquid crystal structure 132 is in the first polarization state, the liquid crystal structure 132 is in a light-transmitting state, and when the liquid crystal structure 132 is in the second polarization state, the liquid crystal structure 132 is in an opaque state.

[0053] In some embodiments of the present application, the filter 120 includes multiple filtering areas, each of which is provided with a liquid crystal structure 132. By adjusting the polarization state of each liquid crystal structure 132, the light transmittance of the corresponding filtering area is adjusted, thereby adjusting the light transmittance of the entire filter 120.

[0054] In some embodiments of the present application, the liquid crystal assembly 130 includes at least two liquid crystal structures 132 , and the at least two liquid crystal structures 132 are electrically connected to at least two electrically controlled driving units 134 , respectively. The electrically controlled driving units 134 can adjust the polarization state of the liquid crystal structures 132 .

[0055] Specifically, each liquid crystal structure 132 has two polarization states. When the liquid crystal structure 132 is in a first polarization state, the light incident on the liquid crystal structure 132 can be transmitted to the light incident end of the photosensitive element 110 through the liquid crystal component 130. When the liquid crystal structure 132 is in a second polarization state, the light incident on the liquid crystal structure 132 is polarized. At this time, the light cannot be transmitted to the photosensitive element 110 through the liquid crystal component 130. Therefore, when the polarization structure is in the first polarization state, the liquid crystal structure 132 is in a light-transmitting state, and when the polarization structure is in the second polarization state, the liquid crystal structure 132 is in a light-impermeable state. The number of liquid crystal components 130 in each pixel unit 100 is the same as the number of the electronically controlled driving units 134, so that the polarization states of multiple liquid crystal components 130 in the pixel unit 100 can be controlled individually.

[0056] It should be noted that the number of liquid crystal structures 132 is related to the adjustable level of light transmittance of the filter 120. The more liquid crystal structures 132 there are, the more adjustable levels of light transmittance of the filter 120. The coverage areas of the multiple liquid crystal structures 132 on the filter 120 may be the same or different.

[0057] Exemplarily, the number of liquid crystal structures 132 is 3, and the coverage area of ​​one of the liquid crystal structures 132 on the filter 120 is 50%, and the coverage area of ​​the other two liquid crystal structures 132 on the filter 120 is 25% each, then the light transmittance is adjustable in five levels, namely 0%, 25%, 50%, 75%, and 100%.

[0058] Exemplarily, the number of the liquid crystal structures 132 is two, and the coverage area of ​​the two liquid crystal structures 132 on the filter 120 is 50% each, and the light transmittance is adjustable to three levels, namely 0%, 50%, and 100%.

[0059] In the embodiment of the present application, the liquid crystal component 130 includes at least two liquid crystal structures 132, and electric control drive units 134 corresponding to the liquid crystal structures 132. Each electric drive unit can adjust the polarization state of the corresponding liquid crystal structure 132, so that the light transmittance of the filter 120 is adjustable, thereby adjusting the photosensitivity of a single pixel unit 100.

[0060] like Figure 3 As shown, in some embodiments of the present application, the liquid crystal component 130 also includes: an analyzer 136, which is arranged on the filter 120; a polarization polarizer 138, which is arranged on the light incident side of the analyzer 136, and at least two liquid crystal structures 132 are arranged between the analyzer 136 and the polarization polarizer 138, wherein the polarization direction of the polarization polarizer 138 is perpendicular to the polarization direction of the analyzer 136.

[0061] In the embodiment of the present application, the liquid crystal assembly 130 further includes an analyzer 136 and a polarization polarizer 138 with perpendicular polarization directions, and the liquid crystal structure 132 is disposed between the analyzer 136 and the polarization polarizer 138. The analyzer 136 and the polarization polarizer 138 with perpendicular polarization directions can cause light to be polarized twice, and because the polarization directions are perpendicular, when the liquid crystal structure 132 is not disposed, light cannot pass through the analyzer 136 and the polarization polarizer 138.

[0062] Specifically, when the light is transmitted to the photosensitive element 110 through the liquid crystal assembly 130, the polarization polarizer 138 is disposed on the light incident side of the analyzer 136, and the liquid crystal structure 132 is disposed between the polarization polarizer 138 and the analyzer 136, so the light passes through the polarization polarizer 138, the liquid crystal structure 132, and the analyzer 136 in sequence. When the liquid crystal structure 132 is in a first polarization state, the light is first polarized after entering the polarization polarizer 138, and the light is second polarized after passing through the liquid crystal structure 132. The light that has undergone two polarizations can pass through the analyzer 136 and be transmitted to the photosensitive element 110. When the liquid crystal structure 132 is in a second polarization state, the light is first polarized after entering the polarization polarizer 138, and the light is second polarized after passing through the liquid crystal structure 132. The light that has undergone two polarizations cannot pass through the analyzer 136.

[0063] In the embodiment of the present application, a polarization polarizer 138 and an analyzer 136 which are perpendicular to each other are additionally provided in the liquid crystal component 130, and the liquid crystal structure 132 is provided between the polarization polarizer 138 and the analyzer 136. When the liquid crystal structure 132 is in a first polarization state, light can be transmitted to the light incident end of the photosensitive element 110 through the polarization polarizer 138, the liquid crystal structure 132 and the analyzer 136 in sequence. When the liquid crystal structure 132 is in a second polarization state, since the polarization directions of the polarization polarizer 138 and the analyzer 136 are perpendicular to each other, light cannot be transmitted to the light incident end of the photosensitive element 110 through the polarization polarizer 138, the liquid crystal structure 132 and the analyzer 136, thereby improving the controllability and stability of adjusting the light transmittance of the filter 120.

[0064] like Figure 2 As shown, in some embodiments of the present application, the filter includes a first area 122 and a second area 124, and the second area 124 is the area on the filter 120 except the first area 122. The pixel unit 100 also includes: a diffraction component 140, which is arranged in the first area 122 of the filter 120, and the diffraction component 140 is used to diffract the light entering the diffraction component 140 toward the photosensitive element 110 in the adjacent pixel unit 100, and the distance between the adjacent pixel unit and the first area 122 is smaller than the distance between the adjacent pixel unit and the second area 124.

[0065] In the embodiment of the present application, the first area 122 is an area of ​​the filter 120 where the diffraction component 140 is disposed, and the second area 124 is an area of ​​the filter 120 where the diffraction component 140 is not disposed. Since the distance between the adjacent pixel unit 100 and the first area 122 in the pixel unit 100 is relatively close, the diffraction component 140 can diffract the light to the photosensitive element in the adjacent pixel unit 100.

[0066] In the embodiment of the present application, the pixel unit 100 further includes a diffraction component 140 disposed on the filter 120. The diffraction component 140 can diffract light, so that the light can be transmitted to the light incident end of the photosensitive element 110 in the pixel unit 100 through the filter 120 in the pixel unit 100, and can also diffract the light to the light incident end of the photosensitive element 110 of the adjacent pixel unit 100, thereby providing fill light to the adjacent pixel unit 100. Since the filter 120 in each pixel unit 100 is provided with the diffraction component 140, the filter 120 in each pixel unit 100 can provide fill light to the photosensitive element 110 in the adjacent pixel unit 100, further improving the dynamic range of the camera module.

[0067] Figure 4 is a cross-sectional view of a camera module provided in some embodiments of the present application, such as Figure 4 As shown, the filters 120 in three adjacent pixel modules are arranged adjacently, and the photosensitive elements 110 are also arranged adjacently. After the light passes through the diffraction component 140 of the filter 120, it not only transmits the light to its own photosensitive element 110, but also diffracts to the photosensitive element 110 in the adjacent pixel module. After the incident light 20 is diffracted by the diffraction grating 144, a diffracted light 21 is formed, and the diffracted light 21 is transmitted to the light incident end of the adjacent photosensitive element 120.

[0068] In some embodiments of the present application, the diffraction component 140 includes: nanometal rods 142, which are spaced apart in the first region 122 of the filter 120, forming a diffraction grating 144 on the first region 122, and the spacing between two adjacent nanometal rods 142 is proportional to the wavelength of the optical fiber incident on the filter.

[0069] In some embodiments of the present application, the nano metal rods 142 are nanoscale metal rod structures that can form a grating on the filter 120, and the formed grating is a diffraction grating 144. The diffraction grating 144 can perform spatial periodic modulation on the amplitude or phase of the incident light.

[0070] Figure 5 is a cross-sectional view of a diffraction grating provided in some embodiments of the present application, Figure 6 is a diffraction diagram of a diffraction grating provided in some embodiments of the present application. Figure 5 and Figure 6As shown, the formed nanoscale grating is an optical element with a periodic structure. This period can be the peaks and valleys embossed on the surface of the material, causing a periodic change in the refractive index n in the material. This period is generally at the micro-nano level, the same order of magnitude as the wavelength of visible light, specifically 450nm-700nm, in order to effectively deflect and control the light. The "splitting" principle of the diffraction grating 144 is as follows Figure 6 As shown, assuming that the incident light is a single wavelength of green light, it will be divided into several diffraction orders by the diffraction grating 144, and each diffraction order continues to propagate in different directions, including light of reflection diffraction and transmission diffraction. The diffraction angle corresponding to each diffraction order is determined by the incident angle of the light and the period of the grating. By designing the parameters of the grating, the parameters of the grating include: material refractive index, grating shape, thickness, duty cycle, etc., the diffraction efficiency of a certain diffraction order can be optimized to the highest, so that most of the light is mainly propagated in this direction after diffraction. Among them, the incident light 20 forms multiple emitted light rays 22 after diffraction by the grating.

[0071] like Figure 6 As shown, the diffraction angle and diffraction efficiency are controlled by the grating parameters. The effect of controlling the light splitting is achieved by designing a grating with variable grating parameters. The grating equation (1) is as follows:

[0072] mλ=d G (sinα+sinβm); (1)

[0073] Among them, d G is the grating spacing, that is, the grating constant, m is an integer, and the value is 0, ±1, etc., βm is the diffraction angle, α is the incident angle, and λ is the wavelength of light.

[0074] For example, taking the light of 400nm band with an incident angle of 30°, a diffraction angle of 31° as an example, 0.515+0.5=0.4 / d, then d=0.394umd, that is, the grating spacing is 0.394um.

[0075] It should be noted that, according to the above grating equation (1), the spacing between the nanometal rods 142 is proportional to the wavelength of the light to be diffracted, and the spacing between the nanometal rods 142 is also related to the incident angle of the light. When a plurality of nanometal rods 142 form a grating, the plurality of nanometal rods 142 are arranged at unequal intervals. The spacing between the nanometal rods 142 in different pixel units may be different or the same. Specifically, the spacing between the nanometal rods 142 on two pixel units 100 that diffract the same light can be set to be the same, and the spacing between the nanometal rods 142 on two pixel units 100 that diffract different light can be set to be different. For example: the spacing between the nanometal rods 142 on two pixel units 100 that are sensitive to red light is set to be the same, and the spacing between the nanometal rods 142 on the pixel unit 100 that is sensitive to green light is different from the spacing between the nanometal rods 142 on the pixel unit 100 that is sensitive to red light.

[0076] In an embodiment of the present application, nano-metal rods 142 are arranged at intervals on the filter 120, and a diffraction grating 144 is formed on the filter 120. The diffraction grating 144 can diffract the light incident on the filter 120, so that when the light passes through the filter 120 of the pixel unit 100, it can supplement the light of the photosensitive element 110 in the adjacent pixel unit 100, thereby further improving the dynamic range of each pixel unit 100.

[0077] Figure 7 is a cross-sectional view of a diffraction component and a filter provided in some embodiments of the present application, such as Figure 2 and Figure 7 As shown, in some embodiments of the present application, the first region 122 is disposed on the peripheral side of the second region 124 , or the first region 122 is disposed on one side of the second region 124 , or the first region 122 is disposed on both sides of the second region 124 .

[0078] In the embodiment of the present application, since the diffraction component 140 can diffract light to the adjacent photosensitive element 110, the diffraction component 140 only needs to cover a partial area of ​​the filter 120 close to the adjacent pixel unit 100, so that when the light passes through the filter 120, part of the light can be directly transmitted to the photosensitive element 110 in the pixel unit 100, and the other part of the light is diffracted and transmitted to the photosensitive element 110 in the pixel unit 100 and the photosensitive element 110 in the adjacent pixel unit 100.

[0079] like Figure 2 As shown, illustratively, the diffraction components 140 are disposed on both sides of the filter 120 .

[0080] like Figure 7As shown, exemplarily, the diffraction component 140 is disposed on the peripheral side of the filter 120 .

[0081] In some embodiments of the present application, at least two pixel units 100 may be an all-in-one pixel group, that is, one pixel group includes pixel units 100 that collect the same photosensitivity signal.

[0082] Figure 8 is a schematic diagram of the arrangement of pixel units provided in some embodiments of the present application, such as Figure 8 As shown, at least two pixel units 100 form a 4-in-1 pixel group, wherein the B pixel unit 100 is used to collect B signals, the Gb pixel unit and the Gr pixel unit are used to collect G signals, and the R pixel unit 100 is used to collect R signals, wherein the R signal is a red light signal, the G signal is a green light signal, and the B signal is a blue light signal.

[0083] Fig. 9 is a schematic diagram of the arrangement of pixel units provided in some embodiments of the present application, such as Fig. 9 As shown, at least two pixel units 100 form a 16-in-1 pixel group. The B pixel unit 100 is used to collect B signals, the Gb pixel unit and the Gr pixel unit are used to collect G signals, and the R pixel unit 100 is used to collect R signals, wherein the R signal is a red light signal, the G signal is a green light signal, and the B signal is a blue light signal.

[0084] Fig.10 is a circuit diagram of a camera module provided in some embodiments of the present application, such as Fig.10 As shown, the camera module also includes a switch TG, a reset transistor RST, a parasitic capacitor FD, a signal amplifier SF and a row selector SET. At the beginning of the exposure phase, the reset transistor RST and the switch TG are turned on at the same time to clear the pixel unit, and then the two are disconnected to start exposure. The electron-hole pairs generated by light irradiation will be separated due to the presence of the photosensitive element in the pixel unit, and the electrons move to the n region and the holes move to the p region. At the end of exposure, RST is activated to reset the parasitic capacitor FD to a high level. After the reset is completed, the reset level of the parasitic capacitor FD is read out. TG is activated to completely transfer the charge from the photosensitive area to the parasitic capacitor FD for reading. Next, the voltage signal in the parasitic capacitor FD is read out. The two voltage signals read out successively are subtracted to eliminate noise. The obtained signal is analog amplified and then sampled to output a digital signal. Among them, VDD is the power supply.

[0085] In some embodiments of the present application, an electronic device is provided. Fig.11It is one of the structural block diagrams of an electronic device provided in some embodiments of the present application. The electronic device 1100 includes: a camera module 200 in any of the above embodiments. The camera module 200 is the camera module in any of the above embodiments, and thus has all the beneficial technical effects of the camera module in any of the above embodiments, which will not be repeated here.

[0086] In some embodiments of the present application, an image acquisition method is provided. Fig.12 is a flow chart of an image acquisition method provided in some embodiments of the present application, such as Fig.12 As shown, the image acquisition method is executed by the electronic device in any of the above embodiments, and the image acquisition method includes:

[0087] Step 1202, determining an exposure parameter range of a first image according to a first exposure parameter when the light transmittances of at least two liquid crystal components corresponding to at least two pixel units are initial transmittances;

[0088] In the embodiment of the present application, the initial transmittance is the light transmittance of the liquid crystal component in the pixel unit when it is not adjusted. At the initial transmittance, the light transmittance of the liquid crystal component can be adjusted upward or downward.

[0089] In the embodiment of the present application, the user controls the electronic device to start the camera module, the camera module controls the lens group and the pixel unit to start working, the pixel unit starts to collect images, and transmits them to the image processor for processing. When the pixel unit starts to collect the first image, the first exposure parameter of the collected image can be determined, and the exposure parameter range of the captured image can be determined according to the first exposure parameter. The exposure parameter range is the range between the maximum exposure parameter and the minimum exposure parameter used when the best shooting effect is achieved in the shooting scene of the image.

[0090] Exemplarily, the exposure parameter includes at least one of the following: exposure duration, exposure gain.

[0091] Step 1204, determining at least two transmittance adjustment values ​​corresponding to at least two liquid crystal components according to the exposure parameter range;

[0092] In the embodiment of the present application, the sensitivity adjustment range required for each pixel unit when the image captured in the current shooting scene reaches a normal exposure can be determined based on the exposure parameter range, and the adjustment range is the transmittance adjustment value.

[0093] Exemplarily, the shooting scene of the image is a sky scene, and the A pixel that is close to overexposure but not in an overexposed state is taken as an example: under the first exposure parameter, the A pixel is 900lsb, and at the minimum exposure parameter within the exposure parameter range, the A pixel is 450lsb, then it is determined that the amount of light entering the A pixel needs to be reduced by half to allow the sky area to be normally exposed, that is, the transmittance adjustment value is -50%.

[0094] Step 1206, adjusting the transmittance of at least two liquid crystal components according to at least two transmittance adjustment values;

[0095] Step 1208: Control at least two pixel units to capture a second image according to the first exposure parameter.

[0096] In the embodiment of the present application, after the transmittance adjustment value of each liquid crystal component corresponding to each pixel unit is calculated, the transmittance of at least two liquid crystal components can be adjusted based on the transmittance adjustment. After the adjustment is completed, the pixel unit is controlled to capture the second image according to the first exposure parameter, and the dynamic range of the exposure of the second image is increased, so that the shooting effect of the second image is significantly improved.

[0097] In the embodiment of the present application, the camera module includes a plurality of pixel units, and a photosensitive element and a filter with a liquid crystal component are separately provided in each pixel unit. The light transmittance of the filter in each pixel unit can be controlled separately through the liquid crystal component, and the photosensitivity of each pixel unit can be adjusted separately. In the process of capturing images by the camera module, the control parameters of the liquid crystal component corresponding to each pixel unit can be generated according to the brightness of the captured scene, and the photosensitivity of each pixel unit can be adjusted separately, so as to control the amount of light entering the pixel units corresponding to the overexposed image area and the underexposed image area in the captured image separately, thereby improving the dynamic range of a single-frame image without additionally setting a variable aperture, solving the problem of being unable to improve the dynamic range of a single-frame image without affecting the optical quality of the camera module.

[0098] In some embodiments of the present application, when the light transmittance of at least two liquid crystal components corresponding to at least two pixel units is an initial transmittance, the exposure parameter range of the first image is determined according to the first exposure parameter, including: when the light transmittance of at least two liquid crystal components is the initial transmittance, controlling at least two pixel units to capture the first image; obtaining the first exposure parameter for capturing the first image; determining the exposure parameter range based on the exposure state of each image area in the first image and the first exposure parameter; wherein the exposure state includes at least one of the following: an overexposed state and an underexposed state.

[0099] In an embodiment of the present application, the first image is an image captured by the camera module according to the initial first exposure parameter before the light transmittance of the filter is adjusted. After the first image is captured, the first image is transmitted to the image processor of the electronic device, and the image processor can divide the first image into multiple image areas and identify the exposure states corresponding to the multiple image areas. According to the exposure state and the actual first exposure parameter, the exposure parameter range can be calculated. Since multiple image areas of the captured first image are counted, and the corresponding exposure parameter range is determined based on the exposure state and the first exposure parameter of the multiple image areas, the exposure parameter range can cover the exposure parameters of each pixel module that captures the first image, ensuring that the exposure parameter range can cover the maximum exposure parameter and the minimum exposure parameter used when the first image is captured to achieve the best exposure, thereby improving the accuracy of determining the exposure parameter range.

[0100] It should be noted that the image area is an image area divided according to actual needs for the captured first image, each image area includes at least one pixel unit, and the number of pixel units included in each image area may be the same or different.

[0101] In the embodiment of the present application, a corresponding exposure value range is set for the exposure state according to actual needs, for example, a brightness value range is set, and when it is detected that the brightness value of the image area is greater than the maximum value of the brightness value range, it is determined that the image area is in an overexposed state, and when it is detected that the brightness of the image area is less than the minimum value of the brightness value range, it is determined that the image area is in an underexposed state. When the brightness value of the image area is within the brightness value range, it is determined that the image area is neither in an overexposed state nor in an underexposed state, that is, the image area is in a normal exposure state.

[0102] Fig.13a is a schematic diagram of capturing images provided in some embodiments of the present application, such as Fig.13a As shown, exemplarily, the electronic device can divide the captured first image into multiple areas, and the multiple areas are arranged in a 12×8 array, with a total of 96 areas, and the exposure status of each image area is detected separately to determine whether there is an overexposed image area 1302 or an underexposed image area 1304 in the captured first image.

[0103] In some embodiments of the present application, based on the exposure state and the first exposure parameter of each image area of ​​the first image, determining the exposure parameter range includes: reducing the parameter value of the first exposure parameter of the overexposed image area in the first image, wherein the overexposed image area is in an overexposed state and the average brightness value of the overexposed image area is greater than the maximum value of the reference brightness range; in a case where the average brightness value of the overexposed image area is updated from being greater than the maximum value of the reference brightness range to being within the reference brightness range, determining the first exposure parameter after the parameter value is reduced as the second exposure parameter; increasing the parameter value of the first exposure parameter of the underexposed image area in the first image, wherein the underexposed image area is in an underexposed state and the average brightness value of the underexposed image area is less than the minimum value of the reference brightness range; in a case where the average brightness value of the underexposed image area is updated from being less than the minimum value of the reference brightness range to being within the reference brightness range, determining the first exposure parameter after the parameter value is increased as the third exposure parameter; determining the minimum value of the second exposure parameters of all the overexposed image areas in the first image as the minimum value of the exposure parameter range, and determining the maximum value of the third exposure parameters of all the underexposed image areas in the first image as the maximum value of the exposure parameter range.

[0104] In the embodiment of the present application, the overexposed image area is an image area in an overexposed state, and at this time, the parameter value of the first exposure parameter of the overexposed image area needs to be reduced until a normal exposure effect is achieved. The underexposed image area is an image area in an underexposed state, and at this time, the parameter value of the first exposure parameter of the underexposed image area needs to be increased until a normal exposure effect is achieved.

[0105] In the embodiment of the present application, the average brightness value in each image area is detected. If the average brightness value in the image area is less than the minimum value of the reference brightness range, the image area is determined to be an underexposed image area. If the average brightness value in the image area is greater than the maximum value of the reference brightness range, the image area is determined to be an overexposed image area.

[0106] For example, the electronic device can divide the captured first image into multiple regions, wherein each region may be an overexposed image region or an underexposed image region, and the number of pixel units in each region is at least one, and the number of pixel units in different regions may be the same or different. Fig.13aAs shown, the number of overexposed image areas in the image ranges from 0 to 96, the number of underexposed image areas ranges from 0 to 96, and the maximum sum of the number of underexposed image areas and overexposed image areas is 96. It should be noted that by comparing the brightness value of the image area with the reference brightness range, it is possible to determine whether the image area is an overexposed image area or an underexposed image area, that is, when the brightness value of the image area is greater than the maximum value of the reference brightness range, the image area is determined to be an overexposed image area, and when the brightness value of the image area is less than the minimum value of the reference brightness range, the image area is determined to be an underexposed image. For example: Fig.13a As shown, there are 34 overexposed image regions 1302 and 32 underexposed image regions 1304 among the 96 image regions.

[0107] In the embodiment of the present application, in the process of adjusting the parameter value of the first exposure parameter of the overexposed image area, the brightness value of the overexposed image area in the adjustment process is continuously detected. When it is detected that the brightness value of the overexposed image area drops to a reference brightness range, it is determined that the overexposed image area is currently in a normal exposure state, and the first exposure parameter after the parameter value is reduced is recorded as the second exposure parameter. In the embodiment of the present application, in the process of adjusting the parameter value of the first exposure parameter of the underexposed image area, the brightness value of the underexposed image area in the adjustment process is continuously detected. When it is detected that the brightness value of the underexposed image area rises to a reference brightness range, it is determined that the overexposed image area is currently in a normal exposure state, and the first exposure parameter after the parameter value is increased is recorded as the third exposure parameter. In the embodiment of the present application, since the number of overexposed image areas may be multiple, and the number of underexposed image areas may also be multiple, multiple second exposure parameters and multiple third exposure parameters can be obtained. The maximum value of the multiple second exposure parameters is used as the maximum value of the exposure parameter range, and the minimum value of the multiple third exposure parameters is used as the minimum value of the exposure parameter range. It should be noted that after determining the maximum value and the minimum value of the exposure parameter range, the dynamic range of the shooting scene in which the first image is shot can be calculated.

[0108] Exemplarily, after reducing the parameter value of the first exposure parameter of 34 overexposed image areas, 34 corresponding second exposure parameters are obtained, including: 12 second exposure parameters with an exposure gain of 5xgain and an exposure time of 10ms, and 22 second parameters with an exposure gain of 3xgain and an exposure time of 5ms. After reducing the parameter value of the first exposure parameter of 34 overexposed image areas, 34 corresponding second exposure parameters are obtained, including: 12 second exposure parameters with an exposure gain of 5xgain and an exposure time of 10ms, and 22 second parameters with an exposure gain of 3xgain and an exposure time of 5ms. The maximum value among the second exposure parameters is counted as the maximum value of the exposure parameter range, that is, the exposure gain of 5xgain and the exposure time of 10ms are taken as the maximum value of the exposure parameter range, and the minimum value among the plurality of third exposure parameters is counted as the minimum value of the exposure parameter range, that is, the exposure gain of 1xgain and the exposure time of 1ms are taken as the minimum value of the exposure parameter range. For example, the exposure gain in the maximum value of the exposure parameter range is 5xgain, the exposure time is 10ms, the exposure gain in the minimum value of the exposure parameter range is 1xgian, the exposure time is 1ms, and the dynamic range of the camera module itself is 48dB. Then the scene dynamic range is as follows (2):

[0109] 48dB+20Log((5 / 1)×(10 / 1))=48dB+33.9dB=81.9dB; (2)

[0110] In the embodiment of the present application, by extracting an overexposed image area in an overexposed state in the first image and reducing the parameter value of the first exposure parameter of the overexposed image area, multiple second exposure parameters can be determined, and the maximum value of the multiple second exposure parameters is determined as the maximum value of the exposure parameter; and by extracting an underexposed image area in an underexposed state in the first image and increasing the first exposure parameters of multiple pixel modules corresponding to the underexposed image area, multiple third exposure parameters can be determined, and the minimum value of the multiple third exposure parameters is determined as the minimum value of the exposure parameter, thereby improving the accuracy of determining the exposure parameter range and improving the matching between the exposure parameter range finally calculated and the scene dynamic range of the shooting scene.

[0111] In some embodiments of the present application, the initial transmittance ranges from 40% to 80%.

[0112] In the embodiment of the present application, by setting the amplitude range of the initial transmittance to be greater than or equal to 40% and less than or equal to 80%, the initial transmittance can be adjusted both downward and upward, thereby increasing the adjustable range of the photosensitivity of each pixel module.

[0113] Fig.14 is a schematic diagram of the structure of the filter provided in some embodiments of the present application, such as Fig.13a and Fig.14 As shown, exemplarily, the filter 120 in each pixel unit includes three liquid crystal structures 132, which respectively cover the area 1 1402, area 2 1404 and area 3 1406 of the filter, and diffraction components are arranged on area 2 1404 and area 3 1406. Area 1 1402, area 2 1404 and area 3 1406 have the same area ratio on the filter, and can diffract light to adjacent photosensitive elements. The captured image is divided into 12×8 areas, and there is at least one pixel unit in each area. The specific examples are as follows:

[0114] like Fig.13a and Fig.14 As shown, when there is an underexposed image area 1304 in the first image, it is necessary to increase the sensitivity of the pixel unit in the area, that is, to increase the light transmittance of the filter in the pixel unit in the area. Among them, the sensitivity value of the pixels in the underexposed image area 1304 is 200 LSB under the first exposure parameter, and at the maximum value of the exposure parameter range, the sensitivity value of the pixels in the underexposed image area 1304 is 300 LSB, then it is determined that the pixels in the underexposed image area 1304 need to increase the amount of light by 50% to allow the shadow area to be normally exposed. When operating under the first exposure parameter, area 1 1402 of the filter is opaque, and area 2 1404 and area 3 1406 are transparent. At this time, it is necessary to control area 1 1402 to switch from an opaque state to a transparent state. When the liquid crystal structure of area 1402 is in an opaque state, the voltage at the control electrode of the liquid crystal structure connected to the electric control driving unit is 2.8V. At this time, the voltage at the control electrode is adjusted from 2.8V to 0V, and the liquid crystal structure of area 1402 is switched from the opaque state to the transparent state, and the pixels in the underexposed image area 1304 can reach a normal exposure level. Fig.13b is a schematic diagram of capturing images provided in some embodiments of the present application, such as Fig.13b As shown, there is no underexposure problem in the adjusted first image 1306.

[0115] like Fig.13aAs shown, when there is an overexposed image area 1302 in the first image, it is necessary to reduce the sensitivity of the pixel unit in the area, that is, reduce the light transmittance of the filter in the pixel unit in the area. Among them, the sensitivity value of the pixels in the overexposed image area 1302 is 900 LSB under the first exposure parameter, and at the maximum value of the exposure parameter range, the sensitivity value of the pixels in the overexposed image area 1302 is 450 LSB, then it is determined that the pixels in the overexposed image area 1302 need to reduce the amount of light entering by 50% in order to allow the overexposed image area to be normally exposed. When operating under the first exposure parameter, area 1 1402 of the filter is opaque, and area 2 1404 and area 3 1406 are translucent. At this time, it is necessary to control area 2 1404 to switch from a translucent state to a non-translucent state. When the liquid crystal structure of the second region 1404 is in the light-transmitting state, the voltage at the control electrode of the electronically controlled driving unit connected to the liquid crystal structure is 0v. At this time, the voltage at the control electrode is adjusted from 0v to 2.8v, and the liquid crystal structure of the second region 1404 switches from the light-transmitting state to the light-impermeable state, and the pixels in the overexposed image region 1302 can reach the normal exposure level. Fig.13b As shown, there is no overexposure problem in the adjusted first image 1306.

[0116] The image acquisition method provided in the embodiment of the present application can be executed by an image acquisition device. In the embodiment of the present application, an image acquisition device executing the image acquisition method is taken as an example to illustrate the image acquisition method provided in the embodiment of the present application.

[0117] In some embodiments of the present application, an image acquisition device is provided, which is applied to the wireless device in any of the above embodiments. Fig.15 is a structural block diagram of an image acquisition device provided in some embodiments of the present application, such as Fig.15 As shown, the image acquisition device 1500 includes:

[0118] A determination module 1502, configured to determine an exposure parameter range of a first image according to a first exposure parameter when the light transmittance of at least two liquid crystal components corresponding to at least two pixel units is an initial transmittance;

[0119] The determination module 1502 is further used to determine at least two transmittance adjustment values ​​corresponding to at least two liquid crystal components according to the exposure parameter range;

[0120] An adjustment module 1504, configured to adjust the transmittance of at least two liquid crystal components according to at least two transmittance adjustment values;

[0121] The control module 1506 is used to control at least two pixel units to capture a second image according to the first exposure parameter.

[0122] In the embodiment of the present application, the camera module includes a plurality of pixel units, and a photosensitive element and a filter with a liquid crystal component are separately provided in each pixel unit. The light transmittance of the filter in each pixel unit can be controlled separately through the liquid crystal component, and the photosensitivity of each pixel unit can be adjusted separately. In the process of capturing images by the camera module, the control parameters of the liquid crystal component corresponding to each pixel unit can be generated according to the brightness of the captured scene, and the photosensitivity of each pixel unit can be adjusted separately, so as to control the amount of light entering the pixel units corresponding to the overexposed image area and the underexposed image area in the captured image separately, thereby improving the dynamic range of a single-frame image without additionally setting a variable aperture, solving the problem of being unable to improve the dynamic range of a single-frame image without affecting the optical quality of the camera module.

[0123] In some embodiments of the present application, the image acquisition device 1500 further includes:

[0124] An acquisition module, used to acquire a first exposure parameter for capturing a first image;

[0125] The determination module 1502 is further configured to determine an exposure parameter range based on the exposure state of each image region in the first image and the first exposure parameter;

[0126] The exposure state includes at least one of the following: an overexposed state and an underexposed state.

[0127] In an embodiment of the present application, the first image is an image captured by the camera module according to the initial first exposure parameter before the light transmittance of the filter is adjusted. After the first image is captured, the first image is transmitted to the image processor of the electronic device, and the image processor can divide the first image into multiple image areas and identify the exposure states corresponding to the multiple image areas. According to the exposure state and the actual first exposure parameter, the exposure parameter range can be calculated. Since multiple image areas of the captured first image are counted, and the corresponding exposure parameter range is determined based on the exposure state and the first exposure parameter of the multiple image areas, the exposure parameter range can cover the exposure parameters of each pixel module that captures the first image, ensuring that the exposure parameter range can cover the maximum exposure parameter and the minimum exposure parameter used when the first image is captured to achieve the best exposure, thereby improving the accuracy of determining the exposure parameter range.

[0128] In some embodiments of the present application, the adjustment module 1504 is further configured to reduce a parameter value of a first exposure parameter of an overexposed image region in the first image, wherein the overexposed image region is in an overexposed state, and an average brightness value of the overexposed image region is greater than a maximum value of a reference brightness range;

[0129] The determination module 1502 is further configured to determine the first exposure parameter after the parameter value is reduced as the second exposure parameter when the average brightness value of the overexposed image area is updated from being greater than the maximum value of the reference brightness range to being within the reference brightness range;

[0130] The adjustment module 1504 is further configured to increase a parameter value of a first exposure parameter of an underexposed image region in the first image, wherein the underexposed image region is in an underexposed state and an average brightness value of the underexposed image region is less than a minimum value of a reference brightness range;

[0131] The determination module 1502 is further configured to determine the first exposure parameter after the parameter value is increased as the third exposure parameter when the average brightness value of the underexposed image area is updated from being less than the minimum value of the reference brightness range to being within the reference brightness range;

[0132] The determination module 1502 is further used to determine the minimum value of the second exposure parameters of all overexposed image areas in the first image as the minimum value of the exposure parameter range, and to determine the maximum value of the third exposure parameters of all underexposed image areas in the first image as the maximum value of the exposure parameter range.

[0133] In the embodiment of the present application, by extracting an overexposed image area in an overexposed state in the first image and reducing the parameter value of the first exposure parameter of the overexposed image area, multiple second exposure parameters can be determined, and the maximum value of the multiple second exposure parameters is determined as the maximum value of the exposure parameter; and by extracting an underexposed image area in an underexposed state in the first image and increasing the first exposure parameters of multiple pixel modules corresponding to the underexposed image area, multiple third exposure parameters can be determined, and the minimum value of the multiple third exposure parameters is determined as the minimum value of the exposure parameter, thereby improving the accuracy of determining the exposure parameter range and improving the matching between the exposure parameter range finally calculated and the scene dynamic range of the shooting scene.

[0134] In some embodiments of the present application, the initial transmittance ranges from 40% to 80%.

[0135] In the embodiment of the present application, by setting the amplitude range of the initial transmittance to be greater than or equal to 40% and less than or equal to 80%, the initial transmittance can be adjusted both downward and upward, thereby increasing the adjustable range of the photosensitivity of each pixel module.

[0136] The image acquisition device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0137] Optionally, an embodiment of the present application further provides an electronic device, which includes an image acquisition device as in any of the above embodiments, and thus has all the beneficial effects of the image acquisition device in any of the embodiments, which will not be elaborated herein.

[0138] Optionally, an embodiment of the present application further provides an electronic device, Fig.16 is a structural block diagram of an electronic device according to an embodiment of the present application, such as Fig.16 As shown, the electronic device 1600 includes a processor 1602, a memory 1604, and a program or instruction stored in the memory 1604 and executable on the processor 1602. When the program or instruction is executed by the processor 1602, each process of the above-mentioned image acquisition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0139] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0140] Fig.17 It is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0141] The electronic device 1700 includes but is not limited to: a radio frequency unit 1701, a network module 1702, an audio output unit 1703, an input unit 1704, a sensor 1705, a display unit 1706, a user input unit 1707, an interface unit 1708, a memory 1709 and a processor 1710 and other components.

[0142] Those skilled in the art will appreciate that the electronic device 1700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.17 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0143] The processor 1710 is configured to determine an exposure parameter range of the first image according to the first exposure parameter when the light transmittance of at least two liquid crystal components corresponding to at least two pixel units is the initial transmittance;

[0144] The processor 1710 is used to determine at least two transmittance adjustment values ​​corresponding to at least two liquid crystal components according to the exposure parameter range;

[0145] The processor 1710 is used to adjust the transmittance of at least two liquid crystal components according to at least two transmittance adjustment values;

[0146] The processor 1710 is used to control at least two pixel units to capture a second image according to the first exposure parameter.

[0147] In the embodiment of the present application, the camera module includes a plurality of pixel units, and a photosensitive element and a filter with a liquid crystal component are separately provided in each pixel unit. The light transmittance of the filter in each pixel unit can be controlled separately through the liquid crystal component, and the photosensitivity of each pixel unit can be adjusted separately. In the process of capturing images by the camera module, the control parameters of the liquid crystal component corresponding to each pixel unit can be generated according to the brightness of the captured scene, and the photosensitivity of each pixel unit can be adjusted separately, so as to control the amount of light entering the pixel units corresponding to the overexposed image area and the underexposed image area in the captured image separately, thereby improving the dynamic range of a single-frame image without additionally setting a variable aperture, solving the problem of being unable to improve the dynamic range of a single-frame image without affecting the optical quality of the camera module.

[0148] Further, the processor 1710 is used to obtain a first exposure parameter for capturing a first image;

[0149] Processor 1710, configured to determine an exposure parameter range based on an exposure state of each image region in the first image and a first exposure parameter;

[0150] The exposure state includes at least one of the following: an overexposed state and an underexposed state.

[0151] In an embodiment of the present application, the first image is an image captured by the camera module according to the initial first exposure parameter before the light transmittance of the filter is adjusted. After the first image is captured, the first image is transmitted to the image processor of the electronic device, and the image processor can divide the first image into multiple image areas and identify the exposure states corresponding to the multiple image areas. According to the exposure state and the actual first exposure parameter, the exposure parameter range can be calculated. Since multiple image areas of the captured first image are counted, and the corresponding exposure parameter range is determined based on the exposure state and the first exposure parameter of the multiple image areas, the exposure parameter range can cover the exposure parameters of each pixel module that captures the first image, ensuring that the exposure parameter range can cover the maximum exposure parameter and the minimum exposure parameter used when the first image is captured to achieve the best exposure, thereby improving the accuracy of determining the exposure parameter range.

[0152] Further, the processor 1710 is configured to reduce a parameter value of a first exposure parameter of an overexposed image region in the first image, wherein the overexposed image region is in an overexposed state, and an average brightness value of the overexposed image region is greater than a maximum value of a reference brightness range;

[0153] Processor 1710, configured to determine the first exposure parameter after the parameter value is reduced as the second exposure parameter when the average brightness value of the overexposed image area is updated from being greater than the maximum value of the reference brightness range to being within the reference brightness range;

[0154] Processor 1710 is configured to increase a parameter value of a first exposure parameter of an underexposed image region in a first image, wherein the underexposed image region is in an underexposed state and an average brightness value of the underexposed image region is less than a minimum value of a reference brightness range;

[0155] Processor 1710, configured to determine the first exposure parameter after the parameter value is increased as the third exposure parameter when the average brightness value of the underexposed image area is updated from being less than the minimum value of the reference brightness range to the average brightness value of the underexposed image area being within the reference brightness range;

[0156] Processor 1710 is used to determine the minimum value of the second exposure parameters of all overexposed image areas in the first image as the minimum value of the exposure parameter range, and determine the maximum value of the third exposure parameters of all underexposed image areas in the first image as the maximum value of the exposure parameter range.

[0157] In the embodiment of the present application, by extracting an overexposed image area in an overexposed state in the first image and reducing the parameter value of the first exposure parameter of the overexposed image area, multiple second exposure parameters can be determined, and the maximum value of the multiple second exposure parameters is determined as the maximum value of the exposure parameter; and by extracting an underexposed image area in an underexposed state in the first image and increasing the first exposure parameters of multiple pixel modules corresponding to the underexposed image area, multiple third exposure parameters can be determined, and the minimum value of the multiple third exposure parameters is determined as the minimum value of the exposure parameter, thereby improving the accuracy of determining the exposure parameter range and improving the matching between the exposure parameter range finally calculated and the scene dynamic range of the shooting scene.

[0158] In some embodiments of the present application, the initial transmittance ranges from 40% to 80%.

[0159] In the embodiment of the present application, by setting the amplitude range of the initial transmittance to be greater than or equal to 40% and less than or equal to 80%, the initial transmittance can be adjusted both downward and upward, thereby increasing the adjustable range of the photosensitivity of each pixel module.

[0160] It should be understood that in the embodiment of the present application, the input unit 1704 may include a graphics processor (GPU) 17041 and a microphone 17042, and the graphics processor 17041 processes the image data of the static picture or action file obtained by the image capture device (such as a camera) in the action file capture mode or the image capture mode. The display unit 1706 may include a display panel 17061, and the display panel 17061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1707 includes a touch panel 17071 and at least one of other input devices 17072. The touch panel 17071 is also called a touch screen. The touch panel 17071 may include two parts: a touch detection device and a touch controller. Other input devices 17072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0161] The memory 1709 can be used to store software programs and various data. The memory 1709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1709 may include a volatile memory or a non-volatile memory, or the memory 1709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0162] The processor 1710 may include one or more processing units; optionally, the processor 1710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1710.

[0163] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0164] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0165] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0166] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0167] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image acquisition method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0168] It should be noted that, in this article, the term "comprises", "includes" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, device, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or device. In the absence of further restrictions, an element defined by the statement "includes one..." does not exclude the presence of other identical elements in the process, device, article or device including the element. In addition, it should be noted that the scope of the devices and apparatuses in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described device may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0169] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment device can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), including a number of instructions for a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) to execute the device of each embodiment of the present application.

[0170] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A camera module, characterized in that: include: At least two pixel units, each pixel unit comprising: Photosensitive element; A filter, arranged at the light incident end of the photosensitive element; The liquid crystal component is arranged on the light incident side of the filter, and the liquid crystal component is used to adjust the light transmittance of the filter.

2. The camera module according to claim 1, characterized in that: The filter comprises at least two filter regions, and the liquid crystal component comprises: At least two liquid crystal structures are arranged flat on the filter, and each filter area corresponds to a liquid crystal structure; At least two electrically controlled driving units are electrically connected to at least two of the liquid crystal structures, and the electrically controlled driving units are used to adjust the polarization states of the liquid crystal structures; The polarization state includes a first polarization state and a second polarization state. When the liquid crystal structure is in the first polarization state, the liquid crystal structure is in a light-transmitting state. When the liquid crystal structure is in the second polarization state, the liquid crystal structure is in an opaque state.

3. The camera module according to claim 2, characterized in that: The liquid crystal assembly further comprises: A polarizer, disposed on the filter; A polarization polarizer is arranged on the light incident side of the analyzer, and the at least two liquid crystal structures are arranged between the analyzer and the polarization polarizer, wherein the polarization direction of the polarization polarizer is perpendicular to the polarization direction of the analyzer.

4. The camera module according to any one of claims 1 to 3, characterized in that: The filter includes a first area and a second area, the second area is an area on the filter except the first area, and the pixel unit further includes: A diffraction component is arranged in the first area of ​​the filter, and is used to diffract the light entering the diffraction component to the photosensitive element in the adjacent pixel unit, and the distance between the adjacent pixel unit and the first area is smaller than the distance between the adjacent pixel unit and the second area.

5. The camera module according to claim 4, characterized in that: The diffraction component comprises: The nano-metal rods are arranged at intervals in the first region of the filter to form a diffraction grating in the first region, and the spacing between two adjacent nano-metal rods is proportional to the wavelength of the light incident on the filter.

6. The camera module according to claim 4, characterized in that: The first region is disposed on a peripheral side of the second region, or the first region is disposed on one side of the second region, or the first region is disposed on both sides of the second region.

7. An electronic device, characterized in that: A camera module comprising any one of claims 1 to 6.

8. An image acquisition method, executed by the electronic device according to claim 7, characterized in that: The image acquisition method comprises: When the light transmittance of at least two liquid crystal components corresponding to at least two pixel units is the initial transmittance, determining the exposure parameter range of the first image according to the first exposure parameter; Determining at least two transmittance adjustment values ​​corresponding to the at least two liquid crystal components according to the exposure parameter range; adjusting the transmittance of the at least two liquid crystal components according to the at least two transmittance adjustment values; According to the first exposure parameter, the at least two pixel units are controlled to capture a second image.

9. The image acquisition method according to claim 8, characterized in that: The step of determining the exposure parameter range of the first image according to the first exposure parameter when the light transmittance of the at least two liquid crystal components corresponding to the at least two pixel units is the initial transmittance includes: When the light transmittance of at least two of the liquid crystal components is the initial transmittance, controlling at least two of the pixel units to capture a first image; Acquire the first exposure parameter for capturing the first image; determining the exposure parameter range based on the exposure state of each image area in the first image and the first exposure parameter; The exposure state includes at least one of the following: an overexposed state and an underexposed state.

10. The image acquisition method according to claim 9, characterized in that: The determining the exposure parameter range based on the exposure state of each image area in the first image and the first exposure parameter includes: reducing a parameter value of the first exposure parameter of an overexposed image area in the first image, wherein the overexposed image area is in an overexposed state, and an average brightness value in the overexposed image area is greater than a maximum value of a reference brightness range; When the average brightness value of the overexposed image area is updated from a maximum value greater than the reference brightness range to within the reference brightness range, the first exposure parameter after the parameter value is reduced is determined as the second exposure parameter; increasing a parameter value of the first exposure parameter of an underexposed image area in the first image, wherein the underexposed image area is in an underexposed state, and an average brightness value of the underexposed image area is less than a minimum value of the reference brightness range; When the average brightness value of the underexposed image area in the first image is updated from a value less than the minimum value of the reference brightness range to a value within the reference brightness range, the first exposure parameter after the parameter value is increased is determined as the third exposure parameter; The minimum value of the second exposure parameters of all overexposed image areas in the first image is determined as the minimum value of the exposure parameter range, and the maximum value of the third exposure parameters of all underexposed image areas in the first image is determined as the maximum value of the exposure parameter range.

11. The image acquisition method according to any one of claims 8 to 10, characterized in that: The initial transmittance has a value range of 40% to 80%.

Images