Image sensor, electronic device and image acquisition method

Abstract

The present application belongs to the technical field of image sensors. Disclosed are an image sensor, an electronic device and an image acquisition method. The image sensor comprises: a pixel array, the pixel array comprising a plurality of columns of pixel components, wherein each column of pixel components comprises a plurality of pixel components, each pixel component comprising a capacitive component, each capacitive component being configured as a fixed-gain module or an adjustable-gain module of the corresponding pixel component, the gain value of the fixed-gain modules being fixed, and the gain value of the adjustable-gain modules being variable; a switch array, wherein the switch array comprises a plurality of columns of first switch groups, the plurality of columns of first switch groups corresponding to the plurality of columns of pixel components on a one-to-one basis, and one first switch group being correspondingly provided between the capacitive components of any two adjacent pixel components in each column of pixel components; a gain programming module connected to each switch array; and a row driving module connected to the pixel array.

Description

Image sensors, electronic devices and image acquisition methods

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510372343.9, filed on March 27, 2025, entitled "Image Sensor, Electronic Device and Image Acquisition Method", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of image sensor technology, specifically relating to an image sensor, electronic device, and image acquisition method. Background Technology

[0004] In complementary metal-oxide-semiconductor (CMOS) image sensors (CIS), dynamic range is typically adjusted by changing the exposure time of all pixels and the overall pixel signal gain. The modulation effect of High Dynamic Range (HDR) is altered by changing the exposure time and the output signal gain.

[0005] When using HDR technology related to Intra-Pixel Gain (CG), since current pixels are only equipped with Dual Conversion Gain (DCG) or Triple Conversion Gain (TCG) technology, the dynamic range of the pixel and CIS is determined by the number and size of CG under fixed exposure time and aperture. Since the number and size of CG are fixed and cannot be adjusted, the native ISO (sensitivity) parameter of the CIS is fixed. It is necessary to use back-end analog gain and digital gain to amplify the output pixel signal. Furthermore, since analog gain and digital gain do not have the effect of noise reduction, the captured image has obvious noise and low image quality.

[0006] Application content

[0007] The purpose of this application is to provide an image sensor, electronic device, and image acquisition method that solves the problems of fixed native ISO parameters of the image sensor due to fixed intra-pixel gain parameters, and significant image noise and low image quality caused by using analog and digital gain to amplify the output pixel signal.

[0008] In a first aspect, embodiments of this application provide an image sensor, comprising: a pixel array, the pixel array including multiple columns of pixel components, each column of pixel components including multiple pixel components, each pixel component including: a capacitive component, each capacitive component being configured as a fixed gain module or an adjustable gain module of the pixel component, the gain value of the fixed gain module being fixed, and the gain value of the adjustable gain module being variable; a switch array, the switch array including multiple columns of first switch groups, the multiple columns of first switch groups being configured one-to-one with the multiple columns of pixel components, and a first switch group being configured between the capacitive components of any two adjacent pixel components in each column of pixel components; a gain programming module connected to each switch array, the gain programming module being used to control the number of first switch groups in each column of first switch groups being in the on state, so as to adjust the gain value of the adjustable gain module in the pixel component corresponding to each column of first switch groups; and a row driving module connected to the pixel array, the row driving module being used to control the pixel array to output pixel signals sequentially through the fixed gain value of the fixed gain module and the adjustable gain value of the adjustable gain module.

[0009] Secondly, embodiments of this application provide an electronic device, including: a body; and an image sensor as described in any of the above technical solutions, wherein the image sensor is disposed on the body.

[0010] Thirdly, embodiments of this application provide an image acquisition method, applied to the electronic device in any of the above-mentioned technical solutions. The image acquisition method includes: performing a reset operation on the current row of pixel components when the previous row of pixel components has completed a reset operation and started an exposure operation; performing a gain setting operation on the current row of pixel components when the current row of pixel components has completed an exposure operation to set a target gain value in a gain value set, the gain value set including all gain values ​​corresponding to a fixed gain module and an adjustable gain module; performing a read operation on the current row of pixel components according to the target gain value, and returning to perform a gain setting operation on the current row of pixel components through a gain programming module until the read operation is completed according to each gain value in the gain value set.

[0011] In this embodiment, multiple column pixel components are arranged in the pixel array, and each pixel component includes a capacitive component. The capacitive component is configured as a fixed gain module or an adjustable gain module within the pixel component. The capacitive components in two adjacent rows of pixel components are connected through a first switch group. The number of connections between the capacitive components of the pixel component that outputs the pixel signal and the capacitive components of other pixel components is selected by the gain programming module, thereby adjusting the adjustable gain value of the adjustable gain module. This allows the adjustable gain module to set an adjustable gain value according to the user's actual needs, thereby making the native ISO parameter of the image sensor adjustable. This solves the problem of fixed native ISO parameters of the image sensor caused by fixed gain parameters within pixels, and the problem of significant image noise and low image quality caused by using analog gain and digital gain to amplify the output pixel signal. Attached Figure Description

[0012] Figure 1 shows one of the schematic diagrams of the image sensor architecture provided in some embodiments of this application;

[0013] Figure 2 shows a structural block diagram of a pixel component provided in some embodiments of this application;

[0014] Figure 3 shows a second schematic diagram of the architecture of the image sensor provided in some embodiments of this application;

[0015] Figure 4 shows one of the circuit diagrams of the pixel component provided in some embodiments of this application;

[0016] Figure 5 shows a third schematic diagram of the architecture of the image sensor provided in some embodiments of this application;

[0017] Figure 6 shows a second circuit diagram of a pixel component provided in some embodiments of this application;

[0018] Figure 7a shows one of the schematic diagrams illustrating the relationship between the ratio of gain values ​​and the dynamic range of signal-to-noise ratio provided in some embodiments of this application;

[0019] Figure 7b shows a second schematic diagram illustrating the relationship between the ratio of gain values ​​and the dynamic range of signal-to-noise ratio provided in some embodiments of this application;

[0020] Figure 8 shows a third circuit diagram of a pixel component provided in some embodiments of this application;

[0021] Figure 9 shows a timing diagram of the image sensor provided in some embodiments of this application during one frame.

[0022] Figure 10 shows a schematic diagram of the structure of an electronic device provided in some embodiments of this application;

[0023] Figure 11 shows a flowchart of an image acquisition method provided in some embodiments of this application.

[0024] The reference numerals in Figures 1 to 10 are as follows: 10 Image sensor, 100 Pixel array, 110 Pixel assembly, 111 Capacitive assembly, 1112 Second switch group, 112 Fixed gain module, 1121 First fixed module, 1122 Second fixed module, 113 Adjustable gain module, 1131 First adjustable module, 1132 Second adjustable module, 114 Photosensitive unit, 115 Transmission unit, 116 Reset unit, 117 Readout unit, 120 Switch array, 121 First switch group, 130 Row drive module, 140 Gain programming module, 150 Column scan assembly, 160 Image signal processor, PPD photodiode, M TX Transmitter transistor, RST reset transistor, SF source follower, M SEL Output transistor, C FD First capacitive unit, C CG The second capacitive unit, M CG1 First switching element, M LCG Second switching element, M SLCG Third switch, M CG2 Fourth switch, M CG3 Fifth switching element, V DD Power supply, 200 electronic devices, 202 main body. Detailed Implementation

[0025] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0026] The terms "first" and "second" in the specification and claims of this application may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise stated, "multiple" means two or more. Furthermore, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0027] In the description of this application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc., indicating the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0028] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0029] The image sensor, electronic device, and image acquisition method provided in this application will be described in detail below with reference to Figures 1 to 11, through specific embodiments and application scenarios.

[0030] In some embodiments of this application, an image sensor is provided. Figure 1 shows one of the schematic diagrams of the image sensor architecture provided in some embodiments of this application. Figure 2 shows a structural block diagram of a pixel component provided in some embodiments of this application. Figure 3 shows another schematic diagram of the image sensor architecture provided in some embodiments of this application. Figure 4 shows one of the circuit diagrams of a pixel component provided in some embodiments of this application. Figure 5 shows a third schematic diagram of the image sensor architecture provided in some embodiments of this application. Figure 6 shows another circuit diagram of a pixel component provided in some embodiments of this application. As shown in Figures 1, 2, 3, 4, 5, and 6, the image sensor 10 includes: a pixel array 100, the pixel array 100 including multiple columns of pixel components 110, each column of pixel components 110 including multiple pixel components 110, each pixel component 110 including: a capacitive component 111, each capacitive component 111 being configured as a fixed gain module 1 of the pixel component 110. 12 or adjustable gain module 113, where the gain value of fixed gain module 112 is fixed and the gain value of adjustable gain module 113 is not fixed; switch array 120, which includes multiple columns of first switch groups 121, each column of first switch groups 121 corresponding to a column of pixel components 110, with a first switch group 121 corresponding to the capacitive components 111 of any two adjacent pixel components 110 in each column; gain programming module 140, connected to each switch array 120, used to control the number of first switch groups 121 in the on state in each column of first switch groups 121, so as to adjust the gain value of adjustable gain module 113 in the pixel component 110 corresponding to each column of first switch groups 121; row driving module 130, connected to pixel array 100, used to control pixel array 100 to output pixel signals sequentially through the fixed gain value of fixed gain module 112 and the adjustable gain value of adjustable gain module 113.

[0031] In Figure 2, the HCG and MCG modules are fixed gain modules 112, and the LCG and SLCG modules are adjustable gain modules 113.

[0032] In this embodiment of the application, the image sensor 10 is provided with a pixel array 100 including multiple columns of pixel components 110. Each column of pixel components 110 includes multiple pixel components 110. In the pixel array 100, the pixel components 110 are arranged in a rectangular array form, that is, the pixel array 100 includes at least two rows of pixel components 110, and the number of pixel components 110 in the at least two rows of pixel components 110 is equal.

[0033] Specifically, the image sensor 10 architecture employs an M×N pixel array 100, with a gain programming module 140 and a row driving module 130 positioned around the pixel array 100. The gain programming module 140 controls the first switch group 121 in each column of the switch array 120 in a row-parallel manner, thereby setting the adjustable gain module 113 within each column of pixels to program the gain of the adjustable gain module 113 in the pixel assembly 110. The control signals for the reset, exposure, and readout operations of the pixel assembly 110 are provided by the row driving module 130, which controls the pixel assembly 110 to perform actions row by row in a parallel manner.

[0034] For example, since the first switch group 121 is connected between the capacitive components 111 in two adjacent pixel components 110, when the gain programming module 140 controls the first switch group 121 between two adjacent pixel components 110 to be in the on state, the capacitive components 111 between the two adjacent pixels are in the connected state, thereby changing the adjustable gain value of the adjustable gain module 113 formed by the capacitive components 111. It should be noted that the row driving module 130 drives the pixel array 100 to output pixel signals row by row. Therefore, the gain programming module 140 can set the adjustable gain value of the adjustable gain module 113 of the pixel component 110 in each row according to the order of the output pixel signals in the independent time period of each row of the pixel array 100 outputting pixel signals.

[0035] In this embodiment, each pixel component 110 includes a capacitive component 111. The capacitive component 111 can be configured as a fixed-gain module 112 or an adjustable-gain module 113 within the pixel component 110. The gain value of the fixed-gain module 112 is fixed and cannot be adjusted, while the gain value of the adjustable-gain module 113 is not fixed and can be adjusted according to user needs. The fixed-gain module 112 is composed of fixed capacitive units within the capacitive component 111; that is, the gain parameter of the fixed-gain module 112 is determined by the capacitance value of the capacitive units within the capacitive component 111 and cannot be changed. The adjustable gain module 113 is formed by connecting the capacitive component 111 to the capacitive components 111 in other rows of pixel components 110 through the first switch group 121. The gain programming module 140 can control the number of capacitive components 111 in other rows connected to the capacitive component 111 in each row of pixel components 110, thereby changing the capacitance value of the capacitive component 111 when each row of pixel components 110 outputs a pixel signal, thus changing the adjustable gain value of the adjustable gain module 113.

[0036] The fixed gain module 112 and the adjustable gain module 113 share the same capacitive component 111 within the pixel assembly 110. The gain value of the fixed gain module 112 depends on the capacitance of the capacitive component 111 itself, while the gain value of the adjustable gain module 113 depends on the number of capacitive components 111 in other pixel assemblies 110 to which the capacitive component 111 in the pixel assembly 110 is connected by the gain programming module 140.

[0037] Specifically, in the pixel array 100, all adjustable gain modules 113 of each pixel component 110 in each column are electrically connected by wires, and the first switch group 121 is set on the wires. The control terminal of the controllable switch in the first switch group 121 is connected to the gain programming module 140. The gain programming module 140 controls the on / off state of the first switch group 121 by transmitting control signals to the first switch group 121, thereby adjusting the number of capacitive components 111 connected to the capacitive components 111 in the pixel component 110 and adjusting the gain value of the adjustable gain module 113.

[0038] In this embodiment of the application, the row driving module 130 is used to drive the pixel array 100. The row driving module 130 drives at least two rows of pixel components 110 in the pixel array 100 row by row, so that only one row of pixel components 110 is read at the same time.

[0039] In this embodiment, when reading the pixel signal of pixel component 110, pixel component 110 needs to be exposed and output the corresponding pixel signal sequentially according to fixed gain value and adjustable gain value. That is, the number of pixel signals output by each row of pixel component 110 is related to the number of gain values. Each row of pixel component 110 needs to generate pixel signal according to the gain value of fixed gain module 112 and the gain value of adjustable gain module 113. Moreover, the gain value of adjustable gain module 113 needs to reuse the capacitive components 111 in adjacent rows of pixel component 110. Therefore, by reading the pixel signal of pixel component 110 row by row by row through row driving module 130, it can be ensured that when reading the pixel signal of the current row of pixel component 110, the reused adjacent row of pixel component 110 does not need to output pixel signal, ensuring the stability of the gain value of adjustable gain module 113, thereby improving the signal quality of the pixel signal output by pixel component 110.

[0040] Specifically, the image sensor 10 employs a rolling shutter operation. Within one frame, each row of pixel components 110 has a separate readout period. Within this independent time period, the gain value of each pixel component 110 within the row is determined by the pixel programming module and the adjustable programming module.

[0041] For example, the pixel component 110 is read using a quad conversion gain (QCG) reading method, which includes two fixed gain values ​​and two adjustable gain values, and the four gain values ​​are all different. That is, one gain is used each time the data is read. After one row of pixel components 110 is read, the reading of the next row of pixel components 110 is performed until one frame of signal is read.

[0042] It is understandable that during the row driving module 130's row-by-row driving process, at least two rows of pixel components 110 can be driven to output pixel signals simultaneously. The pixel components 110 that output the pixel signals are spaced apart, so that the adjustable gain module 113 in the pixel component 110 that outputs the pixel signals can reuse the capacitive components 111 in the pixel components 110 of adjacent rows.

[0043] For example, the row driving module 130 can simultaneously drive two rows of pixel components 110 to output pixel signals, and the two rows of pixel components 110 driven at the same time are spaced four rows of pixel components 110 apart, so that each row of pixel components 110 can call the capacitors in the spaced four rows of pixel components 110.

[0044] In this embodiment, multiple columns of pixel components 110 are arranged in the pixel array 100, and each pixel component 110 includes a capacitive component 111. The capacitive component 111 is configured as a fixed gain module 112 or an adjustable gain module 113 within the pixel component 110. The capacitive components 111 in two adjacent rows of pixel components 110 are connected through a first switch group 121. The gain programming module 140 selects the number of connections between the capacitive components 111 of the pixel component 110 that outputs the pixel signal and the capacitive components 111 of other pixel components 110, thereby adjusting the adjustable gain value of the adjustable gain module 113. This allows the adjustable gain module 113 to set an adjustable gain value according to the user's actual needs, thereby making the native ISO parameter of the image sensor 10 adjustable. This solves the problem of fixed native ISO parameter of the image sensor 10 caused by fixed gain parameter within the pixel, and the problem of obvious image noise and low image quality caused by using analog gain and digital gain to amplify the output pixel signal.

[0045] As shown in Figures 3 and 5, the gain programming module 140 includes a first programmer and a second programmer, which are used to control the on / off states of different switches in the switch array 120, respectively.

[0046] As shown in Figure 2, in some embodiments of this application, each pixel component 110 has at least one fixed gain module 112, each pixel component 110 has at least two adjustable gain modules 113, and the sum of the number of fixed gain modules 112 and the number of adjustable gain modules 113 in each pixel component 110 is at least four.

[0047] In this embodiment, the number of gain values ​​used by the pixel component 110 when outputting pixel signals is related to the number of fixed gain modules 112 and adjustable gain modules 113 within the pixel component 110. That is, the number of fixed gain modules 112 is the same as the number of fixed gain values ​​of the pixel component 110, and the number of adjustable gain modules 113 is the same as the number of adjustable gain values.

[0048] In this embodiment, the fixed gain modules 112 within the pixel assembly 110 are all configured and formed by capacitive components 111. The number of fixed gain modules 112 can be adjusted by setting the number of capacitive units in the capacitive components 111.

[0049] For example, if the capacitive component 111 has one capacitive unit, and since the capacitance value of the capacitive unit is fixed, then the number of fixed gain modules 112 is one. If the capacitive component 111 has two capacitive units, then a single capacitive unit is configured as one fixed gain module 112, and two capacitive units are combined to form a fixed gain module 112.

[0050] In this embodiment, the adjustable gain module 113 within the pixel assembly 110 is formed by the capacitive components 111 of the pixel assembly 110 itself and the capacitive components 111 within the pixel assemblies 110 of other rows connected to the first switch group 121. Therefore, the number of adjustable gain modules 113 is the same as the number of connection ports of the capacitive components 111, and each connection port of the capacitive components 111 is connected to a switch in the first switch group 121. Therefore, the number of switches in the first switch group 121 is also the same as the number of adjustable gain modules 113.

[0051] For example, each capacitive component 111 includes two connection ports for connecting to a different number of other capacitive components 111 within pixel components 110. Specifically, for example, the gain programming module 140 controls one connection port of the capacitive component 111 to connect to one capacitive component 111 in another row, and controls another connection port of the capacitive component 111 to connect to two capacitive components 111 in other rows, thus forming two adjustable gain modules 113 with different adjustable gain values ​​within pixel component 110.

[0052] In this embodiment, the sum of the number of fixed gain modules 112 and the number of adjustable gain modules 113 is greater than or equal to four, which makes the number of gain values ​​in the pixel component 110 greater than or equal to four. This enables the pixel component 110 to achieve single-frame HDR shooting, and greatly expands the dynamic range while ensuring that the SNR curve has no breakpoints.

[0053] Figure 7a shows one schematic diagram of the relationship between the gain ratio and the dynamic range of the signal-to-noise ratio provided in some embodiments of this application, and Figure 7b shows another schematic diagram of the relationship between the gain ratio and the dynamic range of the signal-to-noise ratio provided in some embodiments of this application. As shown in Figures 7a and 7b, the dynamic range of the pixel component 110 and the image sensor 10 is determined by the number and magnitude of the gain values ​​under a fixed exposure time and aperture. As shown in Figure 7a, taking a DCG pixel as an example, if the ratio of HCG (high magnification CG) to LCG (low magnification CG) is not large, for example, taking LCG:HCG = 1:4, then its DCG-HDR signal-to-noise ratio (SNR) curve is continuous and uninterrupted. A continuous and uninterrupted SNR curve can maintain consistent image quality without abrupt changes under different brightness levels. The cost is that the total dynamic range of the HDR image is not high, generally not exceeding 90dB. If it is necessary to extend the dynamic range to, for example, above 100dB, the CG ratio needs to be increased, for example, taking LCG:HCG = 1:32. The cost is a drop in the SNR curve (SNR Dip). This drop in the SNR curve results in a sudden change in image quality in the final HDR image and affects the user experience.

[0054] In this embodiment of the application, the total number of gain modules is set to be greater than or equal to 4, which can avoid the problem that the maximum dynamic range cannot be extended to more than 100dB due to insufficient gain value when the pixel component 110 outputs pixel signal, or the image quality loss caused by excessively increasing the ratio between gain values.

[0055] For example, there are two fixed gain modules 112 and two adjustable gain modules 113. Specifically, the fixed gain module 112 includes a floating diffusion capacitor and an expansion capacitor. The floating diffusion capacitor can be used as a single fixed gain module 112, and the floating diffusion capacitor connected to the expansion capacitor can be used as another fixed gain module 112. The adjustable gain module 113 connects the floating diffusion capacitor and expansion capacitor in the current row of pixel components 110 with the floating diffusion capacitor and expansion capacitor in the adjacent row. The number of floating diffusion capacitors and expansion capacitors in the adjacent rows connected to the two adjustable gain modules 113 is set by the first switch group 121. One adjustable gain module 113 is adjusted to connect the floating diffusion capacitor and expansion capacitor in the pixel components 110 of other rows, and the other adjustable gain module 113 is connected to the floating diffusion capacitor and expansion capacitor in the pixel components 110 of other rows.

[0056] For example, there is one fixed gain module 112 and three adjustable gain modules 113.

[0057] In this embodiment, the number of fixed gain modules 112 is at least one, which avoids all gain modules in the pixel component 110 being adjustable gain modules 113, which helps to simplify and miniaturize the circuit design of the pixel component 110. In addition, the number of adjustable gain modules 113 is at least two, which can ensure the range of adjustable gain values ​​of the pixel component 110.

[0058] In some embodiments of this application, the fixed gain module 112 includes a first fixed module 1121 and a second fixed module 1122, wherein the gain values ​​of the first fixed module 1121 and the second fixed module 1122 are different; the capacitive component 111 includes: a first capacitive unit C FD Second capacitive unit C CG and the first switch M CG1 The first switch M CG1 Used to control the first capacitive unit C FD With the second capacitive unit C CG The on / off state; wherein, in the first switching element M CG1 When in the disconnected state, capacitive component 111 is configured as the first fixed module 1121; in the first switching element M CG1 When in the ON state, the capacitive component 111 is configured as the second fixed module 1122.

[0059] In this embodiment, there are two fixed gain modules 112, namely a first fixed module 1121 and a second fixed module 1122, and the gain values ​​of the first fixed module 1121 and the second fixed module 1122 are different. The capacitive component 111 includes a first capacitive unit C. FD Second capacitive unit C CG and set in the first capacitive unit C FD Second capacitive unit C CG The first switch M between CG1 First switch M CG1 When in the disconnected state, the first capacitive unit C FD With the second capacitive unit C CG When the two are disconnected, only the first capacitive unit C... FD As a fixed gain module 112. In the first switching element M CG1 When in the conducting state, the first capacitive unit C FD With the second capacitive unit C CG When the two are in a connected state, the first capacitive unit C... FD Second capacitive unit C CG The connected components together serve as a fixed gain module 112.

[0060] As shown in Figures 4 and 6, specifically for example: the first capacitive unit C FDFor floating diffusion capacitors, the second capacitive unit C CG This is the expansion capacitor corresponding to the floating diffusion capacitor, i.e., through the second capacitive unit C. CG Capable of the first capacitive unit C FD Expanding capacity. First capacitive unit C FD With the second capacitive unit C CG A first switch M is provided between them. CG1 The first switch M CG1 Used to control the first capacitive unit C FD With the second capacitive unit C CG The on / off state between the two, the first switching element M CG1 The control terminal is connected to the line drive module 130, meaning the line drive module 130 can control the second capacitive unit C. CG Is the first capacitive unit C... FD Expand the capacity. In the first capacitive unit C FD Without expansion, the first capacitive unit C FD Configured as the first fixed module 1121, in the first capacitive unit C FD Through the second capacitive unit C CG During expansion, the first capacitive unit C FD Second capacitive unit C CG It is configured as the second fixed module 1122.

[0061] In this embodiment, the fixed gain module 112 includes a first fixed module 1121 and a second fixed module 1122. A first capacitive unit C is then disposed within the capacitive component 111. FD Second capacitive unit C CG And the second capacitive unit C CG It can be used to expand the capacity of the first capacitive unit by controlling the first switching element M. CG1 The on / off state selection of the second capacitive unit C CG Is the first capacitive unit C... FD The capacity is expanded so that the first capacitive unit that has not been expanded is configured as the first fixed module 1121, and the first capacitive unit that has been expanded is configured as the second fixed module 1122.

[0062] As shown in Figures 1 and 4, in some embodiments of this application, the capacitive component 111 further includes a second switch group 1112, which is used to control the first capacitive unit C. FD The on / off state between the second switch group 1112 and the corresponding first switch group 121; wherein, when the second switch group 1112 is in the on state and the corresponding first switch group 121 is in the on state, the capacitive component 111 is configured as an adjustable gain module 113.

[0063] In this embodiment of the application, the capacitive component 111 includes components connected to the first capacitive unit C. FD The second switch group 1112, located between the first switch group 121 and the first switch group 121, is used to control the first capacitive unit C. FD When the capacitive component 111 needs to be configured as an adjustable gain module 113, the second switch group 1112 is controlled to be in the on state. At this time, the gain programming module 140 can set the adjustable gain value of the adjustable gain module 113 by controlling the on / off state of a series of first switch groups 121.

[0064] As shown in Figures 1, 2, and 4, the CG selection module includes a first switch M in the capacitive component 111. CG1 And the second switch group 1112.

[0065] Specifically, the gain programming module 140 controls the number of first switch groups 121 in the on state in a column of first switch groups 121, which can control the first capacitive unit C in this pixel component 110. FD With the first capacitive unit C in the corresponding number of other pixel components 110 FD The connection is established, thereby adjusting the adjustable gain value of the formed adjustable gain module 113.

[0066] In this embodiment of the application, through the first capacitive unit C of the capacitive component 111 FD A corresponding second switch group 1112 is provided between the first switch group 121 and the capacitive component 111, thus multiplexing the capacitive component 111 to form an adjustable gain module 113. By controlling the on / off state of the second switch group 1112, the capacitive component 111 can be configured as either a fixed gain module 112 or an adjustable gain module 113. Even when the pixel component 110 can have both an adjustable gain module 113 and a fixed gain module 112, it is possible to avoid increasing the hardware structure within the pixel component 110.

[0067] As shown in Figure 2, in some embodiments of this application, the number of adjustable gain modules 113 includes a first adjustable module 1131 and a second adjustable module 1132, and the gain values ​​of the first adjustable module 1131 and the second adjustable module 1132 are different.

[0068] The first switch group 121 includes a second switch element M LCG and the third switch M SLCG The second switch group 1112 includes a fourth switch element M. CG2 and the fifth switch M CG3 The fourth switch M CG2 Used to control the first capacitive unit C FD With the second switch M LCGThe on / off state of the fifth switch M CG3 Used to control the first capacitive unit C FD With the third switch M SLCG On / off state;

[0069] In the fourth switch M CG2 In the ON state, and in a first number of second switches M in a first switch group 121. LCG When in the conducting state, the capacitive component 111 is configured as the first adjustable module 1131;

[0070] In the fifth switch M CG3 In the ON state, and the second number of third switches M in the first switch group 121 of a column. SLCG When in the conducting state, the capacitive component 111 is configured as the second adjustable module 1132;

[0071] The first quantity is different from the second quantity.

[0072] In this embodiment, the adjustable gain module 113 includes a first adjustable module 1131 and a second adjustable module 1132, wherein the gain values ​​of both the first adjustable module 1131 and the second adjustable module 1132 are adjustable, and the gain values ​​of the first adjustable gain module 113 and the second adjustable gain module 113 are different. Since the adjustable gain module 113 includes two different adjustable modules, two different switching elements are provided in both the first switch group 121 and the second switch group 1112, thereby enabling the capacitive component 111 to be configured as a corresponding adjustable gain module 113. The first switch group 121 includes a fourth switching element M connected to two adjacent rows of pixel components 110. CG2 The second switch M between LCG And the fifth switch M connected in the two adjacent rows of pixel components 110 CG3 The third switch M between SLCG Among them, the second switching element M LCG and the third switch M SLCG The quantity is (N-1)×M, where N is the number of rows in pixel array 100 and M is the number of columns in pixel array 100. That is, a second switch M is connected between each pixel component 110 in two adjacent rows. LCG and the third switch M SLCG .

[0073] Specifically, the first switch group 121 includes a second switch element M LCG and the third switch M SLCG The second switch group 1112 includes a fourth switch element M. CG2 and the fifth switch M CG3 The fourth switch M CG2Connected to the first capacitive unit C FD With the second switch element M in the first switch group 121 LCG Between, the fifth switch M CG3 Connected to the first capacitive unit C FD With the third switch element M in the first switch group 121 of a series SLCG Between. The gain programming module 140 controls the second switch M in the on state of a first switch group 121. LCG The first quantity is used to set the gain value of the first adjustable module 1131, and the gain programming module 140 controls the third switch M in the on state of a first switch group 121. SLCG The second quantity is used to set the gain value of the second adjustable module 1132, and the second quantity is not set to be different from the first quantity, so as to ensure that the gain values ​​of the first adjustable module 1131 and the second adjustable module 1132 are different.

[0074] As shown in Figure 2, in some embodiments of this application, the basic component further includes:

[0075] Photosensitive unit 114, the first end of which is grounded;

[0076] A transmission unit 115 is provided, with its first end connected to the second end of the photosensitive unit 114, and its second end connected to the fixed gain module 112 and the adjustable gain module 113. The transmission unit 115 and the photosensitive unit 114 are used to perform an exposure operation.

[0077] A reset unit 116 is connected between the transmission unit 115 and the power supply, and the reset unit 116 is used to perform a reset operation;

[0078] The reading unit 117 is connected to the fixed gain module 112 and the adjustable gain module 113, and is used to perform reading operations.

[0079] In this embodiment, the pixel assembly 110 includes a photosensitive unit 114, a transmission unit 115, a reset unit 116, and a readout unit 117. The fixed gain module 112 and the adjustable gain module 113 include a floating diffusion capacitor, which is used to buffer the charge in the photosensitive unit 114. The readout unit 117 amplifies the signal read from the photosensitive unit 114, converts it into a corresponding voltage, and outputs it outside the pixel assembly 110. The reset unit 116 is responsible for resetting the floating diffusion capacitor.

[0080] As shown in Figures 4 and 6, exemplarily, the photosensitive unit 114 can be selected as a photodiode (PPD), and the transmission unit 115 can be selected as a transmission transistor (M). TX The reset unit 116 can be selected as a reset transistor RST, and the read unit 117 includes a source follower (SF) and an output transistor M. SEL Among them, the transmission transistor M TX This is an NMOS (N-type MOSFET, N-type semiconductor transistor). Specifically, the photodiode (PPD) is responsible for photosensitivity and photoelectric conversion in each frame, and the generated charge is transferred through the transfer transistor M. TX The charge is then buffered within a floating diffusion capacitor in the fixed gain module 112 and the adjustable gain module 113. During the read phase, the floating diffusion capacitor passes the charge through the source follower SF and the output transistor M in the read unit 117. SEL The amplified signal is then output to the pixel assembly 110. It should be noted that during the pixel signal output stage, the fixed gain module 112 and the adjustable gain module 113 need to be controlled to adjust the capacitance value of the floating diffusion capacitor, thereby allowing the pixel signal to be output with different gain values. After the pixel signal is output, the floating diffusion capacitor is reset via the reset transistor RST.

[0081] Figure 8 shows a third circuit diagram of a pixel assembly provided in some embodiments of this application. As shown in Figure 8, exemplarily, the number of photodiodes can be multiple, namely PPD1, PPD2, PPD3, and PPD4, enabling the image sensor 10 to achieve the binning function. When the number of photodiodes PPD is multiple, the transmission transistor M... TX The number is the same as the number of photodiodes (PPDs), and the multiple transmission transistors are M. TX1 M TX2 M TX3 and M TX4 Transmission transistor M TX Each photodiode is configured to correspond to a specific photodiode.

[0082] For example, the number of photodiodes (PPDs) is four, and the charge generated by the four PPDs after photosensitive action is transferred by their respective transfer transistors (M). TX Output. This is achieved by controlling a transmission transistor M. TX By controlling the on / off state, the user can select to transfer the charge generated by different numbers of photodiodes (PPDs) to the floating diffusion capacitors in the fixed gain module 112 and the adjustable gain module 113 according to actual needs, further improving the light sensitivity of the image sensor 10 in low-light environments.

[0083] In this embodiment, by setting a photosensitive unit, a transmission unit 115, a reset unit 116, and a readout unit 117 in the pixel assembly 110, and cooperating with the fixed gain module 112 and the adjustable gain module 113 to output pixel signals to the outside of the pixel assembly 110 according to different gains, the image effect output by the image sensor 10 is further guaranteed.

[0084] As shown in Figures 3 to 6, the specific circuit structure is illustrated below. For example, the photosensitive unit 114 can be selected as a photodiode (PPD), and the transmission unit 115 can be selected as a transmission transistor (M). TX The reset unit 116 can be selected as a reset transistor RST, and the read unit 117 includes a source follower (SF) and an output transistor M. SEL First capacitive unit C FD The first terminal and the transmission transistor M TX The second end is connected to the first capacitive unit C. FD The second terminal is grounded; the second capacitive unit C CG The first terminal is connected to the first terminal of the reset transistor RST, and the second capacitive unit C CG The second terminal of the reset transistor RST is grounded, and the second terminal of the reset transistor RST is connected to the power supply V. DD Connected; First switch M CG1 The first terminal is connected to the first terminal of the reset transistor RST, and the first switching element M CG1 The second end and the first capacitive unit C FD The second end is connected; the fourth switch M CG2 and the fifth switch M CG3 Connected to the first switch M CG1 Between the first end and the first switch group 121, the first switch group 121 is used to connect the fourth switch M in two adjacent rows of pixel assemblies 110. CG2 And the fifth switch M connecting two adjacent rows of pixel components 110 CG3 The fixed gain module 112 includes a first capacitive unit C. FD Second capacitive unit C CG The adjustable gain module 113 controls the first capacitive unit C in the fixed gain module 112. FD Second capacitive unit C CG Reuse. Among them, the first capacitive unit C FD For floating diffusion capacitors, the second capacitive unit C CG This is the expansion capacitor corresponding to the floating diffusion capacitor, i.e., through the second capacitive unit C. CG Capable of the first capacitive unit C FD Expanding capacity. First capacitive unit C FD With the second capacitive unit CCG A first switch M is provided between them. CG1 The first switch M CG1 Used to control the first capacitive unit C FD With the second capacitive unit C CG The on / off state between the two, the first switching element M CG1 The control terminal is connected to the line drive module 130, meaning the line drive module 130 can control the second capacitive unit C. CG Is the first capacitive unit C... FD Capacity expansion is performed. The adjustable gain module 113 includes a fourth switching element M. CG2 and the fifth switch M CG3 Fourth switch M CG2 Connected to the first switch element M via the first switch group 121 CG1 The fourth switch M in the pixel assembly 110 of the adjacent row CG2 Between, the fifth switch M CG3 Connected to the first switch element M via the first switch group 121 CG1 The fifth switch M in the pixel assembly 110 of the adjacent row CG3 Between. By controlling the on / off state of the first switch group 121 through the gain programming module 140, it is possible to determine the interconnected fourth switch M in at least two rows of pixel components 110. CG2 The number and interconnected fifth switch M CG3 The quantity, due to the fourth switch M CG2 and the fifth switch M CG3 All are related to the first switching element M CG1 Connected. The first switch group 121 includes the second switch element M. LCG and the third switch M SLCG Second switch M LCG The fourth switch M used to connect two adjacent rows of pixel components 110 CG2 The third switch M SLCG The fifth switch M used to connect two adjacent rows of pixel components 110 CG3 .

[0085] Fourth switch M CG2 and the fifth switch M CG3 The connection methods in pixel component 110 include the following two methods:

[0086] One type is a parallel connection, as shown in Figure 4, where the fourth switch M... CG2 The first end and the first switching element M CG1 The first end is connected, and the fourth switch M CG2 The second end and the second switch M LCG Connected; Fifth switch MCG3 The first end and the first switching element M CG1 The first end is connected, and the fifth switch M CG3 The second end and the third switch M SLCG Connected. Fourth switch M CG2 With the fifth switch M CG3 Parallel configuration in the first switch M CG1 Between and the first switch group 121.

[0087] Another method is a series connection, as shown in Figure 6, where the fourth switch M... CG2 The first end and the first switching element M CG1 The first end is connected, and the fourth switch M CG2 The second end and the second switch M LCG Connected; Fifth switch M CG3 The first end and the fourth switch M CG2 The second end is connected to the fifth switch M. CG3 The second end and the third switch M SLCG Connected. Fourth switch M CG2 With the fifth switch M CG3 Series-connected in the first switch M CG1 Between the first switch group 121 and the series connection method helps to simplify the wiring layout within the pixel assembly 110.

[0088] The control process of outputting pixel signals through the fixed gain module 112 is as follows: When controlling the first switch M... CG1 When in the off state, the transmission transistor M TX Charge is transferred from the first capacitive unit C. FD This sets the pixel assembly 110 to HCG (high gain) mode, at which point the pixel assembly 110 outputs a pixel signal according to a first fixed gain value. This is achieved by controlling the first switch M... CG When in the on state, the first capacitive unit C FD With the second capacitive unit C CG The connection is established so that the pixel component 110 is set to MCG (medium gain) mode. At this time, the pixel component 110 outputs a pixel signal according to the second fixed gain value.

[0089] The control process of outputting pixel signals through the adjustable gain module 113 is as follows: The gain programming module 140 can control the second switch M... LCG and the third switch M SLCG The adjustable gain module 113 is configured to set the first and second adjustable gain values ​​for the number of conductions. After setting the first and second adjustable gain values, the fourth switch M is controlled. CG2and the fifth switch M CG3 The on / off state of the fourth switch M CG2 The on / off state is used to control whether the fourth switch M is passed. CG2 The second capacitive unit C in the pixel component 110 of the connected adjacent rows CG For the first capacitive unit C of the pixel component 110 in this row FD Second capacitive unit C CG To expand capacity, the fifth switch M CG3 The on / off state is used to control whether the fifth switch M is passed. CG3 The second capacitive unit C in the pixel component 110 of the connected adjacent rows CG For the first capacitive unit C of the pixel component 110 in this row FD Second capacitive unit C CG Capacity expansion is required. Fourth switch M CG2 and the fifth switch M CG3 The control terminal is connected to the line drive module 130, meaning the line drive module 130 can control whether the fourth switch M is activated. CG2 and / or the fifth switch M CG3 The second capacitive unit C in the pixel assembly 110 of the adjacent row connected CG For the first capacitive unit C in the pixel component 110 of this row FD Second capacitive unit C CG Capacity expansion is being carried out. Specifically, this involves controlling the first switching element M. CG1 and the fourth switch M CG2 All are in the on state, and the first capacitive unit C in the pixel component 110 of this row is in the on state. FD With the second capacitive unit C CG Connected, and connected to the fourth switch M CG2 The second capacitive unit C of the pixel component 110 of the other rows connected CG This sets pixel assembly 110 to LCG (low gain) mode. The first switch M is controlled... CG1 Fourth switch M CG2 and the fifth switch M CG3 All are in the on state, and the first capacitive unit C in the pixel component 110 of this row is in the on state. FD With the second capacitive unit C CG Connected, and connected to the fourth switch M CG2 The second capacitive unit C of pixel component 110 of other connected pixel rows CG and connected to the fifth switch M CG3 The second capacitive unit C of the pixel component 110 of the other rows connected CG This sets the pixel component 110 to SLCG (Extra Low Gain) mode.

[0090] Line drive module 130 and first switch M CG1 Control terminal, fourth switch M CG2 Control terminal, fifth switch M CG3 Control terminal, transmission transistor M TX The control terminal of the horizontal drive module 130 is connected to the control terminal of the readout unit 117 and the control terminal of the reset transistor RST. The horizontal drive module 130 can control the pixel array 100, that is, it can control the pixel assembly 110 to perform reset, exposure, and readout operations. Specifically, the horizontal drive module 130 controls the pixel assembly 110 to perform a reset operation by controlling the reset transistor RST, and controls the transfer transistor M... TX To perform the exposure operation, the line drive module 130 controls the first switch M. CG1 Fourth switch M CG2 Fifth switch M CG3 The reading unit 117 performs the reading operation.

[0091] As shown in Figures 1, 3, and 5, in some embodiments of this application, the image sensor 10 further includes: a column scanning component 150, the input of which is connected to the reading unit 117 in each column pixel component 110; and an image signal processor 160, the input of which is connected to the output of the column scanning component 150, and the image signal processor 160 is used to output image data.

[0092] In this embodiment, the image sensor 10 further includes a column scanning component 150 and an image signal processor 160. The column scanning component 150 includes a column scanner and a column parallel analog-to-digital converter, and is connected between the pixel array 100 and the image signal processor 160. The pixel signals output by the pixel array 100 are transmitted to the image signal processor 160 via the column scanning component 150. The image signal processor 160 processes the received pixel signals, and the processed pixel signals generate a captured image.

[0093] Figure 9 shows the working timing diagram of the image sensor in one frame time provided in some embodiments of this application. As shown in Figures 1, 3 and 5, in some embodiments of this application, the pixel array 100 includes multiple rows of pixel components 110, and the row driving module 130 is connected to the transmission unit 115, the reset unit 116 and the reading unit 117 in each pixel component 110.

[0094] Specifically, the row driving module 130 sequentially performs reset, exposure, gain setting, and read operations on the multi-row pixel components 110. When the reset operation of the previous row pixel component 110 is completed and the exposure operation is started, the reset operation is performed on the current row pixel component 110. When the exposure operation of the current row pixel component 110 is completed, the gain setting and read operations are performed on the current row pixel component 110. The gain setting operation is performed through the capacitive component 111 and the gain programming module 140.

[0095] In this embodiment, the row driving module 130 is connected to the pixel array 100 and is used to drive at least two rows of pixel components 110 to output pixel signals row by row. Specifically, the image sensor 10 architecture adopts an M×N pixel array 100, and the gain programming module 140 and the row driving module 130 are arranged around the pixel array 100. The gain programming module 140 sets the adjustable gain module 113 in a column of pixels in a row-parallel manner to program the gain of the pixel components 110. The control signals for the reset operation, exposure operation, and gain setting operation read operation of the pixel components 110 are all provided by the row driving module 130, and the pixel components 110 are controlled to perform actions row by row in a parallel manner. Among them, the reset operation is performed by the reset unit 116 in the pixel component 110, the exposure operation is performed by the transmission unit 115 driving the photosensitive unit 114, the read operation is performed by the read unit 117, and the gain setting operation is performed by the capacitive component 111 and the gain programming module 140.

[0096] It is understandable that during the row driving module 130's row-by-row driving process, at least two rows of pixel components 110 can be driven to output pixel signals simultaneously. The pixel components 110 that output pixel signals are spaced apart, so that the adjustable gain module 113 in the pixel component 110 that outputs pixel signals can reuse the capacitors in the pixel components 110 of adjacent rows.

[0097] In this embodiment, when reading the pixel signal of pixel component 110, pixel component 110 needs to be exposed sequentially according to all gain values ​​and output the corresponding pixel signal. That is, the number of pixel signals output by each row of pixel component 110 is related to the number of gain values. Each row of pixel component 110 needs to generate pixel signals according to the fixed gain value of fixed gain module 112 and the adjustable gain value of adjustable gain module 113. Moreover, the adjustable gain value of adjustable gain module 113 needs to reuse the capacitors in adjacent rows of pixel component 110. Therefore, by reading the pixel signal of pixel component 110 row by row by row through row driving module 130, it can be ensured that when reading the pixel signal of the current row of pixel component 110, the reused adjacent row of pixel component 110 does not need to output pixel signals, ensuring the stability of the gain value of adjustable gain module 113, thereby improving the signal quality of the pixel signal output by pixel component 110.

[0098] In this embodiment, at least two pixel components 110 are provided in the pixel array 100, and each pixel component 110 includes a fixed gain module 112 and an adjustable gain module 113. The adjustable gain module 113 can set the gain value according to the user's actual needs, so that the gain parameter in the pixel component 110 is adjustable, thereby making the native ISO parameter of the image sensor 10 adjustable. This solves the problem that the native ISO parameter of the image sensor 10 is fixed due to the fixed gain parameter in the pixel, and the problem that the image noise and image quality are obvious when the analog gain and digital gain are used to amplify the output pixel signal.

[0099] For example, as shown in Figure 9, within one frame, each row of pixel components 110 performs a reset operation, an exposure operation, a gain setting operation, and a readout operation row by row, with a time difference between pixels in adjacent rows. During the readout period, the row driving module 130 outputs Φ LCG Pulling the signal high closes the readout transistor in the readout unit 117, causing the pixel signal Φ output by the pixel assembly 110 to... PIX In the column scanning component 150, each row of pixel components 110 first performs Correlated Double Sampling (CDS) to sample intra-pixel noise. Specifically, during the CDS period, the transfer transistor M within the pixel component 110... TX Keeping it off, the reset transistor RST is in the on state, causing the power supply V to... DD Clear the first capacitive unit C within the pixel assembly 110 FD Second capacitive unit C CGThe read transistor in the control read unit 117 is turned on, causing the analog-to-digital converter (ADC) module in the column scan assembly 150 to sample and store the initial signal of the cleared pixel. The initial value of this initial signal contains noise. The ADC module is a column-parallel analog-to-digital converter. Then, the pixel assembly 110 is set to HCG mode and HCG reading is performed. After HCG reading, MCG, LCG, and SLCG are performed. The row drive module 130 outputs Φ... CG1 For driving the first switching element M CG1 When the circuit is turned on, the Φ output of the line drive module 130 is... CG2 For driving the first switching element M CG1 When the circuit is turned on, the Φ output of the line drive module 130 is... CG3 For driving the first switching element M CG1 When the circuit is turned on, the Φ output of the line drive module 130 is... CG2 The RST transistor is used to drive the reset transistor to turn on. During LCG and SLCG setting, the gain programming module 140 needs to avoid the pixel assembly 110 being read. For example, when the first row of pixels is being read, the pixel LCG and SLCG programmer will select and control the first switch group 121 between the first and second rows, and the first switch group 121 between the second and third rows, so that the LCG and SLCG of the first row of pixel assembly 110 can be set. After the SLCG reading is completed, this row of pixels enters the image processor's processing time or idle time, i.e., the image signal processor (ISP) processing time or idle time, repeating the above steps until each pixel row has completed the reading of the pixel signal, waiting for the start of the next frame. After the CDS period ends, during each gain value reading stage, such as the HCG stage, the transfer transistor M... TX Both the reset transistor RST and the photodiode PPD are turned on, and charge is transferred from the photodiode PPD to the first capacitive cell C within the pixel assembly 110. FD The ADC module in the column scanning component 150 then samples and reads the signal value of the pixel signal, which also includes noise. The ADC module then subtracts the initial value from the signal value to obtain a noise-free signal value for output.

[0100] Φ in Figures 3 and 5 SEL Used to control the output transistor M SEL Action, Φ TX Used to control the operation of the transmission transistor, Φ LCG and Φ SLCG Used to control the operation of the adjustable gain module.

[0101] In some embodiments of this application, during the gain setting operation of pixel component 110, the capacitive component 111 is configured as a fixed gain module 112, or the capacitive component 111 is configured as an adjustable gain module 113 by the gain programming module 140.

[0102] In this embodiment, the capacitive component 111 includes a second switch group 1112. By controlling the on / off state of the second switch group 1112, the capacitive component 111 can be configured as a fixed gain module 112 or an adjustable gain module 113. That is, when the pixel component 110 outputs a pixel signal, the capacitive component 111 is configured as a fixed gain module 112 or as an adjustable gain module 113, so that the pixel component 110 outputs a pixel signal through only one corresponding gain value at the same time period.

[0103] Specifically, when the second switch group 1112 is in the ON state, the capacitive component 111 is configured as an adjustable gain module 113; when the second switch group 1112 is in the OFF state, the capacitive component 111 is configured as a fixed gain module 112.

[0104] In some embodiments of this application, an electronic device is provided. FIG10 shows a schematic diagram of the structure of the electronic device provided in some embodiments of this application. As shown in FIG10, the electronic device 200 includes: a body 202 and an image sensor 100 in any of the above embodiments, and thus has all the beneficial technical effects of the image sensor 100 in any of the above embodiments, which will not be repeated here.

[0105] In this embodiment of the application, the electronic device can be a mobile phone, tablet computer, or other portable electronic device.

[0106] In some embodiments of this application, an image acquisition method is provided, applied to an electronic device in any of the above embodiments. Figure 11 shows a flowchart of the image acquisition method provided in some embodiments of this application. As shown in Figure 11, the image acquisition method is applied to an image sensor, which includes: a pixel array, a first switch group, a row driving module, and a gain programming module. The pixel array includes at least two rows of pixel components, and each pixel component includes: a fixed gain module and an adjustable gain module. The image acquisition method includes:

[0107] Step 1102: If the previous row of pixel components has completed the reset operation and started the exposure operation, perform the reset operation on the current row of pixel components.

[0108] In this embodiment of the application, the row driving module is connected to the pixel array. The row driving module is used to drive at least two rows of pixel components to output pixel signals row by row. When the previous row of pixel components has completed the reset operation and started the exposure operation, the current row of pixel components starts to perform the reset operation.

[0109] It is understandable that during the row-by-row driving process, the row driving module can simultaneously drive at least two rows of pixel components to output pixel signals. At the same time, the pixel component spacing of the output pixel signals is set so that the adjustable gain module in the pixel component of the output pixel signal can reuse the capacitor in the pixel component of the adjacent row.

[0110] Step 1104: When the current row pixel component has completed the exposure operation, perform a gain setting operation on the current row pixel component to set the target gain value in the gain value set. The gain value set includes all gain values ​​corresponding to the fixed gain module and the adjustable gain module.

[0111] In this embodiment, when the current row of pixel components completes the exposure operation, the gain value of the current pixel row needs to be set before starting the reading operation, i.e., the gain setting operation is started. The current row of pixel components corresponds to a gain value set, which includes fixed gain values ​​and adjustable gain values. The fixed gain value is the gain value that matches the capacitance value of the pixel component's internal component; that is, the fixed gain value is fixed. The adjustable gain value is the gain value obtained by the gain programming module by setting the first switch group in a column of first switches that is in the on state; the adjustable gain value is not fixed. The capacitive component includes a first switch element for configuring the fixed gain module and a second switch group for configuring the adjustable gain module. By controlling the on / off state of the first switch element and the second switch group, a target gain value can be selected from the gain value set.

[0112] For example, the capacitive component includes a first capacitive unit and a second capacitive unit, the second switch group includes a fourth switch element and a fifth switch element, the fourth switch element is connected to a column of second switches elements in a first switch group, and the fifth switch element is connected to a column of third switches elements in a first switch group. The gain value set includes a first fixed gain value, a second fixed gain value, a first adjustable gain value, and a second adjustable gain value. By controlling the first switch element to be in the off state and the second switch group to be in the off state, the target gain value is set to the first fixed gain value. By controlling the first switch element to be in the on state and the second switch group to be in the off state, the target gain value is set to the second fixed gain value. By controlling the first switch element to be in the on state, the fourth switch element to be in the on state, and the fifth switch element to be in the off state, the target gain value is configured as a first adjustable gain value, the first adjustable gain value being related to the number of on states in the column of second switches connected to the fourth switch element. By controlling the first switch to be in the ON state, the fourth switch to be in the OFF state, and the fifth switch to be in the ON state, the target gain value is configured as a second adjustable gain value, which is related to the number of ON switches in a row of third switches connected to the fifth switch.

[0113] Step 1106: Perform a read operation on the current row pixel component according to the target gain value, and return to perform a gain setting operation on the current row pixel component through the gain programming module until the read operation is completed according to each gain value in the gain value set.

[0114] In this embodiment, when reading the pixel signal of a pixel component, the pixel component needs to be exposed sequentially according to all gain values ​​and output the corresponding pixel signal. That is, the number of pixel signals output by each row of pixel components is related to the number of gain values. Each row of pixel components needs to generate a pixel signal according to the fixed gain value of the fixed gain module and the gain value of the adjustable gain module. Moreover, the adjustable gain value of the adjustable gain module needs to reuse the capacitors in the adjacent rows of pixel components. Therefore, by reading the pixel signal of the pixel component row by row through the row driving module, it can be ensured that when reading the pixel signal of the current row of pixel components, the reused adjacent row of pixel components does not need to output pixel signals, ensuring the stability of the gain value of the adjustable gain module, thereby improving the signal quality of the pixel signal output by the pixel component.

[0115] In this embodiment, at least two pixel components are set in the pixel array, and each pixel component includes a fixed gain module and an adjustable gain module. The adjustable gain module can set the gain value according to the user's actual needs, so that the gain parameter in the pixel component is adjustable, thereby making the native ISO parameter of the image sensor adjustable. This solves the problem that the native ISO parameter of the image sensor is fixed due to the fixed gain parameter in the pixel, and the problem that the image noise and image quality are obvious when the analog gain and digital gain are used to amplify the output pixel signal.

[0116] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, apparatus, article, or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, apparatus, article, or device. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, apparatus, article, or device that includes that element.

[0117] Furthermore, it should be noted that the scope of the apparatus and devices in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order according to the functions involved. For example, the described apparatus may be performed in a different order than described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

[0118] Through the above description of the embodiments, those skilled in the art can clearly understand that the apparatus of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platform, and of course, it can also be implemented by hardware, but in many cases the former is a better implementation. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the apparatus of the various embodiments of this application.

[0119] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image sensor, comprising: A pixel array comprising multiple columns of pixel components, each column of pixel components comprising multiple pixel components, each pixel component comprising: a capacitive component, each capacitive component being configured as a fixed gain module or an adjustable gain module of the pixel component, wherein the gain value of the fixed gain module is fixed, and the gain value of the adjustable gain module is not fixed; A switch array, the switch array comprising multiple columns of first switch groups, the multiple columns of first switch groups being configured one-to-one with the multiple columns of pixel components, and a first switch group being configured between any two adjacent capacitive components in each column of pixel components; A gain programming module is connected to each of the switch arrays. The gain programming module is used to control the number of first switch groups in the on state in each column of the first switch group, so as to adjust the gain value of the adjustable gain module in the pixel component corresponding to each column of the first switch group. A row driving module is connected to the pixel array. The row driving module is used to control the pixel array to output pixel signals sequentially through the fixed gain value of the fixed gain module and the adjustable gain value of the adjustable gain module.

2. The image sensor according to claim 1, wherein, The number of fixed gain modules in each pixel component is at least one, the number of adjustable gain modules in each pixel component is at least two, and the sum of the number of fixed gain modules and the number of adjustable gain modules in each pixel component is at least four.

3. The image sensor according to claim 1, wherein, The fixed gain module includes a first fixed module and a second fixed module, wherein the gain values ​​of the first fixed module and the second fixed module are different; The capacitive component includes: a first capacitive unit, a second capacitive unit, and a first switching element, wherein the first switching element is used to control the on / off state of the first capacitive unit and the second capacitive unit; Wherein, when the first switch is in the off state, the capacitive component is configured as the first fixing module; when the first switch is in the on state, the capacitive component is configured as the second fixing module.

4. The image sensor according to claim 3, wherein, The capacitive component also includes: The second switch group is used to control the on / off state between the first capacitive unit and the corresponding first switch group; Wherein, when the second switch group is in the on state and the corresponding first switch group is in the on state, the capacitive component is configured as the adjustable gain module.

5. The image sensor according to claim 4, wherein, The adjustable gain module includes a first adjustable module and a second adjustable module, wherein the gain values ​​of the first adjustable module and the second adjustable module are different; The first switch group includes a second switch element and a third switch element, and the second switch group includes a fourth switch element and a fifth switch element. The fourth switch element is used to control the on / off state between the first capacitive unit and the second switch element, and the fifth switch element is used to control the on / off state between the first capacitive unit and the third switch element. When the fourth switch is in the ON state and a first number of second switches in a column of the first switch group are in the ON state, the capacitive component is configured as the first adjustable module. When the fifth switch is in the ON state and a second number of third switches in a column of the first switch group are in the ON state, the capacitive component is configured as a second adjustable module. The first quantity is different from the second quantity.

6. The image sensor according to any one of claims 1 to 5, wherein, The pixel component also includes: Photosensitive unit, wherein the first terminal of the photosensitive unit is grounded; A transmission unit, wherein a first end of the transmission unit is connected to a second end of the photosensitive unit, and the second end of the transmission unit is connected to the fixed gain module and the adjustable gain module, and the transmission unit and the photosensitive unit are used to perform an exposure operation; A reset unit is connected between the transmission unit and the power supply, and the reset unit is used to perform a reset operation; A reading unit is connected to the fixed gain module and the adjustable gain module, and the reading unit is used to perform reading operations.

7. The image sensor according to claim 6, wherein, Also includes: A column scanning component, wherein the input end of the column scanning component is connected to the reading unit in each column of the pixel component; An image signal processor, wherein the input terminal of the image signal processor is connected to the output terminal of the column scanning component, and the image signal processor is used to output image data.

8. The image sensor according to claim 6, wherein, The pixel array includes multiple rows of pixel components, and the row driving module is connected to the transmission unit, reset unit and read unit in each of the pixel components; Specifically, the row driving module sequentially performs the reset operation, the exposure operation, the gain setting operation, and the read operation on the multiple rows of pixel components. When the reset operation is completed on the previous row of pixel components and the exposure operation is started, the reset operation is performed on the current row of pixel components. When the exposure operation is completed on the current row of pixel components, the gain setting operation and the read operation are performed on the current row of pixel components. The gain setting operation is performed through the capacitive component and the gain programming module.

9. The image sensor according to claim 8, wherein, During the gain setting operation on the pixel component, the capacitive component is configured as the fixed gain module, or the capacitive component is configured as the adjustable gain module through the gain programming module.

10. An electronic device, comprising: ontology; The image sensor according to any one of claims 1 to 9, wherein the image sensor is disposed on the body.

11. An image acquisition method, applied to the electronic device of claim 10, the image acquisition method comprising: If the previous row of pixel components has completed the reset operation and started the exposure operation, the reset operation is performed on the current row of pixel components. When the pixel component in the current row completes the exposure operation, a gain setting operation is performed on the pixel component in the current row to set a target gain value in the gain value set, which includes all gain values ​​corresponding to the fixed gain module and the adjustable gain module. Perform a read operation on the pixel component in the current row according to the target gain value, and return to perform the gain setting operation on the pixel component in the current row until the read operation is completed according to each gain value in the gain value set.

Images