Image sensor and method of operating an imaging device

By introducing multiple pixel groups and timing controllers into the image sensor, and controlling the size and transistor state of the floating diffusion region using the operating mode, the problem of signal-to-noise ratio and dynamic range optimization in the prior art image sensor in different modes is solved. Achieve more efficient image capture performance.

CN112866592BActive Publication Date: 2024-12-03SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011051961.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-11-12
Filing Date
2020-09-29
Publication Date
2024-12-03
Estimated Expiration
2040-09-29

AI Technical Summary

Technical Problem

It is difficult for existing image sensors to optimize signal-to-noise ratio and dynamic range in different image capture modes, and it is difficult for traditional technologies to effectively control the conversion gain.

Method used

By introducing multiple pixel groups into the image sensor, the size of the floating diffusion region is controlled using the operating mode, the switching gain is adjusted by the timing controller according to the operating mode, and the different floating diffusion regions are connected by metal lines to Achieve multiple capacitance ratios to optimize the conversion gain of each pixel.

Benefits of technology

The optimization of signal-to-noise ratio and dynamic range in different image capture modes is achieved, which improves the performance of the image sensor and adapts to a variety of operational needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112866592B_ABST
    Figure CN112866592B_ABST
Patent Text Reader

Abstract

An image sensor and a method for operating an imaging device are provided. The image sensor includes a first pixel, a second pixel, a third pixel, and a fourth pixel, the first pixel includes a first floating diffusion area and a second floating diffusion area, the second pixel includes a first floating diffusion area, a second floating diffusion area, and a third floating diffusion area, the third pixel includes a first floating diffusion area, a second floating diffusion area, and a third floating diffusion area, and the fourth pixel includes a first floating diffusion area and a second floating diffusion area, wherein the second floating diffusion area of ​​the first pixel and the second floating diffusion area of ​​the second pixel are connected by a first metal line, and wherein the third floating diffusion area of ​​the second pixel and the third floating diffusion area of ​​the third pixel are connected by a second metal line.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims the priority benefit of Korean Patent Application No. 10-2019-0144199 filed on November 12, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference. Technical Field

[0002] Example embodiments of the present disclosure relate to an image sensor, an imaging device including the image sensor, and an operating method thereof. Background Art

[0003] Typically, an image sensor converts an optical image into an electrical signal. Recently, with the development of the computer industry and the communications industry, the demand for improved image sensors in various fields is increasing. Image sensors include charge coupled devices (CCDs) and complementary metal oxide semiconductor (CMOS) image sensors. Among these, CMOS image sensors can be easily driven, and signal processing circuits can be integrated on a single chip, thereby miniaturizing the product. CMOS image sensors also have very low power consumption, so they can be used in products with limited battery capacity. In addition, CMOS image sensors can be used interchangeably with CMOS process technology, reducing manufacturing costs. Therefore, as technology develops to achieve high resolution, the use of CMOS image sensors is rapidly increasing. Summary of the invention

[0004] One or more example embodiments provide an image sensor which controls a conversion gain according to an operation mode, an imaging device including the image sensor, and an operation method thereof.

[0005] According to an aspect of an example embodiment, an image sensor is provided, the image sensor comprising a first pixel, a second pixel, a third pixel and a fourth pixel, the first pixel comprising a first floating diffusion area and a second floating diffusion area, the second pixel comprising a first floating diffusion area, a second floating diffusion area and a third floating diffusion area, the third pixel comprising a first floating diffusion area and a second floating diffusion area, the fourth pixel comprising a first floating diffusion area, a second floating diffusion area and a third floating diffusion area, wherein the second floating diffusion area of ​​the first pixel and the second floating diffusion area of ​​the second pixel are connected by a first metal line, wherein the third floating diffusion area of ​​the second pixel and the third floating diffusion area of ​​the third pixel are connected by a second metal line.

[0006] According to another aspect of example embodiments, there is provided an image sensor including a first pixel, a second pixel, a third pixel, and a fourth pixel, wherein each of the first to fourth pixels includes a first transistor, a second transistor, a third transistor, a fourth transistor, and a fifth transistor, the first transistor being configured to connect at least one photodiode with a first floating diffusion node based on a transfer gate signal, the second transistor being configured to connect the first floating diffusion node with a second floating diffusion node based on a first conversion gain signal, the third transistor including a drain connected to the second floating diffusion node, the fourth transistor including a source and a gate, the source being connected to a power supply terminal configured to provide a pixel driving voltage, the gate being connected to the first floating diffusion node, the fifth transistor including a source connected to a drain of the fourth transistor, a drain connected to a column line, and a gate configured to receive a selection signal, wherein the second floating diffusion node of the first pixel and the second floating diffusion node of the second pixel are connected by a metal line, wherein the second floating diffusion node of the third pixel and the second floating diffusion node of the fourth pixel are connected by a metal line, and wherein the third floating diffusion node of the second pixel and the third floating diffusion node of the third pixel are connected by a metal line.

[0007] According to another aspect of example embodiments, there is provided a method of operating an imaging device, the method comprising: receiving an operation mode from an image sensor; and controlling a size of a floating diffusion region of a pixel group according to the received operation mode, wherein the operation mode comprises at least three operation modes. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and / or other aspects, features and advantages of example embodiments will be more clearly understood through the following detailed description taken in conjunction with the accompanying drawings, in which:

[0009] Figure 1 is a diagram showing an imaging device 10 according to an example embodiment;

[0010] Figure 2 is a diagram illustrating an image sensor 100 according to example embodiments;

[0011] Figure 3 is a diagram illustrating a pixel group PXG according to an example embodiment;

[0012] Figure 4 It is shown for Figure 3 Schematic diagram of the circuit of the pixel group PXG shown in FIG.

[0013] Figure 5A and Figure 5B is an exemplary diagram showing a pixel group PXGa according to another exemplary embodiment;

[0014] Figure 6is a diagram illustrating a pixel group PXGb according to another example embodiment;

[0015] Figure 7 is a diagram illustrating a pixel group PXGc according to another example embodiment;

[0016] Fig. 8A is a diagram showing pixels composed of a 2×2 Bayer pattern, Figure 8B is a diagram showing a pixel composed of a 4×4 quad pattern, Figure 8C is a diagram showing a pixel composed of an 8×8Q unit pattern, Fig.8D is a diagram showing a pixel having an infrared (IR) sub-pixel;

[0017] Fig.9A A quad pixel with a lens corresponding to each color sub-pixel is shown, Fig. 9B A quad pixel with lenses corresponding to four sub-pixels of the same color is shown, Fig. 9C A 4×4 color filter pixel with a lens corresponding to a 1×1 sub-pixel is shown, Fig.9D A 4×4 color filter pixel corresponding to a 2×2 sub-pixel is shown, Fig.9E A 4×4 color filter pixel corresponding to a 4×4 sub-pixel is shown;

[0018] Fig. 10A and Fig. 10B is a diagram showing a pixel of a 2-PD structure;

[0019] Fig.11A is an operation timing diagram of a pixel according to a first operation mode, Fig. 11B is an operation timing diagram of a pixel according to the second operation mode, Fig. 11C is an operation timing diagram of a pixel according to a third operation mode;

[0020] Fig.12 is a diagram illustrating changes in capacitance of connections of floating diffusion nodes FD1 , FD2 , and FD3 according to pixels PX1 to PX4 of a pixel group according to example embodiments;

[0021] Fig.13A is a diagram showing a size FD1 of a floating diffusion area corresponding to a pixel according to a first operation mode, Fig. 13B is a diagram showing the size (FD1+2FD2) of the floating diffusion area corresponding to the pixel according to the second operation mode, Fig. 13C is a diagram showing the size (FD1+4FD+2FD3) of a floating diffusion area corresponding to a pixel according to a third operation mode;

[0022] Fig.14Ais a diagram showing a process of generating an image signal in a unit pixel in an image capturing mode in a time series, and Fig. 14B is a diagram showing a process of generating an image signal by unit pixel in an image recognition mode in a time sequence;

[0023] Fig.15A , Fig. 15B and Fig. 15C is a diagram showing pixels PXGd, PXGe, and PXGf according to another example embodiment;

[0024] Fig.16 is a diagram illustrating an example embodiment of a layout arrangement of pixel groups according to an example embodiment;

[0025] Fig.17 is a diagram illustrating an image sensor 300 according to another example embodiment;

[0026] Fig.18 is a block diagram of an electronic device 1000 according to an example embodiment;

[0027] Fig.19A and Fig.19B is a diagram schematically illustrating a mobile device 2000 according to an example embodiment; and

[0028] Fig. 20 is a diagram illustrating a method of operating the imaging device 10 according to an example embodiment. DETAILED DESCRIPTION

[0029] Hereinafter, example embodiments will be described in detail with reference to the accompanying drawings.

[0030] Figure 1 is a diagram showing an imaging device 10 according to an example embodiment. Figure 1 , the imaging device 10 may include an image sensor 100 and an image signal processor (ISP) 200 .

[0031] The image sensor 100 may be implemented to detect an object. The image sensor 100 may include a pixel array 110 , a row driver 120 , a readout circuit 130 , a column driver 140 , and a timing controller 150 .

[0032] The pixel array 110 may include a plurality of pixels arranged in an array form of a plurality of row lines and a plurality of column lines. Each of the plurality of pixels may include a color filter to pass light of a specific wavelength. For example, the color filter may be at least one of a red filter, a green filter, and a blue filter, the red filter passing light of a wavelength in a red region among the plurality of wavelengths of light in the visible region, the green filter passing light of a wavelength in a green region among the plurality of wavelengths of light in the visible region, and the blue filter passing light of a wavelength in a blue region among the plurality of wavelengths of light in the visible region. However, the embodiment is not limited thereto. For example, the color filter may be at least one of a cyan filter, a yellow filter, and a magenta filter.

[0033] In one example embodiment, each of the plurality of pixels may include a photoelectric conversion element. For example, each of the plurality of pixels PX may include a photodiode and a pixel circuit, the photodiode generating a charge in response to a light signal incident from the outside, and the pixel circuit generating an electrical signal corresponding to the charge generated by the photodiode. In this case, the photodiode may be a PIN photodiode having a structure in which an intrinsic semiconductor layer is inserted between PN junctions. The photodiode may also be an APD photodiode in which an avalanche layer exists between PN junctions.

[0034] In one example embodiment, each of the plurality of pixels may include at least two photodiodes. For example, each pixel may include at least two photodiodes to generate pixel signals corresponding to light of various colors or to provide an auto-focus function.

[0035] In addition, each of the plurality of pixels may include a pixel circuit that generates a pixel signal from a charge generated by a photodiode. In this case, the pixel circuit may include a transfer transistor, a drive (source follower) transistor, a selection transistor, a reset transistor, and at least one conversion gain transistor. The pixel circuit may obtain a pixel signal by detecting a reset voltage and a pixel voltage from a plurality of corresponding pixels and calculating their difference. The pixel voltage may be a voltage corresponding to a charge generated in a photodiode included in each of the plurality of pixels.

[0036] In one example embodiment, at least two pixels adjacent to each other may constitute a single pixel group. Two or more pixels included in the pixel group may share at least part of a transfer transistor, a drive transistor, a selection transistor, a reset transistor, and a conversion gain transistor.

[0037] The row driver 120 may be implemented to drive the pixel array 110 in row units. For example, the row driver 120 may generate a transfer control signal to control a transfer transistor of a pixel circuit, a reset control signal to control a reset transistor, or a selection control signal to control a selection transistor.

[0038] The readout circuit 130 may be implemented to convert the analog pixel signal generated by the pixel array 110 into a digital signal and output the converted signal. The readout circuit 130 may include a sampling circuit and an analog-to-digital converter (ADC). The sampling circuit may include a plurality of samplers. For example, the sampler may be a correlated double sampler (CDS). The sampler may be connected to the pixels included in the row line selected by the row driver 120 via a column line, and may detect the reset voltage and pixel voltage from the corresponding pixel. The sampler may compare the reset voltage and the pixel voltage with the ramp voltage, respectively, and may output the comparison result. The analog-to-digital converter may convert the comparison result output by the sampler into a digital signal and may output a digital signal. The analog-to-digital converter may convert the reset voltage and the pixel voltage detected by the correlated double sampler into a digital signal, and may send the converted digital signal to the column driver 140.

[0039] The column driver 140 may include an amplifier circuit and a latch circuit or a buffer circuit that temporarily stores a digital signal. The column driver 140 may process the digital signal received from the readout circuit 130.

[0040] The timing controller 150 may be configured to control the operation timing of the row driver 120, the readout circuit 130, or the column driver 140. In detail, the timing controller 150 may control the operation timing to change the conversion gain of the pixel according to three or more operation modes. In an example embodiment, the timing controller 150 may adjust the capacitance ratio using the junction capacitance or metal capacitance around the pixel according to the operation mode, thereby controlling the conversion gain of the pixel. The timing controller 150 may change the size of the floating diffusion region or the charge storage region corresponding to the conversion gain by turning on / off at least one transistor in the pixel according to the operation mode.

[0041] The image signal processor (ISP) 200 may be configured to process the image data output from the readout circuit 130. For example, the image signal processor (ISP) 200 may process the image data to generate a result image, and may send the result image to a display or may store the result image in a memory. For example, the image signal processor (ISP) 200 may perform a signal processing operation (such as color interpolation, color correction, gamma correction, color space conversion, edge correction, etc.) on the received frame data to generate image data.

[0042] An imaging device 10 according to example embodiments includes an image sensor 100 having pixels whose conversion gains are controlled according to at least three operation modes, thereby achieving optimization in terms of a signal-to-noise ratio and a dynamic range for each image capturing mode.

[0043] Figure 2 is a diagram illustrating an image sensor 100 according to example embodiments. Figure 2 , the image sensor 100 may include a pixel array 110 , a row driver 120 , and a readout circuit 130 .

[0044] The pixel array 110 may include a plurality of pixels PX disposed at intersections of a plurality of row lines ROW and a plurality of column lines CL. 11 To PX MN .

[0045] The row driver 120 can control a plurality of pixels PX through a plurality of row lines ROW inputs. 11 To PX MN For example, the row driver 120 can send signals to multiple pixels PX through multiple row lines ROW. 11 To PX MN A reset control signal (also called a reset gate signal) RG, a transfer control signal (also called a transfer gate signal) TG, or a selection control signal (also called a selection signal) SEL is provided. The row driver 120 may sequentially select a plurality of corresponding row lines ROW. The row driver 120 may select one of the plurality of row lines ROW during a predetermined horizontal period.

[0046] The readout circuit 130 may include a ramp voltage generator 131, a sampling circuit 132, and an analog-to-digital converter (ADC) 133. Data output from the analog-to-digital converter 133 may be input to Figure 1 Column driver 140 is shown in FIG.

[0047] The ramp voltage generator 131 may be configured to generate a ramp signal RMP in response to a ramp activation signal. The ramp signal RMP is a signal whose voltage increases or decreases in proportion to time.

[0048] The sampling circuit 132 can obtain the information from the plurality of pixels PX 11 To PX MN Some pixels connected to the row line scanned by the row driver 120 obtain a reset voltage and a pixel voltage. The sampling circuit 132 may include a plurality of samplers SA, and the plurality of samplers SA may be correlated double samplers. Each of the samplers SA may receive a ramp signal RMP of the ramp voltage generator 131 through a first input terminal, and may receive a ramp signal RMP from a plurality of pixels PX through a second input terminal. 11 To PX MN Receive a reset voltage / pixel voltage.

[0049] The analog-to-digital converter 133 may output pixel data DATA by converting the analog signal of the sampling circuit 132 into a digital signal.

[0050] The image sensor 100 may have a two-layer structure. For example, the first layer may include a pixel array and peripheral circuits (such as a row decoder, CDS, ADC), and the second layer may include logic circuits (such as a power supply circuit, I / O interface, ISP, etc.). However, the embodiment is not limited thereto. For example, the first layer may include only a pixel array, and the second layer may include peripheral circuits and logic circuits.

[0051] Figure 3 is a diagram illustrating a pixel group PXG according to an example embodiment. Figure 3 , the pixel group PXG may include four pixels PX1, PX2, PX3 and PX4. Figure 3 As shown in FIG, the pixel group PXG may include first type pixels PX1 and PX4 and second type pixels PX2 and PX3.

[0052] Each of the first type of pixels PX1 and PX4 may include a photodiode PD, a transfer transistor turned on in response to a transfer gate signal TG, a reset transistor turned on in response to a reset gate signal RG, and a first conversion gain transistor turned on in response to a first conversion gain signal CGS1. In this case, the drain of the reset transistor may be connected to a pixel drive voltage VPIX. In an example embodiment, a first floating diffusion area 111-1 or 114-1 corresponding to a first floating diffusion node FD1 may be disposed between the transfer transistor and the first conversion gain transistor. In an example embodiment, a second floating diffusion area 111-2 or 114-2 corresponding to a second floating diffusion node FD2 may be disposed between the first conversion gain transistor and the reset transistor. Each of the first type of pixels PX1 and PX4 may include two floating diffusion areas 111-1 and 111-2 and 114-1 and 114-2, respectively.

[0053] The first conversion gain transistor electrically connects the first floating diffusion node FD1 and the second floating diffusion node FD2 in response to the first conversion gain signal CGS1 , thereby controlling the capacitance of the entire floating diffusion region of the corresponding pixel.

[0054] In an example embodiment, the second floating diffusion node FD2 (111-2) of the first pixel PX1 may be connected to the second floating diffusion node FD2 (112-2) of the second pixel PX2 through the metal line 101-1 (first metal line). In an example embodiment, the second floating diffusion node FD2 (113-2) of the third pixel PX3 is connected to the second floating diffusion node FD2 (114-2) of the fourth pixel PX4 through the metal line 101-2.

[0055] Each of the second type pixels PX2 and PX3 may include a photodiode PD, a transfer transistor turned on in response to a transfer gate signal TG, a first conversion gain transistor turned on in response to a first conversion gain signal CGS1, and a second conversion gain transistor turned on in response to a second conversion gain signal CGS2. In an example embodiment, a first floating diffusion area 112-1 or 113-1 corresponding to a first floating diffusion node FD1 may be disposed between the transfer transistor and the first conversion gain transistor. In an example embodiment, a second floating diffusion area 112-2 or 113-2 corresponding to a second floating diffusion node FD2 may be disposed between the first conversion gain transistor and the second conversion gain transistor. In an example embodiment, a third floating diffusion area 112-3 or 113-3 corresponding to a third floating diffusion node FD3 may be disposed at the drain of the second conversion gain transistor. Each of the second type pixels PX2 and PX3 may include three floating diffusion areas 112-1, 112-2, 112-3 and 113-1, 113-2, and 113-3, respectively.

[0056] In an example embodiment, the third floating diffusion node FD3 ( 112 - 3 ) of the second pixel PX2 is connected to the third floating diffusion node FD3 ( 113 - 3 ) of the third pixel PX3 through the metal line 102 (second metal line).

[0057] Figure 3 The pixel group PXG shown in FIG. 4 may include adjacent pixel pairs PX1 - PX2 , PX2 - PX3 , and PX3 - PX4 that are symmetrically implemented, but the embodiment is not limited thereto.

[0058] In an example embodiment, the first metal line 101-1 (or 101-2) and the second metal line 102 may exist in the same layer. Here, the same layer may be a first metal layer (eg, M1) or a second metal layer (eg, M2).

[0059] In another example embodiment, the first metal line 101 - 1 (or 101 - 2 ) and the second metal line 102 may exist in different layers. Here, the different layers may include a first metal layer having the first metal line 101 - 1 (or 101 - 2 ) and a second metal layer having the second metal line 102 .

[0060] As an example, Figure 3 The pixel group PXG shown in FIG. 1 is composed of four pixels PX1 to PX4, however, the embodiment is not limited thereto. The pixel group PXG according to the example embodiment may have any structure in which a pixel adjacent to a pixel having at least one conversion gain transistor is disposed, and a floating diffusion node FD2 or FD3 corresponding to the conversion gain transistor is connected in a pixel adjacent to the pixel through a metal line.

[0061] Figure 4 It is shown for Figure 3 Schematic diagram of the circuit of the pixel group PXG shown in FIG. Figure 4 , the pixel group PXG may include four pixels PX1 to PX4 connected to one column line CL.

[0062] The first pixel PX1 may include a photodiode PD, a first transistor T11, a second transistor T12, a third transistor T13, a fourth transistor T14, and a fifth transistor T15. The first transistor T11 may be connected between the photodiode PD of the first pixel PX1 and the first floating diffusion node FD1, and may include a gate configured to receive a transmission gate signal TG. The second transistor T12 is connected between the first floating diffusion node FD1 of the first pixel PX1 and the second floating diffusion node FD2 of the first pixel PX1, and may include a gate receiving a first conversion gain signal CGS1. The third transistor T13 may be connected between the pixel driving voltage VPIX and the second floating diffusion node FD2 of the first pixel PX1, and may include a gate configured to receive a reset gate signal RG. The fourth transistor T14 may include a drain connected to the pixel driving voltage VPIX and a gate connected to the first floating diffusion node FD1 of the first pixel PX1. The fifth transistor T15 may include a drain connected to the source of the fourth transistor T14, a source connected to the column line CL, and a gate connected to the selection signal SEL.

[0063] The second pixel PX2 may include a photodiode PD, a first transistor T21, a second transistor T22, a third transistor T23, a fourth transistor T24, and a fifth transistor T25. The first transistor T21 may be connected between the photodiode PD of the second pixel PX2 and the first floating diffusion node FD1, and may include a gate configured to receive a transmission gate signal TG. The second transistor T22 is connected between the first floating diffusion node FD1 of the second pixel PX2 and the second floating diffusion node FD2 of the second pixel PX2, and may include a gate configured to receive a first conversion gain signal CGS1. In this case, the second floating diffusion node FD2 of the second pixel PX2 may be connected to the second floating diffusion node FD2 of the first pixel PX1 through the metal line 101-1. The third transistor T23 is connected between the second floating diffusion node FD2 of the second pixel PX2 and the third floating diffusion node FD3 of the second pixel PX2, and may include a gate configured to receive a second conversion gain signal CGS2. The fourth transistor T24 may include a drain connected to the pixel driving voltage VPIX and a gate connected to the first floating diffusion node FD1 of the second pixel PX2. The fifth transistor T25 may include a drain connected to the source of the fourth transistor T24, a source connected to the column line CL, and a gate connected to the selection signal SEL.

[0064] The third pixel PX3 may include a photodiode PD, a first transistor T31, a second transistor T32, a third transistor T33, a fourth transistor T34, and a fifth transistor T35. The first transistor T31 may be connected between the photodiode PD and the first floating diffusion node FD1 of the third pixel PX3, and may include a gate configured to receive a transmission gate signal TG. The second transistor T32 is connected between the first floating diffusion node FD1 of the third pixel PX3 and the second floating diffusion node FD2 of the third pixel PX3, and may include a gate configured to receive a first conversion gain signal CGS1. The third transistor T33 is connected between the second floating diffusion node FD2 of the third pixel PX3 and the third floating diffusion node FD3 of the third pixel PX3, and may include a gate configured to receive a second conversion gain signal CGS2. The third floating diffusion node FD3 of the third pixel PX3 may be connected to the third floating diffusion node FD3 of the second pixel PX2 through the metal line 102. The fourth transistor T34 may include a drain connected to the pixel driving voltage VPIX and a gate connected to the first floating diffusion node FD1 of the third pixel PX3. The fifth transistor T35 may include a drain connected to the source of the fourth transistor T34, a source connected to the column line CL, and a gate connected to the selection signal SEL.

[0065] The fourth pixel PX4 may include a photodiode PD, a first transistor T41, a second transistor T42, a third transistor T43, a fourth transistor T44, and a fifth transistor T45. The first transistor T41 may be connected between the photodiode PD of the fourth pixel PX4 and the first floating diffusion node FD1, and may include a gate configured to receive a transmission gate signal TG. The second transistor T42 may be connected between the first floating diffusion node FD1 of the fourth pixel PX4 and the second floating diffusion node FD2 of the fourth pixel PX4, and may include a gate configured to receive a first conversion gain signal CGS1. The third transistor T43 may be connected between the pixel driving voltage VPIX and the second floating diffusion node FD2 of the fourth pixel PX4, and may include a gate configured to receive a reset gate signal RG. In this case, the second floating diffusion node FD2 of the fourth pixel PX4 may be connected to the second floating diffusion node FD2 of the third pixel PX3 through the metal line 101-2. The fourth transistor T44 may include a drain connected to the pixel driving voltage VPIX and a gate connected to the first floating diffusion node FD1 of the fourth pixel PX4. The fifth transistor T45 may include a drain connected to the source of the fourth transistor T44 , a source connected to the column line CL, and a gate connected to the selection signal SEL.

[0066] Figure 4 Each of the pixels PX1 to PX4 shown in FIG. 4 includes five transistors, but the number of transistors constituting a pixel according to an embodiment is not limited thereto.

[0067] Figure 4 Each of the pixels PX1 to PX4 shown in FIG. 1 is connected to one photodiode, but the embodiment is not limited thereto. Figure 4 , an anode of each of the photodiodes PD is connected to a ground voltage GND.

[0068] Figure 5A and Figure 5B Pixel groups PXGa and PXGa' according to example embodiments are shown. Figure 5A ,and Figure 4 Compared to the pixel group PXG shown in , the pixel group PXGa includes a plurality of photodiodes connected to the first floating diffusion node FD1. Figure 5A The pixels of the pixel group PXGa shown in FIG. 1 are pixels of a non-shared photodiode structure. Figure 5B The pixels of the pixel group PXGa′ shown in FIG. 1 are pixels of a sharing structure that share one photodiode.

[0069] like Figure 5A and Figure 5BAs shown in , corresponding photodiodes in response to first to kth (k is an integer greater than or equal to 2) transmission gate signals TG1 to TGk may be connected to corresponding floating diffusion nodes.

[0070] exist Figure 4 , Figure 5A and Figure 5B In the case of each of the pixel groups PXG, PXGa, and PXGa' respectively shown in FIG. 1 , a plurality of pixels are connected to one column line CL, but the embodiment is not limited thereto. In the pixel group according to the example embodiment, each pixel may also be connected to each column line.

[0071] Figure 6 is a diagram showing a pixel group PXGb according to another example embodiment. Figure 6 ,and Figure 4 Compared to the pixel group PXG shown in FIG. 1 , the pixel group PXGb may include output terminals of selection transistors of corresponding pixels respectively connected to the column lines CL1 to CL4 . For example, the pixels of the pixel group PXGb may be respectively connected to the corresponding column lines.

[0072] Figures 3 to 6 Each of the pixel groups PXG, PXGa, PXGa', and PXGb shown in FIG. 1 includes pixels and adjacent pixels implemented in a symmetrical structure, but the embodiment is not limited thereto. For example, the pixel groups may also be implemented as pixels having the same structure.

[0073] Figure 7 is a diagram showing a pixel group PXGc according to another example embodiment. Figure 7 , the pixel group PXGc may include four pixels PX1a, PX2a, PX3a, and PX4a, respectively having the same structure.

[0074] Figures 3 to 7 Each of the pixel groups PXG, PXGa, PXGa′, PXGb, and PXGc shown in FIG. 4 includes four pixels, but the number of pixels included in the pixel group according to the embodiment is not limited thereto.

[0075] A pixel group according to example embodiments may be implemented using various color patterns.

[0076] Fig. 8A is a diagram showing pixels composed of a 2×2 Bayer pattern, Figure 8B is a diagram showing a pixel composed of a 4×4 quad pattern, Figure 8C is a diagram showing a pixel composed of an 8×8Q unit pattern, and Fig.8D is a diagram showing a pixel having an infrared (IR) sub-pixel.

[0077] Fig. 8A , Figure 8B , Figure 8C and Fig.8D The Bayer pattern shown in FIG. 1 includes red sub-pixels R, blue sub-pixels B, and green sub-pixels G, but the embodiment is not limited thereto. The Bayer pattern according to example embodiments may be variously configured by appropriately arranging red sub-pixels R, blue sub-pixels B, green sub-pixels G, or white sub-pixels W.

[0078] A pixel group according to example embodiments may include lenses of various sizes.

[0079] Fig.9A A quad pixel with a lens corresponding to each color sub-pixel is shown, Fig. 9B A quad pixel with lenses corresponding to four sub-pixels of the same color is shown, Fig. 9C A 4×4 color filter pixel with a lens corresponding to a 1×1 sub-pixel is shown, Fig.9D A 4×4 color filter pixel corresponding to a 2×2 sub-pixel is shown, and Fig.9E A 4x4 color filter pixel corresponding to 4x4 sub-pixels is shown.

[0080] Fig.9A , Fig. 9B , Fig. 9C , Fig.9D and Fig.9E The sizes of pixels and lenses corresponding thereto shown in are provided only as examples.

[0081] A pixel according to example embodiments may be implemented in a 2-PD structure sharing one floating diffusion region.

[0082] Fig. 10A and Fig. 10B 2-PD structure pixel. Fig. 10A , 2-PD pixels separate the left PD from the right PD by deep trench isolation (DTI) within the pixel. Fig. 10B , a 2-PD pixel separates the left PD from the right PD through a PN junction.

[0083] The floating diffusion region FD may be connected to a pair of left PDs and a pair of right PDs provided in the pixel. For example, the first floating diffusion region FD1 may be commonly connected to four photoelectric conversion elements. The floating diffusion region FD may include, for example, N-type impurities. The first transfer gate TG1 and the second transfer gate TG2 provided on the substrate of the first pixel PX1 and the first transfer gate TG1 and the second transfer gate TG2 provided on the substrate of the second pixel PX2 may share the floating diffusion region FD.

[0084] The image sensor according to example embodiments may differently control the conversion gain signals CGS1 and CGS2 according to an operation mode.

[0085] Fig.11A is an operation timing diagram of a pixel based on the first operation mode, Fig. 11B is an operation timing diagram of a pixel based on the second operation mode, Fig. 11C is an operation timing diagram of a pixel based on the third operation mode.

[0086] In the reset mode, by activating the reset gate signal RG, the charge transfer gate signal TG, and the first conversion gain signal CGS1 and the second conversion gain signal CGS2, Figure 4 The reset transistor T13 shown in Figure 4 The transfer transistor T11 shown in FIG. 1 may be turned on. Therefore, the pixel driving voltage VPIX is provided to the first floating diffusion node FD1, and the charge of the photodiode PD and the floating diffusion node FD may be initialized. Thereafter, in the optical integration mode EIT, photocharges are generated and accumulated in the photodiode PD until the transfer transistor T11 is turned off and then turned on again, for example, during the photoelectric conversion time.

[0087] In an example embodiment, the Figure 1 The operation mode of the imaging device 10 shown in FIG. 1 controls the first conversion gain signal CGS1 and the second conversion gain signal CGS2 to change the control gain for each unit pixel. For example, Fig.11A is a timing diagram having a conversion gain corresponding to the first floating diffusion node FD1 according to the first operation mode, Fig. 11B is a timing diagram having conversion gains corresponding to the first floating diffusion node FD1 and the second floating diffusion node FD2 according to the second operation mode. Fig. 11C is a timing diagram having conversion gains corresponding to the first floating diffusion node FD1 , the second floating diffusion node FD2 , and the third floating diffusion node FD3 according to the third operation mode.

[0088] According to example embodiments, according to the control of the first conversion gain signal CGS1 and the second conversion gain signal CGS2 , the size of the floating diffusion area corresponding to the operation pixel may be determined.

[0089] As described above, after controlling the conversion gain of the first pixel and the second pixel, the reset gate signal RG is deactivated, and at this time, the reference signal can be output by detecting the reset potential of the first floating diffusion node FD1. Thereafter, after outputting the reference signal, the charge transfer gate signal TG can be activated. Therefore, the photocharge accumulated in the photodiode PD can be transferred to the first floating diffusion node FD1. After the transfer gate signal TG is deactivated, the pixel signal can be output by detecting the potential of the first floating diffusion node FD1.

[0090] Fig.12FD1 is a diagram illustrating changes in capacitance of connections of floating diffusion nodes FD1 , FD2 , and FD3 of pixels PX1 , PX2 , PX3 , and PX4 according to a pixel group according to example embodiments. Fig.12 A case is shown where the second floating diffusion node FD2 of the first pixel PX1 and the second floating diffusion node FD2 of the second pixel PX2 are connected by a metal line, the second floating diffusion node FD2 of the third pixel PX3 and the second floating diffusion node FD2 of the fourth pixel PX4 are connected by a metal line, and the third floating diffusion node FD3 of the second pixel PX2 and the third floating diffusion node FD3 of the third pixel PX3 are connected by a metal line. The connection between the floating diffusion nodes using at least one metal line according to the embodiment is not limited thereto.

[0091] When the first conversion gain transistor CGT11 of the first pixel PX1 is turned off in the first operation mode, the first capacitor C1 corresponding to the first floating diffusion node FD1 of the first pixel PX1 may be formed.

[0092] According to the second operation mode, the first conversion gain transistor CGT11 of the first pixel PX1 is turned on, and the second conversion gain transistor CGT22 of the second pixel PX2 is turned off, and the second capacitor C2 corresponding to the first floating diffusion node FD1 of the first pixel PX1, the second floating diffusion node FD2 of the first pixel PX1, and the second floating diffusion node FD2 of the second pixel PX2 can be formed. In this case, the second floating diffusion node FD2 of the first pixel PX1 and the second floating diffusion node FD2 of the second pixel PX2 can be connected by a metal line.

[0093] According to the third operating mode, the first conversion gain transistor CGT11 of the first pixel PX1 is turned on, the second conversion gain transistor CGT22 of the second pixel PX2 is turned on, and the second conversion gain transistor CGT32 of the third pixel PX3 is turned on, and the third capacitor C3 corresponding to the first floating diffusion node FD1 and the second floating diffusion node FD2 of the first pixel PX1, the second floating diffusion node FD2 and the third floating diffusion node FD3 of the second pixel PX2, the second floating diffusion node FD2 and the third floating diffusion node FD3 of the third pixel PX3, and the second floating diffusion node FD2 of the fourth pixel PX4 can be formed.

[0094] Fig.11A , Fig. 11B and Fig. 11C is an example, and the embodiment is not limited thereto. For example, the reset gate signal RG and the selection signal SEL may be changed at various on / off times.

[0095] like Fig.12As shown in , various capacitances for pixel operation can be formed according to the on / off operation of the conversion gain transistor connected to the floating diffusion node of each pixel.

[0096] Fig.13A is a diagram showing a size FD1 of a floating diffusion area corresponding to a pixel according to a first operation mode, Fig. 13B is a diagram showing the size (FD1+2FD2) of the floating diffusion area corresponding to the pixel according to the second operation mode, Fig. 13C FD1 is a diagram showing the size (FD1+4FD+2FD3) of the floating diffusion area corresponding to the pixel according to the third operation mode. Fig.13A , Fig. 13B and Fig. 13C As shown in , the size of the floating diffusion area may vary according to the operation mode. The change in the size of the floating diffusion area may change the level of the voltage converted according to the same amount of charge transferred from the photodiode FD, and the level of the voltage indicates the adjustment of the conversion gain.

[0097] The image sensor 100 according to example embodiments may have an optimal conversion gain by changing the size of a floating diffusion area according to three or more operation modes.

[0098] Fig.14A is a diagram showing a process of generating an image signal in a unit pixel in an image capturing mode in a time series, Fig. 14B It is a diagram showing a process of generating an image signal in a unit pixel in the image recognition mode in a time series.

[0099] like Fig.14A As shown in , the pixel circuit can generate an image signal by the process of exposure, reset and transmission in the image capture mode. First, after the reset transistor RX and the transfer transistor TX are turned on, the reset transistor RX and the transfer transistor TX can be turned off and exposed to light. At this time, the selection transistor SX is turned on to read the reset voltage level. Thereafter, the transfer transistor TX can be turned on to transfer the photocharge generated in the photodiode PD to the FD node within a predetermined time, thereby reading the signal voltage level. In this case, in order to transfer all the charges of the photodiode PD to the FD node, the FD node needs to be reset to a relatively high power supply voltage. In this case, when a high power supply voltage is used, the power consumption increases. The difference between the read signal voltage level and the reset voltage level can be an image signal of the circuit of the pixel corresponding to the light input within a predetermined time.

[0100] like Fig. 14B As shown in , in the image recognition mode, the pixel circuit can generate an image signal through the processes of reset, exposure and readout. Fig. 14BAs shown in , in the image recognition mode, the transfer transistor TX can be always turned on. Therefore, the photodiode PD and the FD node can be turned on. In the image recognition mode, a method of reading the voltage of electrons accumulated in the photodiode PD and the FD node can be used instead of using the electron transfer method which is the operating method of the pixel circuit in the image capture mode. Hereinafter, a method of reading the voltage of electrons accumulated in the photodiode PD and the FD node in the pixel circuit in the image recognition mode will be described.

[0101] Reference Fig. 14B , because a direct current (DC) voltage is applied to the transfer transistor TX and the transfer transistor TX is always turned on, the electron potentials of the photodiode PD and the FD node are the same. At this time, even when a DC voltage is applied to the transfer transistor TX, because no current flows through the gate of the transfer transistor TX, the power consumption at the gate of the transfer transistor TX can be zero.

[0102] First, the reset transistor RX can use a low power supply voltage to set the FD node that is turned on with the photodiode PD to a reset voltage level. The pixel circuit can then be exposed to light for a period of time. The selection transistor can be turned on to obtain the signal voltage level of the FD node that is changed by the incident light. In this way, the difference between the read signal voltage level and the reset voltage level can be an image signal of the circuit of the pixel corresponding to the light input within the predetermined timing interval. Unlike the electronic transfer method in the image capture mode, it is not necessary to ensure a high reset voltage for charge transfer in the image recognition mode, and therefore, a reset by a relatively low voltage can be performed, and similarly, even when the charge is gradually reduced, the voltage of the source follower can be reduced and the image signal can be read.

[0103] In reference Figures 3 to 14B In the described pixel group, any pixel and an adjacent pixel have different structures, but the embodiment is not limited thereto. The pixel group according to example embodiments may be implemented using pixels having the same configuration.

[0104] Fig.15A , Fig. 15B and Fig. 15C is a diagram illustrating pixels PXGd, PXGe, and PXGf according to another example embodiment.

[0105] Reference Fig.15A, the pixel PXGd may include a transmission transistor TX, a source follower transistor SFX, a selection transistor SX, a reset transistor RX, and conversion gain transistors CGT1 and CGT2. The transmission transistor TX may connect the photodiode PD to the first floating diffusion node FD1 in response to the transmission gate signal TG. The source follower transistor SFX may provide the pixel driving voltage VPIX to the drain of the selection transistor SX in response to the voltage of the first floating diffusion node FD1. The selection transistor SX may connect the drain of the source follower transistor SFX to the output terminal OUT in response to the selection signal SEL. The reset transistor RX may connect the power supply terminal providing the pixel driving voltage VPIX to the third floating diffusion node FD3 in response to the reset gate signal RG. The first conversion gain transistor CGT1 may connect the first floating diffusion node FD1 to the second floating diffusion node FD2 in response to the first conversion gain signal CGS1. The second conversion gain transistor CGT2 may connect the second floating diffusion node FD2 to the third floating diffusion node FD3 in response to the second conversion gain signal CGS2.

[0106] The pixel PXGd according to example embodiments may control the conversion gain signals CGS1 and CGS2 according to an operation mode to obtain an appropriate conversion gain by changing the size of the floating diffusion area.

[0107] Reference Fig. 15B , two photodiodes may be connected to the first floating diffusion node FD1 of the pixel PXGe. The two photodiodes may be connected to the first floating diffusion node FD1 through transfer transistors TX1 and TX2 that are turned on in response to corresponding transfer gate signals TG1 or TG2, respectively.

[0108] Reference Fig. 15C , one photodiode may be connected to the first floating diffusion node FD1 of the pixel PXGf. One photodiode may be connected to the first floating diffusion node FD1 through a transfer transistor TX1 or TX2 turned on in response to a transfer gate signal TG1 or TG2.

[0109] Fig.16 is a diagram illustrating a layout arrangement of a pixel group according to an example embodiment. Fig.16 In each pixel, the gate of the transfer transistor receiving the transfer gate signal TG is set on the lower right side, the gate of the first conversion gain transistor receiving the first conversion gain signal CGS1 is set on the lower left side, and on the upper left side, the gate of the reset transistor receiving the reset gate signal RG can be set or the gate of the second conversion gain transistor receiving the second conversion gain signal CGS2 can be set.

[0110] In an example embodiment, the first floating diffusion node FD1 may be disposed near the gate of the transfer transistor, the second floating diffusion node FD2 may be disposed near the gate of the first conversion gain transistor, the third floating diffusion node FD3 may be disposed near the gate of the second conversion gain transistor, and the power terminal receiving the pixel driving voltage VPIX may be disposed near the gate of the reset transistor.

[0111] Fig.16 The arrangement of gate / power terminals / floating diffusion nodes of transistors shown in FIG. 1 is merely an example.

[0112] An image sensor according to example embodiments may include a plurality of pixel arrays.

[0113] Fig.17 is a diagram illustrating an image sensor 300 according to another example embodiment. Fig.17 , the image sensor 300 includes a pixel array 310 , a control unit 325 , a row decoder 333 , a row driver 335 , a column decoder 353 , a column driver 355 , and an ADC 370 .

[0114] The pixel array 310 may detect light reflected from an object to generate object information OBI1 and / or image information IMI of the object. The pixel array 310 may include a plurality of pixels arranged in the form of a two-dimensional matrix. The pixel array 310 may include a plurality of pixel layers 311, 313, and 315. In an example embodiment, the first pixel layer 311 may be a color pixel array (CPA). For example, the color pixel array may have pixels of a Bayer pattern. In an example embodiment, the second pixel layer 313 may be a depth pixel array (DPA). For example, the depth pixel array may include a plurality of 2-PD pixels or metal shielding pixels. In an example embodiment, the second pixel layer 313 may include at least one temperature sensor to perform depth correction according to temperature. In an example embodiment, the third pixel layer 315 may be a thermal pixel array (TPA). For example, the thermal pixel array may include a plurality of temperature pixels.

[0115] The number of pixel arrays according to the embodiment is not limited thereto.The pixel array according to example embodiments may include at least two pixel layers to perform different functions.

[0116] The control unit 325 may generate one or more control signals to control the corresponding operations of the row decoder 333, the row driver 335, the column decoder 353, the column driver 355, and the plurality of ADCs 371, 373, and 375. For example, the control unit 325 may generate a plurality of row control signals to select a specific row line from among a plurality of row lines included in each of the plurality of stacked pixel layers 311, 313, and 315. In an example embodiment, the control unit 325 may be disposed on a layer different from that of the pixel array 310.

[0117] The row decoder 333 may decode a plurality of row control signals (e.g., row address signals output from the control unit 325), and may output a plurality of row selection signals according to the decoding results. The row driver 335 may drive pixels included in at least one row among a plurality of rows included in a plurality of corresponding pixel layers 311, 313, and 315 in response to a plurality of corresponding row selection signals output from the row decoder 333.

[0118] The column decoder 353 may decode a plurality of column control signals (e.g., column address signals output from the control unit 325), and may output a plurality of column selection signals according to the decoding results. The column driver 355 may drive a plurality of corresponding column lines included in a plurality of corresponding pixel layers 311, 313, and 315 in response to a plurality of corresponding column selection signals output from the column decoder 353.

[0119] Fig.17 The image sensor 300 shown in FIG. 1 includes one row driver 335 and one column driver 355, however the embodiment is not limited thereto. According to example embodiments, the image sensor 300 may include a plurality of row drivers or a plurality of column drivers to drive row lines or column lines of a plurality of corresponding pixel layers 311, 313, and 315. The image sensor 300 may include a plurality of row decoders or a plurality of column decoders.

[0120] Each of the plurality of ADCs 371, 373, and 375 analog-to-digital converts signals output from the plurality of corresponding pixel layers 311, 313, and 315, and may output the analog-to-digital converted signals as image data to an image signal processor (ISP) 200. For example, the image data may include object information or image information.

[0121] According to example embodiments, each of the plurality of ADCs 371, 373, and 375 may further include a correlated double sampling (CDS) circuit that performs correlated double sampling on signals output from the plurality of corresponding pixel layers 311, 313, and 315. In this case, each of the plurality of ADCs 371, 373, and 375 may compare the correlated double sampling signal and the ramp signal, and may output the comparison result as image data.

[0122] The image signal processor (ISP) 200 may process the image data so that the image data may be displayed. In addition, the image signal processor (ISP) 200 may control the control unit 325 so that the image sensor 300 has the same image processing as described above. Figures 1 to 17 The optimum conversion gain for the described operating mode.

[0123] Fig.18 1 is a block diagram illustrating an electronic device 1000 according to an example embodiment. In a network environment, the electronic device 1000 may communicate with other electronic devices through a first network (eg, short-range wireless communication) or communicate with another electronic device or a server through a second network (eg, long-range wireless communication).

[0124] Reference Fig.18 , the electronic device 1000 may include a processor 1200, a memory 1300, an input device 1500, a sound output device 1550, a display device 1600, an audio device 1700, a sensor device 1760, an interface 1770, a haptic device 1790, a camera device 1800, a power management device 1880, a battery 1890, a communication interface 1900, a user recognition device 1960, and an antenna device 1970. According to example embodiments, at least one of the components may be omitted or another component may be added to the electronic device 1000. For example, the display device 1600 may be implemented by integrating some components, such as integrating a fingerprint sensor, an iris sensor, or an illumination sensor in the case of the embedded sensor device 1760.

[0125] The processor 1200 drives software (eg, program 1400 ) to control at least one other component (eg, hardware component or software component) of the electronic device 1000 connected to the processor 1200 , and may perform various data processing and operations.

[0126] The processor 1200 loads a command or data received from another component (eg, the sensor device 1760 and the communication interface 1900 ) into the volatile memory 1320 and processes it, and may store the result data in the nonvolatile memory 1340 .

[0127] In an example embodiment, processor 1200 may operate independently of a main processor 1210 (e.g., a central processing unit or an application processor), and additionally / optionally may include a coprocessor 1230 (e.g., a graphics processing processor, an image signal controller, a sensor hub processor, a communication processor, an artificial intelligence processor) that uses less power than the main processor 1210 or is dedicated to a specified function.

[0128] The coprocessor 1230 may operate separately from the main processor 1210 or by being embedded. The coprocessor 1230 may replace the main processor 1210 when the main processor 1210 is in an inactive or sleep state, or may operate together with the main processor 1210 when the main processor 1210 is in an active state or an application execution state to control at least a portion of a function or state associated with at least one of the components of the electronic device 1000 (e.g., the display device 1600, the sensor device 1760, or the communication interface 1900). In an example embodiment, the coprocessor 1230 may be implemented as a part of other functionally related components (e.g., the camera device 1800 or the communication interface 1900).

[0129] The memory 1300 may store various data (e.g., software and input data or output data for instructions related thereto) used by at least one component (e.g., the processor 1200 or the sensor device 1760) of the electronic device 1000. The memory 1300 may include a volatile memory 1320 or a nonvolatile memory 1340.

[0130] The program 1400 is software stored in the memory 1300 , and may include an operating system 1420 , middleware 1440 , or an application 1460 .

[0131] The input device 1500 is a device for receiving a command or data to be used for a component (processor 1200 ) of the electronic device 1000 from an external user of the electronic device 1000 , and for example, the input device 1500 may include a microphone, a mouse, or a keyboard.

[0132] The sound output device 1550 is a device for outputting an audio signal to the outside of the electronic device 1000. For example, the sound output device 1550 may include a speaker for general use (such as multimedia playback or recording playback) and a receiver only for receiving calls. In an exemplary embodiment, the receiver may be formed integrally with or separately from the speaker.

[0133] The display device 1600 may be implemented to visually provide information to a user of the electronic device 1000. For example, the display device 1600 may include a control circuit such as a display, a holographic device, a projector, and a control device. In an example embodiment, the display device 1600 may include a touch circuit or a pressure sensor that can measure the intensity of the pressure of the touch.

[0134] The audio device 1700 can convert sound and electrical signals bidirectionally. In an exemplary embodiment, the audio device 1700 obtains sound through the input device 1500, or can output sound through the sound output device 1550 or an external electronic device (e.g., a speaker or earphone) connected to the electronic device 1000 in a wired or wireless manner.

[0135] The sensor device 1760 may generate an electrical signal or data value corresponding to an internal operating state (such as a power state or temperature of the electronic device 1000) or an external environmental state. For example, the sensor device 1760 may include a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric information sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0136] The interface 1770 may support a specified protocol that may be connected to an external electronic device by wire or wirelessly. In an example embodiment, the interface 1770 may include a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0137] The connection terminal 1780 may include a connector (eg, an HDMI connector, a USB connector, an SD card connector, or an audio connector such as a headphone connector) to physically connect the electronic device 1000 and an external electronic device.

[0138] The haptic device 1790 may convert an electrical signal into an electrical stimulus or a mechanical stimulus (such as vibration or movement) that may be sensed by a user through sensing of touch or movement. The haptic device 1790 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0139] The camera device 1800 may be configured to capture still images and videos. In an example embodiment, the camera device 1800 may include one or more lenses, image sensors, image signal controllers, or flashes. The camera device 1800 may be configured to capture still images and videos. Figures 1 to 17 The three or more operation modes described in the embodiment are used to control the pixel to optimally select the conversion gain.

[0140] The power management device 1880 is a device for managing power supplied to the electronic device 1000, and may be configured as, for example, at least a portion of a power management integrated circuit (PMIC). The battery 1890 is a device for supplying power to at least one component of the electronic device 1000, and may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0141] The communication interface 1900 may support the establishment of a wired communication channel or a wireless communication channel between the electronic device 1000 and an external electronic device, and communicate through the established communication channel. The communication interface 1900 may include one or more communication processors that support wired communication or wireless communication, and the one or more communication processors operate independently of the processor 1200, which may be an application processor.

[0142] According to an example embodiment, the communication interface 1900 may include a wireless communication module 1920 (e.g., a cellular communication interface, a short-range wireless communication interface, or a global navigation satellite system (GNSS) communication interface) or a wired communication module 1940 (e.g., a local area network (LAN) communication interface or a power line communication interface). The communication interface 1900 may communicate with an external electronic device through a first network (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (LAN or WAN)) using a corresponding wired / wireless communication interface. In an example embodiment, the communication interface 1900 may be implemented in one chip or in a separate chip.

[0143] In an example embodiment, the wireless communication module 1920 may distinguish and authenticate the electronic device 1000 in the communication network using user information stored in the user identification device 1960 .

[0144] The antenna device 1970 may include one or more antennas for transmitting or receiving signals or power to or from the outside. In an example embodiment, the communication interface 1900 may transmit or receive signals to or from an external electronic device through an antenna suitable for a communication method.

[0145] Some of the components are connected to each other via a communication method between peripheral devices such as a bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI) to exchange signals such as commands or data with each other.

[0146] In an example embodiment, commands or data may be sent or received between the electronic device 1000 and an external electronic device through a server connected to the second network. The electronic devices may be devices of the same or different types as the electronic device 1000, respectively. According to an example embodiment, all or part of the operations performed in the electronic device 1000 may be performed in another external electronic device or multiple external electronic devices. According to an example embodiment, when the electronic device 1000 automatically or by request to perform a function or service, instead of performing the function or service by itself, or in addition to performing the function or service by itself, the electronic device 1000 may request the external electronic device to perform at least some related functions. Upon receiving the request, the external electronic device may perform the requested function or additional function, and the result may be sent to the electronic device 1000. The electronic device 1000 may provide the requested function or service by processing the received result as is or additionally. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

[0147] The electronic device 1000 may be various types of devices. For example, the electronic device 1000 may include at least one of a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.

[0148] As used herein, the term device may include a unit composed of hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component or circuit. The device may include various embodiments in the document of a component of an overall structure that can be implemented in software (e.g., program 1400), and program 1400 includes instructions stored in a machine (e.g., a computer-readable storage medium such as internal memory 1360 or external memory 1380). The device may be a device that can call a stored command from a storage medium and operate according to the called command, and may include an electronic device (e.g., an electronic device 1000 according to an example embodiment). When the instruction is executed by a processor (e.g., processor 1200), the processor may directly perform the function corresponding to the instruction by the processor, or may perform the function corresponding to the instruction by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. In this case, "non-transitory" means that the storage medium does not include a signal and is tangible, but does not distinguish whether the data is stored on the storage medium semi-permanently or temporarily.

[0149] Fig.19A and Fig.19B 2 is a diagram schematically illustrating a mobile device 2000 according to an example embodiment. Fig.19A and Fig.19B , the mobile device 2000 may include a housing 2200, a display 2500, cameras 2600, 2700, and 2800, etc. According to an example embodiment, the display 2500 may substantially cover the entire front surface of the housing 2200, and according to an operation mode of the mobile device 2000 or an application being executed, the display 2500 may include a first area 2300, a second area 2400, etc. for operation.

[0150] Reference Fig.19A , the front cameras 2600 and 2700 may include a first front camera 2600 and a second front camera 2700 with different characteristics. For example, the first front camera 2600 and the second front camera 2700 may have different aperture values, focal lengths, viewing angles, etc. In this case, the first front camera 2600 may be a general camera, and the second front camera 2700 may be a time-of-flight (ToF) camera. When the second front camera 2700 is a ToF camera, the second front camera 2700 may be combined with a separate light source to provide functions such as distance measurement, depth map generation, and facial recognition.

[0151] Referring to the rear surface of the mobile device 2000, Fig.19B , the mobile device 2000 may include a rear camera 2800 and a light emitting unit 2900. Similar to the front cameras 2600 and 2700, the rear camera 2800 may include a plurality of rear cameras 2800A to 2800C in which at least one of the aperture value, the viewing angle, and the number of pixels of the image sensor is different from each other. The light emitting unit 2900 may employ a light emitting diode (LED) or the like as a light source, and may operate as a flash in an application using the rear camera 2800.

[0152] Each of the plurality of cameras 2600, 2700, and 2800 may include a lens, an image sensor, a motor, and an engine. In this case, the image sensor may be Figures 1 to 17 The above is achieved by changing the conversion gain of the pixel according to the operation mode.

[0153] The image sensor can provide RGB data based on a clock signal. For example, the image sensor can be connected to the engine interface via a mobile industrial processor interface (MIPI) or a camera serial interface (CSI). The motor can adjust the focus of the lens or execute a shutter in response to a control signal received from the engine. The engine can control the image sensor and the motor. The engine can also generate YUV data including a brightness component, a difference between the brightness component and a blue component, and a difference between the brightness component and a red component based on the RGB data received from the image sensor, or can generate compressed data (e.g., Joint Photographic Experts Group (JPEG) data). The engine can be connected to a host / application, and the engine can provide YUV data or JPEG data to the host / application based on a master clock. In addition, the engine can communicate with the host / application via a serial peripheral interface (SPI) or an internal integrated circuit (I 2 C) Interface with host / application.

[0154] Fig. 20 1 is a diagram illustrating a method of operating the imaging device 10 according to an example embodiment. Figures 1 to 20 , the method of operating the imaging device 10 will be described below. The imaging device 10 may receive an operating mode (S110). The operating mode may be determined according to a user's selection or an internal policy. The image sensor of the imaging device 10 may control at least one transistor to be turned on / off according to the operating mode selected thereafter to change the size of the floating diffusion area of ​​the pixel (S120). In this case, the size of the floating diffusion area may be adjusted by using the junction capacitance or metal capacitance around the pixel. Therefore, the conversion gain corresponding to the size of the floating diffusion area appropriately selected according to the operating mode may be determined.

[0155] According to the pixel of the example embodiment, three or more conversion gains (CG) can be realized. In an example embodiment, the pixel can be implemented as a non-shared pixel structure or a shared pixel structure. In an example embodiment, the conversion gain of the pixel can be changed using the capacitance of the surrounding pixels. In an example embodiment, the conversion gain of the pixel can be changed using the capacitance of the pixel in the row direction and the column direction. In an example embodiment, the conversion gain of the pixel can be changed from a unit pixel to a multi-switch (multi-transistor) by a CG ratio.

[0156] The image sensor according to example embodiments may be applied to a dynamic vision sensor (DVS).

[0157] As described above, in an image sensor, an imaging device including the image sensor, and a method of operating the image sensor according to example embodiments, a conversion gain may be controlled by adjusting a size of a floating diffusion region of a pixel according to three or more operation modes.

[0158] While example embodiments have been shown and described above, it will be apparent to those skilled in the art that modifications and variations may be made without departing from the scope of the inventive concept as defined in the appended claims.

Claims

1. An image sensor, the image sensor include: A first pixel includes a first floating diffusion region and a second floating diffusion region; a second pixel including a first floating diffusion region, a second floating diffusion region and a third floating diffusion region; a third pixel including a first floating diffusion region, a second floating diffusion region and a third floating diffusion region; as well as A fourth pixel includes a first floating diffusion region and a second floating diffusion region, The second floating diffusion region of the first pixel and the second floating diffusion region of the second pixel are connected by a first metal line, and The third floating diffusion area of ​​the second pixel and the third floating diffusion area of ​​the third pixel are connected via a second metal line. Wherein, each of the second pixel and the third pixel includes a second conversion gain transistor, and the second conversion gain transistor is directly set between the second floating diffusion node of each of the second pixel and the third pixel and the third floating diffusion node corresponding to the third floating diffusion area of ​​each of the second pixel and the third pixel based on the second conversion gain signal.

2. The image sensor according to claim 1, in, Each of the first pixel, the second pixel, the third pixel, and the fourth pixel further includes at least one photodiode.

3. The image sensor according to claim 2, in, Each of the first pixel, the second pixel, the third pixel, and the fourth pixel includes: a transfer transistor configured to: connect the at least one photodiode to a first floating diffusion node corresponding to a first floating diffusion region of each of the first pixel, the second pixel, the third pixel, and the fourth pixel based on a transfer gate signal; and The first conversion gain transistor is configured to connect the first floating diffusion node with a second floating diffusion node corresponding to a second floating diffusion region of each of the first pixel, the second pixel, the third pixel, and the fourth pixel based on a first conversion gain signal.

4. The image sensor according to claim 3, in, Each of the first pixel and the fourth pixel includes a reset transistor configured to provide a pixel driving voltage to a second floating diffusion node of each of the first pixel and the fourth pixel based on a reset gate signal.

5. The image sensor according to any one of claims 1 to 4, in, The second floating diffusion region of the third pixel and the second floating diffusion region of the fourth pixel are connected through a metal line.

6. The image sensor according to any one of claims 1 to 4, in, Each of the first pixel, the second pixel, the third pixel, and the fourth pixel includes: a source follower transistor including a gate connected to a first floating diffusion node corresponding to a first floating diffusion region of each of the first pixel, the second pixel, the third pixel, and the fourth pixel, and a drain receiving a pixel driving voltage; and The selection transistor includes a gate receiving a selection signal, a drain connected to the source of the source follower transistor, and a source connected to an output line.

7. The image sensor according to any one of claims 1 to 4, in, The first pixel and the second pixel are symmetrical to each other, wherein the second pixel and the third pixel are symmetrical to each other, and The third pixel and the fourth pixel are symmetrical to each other.

8. An image sensor, the image sensor include: First pixel; The second pixel; The third pixel; as well as The fourth pixel, Wherein, each of the first pixel to the fourth pixel comprises: a first transistor configured to connect at least one photodiode to a first floating diffusion node based on a transfer gate signal; a second transistor configured to connect the first floating diffusion node to a second floating diffusion node based on a first conversion gain signal; a third transistor including a source connected to the second floating diffusion node; a fourth transistor including a drain and a gate, the drain being connected to a power supply terminal configured to provide a pixel driving voltage, and the gate being connected to the first floating diffusion node; and a fifth transistor including a drain connected to the source of the fourth transistor, a source connected to a column line, and a gate configured to receive a selection signal, The second floating diffusion node of the first pixel and the second floating diffusion node of the second pixel are connected by a metal line. The second floating diffusion node of the third pixel and the second floating diffusion node of the fourth pixel are connected by a metal line, and The third floating diffusion node of the second pixel and the third floating diffusion node of the third pixel are connected through a metal line.

9. The image sensor according to claim 8, in, The first pixel, the second pixel, the third pixel, and the fourth pixel are connected to one column line.

10. The image sensor according to claim 8, in, Each of the first pixel, the second pixel, the third pixel, and the fourth pixel is connected to a corresponding column line.

11. The image sensor according to claim 8, in, The at least one photodiode is implemented in a dual photodiode structure separated by deep trench isolation.

12. The image sensor according to claim 8, in, The at least one photodiode is implemented in a dual photodiode structure separated by a PN junction.

13. The image sensor according to any one of claims 8 to 12, in, The third transistor of each of the first pixel and the fourth pixel connects the power supply terminal with the second floating diffusion node based on a reset gate signal.

14. The image sensor according to claim 13, in, The third transistor of each of the second pixel and the third pixel connects the second floating diffusion node with the third floating diffusion node based on a second conversion gain signal.

15. The image sensor according to claim 14, in, The image sensor further includes a timing controller configured to control timing of the first conversion gain signal and the second conversion gain signal to change a size of a floating diffusion region of a pixel based on an operation mode.

16. A method of operating an imaging device, the method include: receiving an operating mode from an image sensor; as well as controlling the size of the floating diffusion region of the pixel group according to the received operation mode, The operation mode includes at least three operation modes: Wherein, the pixel group includes: A first pixel includes a first floating diffusion region and a second floating diffusion region; a second pixel including a first floating diffusion region, a second floating diffusion region and a third floating diffusion region; a third pixel including a first floating diffusion region, a second floating diffusion region, and a third floating diffusion region; and A fourth pixel includes a first floating diffusion region and a second floating diffusion region, The second floating diffusion region of the first pixel and the second floating diffusion region of the second pixel are connected by a first metal line, and The third floating diffusion area of ​​the second pixel and the third floating diffusion area of ​​the third pixel are connected via a second metal line. Wherein, each of the second pixel and the third pixel includes a second conversion gain transistor, and the second conversion gain transistor is directly set between the second floating diffusion node of each of the second pixel and the third pixel and the third floating diffusion node corresponding to the third floating diffusion area of ​​each of the second pixel and the third pixel based on the second conversion gain signal.

17. The method according to claim 16 in, Each of the first pixel, the second pixel, the third pixel, and the fourth pixel includes: The first conversion gain transistor is configured to connect the first floating diffusion region of each of the first pixel, the second pixel, the third pixel and the fourth pixel with the second floating diffusion region of each of the first pixel, the second pixel, the third pixel and the fourth pixel based on a first conversion gain signal.

18. The method according to claim 17, in, The step of controlling the size of the floating diffusion area includes controlling a timing of providing the first conversion gain signal and the second conversion gain signal based on the operation mode to change the size of the floating diffusion area.