Image sensor supporting auto focus and high dynamic range and method of operating the same

Abstract

An image sensor including a pixel array including a plurality of pixel groups and configured to output a pixel signal, and a readout circuit configured to output a first image signal during a first readout period and a second image signal during a second readout period based on the pixel signal. The plurality of pixel groups can each include a plurality of pixels sharing a micro-lens. During the first readout period, a first pixel group can output a first (1-1) pixel signal obtained by summing pixel signals of some pixels disposed at positions having opposite phase information in a predetermined direction with respect to the micro-lens, and a second pixel group and a third pixel group can output a first (1-2) pixel signal obtained by summing pixel signals of some pixels disposed at positions having the same phase information in the predetermined direction with respect to the micro-lens.

Description

[0001] Cross-references to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2024-0177682, filed on December 3, 2024, with the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] The example embodiments relate to complementary metal-oxide-semiconductor (CMOS) image sensors, and more specifically, to image sensors that support autofocus (AF) and high dynamic range (HDR). Background Technology

[0004] The image sensor is configured to convert light signals into electrical signals.

[0005] Image sensors have been developed to enhance the dynamic range of images to improve quality in different environments, while reducing pixel size to increase resolution. Furthermore, autofocus functionality is used in image sensors to automatically detect focus. Phase difference autofocus (PDAF) adjusts the focus based on the phase difference of light signals sensed by different photoelectric conversion elements such as photodiodes. Summary of the Invention

[0006] An example embodiment provides an image sensor that can generate image data with high dynamic range (HDR) and phase information for autofocus, even in environments where some pixel signals are saturated.

[0007] According to one aspect of an example embodiment, an image sensor is provided, comprising: a pixel array including a plurality of pixel groups and configured to output pixel signals; and a readout circuit configured to output a first image signal based on pixel signals output during a first readout period and to output a second image signal based on pixel signals output during a second readout period, wherein each of the plurality of pixel groups includes a plurality of pixels sharing a microlens, and wherein, during the first readout period, the first pixel group of the plurality of pixel groups is configured to output a first (1-1) pixel signal obtained by summing pixel signals of some pixels disposed at positions having opposite phase information relative to the microlens in a predetermined direction, and the second and third pixel groups of the plurality of pixel groups are configured to output a first (1-2) pixel signal obtained by summing pixel signals of some pixels disposed at positions having the same phase information relative to the microlens in a predetermined direction.

[0008] According to one aspect of an example embodiment, an image sensor is provided, comprising: a pixel array including a plurality of pixel groups and configured to output a first pixel signal during a first readout period and a second pixel signal during a second readout period for each of the plurality of pixel groups; at least one microlens disposed above each of the plurality of pixel groups to overlap with each of the plurality of pixel groups in a direction perpendicular to a substrate of the image sensor and shared by the plurality of pixels; and a readout circuit configured to output an image signal based on the first pixel signal and the second pixel signal, wherein, during the first readout period, the first pixel group among the plurality of pixel groups is configured to output a first pixel signal as a (1-1)th pixel signal obtained by summing the pixel signals of the first pixel, and the second pixel group and the third pixel group among the plurality of pixel groups are configured to output a first pixel signal as a (1-2)th pixel signal obtained by summing the pixel signals of the second pixel, and wherein the first pixel in the first pixel group is symmetrically disposed in a horizontal direction with respect to the vertical central axis of the at least one microlens, and the second pixel in the second pixel group and the third pixel group is disposed at a position along the horizontal direction.

[0009] According to one aspect of an example embodiment, a method for operating an image sensor is provided, comprising: outputting a first pixel signal and a second pixel signal from a plurality of pixel groups; outputting a first image signal and a second image signal based on the first pixel signal and the second pixel signal, respectively, by a readout circuit; and outputting phase data based on the first image signal and the second image signal by an image signal processing circuit. The first pixel signal may include a (1-1)th pixel signal and a (1-2)th pixel signal. At least one of the plurality of pixel groups is configured to output a (1-1)th pixel signal obtained by summing pixel signals of some pixels disposed at positions having opposite phase information and corresponding to a microlens, and other pixel groups of the plurality of pixel groups are configured to output a (1-2)th pixel signal obtained by summing pixel signals of some pixels disposed at positions having the same phase information and corresponding to a microlens. Attached Figure Description

[0010] The above and / or other aspects will become more apparent from the description of specific embodiments with reference to the accompanying drawings, in which:

[0011] Figure 1 This is a block diagram illustrating the configuration of an image sensor according to an example embodiment;

[0012] Figures 2A to 2C This is a diagram illustrating pixels according to an example embodiment;

[0013] Figure 3 It is a plan view of the pixel group according to the example embodiment;

[0014] Figure 4 This is a circuit diagram of a pixel group according to an example embodiment;

[0015] Figure 5 This is a graph showing the changes in the image signal according to the comparison example;

[0016] Figure 6 This is a diagram illustrating image signals according to an example embodiment;

[0017] Figure 7A and Figure 7B This is a diagram illustrating pixel signals according to an example embodiment;

[0018] Figure 8 It is based on Figure 7A and Figure 7B A timing diagram of the control signals provided to the pixel group in an example embodiment;

[0019] Figure 9 This is a diagram illustrating pixel signals according to an example embodiment;

[0020] Figures 10A to 10D This is a diagram illustrating pixel signals according to an example embodiment;

[0021] Figure 11 This is a block diagram illustrating the configuration of a high dynamic range (HDR) processing circuit in an image signal processing circuit according to an example embodiment;

[0022] Figure 12 This is a diagram illustrating the color transfer operation of an HDR processing circuit according to an example embodiment;

[0023] Figure 13 This is a block diagram illustrating the configuration of an autofocus (AF) processing circuit in an image signal processing circuit according to an example embodiment;

[0024] Figure 14 This is a block diagram illustrating the configuration of the AF processing circuit in an image signal processing circuit according to an example embodiment;

[0025] Figure 15 and Figure 16 This is a block diagram of an image sensor according to an example embodiment;

[0026] Figure 17 This is a block diagram of an imaging device according to an example embodiment; and

[0027] Figure 18 and Figure 19 This is a flowchart illustrating a method for operating an image sensor according to an example embodiment. Detailed Implementation

[0028] In the following description, exemplary embodiments will be illustrated with reference to the accompanying drawings.

[0029] Figure 1 This is a block diagram of an image sensor 100 according to an example embodiment.

[0030] In autofocus mode, pixel array 110 can output a first pixel signal PXS1 during a first readout period and a second pixel signal PXS2 during a second readout period. Some pixel groups PG of pixel array 110 can output the first pixel signal PXS1 with phase information removed or reduced during the first readout period. Other pixel groups of pixel array 110 can output the first pixel signal PXS1 including phase information during the first readout period. Each pixel group PG of pixel array 110 can output the second pixel signal PXS2 during the second readout period, which is a combination of pixel signals from all pixels within pixel group PG.

[0031] Reference Figure 1 A detailed description of the image sensor 100 according to an example embodiment.

[0032] The image sensor 100 can output image data based on visual information of an object captured by the lens.

[0033] The image sensor 100 may include a pixel array 110, a line driver 120, a timing controller 130, a ramp signal generator 140, a readout circuit 150, and an image signal processing circuit 160.

[0034] Pixel array 110 may include multiple pixel groups PG. Pixel group PG may include multiple pixels. This will be described in more detail later with reference to 2.

[0035] Pixel array 110 can receive multiple pixel drive signals CS from row driver 120, such as select signals for controlling select transistors, reset signals for controlling reset transistors, and transfer transistor control signals for controlling transfer transistors. Each of the multiple pixel units PXU in pixel array 110 can operate under the control of the pixel drive signals CS received from row driver 120. Multiple pixels included in each pixel group PG can operate under the control of the pixel drive signals CS received from row driver 120.

[0036] Multiple pixel groups PG can be arranged, for example, in a matrix. In an example embodiment, each of the multiple pixel groups PG and / or each pixel within a pixel group PG can be electrically connected to row lines and column lines.

[0037] Each pixel group (PG) may include multiple pixels. Each of the multiple pixels may include a photoelectric conversion element.

[0038] Multiple pixels can generate photocharge based on light signals received through the lens and color filter.

[0039] In an example embodiment, the image sensor 100 may include a Bayer mode color filter. The example embodiment of the image sensor 100 including a Bayer mode color filter is described below. However, the example embodiment is not limited to a Bayer mode color filter and may include various color filter arrays, such as RGBW, RYB, CMYG, etc. The first pixel group, the second pixel group, and the third pixel group may be configured to correspond to a green, red, and blue color filter, respectively, corresponding to the Bayer mode. When the image sensor 100 includes different types of color filters, the color filter with the highest sensitivity may be configured to correspond to the first pixel group.

[0040] The photoelectric conversion element can be a photodiode (PD). The photoelectric conversion element can be a photodiode (PD), a photocapacitor, a photogate, a pinned photodiode (PPD), a partially pinned photodiode, an organic photodiode (OPD), a quantum dot (QD), or any combination thereof.

[0041] The example description of the photodiode (PD) is based on the reference photodiode (PD) as an example embodiment, but other photodiodes described above may be used in the image sensor 100. The photodiode (PD) is not the only type of photodiode (PD).

[0042] In an example embodiment, each of the plurality of pixels in each pixel group PG may include pixel circuitry for each individual pixel.

[0043] In an example embodiment, at least a portion of the pixels in each pixel group PG may share at least a portion of the pixel circuitry of the multiple pixels.

[0044] For example, each pixel group PG may include multiple transistors controlled by the row driver 120. At least some of the pixels in the same pixel group PG may share at least some of the drive transistors, select transistors, and reset transistors.

[0045] In an example embodiment, in autofocus mode, the pixel array 110 of the image sensor 100 can output a reset signal RS for each pixel or each pixel group PG, as well as pixel signals PXS1 and PXS2, via column lines CL. Each pixel group PG may include multiple pixels. According to the example embodiment, the pixel array 110 may operate in autofocus mode when needed under the control of the row driver 120, or it may always operate in autofocus mode. The example embodiment is described with reference to an example of the image sensor 100 operating in autofocus mode. However, the example embodiment is not limited to operating in autofocus mode all the time.

[0046] In an example embodiment, pixel array 110 can output a reset signal RS and pixel signals PXS1 and PXS2 for each pixel in full-pixel mode. In binning mode, pixel array 110 can output a reset signal RS and pixel signals PXS1 and PXS2 for each pixel group PG. In environments such as preview mode and / or under low-light conditions, pixel array 110 can operate in binning mode under the control of line driver 120.

[0047] The row driver 120 can drive a single row or multiple rows of the pixel array 110 under the control of the timing controller 130. In this specification, a "row" refers to a plurality of pixel groups PG and / or a plurality of pixels arranged in a first direction (e.g., horizontal direction) within the pixel array 110. Furthermore, a "column" refers to a plurality of pixel groups PG and / or a plurality of pixels arranged in a second direction (e.g., vertical direction) within the pixel array 110.

[0048] Row driver 120 can drive at least one of multiple rows. Row driver 120 can generate a selection signal to drive at least one of multiple rows. Row driver 120 can activate the pixel group PG and / or pixels corresponding to the selected row. The reset signal RS of the pixel group PG and / or pixels of the selected row, as well as the pixel signals PXS1 and PXS2, can be transmitted to readout circuit 150 via multiple column output lines.

[0049] Pixel signals PXS1 and PXS2 can be based on the voltage of the floating diffusion region. Each of pixel signals PXS1 and PXS2 can be based on a voltage reflecting the charge generated by the photodiode PD included in each pixel or group of pixels. The reset signal RS can be a reference signal used to perform correlated double sampling (CDS). The reset signal RS can be based on the voltage of the floating diffusion region reset by the reset transistor.

[0050] The timing controller 130 can control the pixel array 110, the line driver 120, the ramp signal generator 140, and the readout circuit 150. The timing controller 130 can provide a timing control signal TC to the line driver 120.

[0051] The timing control signal TC can be set differently based on the operating mode of the image sensor 100. For example, the image sensor 100 can operate in a per-pixel signal output mode or a per-pixel group (PG) signal output mode. For example, the per-pixel group (PG) signal output mode can be a merge mode, which includes combining and outputting the pixel signals of pixels in the same pixel group PG.

[0052] The line driver 120 can drive each of multiple pixels and / or multiple pixel groups PG in normal imaging mode or high dynamic range (HDR) mode based on a timing control signal TC.

[0053] The timing controller 130 can control the ramp signal generator 140 via the ramp control signal CS_RP. The ramp control signal CS_RP may include a ramp enable signal, a mode signal, etc.

[0054] The ramp signal generator 140 can generate a ramp signal RAMP in response to the ramp control signal CS_RP. The ramp signal generator 140 can generate a ramp signal RAMP with a predetermined slope. The ramp signal generator 140 can provide the generated ramp signal RAMP to the analog-to-digital converter (ADC) of the readout circuit 150.

[0055] The readout circuit 150 may include an analog-to-digital converter (ADC).

[0056] The ADC of the readout circuit 150 can output an image signal IMG (which is a digital signal) based on the ramp signal RAMP and the pixel signals. For example, the ADC can use correlated double sampling to output each of the pixel signals PXS based on the ramp signal RAMP as the image signal IMG. The image signal IMG can be provided to the image signal processing circuit 160. The image signal IMG can be the intensity value corresponding to the pixel signals PXS1 and PXS2. The readout circuit 150 can output a first image signal based on the first pixel signal PXS1 and a second image signal based on the second pixel signal PXS2. Therefore, the amplitude of the first image signal can be smaller than the amplitude of the second image signal, which will be described in more detail later.

[0057] The image signal processing circuit 160 can process the image signal IMG received from the readout circuit 150 and send image data IDT to an external display device and / or an external storage device through the output interface.

[0058] In an example embodiment, when the image sensor 100 operates in HDR mode, the row driver 120 can drive each of a plurality of pixels and / or pixel groups PG to output a first pixel signal PXS1 and a second pixel signal PXS2.

[0059] For example, the row driver 120 can control the pixel group PG such that a portion of the pixels in the pixel group PG outputs a first pixel signal PXS1 during a first readout period. The row driver 120 can also control the pixel group PG such that all pixels in the pixel group PG output a second pixel signal PXS2 during a second readout period.

[0060] During the first readout period, some pixel groups PG can output a first pixel signal PXS1 based on some of their included pixels, which has no phase information or at least reduced phase information. During the first readout period, other pixel groups PG can output a first pixel signal PXS1 with phase information based on some of their included pixels.

[0061] For example, during the first readout period, the first pixel group can output a first (1-1) pixel signal obtained by combining pixel signals of some pixels located at positions having opposite phase information in a specific direction relative to the microlens. For example, pixel signals of some pixels included in the first pixel group and located at positions having opposite phase information in both the horizontal and vertical directions can be combined. During the first readout period, the second and third pixel groups can output a first (1-2) pixel signal obtained by combining pixel signals of some pixels included in the second and third pixel groups and located at positions having the same phase information in a specific direction relative to the microlens in the horizontal direction. Each pixel group can be disposed below the microlens. The microlens can be disposed above each of the plurality of pixel groups to overlap with each of the plurality of pixel groups in a direction perpendicular to the substrate of the image sensor 100.

[0062] During the second readout period, each of the pixel groups PG can output a second pixel signal PXS2 obtained by combining the pixel signals of all pixels among the plurality of pixels included in each pixel group.

[0063] In an example embodiment, the image signal processing circuit 160 may include an HDR processing circuit 161 and an autofocus (AF) processing circuit 162.

[0064] The HDR processing circuit 161 can output HDR image data IDT using the image signal IMG.

[0065] In an example embodiment, the HDR processing circuit 161 can generate low-sensitivity image data based on a first image signal and high-sensitivity image data based on a second image signal. The HDR processing circuit 161 can use the low-sensitivity image data and the high-sensitivity image data to generate HDR image data IDT.

[0066] In an example embodiment, when the second image signal reaches the saturation level, the HDR processing circuit 161 can use the first image signal to generate high-sensitivity image data for some of the multiple pixel groups PG.

[0067] For example, when the second image signal of the first pixel group PG reaches the saturation level, the HDR processing circuit 161 can use the first image signal of the first pixel group PG to generate high-sensitivity image data of the first pixel group PG.

[0068] In the example embodiment, the HDR processing circuit 161 can determine whether the image signal IMG of pixel group PG is saturated. When some pixel group PG's image signal IMG is saturated, the image signal processing circuit 160 can use the unsaturated pixel group PG's image signal IMG to recover the saturated image signal IMG.

[0069] For example, when the second image signal of the second pixel group is saturated, the HDR processing circuit 161 can use the first image signal of the second pixel group and the first and second image signals of the third pixel group to generate second image data of the second pixel group. In this specification, the process of recovering the image signal of a specific pixel group using the image signals of other pixel groups can be referred to as "color transfer".

[0070] The AF processing circuit 162 can generate phase data. In an example embodiment, the phase data may be a phase difference signal (PDS). The phase difference signal (PDS) may include multiple phase information obtained from positions with different phase information in a predetermined direction.

[0071] In the example embodiment, the AF processing circuit 162 can output a phase difference signal PDS. For example, the AF processing circuit 162 can use different phase information in the horizontal direction to output the phase difference signal PDS. The example embodiment is described with reference to an example of outputting the phase difference signal PDS using differential segments of phase information in the horizontal direction. However, the example embodiment does not exclude the use of different phase information in the vertical direction to output the phase difference signal PDS.

[0072] In an example embodiment, the AF processing circuit 162 can generate first phase information and second phase information based on the first image signal of the first pixel group, the first image signal of the second pixel group, and the first image signal of the third pixel group.

[0073] For example, the AF processing circuit 162 can generate first phase information based on the first image signal of the second pixel group and the first image signal of the third pixel group. The AF processing circuit 162 can generate second phase information using the value obtained by subtracting the first phase information from the first image signal of the first pixel group. The AF processing circuit 162 can output the first phase information and the second phase information as a phase difference signal PDS. According to an example embodiment, the AF processing circuit 162 can generate second phase information using the value obtained by subtracting a multiple of the first phase information from the first image signal of the first pixel group.

[0074] Therefore, the image sensor 100 can generate a phase difference signal PDS based on the first image signal of the first pixel group, the first image signal of the second pixel group, and the first image signal of the third pixel group, so as to stably output the phase difference signal PDS over a wide illumination range, regardless of the saturation of the second image signal. For example, the phase difference signal PDS can be stably output until the first pixel signal of the low-sensitivity signal of the first pixel group is saturated. Therefore, an electronic device including the image sensor 100 can stably perform autofocus.

[0075] For example, in the prior art, when the second image signal of all pixel groups PG is saturated, even if image signals from other pixel groups are used, it may not be possible to recover the saturated second image signal. Therefore, phase difference information cannot be output.

[0076] Figures 2A to 2C This is a diagram showing pixels according to an example embodiment. Figure 1 The pixel array 110 may include Figures 2A to 2C Pixel groups PG1, PG2, and PG3. (Refer to...) Figure 1 and Figures 2A to 2C This describes a pixel group PG according to an example embodiment. The example embodiment is not limited to... Figures 2A to 2C The layout of pixel groups, and can include different types of pixel groups.

[0077] Each pixel group according to the example embodiment may include multiple pixels disposed at positions having different phase information in the horizontal direction and multiple pixels disposed at positions having the same phase information in the horizontal direction.

[0078] refer to Figures 2A to 2C The pixel groups PG1, PG2, and PG3 described are illustrated with an example of an arrangement corresponding to a Bayer pattern color filter. However, the color pattern is not limited to a Bayer pattern color filter.

[0079] An image sensor may include multiple pixel groups, each pixel group comprising multiple pixels. Each of the multiple pixels may include a photoelectric conversion element, which may be a photodiode. Multiple pixels may share a microlens for a certain number of pixels.

[0080] refer to Figures 2A to 2C The pixel array 110 may include pixel units PU_A, PU_B, and PU_C. The pixel units PU_A, PU_B, and PU_C may be arranged in a matrix repeat within the pixel array 110.

[0081] refer to Figures 2A to 2CPixel units PU_A, PU_B, and PU_C may include a first pixel group PG1, a second pixel group PG2, and a third pixel group PG3, respectively, corresponding to a green color filter, a red color filter, and a blue color filter of the Bayer pattern. Pixel units PU_A, PU_B, and PU_C may include two first pixel groups PG1 based on the Bayer pattern.

[0082] refer to Figure 2A Each of the pixel groups PG1, PG2, and PG3 may include eight pixels, each pixel including a photoelectric conversion element such as a photodiode. The eight pixels may share a single microlens in pairs. For example, the first pixel PX1 and the second pixel PX2 of the first pixel group PG1 may share a first microlens ML1. The third pixel PX3 and the fourth pixel PX4 may share a second microlens ML2.

[0083] refer to Figure 2A For example, the first pixel PX1 and the third pixel PX3 can be positioned at the same location in the horizontal direction relative to different microlenses. The first pixel PX1 and the third pixel PX3 can also be positioned at a location where their horizontal phase information differs from that of the second pixel PX2 and the fourth pixel PX4. For example, the first pixel PX1 can be positioned at a location where its horizontal phase information differs from that of the second pixel PX2 and the fourth pixel PX4. Similarly, the third pixel PX3 can be positioned at a location where its horizontal phase information differs from that of the second pixel PX2 and the fourth pixel PX4.

[0084] According to the example embodiment, similar to Figure 2A Two pixels of a single microlens can be shared repeatedly within a single pixel group. The number of microlenses set within a single pixel group can be s×s or more, where s is a positive integer greater than or equal to 2.

[0085] refer to Figure 2B Each of the pixel groups PG1, PG2, and PG3 may include four pixels. Each of the four pixels may include a photoelectric conversion element such as a photodiode. The four pixels may share a single microlens. For example, the first pixel PX1, the second pixel PX2, the third pixel PX3, and the fourth pixel PX4 of the first pixel group PG1 may share a first microlens ML1.

[0086] refer to Figure 2BFor example, the first pixel PX1 and the third pixel PX3 can be set at the same position in their horizontal phase information relative to the same microlens ML1. Alternatively, the first pixel PX1 and the third pixel PX3 can be set at a position in their horizontal phase information relative to the same microlens ML1 that differs from the horizontal phase information of the second pixel PX2 and the fourth pixel PX4.

[0087] According to the example embodiment, similar to Figure 2B A single microlens is set so that all m×m pixels within a single pixel group can share a single microlens, where m is a positive integer greater than or equal to 2.

[0088] refer to Figure 2C Each of the pixel groups PG1, PG2, and PG3 may include 16 pixels. Each of the 16 pixels may include a photoelectric conversion element such as a photodiode. The 16 pixels may share a single microlens every four pixels. For example, the first pixel PX1, the second pixel PX2, the third pixel PX3, and the fourth pixel PX4 of the first pixel group PG1 may share a first microlens ML1.

[0089] refer to Figure 2C For example, the first pixel PX1, the third pixel PX3, and the fifth pixel PX5 can be positioned at locations where their horizontal phase information is the same. The second pixel PX2, the fourth pixel PX4, and the sixth pixel PX6 can also be positioned at locations where their horizontal phase information is the same. Each of the first pixel PX1, the third pixel PX3, and the fifth pixel PX5 can be positioned at a location where its horizontal phase information differs from that of the second pixel PX2, the fourth pixel PX4, and the sixth pixel PX6.

[0090] According to the example embodiment, similar to Figure 2C A single microlens can be shared repeatedly within a single pixel group, where k is a positive integer greater than or equal to 2. The number of microlenses set within a single pixel group can be u×u or more, where u is a positive integer greater than or equal to 2.

[0091] Therefore, some pixel groups can output the (1-1)th pixel signal obtained by combining the pixel signals of some pixels whose phase information is set at opposite positions in their horizontal direction during the first readout period, while other pixel groups can output the (1-2)th pixel signal obtained by combining the pixel signals of some pixels whose phase information is set at the same position in their horizontal direction during the first readout period.

[0092] Each pixel in a pixel group can output a pixel signal obtained by combining the pixel signals of all pixels within the respective pixel group during the second readout period.

[0093] Figure 3 This is a diagram illustrating the first pixel signal of a pixel group according to an example embodiment. (Using...) Figure 2B Pixel groups are used as an example description Figure 3 Examples of implementations. However, pixel groups are not limited to. Figure 2B and Figure 3 Pixel groups.

[0094] According to the example embodiment, the pixel group PG may include multiple pixels disposed at positions with different phase information in a predetermined direction and other multiple pixels disposed at positions with the same phase information in the predetermined direction.

[0095] For example, a pixel group PG may include four pixels PX1, PX2, PX3, and PX4 that share the same microlens ML. The four pixels PX1, PX2, PX3, and PX4 may output pixel signals based on phase information P1, P2, P3, and P4, respectively.

[0096] The first pixel PX1 and the second pixel PX2 have different phase information in the horizontal direction relative to the microlens ML. For example, the first pixel PX1 and the second pixel PX2 are positioned symmetrically with respect to the virtual vertical central axis VL of the microlens ML. The first pixel PX1 and the third pixel PX3 have different phase information in the vertical direction relative to the microlens ML. For example, the first pixel PX1 and the third pixel PX3 are positioned symmetrically with respect to the virtual horizontal central axis HL of the microlens ML. The first pixel PX1 and the fourth pixel PX4 have different phase information in both the vertical and horizontal directions relative to the microlens ML. For example, the first pixel PX1 and the fourth pixel PX4 can be positioned symmetrically with respect to both the virtual horizontal central axis HL and the virtual vertical central axis VL of the microlens ML.

[0097] Some pixel groups can output a first (1-1) pixel signal during the first readout period by combining pixel signals of some pixels positioned at locations with opposite phase information in a predetermined direction, while other pixel groups can output a first (1-2) pixel signal during the first readout period by combining pixel signals of some pixels positioned at locations with the same phase information in a predetermined direction. The arrangement of the pixels outputting the first (1-1) pixel signal and the arrangement of the pixels outputting the first (1-2) pixel signal can be different from each other.

[0098] For example, when pixel group PG outputs the (1-1)th pixel signal PXS1-1, pixel group PG can output a signal obtained by combining the pixel signals of the first pixel PX1 and the fourth pixel PX4 during the first readout period. Alternatively, pixel group PG can output a signal obtained by combining the pixel signals of the second pixel PX2 and the third pixel PX3 during the first readout period. For example, pixel group PG can combine and output the pixel signals of pixels located at positions with different phase information in both the horizontal and vertical directions.

[0099] When pixel group PG outputs the (1-2)th pixel signal PXS1-2, pixel group PG can output a signal obtained by combining the pixel signals of the first pixel PX1 and the third pixel PX3 during the first readout period. Alternatively, pixel group PG can output a signal obtained by combining the pixel signals of the second pixel PX2 and the fourth pixel PX4 during the first readout period. For example, pixel group PG can combine and output the pixel signals of pixels located at positions with the same phase information in the horizontal direction.

[0100] Figure 4 This is a circuit diagram of a pixel group PG according to an example embodiment. Figure 4 The circuit diagram can correspond to Figure 3 PG pixel group. Figure 3 The circuit diagram of the pixel group PG can be used in addition to Figure 4 Implementation using various circuit forms other than the standard circuit form. Using... Figure 2B Pixel groups are used as an example description Figure 4 Examples of implementations. However, pixel groups are not limited to. Figure 2B Pixel groups.

[0101] Reference Figure 3 and Figure 4 A circuit diagram describing a pixel group PG according to an example embodiment.

[0102] refer to Figure 3 and Figure 4 Pixel group PG can include multiple pixels PX1, PX2, PX3, and PX4. Multiple pixels PX1, PX2, PX3, and PX4 can respectively include photodiodes PD1, PD2, PD3, and PD4.

[0103] Photodiodes PD1, PD2, PD3, and PD4 of multiple pixels PX1, PX2, PX3, and PX4 can be connected to the floating diffusion region FD via transfer transistors TG1, TG2, TG3, and TG4, respectively. The transfer transistors TG1, TG2, TG3, and TG4 can be connected from... Figure 1The row driver 120 receives transmission control signals TS1, TS2, TS3, and TS4. Transmission transistors TG1, TG2, TG3, and TG4 may be turned on during the same time period or during different time periods. A subset of transmission transistors TG1, TG2, TG3, and TG4 may be turned on during the same time period or during different time periods.

[0104] When the transmission transistors TG1, TG2, TG3, and TG4 are turned on during the same time period, the pixel signals of all multiple pixels PX1, PX2, PX3, and PX4 can be combined and output as pixel signal Vout through the column line CLI.

[0105] Multiple pixels PX1, PX2, PX3, and PX4 can share at least some pixel circuitry. For example, see reference... Figure 4 Multiple pixels PX1, PX2, PX3, and PX4 can share the reset transistor RG, drive transistor SF, and select transistor SX. The reset transistor RG and select transistor SX can be driven from the row... Figure 1 The driver 120 receives a reset signal RS and a select signal SEL.

[0106] Figure 5 This is a graph showing the changes in the image signal according to a comparison example. (Reference) Figure 5 The described embodiments provide only alternative methods and do not imply known methods.

[0107] Refer to the example where pixel groups correspond to Bayer mode color filters for description. Figure 5 For example, the first pixel group, the second pixel group, and the third pixel group can be set to correspond to the green, red, and blue color filters of the Bayer mode, respectively. Figure 5 An example of changes in the image signal is shown.

[0108] First image signals GL, RL, and BL can be generated respectively based on the first pixel signals of the first pixel group, second pixel group, and third pixel group of the comparison example. The first pixel signal can be obtained by combining the pixel signals of some pixels in the pixel group.

[0109] The second image signals GS, RS, and BS can be generated based on the second pixel signals of the first, second, and third pixel groups in the comparison example, respectively. The second pixel signal can be obtained by combining the pixel signals of all pixels in the pixel group.

[0110] Reference Figure 5 In the described embodiments, the image signal of a specific pixel group refers to the image signal generated based on the pixel signal of the specific pixel group.

[0111] As the illumination changes, the second image signal GS of the first pixel group can reach a saturation level SAT_LV at the first illumination level GS_SAT. Subsequently, the second image signal RS of the second pixel group and the second image signal BS of the third pixel group reach saturation levels SAT_LV at the second illumination level RS_SAT and the third illumination level BS_SAT, respectively. The saturation level SAT_LV can be the maximum value of the digital code set in the readout circuit. The maximum level MAX_LV can be the maximum value of the image signal used by the image signal processing circuit to generate the HDR image.

[0112] In the zero-th region RG_0, the illuminance does not reach the first illuminance level GS_SAT. Therefore, the second image signals GS, RS, and BS of the first, second, and third pixel groups may not reach the saturation level SAT_LV. Thus, the image sensor can normally output the first image signals GL, RL, and BL, as well as the second image signals GS, RS, and BS. The image sensor can generate a phase difference signal based on the first image signals GL, RL, and BL, and the second image signals GS, RS, and BS.

[0113] In the first region RG_1, the illuminance exceeds the first illuminance level GS_SAT and the second image signals RS and BS of the second and third pixel groups have not reached the saturation level SAT_LV, while the second image signal GS of the first pixel group may exceed the saturation level SAT_LV.

[0114] An image sensor can estimate a second image signal for a saturated pixel group using image signals from unsaturated pixel groups adjacent to the saturated pixel group. For example, the image sensor can estimate a second image signal GS for a first pixel group using a first image signal GL from a first pixel group, first image signals RL and BL from other pixel groups, and second image signals RS and BS from other pixel groups. The image sensor can generate a phase difference signal for the first pixel group using the first image signal GL and the estimated second image signal for the first pixel group. The phase difference signals for the second and third pixel groups can be generated in the same manner as in the zero-th region RG_0.

[0115] In the second region RG_2, similar to the first region RG_1, the second image signals GS and RS of the first pixel group and the second pixel group exceed the saturation level SAT_LV, and the image sensor can estimate the second image signals GS and RS of the first pixel group and the second pixel group in a manner similar to that of the first region RG_1.

[0116] In the third region RG_3, the second image signals GS, RS, and BS of the first, second, and third pixel groups can all exceed the saturation level SAT_LV. The second image signals GS, RS, and BS of the saturated pixel groups can be estimated without using the image signals of adjacent unsaturated pixel groups.

[0117] When all second image signals GS, RS, and BS are saturated, the image sensor can generate the second image signals GS, RS, and BS using the first image signal GL of the first pixel group, the first image signal RL of the second pixel group, and the first image signal BL of the third pixel group, respectively. For example, the image sensor can generate the second image signals GS, RS, and BS by multiplying each of the first image signals GL of the first pixel group, RL of the second pixel group, and BL of the third pixel group by a factor n.

[0118] Therefore, in the third region RG_3, the first image signals GL, RL, and BL, and the second image signals GS, RS, and BS have the same phase information, and the image sensor according to the comparative example cannot generate a phase difference signal. The electronic device according to the comparative example cannot accurately perform autofocus.

[0119] Figure 6 This is a diagram illustrating image signals according to an example embodiment. (The symbols related to... are omitted.) Figure 5 Detailed descriptions of features that are the same or similar in the example embodiments are provided to avoid redundancy. Figure 6 The image signal can be Figure 1 The image signal from the image sensor 100. (Refer to...) Figure 1 and Figure 6 Describe the image signal of image sensor 100.

[0120] exist Figure 1 In the pixel group PG, the first pixel group can output a first (1-1) pixel signal during a first readout period, obtained by summing (or combining) the pixel signals of some pixels located at positions with opposite phase information in a predetermined direction. The readout circuit 150 can digitally convert the first (1-1) pixel signal to output a first image signal GAS.

[0121] During the first readout period, each of the second and third pixel groups can output a (1-2)th pixel signal obtained by summing the pixel signals of some pixels located at positions with the same phase information in a predetermined direction. The readout circuit 150 can digitally convert the (1-2)th pixel signal to output first image signals RL and BL.

[0122] exist Figure 1In the pixel group PG, the first pixel group can output a second pixel signal obtained by summing the pixel signals of all pixels in the pixel group PG during the second readout period. The readout circuit 150 can convert the second pixel signal to output a second image signal GS.

[0123] Figure 1 The image signal processing circuit 160 can generate a second pseudo-image signal GS' by amplifying the first image signal GAS by a factor of n within the first region RG_1 to the third region RG_3 when the second image signal GS of the first pixel group reaches the saturation level SAT_LV. The amplification factor n can be the sensitivity ratio between low-sensitivity image data and high-sensitivity image data used to generate the HDR image. The image signal processing circuit 160 can use the first image signal GAS and the second pseudo-image signal GS' to generate an HDR image.

[0124] When one of the second image signal RS of the second pixel group and the second image signal BS of the third pixel group reaches the saturation level SAT_LV Figure 1 The image signal processing circuit 160 can use the image signal of the surrounding unsaturated pixel group to generate a second pseudo image signal RS' of the second pixel group and a second pseudo image signal BS' of the third pixel group.

[0125] For example, the image signal processing circuit 160 can generate second pseudo-image signals RS' and BS' for the second pixel group and the third pixel group in the first region RG_1 and the second region RG_2 based on Equation 1. The image signal processing circuit 160 can generate an HDR image using the first image signals RL and BL for the second pixel group and the third pixel group in the first region RG_1 and the second region RG_2, as well as the second pseudo-image signals RS' and BS'.

[0126] Equation 1

[0127] RS' = (BS / BL) × RL

[0128] BS' = (RS / RL) × BL

[0129] Referring to Equation 1, when the second image signal RS of the second pixel group is saturated, the second pseudo image signal RS' of the second pixel group can be generated by dividing the second image signal BS of the surrounding unsaturated third pixel group by the first image signal BL of the third pixel group, and then multiplying the result by the first image signal RL of the second pixel group.

[0130] Similarly, when the second image signal BS of the third pixel group is saturated, the second pseudo image signal BS' of the third pixel group can be generated by dividing the second image signal RS of the surrounding unsaturated second pixel group by the first image signal RL of the second pixel group, and then multiplying it by the first image signal BL of the third pixel group.

[0131] When the second image signals RS and BS of the second and third pixel groups both reach the saturation level SAT_LV (e.g., in the third region RG_3). Figure 1 The image signal processing circuit 160 can use the first image signal GAS, the first pseudo image signal GAL of the first pixel group, and the first image signals RL and BL of the second and third pixel groups to generate the second pseudo image signals RS' and BS' of the second and third pixel groups.

[0132] For example, the image signal processing circuit 160 can generate second pseudo-image signals RS' and BS' for the second and third pixel groups in the third region RG_3 based on Equation 2. The image signal processing circuit 160 can generate an HDR image using the first image signals RL and BL for the second and third pixel groups in the third region RG_3, as well as the second pseudo-image signals RS' and BS'.

[0133] Equation 2

[0134] RS'=(RL / GAL)×(GAS×n)

[0135] BS'=(BL / GAL)×(GAS×n)

[0136] Referring to Equation 2, in the third region RG_3, the second pseudo-image signal RS' of the second pixel group can be generated by dividing the first image signal RL of the second pixel group by the first pseudo-image signal GAL of the first pixel group, and then multiplying the result by the first image signal GAS of the first pixel group and the factor n.

[0137] Similarly, in the third region RG_3, the second pseudo-image signal BS' of the third pixel group can be generated by dividing the first image signal BL of the third pixel group by the first pseudo-image signal GAL of the first pixel group and then multiplying the result by the first image signal GAS of the first pixel group and the factor n.

[0138] In Equation 2, n can be the sensitivity ratio between the low-sensitivity image data and the high-sensitivity image data used to generate the HDR image.

[0139] Image sensor 100 can generate a first pseudo-image signal GAL for the first pixel group based on Equation 3.

[0140] Equation 3

[0141] GAL=(RL × wbR+BL × wbB) / 4

[0142] Referring to Equation 3, the first pseudo-image signal GAL for the first pixel group can be generated by adding a first value obtained by multiplying the first image signal RL of the second pixel group by a first white balance gain wbR and a second value obtained by multiplying the first image signal BL of the third pixel group by a second white balance gain wbB, and then dividing the sum by 4. The first image signal GAS can be based on the pixel signals of two pixels. The first pseudo-image signal GAL for the first pixel group can be generated as a value obtained by dividing the sum of the first and second values ​​by 4 to generate phase information from the first image signal GAS and the first pseudo-image signal GAL.

[0143] The image sensor can generate a phase difference signal using a first pseudo-image signal GAL and a first image signal GAS of the first pixel group. A first white balance gain and a second white balance gain can be received from the host device. For example, the first white balance gain and the second white balance gain can be received from the application processor of the electronic device.

[0144] In an example embodiment, the image sensor 100 can treat a first image signal GAS based on first pixel signals of a first pixel group with phase information removed as a merged second image signal of the first pixel group. The image sensor 100 can generate a first pseudo image signal GAL for the first pixel group based on the first pixel signals of the second and third pixel groups while retaining phase information. Therefore, the first pseudo image signal GAL can be generated as first phase information, and the value obtained by subtracting the first phase information (first pseudo image signal GAL) from the first image signal GAS can be generated as second phase information. The image sensor 100 can output the first phase information and the second phase information as a phase difference signal.

[0145] In all regions RG_0, RG_1, RG_2, and RG_3, the first image signal GAS of the first pixel group can remain unsaturated. Furthermore, in all regions RG_0, RG_1, RG_2, and RG_3, the first image signal RL of the second pixel group and the first image signal BL of the third pixel group can remain unsaturated. Therefore, the image sensor 100 can stably generate phase difference signals in regions RG_0, RG_1, RG_2, and RG_3 until the first image signal GAS of the first pixel group becomes saturated.

[0146] Figure 7A and Figure 7B This is a diagram illustrating pixel signals according to an example embodiment. Figure 7A This is a diagram showing the first pixel signal of the first pixel group and the second pixel group. Figure 7B This is a diagram showing the second pixel signal of the first pixel group and the second pixel group.

[0147] use Figure 2B Pixel groups are used as an example description Figure 7A and Figure 7B Examples of implementations. However, pixel groups are not limited to. Figure 2B , Figure 7A and Figure 7B Pixel groups.

[0148] Figure 7A and Figure 7B Figure 2 and are shown Figure 6 The pixel signals of the first and second pixel groups are described. The pixel signals of the third pixel group can be similar to those of the second pixel group.

[0149] In an example embodiment, during the first readout period, the first pixel group PG1 may output the (1-1)th pixel signal with phase information removed or reduced, and during the first readout operation, the second pixel group PG2 may output the (1-2)th pixel signal with phase information retained.

[0150] For example, refer to Figure 7A The first pixel group PG1 can combine and output the pixel signals of the first pixel PX11 and the fourth pixel PX14 during the first readout period. The first pixel PX11 and the fourth pixel PX14 are pixels with opposite phase information in the horizontal and vertical directions relative to the first microlens ML1. The second pixel group PG2 can combine and output the pixel signals of the first pixel PX21 and the third pixel PX23. The first pixel PX21 and the third pixel PX23 are pixels with the same phase information in the horizontal direction relative to the second microlens ML2.

[0151] In an example embodiment, the first pixel group PG1 and the second pixel group PG2 can output a second pixel signal obtained by combining the pixel signals of all pixels within the pixel group during the second readout period.

[0152] For example, refer to Figure 7B During the second readout period, the first pixel group PG1 can combine and output the pixel signals of all pixels PX11, PX12, PX13 and PX14, and the second pixel group PG2 can combine and output the pixel signals of all pixels PX21, PX22, PX23 and PX24.

[0153] Figure 8 It is based on Figure 7A and Figure 7B A timing diagram of the control signals provided to pixel groups PG1 and PG2 in an embodiment. In the example embodiment, Figure 8The circuit diagrams for pixel groups PG1 and PG2 in the diagram can be similar to those in diagram 4. (Reference) Figure 4 , Figure 7A , Figure 7B and Figure 8 The operations for pixel groups PG1 and PG2 are described.

[0154] At the first time T1, the reset signal RS of the first pixel group PG1 and the second pixel group PG2 can go high, and the reset transistor RG can reset the floating diffusion region FD.

[0155] At the second time T2, the selection signal SEL of the first pixel group PG1 and the second pixel group PG2 can go high, and the selection transistor SX can output the voltage of the reset floating diffusion region FD as a reset signal.

[0156] At the third time T3, the first transmission control signal TS1 and the fourth transmission control signal TS4 of the first pixel group PG1 can transition to a high level, and the first transmission transistor TG1 and the fourth transmission transistor TG4 can transfer the photocharge of the first pixel PX11 and the fourth pixel PX14 to the floating diffusion region FD. The first pixel PX11 and the fourth pixel PX14 can have opposite phase information relative to the first microlens ML1 in both the horizontal and vertical directions, as shown in the reference... Figure 7A The embodiments described herein are not limited thereto. At the fourth time T4, the selection transistor SX of the first pixel group PG1 can be turned on again, and the (1-1)th pixel signal based on the photocharge of both the first pixel PX11 and the fourth pixel PX14 can be output.

[0157] At the third time T3, the first transmission control signal TS1 and the third transmission control signal TS3 of the second pixel group PG2 can switch to a high level, and the first transmission transistor TG1 and the third transmission transistor TG3 can transfer the photocharge of the first pixel PX21 and the third pixel PX23 to the floating diffusion region FD. The first pixel PX21 and the third pixel PX23 can have the same phase information in the horizontal direction relative to the first microlens ML1, as shown in the reference. Figure 7A As described in the embodiment. At the fourth time T4, the selection transistor SX of the second pixel group PG2 can be turned on again, and the (1-2)th pixel signal based on the photocharge of both the first pixel PX21 and the third pixel PX23 can be output.

[0158] At time T5, all transmission control signals TS1, TS2, TS3, and TS4 of the first pixel group PG1 can go high, and the transmission transistors TG1, TG2, TG3, and TG4 of the first pixel group PG1 can transfer the photocharge of pixels PX11, PX12, PX13, and PX14 to the floating diffusion region FD. Similarly, all transmission control signals TS1, TS2, TS3, and TS4 of the second pixel group PG2 can go high, and the transmission transistors TG1, TG2, TG3, and TG4 of the second pixel group PG2 can transfer the photocharge of pixels PX21, PX22, PX23, and PX24 to the floating diffusion region FD.

[0159] At the sixth time T6, the selection transistor SX of the first pixel group PG1 and the second pixel group PG2 can be turned on again by the selection signal SEL, and each of the first pixel group PG1 and the second pixel group PG2 can output the second pixel signal.

[0160] Figure 9 This is a diagram illustrating the first pixel signals of the first pixel group PG1 and the second pixel group PG2 according to an example embodiment. (Using...) Figure 2B Pixel groups are used as an example description Figure 9 Examples of implementations. However, pixel groups are not limited to. Figure 2B and Figure 9 Pixel groups.

[0161] refer to Figure 9 The first pixel signals of the first pixel group PG1 and the second pixel group PG2 are described. (The following is omitted: ...) Figure 7A and Figure 7B The example embodiments are described in detail with reference to the same or similar figures to avoid redundancy. The pixel signals of the third pixel group may be similar to those of the second pixel group.

[0162] refer to Figure 9 The first pixel group PG1 can combine and output the pixel signals of the second pixel PX12 and the third pixel PX13 during the first readout period. The second pixel PX12 and the third pixel PX13 are pixels with opposite phase information relative to the first microlens ML1. The pixel signals of the second pixel PX12 and the third pixel PX13 can have opposite phase information relative to the first microlens ML1 in both the horizontal and vertical directions.

[0163] The second pixel group PG2 can combine and output the pixel signals of the first pixel PX21 and the third pixel PX23. The first pixel PX21 and the third pixel PX23 are pixels that have the same phase information in the horizontal direction relative to the second microlens ML2.

[0164] Figures 10A to 10DThis is a diagram illustrating the first pixel signals of the first pixel group PG1 and the second pixel group PG2 according to an example embodiment. (Using...) Figure 2A Pixel groups are used as an example description Figures 10A to 10D Examples of implementations. However, pixel groups are not limited to. Figure 2A and Figures 10A to 10D Pixel groups.

[0165] refer to Figures 10A to 10D The first pixel signals of the first pixel group PG1 and the second pixel group PG2 are described. (The following is omitted: ...) Figures 2A to 2C , Figure 7A , Figure 7B and Figure 9 The accompanying drawings in the example embodiments are described in detail to avoid redundancy, as features that are identical or similar to those in the original drawings. The pixel signals of the third pixel group may be similar to those of the second pixel group.

[0166] Figures 10A to 10D Each pixel group can consist of eight pixels. Each of the eight pixels can include a photoelectric conversion element such as a photodiode. The eight pixels can share a single microlens for every two pixels. The two pixels sharing a microlens can be arranged adjacent to each other in the horizontal direction. Figures 10A to 10D All pixels in a pixel group have the same phase information in the vertical direction.

[0167] Figures 10A to 10D The second pixel group PG2 can combine and output the pixel signals of the first pixel PX21 and the fifth pixel PX25, where the first pixel PX21 and the fifth pixel PX25 are pixels with the same phase information in the horizontal direction relative to the second microlenses ML21 and ML23. Alternatively, the second pixel group PG2 can combine and output the pixel signals of the third pixel PX23 and the seventh pixel PX27, where the third pixel PX23 and the seventh pixel PX27 are pixels with the same phase information in the horizontal direction relative to the second microlenses ML21 and ML23. Alternatively, the second pixel group PG2 can combine and output the pixel signals of the second pixel PX22 and the sixth pixel PX26, or combine and output the pixel signals of the fourth pixel PX24 and the eighth pixel PX28.

[0168] refer to Figure 10AThe first pixel group PG1 can combine and output the pixel signals of the first pixel PX11 and the eighth pixel PX18 during the first readout period. The first pixel PX11 and the eighth pixel PX18 are pixels with opposite phase information in the horizontal direction relative to the first microlenses ML11 and ML14. The first pixel PX11 and the eighth pixel PX18 can have the same phase information in the vertical direction. The positions of the first pixel PX11 and the eighth pixel PX18 within the first pixel group PG1 can be symmetrical in both the horizontal and vertical directions. For example, when the first pixel group PG1 is viewed in a direction perpendicular to the substrate, the first pixel PX11 can be located at the upper left corner of the first pixel group PG1, and the eighth pixel PX18 can be located at the lower right corner of the first pixel group PG1.

[0169] In the example embodiment, with Figure 10A Unlike the previous illustration, the first pixel group PG1 can combine and output the pixel signals of the fourth pixel PX14 and the fifth pixel PX15 during the first readout period. The fourth pixel PX14 and the fifth pixel PX15 are pixels with opposite phase information in the horizontal direction relative to the first microlenses ML11 and ML14. The positions of the fourth pixel PX14 and the fifth pixel PX15 within the first pixel group PG1 can be symmetrical in both the horizontal and vertical directions.

[0170] refer to Figure 10B The first pixel group PG1 can combine and output the pixel signals of the first pixel PX11 and the sixth pixel PX16 during the first readout period. The first pixel PX11 and the sixth pixel PX16 are pixels with opposite phase information in the horizontal direction relative to the first microlenses ML11 and ML13. The positions of the first pixel PX11 and the sixth pixel PX16 within the first pixel group PG1 can be asymmetrical in both the horizontal and vertical directions.

[0171] refer to Figure 10C The first pixel group PG1 can combine and output the pixel signals of the first pixel PX11 and the fourth pixel PX14 during the first readout period. The first pixel PX11 and the fourth pixel PX14 are pixels with opposite phase information in the horizontal direction relative to the first microlenses ML11 and ML12. The positions of the first pixel PX11 and the fourth pixel PX14 within the first pixel group PG1 can be symmetrical in the horizontal direction, but asymmetrical in the vertical direction. For example, the first pixel PX11 can be located at the upper left corner of the first pixel group PG1, and the fourth pixel PX14 can be located at the upper right corner of the first pixel group PG1.

[0172] refer to Figure 10DThe first pixel group PG1 can combine and output the pixel signals of the fifth pixel PX15 and the eighth pixel PX18 during the first readout period. The fifth pixel PX15 and the eighth pixel PX18 are pixels with opposite phase information in the horizontal direction relative to the first microlenses ML13 and ML14. The positions of the fifth pixel PX15 and the eighth pixel PX18 within the first pixel group PG1 can be symmetrical in the horizontal direction, but asymmetrical in the vertical direction. For example, the fifth pixel PX15 can be located at the lower left corner of the first pixel group PG1, and the eighth pixel PX18 can be located at the lower right corner of the first pixel group PG1.

[0173] Figure 11 This is a block diagram illustrating the configuration of an HDR processing circuit 161 of an image signal processing circuit according to an example embodiment. Figure 11 The HDR processing circuit 161 can correspond to Figure 1 HDR processing circuit 161. (Refer to...) Figure 1 , Figure 6 and Figure 11 Describe the HDR processing circuit 161.

[0174] refer to Figure 11 The HDR processing circuit 161 may include a saturation detection circuit 163, a merging circuit 164, a color transfer circuit 165, and an HDR image generation circuit 166.

[0175] The saturation detection circuit 163 can be used from Figure 1 The readout circuit 150 receives the first image signal GAS and the second image signal GS of the first pixel group PG1, the first image signal RL and the second image signal RS of the second pixel group PG2, and the first image signal BL and the second image signal BS of the third pixel group PG3.

[0176] In an example embodiment, the saturation detection circuit 163 can determine whether the second image signals GS, RS, and BS of pixel groups PG1, PG2, and PG3 are saturated. When the second image signals GS, RS, and BS are not saturated, the HDR image generation circuit 166 can use the first image signals GAS, RL, and BL of pixel groups PG1, PG2, and PG3, as well as the second image signals GS, RS, and BS, to generate HDR image data IMG.

[0177] When the second image signal GS of the first pixel group PG1 is saturated, the saturation detection circuit 163 can send the first image signal GAS of the first pixel group PG1 to the merging circuit 164. The merging circuit 164 can send the second pseudo image signal GS' obtained by amplifying the first image signal GAS of the first pixel group PG1 by n times to the HDR image generation circuit 166.

[0178] When one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is saturated, the saturation detection circuit 163 can send the first image signal GAS of the first pixel group PG1 and the first image signals RL and BL of the second pixel group PG2 and the third pixel group PG3 to the color transfer circuit 165.

[0179] When one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is saturated, the color transfer circuit 165 can be based on a reference. Figure 6 Equation 1 describes the estimation of the second pseudo-image signals RS' and BS' of the second pixel group PG2 and the third pixel group PG3.

[0180] When the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 are both saturated, the color transfer circuit 165 can be based on a reference. Figure 6 Equations 2 and 3 describe the estimation of the second pseudo-image signals RS' and BS' for both the second pixel group PG2 and the third pixel group PG3. Color transfer circuit 165 can use the white balance gain WB received from the host device to estimate the first pseudo-image signal GAL for the first pixel group PG1. Color transfer circuit 165 can then send the second pseudo-image signals RS' and BS' together with the first image signals RL and BL to HDR image generation circuit 166.

[0181] The HDR image generation circuit 166 can generate HDR image data IMG using the received signal.

[0182] Figure 12 This is an example embodiment illustrating the principle. Figure 11 A diagram showing the color transfer operation of the HDR processing circuit 161. (Refer to...) Figure 11 and Figure 12 Describe the color transfer operation of the HDR processing circuit 161. For example, when Figure 6 When the second image signal RS of the second pixel group PG2 in the first region RG1 and the second region RG2 is saturated, it can be performed based on Equation 1 according to... Figure 12 The color transfer operation in the example embodiment.

[0183] Figure 12 Four pixel units, PU1, PU2, PU3, and PU4, are shown. (Reference) Figure 12 Each of the pixel units PU1, PU2, PU3 and PU4 may include two first pixel groups PG1A and PG1B, a second pixel group PG2 and a third pixel group PG3.

[0184] The HDR processing circuit 161 can determine that a second image signal IMG22 of the second pixel group PG2 is saturated. For example, the second image signal IMG22 of the second pixel group PG2 in the first pixel unit PU1 can be saturated.

[0185] The HDR processing circuit 161 can use the image signals of the third pixel group PG31, PG32, PG33 and PG34 (or collectively referred to as PG3) of the second pixel group PG2 within the first pixel unit PU1 and the first image signal IMG21 of the second pixel group PG2 in the first pixel unit PU1 to recover the second image signal IMG22 of the second pixel group PG2 in the first pixel unit PU1.

[0186] For example, the HDR processing circuit 161 can interpolate the first image signal CT1 of the third pixel group PG31, PG32, PG33, and PG34 to generate a first image signal PG2_1 corresponding to the position of the second pixel group PG2 in the first pixel unit PU1. Furthermore, the HDR processing circuit 161 can interpolate the second image signal CT2 of the third pixel group PG31, PG32, PG33, and PG34 to generate a second image signal PG2_2 corresponding to the position of the second pixel group PG2 in the first pixel unit PU1.

[0187] The HDR processing circuit 161 can generate the recovered second image signal IMG22CT of the second pixel group PG2 in the first pixel unit PU1 by applying Equation 1 to the first image signal PG2_1 corresponding to the position of the second pixel group PG2 in the first pixel unit PU1, the second image signal PG2_2 corresponding to the position of the second pixel group PG2 in the first pixel unit PU1, and the first image signal IMG21 of the second pixel group PG2 in the first pixel unit PU1.

[0188] Figure 13 This is a block diagram illustrating the configuration of the AF processing circuit 162 of the image signal processing circuit according to an example embodiment. Figure 13 The AF processing circuit 162 can correspond to Figure 1 The AF processing circuit 162. (Refer to...) Figure 1 , Figure 6 and Figure 13 Describe the AF processing circuit 162.

[0189] refer to Figure 13 The AF processing circuit 162 may include a saturation detection circuit 163, a first pseudo-image signal (GAL) generation circuit 167, and a phase information generation circuit 168.

[0190] The saturation detection circuit 163 can be used from Figure 1The readout circuit 150 receives the first image signal GAS and the second image signal GS of the first pixel group PG1, the first image signal RL and the second image signal RS of the second pixel group PG2, and the first image signal BL and the second image signal BS of the third pixel group PG3.

[0191] The first image signal GAS of the first pixel group PG1 can be based on the first pixel signal of some pixels located at positions with opposite phase information. The first image signal RL of the second pixel group PG2 and the first image signal BL of the third pixel group PG3 can be based on the first pixel signal of some pixels located at positions with the same phase information.

[0192] In an example embodiment, the saturation detection circuit 163 can determine whether any one of the second image signals GS, RS, and BS of pixel groups PG1, PG2, and PG3 is saturated.

[0193] When at least one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is unsaturated, the saturation detection circuit 163 can send the first and second image signals of the unsaturated pixel group to the phase information generation circuit 168. For example, when the second image signal BS of the third pixel group PG3 is unsaturated, the saturation detection circuit 163 can send the first image signal BL and the second image signal BS of the third pixel group PG3 to the phase information generation circuit 168.

[0194] The saturation detection circuit 163 can send the first image signal GAS of the first pixel group PG1, the first image signal RL of the second pixel group PG2, and the first image signal BL of the third pixel group PG3 to the first pseudo image signal generation circuit 167.

[0195] The first pseudo-image signal generation circuit 167 can generate a first pseudo-image signal GAL for the first pixel group by applying Equation 3 to the white balance gain WB and the first image signals GAS, RL, and BL of pixel groups PG1, PG2, and PG3. The first pseudo-image signal generation circuit 167 can send the first pseudo-image signal GAL and the first image signal GAS of the first pixel group to the phase information generation circuit 168.

[0196] The phase information generation circuit 168 can generate phase data based on the first pseudo-image signal GAL and the first image signal GAS of the first pixel group. For example, the phase information generation circuit 168 can generate a phase difference signal PDS that includes first phase information and second phase information as phase data. The phase information generation circuit 168 can generate the first pseudo-image signal GAL of the first pixel group as first phase information. The phase information generation circuit 168 can generate the value obtained by subtracting the first pseudo-image signal GAL from the first image signal GAS of the first pixel group as second phase information.

[0197] When at least one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is unsaturated, the phase information generation circuit 168 can use the first and second image signals of the unsaturated pixel group to generate an additional phase difference signal PHS. For example, when the second image signal BS of the third pixel group PG3 is unsaturated, the phase information generation circuit 168 can generate the first image signal BL of the third pixel group PG3 as the first phase information and the difference between the second image signal BS and the first image signal BL as the second phase information.

[0198] Figure 14 This is a block diagram illustrating the configuration of the AF processing circuit 162A of the image signal processing circuit according to an example embodiment. Figure 14 The AF processing circuit 162A can correspond to Figure 1 The AF processing circuit 162. (Refer to...) Figure 1 , Figure 6 and Figure 14 Describe the AF processing circuit 162, and pay attention to and refer to it. Figure 13 The AF processing circuit 162 described is different.

[0199] refer to Figure 14 ,and Figure 13 Unlike the AF processing circuit 162, the AF processing circuit 162A can receive the second pseudo image signal RS' of the second pixel group PG2 and the third pseudo image signal BS' of the third pixel group PG3 from the HDR processing circuit 161.

[0200] When at least one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is unsaturated, the AF processing circuit 162A can use the first and second image signals of the unsaturated pixel group to generate an additional phase difference signal PHS.

[0201] When at least one of the second image signals RS and BS of the second pixel group PG2 and the third pixel group PG3 is saturated, the AF processing circuit 162A can use the first image signal and the second pseudo image signal of the saturated pixel group to generate an additional phase difference signal PHS.

[0202] Figure 15 This is a block diagram of an image sensor 100a according to an example embodiment. Detailed descriptions of features that are the same as or similar to those in the foregoing embodiments are omitted to avoid redundancy. Figure 15 The pixel group PG can correspond to the pixel group PG. Figure 1 PG pixel group.

[0203] Image sensor 100a may include a stacked first substrate 10a and a second substrate 20a. The first substrate 10a and the second substrate 20a can be connected to each other at the pixel group level by a wafer bonding process using copper-to-copper (C2C) interconnects. The first substrate 10a and the second substrate 20a are electrically connected not only through in-pixel contacts IN_CT within the pixel group PG, but also through a C2C array disposed in the peripheral region of the substrates. Control signals for controlling pixel circuits can be transmitted through the C2C array. Pixel signals from the first substrate 10a can be transmitted to the readout circuit of the second substrate 20a through the in-pixel contacts IN_CT.

[0204] In the example embodiment, some pixel circuits may be disposed on the first substrate 10a, while other pixel circuits may be disposed on the second substrate 20a.

[0205] In the example embodiment, all pixel circuits may be disposed on the second substrate 20a.

[0206] Figure 16 This is a block diagram of an image sensor 100b according to an example embodiment. Detailed descriptions of features that are the same as or similar to those in the foregoing embodiments are omitted to avoid redundancy. Figure 16 The pixel group PG can correspond to Figure 1 PG pixel group.

[0207] refer to Figure 16 The image sensor 100b may include a first substrate 10b, a second substrate 20b, and a third substrate 30b. The third substrate 30b, the second substrate 20b, and the first substrate 10b may be stacked sequentially in a direction D3 perpendicular to the plane of substrates 10b-30b (parallel to the planes D1 and D2).

[0208] In an example embodiment, some circuits PG_a, PG_b, and PG_c of the pixel group can be formed on one of the first substrate 10b and the second substrate 20b. The first portion of the pixel group's circuitry PG_a can be disposed on the first substrate 10b, while the remaining second portion of the pixel group's circuitry PG_b and PG_c can be disposed on the second substrate 20b. The third substrate 30b may include logic (such as readout circuitry, a timing controller, or an image signal processor) and interface circuitry. The readout circuitry may include an analog-to-digital converter (ADC).

[0209] The array of circuits constituting the pixel groups on the first substrate 10b and the second substrate 20b is not limited thereto.

[0210] The first substrate 10b and the second substrate 20b can be electrically connected to each other.

[0211] In an example embodiment, the first substrate 10b and the second substrate 20b can transmit pixel signals or control signals through through-silicon vias (TSVs) disposed in the peripheral region of the substrates.

[0212] In an example embodiment, the first portion of the pixel group circuit PG_a on the first substrate 10b and the second portion of the pixel group circuit PG_b on the second substrate 20b can also be electrically connected via the first substrate interconnect structure INTC_1. The substrate interconnect structure INTC_1 can be a C2C bonded contact or a deep contact structure. A deep contact structure can include a through-silicon via (TSV). The substrate interconnect structure INTC_1 can electrically connect the components of the first portion of the pixel group circuit PG_a to the components of the second portion of the pixel group circuit PG_b.

[0213] In an example embodiment, the first substrate 10b and / or the second substrate 20b can be electrically connected to the third substrate 30b via a through-silicon via (TSV) and / or an inter-substrate connection structure (INTC_2). Signals from the first substrate 10b and / or the second substrate 20b can be transmitted to the readout circuit (or image signal processor) of the third substrate 30b via the TSV and / or the inter-substrate connection structure (INTC_2).

[0214] In the example embodiment, the second part of the pixel group circuit PG_b can be electrically connected to the circuit of the third substrate 30b via C2C bonding contacts. The second substrate connection structure INTC_2 may include C2C bonding contacts.

[0215] In an example embodiment, the third part of the pixel group circuit PG_c can be electrically connected to the circuit of the third substrate 30b via through-silicon copper (TSC) interconnects.

[0216] Figure 17 This is a block diagram of an imaging device 1000 according to an example embodiment. Detailed descriptions of features that are the same as or similar to those in the foregoing embodiments have been omitted to avoid redundancy.

[0217] Imaging device 1000 may include imaging unit 1100, image sensor 1200, processor 1300, display device 1400 and storage device 1500.

[0218] The processor 1300 can control the overall operation of the imaging device 1000. The processor 1300 can provide the actuator 1120 with the control signal CTRL to control the position of the lens 1110, and thus control the focal length of the lens 1110.

[0219] The imaging unit 1100, which serves as a light receiving component, may include a lens 1110 and an actuator 1120. The lens 1110 may include multiple lenses.

[0220] The actuator 1120 can move the lens 1110 in the direction of increasing or decreasing distance from the object S based on the control signal CTRL from the processor 1300.

[0221] Image sensor 1200 can generate image data and phase data based on incident light. Image sensor 1200 may include pixel array 1210, timing controller 1220, readout circuit 1230 and image signal processor (ISP) 1240.

[0222] The pixels of pixel array 1210 may include at least one photoelectric conversion element.

[0223] According to the example embodiment, the image sensor 1200 can receive mode information MODE and white balance gain WB from the processor 1300.

[0224] The pixel group of pixel array 1210 can output a first pixel signal and a second pixel signal based on the mode information MODE. For example, the pixel group of pixel array 1210 can output the pixel signals described in Figures 7 to 10 in preview mode.

[0225] The image signal processor 1240 can use the white balance gain (WB gain) to generate the first pseudo-image signal for the first pixel group in the above example embodiment.

[0226] The image signal processing unit 1240 can send HDR image data IMG and phase difference signal PDS to the processor 1300.

[0227] Figure 18 This is a flowchart illustrating a method for operating an image sensor to generate HDR image data according to an example embodiment.

[0228] Figure 18 The method can be found in Figure 1 The image sensor 100 is used for execution. (Refer to...) Figure 1 and Figure 18 Describe the method of operating the image sensor 100.

[0229] In operation S110, the pixel group of the image sensor 100 can output a first pixel signal and a second pixel signal. The first pixel signal may include a (1-1)th pixel signal and a (1-2)th pixel signal.

[0230] A portion of the pixel group can output a (1-1)th pixel signal obtained by summing the pixel signals of a first pixel located at a position having opposite phase information relative to the microlens. For example, the first pixel can be located at a position symmetrical in the horizontal direction relative to the vertical central axis of the microlens. The first pixel can have opposite phase information in at least one of the horizontal and vertical directions relative to the microlens.

[0231] Another part of the pixel group can output a first (1-2) pixel signal obtained by summing the pixel signals of a second pixel located at a position having the same phase information relative to the microlens. For example, the second pixel can be located at the same position in the horizontal direction relative to the vertical central axis of the microlens within the pixel group. The second pixel can have the same phase information in the horizontal and / or vertical directions relative to the microlens.

[0232] Therefore, the array of the first pixel can be different from the array of the second pixel.

[0233] In operation S120, the readout circuit 150 can generate a first image signal based on a first pixel signal and a second image signal based on a second pixel signal.

[0234] In operation S130, the image signal processing circuit 160 can determine whether the second image signal of the pixel group is saturated.

[0235] In operation S140, when the second image signal is saturated, the image signal processing circuit 160 can generate a first pseudo-image signal for the first pixel group and / or a second pseudo-image signal for the second and third pixel groups based on at least one of Equations 1, 2, and 3. The image signal processing circuit 160 can generate the second pseudo-image signal for the first pixel group by amplifying the first image signal of the first pixel group by a factor of n. The amplification factor n can be the sensitivity ratio of the HDR image.

[0236] In operation S150, the image signal processing circuit 160 can use the first pseudo-image signal of the first pixel group and / or the second pseudo-image signal of the second pixel group and the third pixel group to generate HDR image data.

[0237] Figure 19 This is a flowchart illustrating a method for operating an image sensor to generate phase data according to an example embodiment.

[0238] Figure 19 The method can be found in Figure 1 The image sensor 100 is used for execution. (Refer to...) Figure 1 and Figure 19 Describe the method of operating the image sensor 100.

[0239] Operations S210 and S220 can be respectively connected with Figure 18 Operations S110 and S120 are the same, and repeated descriptions are omitted to avoid redundancy.

[0240] In operation S230, the image signal processing circuit 160 can generate a first pseudo-image signal for the first pixel group based on Equation 3. For example, as referenced... Figure 6 The image signal processing circuit 160 can generate a first pseudo image signal GAL for the first pixel group based on Equation 3.

[0241] In operation S240, the image signal processing circuit 160 can use the first pseudo-image signal and the first image signal of the first pixel group to generate phase data. For example, as Figure 13 As described in the example embodiments, Figure 13 The AF processing circuit 162 can generate phase data.

[0242] As described above, according to the example embodiment, the image sensor can generate image data with high dynamic range (HDR) and phase information for autofocusing across a wide illumination range.

[0243] While exemplary embodiments have been shown and described above, it will be apparent to those skilled in the art that modifications and variations may be made without departing from the scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An image sensor, comprising: A pixel array, comprising multiple groups of pixels and configured to output pixel signals; and The readout circuit is configured to output a first image signal based on the pixel signal output during a first readout period, and to output a second image signal based on the pixel signal output during a second readout period. Each of the plurality of pixel groups includes a plurality of pixels sharing a microlens, and During the first readout period, the first pixel group among the plurality of pixel groups is configured to output a first (1-1) pixel signal obtained by summing the pixel signals of some pixels located at positions with opposite phase information relative to the microlens in a predetermined direction, and the second and third pixel groups among the plurality of pixel groups are configured to output a first (1-2) pixel signal obtained by summing the pixel signals of some pixels located at positions with the same phase information relative to the microlens in the predetermined direction.

2. The image sensor according to claim 1, wherein, The readout circuit is configured as follows: During the first readout period, based on the pixel signals of a subset of the pixels, the first image signal of each pixel group in the plurality of pixel groups is output; as well as During the second readout period, based on the pixel signals of all the plurality of pixels, the second image signal of each of the plurality of pixel groups is output.

3. The image sensor according to claim 1, further comprising: A color filter array is disposed on the pixel array. The color filter array includes a red filter, a green filter, and a blue filter. The first pixel group corresponds to the green filter and is configured to output pixel signals based on green light signals. The second pixel group corresponds to the red color filter and is configured to output pixel signals based on red light signals. The third pixel group corresponds to the blue filter and is configured to output pixel signals based on blue light signals.

4. The image sensor according to claim 1, wherein, Each of the plurality of pixel groups includes at least one microlens.

5. The image sensor according to claim 1, wherein, During the first readout period, the first pixel group is configured to output the (1-1)th pixel signal obtained by summing the pixel signals of some pixels symmetrically arranged in the horizontal direction and corresponding to the microlens, and The second pixel group and the third pixel group are configured to output the (1-2)th pixel signal obtained by summing the pixel signals of some pixels arranged along the horizontal direction and corresponding to the microlens.

6. The image sensor according to claim 1, wherein, During the first readout period, the first pixel group is configured to output the (1-1)th pixel signal obtained by summing the pixel signals of some pixels disposed below different microlenses, and is configured to sense light signals having opposite phase information in the horizontal direction. The second pixel group and the third pixel group are configured to output the (1-2) pixel signal obtained by summing the pixel signals of some pixels disposed below different microlenses, and are configured to sense light signals having the same phase information in the horizontal direction.

7. The image sensor according to claim 1, wherein, During the first readout period, the first pixel group is configured to output the (1-1)th pixel signal obtained by summing the pixel signals of some pixels disposed below the same microlens, and is configured to sense light signals having opposite phase information in the horizontal direction. The second pixel group and the third pixel group are configured to output the (1-2) pixel signal obtained by summing the pixel signals of some pixels disposed below the same microlens, and are configured to sense light signals having the same phase information in the horizontal direction.

8. The image sensor according to claim 1, further comprising: The image signal processing circuit is configured to generate image data based on the first image signal and the second image signal. The image signal processing circuit is configured to generate at least a portion of high dynamic range (HDR) image data using a first image signal of the first pixel group as a low-sensitivity image signal and a signal obtained by amplifying the first image signal of the first pixel group as a high-sensitivity image signal.

9. The image sensor according to claim 1, further comprising: The image signal processing circuit is configured to generate image data based on the first image signal and the second image signal. The image signal processing circuit is configured to generate high dynamic range (HDR) image data by using a first image signal of each of the second and third pixel groups as a low-sensitivity image signal and a second image signal of each of the second and third pixel groups as a high-sensitivity image signal.

10. The image sensor according to claim 9, wherein, The image signal processing circuit is configured to respond to the detection of second image signal saturation in the second pixel group or the third pixel group: Based on the ratio of the second image signal to the first image signal of the fourth pixel group, and the first image signal of the second pixel group or the third pixel group, recover the saturated second image signal of the second pixel group or the third pixel group; and The HDR image data is generated based on the recovered second image signal from the second pixel group or the third pixel group, and The fourth pixel group is adjacent to the second pixel group or the third pixel group that is saturated by the second image signal.

11. The image sensor of claim 9, wherein the image signal processing circuit is configured to saturate in response to detecting that the second image signals of the second pixel group and the third pixel group are both saturated: Based on the ratio of the first image signal to the third image signal of each of the second and third pixel groups, and the signal obtained by amplifying the first image signal of the first pixel group, a saturated second image signal for each of the second and third pixel groups is recovered; and At least a portion of the HDR image data is generated based on the recovered second image signal from each of the second pixel group and the third pixel group, and in, The image signal processing circuit is further configured to generate a third image signal for the first pixel group based on the first image signal of the second pixel group and the first image signal of the third pixel group.

12. The image sensor according to claim 1, further comprising: The image signal processing circuit is configured to generate phase data based on the first image signal and the second image signal. The image signal processing circuit is configured as follows: Generate a third image signal for the first pixel group based on the first image signal of the second pixel group and the first image signal of the third pixel group; and The phase data is generated based on the first image signal of the first pixel group and the third image signal of the first pixel group.

13. The image sensor according to claim 12, wherein, The image signal processing circuit is configured as follows: A fourth image signal for the first pixel group is generated based on the difference between the third image signal of the first pixel group and the first image signal of the first pixel group. and The phase data is generated based on the third image signal of the first pixel group and the fourth image signal of the first pixel group.

14. The image sensor according to claim 12, wherein, The image signal processing circuit is configured to generate the phase data further based on the following in response to detecting that the second image signal of the second pixel group or the second image signal of the third pixel group is unsaturated: The first image signal of the second pixel group and the second image signal of the second pixel group, or The first image signal of the third pixel group and the second image signal of the third pixel group.

15. An image sensor, comprising: A pixel array comprising multiple pixel groups, and configured to output a first pixel signal during a first readout period and a second pixel signal during a second readout period for each of the multiple pixel groups; At least one microlens is disposed above each of the plurality of pixel groups to overlap with each of the plurality of pixel groups in a direction perpendicular to the substrate of the image sensor, and is shared by the plurality of pixels; and The readout circuit is configured to output an image signal based on the first pixel signal and the second pixel signal. During the first readout period, the first pixel group among the plurality of pixel groups is configured to output the (1-1)th pixel signal obtained by summing the pixel signals of the first pixel as the first pixel signal, and the second and third pixel groups among the plurality of pixel groups are configured to output the (1-2)th pixel signal obtained by summing the pixel signals of the second pixel as the first pixel signal. Wherein, the first pixel in the first pixel group is symmetrically arranged in the horizontal direction with respect to the vertical central axis of the at least one microlens, and the second pixel in the second pixel group and the third pixel group is arranged at a position along the horizontal direction.

16. The image sensor according to claim 15, wherein, The readout circuit is configured to output a first image signal based on the first pixel signal during the first readout period, and to output a second image signal based on the second pixel signal during the second readout period. In each of the plurality of pixel groups, the amplitude of the first image signal is smaller than the amplitude of the second image signal.

17. The image sensor according to claim 15, wherein, The array in which the first pixel is disposed in the first pixel group is different from the array in which the second pixel is disposed in the second pixel group and the third pixel group.

18. The image sensor according to claim 15, wherein, Each of the plurality of pixel groups includes a plurality of pixels disposed at positions having different phase information in the horizontal direction and a plurality of pixels disposed at positions having the same phase information in the horizontal direction.

19. The image sensor according to claim 15, further comprising: The image signal processing circuit is configured to generate phase data based on the image signal. The image signal processing circuit is configured to generate the phase data using a first pseudo-image signal based on the (1-2)th pixel signal of the second pixel group and the third pixel group and a first image signal based on the (1-1)th pixel signal.

20. A method of operating an image sensor, the method comprising: The first pixel signal and the second pixel signal are output from multiple pixel groups; The readout circuit outputs a first image signal and a second image signal based on the first pixel signal and the second pixel signal, respectively. as well as The image signal processing circuit outputs phase data based on the first image signal and the second image signal. Wherein, the first pixel signal includes the (1-1)th pixel signal and the (1-2)th pixel signal, and Wherein, at least one of the plurality of pixel groups is configured to output the first (1-1) pixel signal obtained by summing the pixel signals of some pixels set at positions with opposite phase information and corresponding to the microlens, and the other pixel groups of the plurality of pixel groups are configured to output the first (1-2) pixel signal obtained by summing the pixel signals of some pixels set at positions with the same phase information and corresponding to the microlens.

Images