Image sensor outputting phase data and high dynamic range image

Abstract

An image sensor is provided. The image sensor includes: a pixel array including a plurality of pixels; a readout circuit configured to digitize pixel signals of the plurality of pixels into a plurality of image signals; and an image processing circuit configured to output high dynamic range (HDR) image data and phase data based on the plurality of image signals. The plurality of pixels includes a first pixel and a second pixel. Each of the first pixel and the second pixel includes a sub-pixel sharing a microlens, and each sub-pixel includes a photoelectric element and a transmission transistor connecting the photoelectric element to a floating diffusion node. In the first pixel and the second pixel, a portion of the sub-pixels located at the same position relative to the microlens are configured to receive control signals from the transmission transistor via different interconnects.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2025-0036142, filed on March 20, 2025, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] This disclosure relates to an image sensor, and more specifically, to an image sensor that generates high dynamic range (HDR) images and phase data. Background Technology

[0004] An image sensor can be a device configured to convert optical signals into electrical signals. Examples of image sensors include charge-coupled device (CCD) image sensors and complementary metal-oxide-semiconductor (CMOS) image sensors. Image sensors can be configured to generate phase data for autofocus (AF). For example, in phase-difference autofocus (PDAF), an application processor can adjust the focal length based on the phase difference between optical signals detected by pixels positioned at different locations. This can increase the sensor's dynamic range and image quality. Summary of the Invention

[0005] One or more embodiments of this disclosure may include an image sensor configured to generate HDR images and reliably generate phase data over a wide dynamic range.

[0006] According to one aspect of one or more embodiments, an image sensor may include: a pixel array including a plurality of pixels; a readout circuit configured to digitize pixel signals of the plurality of pixels into a plurality of image signals; and an image processing circuit configured to output high dynamic range (HDR) image data and phase data based on the plurality of image signals. The plurality of pixels may include a first pixel and a second pixel. Each of the first pixel and the second pixel may include a sub-pixel sharing a microlens, and each sub-pixel includes a photoelectric element and a transmission transistor connecting the photoelectric element to a floating diffusion node. In each of the first pixel and the second pixel, a portion of the sub-pixels located at the same position relative to the microlens may be configured to receive transmission control signals of the transmission transistor via different interconnects.

[0007] According to another aspect of one or more embodiments, an image sensor may include: a pixel array including a plurality of pixels; a readout circuit configured to digitally convert pixel signals of the plurality of pixels into image signals; and an image processing circuit configured to output high dynamic range (HDR) image data and phase data based on the image signals. The plurality of pixels may include a first pixel and a second pixel. Each of the first pixel and the second pixel may include a sub-pixel sharing a microlens, each sub-pixel including a photoelectric element and a transfer transistor configured to connect the photoelectric element to a floating diffusion node. At least one sub-pixel of the first pixel may be configured not to output a pixel signal during both a first readout period and a second readout period. Each sub-pixel of the second pixel may be configured to output a pixel signal during at least one of the first readout period and the second readout period.

[0008] According to another aspect of one or more embodiments, an image sensor may include: a pixel array including a plurality of pixel groups; a readout circuit configured to digitally convert pixel signals from the pixel array into image signals; and an image processing circuit configured to output high dynamic range (HDR) image data and phase data based on the image signals. Each of the plurality of pixel groups may include a plurality of first pixels and a plurality of second pixels arranged along row and column directions. Each of the plurality of first pixels and each of the plurality of second pixels may include a subpixel sharing a microlens, each of the subpixels including a photoelectric element and a transfer transistor connecting the photoelectric element to a floating diffusion node. A first subpixel of each of the plurality of first pixels may be configured to output a pixel signal during at least one of a first readout period and a second readout period, and a second subpixel of each of the plurality of first pixels may be configured not to output a pixel signal during either the first readout period or the second readout period. A subpixel of each of the plurality of second pixels may be configured to output a pixel signal during at least one of the first readout period and the second readout period. Attached Figure Description

[0009] Various techniques will be described with reference to the accompanying drawings, in which:

[0010] Figure 1 This is an example diagram illustrating an image sensor according to one or more embodiments;

[0011] Figure 2 This is an example diagram illustrating a method by which an image signal processor generates phase data based on a first pixel and a second pixel according to one or more embodiments;

[0012] Figure 3 This is an example diagram illustrating an image signal used to generate HDR image data and phase data according to one or more embodiments;

[0013] Figure 4 This is an example diagram illustrating a method for generating HDR image data from an image signal processor according to one or more embodiments;

[0014] Figure 5 This is an example diagram illustrating a method for generating phase data from an image signal processor according to one or more embodiments;

[0015] Figures 6A-6D This is an example diagram showing pixels according to one or more embodiments;

[0016] Figure 7 This is an example circuit diagram of a pixel according to one or more embodiments;

[0017] Figure 8 It is shown that according to at least the combination Figure 7 Example timing diagrams of pixel operation in a first mode for one or more embodiments described;

[0018] Figure 9 This is an example diagram showing a first pixel according to one or more embodiments;

[0019] Figure 10 and Figure 11 This is an example diagram showing a group of pixels including a first pixel according to one or more embodiments;

[0020] Figure 12 and Figure 13 They respectively show the combination of at least Figure 9 Example diagrams illustrating a first readout operation and a second readout operation for a pixel group including a first pixel, representing one or more embodiments described;

[0021] Figure 14 It is shown that according to at least the combination Figure 9 Example diagram of an example of an interconnect for controlling a first pixel, describing one or more embodiments;

[0022] Figure 15 and Figure 16 It is shown that according to at least the combination Figure 9 Example diagrams of a first readout operation and a second readout operation of a first pixel in one or more embodiments described;

[0023] Figure 17A It is a graph showing phase data from an example image sensor, and Figure 17B It shows the combination Figure 9 A graph of phase data from an image sensor including a first pixel, describing one or more embodiments;

[0024] Figure 18 This is an example diagram showing a first pixel according to one or more embodiments;

[0025] Figure 19 and Figure 20 They respectively show the combination of at least Figure 18 Example diagrams illustrating a first readout operation and a second readout operation for a pixel group including a first pixel, representing one or more embodiments described;

[0026] Figures 21 to 28 It shows the combination Figure 18 Example diagrams illustrating one or more embodiments of the described example for controlling the interconnects of the first pixel and the readout operation of the first pixel;

[0027] Figure 29 It shows the combination Figure 18 Example diagrams of phase data from an image sensor including a first pixel, describing one or more embodiments;

[0028] Figure 30 It shows the combination Figure 9 Example diagrams of a first readout operation of a pixel group including a first pixel, according to one or more embodiments described;

[0029] Figures 31 to 34 It shows the combination Figure 9 Example diagrams illustrating one or more embodiments of the described example for controlling the interconnects of the first pixel and the readout operation of the first pixel;

[0030] Figure 35 It shows that it is based on at least the combination Figures 30 to 34 Example diagram of the phase data generated by the described operation;

[0031] Figure 36 It shows the combination Figure 9 Example diagrams of a first readout operation of a pixel group including a first pixel, according to one or more embodiments described;

[0032] Figure 37 It shows the combination Figure 36 Example diagrams of a method for generating phase data by an image signal processor based on a first readout operation, according to one or more embodiments described;

[0033] Figure 38 and Figure 39 It is shown that according to at least the combination Figure 36 and Figure 37 Example diagrams of the first and second readout operations of a pixel group according to one or more embodiments described;

[0034] Figure 40This is an example diagram illustrating pixel units, each including a first pixel, according to one or more embodiments;

[0035] Figure 41 and Figure 42 It shows the combination Figure 40 Example diagrams of a first readout operation and a second readout operation of a pixel unit according to one or more embodiments described;

[0036] Figure 43 This is an example diagram illustrating pixel units, each including a first pixel, according to one or more embodiments;

[0037] Figure 44 and Figure 45 It shows the combination Figure 43 Example diagrams of a first readout operation and a second readout operation of a pixel unit according to one or more embodiments described;

[0038] Figure 46 This is an example diagram illustrating pixel units, each including a first pixel, according to one or more embodiments;

[0039] Figure 47 and Figure 48 It shows the combination Figure 46 Example diagrams of a first readout operation and a second readout operation of a pixel unit according to one or more embodiments described;

[0040] Figure 49 This is an example diagram illustrating pixel units, each including a first pixel, according to one or more embodiments; and

[0041] Figure 50 and Figure 51 It shows according to Figure 49 Example diagrams of the first and second readout operations of pixel units in one or more embodiments. Detailed Implementation

[0042] The following description, provided with reference to the accompanying drawings, is intended to aid in a comprehensive understanding of the various embodiments of this disclosure.

[0043] Unless otherwise indicated herein or clearly contradicted by the context, the use of “a” and “the” and similar designations in the context of describing the disclosed embodiments (especially in the context of the appended claims) should be interpreted as covering both the singular and plural forms and should not be considered as a limitation of the terminology.

[0044] As used herein, expressions such as “comprising,” “having,” “constituting,” or “including” should not be construed as necessarily including all elements or operations described herein, and should be construed as allowing the exclusion of some of these elements or operations, or further including additional elements or operations.

[0045] Terms such as “first,” “second,” “third,” and “fourth” are used only to distinguish one element from another and therefore do not indicate any particular order unless the order is specifically described. For example, the term “second” may be used without the term “first.” Furthermore, although the terms “first,” “second,” “third,” etc., may be used herein to describe various elements, components, regions, layers, and / or parts, these elements, components, regions, layers, and / or parts should not be limited by these terms.

[0046] It should be understood that when a component is referred to as "connected" or "coupled" to another component, the component may be directly connected or coupled to that other component, or any other component may be inserted between them. Conversely, it should be understood that when a component is referred to as "directly connected" or "directly coupled" to another component, there is no component inserted between them.

[0047] Unless otherwise specifically stated or clearly contradicted by the context, phrases such as “at least one of A, B, and C” or “at least one of A, B, and C” should be understood in context as generally used to express any non-empty subset of an item, term, etc., that can be A or B or C, or A and B and C. For example, in an illustrative example of a set with three members, the connecting phrases “at least one of A, B, and C” and “at least one of A, B, or C” refer to any one of the following sets: {A}, {B}, {C}, {A, B}, {A, C}, {B, C}, {A, B, C}. Therefore, such language is generally not intended to imply that some embodiments require the presence of at least one A, at least one B, and at least one C.

[0048] Unless otherwise stated or contradicted by the context, terms such as “set” (e.g., “set of items”) or “subset” should be interpreted as a non-empty set that includes one or more members. Furthermore, unless otherwise stated or contradicted by the context, the term “subset” corresponding to a set does not necessarily mean a proper subset of the corresponding set, but rather that the subset and the corresponding set can be equal.

[0049] Additionally, unless otherwise stated or contradicted by the context, the term "multiple" indicates the existence of multiple items (e.g., "a plurality of items" indicates more than one item). The number of items in the plural form is at least two, but may be more when explicitly indicated or indicated by the context. Furthermore, unless otherwise stated or clearly implied by the context, the term "based on" means "at least partially based on," not "completely based on."

[0050] Figure 1 This is an example diagram illustrating an image sensor 100 according to one or more embodiments.

[0051] The pixel array 110 according to an embodiment may include a first pixel PX1 and a second pixel PX2. The image sensor 100 may control the first pixel PX1 and the second pixel PX2 differently in a specific mode. For example, the second sub-pixel SPX2 of the first pixel PX1 may not output a pixel signal during all readout periods (multiple readout operations) in a specific mode. The second sub-pixel SPX2 of the first pixel PX1 may be referred to as a sub-pixel that is electrically disabled in a specific mode.

[0052] For example, when a sub-pixel outputs a pixel signal, at least a portion of the pixel signal output from the pixel array can be based on the photocharge generated by that sub-pixel.

[0053] Depend on Figures 1 to 4 The dashed lines in the diagram indicate subpixels that can represent conceptual subpixels, but do not indicate the number or location of subpixels. For example, Figure 1 It does not necessarily indicate that each of the subpixels SPX1, SPX2, SPX3, and SPX4 consists of only one subpixel. Figure 1 It should not be interpreted as merely indicating that the first sub-pixel SPX1 and the second sub-pixel SPX2 are laterally symmetrical with respect to the microlens ML1. Figure 1 It should not be interpreted as merely indicating that the third sub-pixel SPX3 and the fourth sub-pixel SPX4 are laterally symmetrical with respect to the microlens ML2.

[0054] refer to Figure 1 The image sensor 100 according to the embodiment is described in detail.

[0055] refer to Figure 1 The image sensor 100 may include a pixel array 110, a line driver 120, a timing controller 130, a ramp generator 140, a readout circuit 150, an image signal processor 160, and a control register 170.

[0056] Pixel array 110 may include multiple pixels. The multiple pixels may be arranged, for example, in a matrix. Pixel array 110 may receive multiple pixel drive signals CSn (e.g., select signals, reset signals, and transfer control signals) from row driver 120. Pixel array 110 may operate under the control of the received pixel drive signals CSn.

[0057] The photoelectric conversion element can be a photodiode (PD). A photodiode (PD) can refer to a photoelectric conversion element that generates and accumulates charge proportionally to the optical signal incident on each pixel. The photoelectric conversion element can be a photodiode (PD), a photocapacitor, a photogate, a pinned photodiode (PPD), a partially pinned photodiode, an organic photodiode (OPD), a quantum dot (QD), or a combination thereof. According to one or more embodiments, the photoelectric conversion element can be a photodiode (PD). However, other photoelectric conversion elements, including those described above, can also be used as photoelectric conversion elements, and the photoelectric conversion element is not limited to a photodiode (PD).

[0058] Each pixel of the image sensor 100 can use a photoelectric conversion element to convert an optical signal into a pixel signal PXS as an electrical signal. The pixel signal PXS can be provided to the readout circuit 150 through multiple column lines CL. The readout circuit 150 may include an analog-to-digital converter that converts the pixel signal PXS into a digital image signal IS.

[0059] The image signal processor 160 can process the image signal IS to generate HDR image data HIDT and phase data PDT. The HDR image data HIDT and phase data PDT can be output to an interface circuit. The interface circuit can then output the HDR image data HIDT and phase data PDT to an external entity. For example, the interface circuit can send the HDR image data HIDT and phase data PDT to an application processor.

[0060] The image sensor 100 can operate in multiple modes based on control information stored in the control register 170. For example, the control register 170 can store mode information received from an external device via an interface circuit.

[0061] According to an embodiment, the row driver 120 can generate a pixel drive signal CSn to control pixels PX1 and PX2 based on control information.

[0062] For example, the row driver 120 can generate a pixel drive signal CSn to control pixels PX1 and PX2 differently in different modes.

[0063] For example, in a first mode, the row driver 120 can generate a pixel drive signal CSn to control the transfer of photoelectric charge from each of the sub-pixels SPX1, SPX2, SPX3, and SPX4 of pixels PX1 and PX2 to the floating diffusion node. In a second mode, the row driver 120 can generate a pixel drive signal CSn to control a subset of the sub-pixels SPX1, SPX2, SPX3, and SPX4 of pixels PX1 and PX2, thereby preventing photoelectric charge from being transferred to the floating diffusion node during all readout periods.

[0064] The image signal processor 160 can generate HDR image data HIDT and phase data PDT based on control information. For example, the image signal processor 160 can generate HDR image data HIDT and phase data PDT in different ways in different modes.

[0065] The pixel array 110 according to an embodiment may include a plurality of pixel groups PG. Each of the pixel groups PG may include a plurality of pixels.

[0066] A pixel group PG may include a first pixel PX1 and a second pixel PX2. A pixel group PG may include multiple first pixels PX1 and multiple second pixels PX2. A pixel group PG may include a number of second pixels PX2 equal to or greater than the number of first pixels PX1.

[0067] One of the multiple first pixels PX1 can be set in the same row as one of the multiple second pixels PX2.

[0068] The first pixel PX1 and the second pixel PX2 can each include microlenses ML1 and ML2, respectively.

[0069] The first pixel PX1 and the second pixel PX2 may each include sub-pixels that share microlenses ML1 and ML2. The first pixel PX1 and the second pixel PX2 may each include multiple sub-pixels. For example, the first pixel PX1 may include a first sub-pixel SPX1 and a second sub-pixel SPX2, and the second pixel PX2 may include a third sub-pixel SPX3 and a fourth sub-pixel SPX4.

[0070] In one or more embodiments, in each of the first pixels PX1 located in different rows, the position of the second sub-pixel SPX2 may vary relative to the microlens ML1.

[0071] In one or more embodiments, each of the first sub-pixel SPX1, the second sub-pixel SPX2, the third sub-pixel SPX3, and the fourth sub-pixel SPX4 may include at least one sub-pixel. For example, each of the first sub-pixel SPX1, the second sub-pixel SPX2, the third sub-pixel SPX3, and the fourth sub-pixel SPX4 may include multiple sub-pixels.

[0072] In one or more embodiments, at least one of the first sub-pixel SPX1, the second sub-pixel SPX2, the third sub-pixel SPX3, and the fourth sub-pixel SPX4 may include multiple sub-pixels. For example, the first pixel PX1 may include multiple first sub-pixels SPX1 and multiple second sub-pixels SPX2. Alternatively, the first pixel PX1 may include multiple first sub-pixels SPX1 and a single second sub-pixel SPX2.

[0073] The position of the first sub-pixel SPX1 relative to the microlens ML1 can correspond to the position of the third sub-pixel SPX3 relative to the microlens ML2, and the position of the second sub-pixel SPX2 relative to the microlens ML1 can correspond to the position of the fourth sub-pixel SPX4 relative to the microlens ML2. The number of third sub-pixels SPX3 can be the same as the number of first sub-pixels SPX1, and the number of fourth sub-pixels SPX4 can be the same as the number of second sub-pixels SPX2. The number of second and fourth sub-pixels can be greater than or equal to the number of first and third sub-pixels, respectively.

[0074] Each of the sub-pixels SPX1, SPX2, SPX3, and SPX4 of the first pixel PX1 and the second pixel PX2 may include an optoelectronic element and a transmission transistor for connecting the optoelectronic element to a floating diffusion node.

[0075] In one or more embodiments, in the second mode, the first pixel PX1 and the second pixel PX2 can be controlled differently by the row driver 120. The first pixel PX1 and the second pixel PX2 can operate differently based on the pixel drive signal CSn of the row driver 120.

[0076] For example, in the second mode, the first sub-pixel SPX1 of the first pixel PX1 can output a pixel signal during at least one of the first and second readout periods, and each of the sub-pixels SPX3 and SPX4 of the second pixel PX2 can output a pixel signal during at least one of the first and second readout periods. The second sub-pixel SPX2 of the first pixel PX1 can not output a pixel signal during either the first or second readout period. For example, the second sub-pixel SPX2 of the first pixel PX1 can be electrically controlled to prevent it from outputting a pixel signal during both the first and second readout periods.

[0077] In one or more embodiments, in a first mode, sub-pixels located at the same position relative to the microlens in the first pixel PX1 and the second pixel PX2, which are arranged in the same row, can operate in the same manner. For example, the first pixel PX1 and the second pixel PX2 can be arranged in the same row, and the first sub-pixel SPX1 and the third sub-pixel SPX3 can be arranged at the same position relative to the microlens in the first pixel PX1 and the second pixel PX2. In the first mode, the first sub-pixel SPX1 and the third sub-pixel SPX3 can output pixel signals during the same readout period, and the second sub-pixel SPX2 and the fourth sub-pixel SPX4 can output pixel signals during the same readout period.

[0078] In one or more embodiments, in the second mode, some sub-pixels in the first pixel PX1 and the second pixel PX2 that are located at the same position relative to the microlens can receive control signals (transmission control signals) for the transmission transistor through different interconnects.

[0079] For example, even when the first pixel PX1 and the second pixel PX2 are located in the same row, the first sub-pixel SPX1 of the first pixel PX1 and the third sub-pixel SPX3 of the second pixel PX2 can receive transmission control signals through the same interconnection line, while the second sub-pixel SPX2 of the first pixel PX1 and the fourth sub-pixel SPX4 of the second pixel PX2 can receive transmission control signals through different interconnection lines. Alternatively, the first sub-pixel SPX1, the second sub-pixel SPX2, the third sub-pixel SPX3, and the fourth sub-pixel SPX4 can all receive transmission control signals through different interconnection lines.

[0080] In one or more embodiments, the image signal processor 160 can generate phase data PDT differently based on control information in different modes. For example, the image signal processor 160 can generate one type of phase data in a first mode and two types of phase data in a second mode. Alternatively, the image signal processor 160 can generate one type of phase data in a first mode and different types of phase data in a second mode.

[0081] In the second mode, the image signal processor 160 can generate phase data based on the pixel signal of the first sub-pixel SPX1 of the first pixel PX1. The first sub-pixel SPX1 of the first pixel PX1 can output an unsaturated pixel signal with a wide dynamic range. For example, the first sub-pixel SPX1 of the first pixel PX1 can output an unsaturated pixel signal ranging from low brightness to high brightness. Therefore, the image sensor 100 can reliably generate phase data with a wide dynamic range.

[0082] Electronic devices can use phase data from image sensor 100 to accurately perform autofocus over a wide dynamic range. For example, even in very bright environments, image sensor 100 can generate phase data based on unsaturated pixel signals, and electronic devices can accurately perform autofocus.

[0083] Figure 2 It shows the result of Figure 1 An example diagram of a method for generating phase data based on a first pixel and a second pixel in an image signal processor 160.

[0084] Figure 2 The first pixels PX1_a and PX1_b can correspond to Figure 1 The first pixel, PX1. Figure 2 The second pixels PX2_a and PX2_b can correspond to Figure 1 The second pixel, PX2.

[0085] refer to Figure 2 The described method for generating phase data PDT1 and PDT2 can be executed in a specific mode. For example, Figure 2 The method can be executed in high-speed shooting mode.

[0086] In one or more embodiments, the image sensor 100 may generate multiple phase data PDT1 and PDT2.

[0087] The readout circuit 150 can read the pixel signal of a pixel in a single frame through multiple readout operations RO1 and RO2.

[0088] For example, the readout circuit 150 can read the pixel signal of a portion of the sub-pixels in each pixel in the first readout operation RO1, and read the pixel signal of all the sub-pixels in each pixel in the second readout operation RO2.

[0089] According to the embodiment, the electrically disabled sub-pixel can not output a pixel signal in either the first readout operation RO1 or the second readout operation RO2.

[0090] The image signal processor 160 can use at least a portion of the image signals IS1, IS2, IS3A, IS3B and IS4 generated based on multiple readout operations RO1 and RO2 to generate multiple phase data PDT1 and PDT2.

[0091] In one or more embodiments, the positions of the second sub-pixel SPX2 in the first pixels PX1_a and PX1_b can be different from each other. For example, the second sub-pixel SPX2 of one first pixel PX1_a can be positioned on the right side relative to the microlens ML, and the second sub-pixel SPX2 of another first pixel PX1_b can be positioned on the left side relative to the microlens ML.

[0092] In one or more embodiments, one of the sub-pixels of the first pixels PX1_a and PX1_b may not output a pixel signal in either the first readout operation RO1 or the second readout operation RO2. For example, the second sub-pixel SPX2 of the first pixels PX1_a and PX1_b may not output a pixel signal in either the first readout operation RO1 or the second readout operation RO2. Conversely, the sub-pixels SPX3 and SPX4 of the second pixels PX2_a and PX2_b may output a pixel signal in at least one of the first readout operation RO1 and the second readout operation RO2.

[0093] refer to Figure 2 In the first readout operation RO1, the first pixel PX1_a and the second pixels PX2_a and PX2_b can output pixel signals, while the first pixel PX1_b can choose not to output a pixel signal. For example, the first pixel PX1_a can output only the first pixel signal PXS1 based on the first sub-pixel SPX1. The second pixel PX2_a can output only the second pixel signal PXS2 based on the third sub-pixel SPX3. The second pixel PX2_b can output only the second pixel signal PXS2 based on the fourth sub-pixel SPX4.

[0094] For example, in the first readout operation RO1, each of pixels PX1_a, PX1_b, PX2_a, and PX2_b can output a pixel signal based on a portion of the subpixels located at the same position in the subpixel, excluding the electrically disabled subpixels.

[0095] refer to Figure 2 In the second readout operation RO2, the first pixels PX1_a and PX1_b, and the second pixels PX2_a and PX2_b, can output pixel signals. For example, the first pixel PX1_a can output only the third pixel signal PXS3A based on the first sub-pixel SPX1. The second pixels PX2_a and PX2_b can output a fourth pixel signal PXS4 based on all sub-pixels SPX3 and SPX4. The first pixel PX1_b can output only the third pixel signal PXS3B based on the first sub-pixel SPX1.

[0096] For example, in the second readout operation RO2, each of pixels PX1_a, PX1_b, PX2_a, and PX2_b can output a pixel signal based on all sub-pixels except for those that are electrically disabled.

[0097] The image signal processor 160 can generate second phase data PDT2 based on the pixel signals PXS2 and PXS4 of the second pixels PX2_a and PX2_b.

[0098] For example, the image signal processor 160 can generate a portion of the second phase data PDT2 based on the second image signal IS2 based on the second pixel signal PXS2. The image signal processor 160 can generate another portion of the second phase data PDT2 by subtracting the image signal generated based on the second image signal IS2 from the fourth image signal IS4 based on the fourth pixel signal PXS4.

[0099] The image signal processor 160 can generate the first phase data PDT1 based solely on the third pixel signals PXS3A and PXS3B read in the second readout operation RO2 from among the pixel signals PXS1, PXS3A, and PXS3B of the first pixels PX1_a and PX1_b. Alternatively, the image signal processor 160 can generate the first phase data PDT1 without using the pixel signal PXS1 read in the first readout operation RO1.

[0100] For example, the image signal processor 160 can generate a third image signal IS3A based on the third pixel signal PXS3A to generate a portion of the first phase data PDT1, and can generate another third image signal IS3B based on another third pixel signal PXS3B to generate another portion of the first phase data PDT1.

[0101] According to one or more embodiments, first phase data PDT1 can be generated based on pixel signals PXS3A and PXS3B output solely by sub-pixels SPX1 of first pixels PX1_a and PX1_b. Therefore, pixel signals PXS3A and PXS3B can be unsaturated over a wide dynamic range. Thus, first phase data PDT1 can be reliably generated over a wide dynamic range.

[0102] Figure 3 This is an example diagram showing the image signal used to generate HDR image data HIDT and phase data PDT1 and PDT2 in the second mode.

[0103] refer to Figure 1 and Figure 3 This describes the image signals used to generate HDR image data HIDT and phase data PDT1 and PDT2.

[0104] At least one first pixel PX1 can output a pixel signal during the first readout operation. Figure 1 The readout circuit 150 can output a first image signal IS1 based on the pixel signal output by the first pixel PX1 in the first readout operation.

[0105] The first pixel PX1 can output a pixel signal during the second readout operation. Figure 1 The readout circuit 150 can output a third image signal IS3 based on the pixel signal output by the first pixel PX1 in the second readout operation.

[0106] The second pixel PX2 can output a pixel signal in both the first readout operation and the second readout operation. Figure 1 The readout circuit 150 can output a second image signal IS2 and a fourth image signal IS4 based on the pixel signals output from the second pixel PX2 in the first readout operation and the second readout operation, respectively.

[0107] The image signal processor 160 according to the embodiment can generate HDR image data HIDT based on the first image signal IS1, the second image signal IS2, the third image signal IS3 and the fourth image signal IS4.

[0108] The image signal processor 160 can generate the first phase data PDT1 based solely on the third image signal IS3.

[0109] The image signal processor 160 can generate second phase data PDT2 based on the first image signal IS1, the second image signal IS2, the third image signal IS3, and the fourth image signal IS4.

[0110] Figure 4 It shows the result of Figure 1 An example diagram of a method for generating HDR image data (HIDT) based on a first pixel PX1 and a second pixel PX2 using an image signal processor 160. (Reference) Figure 1 and Figure 4 This describes a method for generating HDR image data (HIDT) by an image signal processor 160. The image signal processor 160 may include a bad pixel correction circuit 161 and an HDR processing circuit 162.

[0111] Image signal processor 160 can be used from Figure 1 The readout circuit 150 receives the low-sensitivity image signal S1 and the high-sensitivity image signal S2.

[0112] For example, during the first readout period, the low-sensitivity image signal S1 may include Figure 2The first image signal IS1 and the second image signal IS2 are based on a portion of the sub-pixels of the first pixel PX1 and the second pixel PX2, excluding the second sub-pixel SPX2 of the first pixel PX1.

[0113] For example, during the first readout period, the low-sensitivity image signal S1 may include a first image signal IS1 and a second image signal IS2, which are based on a portion of the sub-pixels in the first pixel PX1 and the second pixel PX2 that correspond to the same position relative to the microlenses ML1 and ML2.

[0114] For example, during the second readout period, the high-sensitivity image signal S2 may include Figure 2 The third image signals IS3A and IS3B and the fourth image signal IS4 are based on all sub-pixels of the first pixel PX1 except for the second sub-pixel SPX2 and all sub-pixels of the second pixel PX2.

[0115] Based on the image signal of the pixel adjacent to the second sub-pixel SPX2, the bad pixel correction circuit 161 can perform bad pixel correction on the second sub-pixel SPX2 of the first pixel PX1 in the low-sensitivity image signal S1 and the high-sensitivity image signal S2, and can generate the corrected low-sensitivity image signal CS1 and the corrected high-sensitivity image signal CS2 respectively.

[0116] For example, the bad pixel correction circuit 161 can interpolate the image signal of surrounding pixels having the same color filter as the second sub-pixel SPX2 to generate a low-sensitivity image signal and a high-sensitivity image signal for the second sub-pixel SPX2. The bad pixel correction circuit 161 can then generate a corrected low-sensitivity image signal CS1 and a corrected high-sensitivity image signal CS2 based on the low-sensitivity image signal and the high-sensitivity image signal for the second sub-pixel SPX2.

[0117] The HDR processing circuit 162 can generate HDR image data HIDT based on the corrected low-sensitivity image signal CS1 and the corrected high-sensitivity image signal CS2.

[0118] In the second mode, even when the second sub-pixel SPX2 of the first pixel PX1 does not output a pixel signal, Figure 1 The image sensor 100 can also perform bad pixel correction on the image signal based on the second sub-pixel SPX2 to reliably generate HDR image data HIDT.

[0119] Figure 5 It shows the result of Figure 1 An example diagram illustrating a method by which the image signal processor 160 generates phase data PDT1 and PDT2 based on a first pixel and a second pixel in a second mode. (See reference) Figure 1 , Figure 4 and Figure 5 This describes a method for generating phase data PDT1 and PDT2 by an image signal processor 160. According to one or more embodiments, the image signal processor 160 may output both the first phase data PDT1 and the second phase data PDT2, or it may output either the first phase data PDT1 or the second phase data PDT2.

[0120] The image signal processor 160 may include a bad pixel correction circuit 161, a phase data generation circuit 163, and a first pixel extraction circuit 164.

[0121] Image signal processor 160 can be used from Figure 1 The readout circuit 150 receives the low-sensitivity image signal S1 and the high-sensitivity image signal S2.

[0122] For example, Figure 5 The low-sensitivity image signal S1 and the high-sensitivity image signal S2 can be used as references. Figure 4 The low-sensitivity image signal S1 and the high-sensitivity image signal S2 are described.

[0123] The bad pixel correction circuit 161 can be used with a reference. Figure 4 The corrected low-sensitivity image signal CS1 and the corrected high-sensitivity image signal CS2 are generated in the same manner as described above.

[0124] The first pixel extraction circuit 164 can extract pixels based on the high-sensitivity image signal S2. Figure 1 The image signal of the first pixel PX1 is used to extract the image signal, and the extracted image signal is output as the extracted high-sensitivity image signal ES2. For example, with Figure 1 Information related to the first pixel PX1 can be stored in an additional register. The first pixel extraction circuit 164 can extract the image signal based on the first pixel PX1 from the high-sensitivity image signal S2 based on the information related to the first pixel PX1.

[0125] The phase data generation circuit 163 can generate first phase data PDT1 based on the extracted high-sensitivity image signal ES2.

[0126] For example, the phase data generation circuit 163 can extract the image signal of the sub-pixel positioned on one side relative to the microlens from the high-sensitivity image signal S2 to generate a portion of the first phase data PDT1, and extract the image signal of the sub-pixel positioned on the other side to generate another portion of the first phase data PDT1. For example, the phase data generation circuit 163 can extract the image signal of the sub-pixel positioned on the left and right sides relative to the microlens from the high-sensitivity image signal S2 to generate the first phase data PDT1.

[0127] The phase data generation circuit 163 can generate second phase data PDT2 based on the corrected low-sensitivity image signal CS1 and the corrected high-sensitivity image signal CS2.

[0128] For example, the phase data generation circuit 163 can generate a portion of the second phase data PDT2 based on the corrected low-sensitivity image signal CS1. The phase data generation circuit 163 can also generate another portion of the second phase data PDT2 based on the portion of the phase data generated from the corrected low-sensitivity image signal CS1 and the corrected high-sensitivity image signal CS2. For example, another portion of the second phase data PDT2 can be generated by subtracting the portion of the phase data generated from the corrected low-sensitivity image signal CS1 from the corrected high-sensitivity image signal CS2.

[0129] According to the embodiment, the first phase data PDT1 can be generated from an image signal based on the pixel signal of the first sub-pixel SPX1 of the first pixel PX1, and therefore can be generated based on an unsaturated image signal. Thus, the first phase data PDT1 can be reliably generated over a wide dynamic range.

[0130] The second phase data PDT2 can be based on more pixels than the first phase data PDT1. Therefore, the second phase data PDT2 can include phase information over a wider spatial range.

[0131] Figure 1 The image sensor 100 can output first phase data PDT1 and second phase data PDT2 with different characteristics, enabling external devices (e.g., application processors) to accurately perform autofocus.

[0132] Figures 6A to 6D This is an example diagram showing pixels according to an embodiment. Figures 6A to 6D The image shows including Figure 1 The second pixel PX2 consists of pixel units PU_A, PU_B, PU_C, and PU_D, and Figure 1 The pixel group PG can also include pixels other than the second pixel PX2. Figures 6A to 6DPixels PX1 and PX2 can respectively correspond to Figure 1 The first pixel PX1 and the second pixel PX2.

[0133] Figure 1 The pixel group PG can include Figures 6A to 6D It is one of the pixel units PU_A, PU_B, PU_C, and PU_D. Pixel group PG may include multiple pixel units.

[0134] Within each pixel group PG, a portion of multiple pixel units may include a first pixel PX1, while another portion may not include the first pixel PX1. A pixel in such a pixel unit may include a second pixel PX2.

[0135] Figures 6A to 6D The pixel units PU_A, PU_B, PU_C, and PU_D can be examples of pixel units. This applies when each pixel comprises multiple sub-pixels sharing a microlens. Figures 6A to 6D The pixel units PU_A, PU_B, PU_C, and PU_D can all be implemented as Figure 1 PG pixel group.

[0136] Pixel units can correspond to the pattern of a color filter. For example, Figure 1 A pixel group PG can include multiple pixel units, and each of the multiple pixel units can have a color filter with the same pattern.

[0137] exist Figures 6A to 6D In the diagram, each of pixel units PU_A, PU_B, PU_C, and PU_D is shown as a pixel unit based on a color filter arranged in a Bayer pattern. However, Figure 1 The pixel group PG may include pixel units based on color filters arranged in other patterns.

[0138] exist Figures 6A to 6D In the diagram, the first pixel PX1 is shown as a pixel with a red color filter. However, the first pixel PX1 can be independent of the color of the color filter.

[0139] although Figures 6A to 6D The diagram shows a single pixel unit, but the number of pixel units including the first pixel PX1 can be even. Additionally, the number of first pixels PX1 with color filters of the same color disposed thereon can also be even.

[0140] For example, except Figure 6A In addition to the pixel unit PU_A, Figure 1 The image sensor 100 may also include another pixel unit, including a first pixel PX1 on which a red color filter may be disposed. In addition... Figure 6A In addition to the pixel unit PU_A, Figure 1The image sensor 100 may also include an even number of other pixel units, including a first pixel PX1 on which a blue color filter is disposed.

[0141] In the first pixel PX1, which has a color filter of the same color, the position of the second sub-pixel SPX2 can be set on the left or right side relative to the microlens.

[0142] refer to Figure 6A Pixel unit PU_A may include multiple sub-pixel units SPU1, SPU2, SPU3, and SPU4 corresponding to the color filter. Each of sub-pixel units SPU1, SPU2, SPU3, and SPU4 may include four pixels. Each of the four pixels may include two sub-pixels sharing a microlens. One of the four pixels may be... Figures 1 to 5 The first pixel, PX1.

[0143] refer to Figure 6B A pixel unit PU_B may include multiple pixels PX1, PX2, PX3, and PX4 corresponding to a color filter. The first pixel PX1 among the multiple pixels PX1, PX2, PX3, and PX4 may correspond to... Figure 1 The first pixel PX1. Each of the plurality of pixels PX1, PX2, PX3, and PX4 may include four sub-pixels sharing a microlens. At least one of the sub-pixels of the first pixel PX1 may correspond to Figure 1 The second sub-pixel SPX2.

[0144] refer to Figure 6C The pixel unit PU_C may include multiple sub-pixel units SPU1, SPU2, SPU3, and SPU4 corresponding to the color filter. Each of the sub-pixel units SPU1, SPU2, SPU3, and SPU4 may include four pixels. Each of the four pixels may include four sub-pixels sharing a microlens. One of the four pixels may be... Figures 1 to 5 The first pixel PX1. At least one of the sub-pixels of the first pixel PX1 can correspond to Figure 1 The second sub-pixel SPX2.

[0145] refer to Figure 6D The pixel unit PU_D may include multiple pixels PX1, PX2, PX3, and PX4 corresponding to the color filter. The first pixel PX1 among the multiple pixels PX1, PX2, PX3, and PX4 may correspond to... Figure 1 The first pixel PX1. Each of the plurality of pixels PX1, PX2, PX3, and PX4 may include two sub-pixels sharing a microlens. One of the sub-pixels of the first pixel PX1 may correspond to Figure 1 The second sub-pixel SPX2.

[0146] Figure 7 This is an example circuit diagram of a pixel PX according to an embodiment. Figure 7 This is an exemplary circuit diagram of pixel PX, and according to the embodiment, the pixel may have the same characteristics as... Figure 7 Different circuit configurations can be used. For example, Figure 7 The circuitry of the pixel PX can correspond to Figure 6B The pixel unit PU_B contains pixels PX1 and PX2. Although Figures 7 to 39 Based on Figure 6B The pixel unit PU_B is described, but it will be apparent to those skilled in the art that a similar structure can be applied with appropriate modifications. Figure 6A , Figure 6C and Figure 6D The pixel units PU_A, PU_C and PU_D.

[0147] You can refer to this. Figure 6B and Figure 7 To describe the pixel PX of pixel unit PU_B.

[0148] Each sub-pixel of pixel PX may include photoelectric elements PD1, PD2, PD3, and PD4, and transmission transistors TG1, TG2, TG3, and TG4 connecting the photoelectric elements PD1, PD2, PD3, and PD4 to the floating diffusion node FD. Transmission transistors TG1, TG2, TG3, and TG4 may be controlled by transmission control signals TS1, TS2, TS3, and TS4, respectively.

[0149] In the first mode, the transmission transistors TG1, TG2, TG3 and TG4 can be turned on at different times, and the optoelectronic elements PD1, PD2, PD3 and PD4 can each transfer photocharge to the floating diffusion node FD.

[0150] In the second mode, the transmission transistors TG1, TG2, TG3, and TG4 of the first pixel PX1 and the second pixel PX2 can be controlled in different ways. For example, the first pixel PX1 and the second pixel PX2, which are located in the same row, can be controlled in different ways. At the point when at least one transistor corresponding to the third sub-pixel SPX3 of the second pixel PX2 is turned on, at least one transistor corresponding to the second sub-pixel SPX2 of the first pixel PX1 can be turned off. During multiple readout periods in the second mode, at least one transistor corresponding to the second sub-pixel SPX2 can remain in an off state.

[0151] The reset transistor RX can be turned on by the reset control signal RS, and the floating diffusion node FD can be reset by the power supply voltage VDD.

[0152] The voltage level at the floating diffusion node FD can be amplified by operating the driver DX and output to the column line CLI via the selection transistor SX. The selection transistor SX can be controlled by the selection signal SEL.

[0153] Figure 8 It shows according to Figure 7 An example timing diagram of the operation of pixel PX in the first mode of an embodiment.

[0154] refer to Figure 8 Transmission transistors TG1, TG2, TG3, and TG4 can be turned on at different times via high-level transmission control signals TS1, TS2, TS3, and TS4, respectively. Additionally, optoelectronic elements PD1, PD2, PD3, and PD4 can each transfer photocharge to the floating diffusion node FD. Pixel signals can be output based on the photocharge transferred to the floating diffusion node FD.

[0155] Before each of the optoelectronic elements PD1, PD2, PD3, and PD4 transfers photocharge to the floating diffusion node FD, the floating diffusion node FD can be reset to a high-level reset control signal RS. Figure 7 The power supply voltage VDD. The reset pixel signal can be output based on the voltage level at the floating diffusion node FD after reset. Figure 1 The readout circuit 150 can perform correlated double sampling (CDS) based on the pixel signal and the reset pixel signal.

[0156] Figure 9 This is an example diagram showing the first pixel according to an embodiment. Figure 9 It shows according to Figure 6B An example of the first pixel in an embodiment. Figure 9 The first pixels PX1_A1 and PX1_A2 can correspond to Figure 1 The first pixel, PX1.

[0157] Figure 9 The first pixels PX1_A1 and PX1_A2 can be set in different pixel units. A color filter of the same color can be set in each of the first pixels PX1_A1 and PX1_A2.

[0158] Figure 9 An example is shown where the second sub-pixel SPX2 of each of the first pixels PX1_A1 and PX1_A2 comprises two sub-pixels.

[0159] refer to Figure 9 Relative to the microlens, the second sub-pixel SPX2 of the first pixel PX1_A1 can be set on the right side, and the second sub-pixel SPX2 of the first pixel PX1_A2 can be set on the left side.

[0160] Figure 10 This is an example diagram illustrating a pixel group PG_1 including a first pixel according to an embodiment. Pixel group PG_1 may include, according to... Figure 6B The pixel unit PU_B in the embodiment. Figure 1 The pixel array 110 may include Figure 10 and Figure 11 Multiple pixel groups PG_1.

[0161] Pixel group PG_1 can include multiple pixel units. Figure 10 An example of pixel group PG_1 comprising 16 pixel units is shown. A color filter with the same pattern can be set in each pixel unit.

[0162] A portion of a pixel unit may include the first pixel, and another portion of the pixel unit may not include the first pixel. Figure 10 An example is shown where each of four pixel units among a plurality of pixel units includes one of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4. For example, the first pixel unit PU1 may include only the second pixels PX2_1, PX2_2, PX2_3, and PX2_4, and the second pixel unit PU2 may include one first pixel PX1_1 and three second pixels.

[0163] Figure 10 An example is shown where pixel group PG_1 includes four first pixels PX1_1, PX1_2, PX1_3 and PX1_4, but pixel group PG_1 may include fewer or more than four first pixels.

[0164] refer to Figure 10 The first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can be set in different rows of pixel group PG_1. The first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can be set in different columns of pixel group PG_1.

[0165] In one or more embodiments, the number of first pixels corresponding to the same color filter can be even. For example, the first color filter can be set in first pixels PX1_1 and PX1_3, and the second color filter can be set in first pixels PX1_2 and PX1_4.

[0166] In one or more embodiments, a first intermediate position of a second sub-pixel positioned relative to a microlens at a first location may be adjacent to a second intermediate position of a second sub-pixel positioned relative to a microlens at a second location. The intermediate position of the second sub-pixel may be considered when setting the first pixel.

[0167] For example, refer to Figure 10 The second sub-pixels of the first pixels PX1_1 and PX1_4 can be positioned at a first location relative to the microlens, and the second sub-pixels of the first pixels PX1_2 and PX1_3 can be positioned at a second location relative to the microlens. The pixel VPX1_1 at the first intermediate position of the first pixels PX1_1 and PX1_4 can be adjacent to the pixel VPX1_2 at the second intermediate position of the first pixels PX1_2 and PX1_3. Therefore, Figure 5 The first phase data PDT1 can generate phase data based on multiple partial phase data from adjacent locations, and external devices can accurately perform autofocus.

[0168] Figure 11 This is a diagram illustrating an example of the arrangement of the first pixel in a pixel group PG_1, including the first pixel, according to an embodiment.

[0169] Figure 11 The pixel group PG_1 has the same Figure 10 The pixel group PG_1 has the same form, and redundant descriptions are omitted.

[0170] refer to Figure 11 Pixel group PG_1 may include four first pixels PX1_1, PX1_2, PX1_3 and PX1_4, and the second sub-pixel of each of the first pixels PX1_1, PX1_2, PX1_3 and PX1_4 may include two sub-pixels.

[0171] refer to Figure 10 The second sub-pixels of the first pixels PX1_1 and PX1_4 can be positioned at a first location relative to the microlens (e.g., positioned on the right side relative to their microlens), and the second sub-pixels of the first pixels PX1_2 and PX1_3 can be positioned at a second location relative to the microlens (e.g., positioned on the left side relative to their microlens).

[0172] therefore, Figure 5 The first phase data PDT1 can generate phase data based on multiple partial phase data with opposite phases, and external devices can accurately perform autofocus.

[0173] Figure 12 and Figure 13 They respectively show according to Figure 9 Example diagrams of the first and second readout operations of pixel group PG_1, including first pixels PX1_A1 and PX1_A2, in the second mode of the embodiment. (The remaining text is incomplete and likely refers to further details about the operation.) Figure 10 and Figure 11 The description in the text is redundant.

[0174] refer to Figure 12In the first readout operation, the second pixel PX2 and at least one first pixel PX1 may each output a pixel signal based on at least one sub-pixel, while at least one first pixel PX1 may not output a pixel signal. The second sub-pixel PX2 may not output a pixel signal.

[0175] For example, Figure 12 The diagram shows that in the first readout operation, each pixel output is based on the pixel signal of the sub-pixel positioned to the left relative to the microlens.

[0176] For example, the second pixels PX2_1, PX2_2, PX2_3, and PX2_4 can output pixel signals based on the sub-pixels set on the left relative to the microlens.

[0177] However, pixels PX1_2 and PX1_3, which are the second sub-pixel SPX2 located on the left side relative to the microlens, may not output pixel signals, while pixels PX1_1 and PX1_4, which are the second sub-pixel SPX2 located on the right side relative to the microlens, may output pixel signals.

[0178] refer to Figure 13 In the second readout operation, all pixels PX1 and PX2 can output pixel signals based on at least one sub-pixel. The second sub-pixel SPX2 may not output a pixel signal. The pixel signal output in the second readout operation may not be based on the second sub-pixel SPX2.

[0179] For example, the second pixels PX2_1, PX2_2, PX2_3, and PX2_4 can output pixel signals based on all sub-pixels. However, the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can output pixel signals based on sub-pixels other than the second sub-pixel SPX2.

[0180] Figure 14 It shows according to Figure 9 An example diagram of an embodiment of the interconnection lines used to control the first pixels PX1_A1 and PX1_A2.

[0181] First pixels PX1_A1 and PX1_A2 can be located in the same row as the second pixel PX2. First pixels PX1_A1 and PX1_A2 can include a first sub-pixel SPX1 and a second sub-pixel SPX2. Second pixel PX2 can include a third sub-pixel SPX3 at a position corresponding to the first sub-pixel SPX1 and a fourth sub-pixel SPX4 at a position corresponding to the second sub-pixel SPX2. In one or more embodiments, in the second mode, a sub-pixel that outputs a pixel signal during the first readout period can be referred to as a fifth sub-pixel SPX5, and a sub-pixel that does not output a pixel signal can be referred to as a sixth sub-pixel SPX6.

[0182] In one or more embodiments, the second sub-pixel SPX2 of the first pixel PX1_A1 and PX1_A2 and the fourth sub-pixel SPX4 of the second pixel PX2 can receive transmission control signals through different interconnects.

[0183] For example, refer to Figure 14 The second sub-pixel SPX2 of the first pixel PX1_A1 can receive transmission control signals through interconnecting lines LN2* and LN4* among interconnecting lines LN1, LN2, LN2*, LN3, LN4, and LN4*. The fourth sub-pixel SPX4 of the second pixel PX2, located in the same row as the first pixel PX1_A1, can receive transmission control signals through interconnecting lines LN2 and LN4. Similarly, the second sub-pixel SPX2 of the first pixel PX1_A2 can receive transmission control signals through interconnecting lines LN1* and LN3* among interconnecting lines LN1, LN2, LN1*, LN3, LN4, and LN3*, and the fourth sub-pixel SPX4 of the second pixel PX2, located in the same row, can receive transmission control signals through interconnecting lines LN1 and LN3.

[0184] In one or more embodiments, the first sub-pixel SPX1 of the first pixel PX1_A1 and PX1_A2 can receive the transmission control signal via the same or different interconnection as the third sub-pixel SPX3 of the second pixel PX2. Figure 14 An example is shown where the first sub-pixel SPX1 of the first pixel PX1_A1 and PX1_A2 receives the transmission control signal via the same interconnects as the third sub-pixel SPX3 of the second pixel PX2. The first sub-pixel SPX1 of the first pixel PX1_A1 can receive the transmission control signal via interconnects LN1 and LN2, which are the same as the third sub-pixel SPX3 of the second pixel PX2, and the first sub-pixel SPX1 of the first pixel PX1_A2 can receive the transmission control signal via interconnects LN2 and LN4, which are the same as the third sub-pixel SPX3 of the second pixel PX2.

[0185] Therefore, the second sub-pixel SPX2 of the first pixel PX1_A1 and PX1_A2 can be controlled by an interconnection different from the interconnection of the second pixel PX2 in the same row, so as to be controlled independently of other sub-pixels during the first readout period and the second readout period in the second mode.

[0186] For example, during the first readout period, while the pixel signal is output through the fifth sub-pixel SPX5 of the second pixel PX2, the second sub-pixel SPX2 of the first pixel PX1_A2 may not output a pixel signal due to the transmission control signals sent through interconnects LN1* and LN3*.

[0187] Figure 15 It shows according to Figure 9 Example diagrams of the first readout operation RO11 and the second readout operation RO12 of the first pixel PX1_A1 and the first readout operation RO21 and the second readout operation RO22 of the second pixel PX2, and... Figure 16 It shows according to Figure 9 Example diagram of the first readout operation RO11 and the second readout operation RO12 of the first pixel PX1_A2 and the first readout operation RO21 and the second readout operation RO22 of the second pixel PX2. Figure 15 and Figure 16 The first pixel PX1 can correspond to respectively Figure 9 The first pixels are PX1_A1 and PX1_A2. The second pixel PX2 can be set in the same row as the first pixels PX1_A1 and PX1_A2. Transmission control signals TS11, TS12, TS13, TS14, TS21, TS22, TS23 and TS24 can control transistors T11, T12, T13, T14, T21, T22, T23 and T24 respectively.

[0188] refer to Figure 15 The first pixel PX1_A1 and the second pixel PX2 can output a pixel signal with a reset level at time T0 in response to the reset control signal RS. The first pixel PX1_A1 and the second pixel PX2 can perform a first readout operation at time T1 and a second readout operation at time T2.

[0189] At time T1, some sub-pixels of the first pixel PX1_A1 can output pixel signals by transmitting control signals TS11 and TS13 at high level, and some sub-pixels of the second pixel PX2 can output pixel signals by transmitting control signals TS21 and TS23 at high level.

[0190] At time T2, all sub-pixels of the first pixel PX1_A1 except for the second sub-pixel SPX2 can output pixel signals through high-level transmission control signals TS11 and TS13, and all sub-pixels of the second pixel PX2 can output pixel signals through high-level transmission control signals TS21, TS22, TS23 and TS24.

[0191] refer to Figure 16 At time T1, the first pixel PX1_A2 may not output a pixel signal. The remaining operations are the same as... Figure 15 The operation is the same as in [the previous section]. See reference [the previous section]. Figure 14The second sub-pixel SPX2 of the first pixel PX1 can receive transmission control signals through different interconnects, and therefore can be controlled differently from the second pixel PX2.

[0192] Figure 17A It is a graph showing phase data from an example image sensor, and Figure 17B It shows according to Figure 9 An embodiment of the image sensor includes phase data of the first pixels PX1_A1 and PX1_A2.

[0193] refer to Figure 17A In the second mode, according to the example image sensor, all pixels can generate a first image signal LT based on a portion of the sub-pixels during the first readout operation, and output a second image signal 4SUM based on all sub-pixels during the second readout operation. For example, the first image signal LT according to the example image sensor can be based on sub-pixels set on the left or right side relative to the microlens.

[0194] According to the example image sensor, a third image signal RT can be generated by subtracting the first image signal LT from the second image signal 4SUM to produce phase data. HDR image data can be generated based on the second image signal 4SUM and the first image signal LT.

[0195] The second image signal 4SUM of the image sensor according to the example can be a high-sensitivity image signal based on the pixel signals of all sub-pixels, and therefore can reach a saturation level at relatively low brightness. Even at brightness higher than the brightness SL corresponding to the saturation level, the previously saturated second image signal 4SUM can still have an encoded value corresponding to the saturation level, while the encoded value of the first image signal LT, as a low-sensitivity image signal, can continue to increase. Therefore, the encoded value of the third image signal RT can increase to the brightness SL, but decrease at brightness higher than the brightness SL. As a result, the phase data according to the example is generated based on the first image signal LT and the third image signal RT, making it possible that autofocus may not be performed accurately. Electronic devices using the phase data according to the example can only perform accurate autofocus within a narrow dynamic range PDAF_DR1.

[0196] refer to Figure 17B A reference image signal can be generated based on image signals LT1 and RT1 of a subset of sub-pixels from the sub-pixels of the first pixels PX1_A1 and PX1_A2 during the second readout operation. Figures 1 to 9 The first phase data PDT1 is described. For example, image signals LT1 and RT1 can be based on... Figure 9The microlenses relative to the first pixels PX1_A1 and PX1_A2 are set on the left or right side of the first sub-pixel SPX1.

[0197] The first phase data PDT1 can be generated based on the image signals LT1 and RT1 of a portion of the sub-pixels in the sub-pixels of the first pixels PX1_A1 and PX1_A2, and therefore can remain unsaturated even at brightness SL. Thus, an electronic device using the first phase data PDT1 can perform accurate autofocus within a wide dynamic range PDAF_DR2.

[0198] It can be based on the second pixel (e.g., Figure 10 HDR image data is generated from a first image signal LT2 of a portion of the sub-pixels in the PX2 sub-pixels and a second image signal 4SUM based on all the sub-pixels. For example, the low-light range of HDR image data can be generated based on the second image signal 4SUM, and the high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal LT2 by a factor of two. Figure 4 Alternatively, bad pixel correction image signals for sub-pixels of the first pixel can be used to generate HDR image data.

[0199] Figure 18 This is an example diagram showing the first pixel according to an embodiment. Figure 18 It shows according to Figure 6B An example of the first pixel in an embodiment. Figure 18 The first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4 can correspond to Figure 1 The first pixel, PX1.

[0200] refer to Figure 18 Each of the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4 may include one first sub-pixel SPX1 and three second sub-pixels SPX2. The positions of the first sub-pixels SPX1 included in the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4 may differ from each other relative to the microlens. Similarly, the positions of the second sub-pixels SPX2 included in the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4 may differ from each other relative to the microlens. For example, the first sub-pixel SPX1 of each of the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4 may be located relative to the microlens in one of the following positions: upper left, upper right, lower left, or lower right. The orientation relative to the microlens may be a direction that allows the pixel array to be observed perpendicular to the substrate.

[0201] Figure 19 and Figure 20 They respectively show the following based on Figure 18 An example diagram illustrating the first and second readout operations of pixel group PG_2, including first pixels PX1_1, PX1_2, PX1_3, and PX1_4, in a second mode. The first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can respectively correspond to... Figure 18 The first pixels PX1_B1, PX1_B2, PX1_B4, and PX1_B3. (The numbers related to...) Figure 12 and Figure 13 The description is redundant.

[0202] refer to Figure 19 In the first readout operation, the second pixel PX2 and at least one first pixel PX1_1 can each output a pixel signal based on at least one sub-pixel, while at least one first pixel PX1_2, PX1_3, and PX1_4 may not output a pixel signal. The second sub-pixel SPX2 may not output a pixel signal.

[0203] For example, in the first readout operation, each of the second pixels PX2 can output a pixel signal relative to the sub-pixel positioned in the upper left corner relative to the microlens. When the second sub-pixel PX2 is not positioned in the upper left corner relative to the microlens, the first pixels PX1_1, PX1_B2, PX1_B3, and PX1_B4 can output pixel signals based on the sub-pixel positioned in the upper left corner.

[0204] refer to Figure 20 In the second readout operation, all pixels can output a pixel signal based on at least one sub-pixel. The second sub-pixel SPX2 may not output a pixel signal. The pixel signal output in the second readout operation may not be based on the second sub-pixel SPX2.

[0205] Figures 21 to 28 It shows according to Figure 18 An example diagram illustrating the interconnections for controlling the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4, and an example of the first readout operation RO11 and the second readout operation RO12 for the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4. (The remaining text is incomplete and likely refers to a separate section.) Figures 14 to 16 The description is similar to or redundant, and focuses on the description with Figures 14 to 16 The differences are used to describe the examples.

[0206] refer to Figure 21All sub-pixels of the first pixel PX1_B1 can receive transmission control signals through interconnections different from those of the sub-pixels of the second pixel PX2. For example, the first pixel PX1_B1 can receive transmission control signals through interconnections LN1*, LN2*, LN3*, and LN4*, and the second pixel PX2 can receive transmission control signals through interconnections LN1, LN2, LN3, and LN4.

[0207] Similarly, Figure 23 The first pixel PX1_B2, Figure 25 The first pixel PX1_B3 and Figure 27 The first pixel PX1_B4 can also have all its subpixels receive transmission control signals through interconnections that are different from the interconnections of the subpixels of the second pixel PX2.

[0208] refer to Figure 22 In the first readout operations RO11 and RO21, a pixel signal based on the microlens setting of the sub-pixel in the upper left position relative to the first pixel PX1_B1 and the second pixel PX2 can be output. Figure 22 The first pixel PX1 in the image can correspond to Figure 21 The first pixel PX1_B1. The upper left sub-pixel of the first pixel PX1_B1 may not be the second sub-pixel SPX2, so that a pixel signal can be output at time T1 based on the transmission control signal TS11. Due to the transmission control signals TS12, TS13 and TS14, the second sub-pixel SPX2 of the first pixel PX1_B1 may not output a pixel signal in either the first readout operation RO11 or the second readout operation RO12.

[0209] Figure 24 The first pixel PX1 in the image can correspond to Figure 23 The first pixel PX1_B2 in the image. (Reference) Figure 24 In the first readout operation RO21, a pixel signal can be output based on the sub-pixel positioned in the upper left corner relative to the microlens of the second pixel PX2. The upper left sub-pixel of the first pixel PX1_B2 can be the second sub-pixel SPX2, allowing no pixel signal output at time T1 based on the transmission control signal TS11. Due to the transmission control signals TS11, TS13, and TS14, the second sub-pixel SPX2 of the first pixel PX1_B2 can not output a pixel signal in either the first readout operation RO11 or the second readout operation RO12. In the second readout operation RO12, only the sub-pixel connected to the transmission transistor T12 of the first pixel PX1_B2 can output a pixel signal through the transmission control signal TS12.

[0210] refer to Figure 26 and Figure 28The first pixels PX1_B3 and PX1_B4 may not output pixel signals in the first readout operation RO11, and may each output pixel signals based on a first sub-pixel in the second readout operation RO12. Figure 26 and Figure 28 The first pixel PX1 in the image can correspond to... Figure 25 and Figure 27 The first pixels PX1_B3 and PX1_B4 in the image.

[0211] refer to Figure 29 It can be based on the reference Figures 21 to 28 The reference image signals LT1 and RT1, based on the first sub-pixels, are generated during the second readout operation RO12 of the first pixels PX1_B1, PX1_B2, PX1_B3, and PX1_B4. Figures 1 to 9 The first phase data described is PDT1.

[0212] For example, during the second read operation RO12, it can be based on... Figure 22 The first pixel PX1_B1 and Figure 26 The partial phase data of the first phase data PDT1 is generated from the image signal LT1 of the first pixel PX1_B3. This can be based on... Figure 24 The first pixel PX1_B2 and Figure 28 The image signal RT1 of the first pixel PX1_B4 is used to generate another part of the phase data of the first phase data PDT1.

[0213] The first phase data PDT1 can be generated based on the image signals LT1 and RT1 of a portion of the sub-pixels in the sub-pixels of the first pixel PX1, and therefore can remain unsaturated even at brightness SL. Thus, an electronic device using the first phase data PDT1 can perform accurate autofocus within a wide dynamic range PDAF_DR2.

[0214] HDR image data can be generated based on a first image signal LT2 of a portion of the sub-pixels in the second pixel PX2 and a second image signal 4SUM of all the sub-pixels. For example, the low-light range of HDR image data can be generated based on the second image signal 4SUM, and the high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal LT2 by a factor of four. Figure 4 As described above, bad pixel correction image signals for sub-pixels of the first pixel can be used to generate HDR image data.

[0215] Figure 30 It shows according to Figure 9An example diagram of the first readout operation of pixel group PG_3 in the second mode, including first pixels PX1_A1 and PX1_A2, is shown in the embodiment. The first readout operation of pixel group PG_3 in the second mode can be related to... Figure 13 The first read operation is the same as in [the previous section]. [The following is omitted:] ...and... Figure 12 , Figure 13 as well as Figures 21 to 28 The description is redundant. Figure 30 Each of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can correspond to Figure 9 One of the first pixels, PX1_A1 and PX1_A2.

[0216] and Figure 12 compared to, Figure 30 It is shown that in the first readout operation, first pixels PX1_1, PX1_2, PX1_3, and PX1_4, and second pixel PX2 can output pixel signals based on sub-pixels positioned in the upper left corner relative to the microlens. When the upper left sub-pixel of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 is the second sub-pixel PX2, the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 may not output pixel signals in the first readout operation. For example, in the first readout operation, first pixels PX1_1 and PX1_4 can output pixel signals, while first pixels PX1_2 and PX1_3 may not output pixel signals.

[0217] Figures 31 to 34 It shows according to Figure 9 Example diagrams illustrating the interconnects for controlling the first pixels PX1_A1 and PX1_A2, and the readout operations RO11 and RO12 for the first pixels PX1_A1 and PX1_A2, from an embodiment of the invention. (The remaining text is incomplete and likely refers to further details about the diagrams.) Figures 14 to 16 as well as Figures 21 to 28 The description is similar to or redundant, and focuses on the description of... Figures 14 to 16 as well as Figures 21 to 28 The differences are described in the embodiments.

[0218] Reference Figures 31 to 34 In the example described, with Figures 12 to 14 Unlike the HDR image data with twice the sensitivity in the example, HDR image data with four times the sensitivity can be generated. For example, 12-bit HDR image data can be generated based on 10-bit pixel signals.

[0219] refer to Figure 31 and Figure 33 All sub-pixels of the first pixel PX1_A1 and PX1_A2 can receive transmission control signals through interconnections that are different from the interconnections of the sub-pixels of the second pixel PX2.

[0220] refer to Figure 32 In the first readout operation RO11, the first pixel PX1 can output a pixel signal based on the sub-pixel set in the upper left relative to the microlens. Figure 32 The first pixel PX1 can correspond to Figure 31 The first pixel, PX1_A1. (Reference) Figure 34 In the first readout operation RO11, since the sub-pixel located at the upper left relative to the microlens is the second sub-pixel SPX2, the first pixel PX1 may not output a pixel signal. Figure 34 The first pixel PX1 can correspond to Figure 33 The first pixel, PX1_A2. (Reference) Figure 32 and Figure 34 The second pixel PX2 can output a pixel signal based on the sub-pixel positioned in the upper left corner relative to the microlens in the first readout operation RO21, and output a pixel signal based on all sub-pixels in the second readout operation RO22. In the second readout operation RO12, the first pixel PX1 can output a pixel signal based on the sub-pixels other than the second sub-pixel PX2.

[0221] Figure 35 It shows that based on Figures 30 to 34 Example diagram of the first phase data generated by the operation.

[0222] refer to Figure 35 It can be based on the reference Figures 30 to 34 The reference image is generated by using the image signals LT1 and RT1 based on the first sub-pixels, which are described in the first pixels PX1_A1 and PX1_A2, and the second readout operation RO12. Figures 1 to 9 The first phase data described is PDT1.

[0223] The first phase data PDT1 can be generated based on the image signals LT1 and RT1 of a portion of the sub-pixels of the first pixel PX1, and therefore can include accurate phase information at a brightness lower than or equal to the second brightness SL2. However, it can be generated based on the image signals of two sub-pixels. Figure 35 The first phase data PDT1 allows the dynamic range of the first phase data PDT1 to be greater than that of the first phase data PDT1. Figure 29 The dynamic range in this embodiment is narrow. For example, the first phase data PDT1 may include inaccurate phase information at a brightness level higher than the second brightness SL2.

[0224] However, the high-illumination range of HDR image data can be generated based on the image signal obtained by amplifying the first image signal LT2 by four times. Therefore, HDR image data with an extended dynamic range can be provided. Figure 4The image signal based on the first pixel can be used for HDR image data after bad pixel correction.

[0225] Figure 36 It shows according to Figure 9 An example diagram of the first readout operation of a pixel group including first pixels PX1_A1 and PX1_A2 in an embodiment. The first readout operation of pixel group PG_4 in the second mode can be related to... Figure 13 The first read operation is the same as in [the previous section]. [The following is omitted:] ...and... Figure 12 , Figure 13 as well as Figures 21 to 28 The description is redundant. Figure 36 Each of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can correspond to Figure 9 One of the first pixels, PX1_A1 and PX1_A2.

[0226] and Figure 12 and Figure 30 compared to, Figure 36 It is shown that in the first readout operation, first pixels PX1_1, PX1_2, PX1_3, and PX1_4, and second pixel PX2 can output pixel signals based on sub-pixels positioned relative to the microlens at the upper left and lower right. When the upper left or lower right sub-pixel of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 is the second sub-pixel PX2, the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 may not output pixel signals for a portion of the sub-pixels in the first readout operation. For example, in the first readout operation, first pixels PX1_1 and PX1_4 can output pixel signals for the upper left sub-pixels, and first pixels PX1_2 and PX1_3 can output pixel signals for the lower right sub-pixels.

[0227] Figure 37 It shows the image signal processor based on... Figure 36 An example diagram of a method for generating phase data using a first readout operation in an embodiment. (The details can be omitted.) Figure 2 The method for generating phase data is similar to or redundantly described. Figure 36 Each of the first pixels PX1_1, PX1_2, PX1_3, and PX1_4 can correspond to Figure 37 One of the first pixels, PX1_c and PX1_d. For example, Figure 36 The first pixels PX1_1 and PX1_4 can correspond to Figure 37 The first pixel PX1_c, and Figure 36 The first pixels PX1_2 and PX1_3 can correspond to Figure 37 The first pixel PX1_d.

[0228] and Figure 2 compared to, Figure 37 The diagram illustrates that both first pixels PX1_c and PX1_d can output pixel signals based on a single first sub-pixel during a first readout operation. For example, in the first readout operation, first pixel PX1_c can output the pixel signal PXS1A of the upper-left sub-pixel, and first pixel PX1_d can output the pixel signal PXS1B of the lower-right sub-pixel. In the second readout operation, first pixel PX1_c can output the pixel signals PXS3A of the upper-left and lower-left sub-pixels, and first pixel PX1_d can output the pixel signals PXS3B of the upper-right and lower-right sub-pixels.

[0229] refer to Figure 37 The image signal processor can generate first phase data PDT1 based on image signals IS3A and IS3B based on pixel signals PXS3A and PXS3B. The image signal processor can generate second phase data PDT2 without being based on second image signal IS2 and fourth image signal IS4.

[0230] The high-light range of HDR image data can be generated based on the image signal obtained by amplifying the first image signal IS2 by a factor of two, and the low-light range of HDR image data can be generated based on the second image signal IS4. For example... Figure 4 The image signals based on the first pixels PX1_c and PX1_d can be used for HDR image data after bad pixel correction.

[0231] Figure 38 and Figure 39 It shows according to Figure 36 and Figure 37 Example diagrams of the first readout operations RO11 and RO21 and the second readout operations RO12 and RO22 of pixel group PG_4 in the embodiment are provided. Descriptions that are redundant or similar to those in the above embodiments are omitted.

[0232] Figure 38 The first pixel PX1 can correspond to Figure 36 One of the first pixels, PX1_1 and PX1_4. Figure 39 The first pixel PX1 can correspond to Figure 36 One of the first pixels, PX1_2 and PX1_3. (Reference) Figure 38 The first pixels PX1_1 and PX1_4 can output the pixel signal of the upper left sub-pixel in the first readout operation RO11, and can output the pixel signal of the left sub-pixel in the second readout operation RO12. (Reference) Figure 39The first pixels PX1_2 and PX1_3 can output the pixel signal of the lower right sub-pixel in the first readout operation RO11, and can output the pixel signal of the right sub-pixel in the second readout operation RO12.

[0233] refer to Figure 38 and Figure 39 The second pixel PX2 can output the pixel signals of the upper left and lower right sub-pixels in the first readout operation RO21, and can output the pixel signals of all sub-pixels in the second readout operation RO22.

[0234] Figure 40 The diagram illustrates pixel units PU_A1 and PU_A2, each including a first pixel, according to an embodiment. Figure 41 and Figure 42 It shows according to Figure 40 A diagram illustrating the first and second readout operations of pixel units PU_A1 and PU_A2 in an embodiment. Pixel units PU_A1 and PU_A2 can correspond to... Figure 6A The pixel unit PU_A.

[0235] refer to Figure 40 In pixel units PU_A1 and PU_A2, each of the four pixels of the first pixel PX1 may include two sub-pixels sharing a microlens. The left or right sub-pixel of the four pixels of the first pixel PX1 may be a second sub-pixel relative to the microlens.

[0236] refer to Figure 41 In the first readout operation, the first pixel PX1 of one of the pixel units PU_A1 and PU_A2 may not output a pixel signal. For example, in the first readout operation, the first pixel PX1 of pixel unit PU_A1 may output a pixel signal based on the sub-pixel located to the left of the microlens, while the first pixel PX1 of pixel unit PU_A2 may not output a pixel signal.

[0237] refer to Figure 42 In the second readout operation, all sub-pixels of pixel units PU_A1 and PU_A2, except for the second sub-pixel SPX2, can output pixel signals.

[0238] In the second read operation Figure 1 The image signal processor 160 can use an image signal based on the pixel signal of the first pixel PX1 to generate first phase data.

[0239] The high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal of the second pixel in the first readout operation by a factor of two, and the low-light range of HDR image data can be generated based on a second image signal of the second pixel in the second readout operation. For example... Figure 4 The image signal based on the first pixel PX1 can be used for HDR image data after bad pixel correction.

[0240] Figure 43 This is an example diagram showing pixel units PU_A1 and PU_A2, each including a first pixel, according to one or more embodiments. Figure 44 and Figure 45 It shows according to Figure 43 Example diagrams of the first and second readout operations of pixel units PU_A1 and PU_A2 in an embodiment. Pixel units PU_A1 and PU_A2 can correspond to... Figure 6A The pixel unit PU_A.

[0241] refer to Figure 43 In the pixels of pixel units PU_A1 and PU_A2, each of the four pixels of the first pixel PX1 may include two sub-pixels sharing a microlens. Among the four pixels of the first pixel PX1, six sub-pixels may be second sub-pixels. For example, among the four pixels of the first pixel PX1, a single pixel in the diagonal direction of sub-pixel unit SPU1 may have a single sub-pixel as the second sub-pixel SPX2, while all the sub-pixels of the other pixel in the other diagonal direction may be the second sub-pixel SPX2.

[0242] refer to Figure 44 In the first readout operation, the first pixel PX1 of one of the pixel units PU_A1 and PU_A2 may not output a pixel signal. For example, in the first readout operation, the first pixel PX1 of pixel unit PU_A1 may output a pixel signal based on a portion of the sub-pixels located to the left of the microlens, while the first pixel PX1 of pixel unit PU_A2 may not output a pixel signal.

[0243] refer to Figure 44 In the first readout operation, the second pixel can output a pixel signal based on the left sub-pixel of a pixel in a diagonal direction.

[0244] refer to Figure 45 In the second readout operation, all sub-pixels of pixel units PU_A1 and PU_A2, except for the second sub-pixel SPX2, can output pixel signals.

[0245] In the second read operation Figure 1The image signal processor 160 can use an image signal based on the pixel signal of the first pixel PX1 to generate first phase data.

[0246] The high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal of the second pixel in the first readout operation by a factor of four, and the low-light range of HDR image data can be generated based on a second image signal of the second pixel in the second readout operation. For example... Figure 4 The image signal based on the second pixel PX2 can be used for HDR image data after bad pixel correction.

[0247] Figure 46 This is an example diagram showing pixel units PU_C1 and PU_C2, each including a first pixel, according to one or more embodiments. Figure 47 and Figure 48 It shows according to Figure 46 Example diagrams of the first and second readout operations of pixel units PU_C1 and PU_C2 in one or more embodiments. Pixel units PU_C1 and PU_C2 may correspond to... Figure 6C The pixel unit PU_C.

[0248] refer to Figure 46 In pixel units PU_C1 and PU_C2, each of the four pixels of the first pixel PX1 may include four sub-pixels sharing a microlens. The left or right sub-pixel of the four pixels of the first pixel PX1 may be a second sub-pixel relative to the microlens.

[0249] refer to Figure 47 In the first readout operation, the first pixel PX1 of one of the pixel units PU_C1 and PU_C2 may not output a pixel signal. For example, in the first readout operation, the first pixel PX1 of pixel unit PU_C1 may not output a pixel signal, while the first pixel PX1 of pixel unit PU_C2 may output a pixel signal based on the sub-pixel located to the left of the microlens.

[0250] refer to Figure 48 In the second readout operation, all sub-pixels of pixel units PU_C1 and PU_C2, except for the second sub-pixel SPX2, can output pixel signals.

[0251] In the second read operation Figure 1 The image signal processor 160 can use an image signal based on the pixel signal of the first pixel PX1 to generate first phase data.

[0252] The high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal of the second pixel in the first readout operation by a factor of two, and the low-light range of HDR image data can be generated based on a second image signal of the second pixel in the second readout operation. For example... Figure 4 The image signal based on the first pixel PX1 can be used for HDR image data after bad pixel correction.

[0253] Figure 49 Example diagrams are shown showing pixel units PU_C1, PU_C2, PU_C3 and PU_C4, each including a first pixel, according to an embodiment. Figure 50 and Figure 51 It shows according to Figure 49 Example diagrams of the first and second readout operations for pixel units PU_C1, PU_C2, PU_C3, and PU_C4 in the embodiment. Pixel units PU_C1, PU_C2, PU_C3, and PU_C4 can correspond to... Figure 6C The pixel unit PU_C.

[0254] refer to Figure 49 In pixel units PU_C1, PU_C2, PU_C3, and PU_C4, each of the four pixels of the first pixel PX1 may include four sub-pixels sharing a microlens. Relative to the microlens, one of the four sub-pixels of the first pixel PX1 may be a second sub-pixel.

[0255] refer to Figure 50 In the first readout operation, the first pixel PX1 of one of the pixel units PU_C1, PU_C2, PU_C3, and PU_C4 may not output a pixel signal. For example, in the first readout operation, the first pixel PX1 of pixel unit PU_C1 may not output a pixel signal, while the first pixel PX1 of pixel units PU_C2, PU_C3, and PU_C4 may output a pixel signal based on the sub-pixel located in the upper left position relative to the microlens.

[0256] refer to Figure 50 The second pixel can output a pixel signal based on the sub-pixel at the top left.

[0257] refer to Figure 51 In the second readout operation, all sub-pixels of pixel units PU_C1, PU_C2, PU_C3, and PU_C4, except for the second sub-pixel SPX2, can output pixel signals.

[0258] In the second read operation Figure 1 The image signal processor 160 can use an image signal based on the pixel signal of the first pixel PX1 to generate first phase data.

[0259] The high-light range of HDR image data can be generated based on an image signal obtained by amplifying the first image signal of the second pixel in the first readout operation by a factor of four, and the low-light range of HDR image data can be generated based on a second image signal of the second pixel in the second readout operation. For example... Figure 4 The image signal based on the first pixel PX1 can be used for HDR image data after bad pixel correction.

[0260] As described above, according to the embodiments, the image sensor can generate HDR images and reliably generate phase data over a wide dynamic range.

[0261] While various embodiments have been shown and described above, it will be apparent to those skilled in the art that modifications and variations may be made without departing from the scope of the inventive concept as defined by the appended claims.

[0262] include Figures 1 to 5 , Figure 7 and Figure 37 At least one of the components, elements, modules, units, or any nominalized verbs (collectively referred to as "components" in this paragraph) represented by the boxes or equivalent indications in the accompanying drawings may be implemented or embodied by analog and / or digital circuitry, including one or more logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, etc. Alternatively or additionally, these components may be implemented or embodied by software, including one or more instructions stored in an internal or external (e.g., non-volatile) storage medium readable by at least one processor. For example, at least one processor may invoke at least one of one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components under the control of the processor. This allows at least one processor to perform at least one function or operation performed by each component as described above, according to the invoked at least one instruction. Here, at least one processor may include, but is not limited to, a central processing unit (CPU), a graphics processing unit (GPU), or other types of microprocessors. At least one processor may be implemented as an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

Claims

1. An image sensor, comprising: A pixel array, comprising multiple pixels; The readout circuit is configured to convert the pixel signals of the plurality of pixels into a plurality of image signals; as well as The image processing circuit is configured to output high dynamic range (HDR) image data and phase data based on the plurality of image signals, and in: The plurality of pixels includes a first pixel and a second pixel; Each of the first pixel and the second pixel includes a sub-pixel sharing a microlens, and each of the sub-pixels includes a photoelectric element and a transmission transistor connecting the photoelectric element to a floating diffusion node; as well as In the first pixel and the second pixel, some sub-pixels located at the same position relative to the microlens are configured to receive the transmission control signal of the transmission transistor via different interconnects.

2. The image sensor according to claim 1, wherein: The first pixel includes a first sub-pixel and a second sub-pixel; The second pixel includes a third sub-pixel at a position corresponding to the position of the first sub-pixel and a fourth sub-pixel at a position corresponding to the position of the second sub-pixel; as well as The transmission transistors of the second sub-pixel and the fourth sub-pixel are configured to receive the transmission control signal via different interconnects.

3. The image sensor according to claim 2, wherein: The transmission transistors of the first sub-pixel and the third sub-pixel are configured to receive the transmission control signal via the same interconnect or different interconnects.

4. The image sensor according to claim 2, wherein: The first pixel includes at least one first sub-pixel and at least one second sub-pixel; and The second pixel includes at least one third sub-pixel and at least one fourth sub-pixel.

5. The image sensor according to claim 2, wherein: The pixel array includes a plurality of first pixels; as well as Relative to the microlens, the second sub-pixel of one of the plurality of first pixels is located on the right, and the second sub-pixel of another of the plurality of first pixels is located on the left.

6. The image sensor according to claim 2, wherein: The number of the second sub-pixel and the number of the fourth sub-pixel are respectively greater than or equal to the number of the first sub-pixel and the number of the third sub-pixel.

7. The image sensor according to claim 2, wherein: The image processing circuit is configured to output first phase data based on the first pixel and second phase data based on the first pixel and the second pixel.

8. The image sensor according to claim 7, wherein: The image processing circuit is configured to further generate the second phase data based on a first image signal for which bad pixel correction has been performed on the second sub-pixel of the first pixel and a second image signal of the second pixel.

9. The image sensor according to claim 1, wherein: The first pixel includes a first sub-pixel and a second sub-pixel; The second pixel includes a third sub-pixel and a fourth sub-pixel; The pixel array is configured to output a first pixel signal based on the first sub-pixel during at least one of a first readout period and a second readout period, and not output a pixel signal based on the second sub-pixel during both the first readout period and the second readout period; as well as The pixel array is configured to output a second pixel signal based on the third sub-pixel during the first readout period, and to output a third pixel signal based on both the third sub-pixel and the fourth sub-pixel during the second readout period.

10. The image sensor according to claim 9, wherein: The transmission transistor of the second sub-pixel is configured to be turned off during the first readout period and the second readout period.

11. The image sensor according to claim 9, wherein: The image processing circuit is configured to output first phase data based on the first pixel signal, and second phase data based on the first pixel signal, the second pixel signal, and the third pixel signal.

12. The image sensor according to claim 11, wherein: The image processing circuit is configured to generate the second phase data based on one or more image signals from the plurality of image signals for which bad pixel correction has been performed on the second sub-pixel of the first pixel.

13. The image sensor according to claim 1, wherein, The image processing circuit includes: A bad pixel correction circuit is configured to perform bad pixel correction on a second sub-pixel of the first pixel; and An HDR processing circuit is configured to generate the HDR image data based on one or more image signals from the plurality of image signals for which bad pixel correction has been performed on the second sub-pixel of the first image.

14. An image sensor, comprising: A pixel array, comprising multiple pixels; The readout circuit is configured to convert the pixel signals of the plurality of pixels into image signals; as well as The image processing circuit is configured to output high dynamic range (HDR) image data and phase data based on the image signal, and in: The plurality of pixels includes a first pixel and a second pixel; Each of the first pixel and the second pixel includes a sub-pixel sharing a microlens, and each of the sub-pixels includes a photoelectric element and a transmission transistor configured to connect the photoelectric element to a floating diffusion node; At least one sub-pixel of the first pixel is configured to not output a pixel signal during either the first readout period or the second readout period; and Each sub-pixel of the second pixel is configured to output a pixel signal during at least one of the first readout period and the second readout period.

15. The image sensor according to claim 14, wherein: The image processing circuit is configured to output first phase data based on the first pixel and second phase data based on both the first pixel and the second pixel.

16. The image sensor according to claim 15, wherein: The image processing circuit is configured to generate the second phase data based on an image signal for which bad pixel correction has been performed on the sub-pixels for which no output pixel signal has been applied to the first pixel.

17. An image sensor, comprising: A pixel array, comprising multiple groups of pixels; The readout circuit is configured to convert pixel signals from the pixel array into image signals; as well as The image processing circuit is configured to output high dynamic range (HDR) image data and phase data based on the image signal, and in: Each of the plurality of pixel groups includes a plurality of first pixels and a plurality of second pixels arranged along the row and column directions; Each of the plurality of first pixels and each of the plurality of second pixels includes a sub-pixel sharing a microlens, and each sub-pixel includes a photoelectric element and a transmission transistor connecting the photoelectric element to a floating diffusion node; A first sub-pixel of each of the plurality of first pixels is configured to output a pixel signal during at least one of a first readout period and a second readout period, and a second sub-pixel of each of the plurality of first pixels is configured not to output a pixel signal during either the first readout period or the second readout period. as well as Each of the plurality of second pixels is configured to output a pixel signal during at least one of the first readout period and the second readout period.

18. The image sensor according to claim 17, wherein: The plurality of first pixels includes a third pixel and a fourth pixel; and Relative to the microlens, the first sub-pixel of the third pixel is positioned on the right side, and the first sub-pixel of the fourth pixel is positioned on the left side.

19. The image sensor according to claim 18, wherein: Each of the plurality of pixel groups includes a plurality of the third pixels and a plurality of the fourth pixels; and The number of the third pixel is equal to the number of the fourth pixel.

20. The image sensor according to claim 17, wherein: The plurality of first pixels includes a third pixel, a fourth pixel, a fifth pixel, and a sixth pixel; In the row direction and the column direction, relative to the microlens, the second sub-pixel of the third pixel and the second sub-pixel of the fourth pixel are positioned on the right side, and the second sub-pixel of the fifth pixel and the second sub-pixel of the sixth pixel are positioned on the left side.

Images