Image sensor and image pickup device including phase detection pixels
By designing phase detection pixel groups with different sensitivity in the image sensor and calculating the phase difference with the processor, the problem of insufficient accuracy of traditional phase detection pixels under different imaging conditions is solved, and more accurate automatic focus and image pickup effects are achieved.
Patent Information
- Application Number
- CN201910178059.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-03-09
- Filing Date
- 2019-03-08
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2039-03-08
AI Technical Summary
Traditional phase detection pixels cannot accurately detect phase differences under different imaging conditions, resulting in insufficient accuracy of image sensors during automatic focusing and image pickup.
An image sensor is designed, including two phase detection pixel groups, each of which is arranged adjacent to each other in different directions and is covered by separate microlenses respectively. The sensitivity of the first phase detection pixel group is different from that of the second phase detection pixel group. The phase difference based on the sensitivity is calculated by the processor and the lens driver is controlled to achieve automatic focus.
This technical method can accurately detect phase difference under various imaging conditions, improving the accuracy and stability of the image sensor in automatic focus and image pickup.
Smart Images

Figure CN110246853B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] Korean Patent Application No. 10-2018-0028307 filed on March 9, 2018 with the Korean Intellectual Property Office is incorporated herein by reference in its entirety. Technical Field
[0003] The inventive concept relates to an image sensor, and more particularly, to an image sensor and an image pickup device including a phase detection pixel. Background Art
[0004] The number of image sensors including phase detection pixels for detecting a phase difference between images or image pickup devices including such image sensors may increase. Because some conventional phase detection pixels either include a specific color filter (e.g., one of a red, green, and blue color filter) or do not include a color filter, they may be implemented to have a single sensitivity. Therefore, a phase detection pixel having a single sensitivity may not be able to detect an accurate phase difference depending on imaging conditions (e.g., lighting conditions and scene contents). Summary of the invention
[0005] The inventive concept provides an image sensor including phase detection pixels capable of detecting an accurate phase difference under various imaging conditions and an image pickup device.
[0006] According to one aspect of the inventive concept, there is provided an image sensor comprising a pixel array, wherein the pixel array comprises a first pixel group and a second pixel group, each of which comprises a plurality of image pixels to generate image data. The first pixel group comprises a first phase detection pixel pair, the first phase detection pixel pair comprises first phase detection pixels arranged adjacent to each other in a first direction and covered by a first single microlens; and the second pixel group comprises a second phase detection pixel pair, the second phase detection pixel pair comprises second phase detection pixels arranged adjacent to each other in a second direction different from the first direction and covered by a second microlens. A first sensitivity of the first phase detection pixel is different from a second sensitivity of the second phase detection pixel.
[0007] According to another aspect of the inventive concept, an image sensor is provided, the image sensor comprising a pixel array, wherein the pixel array comprises a first pixel group and a second pixel group, each of which comprises a plurality of image pixels to generate image data. The first pixel group comprises a first phase detection pixel pair, the first phase detection pixel pair comprising first phase detection pixels arranged adjacent to each other in a first direction and each individually covered by a corresponding microlens, and the second pixel group comprises a second phase detection pixel pair, the second phase detection pixel pair comprising second phase detection pixels arranged adjacent to each other in a second direction different from the first direction and each individually covered by a corresponding microlens. The sensitivity of the first phase detection pixel is different from the sensitivity of the second phase detection pixel.
[0008] According to another aspect of the inventive concept, an image sensor includes: a pixel array including a plurality of shared pixels, wherein the plurality of shared pixels include: a first shared phase detection pixel including first phase detection sub-pixels arranged adjacent to each other in a first direction; and a second shared phase detection pixel including second phase detection sub-pixels arranged adjacent to each other in a second direction different from the first direction. A first sensitivity of the first phase detection sub-pixel is different from a second sensitivity of the second phase detection sub-pixel.
[0009] An image pickup device includes: a lens; a lens driver configured to control the position of the lens; a pixel array and a processor. The pixel array includes a first phase detection pixel pair and a second phase detection pixel pair, wherein the first phase detection pixel pair includes first phase detection pixels arranged adjacent to each other in a first direction and having a first sensitivity, and the second phase detection pixel pair includes second phase detection pixels arranged adjacent to each other in a second direction different from the first direction and having a second sensitivity different from the first sensitivity. The processor is configured to perform sensitivity-based phase difference calculation using first phase information received from the first phase detection pixel pair and / or second phase information received from the second phase detection pixel pair, and control the lens driver based on the calculation result. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Embodiments of the present inventive concept will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
[0011] Figure 1 is a diagram showing an example structure of an image pickup device according to some embodiments to explain the operation of an auto focus function of the image pickup device;
[0012] Figure 2 is a block diagram showing the construction of an image sensor according to some embodiments;
[0013] Figure 3is a diagram showing a partial configuration of a pixel array according to some embodiments;
[0014] Figure 4A is a diagram showing a specific configuration of a first phase detection pixel pair and a second phase detection pixel pair according to some embodiments, and Figure 4B is a diagram showing a specific configuration of a first phase detection pixel pair according to some embodiments;
[0015] Figure 5 is a diagram showing a partial configuration of a pixel array according to some embodiments;
[0016] Fig. 6A is a diagram showing a specific configuration of a first phase detection pixel pair and a second phase detection pixel pair according to some embodiments, and Figure 6B and Figure 6C is a diagram showing a specific structure of a first phase detection pixel pair;
[0017] 7A to 7C is a diagram showing an arrangement pattern of phase detection pixel pairs according to some embodiments;
[0018] Figure 8 is a diagram showing an example in which some embodiments of the inventive concept are applied to a shared pixel structure;
[0019] Fig.9A and Fig. 9B is a diagram showing some embodiments of the present invention. Figure 8 Figure 2 shows a phase detection shared pixel in Figure 2;
[0020] Fig. 10A and Fig. 10B It is shown that according to other embodiments Figure 8 Figure 2. Phase detection shared pixels in Fig.
[0021] Fig.11A and Fig. 11B It is shown that according to some other embodiments Figure 8 Figure 2. Phase detection shared pixels in Fig.
[0022] Fig.12 and Fig.13 According to some embodiments Figure 1 A flowchart of an autofocus operation of a processor in; and
[0023] Fig.14 is a block diagram illustrating a system including an image sensor according to some embodiments. DETAILED DESCRIPTION
[0024] Hereinafter, embodiments of the inventive concept will be described in detail with reference to the accompanying drawings.
[0025] Figure 1is a diagram illustrating an example structure of the image pickup device 1000 according to some embodiments to explain an operation of auto focusing (AF) of the image pickup device 1000 .
[0026] Reference Figure 1 , the image pickup device 1000 may include an imaging unit 1100, an image sensor 100, and a processor 1200. The image pickup device 1000 may support a focus detection function.
[0027] The overall operation of the image pickup device 1000 may be controlled by the processor 1200. The processor 1200 may provide control signals for operation of one or more components of the image pickup device 1000 to the lens driver 1120, the iris driver 1140, the timing controller 120, and the like.
[0028] The imaging unit 1100 may include a lens 1110, a lens driver 1120, an aperture 1130, and an aperture driver 1140 as components for receiving light. The lens 1110 may include a plurality of lenses.
[0029] The lens driver 1120 may exchange (e.g., transmit and receive) information about focus detection with the processor 1200, and adjust the position of the lens 1110 according to a control signal provided by the processor 1200. The lens driver 1120 may move the lens 1110 in a direction in which the distance from the object S to the lens 1110 increases or decreases. Thus, the distance between the lens 1110 and the object S may be adjusted. The object S may be focused or blurred according to the position of the lens 1110.
[0030] For example, when the distance between the lens 1110 and the object S is relatively close, the lens 1110 may deviate from an in-focus position focused on the object S, and a phase difference may occur between images captured by the image sensor 100. The lens driver 1120 may move the lens 1110 in a direction in which the distance relative to the object S increases based on a control signal provided by the processor 1200.
[0031] Alternatively, when the distance between the lens 1110 and the object S is relatively long or far, the lens 1110 may deviate from the focus position, and a phase difference may occur between images formed on the image sensor 100. The lens driver 1120 may move the lens 1110 in a direction in which the distance relative to the object S decreases based on a control signal provided by the processor 1200.
[0032] The image sensor 100 may convert incident light into an image signal. The image sensor 100 may include a pixel array 110, a timing controller 120, and a signal processor 130. The optical signal transmitted through the lens 1110 and the aperture 1130 may reach a light receiving surface of the pixel array 110 and may form an image of the object S.
[0033] The pixel array 110 may include a complementary metal oxide semiconductor image sensor (CIS) that converts an optical signal into an electrical signal. The pixel array 110 may adjust the sensitivity, etc. through the timing controller 120. The pixel array 110 may include a plurality of phase detection pixels. According to some embodiments, the phase detection pixels may be arranged adjacent to each other in at least two directions, and the phase detection pixels arranged adjacent to each other may constitute or define a phase detection pixel pair. In addition, the pixel array 110 may include phase detection pixels with different sensitivities from each other. Figure 2 etc. describe specific embodiments of phase detection pixels.
[0034] The processor 1200 may perform phase difference calculation by receiving phase information (or pixel information) from the signal processor 130, and may perform phase difference calculation by performing correlation calculation of signals of a plurality of pixels. The processor 1200 according to some embodiments may perform phase difference calculation by using phase detection pixels having different sensitivities from each other based on sensitivity. For example, the processor 1200 may perform phase difference calculation by first using high-sensitivity phase detection pixels, and then perform phase difference calculation by using low-sensitivity phase detection pixels based on the confidence level of the generated phase difference value. Referring later to FIGS. 11 and Fig.12 A specific example of this case is described.
[0035] The processor 1200 may obtain the focus position, the direction of the focus, and / or the distance between the object S and the image sensor 100 as a result of the phase difference calculation. The processor 1200 may output a control signal to the lens driver 1120 to move the position of the lens 1110 based on the result of the phase difference calculation.
[0036] The processor 1200 may perform image signal processing to reduce noise in an input signal and for color improvement, such as (but not limited to) gamma correction, color filter array interpolation, color matrix, color correction and / or color enhancement. In addition, the processor 1200 may generate an image file by compressing image data generated by the image signal processing for picture improvement, or may restore image data from an image file.
[0037] Figure 2 is a block diagram illustrating a configuration of an image sensor 100 according to some embodiments.
[0038] Reference Figure 1 and Figure 2, the image sensor 100 may include a pixel array 110 , a timing controller 120 , a signal processor 130 , a row driver 140 , and a signal reader 150 .
[0039] The pixel array 110 may be formed in pixel units and may include a plurality of image pixels and a plurality of phase detection pixels. Each of the image pixels and the phase detection pixels may include a photosensitive element. For example, the photosensitive element may include a photodiode. The image pixels and the phase detection pixels may absorb light to generate charges, and an electrical signal according to the generated charges may be provided to the signal reader 150 as a 0th output voltage CL0_0 to a (n-1)th output voltage CL0_n-1.
[0040] The image pixels can generate Figure 1 The phase detection pixel may generate a phase signal for calculating a phase difference between images generated by imaging the object S.
[0041] In some embodiments, the pixel array 110 may include a first phase detection pixel pair PDPX_P1 and a second phase detection pixel pair PDPX_P2. Although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms; rather, these terms are only used to distinguish one element from another. The first phase detection pixel pair PDPX_P1 may include two or more phase detection pixels arranged adjacent to each other in the horizontal direction, and the second phase detection pixel pair PDPX_P2 may include two or more phase detection pixels arranged adjacent to each other in the vertical direction. The first phase detection pixel pair PDPX_P1 may include a phase detection pixel for detecting a phase difference between images based on a horizontal direction or a vertical direction, and the second phase detection pixel pair PDPX_P2 may include a phase detection pixel for detecting a phase difference between images of an object S in a vertical direction or a horizontal direction. For example, when the first phase detection pixel pair PDPX_P1 is used to detect the phase difference between images based on the horizontal direction, the second phase detection pixel pair PDPX_P2 may be complementary to the first phase detection pixel pair PDPX_P1 and may be used to detect the phase difference between images based on the vertical direction.
[0042] In addition, the sensitivities of the phase detection pixels included in the first phase detection pixel pair PDPX_P1 and the phase detection pixels included in the second phase detection pixel pair PDPX_P2 may be different from each other. Figure 21 and 2. Only the first phase detection pixel pair PDPX_P1 and the second phase detection pixel pair PDPX_P2 are shown in the figure, but the embodiments described herein are not limited thereto, and the pixel array 110 may further include a plurality of phase detection pixel pairs having the same sensitivity characteristics or arrangement characteristics as any one of the first phase detection pixel pair PDPX_P1 and the second phase detection pixel pair PDPX_P2. The pixel array 110 may further include a phase detection pixel pair having the same sensitivity characteristics and arrangement characteristics as the first phase detection pixel pair PDPX_P1, and a phase detection pixel pair having the same sensitivity characteristics and arrangement characteristics as the second phase detection pixel pair PDPX_P2. In addition, the pixel array 110 may include a phase detection pixel pair having the same sensitivity characteristics as the first phase detection pixel pair PDPX_P1 and the same arrangement characteristics as the second phase detection pixel pair PDPX_P2, and a phase detection pixel pair having the same sensitivity characteristics as the second phase detection pixel pair PDPX_P2 and the same arrangement characteristics as the first phase detection pixel pair PDPX_P1. That is, the pixel array 110 may include phase detection pixel pairs having any combination of the sensitivity characteristics and arrangement characteristics of PDPX_P1 and PDPX_P2.
[0043] In addition, the above description is only an example and is not limited thereto, and Figure 2 Different from what is shown, the pixel array 110 may be variously implemented to include a plurality of phase detection pixel pairs each having at least three arrangement characteristics and at least three sensitivity characteristics.
[0044] Hereinafter, it is assumed that the first phase detection pixel pair PDPX_P1 may have smaller sensitivity than the second phase detection pixel pair PDPX_P2 and may be used to detect the phase difference between images based on the horizontal direction, and the second phase detection pixel pair PDPX_P2 may be used to detect the phase difference between images based on the vertical direction, but this is only for ease of explanation, and the embodiments described herein are not limited to this.
[0045] Phase detection pixels including the first phase detection pixel pair PDPX_P1 and the second phase detection pixel pair PDPX_P2 included in the image sensor 100 may be used to focus on the object S. In some embodiments, Figure 1The processor 1200 in may first perform a phase difference calculation operation between images using high-sensitivity phase detection pixels. In other words, the processor 1200 may perform a phase difference calculation operation between images using a phase detection pixel pair having the same sensitivity characteristics and arrangement characteristics as the second phase detection pixel pair PDPX_P2, and may generate a high-sensitivity phase difference value and a confidence level of the high-sensitivity phase difference value. The confidence level of the high-sensitivity phase difference value may be an indicator indicating the accuracy of the high-sensitivity phase difference value, and it may be generated based on the following parameters: such as (but not limited to) the lighting conditions when imaging the object S, the texture of the object S, and / or the imaging area of the object S. For example, when the illumination of the object S is greater than a certain amount when imaging, the photodiode of the high-sensitivity phase detection pixel may be saturated, and therefore may not be able to generate a sufficient phase signal, and considering such lighting conditions, the processor 1200 may generate such a confidence level: it indicates that the accuracy of the high-sensitivity phase difference value generated under the current imaging conditions is low. As another example, the processor 1200 may generate a confidence level indicating that the accuracy of the high-sensitivity phase difference value generated under the current imaging condition is low even if the area of the object S to be imaged does not include the top edge area or the bottom edge area of the object S. For example, when the confidence level is low, the accuracy of the high-sensitivity phase difference value may be low.
[0046] In some embodiments, when the confidence level of the high-sensitivity phase difference value is equal to or greater than a specific threshold, the processor 1200 may perform an AF operation by using the high-sensitivity phase difference value. The threshold may be set to various values according to imaging conditions, etc. When the confidence level of the high-sensitivity phase difference value is less than a specific threshold, the processor 1200 may perform a phase difference calculation operation between images by using a low-sensitivity phase detection pixel. In other words, the processor 1200 may perform a phase difference calculation operation between images by using a phase detection pixel pair having the same sensitivity characteristics and arrangement characteristics as the first phase detection pixel pair PDPX_P1, and may generate a low-sensitivity phase difference value and a confidence level for the low-sensitivity phase difference value.
[0047] In some embodiments, when the confidence level of the low sensitivity phase difference value is equal to or greater than a specific threshold, the processor 1200 may perform an AF operation using the low sensitivity phase difference value. When the confidence level of the low sensitivity phase difference value is less than a specific threshold, the processor 1200 may perform a contrast AF operation.
[0048] The phase signal may include information about the position of the image formed in the image sensor 100. Therefore, the phase signal may be used to calculate the phase difference between the images. The phase difference between the lens 1110 ( Figure 1 For example, the lens 1110 ( Figure 1 The position in the middle) can be the focus position.
[0049] In some embodiments of the present inventive concept, a plurality of phase detection pixels may be used not only to focus on the object S but also to measure the distance between the object S and the image sensor 100. In order to measure the distance between the object S and the image sensor 100, additional information such as (but not limited to) the phase difference between images formed on the image sensor 100, the distance between the lens 1110 and the image sensor 100, the size of the lens 1110, and / or the focus position of the lens 1110 may be referred to.
[0050] The timing controller 120 may control the row driver 140 by providing the timing control signal TC to the row driver 140, so that the pixel array 110 accumulates charges by absorbing light, temporarily stores the accumulated charges, and outputs an electrical signal to the outside or outside of the pixel array 110 according to the stored charges. In some embodiments, the timing controller 120 may adjust the sensitivity of the phase detection pixel by controlling the exposure time of the phase detection pixel according to the phase detection pixel information. For example, the timing controller 120 may control the exposure time of the first phase detection pixel pair PDPX_P1 to be shorter than the exposure time of the second phase detection pixel pair PDPX_P2 so that the sensitivity of the first phase detection pixel pair PDPX_P1 is different from the sensitivity of the second phase detection pixel pair PDPX_P2. PDPX_Info may include position information about the first phase detection pixel pair PDPX_P1 and the second phase detection pixel pair PDPX_P2. In addition, the timing controller 120 may control the signal reader 150 to measure the output voltage provided by the pixel array 110.
[0051] The row driver 140 may generate a reset control signal RS, a transmission control signal TX, and a selection signal SELS to control the pixel array 110, and provide them to a plurality of phase detection pixels included in the pixel array 110. The row driver 140 may determine activation timing and inactivation timing of the reset control signal RS, the transmission control signal TX, and the selection signal SELS for the plurality of phase detection pixels based on whether an AF function is performed.
[0052] The signal reader 150 may include a correlated double sampler (CDS) 151, an analog-to-digital converter (ADC) 153, and a buffer 155. The CDS 151 may sample and hold the 0th output voltage CLO_0 to the (n-1)th output voltage CLO_n-1 provided by the pixel array 110. The CDS 151 may double-sample the specific noise level and the levels of the 0th output voltage CLO_0 to the (n-1)th output voltage CLO_n-1, and output a level corresponding to the difference therebetween. In addition, the CDS 151 may receive a ramp signal generated by a ramp signal generator 157, compare them with each other, and output a comparison result. The ADC 153 may convert an analog signal corresponding to the level received from the CDS 151 into a digital signal. The buffer 155 may latch the digital signal, and the latched digital signal may be output to the outside or the outside of the signal processor 130 or the image sensor 100 in sequence.
[0053] The signal processor 130 may perform signal processing on the data received from the plurality of pixels. The signal processor 130 may perform noise reduction processing, gain adjustment, waveform shaping processing, interpolation processing, white balance processing, gamma processing, edge emphasis processing, etc. In addition, the signal processor 130 may output the phase information of the phase detection pixel to the processor 1200 during the phase difference AF to perform phase difference calculation. In some embodiments, the signal processor 130 may be included in the processor 1200 ( Figure 1 in Chinese.
[0054] Through the configuration of the pixel array 110 provided with phase detection pixels having various sensitivity characteristics and various arrangement characteristics according to some embodiments of the inventive concept, the AF function may be improved by accurately calculating a phase difference between images.
[0055] Figure 3 is a diagram showing a partial configuration of a pixel array 110 a according to some embodiments.
[0056] Reference Figure 3 , the pixel array 110a may include a first pixel group PXG_1a and a second pixel group PXG_2a. Hereinafter, for convenience, it is described that a pixel group is a unit including a plurality of image pixels IPX and one phase detection pixel pair; however, there may be additional phase detection pixel pairs.
[0057] The second pixel group PXG_2a may be arranged adjacent to the first pixel group PXG_1a in a downward direction. The first pixel group PXG_1a may include the plurality of image pixels IPX and the first phase detection pixel pair PDPX_P1a, and the second pixel group PXG_2a may include the plurality of image pixels IPX and the second phase detection pixel pair PDPX_P2a. The first phase detection pixel pair PDPX_P1a may include the first phase detection pixels PDPX_1a and PDPX_2a, and the second phase detection pixel pair PDPX_P2a may include the second phase detection pixels PDPX_3a and PDPX_4a. In some embodiments, the first phase detection pixels PDPX_1a and PDPX_2a in the first phase detection pixel pair PDPX_P1a may be arranged adjacent to each other in the horizontal direction, and the second phase detection pixels PDPX_3a and PDPX_4a in the second phase detection pixel pair PDPX_P2a may be arranged adjacent to each other in the vertical direction. In addition, the sensitivity of the first phase detection pixel pair PDPX_P1a may be less than that of the second phase detection pixel pair PDPX_P2a. However, the embodiments described herein are not limited thereto, and the sensitivity of the first phase detection pixel pair PDPX_P1a may be greater than that of the second phase detection pixel pair PDPX_P2a.
[0058] Figure 3 The illustrated configuration of the first pixel group PXG_1a and the second pixel group PXG_2a is not limited thereto, and the first pixel group PXG_1a and the second pixel group PXG_2a may include more or less image pixels IPX, and the arrangement of the first phase detection pixel pair PDPX_P1a and the second phase detection pixel pair PDPX_P2a may be implemented differently.
[0059] Figure 4A is a diagram showing a specific configuration of a first phase detection pixel pair PDPX_P1a and a second phase detection pixel pair PDPX_P2a according to some embodiments, Figure 4B : is a diagram showing a specific structure of the first phase detection pixel pair PDPX_P1a.
[0060] Reference Figure 4A, the type of color filter included in the first phase detection pixel of the first phase detection pixel pair PDPX_P1a and the type of color filter included in the second phase detection pixel of the second phase detection pixel pair PDPX_P2a may be different from each other, so that the sensitivity of the first phase detection pixel pair PDPX_P1a is different from the sensitivity of the second phase detection pixel pair PDPX_P2a. In one example, the first phase detection pixels of the first phase detection pixel pair PDPX_P1a may each include a green color filter, and the second phase detection pixels of the second phase detection pixel pair PDPX_P2a may each include a white color filter (or may not include any color filter). In addition, the first phase detection pixel pair PDPX_P1a may be covered by one horizontal microlens ML_H, and the second phase detection pixel pair PDPX_P2a may be covered by one vertical microlens ML_V. That is, a single microlens ML_H may be set on two pixels of the first phase detection pixel pair PDPX_P1a, and a single microlens ML_V may be set on two pixels of the second phase detection pixel pair PDPX_P2a. When an element is referred to as being “on” or “connected to” another element, it may be directly on or connected to the other element, or intervening elements may be present. In contrast, when an element is referred to as being “directly on” or “directly connected to” another element, there are no intervening elements.
[0061] Further references Figure 4B , the first phase detection pixel pair PDPX_P1a may include first phase detection pixels PDPX_1a and PDPX_2a. The first photodiode PD1 of the first phase detection pixel PDPX_1a and the second photodiode PD2 of the first phase detection pixel PDPX_2a may be arranged in the substrate 208. A color filter 204a (e.g., a green color filter) may be arranged on the substrate 208. In addition, one microlens 202 may be arranged on the first phase detection pixel pair PDPX_P1a. Figure 4B The illustrated structure of the first phase detection pixel pair PDPX_P1a or a structure similar thereto may also be applied to the second phase detection pixel pair PDPX_P2a. However, the type of color filter included in the second phase detection pixel pair PDPX_P2a may be different from the type of color filter included in the first phase detection pixel pair PDPX_P1a.
[0062] Figure 5 is a diagram showing a partial configuration of a pixel array 110 b according to some embodiments.
[0063] Reference Figure 5, the pixel array 110b may include a first pixel group PXG_1b and a second pixel group PXG_2b. The second pixel group PXG_2b may be arranged adjacent to the first pixel group PXG_1b in a downward direction. The first pixel group PXG_1b may include the plurality of image pixels IPX and a first phase detection pixel pair PDPX_P1b, and the second pixel group PXG_2b may include the plurality of image pixels IPX and a second phase detection pixel pair PDPX_P2b. The first phase detection pixel pair PDPX_P1b may include first phase detection pixels PDPX_1b and PDPX_2b, and the second phase detection pixel pair PDPX_P2b may include second phase detection pixels PDPX_3b and PDPX_4b. In some embodiments, the first phase detection pixels PDPX_1b and PDPX_2b may be arranged adjacent to each other in the vertical direction in the first phase detection pixel pair PDPX_P1b, and the second phase detection pixels PDPX_3b and PDPX_4b may be arranged adjacent to each other in the horizontal direction in the second phase detection pixel pair PDPX_P2b. In addition, the sensitivity of the first phase detection pixel pair PDPX_P1b may be less than the sensitivity of the second phase detection pixel pair PDPX_P2b. However, the embodiments described herein are not limited thereto, and the sensitivity of the first phase detection pixel pair PDPX_P1b may be greater than the sensitivity of the second phase detection pixel pair PDPX_P2b.
[0064] Figure 5 The illustrated configuration of the first and second pixel groups PXG_1b and PXG_2b is not limited thereto, and the first and second pixel groups PXG_1b and PXG_2b may include more or less image pixels IPX, and the arrangement of the first and second phase detection pixel pairs PDPX_P1b and PDPX_P2b may be variously implemented.
[0065] Fig. 6A is a diagram showing a specific configuration of a first phase detection pixel pair PDPX_P1b and a second phase detection pixel pair PDPX_P2b according to some embodiments, and Figure 6B and Figure 6C : is a diagram showing a specific structure of the first phase detection pixel pair PDPX_P1b.
[0066] Reference Fig. 6A, a light blocking layer B1b may be formed on the left side of the first phase detection pixel PDPX_1b of the first phase detection pixel pair PDPX_P1b, and a light blocking layer B2b may be formed on the right side of the first phase detection pixel PDPX_2b of the first phase detection pixel pair PDPX_P1b. In other words, the phase difference between the images of the object S in the horizontal direction may be detected using the first phase detection pixel pair PDPX_P1b. The light blocking layer B3b may be formed on the top side of the second phase detection pixel PDPX_3b of the second phase detection pixel pair PDPX_P2b, and the light blocking layer B4b may be formed on the bottom side of the second phase detection pixel PDPX_4b of the second phase detection pixel pair PDPX_P2b. In other words, the phase difference between the images of the object S in the vertical direction may be detected using the second phase detection pixel pair PDPX_P2b.
[0067] The lengths of the light blocking layers B1b and B2b included in the first phase detection pixels PDPX_1b and PDPX_2b of the first phase detection pixel pair PDPX_P1b and the lengths of the light blocking layers B3b and B4b included in the second phase detection pixels PDPX_3b and PDPX_4b of the second phase detection pixel pair PDPX_P2b may be different from each other, so that the sensitivity of the first phase detection pixel pair PDPX_P1b is different from the sensitivity of the second phase detection pixel pair PDPX_P2b. For example, the length L1 of the light blocking layers B1b and B2b of the first phase detection pixel pair PDPX_P1b may be greater than the length L2 of the light blocking layers B3b and B4b of the second phase detection pixel pair PDPX_P2b. In addition, each of the first phase detection pixels PDPX_1b and PDPX_2b may be individually covered by a corresponding microlens, and each of the second phase detection pixels PDPX_3b and PDPX_4b may be individually covered by a corresponding microlens.
[0068] Further references Figure 6B , the first phase detection pixel pair PDPX_P1b may include first phase detection pixels PDPX_1b and PDPX_2b. The first photodiode PD1 of the first phase detection pixel PDPX_1b and the second photodiode PD2 of the first phase detection pixel PDPX_2b may be arranged in the substrate 208. Light blocking layers 205_1b and 205_2b may be formed over the substrate 208. The length L of the light blocking layers 205_1b and 205_2b may be formed differently according to the sensitivity of the first phase detection pixel pair PDPX_P1b. In addition, micro lenses 202_1b and 202_2b may be independently arranged over the first phase detection pixels PDPX_1b and PDPX_2b of the first phase detection pixel pair PDPX_P1b, respectively. Figure 6BThe structure of the first phase detection pixel pair PDPX_P1b shown may also be applied to the second phase detection pixel pair PDPX_P2b. However, the length of the light blocking layer included in the second phase detection pixel pair PDPX_P2b may be smaller than the length of the light blocking layers 205_1b and 205_2b included in the first phase detection pixel pair PDPX_P1b.
[0069] Further references Figure 6C The first phase detection pixel pair PDPX_P1b may further include the color filter 204b in Figure 6B In the structure shown. Figure 6C The structure of the first phase detection pixel pair PDPX_P1b shown may also be applied to the second phase detection pixel pair PDPX_P2b. However, in this case, the length of the light blocking layer included in the second phase detection pixel pair PDPX_P2b may be the same as the length of the light blocking layers 205_1b and 205_2b included in the first phase detection pixel pair PDPX_P1b, but the types and / or sensitivities of the color filters respectively included in the first phase detection pixel pair PDPX_P1b and the second phase detection pixel pair PDPX_P2b may be different from each other.
[0070] 7A to 7C is a diagram showing an arrangement pattern of phase detection pixel pairs according to some embodiments. 7A to 7C Portions of pixel arrays 210a, 210b, and 210c are shown. "L" refers to lower sensitivity pixel pairs, and "H" refers to higher sensitivity pixel pairs.
[0071] Reference Fig. 7A , the pixel array 210a may include first to sixth pixel groups PXG_1 to PXG_6 arranged adjacent to each other. The first to sixth pixel groups PXG_1 to PXG_6 may include first to sixth phase detection pixel pairs PDPX_P1a to PDPX_P6a, respectively.
[0072] In some embodiments, the first phase detection pixel pair PDPX_P1a, the third phase detection pixel pair PDPX_P3a, and the fifth phase detection pixel pair PDPX_P5a may include at least two phase detection pixels arranged adjacent to each other in the horizontal direction. The second phase detection pixel pair PDPX_P2a, the fourth phase detection pixel pair PDPX_P4a, and the sixth phase detection pixel pair PDPX_P6a may include at least two phase detection pixels arranged adjacent to each other in the vertical direction. In addition, the first phase detection pixel pair PDPX_P1a, the third phase detection pixel pair PDPX_P3a, and the fifth phase detection pixel pair PDPX_P5a may have a low sensitivity feature, and the second phase detection pixel pair PDPX_P2a, the fourth phase detection pixel pair PDPX_P4a, and the sixth phase detection pixel pair PDPX_P6a may have a high sensitivity feature.
[0073] In other words, a phase detection pixel pair of one pixel group may have different arrangement characteristics and different sensitivity characteristics from a phase detection pixel pair of another pixel group arranged adjacent thereto in the vertical direction and / or the horizontal direction.
[0074] Reference Figure 7B , the pixel array 210b may include first to sixth pixel groups PXG_1 to PXG_6 arranged adjacent to each other. The first to sixth pixel groups PXG_1 to PXG_6 may include first to sixth phase detection pixel pairs PDPX_P1b to PDPX_P6b, respectively.
[0075] In some embodiments, the first phase detection pixel pair PDPX_P1b, the second phase detection pixel pair PDPX_P2b, and the third phase detection pixel pair PDPX_P3b may include at least two phase detection pixels arranged adjacent to each other in the horizontal direction. The fourth phase detection pixel pair PDPX_P4b, the fifth phase detection pixel pair PDPX_P5b, and the sixth phase detection pixel pair PDPX_P6b may include at least two phase detection pixels arranged adjacent to each other in the vertical direction. In addition, the first phase detection pixel pair PDPX_P1b, the second phase detection pixel pair PDPX_P2b, and the third phase detection pixel pair PDPX_P3b may have a low sensitivity characteristic, and the fourth phase detection pixel pair PDPX_P4b, the fifth phase detection pixel pair PDPX_P5b, and the sixth phase detection pixel pair PDPX_P6b may have a high sensitivity characteristic. However, since the embodiments described herein are merely examples, the first phase detection pixel pair PDPX_P1b, the second phase detection pixel pair PDPX_P2b, and the third phase detection pixel pair PDPX_P3b may have high sensitivity characteristics, while the fourth phase detection pixel pair PDPX_P4b, the fifth phase detection pixel pair PDPX_P5b, and the sixth phase detection pixel pair PDPX_P6b may have low sensitivity characteristics.
[0076] In other words, the phase detection pixel pairs of one pixel group may be different from the phase detection pixel pairs of another pixel group arranged adjacent to the one pixel group in the vertical direction, and may have the same arrangement characteristics and the same sensitivity characteristics as the phase detection pixel pairs of another pixel group arranged adjacent to the one pixel group in the horizontal direction.
[0077] Reference Figure 7C , the pixel array 210c may include first to sixth pixel groups PXG_1 to PXG_6 arranged adjacent to each other. The first to sixth pixel groups PXG_1 to PXG_6 may include first to sixth phase detection pixel pairs PDPX_P1c to PDPX_P6c, respectively.
[0078] In some embodiments, the first phase detection pixel pair PDPX_P1c, the third phase detection pixel pair PDPX_P3c, and the fifth phase detection pixel pair PDPX_P5c may each include at least two phase detection pixels arranged adjacent to each other in the horizontal direction. The second phase detection pixel pair PDPX_P2c, the fourth phase detection pixel pair PDPX_P4c, and the sixth phase detection pixel pair PDPX_P6c may each include at least two phase detection pixels arranged adjacent to each other in the vertical direction. In addition, the first phase detection pixel pair PDPX_P1c, the second phase detection pixel pair PDPX_P2c, and the sixth phase detection pixel pair PDPX_P6c may have a low sensitivity feature, and the third phase detection pixel pair PDPX_P3c, the fourth phase detection pixel pair PDPX_P4c, and the fifth phase detection pixel pair PDPX_P5c may have a high sensitivity feature. In other words, as in the case of the first phase detection pixel pair PDPX_P1c and the second phase detection pixel pair PDPX_P2c, the arrangement features may be different from each other, but the sensitivity features may be the same.
[0079] In other words, the phase detection pixel pairs of one pixel group may have different arrangement characteristics and different sensitivity characteristics from the phase detection pixel pairs of another pixel group arranged adjacent to the one pixel group in the vertical direction; among the phase detection pixel pairs arranged adjacent to each other in the horizontal direction, the phase detection pixel pairs of one pixel group may have different arrangement characteristics and the same sensitivity characteristics as the phase detection pixel pairs of another pixel group arranged on one side of the one pixel group; and among the phase detection pixel pairs arranged adjacent to each other in the horizontal direction, the phase detection pixel pairs of one pixel group may have different arrangement characteristics and different sensitivity characteristics from the phase detection pixel pairs of another pixel group arranged on the other side of the one pixel group.
[0080] 7A to 7C The illustrated embodiment is not limited thereto, and the phase detection pixel pairs may be arranged in a different pattern.
[0081] Figure 8 is a diagram illustrating an example in which some embodiments of the inventive concept are applied to a shared pixel structure.
[0082] Reference Figure 8 , the pixel array 310 may include a first shared pixel group SPX_G1 and a second shared pixel group SPX_G2. Hereinafter, it is assumed that the shared pixel group is a unit including a plurality of shared image pixels and one shared phase detection pixel. In addition, a configuration including four sub-pixels in one shared pixel is described below, but the embodiments described herein are not limited thereto, and one shared pixel may include various numbers of sub-pixels therein. The second shared pixel group SPX_G2 may be arranged adjacent to the first shared pixel group SPX_G1 in a downward direction.
[0083] The first shared pixel group SPX_G1 may include first to third shared image pixels SIPX1 to SIPX3 and a first shared phase detection pixel SPDPX1, and the second shared pixel group SPX_G2 may include fourth to sixth shared image pixels SIPX4 to SIPX6 and a second shared phase detection pixel SPDPX2. The shared image pixel may include a plurality of image sensing sub-pixels, and the shared phase detection pixel may include at least two phase detection sub-pixels. According to some embodiments, the shared phase detection pixel may include at least one image sensing sub-pixel. The image sensing sub-pixel may be a general pixel from which image information is obtained, and the phase detection sub-pixel may be a pixel capable of obtaining phase information for phase difference detection AF. The sub-pixels included in one shared pixel (that is, one shared image pixel or one shared phase detection pixel) may be connected to one selection signal line, and from Figure 2 The row drivers 140 in receive the same selection signal SEL.
[0084] Fig.9A and 9B are respectively shown according to some embodiments Figure 8 Figure 2 shows a diagram of the shared phase detection pixels SPDPX1 and SPDPX2 in FIG.
[0085] Reference Fig.9A , the first shared phase detection pixel SPDPX1 may include first phase detection sub-pixels PDPX_1a and PDPX_1b and first image sensing sub-pixels IPX_1a and IPX_1b. The first phase detection sub-pixels PDPX_1a and PDPX_1b may be defined as a first phase detection sub-pixel pair. The first phase detection sub-pixels PDPX_1a and PDPX_1b may be arranged adjacent to each other in a horizontal direction and may be covered by one horizontal microlens ML_H. In addition, each of the first image sensing sub-pixels IPX_1a and IPX_1b may be individually covered by an individual microlens ML_I.
[0086] In some embodiments, the type of color filters included in the first phase detection sub-pixels PDPX_1a and PDPX_1b and the type of color filters included in the first image sensing sub-pixels IPX_1a and IPX_1b may be the same as or different from each other. The structure of the first phase detection sub-pixels PDPX_1a and PDPX_1b may be the same as Figure 4A and Figure 4B The structures of the first phase detection pixel PDPX_1a and the second phase detection pixel PDPX_2a are the same, and thus, detailed descriptions thereof are omitted.
[0087] Return to reference Fig. 9B, the second shared phase detection pixel SPDPX2 may include second phase detection sub-pixels PDPX_2a and PDPX_2b and second image sensing sub-pixels IPX_2a and IPX_2b. The second phase detection sub-pixels PDPX_2a and PDPX_2b may be defined as a second phase detection sub-pixel pair. The second phase detection sub-pixels PDPX_2a and PDPX_2b may be arranged adjacent to each other in the vertical direction and may be covered by one vertical microlens ML_H. In addition, each of the second image sensing sub-pixels IPX_2a and IPX_2b may be individually covered by an individual microlens ML_I.
[0088] In some embodiments, the type of color filters included in the second phase detection sub-pixels PDPX_2a and PDPX_2b and the type of color filters included in the second image sensing sub-pixels IPX_2a and IPX_2b may be the same as or different from each other. In addition, the sensitivity of the first phase detection sub-pixels PDPX_1a and PDPX_1b of the first shared phase detection pixel SPDPX1 and the sensitivity of the second phase detection sub-pixels PDPX_2a and PDPX_2b of the second phase detection shared pixel SPDPX2 may be different from each other, and furthermore, the sensitivity of the first phase detection sub-pixels PDPX_1a and PDPX_1b may be less than the sensitivity of the second phase detection sub-pixels PDPX_2a and PDPX_2b. In other words, the type of color filters included in the first phase detection sub-pixels PDPX_1a and PDPX_1b may be different from the type of color filters included in the second phase detection sub-pixels PDPX_2a and PDPX_2b. The structure of the second phase detection sub-pixels PDPX_2a and PDPX_2b may be the same as that described with reference to the above. Figure 4A and Figure 4B The structures of the described first phase detection pixels PDPX_1a and PDPX_2a are the same or similar, and thus, a detailed description thereof is omitted.
[0089] Fig. 10A and 10B It is a diagram showing a method according to another embodiment Figure 8 Diagram of shared phase detection pixels in .
[0090] Reference Fig. 10A, the first shared phase detection pixel SPDPX1 may include four first phase detection sub-pixels PDPX_1a to PDPX_1d. The first phase detection sub-pixels PDPX_1a and PDPX_1b may be arranged adjacent to each other in the horizontal direction, and the types of color filters included therein may be the same. The first phase detection sub-pixels PDPX_1c and PDPX_1d may be arranged adjacent to each other in the horizontal direction, and the types of color filters included therein may be the same. In some embodiments, the sensitivity of the first phase detection sub-pixels PDPX_1a and PDPX_1b may be less than the sensitivity of the first phase detection sub-pixels PDPX_1c and PDPX_1d. For example, the first phase detection sub-pixels PDPX_1a and PDPX_1b may include green filters, and the first phase detection sub-pixels PDPX_1c and PDPX_1d may include white filters. In addition, the first shared phase detection pixel SPDPX1 may be covered by one microlens ML.
[0091] Further references Fig. 10B , the second shared phase detection pixel SPDPX2 may include four second phase detection sub-pixels PDPX_2a to PDPX_2d. The second phase detection sub-pixels PDPX_2a and PDPX_2c may be arranged adjacent to each other in the vertical direction, and the types of color filters included therein may be the same. The second phase detection sub-pixels PDPX_2b and PDPX_2d may be arranged adjacent to each other in the vertical direction, and the types of color filters included therein may be the same. In some embodiments, the sensitivity of the second phase detection sub-pixels PDPX_2a and PDPX_2c may be greater than the sensitivity of the second phase detection sub-pixels PDPX_2b and PDPX_2d. For example, the second phase detection sub-pixels PDPX_2a and PDPX_2c may include white filters, and the second phase detection sub-pixels PDPX_2b and PDPX_2d may include green filters. In addition, the second shared phase detection pixel SPDPX2 may be covered by one microlens ML.
[0092] In some embodiments, the sensitivity of the second phase detection subpixels PDPX_2a and PDPX_2c may be the same as that of the first phase detection subpixels PDPX_1c and PDPX_1d, and the sensitivity of the second phase detection subpixels PDPX_2b and PDPX_2d may be the same as that of the first phase detection subpixels PDPX_1a and PDPX_1b.
[0093] Fig.11A and 11B It is shown that according to other embodiments Figure 8 Diagram of shared phase detection pixels in .
[0094] Reference Fig.11A, the first shared phase detection pixel SPDPX1 may include first phase detection sub-pixels PDPX_1a and PDPX_1b and first image sensing sub-pixels IPX_1a and IPX_1b. The first phase detection sub-pixels PDPX_1a and PDPX_1b may be defined as a first phase detection sub-pixel pair. The first phase detection sub-pixels PDPX_1a and PDPX_1b may be arranged adjacent to each other in a vertical direction, and may respectively include a light blocking layer B1a and a light blocking layer B1b each having a first length L1. Although Fig.11A Although not shown in the drawings, the first phase detection sub-pixels PDPX_1a and PDPX_1b and the first image sensing sub-pixels IPX_1a and IPX_1b may each be individually covered by a corresponding microlens.
[0095] Further references Fig. 11B , the second shared phase detection pixel SPDPX2 may include second phase detection sub-pixels PDPX_2a and PDPX_2b and second image sensing sub-pixels IPX_2a and IPX_2b. The second phase detection sub-pixels PDPX_2a and PDPX_2b may be defined as a second phase detection sub-pixel pair. The second phase detection sub-pixels PDPX_2a and PDPX_2b may be arranged adjacent to each other in a horizontal direction, and may respectively include a light blocking layer B2a and a light blocking layer B2b each having a second length L2.
[0096] In some embodiments, a second length L2 of the light-blocking layers B2a and B2b included in the second phase-detection sub-pixels PDPX_2a and PDPX_2b may be less than a first length L1 of the light-blocking layers B1a and B1b included in the first phase-detection sub-pixels PDPX_1a and PDPX_1b. As a result, the sensitivity of the second phase-detection sub-pixels PDPX_2a and PDPX_2b may be greater than the sensitivity of the first phase-detection sub-pixels PDPX_1a and PDPX_1b. However, the embodiments described herein are not limited thereto, and the sensitivity of the second phase-detection sub-pixels PDPX_2a and PDPX_2b may be implemented to be less than the sensitivity of the first phase-detection sub-pixels PDPX_1a and PDPX_1b.
[0097] Although Fig. 11B Although not shown in the drawings, the second phase detection sub-pixels PDPX_2a and PDPX_2b and the second image sensing sub-pixels IPX_2a and IPX_2b may each be individually covered by a corresponding microlens.
[0098] Fig.12 and Fig.13 According to some embodiments Figure 1 Flowchart of the AF operation of the processor 1200 in FIG.
[0099] Reference Figure 1 and Fig.12 , the processor 1200 may calculate a first phase difference using a high-sensitivity phase detection pixel among the phase detection pixels of the pixel array 110 (Sl00). The processor 1200 may control the timing controller 120 to receive phase information of a high-sensitivity phase detection pixel among the phase detection pixels of the pixel array 110, and calculate the first phase difference based on the phase information. In addition, the processor 1200 may generate a first confidence level representing the accuracy of the first phase difference value, and may determine whether the first confidence level is equal to or greater than a first threshold value (S110). When the first confidence level is equal to or greater than the first threshold value (or yes in S110), the processor 1200 may perform phase difference AF using the first phase difference value (S140). Otherwise, when the first confidence level is less than the first threshold value (or no in S110), the processor 1200 may receive phase information of a low-sensitivity phase detection pixel among the phase detection pixels of the pixel array 110, and may calculate the phase difference based on the received phase information (S120). In addition, the processor 1200 may generate a second confidence level representing the accuracy of the second phase difference value, and may determine whether the second confidence level is equal to or greater than the first threshold value (S130). When the second confidence level is equal to or greater than the first threshold value (or "yes" in S130), the processor 1200 may perform phase difference AF using the second phase difference value (S140). Otherwise, when the second confidence level is less than the first threshold value (or "no" in S130), the processor 1200 may perform contrast AF based on the contrast difference between the images (S150). Although the common threshold value of the first confidence level and the second confidence level is described as an example, it should be understood that in some embodiments, respective threshold values for the first confidence level and the second confidence level may be used.
[0100] Reference Figure 1 and Fig.13 , the processor 1200 may calculate the first phase difference using the high-sensitivity phase detection pixels among the phase detection pixels of the pixel array 110 (S200). The processor 1200 may control the timing controller 120 to receive the phase information of the high-sensitivity phase detection pixels among the phase detection pixels of the pixel array 110, and calculate the first phase difference based on the phase information. In addition, the processor 1200 may generate a first confidence level representing the accuracy of the first phase difference value, and may determine whether the first confidence level is equal to or greater than a second threshold value (S210). The second threshold value may be set to be greater than Fig.12. When the first confidence level is equal to or greater than the second threshold value (or "Yes" in S210), the processor 1200 may perform phase difference AF using the second phase difference value (S260). Otherwise, when the first confidence level is less than the second threshold value (or "No" in S210), the processor 1200 may receive phase information of low-sensitivity phase detection pixels among the phase detection pixels of the pixel array 110, and may calculate the second phase difference based on the received phase information (S220). In addition, the processor 1200 may generate a second confidence level representing the accuracy of the second phase difference value, and may determine whether the second confidence level is equal to or greater than the second threshold value (S230). When the second confidence level is equal to or greater than the second threshold value (or "Yes" in S230), the processor 1200 may perform phase difference AF using the second phase difference value (S260). Otherwise, when the second confidence level is less than the second threshold value (or "No" in S230), the processor 1200 may combine the results of the first phase difference and the second phase difference generated using the high-sensitivity / low-sensitivity phase detection pixels (S240). In some embodiments, the processor 1200 may provide a weight corresponding to the first confidence level for the first phase difference value, provide a weight corresponding to the second confidence level for the second phase difference value, and calculate the sum of the first phase difference value and the second phase difference value. The processor 1200 may generate a third confidence level indicating the accuracy of the calculated sum value, and may determine whether the third confidence level is equal to or greater than the second threshold value (S250). When the third confidence level is equal to or greater than the second threshold value (or "Yes" in S250), the processor 1200 may perform phase difference AF using the calculated sum value (S260). Otherwise, when the third confidence level is less than the second threshold value (or "No" in S250), the processor 1200 may perform contrast AF (S270).
[0101] Fig.14 is a block diagram illustrating a system 2000 including an image sensor according to some embodiments.
[0102] Fig.14 The system 2000 may include a computer system, a camera system, a scanner, a vehicle navigation system, a video phone, a security system, and / or a motion detection system requiring image data. Fig.14 , the system 2000 may include a central processing unit (CPU) or processor 2010, a nonvolatile memory 2020, an image pickup device 2030 including an image sensor, an input / output device (I / O) 2040, and a random access memory (RAM) 2050. The CPU 2010 may communicate with the nonvolatile memory 2020, the image pickup device 2030, the input / output device 2040, and the RAM 2050 via a bus 2060.
[0103] Included in Fig.14The image pickup device 2030 in the system 2000 may include the above-mentioned image sensor according to an embodiment of the inventive concept. For example, the image sensor included in the image pickup device 2030 may include a phase detection pixel pair having different sensitivity characteristics and arrangement characteristics. The image pickup device 2030 may perform phase difference AF using the phase detection pixel pair.
[0104] Image data output from the image pickup device 2030 may be transferred to the CPU 2010, the nonvolatile memory 2020, the input / output device 2040, and / or the RAM 2050 via the bus 2060. The image pickup device 2030 according to some embodiments may provide an improved image through a fast and accurate AF operation.
[0105] As used herein, the singular forms "a", "an" and "an" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "comprising" when used in this specification specifies the presence of the listed features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. The term "and / or" includes any and all combinations of one or more of the associated listed items.
[0106] Although the inventive concept has been specifically shown and described with reference to the exemplary embodiments of the inventive concept, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the inventive concept as defined by the claims. Therefore, the true scope of protection of the inventive concept should be determined by the technical ideas of the appended claims.
Claims
1. An image sensor, comprising: A pixel array comprising a plurality of shared pixels, wherein the plurality of shared pixels comprises: a first shared phase-detection pixel including first phase-detection sub-pixels arranged adjacent to each other in a first direction, the first phase-detection sub-pixels having a first single micro-lens thereon, and the first shared phase-detection pixel further including first image sensing sub-pixels, each first image sensing sub-pixel having a respective first micro-lens thereon; and a second shared phase-detection pixel including second phase-detection sub-pixels arranged adjacent to each other in a second direction different from the first direction, the second phase-detection sub-pixels having a second single microlens thereon, and the second shared phase-detection pixel further including second image sensing sub-pixels, each second image sensing sub-pixel having a respective second microlens thereon, The first sensitivity of the first phase detection sub-pixel is different from the second sensitivity of the second phase detection sub-pixel. Each of the second phase detection sub-pixels includes a white color filter or does not include a color filter.
2. The image sensor according to claim 1, wherein: The first direction and the second direction are orthogonal to each other.
3. The image sensor according to claim 1, wherein: The second phase detection sub-pixel does not include a color filter.
4. The image sensor according to claim 1, wherein: The second shared phase detection pixel is arranged adjacent to the first shared phase detection pixel in the second direction, and the first direction is a horizontal direction and the second direction is a vertical direction.
5. The image sensor according to claim 1, further comprising a timing controller configured to differently control an exposure time of the first phase detection sub-pixel and an exposure time of the second phase detection sub-pixel to generate phase information for calculating a phase difference between respective images. 6 . The image sensor of claim 1 , some of the first phase detection sub-pixels comprising a white color filter.
7. The image sensor according to claim 1, wherein: The plurality of shared pixels further comprises: A plurality of shared image pixels includes a plurality of image sensing sub-pixels, each of which includes a corresponding identical color filter, wherein each image sensing sub-pixel included in the same shared image pixel is connected to the same selection signal line.
8. The image sensor according to claim 1, wherein: The second phase detection sub-pixel included in the second shared phase detection pixel includes a second color filter.
9. The image sensor according to claim 1, wherein: The first shared phase detection pixel further includes a third phase detection sub-pixel, the third phase detection sub-pixels are arranged adjacent to each other in the first direction and have a first single microlens on the third phase detection sub-pixel; The second shared phase detection pixel further includes a fourth phase detection sub-pixel, the fourth phase detection sub-pixels are arranged adjacent to each other in the second direction and have a second single microlens on the fourth phase detection sub-pixel; The third sensitivity of the third phase detection sub-pixel is the same as the second sensitivity of the second phase detection sub-pixel; and A fourth sensitivity of the fourth phase detection sub-pixel is the same as the first sensitivity of the first phase detection sub-pixel.
10. An image pickup device, comprising: lens; a lens driver configured to control a position of the lens; a pixel array including a first phase detection pixel pair and a second phase detection pixel pair, wherein the first phase detection pixel pair includes first phase detection pixels arranged adjacent to each other in a first direction and having a first sensitivity, and the second phase detection pixel pair includes second phase detection pixels arranged adjacent to each other in a second direction different from the first direction and having a second sensitivity different from the first sensitivity; as well as A processor is configured to perform sensitivity-based phase difference calculation using first phase information received from the first phase detection pixel pair and / or second phase information received from the second phase detection pixel pair, and control the lens driver based on the calculation result.
11. The image pickup device according to claim 10, wherein: The processor is further configured to generate a first phase difference value and a first confidence level of the first phase difference value using the first phase information, and calculate a second phase difference value using the second phase information based on the first confidence level of the first phase difference value.
12. The image pickup device according to claim 11, wherein: The processor is also configured to control the lens driver using the first phase difference value when the first confidence level of the first phase difference value is equal to or greater than a threshold, and to generate the second phase difference value and a second confidence level of the second phase difference value when the first confidence level of the first phase difference value is less than the threshold.
Citation Information
Patent Citations
Fingerprint sensor module
KR1020180028307A
Image processing methods for image sensors with phase detection pixels
CN105306786A
Imaging device
CN204761572U