Image sensor and method of operating the same
By designing the sensing pixels in the image sensor to share floating diffusion nodes and processing pixel signals according to the shooting mode, the problems of poor image quality under low illumination conditions and difficult exposure time period processing in HDR mode are solved, and the functions of high-quality image capture and high dynamic range are realized.
Patent Information
- Application Number
- CN202010190218.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-03-25
- Filing Date
- 2020-03-18
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2040-03-18
AI Technical Summary
It is difficult for existing image sensors to obtain high-quality images under low lighting conditions, and it is difficult to effectively process pixel signals for different exposure time periods in high dynamic range (HDR) shooting mode.
An image sensor is designed, including a pixel array, in which multiple sensing pixels can share a floating diffusion node and output pixel signals through a column line. The image sensor is able to output pixel signals according to operation mode information (general shooting mode or HDR shooting mode), and perform reconstruction operations and dynamic range compression in HDR mode.
Improve image quality under low lighting conditions, can effectively process pixel signals in different exposure time periods, realize high dynamic range image capture, and support automatic focus function.
Smart Images

Figure CN111741242B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] Korean Patent Application No. 10-2019-0033727, entitled “IMAGE SENSOR AND METHOD OF OPERATING THE SAME,” filed on March 25, 2019 in the Korean Intellectual Property Office, is incorporated herein by reference in its entirety. Technical Field
[0003] Embodiments relate to image sensors, and more particularly, to image sensors including sensing pixels sharing a floating diffusion node and phase detection pixels sharing a microlens. Background Art
[0004] An image sensor captures a two-dimensional image or a three-dimensional image of an object. An image sensor generates an image of an object by using a photoelectric conversion device that responds to the intensity of light reflected from the object. With the development of complementary metal-oxide semiconductor (CMOS) technology, CMOS image sensors using CMOS have been widely used. Summary of the invention
[0005] According to one or more embodiments, an image sensor includes a pixel array, wherein the pixel array includes a first unit pixel and a same color filter, wherein the first unit pixel includes a first sensing pixel adjacent to each other in a column direction and a second sensing pixel adjacent to each other in a column direction, the first sensing pixel and the second sensing pixel are adjacent to each other in a row direction, and the same color filter overlaps the first sensing pixel and the second sensing pixel. The first sensing pixel shares a first floating diffusion node. The second sensing pixel shares a second floating diffusion node.
[0006] According to one or more embodiments, an image sensor includes: a pixel array that outputs pixel signals, the pixel array including a plurality of sensing pixels and a plurality of phase detection pixels; a timing controller configured to output a control signal based on operating mode information indicating a general shooting mode or a high dynamic range (HDR) shooting mode; and a read circuit configured to output pixel data based on the control signal and the pixel signal, wherein some of the plurality of sensing pixels may share a floating diffusion node and output the pixel signal through a column line.
[0007] According to one or more embodiments, an operating method of an image sensor includes: sequentially outputting pixel signals by a plurality of sensing pixels through a shared floating diffusion node; receiving operating mode information indicating a general shooting mode or a high dynamic range (HDR) shooting mode; when the operating mode information indicates the general shooting mode, performing an analog binning operation on the pixel signal; and when the operating mode information indicates the HDR shooting mode, performing at least one of a reconstruction operation and a dynamic range compression (DRC) operation on the pixel signal. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Features will become apparent to those skilled in the art by describing in detail exemplary embodiments with reference to the accompanying drawings, in which:
[0009] Figure 1 An image capturing device according to an embodiment is shown;
[0010] Figure 2 An image sensor according to an embodiment is shown;
[0011] Figure 3 shows a pixel array according to an embodiment;
[0012] Figure 4 shows a unit pixel group according to an embodiment;
[0013] Figures 5A to 5D shows a unit pixel group according to an embodiment, the unit pixel group including a plurality of sensing pixels having various exposure time periods in a high dynamic range (HDR) shooting mode;
[0014] Fig. 6A A circuit diagram of a sensing pixel group including a plurality of sensing pixels according to an embodiment is shown;
[0015] Figure 6B is applied to Fig. 6A A waveform diagram of a signal of a sensing pixel group shown;
[0016] Figure 7 A flow chart showing a method of operating an image sensor according to an embodiment;
[0017] Figure 8 shows an image processing operation in a general shooting mode according to an embodiment;
[0018] Fig. 9 shows an image processing operation in a general shooting mode according to an embodiment;
[0019] Fig.10 shows an image processing operation in a high dynamic range (HDR) shooting mode according to an embodiment;
[0020] Fig.11 shows an image processing operation in an HDR shooting mode according to an embodiment;
[0021] Fig.12 A cross-sectional view showing a structure of a phase detection pixel group according to an embodiment;
[0022] FIG. 13A to FIG. 13D A diagram showing a phase detection pixel group and a microlens according to an embodiment, wherein a plurality of phase detection pixels are included in the phase detection pixel group; and
[0023] Fig.14 An image processing system according to an embodiment is shown. DETAILED DESCRIPTION
[0024] Figure 1 FIG. 1 shows an image capturing apparatus 1000 according to an embodiment. Figure 1 , the image photographing device 1000 may include a photographing unit 1100, an image sensor 100, and a processor 1200. The image photographing device 1000 may acquire image data by photographing a subject S, and may perform an auto focus function.
[0025] All operations of the image capture device 1000 may be controlled by the processor 1200. The processor 1200 may provide a control signal and / or information for the operation of each component to the lens driver 1120, the timing controller 120, etc. For example, the processor 1200 may provide the timing controller 120 with operation mode information INFO_MD indicating a general shooting mode or a high dynamic range (HDR) shooting mode.
[0026] The photographing unit 1100 may include a lens 1110 and a lens driver 1120. The lens 1110 may include at least one lens. In addition, the photographing unit 1100 may further include an aperture and an aperture driving unit.
[0027] The lens driver 1120 may exchange information about focus detection with the processor 1200, and may adjust the position of the lens 1110 in response to a control signal provided by the processor 1200. The lens driver 1120 may drive the lens 1110 in a direction in which the distance between the object S and the lens 1110 increases or decreases to adjust the distance between the lens 1110 and the object S. According to the position of the lens 1110, the object S may be in focus or out of focus.
[0028] The image capture device 1000 may perform phase detection autofocusing (PDAF). For example, when the distance between the lens 1110 and the object S is relatively short, the lens 1110 may be out of the in-focus position of the object S, and a phase difference may occur between images captured by the image sensor 100. In response to a control signal provided from the processor 1200, the lens driver 1120 may move the lens 1110 in a direction in which the distance between the object S and the lens 1110 increases.
[0029] Alternatively, when the distance between the lens 1110 and the object S is relatively long, the lens 1110 may be out of focus and a phase difference may occur between images captured by the image sensor 100. In response to a control signal provided from the processor 1200, the lens driver 1120 may move the lens 1110 in a direction in which the distance between the object S and the lens 1110 decreases.
[0030] The image sensor 100 may convert light incident on the image sensor 100 into image data. The image sensor 100 may include a pixel array 110, a timing controller 120, and an image signal processor 130. An optical signal transmitted through a lens 1110 may reach a light receiving surface of the pixel array 110 and determine an image of the object S.
[0031] The pixel array 110 may be a complementary metal oxide semiconductor image sensor (CIS) that converts an optical signal into an electrical signal. The exposure period and sensitivity of the pixel array 110 may be adjusted by the timing controller 120. The pixel array 110 may include a plurality of sensing pixels and a plurality of phase detection pixels. The sensing pixels may be operated to output image data of the object S, and each of the phase detection pixels may detect a phase difference between the image data of the object S and operate to move the lens 1110. Specific embodiments of the sensing pixels and the phase detection pixels will be described later.
[0032] The processor 1200 may receive image data from the image signal processor 130 , perform various image after-processing operations on the image data, and perform phase difference calculation.
[0033] For example, the processor 1200 may perform an image post-processing operation to adjust one or more image parameters, such as brightness, light and shadow, gamma, luminance, etc., for the image data received from the sensing pixels. The image post-processing operation may include various operations for improving image quality, such as noise reduction, gamma correction, color filter array interpolation, color matrix, color correction, color enhancement, etc. Next, the processor 1200 may perform an image compression operation to generate an image file, and may also restore the image data by using the image file.
[0034] As another example, the processor 1200 may perform phase difference calculation on the image data received from the phase detection pixel. The processor 1200 may obtain the focused position, the focused direction, the distance between the object S and the image sensor 100, etc. according to the result of the phase difference calculation. The processor 1200 may output a control signal to the lens driver 1120 based on the result of the phase difference calculation so as to move the position of the lens 1110.
[0035] According to an embodiment, the image capturing device 1000 may be included in various electronic devices. For example, the image capturing device 1000 may be installed in electronic devices such as cameras, smart phones, wearable devices, Internet of Things (IoT) devices, tablet personal computers (PCs), notebook PCs, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices, and display devices. In addition, the image capturing device 1000 may be installed in electronic devices provided as components in vehicles, furniture, manufacturing equipment, doors, various measuring devices, and the like.
[0036] Figure 2 An image sensor 100 according to an embodiment is shown. Figure 2 , the image sensor 100 may include a pixel array 110 , a timing controller 120 , an image signal processor 130 , a row driver 140 , and a readout circuit 150 .
[0037] The pixel array 110 may include a plurality of sub-pixels arranged in a matrix, and the plurality of sub-pixels may include a plurality of sensing pixels SPX and a plurality of phase detection pixels PPX. For example, the sub-pixel may be a sensing pixel SPX, and as another example, the sub-pixel may be a phase detection pixel PPX. Each of the plurality of sub-pixels may include a light sensing device, such as a photodiode. The light sensing device may generate a photo charge according to light incident from the outside. The plurality of pixels may convert the photo charge into a voltage or current signal to output the voltage or current signal as a pixel signal SIG_PX through a plurality of column lines CL1 to CLn.
[0038] The pixel signal SIG_PX may include an image signal output from the sensing pixel SPX and a phase signal output from the phase detection pixel PPX. For example, the plurality of sensing pixels SPX may output a phase signal related to Figure 1 The image signal corresponding to the object S is used as the pixel signal SIG_PX, and as another example, the plurality of phase detection pixels PPX may generate a phase signal for calculating a phase difference between images generated by photographing the object S.
[0039] According to an embodiment, the pixel array 110 may include a plurality of sensing pixel groups SPXG. The plurality of sensing pixel groups SPXG may be arranged to be adjacent to each other in a row direction. A plurality of sensing pixels (eg, SPX1 to SPX3) included in the sensing pixel group SPXG may share a floating diffusion node (eg, Fig. 6A The floating diffusion node FD shown). The plurality of sensing pixels may output pixel signals SIG_PX through extended column lines. In this case, the plurality of sensing pixels SPX included in the sensing pixel group SPXG may include color filters having the same color. The sensing pixels SPX included in the same column may output pixel signals SIG_PX in units of rows. For example, among the plurality of sensing pixels SPX included in the sensing pixel group SPXG, a first sensing pixel SPX1 arranged in a first row, a second sensing pixel SPX2 arranged in a second row, and a third sensing pixel SPX3 arranged in a third row may sequentially output pixel signals SIG_PX, respectively. By using the pixel signals SIG_PX outputted from the plurality of sensing pixels SPX, a high-quality image may be obtained at a low illumination level.
[0040] According to an embodiment, a plurality of phase detection pixels (eg, PPX1 and PPX2) included in the phase detection pixel group PPXG may include one same microlens (eg, Fig.12The phase detection pixels PPX may increase the number of pixels per unit area of the pixel array 110 by sharing microlenses. In this case, the plurality of phase detection pixels PPX included in the phase detection pixel group PPXG may include color filters having the same color because light in the same wavelength band is used for phase difference calculation.
[0041] The timing controller 120 may control the row driver 140 by providing the row driver 140 with a timing control signal TC so that the pixel array 110 accumulates charges by absorbing light, temporarily stores the accumulated charges, and outputs an electrical signal to an external area of the pixel array 110 according to the stored charges.
[0042] According to an embodiment, the timing controller 120 may control the exposure period of the sensing pixel SPX or the phase detection pixel PPX with reference to the operation mode information INFO_MD. For example, the operation mode information INFO_MD may indicate a general shooting mode or an HDR shooting mode.
[0043] For example, the timing controller 120 may transmit the timing control signal TC to the row driver 140 based on the operation mode information INFO_MD indicating the general shooting mode, so that the first sensing pixel SPX1 in the first row, the second sensing pixel SPX2 in the second row, and the third sensing pixel SPX3 in the third row have the same exposure period. As another example, the timing controller 120 may transmit the timing control signal TC to the row driver 140 based on the operation mode information INFO_MD indicating the HDR shooting mode, so that the sensing pixel SPX1 in the first row, the sensing pixel SPX2 in the second row, and the sensing pixel SPX3 in the third row have different exposure periods.
[0044] According to an embodiment, the timing controller 120 may control at least one of the image signal processor 130 and the read circuit 150 with reference to the operation mode information INFO_MD.
[0045] For example, the timing controller 120 may control the reading circuit 150 and the image signal processor 130 to perform analog merging and digital merging based on the operation mode information INFO_MD indicating the general shooting mode. The analog merging may refer to an operation of merging the pixel signal SIG_PX output from the sensing pixels (e.g., the first sensing pixel SPX1, the second sensing pixel SPX2, and the third sensing pixel SPX3) sharing the floating diffusion node FD. The digital merging may refer to an operation of merging the pixel data PDTA that is analog-merged. Figures 7 to 9 Describe analog merging and digital merging in detail.
[0046] As another example, the timing controller 120 may control the image signal processor 130 to perform a reconstruction operation and a dynamic range compression (DRC) operation based on the operation mode information INFO_MD indicating the HDR shooting mode. Figure 7 and Figure 10 to Figure 11 Control of the image signal processor 130 is described in detail.
[0047] The row driver 140 may generate signals (e.g., a reset control signal RS, a transmission control signal TX, a selection signal SEL, etc.) to control the pixel array 110, and provide the signals to the plurality of sub-pixels in the pixel array 110. The row driver 140 may determine activation timing and deactivation timing of the reset control signal RS, the transmission control signal TX, and the selection signal SELS for the plurality of sensing pixels SPX and the plurality of phase detection pixels PPX.
[0048] The read circuit 150 may perform an analog binning operation and a correlated double sampling operation. The read circuit 150 may output the pixel data PDTA as a result of the correlated double sampling operation to the image signal processor 130 or the processor 1200. Figure 8 The output of the read circuit 150 is described in detail.
[0049] The image signal processor 130 may perform various signal processing operations on the pixel data PDTA. The image signal processor 130 may perform digital merging operations, noise reduction processing, gain adjustment, waveform normalization processing, interpolation processing, white balance processing, gamma processing, edge emphasis processing, etc. In addition, when performing PDAF, the image signal processor 130 may output phase information of phase detection pixels to the processor 1200 so that the processor 1200 performs phase difference calculation. In an embodiment, the image signal processor 130 may be disposed in a general-purpose image processor located outside the image sensor 100 (e.g., the processor 1200 (see Figure 1 ))middle.
[0050] Figure 3 is a diagram of a pixel array 110 according to an embodiment. Figure 4 is a diagram of a unit pixel group UPX according to an embodiment. Figure 4 yes Figure 3 An enlarged view of the unit pixel group UPXG is shown.
[0051] refer to Figure 3 , the pixel array 110 may include a plurality of unit pixel groups UPXG, and the unit pixel group UPXG may include a plurality of unit pixels UPX. Figure 4The unit pixel UPX may include a plurality of sub-pixels including the same color filters as each other. For example, the sub-pixel may be a sensing pixel SPX or a phase sensing pixel PPX.
[0052] According to an embodiment, the unit pixel group UPXG may include a red unit pixel, a blue unit pixel, and a green unit pixel that together form a Bayer pattern. In other words, the unit pixel group UPXG may be formed as an RGBG Bayer pattern (also referred to as an RGB Bayer pattern). In an embodiment, the unit pixel group UPXG may include various patterns, for example, a red, green, blue, white (red, green, blue, white, RGBW) pattern, a cyan, yellow, green, magenta (cyan, yellow, green, magenta, CYGM) pattern, a red, green, blue, emerald (red, green, blue, emerald, RGBE) pattern, a cyan, magenta, yellow, white (cyan, magenta, yellow, white, CMYW) pattern, etc.
[0053] refer to Figure 3 and Figure 4 , the sensing pixel group SPXG may include a plurality of sensing pixels SPX arranged in a matrix (e.g., an M*N matrix (N and M are natural numbers, respectively)). The plurality of sensing pixels SPX adjacent to each other in the column direction may share a floating diffusion node FD. For example, one unit pixel UPX may include sensing pixels SPX of M rows and N columns that share N floating diffusion nodes FD. For example, sensing pixels SPX arranged in the same column may share the same floating diffusion node FD. For convenience, in Figure 4 In FIG. 1 , only the green sensing pixels are shown as sharing the floating diffusion node FD, but the same may be applied to the red sensing pixels and the blue sensing pixels.
[0054] FIG. 5A to FIG. 5D is a diagram of a unit pixel group including a plurality of sensing pixels having various exposure time periods in an HDR photographing mode according to an embodiment.
[0055] refer to FIG. 5A to FIG. 5D , the unit pixel UPX may include a plurality of sensing pixels L, M, and S. For example, the unit pixel UPX may include a plurality of sensing pixels SPX arranged in an M*N matrix (eg, a 3*3 matrix).
[0056] According to an embodiment, in the HDR shooting mode, the light sensing devices included in the plurality of sensing pixels SPX may have different exposure time periods. For example, the first sensing pixel L may include a light sensing device exposed for a first time period, the second sensing pixel M may include a light sensing device exposed for a second time period, and the third sensing pixel S may include a light sensing device exposed for a third time period. Here, the first time period may be longer than the second time period, and the second time period may be longer than the third time period, such as a long, medium, or short time period.
[0057] refer to Figure 5A , the unit pixel group UPXG may include a first unit pixel UPX1, a second unit pixel UPX2, a third unit pixel UPX3, and a fourth unit pixel UPX4 having the same exposure time period. For each column of the first unit pixel UPX1, the first unit pixel UPX1 may include a first sensing pixel group SPXG1, a second sensing pixel group SPXG2, and a third sensing pixel group SPXG3. Each sensing pixel group SPXG may include a plurality of sensing pixels SPX in one column, and sensing pixels adjacent to each other may have different exposure time periods.
[0058] The first sensing pixel group SPXG1 may include sensing pixels L, S, M sequentially arranged in a column direction in the order of the second sensing pixel M, the third sensing pixel S, and the first sensing pixel L. For each column, the sensing pixel group SPXG2 may sequentially include the first sensing pixel L, the second sensing pixel M, and the third sensing pixel S. The third sensing pixel group SPXG3 may sequentially include the third sensing pixel S, the first sensing pixel L, and the second sensing pixel M.
[0059] refer to Figure 5B , some of the first to fourth unit pixels UPX1 to UPX4 may have different exposure time period patterns. For example, the unit pixels UPX located in the same column may have the same exposure time period pattern, and the unit pixels UPX located in the same row may have different exposure time period patterns. For example, the first unit pixel UPX1 and the third unit pixel UPX3 may have the same exposure time period pattern, the first unit pixel UPX1 and the second unit pixel UPX2 may have different exposure time period patterns, and the second unit pixel UPX2 and the fourth unit pixel UPX4 may have the same exposure time period pattern.
[0060] For each column in the fourth unit pixel UPX4, the fourth unit pixel UPX4 may include a fourth sensing pixel group SPXG4, a fifth sensing pixel group SPXG5, and a sixth sensing pixel group SPXG6. The fourth sensing pixel group SPXG4 may include sensing pixels L, S, and M sequentially arranged in the order of a third sensing pixel S, a first sensing pixel L, and a second sensing pixel M in the column direction. For each column, the sensing pixel group SPXG5 may sequentially include a first sensing pixel L, a second sensing pixel M, and a third sensing pixel S. The sixth sensing pixel group SPXG6 may sequentially include a second sensing pixel M, a third sensing pixel S, and a first sensing pixel L.
[0061] refer to Figure 5C , some of the first to fourth unit pixels UPX1 to UPX4 may have different exposure time period patterns. For example, unit pixels adjacent to each other in a diagonal direction may have the same exposure time period pattern. The first unit pixel UPX1 and the fourth unit pixel UPX4 may have the same exposure time period pattern, and the second unit pixel UPX2 and the third unit pixel UPX3 may have the same exposure time period pattern.
[0062] refer to FIG. 5A to FIG. 5C , each unit pixel UPX may include a plurality of sensing pixels SPX, and each sensing pixel included in one unit pixel UPX may include an exposure period different from an exposure period of an adjacent sensing pixel. For example, for a first unit pixel UPX1, a pixel adjacent to a second sensing pixel M located at the center is a first sensing pixel L or a third sensing pixel S.
[0063] refer to Figure 5D , the unit pixel group UPXG may include first to fourth unit pixels UPX1 to UPX4 having different exposure time period patterns. Each of the first to fourth unit pixels UPX1 to UPX4 may include: a first sensing pixel group SPXG1 including a third sensing pixel S, a second sensing pixel group SPXG2 including a second sensing pixel M, and a third sensing pixel group SPXG3 including a first sensing pixel L. In addition, the first to fourth unit pixels UPX1 to UPX4 may include a plurality of sensing pixels SPX in each column, wherein the sensing pixels SPX may have the same exposure time period.
[0064] Fig. 6A is a circuit diagram of a sensing pixel group including a plurality of sensing pixels according to an embodiment. Figure 6B is applied to Fig. 6A The signals of the sensing pixel group are shown in waveform form.
[0065] refer to Fig. 6A, the sensing pixel group SPXG may include a plurality of sensing pixels SPX1 to SPX3 adjacent along the column direction. The sensing pixel SPX may include a light sensing device PD, and the row driver 140 may control the operation of the transfer transistor TX under the control of the timing controller 120. The transfer transistor TX may be turned on to output the photocharge accumulated by the light sensing device PD.
[0066] For example, the first sensing pixel SPX1 may include a first light sensing device PD11. The first sensing pixel SPX1 may also include a first transfer transistor TX1 that controls the output of the photocharge accumulated by the first light sensing device PD11. The row driver 140 may apply a first transfer signal TG1 to the first transfer transistor TX1 based on the timing control signal TC transmitted from the timing controller 120. For example, the timing controller 120 may apply a first transfer signal TG1 that indicates that the transfer transistor TX1 is turned on. Therefore, the first light sensing device PD11 may output the photocharge to the floating diffusion node FD. Similarly, the timing controller 120 may control the row driver 140 to control the second transfer transistor TX2 and the third transfer transistor TX3 to output the photocharges charged by the second light sensing device PD12 and the third light sensing device PD13 to the same floating diffusion node FD, respectively.
[0067] The timing controller 120 may turn on the selection transistor SX to output the photocharge charged in the floating diffusion node FD as a pixel signal SIG_PX to the reading circuit 150. For example, the timing controller 120 may transmit a timing control signal TC to the row driver 140 to transmit a selection signal SEL indicating conduction. Therefore, the selection transistor SX connected to the column line COL may be turned on. The photocharge accumulated in the floating diffusion node FD may be amplified by the driving voltage VDD applied to the driving transistor DX and may be converted into the pixel signal SIG_PX. That is, the photocharge accumulated in the floating diffusion node FD may be converted into the pixel signal SIG_PX and may be output to the reading circuit 150 via the selection transistor SX.
[0068] refer to Figure 6B , based on the photo charges obtained during each of the first exposure period T1, the second exposure period T2, and the third exposure period T3, the first to third sensing pixels SPX1 to SPX3 may output pixel signals SIG_PX at different time points T4 to T6.
[0069] At the time point Ta, the timing controller 120 may transmit a logic high reset signal RS to the reset transistor RX to reset the floating diffusion node FD. In this case, the reset transistor RX is turned on, and a voltage having the same level as that of the driving voltage VDD may be applied to the floating diffusion node FD.
[0070] At time point Tb, the timing controller 120 may reset the logic high first transmission signal TG1 to the gate electrode of the first transmission transistor TX1. Therefore, the first light sensing device PD11 may completely discharge the light charges charged by the first light sensing device PD11 to the floating diffusion node FD, and the first light sensing device PD11 may be in a reset state.
[0071] In the time period T1, the first light sensing device PD11 can obtain light charges. That is, the first sensing pixel SPX1 can have an exposure time period as long as the time period T1. Similarly, the second sensing pixel SPX2 can have an exposure time period as long as the time period T2, and the third sensing pixel SPX3 can have an exposure time period as long as the time period T3.
[0072] According to an embodiment, the photocharges output from the first photo-sensing device PD11, the second photo-sensing device PD12, and the third photo-sensing device PD13 may be transmitted to the floating diffusion node FD at different time points (e.g., time point T4, time point T5, and time point T6), respectively. Next, the first sensing pixel SPX1 to the third sensing pixel SPX3 may sequentially output the pixel signal SIG_PX according to the order in which the floating diffusion node FD receives the photocharges. The sequentially output pixel signal SIG_PX may be used for the analog merging operation to be described below.
[0073] In the time period T4, the timing controller 120 may output the first transfer signal TG1 and the selection signal SEL as logic high signals, respectively, and may output the reset signal as a logic low signal. In response thereto, the photocharge charged by the first light sensing device PD11 included in the first sensing pixel SPX1 in the time period T1 may be transferred to the floating diffusion node FD, converted into the pixel signal SIG_PX, and may be output. Similarly, the second sensing pixel SPX2 may charge the photocharge in the time period T2, and in the time period T5, the second sensing pixel SPX2 may transfer the photocharge to the floating diffusion node FD, convert the photocharge into the pixel signal SIG_PX, and output the pixel signal SIG_PX. The third sensing pixel SPX3 may charge the photocharge in the time period T3. In the time period T6, the third sensing pixel SPX3 may transfer the photocharge to the floating diffusion node FD, convert the photocharge into the pixel signal SIG_PX, and output the pixel signal SIG_PX.
[0074] refer to Figure 6B, the timing controller 120 may receive the operation mode information INFO_MD indicating the general shooting mode, and may control the first sensing pixel SPX1, the second sensing pixel SPX2, and the third sensing pixel SPX3 to have the same exposure period. In other words, the timing controller 120 may control the row driver so that the transmission signals TG output in the time period T1, the time period T2, and the time period T3 are substantially the same as each other.
[0075] refer to Figure 6B , the timing controller 120 may receive the operation mode information INFO_MD indicating the HDR shooting mode, and may control the first sensing pixel SPX1, the second sensing pixel SPX2, and the third sensing pixel SPX3 to have different exposure time periods. In other words, the timing controller 120 may control the row driver so that the transmission signals TG output in the time periods T1, T2, and T3 are different from each other.
[0076] Reference Figure 5A , Fig. 6A and Figure 6B Describe the operation of the sensing pixel in the HDR shooting mode. The second sensing pixel group SPXG2 may include a first sensing pixel L having an exposure period as long as the first period, a second sensing pixel M having an exposure period as long as the second period, and a third sensing pixel S having an exposure period as long as the third period. The first period may be longer than the second period, and the second period may be longer than the third period. In this case, Figure 5A The first sensing pixel L, the second sensing pixel M and the third sensing pixel S shown can be respectively Fig. 6A The first sensing pixel SPX1, the second sensing pixel SPX2 and the third sensing pixel SPX3 shown correspond to each other. That is, the first sensing pixel L with the longest exposure period can obtain photocharge for period T1, and the third sensing pixel S with the shortest exposure period can obtain photocharge for period T3.
[0077] refer to Figure 6B , the first sensing pixel SPX1, the second sensing pixel SPX2, and the third sensing pixel SPX3 can output the photocharges respectively obtained in the photo-sensing device PD at different time points. For example, in the time period T4, the first sensing pixel SPX1 can transfer the photocharges from the first photo-sensing device PD11 to the floating diffusion node FD, convert the photocharges into the pixel signal SIG_PX, and output the pixel signal SIG_PX through the column line COL. Similarly, the second sensing pixel SPX2 can output the pixel signal SIG_PX in the time period T5, and the third sensing pixel SPX3 can output the pixel signal SIG_PX in the time period T6.
[0078] Figure 7 is a flowchart of an operating method of the image sensor 100 according to an embodiment.
[0079] In step S310, a pixel signal SIG_PX may be received from the pixel array 110 (S310). For example, the pixel array 110 may include a plurality of sensing pixels SPX, and at least some of the sensing pixels SPX may share a floating diffusion node FD.
[0080] In step S320, various image processing may be performed according to the shooting mode of the pixel signal SIG_PX. The timing controller 120 may control the image sensor 100 based on the operation mode information INFO_MD indicating the general shooting mode or the HDR shooting mode. For example, in the general shooting mode, the image sensor 100 may perform a merging operation including at least one of an analog merging operation and a digital merging operation based on the pixel signal SIG_PX. As another example, in the HDR shooting mode, the image sensor 100 may perform at least one of a reconstruction operation and a DRC operation based on the pixel signal SIG_PX. In other words, the pixel signals sequentially output from the shared floating diffusion node may be used individually (general shooting mode) or synthesized (HDR shooting mode).
[0081] In step S330, when the image sensor 100 is in the general photographing mode, the image sensor 100 may determine whether to perform a binning operation. For example, the timing controller 120 may transmit a control signal RC including information on whether to perform a binning operation to the reading circuit 150.
[0082] In step S340, the image sensor 100 may perform a merging operation. For example, the image sensor 100 may perform an analog merging operation. The image sensor 100 may merge pixel signals SIG_PX sequentially output from sensing pixels SPX sharing the same floating diffusion node FD. In this case, since the electrical signals output from the sensing pixels SPX may be added together, a bright image may be acquired at low light levels. As another example, the image sensor 100 may perform a digital merging operation. In this case, the image sensor 100 may perform a digital merging operation based on the analog merged data.
[0083] At step S350, the image sensor 100 may perform a pixel remosaic operation. For example, the pixel remosaic operation may be an operation of rearranging the order of data obtained from each sensing pixel SPX with respect to the pixel data PDTA quantized by the reading circuit 150. By doing so, an image having a resolution corresponding to the number of sensing pixels SPX may be obtained.
[0084] In steps S360 and S370 , in the HDR photographing mode, the image sensor 100 may perform a reconstruction operation and perform a DRC operation on the data on which the reconstruction operation is performed.
[0085] Figure 8 The reading circuit 150 may include a binning determiner 151 , a correlated double sampler (CDS) 152 , an analog-digital converter (ADC) 153 , and a buffer 154 .
[0086] The merger determiner 151 may receive the pixel signal SIG_PX output from the pixel array 110 and may receive, for example, the pixel signal SIG_PX output from the plurality of sensing pixels SPX. According to an embodiment, in a general photographing mode, the timing controller 120 may control the merger determiner 151 to perform an analog merger operation.
[0087] Fig. 9 FIG. 2 shows an image processing operation in a general shooting mode according to an embodiment. Fig. 9 , the merge determiner 151 may perform an analog merge operation 21 on the pixel signal to output analog merged data 22. The merge determiner 151 may merge pixel signals SIG_PX obtained from a plurality of sensing pixels SPX included in the unit pixel UPX. For example, the merge determiner 151 may perform an analog merge operation on the pixel signal SIG_PX obtained from the plurality of sensing pixels SPX that share a floating diffusion node FD. In other words, merging may be performed on the pixel signal SIG_PX obtained from the sensing pixels SPX that are arranged in the same column included in the unit pixel UPX. As another example, the merge determiner 151 may perform an analog merge operation on the pixel signal SIG_PX obtained from the plurality of sensing pixels SPX that share a floating diffusion node FD and are arranged in the same column of the pixel array 110 (see Fig. 6A ), the second sensing pixel SPX2 (see Fig. 6A ) and the third sensing pixel SPX3 (see Fig. 6A ) performs merging of the pixel signals SIG_PX output sequentially.
[0088] Reference Figure 8, the correlated double sampler 152 may sample and save the merged data. The correlated double sampler 152 may perform double sampling on a certain noise level and a level according to the generated output voltage, and may output a level corresponding to the gap therebetween. In addition, the correlated double sampler 152 may receive a light signal generated by a light signal generator, compare the light signals, and output a result of the comparison. The analog-to-digital converter 153 may convert an analog signal corresponding to the level of the output received from the correlated double sampler 152 into a digital signal. The buffer 154 may latch the digital signal, and the latched signal may be sequentially output to the image signal processor 130 or the outside of the image sensor 100 (e.g., the processor 1200).
[0089] The image signal processor 130 may receive the pixel data PDTA and perform a digital merging operation. Figure 8 and Fig. 9 , the image signal processor 130 may receive the pixel data PDTA 22 to which analog merging is performed, and output the digitally merged data 23. For example, the image signal processor 130 may merge a plurality of pieces of data included in each of the unit pixels UPX into one piece of data. As another example, the image signal processor 130 may receive the analog-merged data in the row direction, and may perform digital merging in the column direction. In this case, the image signal processor 130 may output data 23 having a resolution divided from a resolution according to the number of pixels arranged in the pixel array 110 to match the number of sensing pixels included in the unit pixel UPX.
[0090] refer to Figure 8 and Fig. 9 , the image signal processor 130 may perform a pixel rearrangement operation. The image signal processor 130 may rearrange the plurality of pieces of pixel data PDTA acquired from the sensing pixel SPX to match the Bayer pattern. In this case, the timing controller 120 may control the merging determiner 151 not to perform the analog merging operation. The image signal processor 130 may perform a pixel rearrangement operation on the pixel data PDTA from the reading circuit 150 to output data 24 having the same resolution as the resolution according to the number of pixels arranged in the pixel array 110. That is, when the pixel rearrangement operation is performed, the image sensor 100 may output a high-resolution image.
[0091] Fig.10 FIG. 1 is a flowchart of an image processing operation in an HDR shooting mode according to an embodiment. Fig.10, the timing controller 120 may control the read circuit 150 to output the pixel data PDTA based on the pixel signal SIG_PX. For example, in the HDR shooting mode, the timing controller 120 may control the merge determiner 151 not to perform the analog merge operation. That is, the merge determiner 151 may output the pixel signal SIG_PX received from the pixel array 110 to the correlated double sampler 152. Figure 8 and Fig. 9 The subsequent operation of the read circuit 150 is described, and thus the description will not be repeated.
[0092] The timing controller 120 may control the image signal processor 130 to perform a reconstruction operation and a dynamic range compression (DRC) operation. The reconstructor 131 may receive the pixel data PDTA, reconstruct a plurality of pieces of data acquired from the sensing pixel SPX, and synthesize the plurality of pieces of data. In other words, the reconstructor 131 may receive a plurality of pieces of data having different exposure time periods, and output image data in which the dynamic range is increased. The DRC unit 132 may perform a compression operation on the image data received from the reconstructor 131 without losing the dynamic range. By using the compression function performed by the DRC unit 132, a general purpose processor (e.g., the processor 1200) may be used for image post-processing operations.
[0093] Fig.11 FIG. 2 shows an image processing operation in an HDR shooting mode according to an embodiment. Fig.11 , the image signal processor 130 can obtain image data 26 without losing resolution and dynamic range by performing a reconstruction operation and a DRC operation on the pixel data 25 output from the reading circuit 150. The image signal processor 130 can obtain image data 26 with an improved dynamic range by reconstructing the pixel data 25 having various exposure time periods. In addition, by performing the DRC operation, the dynamic range loss of the image data 26 and the image data 26 can be output to an external area of the image sensor (e.g., the processor 1200).
[0094] According to an embodiment, the image data 26 may be acquired based on a plurality of pixel data 25 collected on the basis of different exposure time periods. For example, referring to the plurality of pixel data 25, the plurality of pixel data 25 may include a plurality of pixel data set to have a long exposure time period L, a medium exposure time period M, and a short exposure time period S.
[0095] According to an embodiment, the resolution of the image data 26 may be lower than the resolution of the pixel data 25. For example, the image signal processor 130 may perform a reconstruction operation to reconstruct nine identically colored pixels among the plurality of pieces of pixel data 25 into a single image pixel.
[0096] At the same time, the image signal processor 130 performs and refers to Figures 7 to 10 The described operations may also be performed by the processor 1200. For example, digital binning operations, pixel rearrangement operations, reconstruction operations, and DRC operations may be alternatively performed in a general-purpose image processor (eg, the processor 1200), or may be performed together by a general-purpose image processor.
[0097] Fig.12 FIG. 1 is a cross-sectional view of the structure of a phase detection pixel group PPXG according to an embodiment. Fig.12 , the phase detection pixel group PPXG may include a plurality of phase detection pixels PPX. Fig.12 For ease of explanation, the phase detection pixel group PPXG includes two phase detection pixels PPX1 and PPX2. FIG. 13A to FIG. 13D As described, the phase detection pixel group PPXG may include various numbers of phase detection pixels PPX.
[0098] refer to Fig.12 , each of the phase detection pixels PPX may include a light sensing device PD. In addition, when light is incident on the phase detection pixel PPX from the microlens ML, light in a certain wavelength band may be incident on the light sensing device PD through the color filter CF. The light sensing device PD may output an electrical signal according to the incident light. For example, the light sensing device PD may transmit an electrical signal to a transmission transistor (e.g., Fig. 6A The transmission transistor TX1) shown outputs an electrical signal.
[0099] According to example embodiments, the plurality of phase detection pixels PPX may share one microlens ML. For example, a first light sensing device PD1 included in a first phase detection pixel PPX1 and a second light sensing device PD2 included in a second phase detection pixel PPX2 may receive light from the microlens ML. In other words, the first phase detection pixel PPX1 and the second phase detection pixel PPX2 may be adjacent to each other, and the microlens ML may cover the first phase detection pixel PPX1 and the second phase detection pixel PPX2.
[0100] According to example embodiments, the phase detection pixels PPX sharing the microlens ML may include color filters CF having the same color, respectively. For example, the color filters CF may have red, blue, green, or any suitable wavelength. The substrate SB may be included in the peripheral region of the light sensing device PD.
[0101] According to example embodiments, the phase detection pixels PPX sharing the microlens ML may have the same exposure period. When performing the PDAF operation, other parameters except the phase difference are similar or substantially the same as each other.
[0102] FIG. 13A to FIG. 13Dis a diagram of a phase detection pixel group and a microlens according to an embodiment, wherein a plurality of phase detection pixels are included in the phase detection pixel group. FIG. 13A to FIG. 13D , the pixel array 110 may include a plurality of unit pixel groups UPXG, and the unit pixel group UPXG may include a plurality of unit pixels UPX. For example, the unit pixel UPX may include at least one of a sensing pixel SPX and a phase detection pixel PPX. As another example, the unit pixel group UPXG may be formed such that the plurality of unit pixels UPX form a Bayer pattern.
[0103] In addition, the microlens ML covers at least a portion of the unit pixel group UPXG, and a plurality of unit pixels UPX including the microlens ML may be adjacent to each other. For example, a first unit pixel UPXa and a second unit pixel UPXb including the microlens ML may be arranged adjacent to each other. Since the first unit pixel UPXa and the second unit pixel UPXb having different color filters, respectively, include the phase detection pixel PPX, the loss of the pixel signal SIG_PX of a certain color may be reduced.
[0104] The sensing pixels SPX included in the unit pixel group UPXG may have the same FIG. 5A to FIG. 5D The various exposure time periods described in the above descriptions may be different. The plurality of phase detection pixels PPX included in the phase detection pixel group PPXG may have the same exposure time period.
[0105] refer to Fig.13A The microlens ML covers the phase detection pixel group PPXG including the first phase detection pixel PPX1 and the second phase detection pixel PPX2. The first phase detection pixel PPX1 and the second phase detection pixel PPX2 may be included in the first unit pixel UPXa and the second unit pixel UPXb, respectively.
[0106] In other words, the first and second unit pixels UPXa and UPXb may respectively include first and second phase detection pixels PPX1 and PPX2 included in the phase detection pixel group PPXG, and the microlens ML may cover the first and second phase detection pixels PPX1 and PPX2.
[0107] According to example embodiments, the phase detection pixels PPX included in the phase detection pixel group PPXG may include color filters having the same color. Fig.13A The color filter used for the phase detection pixel PPX is shown as green, but any other suitable color filter may be used.
[0108] According to example embodiments, the phase detection pixels PPX included in the phase detection pixel group PPXG may have the same exposure period. For example, the exposure period may include the above reference period. Figure 5A The first time period described above, and accurate phase data can be obtained by exposing for a long time period. In an embodiment, the phase detection pixel can have various exposure time periods (e.g., Figure 5A the second time period or the third time period described).
[0109] According to example embodiments, at least a portion of one unit pixel (eg, UPXa) and at least a portion of another unit pixel (eg, UPXb) may include a single micro lens ML.
[0110] refer to Fig. 13B , the microlens ML covers the phase detection pixel group PPXG including four phase detection pixels PPX1, PPX2, PPX3 and PPX4. In other words, the microlens ML may cover the first phase detection pixel PPX1 to the fourth phase detection pixel PPX4. The phase detection pixel PPX may be included in the first unit pixel UPXa and the second unit pixel UPXb, respectively. In this case, the phase detection pixels PPX included in the pixel detection pixel group PPXG may have the same color filter and the same exposure time period.
[0111] refer to Fig. 13C , the microlens ML may be formed to cover the phase detection pixel group PPXG including six phase detection pixels PPX1, PPX2, PPX3, PPX4, PPX5, and PPX6. That is, the microlens ML may cover the first phase detection pixel PPX1 to the sixth phase detection pixel PPX6. The phase detection pixel PPX may be included in the first unit pixel UPXa and the second unit pixel UPXb, respectively. The description of the color filter and the exposure period is the same as above.
[0112] refer to FIG. 13A to FIG. 13C , the phase detection pixel group PPXG may be included in some unit pixels (eg, the first unit pixel UPXa and the second unit pixel UPXb), but referring to Fig.13D , the phase detection pixel group PPXG may be included in all unit pixels (eg, UPXa to UPXd).
[0113] refer to Fig.13D , the microlens ML covers the phase detection pixel group PPXG including four phase detection pixels PPX5, PPX6, PPX7 and PPX8. That is, the microlens ML can cover the fifth phase detection pixel PPX5 to the eighth phase detection pixel PPX8. In this case, the phase detection pixel group PPXG can occupy a portion of each of the unit pixels UPXa to UPXd.
[0114] Fig.14An image processing system 2000 according to an embodiment is shown. Fig.14 The image processing system 2000 shown may include computer systems, camera systems, scanners, vehicle navigation systems, video phones, security systems, motion detection systems that require image data. Fig.14 , the image processing system 2000 may include a central processing unit (CPU) or processor 2010, a non-volatile memory 2020, an imaging device 2030 including an image sensor, an input / output (I / O) device 2040, and a random access memory (RAM) 2050. The CPU 2010 may communicate with the non-volatile memory 2020, the imaging device 2030, the input / output (I / O) device 2040, and the RAM 2050 via a bus 2060.
[0115] Included Fig.14 The imaging device 2030 in the image processing system 2000 may include the above-mentioned image sensor according to the embodiment. The image data output from the imaging device 2030 may be transmitted to the CPU 2010, the nonvolatile memory 2020, the input / output (I / O) device 2040, and the RAM 2050 via the bus 2060. For example, the image sensor included in the imaging device 2030 may include sensing pixels sharing a floating diffusion node, and may also include phase detection pixels sharing a microlens. An image may be acquired by using the sensing pixels, or an autofocus function may be performed by using the phase detection pixels.
[0116] An embodiment provides a lightweight image sensor for improving low-light characteristics by summing a plurality of pieces of pixel data, obtaining a high-resolution image by using information of light received in each pixel, and performing a high dynamic range (HDR) operation and a phase detection auto focus (PDAF) operation.
[0117] In an image sensor according to an example embodiment, low brightness characteristics can be improved by summing information of a plurality of sensing pixels. In addition, a high-resolution image can be acquired by a pixel rearrangement operation. In addition, in a unit pixel having a plurality of sensing pixels, an HDR operation can be performed by changing the exposure time period of the plurality of sensing pixels. In addition, by appropriately adopting the shape of a microlens, a phase detection pixel can be included in the unit pixel, and a PDAF operation can be performed.
[0118] Example embodiments have been disclosed herein, and although specific terms are employed, they are used and interpreted in a general and descriptive sense only and not for purposes of limitation. In some instances, it will be clear to those of ordinary skill in the art at the time of filing this application that, unless otherwise expressly indicated, features, characteristics, and / or elements described in conjunction with a specific embodiment may be used alone or in combination with features, characteristics, and / or elements described in conjunction with other embodiments. Therefore, it will be understood by those skilled in the art that various changes in form and detail may be made without departing from the spirit and scope of the invention as set forth in the appended claims.
Claims
1. An image sensor comprising a pixel array, wherein the pixel array comprises: The first unit pixel has first sensing pixels adjacent to each other in a column direction and second sensing pixels adjacent to each other in a column direction, and the first sensing pixels and the second sensing pixels are adjacent to each other in a row direction; as well as The same color filter overlaps the first sensing pixel and the second sensing pixel, wherein The first sensing pixel shares the first floating diffusion node, The second sensing pixel shares the second floating diffusion node, and The first floating diffusion node is shared only by the first sensing pixel, and the second floating diffusion node is shared only by the second sensing pixel.
2. The image sensor of claim 1, wherein: Each of the first sensing pixel and the second sensing pixel includes a first light sensing device, a second light sensing device, and a third light sensing device, and Photo charges output from the first, second, and third photo-sensing devices are transferred to the first floating diffusion node or the second floating diffusion node at different times.
3. The image sensor according to claim 2, wherein: The first light sensing device, the second light sensing device, and the third light sensing device have different exposure time periods.
4. The image sensor of claim 3, further comprising a timing controller, wherein At a first time point, the timing controller transmits a signal for turning on a first transmission transistor connected to a first light sensing device, At a second time point after the first time point, the timing controller transmits a signal for turning on a second transmission transistor connected to the second light sensing device, and At a third time point after the second time point, the timing controller transmits a signal for turning on a third transmission transistor connected to the third light sensing device.
5. The image sensor according to claim 1, wherein: The first sensing pixel and the second sensing pixel respectively include a light sensing device, which sequentially outputs photocharges to the first floating diffusion node and the second floating diffusion node, and sequentially outputs pixel signals according to the order in which the photocharges are received by the first floating diffusion node and the second floating diffusion node.
6. The image sensor according to claim 5, further comprising a readout circuit for performing an analog binning operation on the sequentially output pixel signals.
7. The image sensor of claim 1, wherein: The pixel array further includes a plurality of phase detection pixels, each phase detection pixel having a color filter having a same color, and A single microlens is used for the plurality of phase detection pixels.
8. The image sensor of claim 7 , further comprising a second unit pixel, the second unit pixel comprising a third sensing pixel having a color filter different from the color filter of the first sensing pixel, the second unit pixel comprising some of the plurality of phase detection pixels, and The first unit pixel also includes the remaining portion of the plurality of phase detection pixels.
9. The image sensor of claim 8, wherein: The first unit pixel includes a first phase detection pixel, The second unit pixel includes a second phase detection pixel adjacent to the first phase detection pixel, and The single microlens covers the first phase detection pixel and the second phase detection pixel.
10. The image sensor of claim 7, wherein: The first sensing pixels respectively have different exposure time periods, The second sensing pixels respectively have different exposure time periods, and The plurality of phase detection pixels have the same exposure period.
11. An image sensor, comprising: A pixel array outputting a pixel signal, the pixel array comprising a plurality of sensing pixels and a plurality of phase detection pixels; a timing controller configured to output a control signal based on operation mode information indicating a general shooting mode or a high dynamic range (HDR) shooting mode; as well as a reading circuit configured to output pixel data based on the control signal and the pixel signal, Some of the plurality of sensing pixels share a first floating diffusion node and output the pixel signal through a column line, and other sensing pixels of the plurality of sensing pixels share a second floating diffusion node, and Wherein the first floating diffusion node is shared only by some of the multiple sensing pixels, the second floating diffusion node is shared only by some other of the multiple sensing pixels, the some of the multiple sensing pixels are adjacent to each other in the column direction, the some of the multiple sensing pixels are adjacent to each other in the column direction, the some of the multiple sensing pixels and the some other of the multiple sensing pixels are adjacent to each other in the row direction and correspond to the same color.
12. The image sensor according to claim 11, wherein: When operating in a general photographing mode, the timing controller controls the reading circuit to perform an analog binning operation on pixel signals received from some of the plurality of sensing pixels.
13. The image sensor of claim 12, wherein: Some of the plurality of sensing pixels include a first sensing pixel, a second sensing pixel, and a third sensing pixel arranged in the same column of the pixel array, and The read circuit performs integration on pixel signals sequentially output from each of the first sensing pixel, the second sensing pixel, and the third sensing pixel. 14 . The image sensor of claim 12 , further comprising an image signal processor, wherein the timing controller controls the image signal processor to perform a digital binning operation on pixel signals having the same color and on which the analog binning operation is performed.
15. The image sensor of claim 12, further comprising an image signal processor, wherein: The timing controller controls the image signal processor to perform a pixel rearrangement operation using pixel signals output from the plurality of sensing pixels to output image data having the same number of pixels as the number of pixels in the image sensor, and The pixel rearrangement operation rearranges pixel signals respectively output from the plurality of sensing pixels.
16. The image sensor according to claim 11, wherein: When operating in an HDR photographing mode, the timing controller controls some of the plurality of sensing pixels to have different exposure time periods.
17. The image sensor of claim 16, further comprising an image signal processor, wherein the timing controller controls the image signal processor to reconstruct the pixel data based on some of the plurality of sensing pixels having different exposure time periods, compress the reconstructed pixel data, and output the reconstructed and compressed pixel data.
18. The image sensor of claim 11, wherein: The pixel array includes a phase detection pixel group having a single microlens, The phase detection pixel group includes at least some of the plurality of phase detection pixels, and When operating in an HDR photographing mode, the timing controller controls some of the plurality of phase detection pixels included in the phase detection pixel group to all have the same exposure period.
19. A method for operating an image sensor, the method comprising: The plurality of sensing pixels sequentially output pixel signals through a shared floating diffusion node; receiving operation mode information indicating a general shooting mode or a high dynamic range (HDR) shooting mode; When operating in a general shooting mode, performing an analog binning operation on the pixel signal; as well as When operating in an HDR shooting mode, performing at least one of a reconstruction operation and a dynamic range compression (DRC) operation on the pixel signal, wherein some of the plurality of sensing pixels share the shared floating diffusion node, and other some of the plurality of sensing pixels share another floating diffusion node, and Wherein the shared floating diffusion node is shared only by some of the multiple sensing pixels, the other floating diffusion node is shared only by some of the other sensing pixels among the multiple sensing pixels, the some of the multiple sensing pixels are adjacent to each other in the column direction, the other of the multiple sensing pixels are adjacent to each other in the column direction, the some of the multiple sensing pixels and the other of the multiple sensing pixels are adjacent to each other in the row direction and correspond to the same color.
20. The operating method according to claim 19, wherein: The plurality of sensing pixels include light sensing devices, The pixel signals on which the analog binning operation is performed are output from the light sensing devices having the same exposure period, and Pixel signals on which at least one of the reconstruction operation and the DRC operation is performed are output from the light sensing device with different exposure time periods.
Citation Information
Patent Citations
Method for Operating Virtual Account based on Real Identity
KR1020190033727A
Image sensor with sensing transistor having two gates and method of operating the same
CN101556962A
Method for capturing image data, HDR imaging system for use and pixel
CN104780321A
Imaging systems having image sensor pixel arrays with phase detection capabilities
US20160286108A1
Imaging systems with high dynamic range and phase detection pixels
US20170339353A1