Image sensor

By combining phase detection pixels and dynamic vision sensor pixels in the image sensor, and through the multi-layer semiconductor die design, the problems of large data volume and high processing complexity in the prior art are solved, and efficient image signal processing and automatic focus are achieved Function.

CN119071664APending Publication Date: 2024-12-03SAMSUNG ELECTRONICS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202311602504.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-30
Filing Date
2023-11-28
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

When existing image sensors process phase detection autofocus and dynamic vision sensor event signals, there are problems such as large data volume and high processing complexity. Especially when combining CMOS image sensors and dynamic vision sensors, the image signal processor has been added. burden.

Method used

Design an image sensor, including phase detection pixels and dynamic vision sensor pixels, by stacking multiple semiconductor dies, using different dies to set phase detection and event detection circuits, adopt pad connection structure and logic circuits to optimize signal processing, Reduce data volume and processing complexity.

Benefits of technology

In phase detection automatic focus and dynamic vision sensor event signal processing, the burden on the image signal processor is reduced, the efficiency and processing capabilities of the image sensor are improved, and the size and performance of the image sensor are optimized.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071664A_ABST
    Figure CN119071664A_ABST
Patent Text Reader

Abstract

An embodiment of the present disclosure provides an image sensor including: a first die including a pixel array region in which a first photoelectric conversion device and a second photoelectric conversion device that generate respective charges corresponding to incident light are disposed; and a second die including a first pixel circuit that receives the charge from the first photoelectric conversion device and generates a phase signal of the incident light based on the charge received from the first photoelectric conversion device, and a second pixel circuit that generates a phase signal of the incident light based on the phase signal. The second pixel circuit receives the charge from the second photoelectric conversion device and generates an event signal corresponding to the incident light based on the charge received from the second photoelectric conversion device.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to and the benefit of Korean Patent Application No. 10-2023-0069425 filed in the Korean Intellectual Property Office on May 30, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to an image sensor. Background Art

[0004] Typical examples of image sensors are complementary metal oxide semiconductor (CMOS) image sensors and dynamic vision sensors (DVS). CMOS image sensors have the advantage of providing captured images to users as they are, but have the disadvantage of having to process a large amount of data. When an event (e.g., a change in light intensity) occurs, the dynamic vision sensor generates information about the event (i.e., an event signal) and sends the event signal to a processor, so the amount of data to be processed is small. When the event signal of the dynamic vision sensor is interlocked with the CMOS image sensor, various functions such as deblurring or ultra-slow can be supported.

[0005] In addition, when the CMOS image sensor and the dynamic vision sensor are implemented as one image sensor, the signal output from the CMOS image sensor and / or the dynamic vision sensor may be sent to and processed by an image signal processor (ISP). In this case, the image signal processor may perform processing such as bad pixel correction (BPC) on the signal output from the DVS pixel of the dynamic vision sensor.

[0006] On the other hand, the CMOS image sensor may provide a phase detection auto focus (PDAF) function for focusing on a subject when photographing the subject, and phase detection pixels required to perform phase detection auto focus (PDAF) may be discontinuously or regularly arranged within a pixel array. Summary of the invention

[0007] The present disclosure is to provide an image sensor including phase detection pixels capable of detecting a phase difference of an object and dynamic vision sensor pixels capable of detecting an event.

[0008] The present disclosure is to provide an image sensor including a semiconductor die in which a plurality of layers are stacked.

[0009] An embodiment of the present disclosure provides an image sensor, comprising: a first bare chip, which includes a pixel array area, in which a first photoelectric conversion device and a second photoelectric conversion device configured to generate corresponding charges corresponding to incident light are arranged; and a second bare chip, which includes a first pixel circuit and a second pixel circuit, the first pixel circuit being configured to receive charges from the first photoelectric conversion device and generate a phase signal of the incident light based on the charges received from the first photoelectric conversion device, and the second pixel circuit being configured to receive charges from the second photoelectric conversion device and generate an event signal corresponding to the incident light based on the charges received from the second photoelectric conversion device.

[0010] The image sensor may also include a third die, the third die including a first logic circuit configured to receive a phase signal from the first pixel circuit, a second logic circuit configured to receive an event signal from the second pixel circuit, and an image signal processor (ISP) configured to receive data output from the first logic circuit and the second logic circuit.

[0011] The image sensor may also include a first pad arranged on the first die to be separated from the pixel array area, a second pad arranged on the second die to be separated from the first pixel circuit and the second pixel circuit, and a third pad arranged on the third die to be separated from the first logic circuit, the second logic circuit and the image signal processor.

[0012] The first pad may be electrically connected to the second pad, and the second pad may be electrically connected to the third pad.

[0013] A third photoelectric conversion device configured to generate charges corresponding to incident light and a third pixel circuit configured to receive the charges from the third photoelectric conversion device to generate an output voltage may also be provided in the pixel array region.

[0014] The third pixel circuit may be connected to the first pad through a metal layer on the first die.

[0015] The number of the first photoelectric conversion devices and the second photoelectric conversion devices relative to the number of the third photoelectric conversion devices in the pixel array area may satisfy a predetermined ratio.

[0016] The image sensor may also include a first connection structure and a second connection structure, the first connection structure is configured to connect the first photoelectric conversion device and the first pixel circuit and is arranged in an area where the pixel array area and the first pixel circuit overlap, and the second connection structure is configured to connect the second photoelectric conversion device and the second pixel circuit and is arranged in an area where the pixel array area and the second pixel circuit overlap.

[0017] The image sensor may further include a first switch and a second switch, wherein one end of the first switch is electrically connected to the second connection structure and the other end is electrically connected to the second pixel circuit, and one end of the second switch is electrically connected between the first connection structure and the first pixel circuit and the other end is electrically connected to one end of the first switch.

[0018] The first switch and the second switch may be disposed on the second die.

[0019] The first connection structure and the second connection structure may be at least one of a wire, a conductive line, a solder ball, a bump, and a through silicon via (TSV).

[0020] The first photoelectric conversion device and the second photoelectric conversion device may be disposed adjacent to each other, and may further include a micro lens disposed on the first photoelectric conversion device and the second photoelectric conversion device.

[0021] The image sensor may further include a mask layer disposed on the first photoelectric conversion device, and the first side or the second side of the first photoelectric conversion device is shielded.

[0022] Another embodiment of the present disclosure provides an image sensor, comprising: a phase detection pixel, which includes a first photoelectric conversion device configured to generate charges corresponding to incident light, and a first pixel circuit configured to generate an output voltage corresponding to the charges received from the first photoelectric conversion device and a phase signal of the incident light; and a dynamic vision sensor (DVS) pixel, which includes a second photoelectric conversion device and a second pixel circuit, the second photoelectric conversion device is configured to generate charges corresponding to the incident light, and the second pixel circuit is configured to generate an event signal by detecting changes in the intensity of the incident light based on the charges received from the second photoelectric conversion device.

[0023] The image sensor may also include a first logic circuit configured to receive a phase signal from the first pixel circuit, a second logic circuit configured to receive an event signal from the second pixel circuit, and an image signal processor (ISP) configured to receive data output from the first logic circuit and the second logic circuit.

[0024] The image signal processor can generate signals to control a first mode, a second mode and a third mode. In the first mode, the first photoelectric conversion device is connected to the first pixel circuit and the second photoelectric conversion device is connected to the second pixel circuit. In the second mode, the first photoelectric conversion device is connected to the second pixel circuit. In the third mode, the second photoelectric conversion device is connected to the first pixel circuit.

[0025] The image sensor may include a first switch and a second switch, the first switch is arranged between the second photoelectric conversion device and the second pixel circuit, and includes one end electrically connected to the second photoelectric conversion device and the other end electrically connected to the second pixel circuit, the second switch includes one end electrically connected between the first photoelectric conversion device and the first pixel circuit and the other end electrically connected to one end of the first switch, wherein the image signal processor can turn on the first switch and turn off the second switch in a first mode, the image signal processor can turn on the first switch and turn on the second switch in a second mode, and the image signal processor can turn off the first switch and turn on the second switch in a third mode.

[0026] The first photoelectric conversion device and the second photoelectric conversion device may be disposed on a semiconductor die different from a semiconductor die on which the first pixel circuit and the second pixel circuit are disposed.

[0027] The first pixel circuit and the second pixel circuit may be provided on the same semiconductor chip.

[0028] Another embodiment of the present disclosure provides an image sensor, comprising: a first semiconductor die, which includes a first photoelectric conversion device and a second photoelectric conversion device configured to convert an optical signal into an electrical signal; and a second semiconductor die, which includes a first pixel circuit and a second pixel circuit, the first pixel circuit includes a first transistor, a second transistor and a third transistor, the first transistor is configured to transmit the electrical signal received from the first photoelectric conversion device to a floating diffusion node, the second transistor has a gate electrode connected to the floating diffusion node, the third transistor is configured to reset the floating diffusion node, and the second pixel circuit includes an output logic circuit, and the output logic circuit is configured to generate an event signal by detecting an intensity change of the optical signal based on the electrical signal received from the second photoelectric conversion device. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 An image sensor according to example embodiments is shown.

[0030] Figure 2 A perspective view of an image sensor according to example embodiments is shown.

[0031] Figure 3 An example configuration of a CMOS image sensor is shown.

[0032] Figures 4 to 7B A top view of a pixel arrangement of a pixel array according to example embodiments is shown.

[0033] Figure 8 A circuit diagram illustrating an example configuration of a pixel according to example embodiments.

[0034] Fig. 9 An example configuration of a dynamic vision sensor according to an example embodiment is shown.

[0035] Fig.10 A circuit diagram illustrating an example configuration of a dynamic vision sensor pixel according to an example embodiment is shown.

[0036] Fig.11 An example configuration of a back-end circuit of a dynamic vision sensor pixel according to example embodiments is shown.

[0037] Fig.12 and Fig.13 A top view of a pixel arrangement including phase detection pixels and dynamic vision sensor pixels according to example embodiments is shown.

[0038] Fig.14 A perspective view of an image sensor according to example embodiments is shown.

[0039] Fig.15 A circuit diagram illustrating an example configuration of a portion of an image sensor according to example embodiments.

[0040] Fig.16 A top view of a pixel arrangement including phase detection pixels and dynamic vision sensor pixels according to example embodiments is shown.

[0041] Fig.17 A perspective view of an image sensor according to example embodiments is shown.

[0042] Fig.18 A circuit diagram illustrating an example configuration of a portion of an image sensor according to example embodiments.

[0043] Fig.19 and Fig. 20 A circuit diagram illustrating an example configuration of a portion of an image sensor according to example embodiments.

[0044] Fig.21 A block diagram of a computing device according to an example embodiment is illustrated. DETAILED DESCRIPTION

[0045] The present disclosure will be described more fully below with reference to the accompanying drawings, in which embodiments of the present disclosure are shown. As those skilled in the art will appreciate, the described embodiments can be modified in various different ways, all without departing from the spirit or scope of the present disclosure.

[0046] Accordingly, the drawings and description are to be regarded as illustrative in nature and not restrictive, and like reference numerals refer to like elements throughout the description and drawings.

[0047] In addition, singular forms may be intended to include plural forms unless explicit expressions such as "one" or "single" are used. Terms including ordinal numbers such as "first", "second", etc. will only be used to describe various constituent elements and should not be interpreted as limiting these constituent elements. These terms can be used to distinguish one constituent element from other constituent elements.

[0048] Figure 1 An image sensor 1000 according to an example embodiment of the present disclosure is shown. The image sensor 1000 may include a complementary metal oxide semiconductor (CMOS) image sensor 1100 , a dynamic vision sensor (DVS) 1200 , and an image signal processor 1300 .

[0049] The CMOS image sensor 1100 and the dynamic vision sensor 1200 may each include a plurality of pixels, each pixel including a photoelectric conversion device (PSD), but is not limited thereto.

[0050] The image signal processor 1300 may process data output from the CMOS image sensor 1100 and / or the dynamic vision sensor 1200 to generate an image (IMG). In an embodiment, the image signal processor 1300 may process frame-based image data received from the CMOS image sensor 1100 to generate an image (IMG). In addition, the image signal processor 1300 may process packet-based or frame-based image data received from the dynamic vision sensor 1200 to generate an image (IMG).

[0051] The image signal processor 1300 may perform various processes on the image data received from the CMOS image sensor 1100. For example, the image signal processor 1300 may perform various processes such as color interpolation, color correction, automatic white balance, gamma correction, color saturation correction, formatting, bad pixel correction, and hue correction.

[0052] The image signal processor 1300 may perform various processes on the image data received from the dynamic vision sensor 1200. For example, the image signal processor 1300 may correct the time stamp value of a noise pixel, a hot pixel, or a dead pixel by using the time correlation of the time stamp values ​​of adjacent pixels configuring the dynamic vision sensor 1200.

[0053] Figure 2 A perspective view of an image sensor according to example embodiments is shown.

[0054] Reference Figure 1 and Figure 2, the image sensor 1000 may be formed by stacking three layers. For example, the image sensor 1000 may include first to third semiconductor dies DIE1 to DIE3. The first to third semiconductor dies DIE1 to DIE3 may be manufactured using different semiconductor processes or different semiconductor wafers.

[0055] The first semiconductor die DIE1 may include a pixel array area 2100. The pixel array area 2100 may include a plurality of row lines (RL1, RL2, ..., RLn) and a plurality of column lines (CL1, CL2, ..., CLm), and a plurality of pixels connected to N row lines and M column lines and arranged in a matrix form may be arranged in the pixel array. In an embodiment, a plurality of image sensing pixels IPX, a photoelectric conversion device (PSD) of a phase detection pixel, and a photoelectric conversion device (PSD) of a DVS pixel may be arranged in the pixel array of the first semiconductor die DIE1.

[0056] In addition, the first semiconductor die DIE1 may include a first pad area PAD1. The pixel array area 2100 and the first pad area PAD1 may be physically separated from each other or spaced apart from each other by a predetermined distance. The first pad area PAD1 may be an area for forming a plurality of pads configured to be connected to a second pad area PAD2 of the second semiconductor die DIE2 and a third pad area PAD3 of the third semiconductor die DIE3. The first pad area PAD1 may be connected to an element of the pixel array area 2100 through a metal layer formed on the first semiconductor die DIE1.

[0057] The second semiconductor die DIE2 may include a CMOS image sensor (CIS) pixel circuit 2200 and a DVS pixel circuit 2300. In an embodiment, the CIS pixel circuit 2200 may include a pixel circuit for a phase detection pixel, and the DVS pixel circuit 2300 may include a DVS pixel back-end circuit, etc. Figures 3 to 11 The CIS pixel circuit 2200 and the DVS pixel circuit 2300 are described in detail.

[0058] In addition, the second semiconductor die DIE2 may further include a second pad area PAD2. The CIS pixel circuit 2200, the DVS pixel circuit 2300, and the second pad area PAD2 may be physically separated from each other or spaced apart from each other by a predetermined distance. The second pad area PAD2 may be an area for forming a plurality of pads configured to be connected to the first pad area PAD1 of the first semiconductor die DIE1 and the third pad area PAD3 of the third semiconductor die DIE3. The second pad area PAD2 may be connected to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 through a metal layer formed on the second semiconductor die DIE2.

[0059] The third semiconductor die DIE3 may include the remaining constituent elements of the image sensor 1000 that are not formed on the first semiconductor die DIE1 and the second semiconductor die DIE2. For example, it may include CIS logic 2111, DVS logic 2112, analog-to-digital converter (ADC) 2113, correlated double sampler (CDS) 2114, etc. Although not shown, the third semiconductor die DIE3 may also include an image signal processor (ISP), etc. Figures 3 to 11 Each constituent element is described in detail.

[0060] In addition, the third semiconductor die DIE3 may further include a third pad area PAD3. The CIS logic 2111, the DVS logic 2112, etc. and the third pad area PAD3 may be physically separated from each other or spaced apart from each other by a predetermined distance. The third pad area PAD3 may be an area for forming a plurality of pads configured to be connected to the first pad area PAD1 of the first semiconductor die DIE1 and the second pad area PAD2 of the second semiconductor die DIE2. The third pad area PAD3 may be connected to the CIS logic 2111, the DVS logic 2112, etc. through a metal layer formed on the third semiconductor die DIE3.

[0061] Although not shown in the present specification, the first semiconductor die DIE1, the second semiconductor die DIE2 and the third semiconductor die DIE3 can be connected to the first pad area PAD1 and the second pad area PAD2, respectively, and can be connected by using connection structures connected to the second pad area PAD2 and the third pad area PAD3, and these connection structures can be at least one of wires, conductive lines, solder balls, bumps and through silicon vias (TSVs), but are not limited thereto.

[0062] As described above, in the image sensor 1000 including both the CIS pixel and the DVS pixel, the structure in which the CIS pixel and the DVS pixel circuit 2300 are formed on separate semiconductor dies can optimize the size of the image sensor 1000. In addition, by further implementing the CIS pixel circuit 2200 in the semiconductor die DIE2 formed with the DVS pixel circuit 2300, the space of the semiconductor die DIE2 can be effectively utilized. In an embodiment, the CIS pixel circuit 2200 implemented on the same semiconductor die DIE2 as the DVS pixel circuit 2300 can be a pixel circuit for phase detection autofocus.

[0063] Figure 3 An example configuration of a CMOS image sensor according to example embodiments is shown.

[0064] Reference Figure 3, the CMOS image sensor 1100 may include a lens LS, a pixel array 1110 , a row driver 1120 , a controller 1130 , a ramp generator 1140 , and a readout circuit 1150 .

[0065] The CMOS image sensor 1100 may convert an optical signal of an object (OBJECT) incident through an optical device into an electrical signal, and may generate image data IDAT based on the converted electrical signal. The optical device may be an optical converging device including a reflector and a lens LS, but is not limited thereto, and the CMOS image sensor 1100 may use various optical devices.

[0066] The pixel array 1110 may include a plurality of pixels PX (also referred to herein as pixels 1111 ), and a plurality of row lines RLs and a plurality of column lines CLs respectively connected to the plurality of pixels PX.

[0067] The row lines RLs may extend in a first direction and may be connected to the pixels PX arranged along the first direction. For example, the row lines RLs may transmit a control signal output from the row driver 1120 to an element included in the pixel PX, such as a transistor. The column lines CLs may extend in a second direction crossing the first direction and may be connected to the pixels PX arranged along the second direction. The column lines CLs may transmit a pixel signal output from the pixel PX to the readout circuit 1150.

[0068] The plurality of pixels PX included in the pixel array 1110 may include a plurality of image sensing pixels IPX and a plurality of phase detection pixels PPX.

[0069] A plurality of image sensing pixels IPX may generate an image signal corresponding to an object (OBJECT). A plurality of phase detection pixels PPX may generate not only an image signal corresponding to an object (OBJECT), but also a phase signal for focusing on the object (OBJECT). The phase signal may include information about the position of an image corresponding to an object (OBJECT) incident through an optical device. The image signal and the phase signal generated by the plurality of image sensing pixels IPX and the plurality of phase detection pixels PPX may be sent to a readout circuit 1150 through a column line CLs. The readout circuit 1150 may calculate a phase difference between images through a phase signal.

[0070] The row driver 1120 may generate a control signal for driving the pixel array 1110 in response to a control signal (eg, a row control signal CTR_X) of the controller 1130 , and may provide the control signal to a plurality of pixels PX of the pixel array 1110 through a plurality of row lines RLs.

[0071] The controller 1130 may generally control each of the constituent elements 1110, 1120, 1140, and 1150 included in the CMOS image sensor 1100. The controller 1130 may control the operation timing of each of the constituent elements 1110, 1120, 1140, and 1150 by using a control signal. For example, the controller 1130 may provide a row control signal CTR_X to the row driver 1120, and the row driver 1120 may control the pixel array 1110 to be sensed in units of row lines through the row lines RLs based on the row control signal CTR_X. For example, the controller 1130 may provide a ramp control signal CTR_R for controlling a ramp signal to the ramp generator 1140, and the ramp generator 1140 may generate a reference signal RAMP for the operation of the readout circuit 1150 based on the ramp control signal CTR_R. For example, the controller 1130 may provide the readout circuit 1150 with a column control signal CTR_Y, and the readout circuit 1150 may receive and process a pixel signal from the pixel array 1110 through the column line CLs based on the column control signal CTR_Y.

[0072] The readout circuit 1150 may convert a pixel signal (or electric signal) from a pixel PX selected from a plurality of pixels PX connected to the row line RLs into a pixel value representing the amount of light according to the control from the controller 1130. The readout circuit 1150 may process the pixel signal output through the corresponding column line CLs to output it as the image data IDAT. The readout circuit 150 may include a correlated double sampling (CDS) circuit 1151, an analog-to-digital converter (ADC) circuit 1153, and a buffer 1155.

[0073] The correlated double sampling circuit 1151 may include a plurality of comparators, and each of the comparators may compare a pixel signal received from the pixel array 1110 through a plurality of column lines CLs with a reference signal RAMP from the ramp generator 1140 to output a comparison result to the analog-to-digital converter circuit 1153. In addition, the correlated double sampling circuit 1151 may receive a phase signal from the pixel array 1110 to perform a phase difference operation. For example, the CDS circuit 1151 may perform a correlated double sampling operation on a phase signal received from the phase detection pixel PPX to obtain a focus position, a focus direction, or a distance between an object (OBJECT) and the CMOS image sensor 1100. Thereafter, the controller 1130 may output a control signal for moving the position of the lens LS based on the result of the correlated double sampling operation.

[0074] The analog-to-digital converter circuit 1153 converts the comparison result of the correlated double sampling circuit 1151 into digital data, thereby generating and outputting pixel values ​​corresponding to a plurality of pixels in a row unit. The analog-to-digital converter circuit 1153 may include a plurality of counters, and the plurality of counters may be respectively connected to the outputs of the plurality of comparators, and may count the comparison results output from the comparators, thereby outputting digital data (e.g., pixel values) according to the count results.

[0075] The buffer 1155 may store pixel values ​​output from the analog-to-digital converter circuit 1153, respectively. The buffer 1155 may store digital data for each row. In an embodiment, the buffer 1155 may temporarily store a plurality of digital data output from the counter, and then amplify and output them. For example, the buffer 1155 may be an output buffer. The buffer 1155 may output the image data IDAT amplified based on the column control signal CTR_Y of the controller 1130 to the outside.

[0076] In an embodiment, at least some of the row driver 1120, the controller 1130, the ramp generator 1140, and the readout circuit 1150 may be Figure 2 CIS logic 2111 shown.

[0077] Figures 4 to 7B A top view of a pixel arrangement of a pixel array according to example embodiments is shown.

[0078] like Figure 4 As shown, the pixel array 1110 of the CMOS image sensor 1100 may include a plurality of first pixel groups PG1 and second pixel groups PG2 repeatedly disposed along the x-axis on the substrate of the image sensor 1000. Figure 4 , it is shown that all the first pixel groups PG1 are disposed in the first column, but the present disclosure is not limited thereto, and the second pixel group PG2 may be disposed in the first column.

[0079] Figure 5 The arrangement of pixels in the first pixel group PG1 and the second pixel group PG2 is shown.

[0080] like Figure 5 As shown, each pixel group PG1 or PG2 may include a plurality of pixel units. The plurality of pixel units may be arranged in the form of A×B (where A and B are both arbitrary natural numbers). Hereinafter, it will be described that one pixel group includes four pixel units, and four pixel units are arranged in the form of 2×2 in one pixel group. For example, the first pixel group PG1 may include 2×2 pixel units (PU11, PU12, PU21, and PU22), but is not limited thereto.

[0081] A pixel unit may include a pixel for outputting information related to a color. In some example embodiments, the same color filter may be formed on a pixel unit. For example, a first color filter CF1 may be formed on a pixel unit PU11, a second color filter CF2 may be formed on a pixel unit PU12, a third color filter CF3 may be formed on a pixel unit PU21, and a fourth color filter CF4 may be formed on a pixel unit PU22. The first color filter CF1 may transmit green (Gr) light, the second color filter CF2 may transmit red (R) light, the third color filter CF3 may transmit blue (B) light, and the fourth color filter CF4 may transmit green (Gb) light. Hereinafter, a pixel having the first color filter CF1 formed thereon is referred to as a first green pixel, a pixel having the second color filter CF2 formed thereon is referred to as a red pixel, a pixel having the third color filter CF3 formed thereon is referred to as a blue pixel, and a pixel having the fourth color filter CF4 formed thereon is referred to as a second green pixel.

[0082] A plurality of pixel units PU11, PU12, PU21, and PU22 may be arranged in a pixel group PG1 or PG2 in a Bayer pattern. In the present disclosure, for better understanding and ease of description, an implementation scheme of the Bayer pattern is shown, in which the pixel unit PU12 is arranged on the right side of the pixel unit PU11, the pixel unit PU21 is arranged below the pixel unit PU11, and the pixel unit PU22 is arranged on the diagonal side of the pixel unit PU11, but the present disclosure is not limited thereto, and the positions of the pixel units may be exchanged, or one of the pixel units PU11 and PU22 having green pixels may be replaced, and the Bayer pattern may be combined with other color configurations (e.g., pixel units having white pixels, pixel units having yellow pixels, and pixel units having cyan pixels).

[0083] One pixel group may include a plurality of phase detection pixels PPX. For example, a pixel unit PU22 in a pixel group PG1 may include a plurality of second green pixels and a plurality of phase detection pixels PPX. As another example, one pixel unit PU22 may include only a plurality of phase detection pixels PPX. As yet another example, a pixel unit PU22 in a pixel group PG1 may include only a plurality of second green pixels.

[0084] According to an embodiment, Fig. 6A As shown, the phase detection pixel PPX can be a metal shielding pixel (see Fig. 6APPX in ). The metal shielded pixel is a pixel in which half of the pixel is shielded by a metal film, and there are two types of shielded pixels, i.e., left shielded pixels and right shielded pixels, and phase information of the left shielded pixels and the right shielded pixels enables phase detection autofocus (PDAF) for high-speed AF by the image signal processor 1300. In the present specification, it is shown that the left shielded pixels and the right shielded pixels are respectively arranged in a 2×2 form, but the present disclosure is not limited thereto, and in an embodiment, the left shielded pixels and the right shielded pixels may each be arranged adjacent to one pixel.

[0085] Figure 6B is a diagram schematically illustrating a configuration of a metal shielding pixel according to example embodiments.

[0086] Reference Figure 6B The first metal shielding pixel 60A may be a left shielding pixel, and the second metal shielding pixel 60B may be a right shielding pixel. The metal shielding pixels 60A and 60B may each include a microlens 61 , a mask layer 63 , and a photoelectric conversion device 65 .

[0087] The mask layer 63 may form a shielding area in the metal shielding pixel 60A or 60B. The mask layer 63 may be implemented as a metal mask, and an opening 69 through which light may be incident and a shielding area 67 through which light may be blocked may be distinguished by the mask layer 63. For example, the mask layer 63 may include an opening 69 through which light may be incident and a shielding area 67 through which light may be blocked.

[0088] The microlens 61 may focus the incident light to the center of the metal shielding pixel and transmit it to the photoelectric conversion device 65. For example, the microlens 61 may focus the incident light to the center of the opening 69 of the metal shielding pixel.

[0089] The photoelectric conversion device 65 can convert an incident light signal into an electric signal. The photoelectric conversion device 65 can be, for example, a photodiode.

[0090] According to another embodiment, Fig. 7A As shown, the phase detection pixel PPX may be a super PD pixel. A super PD pixel is a pixel in which one microlens is disposed on two adjacent phase detection pixels PPX, and the phase information of light incident on the photoelectric conversion device of the super PD pixel enables phase detection autofocus (PDAF) for high-speed AF to be performed by the image signal processor 1300.

[0091] Figure 7B is a diagram schematically illustrating a configuration of a super PD pixel according to example embodiments.

[0092] The first pixel 70A and the second pixel 70B may each include a mask layer 73 and a photoelectric conversion device 75, and one microlens 71 may be provided on the mask layer 73 of the first pixel 70A and the second pixel 70B. Light incident to the microlens 71 is refracted, and the incident light may form an image on the photoelectric conversion device 75 of the first pixel 70A and the second pixel 70B, respectively. The photoelectric conversion device 75 may be, for example, a photodiode or the like.

[0093] In an embodiment, the ratio of the number of phase detection pixels PPX and the number of pixels set in the pixel array 1110 may be 1 / 32. The signal generated by the phase detection pixel PPX may be different from the signal generated by the image sensing pixel IPX. For example, the signal generated by the phase detection pixel PPX may have a lower sensitivity than the signal generated by the image sensing pixel IPX. Therefore, the image signal processor 1300 can prevent image quality degradation by performing bad pixel correction (BPC) on the phase detection pixel PPX.

[0094] Figure 8 A circuit diagram illustrating an example configuration of a pixel according to example embodiments.

[0095] In an embodiment, the pixel 1111 may be an image sensing pixel (IPX) or a phase detection pixel (PPX). It may include a photoelectric conversion device PSD and a CIS pixel circuit 610 having a 4TR structure including four transistors. The pixel 1111 may include a photoelectric conversion device PSD, a transfer transistor TX, a reset transistor RX, a drive transistor DX, and a selection transistor SX. Figure 8 The photoelectric conversion device PSD can correspond to Figure 6B Photoelectric conversion device 65 or Figure 7B A photoelectric conversion device 75.

[0096] In an embodiment, the photoelectric conversion device PSD may generate charges in response to incident light. For example, the photoelectric conversion device PSD may generate a photocurrent by converting an optical signal into an electrical signal. In an embodiment, the transfer transistor TX may receive the charges generated by the photoelectric conversion device PSD to transfer the charges to the floating diffusion area FD. For example, one end of the transfer transistor TX may be connected to the photoelectric conversion device PSD, and the other end thereof may be connected to the floating diffusion area FD. The transfer transistor TX may be connected to the floating diffusion area FD from the row driver 1120 (see FIG. Figure 3 ) is turned on or off under the control of the control signal TG received.

[0097] The floating diffusion area FD has a function of detecting a charge corresponding to the amount of incident light. During the time when the control signal TG is activated, the charge provided from the photoelectric conversion device PSD can be accumulated in the floating diffusion area FD. The floating diffusion area FD can be connected to the gate terminal of the drive transistor DX driven by the source follower amplifier. The floating diffusion area FD can be reset by the power supply voltage VDD provided when the reset transistor RX is turned on.

[0098] The reset transistor RX may be turned on by the reset signal RG to provide the power supply voltage VDD to the floating diffusion area FD. As a result, the charge accumulated in the floating diffusion area FD may be moved to the terminal of the power supply voltage VDD, and the voltage of the floating diffusion area FD may be reset. Although the power supply voltage VDD is used as the voltage applied to the floating diffusion area FD, various levels of voltages (e.g., a reset voltage) may be used to reset the floating diffusion area FD.

[0099] The driving transistor DX may operate as a source follower amplifier. The driving transistor DX may amplify a change in the potential of the floating diffusion area FD and may output an output voltage Vout corresponding to the amplified potential of the floating diffusion area FD.

[0100] The selection transistor SX may be driven by a selection signal SEL to select pixels to be read in row units. When the selection transistor SX is turned on, the potential of the floating diffusion area FD is amplified by the drive transistor DX to be transferred to the drain electrode of the selection transistor SX.

[0101] In an embodiment, the first semiconductor die DIE1 (see Figure 2 ) can be connected to the first pad area PAD1 (see Figure 2 )、the second pad area PAD2 (see Figure 2 ) and / or the third pad area PAD3 (see Figure 2 ) is sent to the second semiconductor die DIE2 (see Figure 2 ) and / or the third semiconductor die DIE3 (see Figure 2 ).

[0102] Fig. 9 An example configuration of a dynamic vision sensor according to an example embodiment is shown.

[0103] The dynamic vision sensor 1200 may include a DVS pixel array 1210, a column address event representation (AER) circuit 1220, a row AER circuit 1230, and an output buffer 1240. The dynamic vision sensor 1200 may detect an event of a light intensity change (hereinafter, referred to as an "event"), may determine the type of the event (e.g., whether the light intensity increases or decreases), and may output a value corresponding to the event. For example, the event may occur mainly in the outline of a moving object. The signal output from the dynamic vision sensor 1200 may be different from that output from a CMOS image sensor (e.g., Figure 1 For example, with a CMOS image sensor (e.g., Figure 1 Unlike the CMOS image sensor 1100 in FIG. 1 , since the dynamic vision sensor 1200 only outputs values ​​corresponding to light whose intensity changes, the number of pixels processed by the dynamic vision sensor 1200 and / or the image signal processor (e.g., Figure 1 The amount of data processed by the image signal processor 1300).

[0104] The DVS pixel array 1210 may include a plurality of DVS pixels PX arranged in a matrix format along a plurality of rows and a plurality of columns. The DVS pixel 1211 (which may be an event one of the plurality of pixels of the detection-configured DVS pixel array 1210 among the plurality of DVS pixels PX) may send a column request CR signal to the column AER circuit 1220, the column request CR signal indicating that an event of light intensity increase or decrease has occurred.

[0105] The column AER circuit 1220 may send a response signal ACK to the pixel in response to the column request CR received from the pixel of the sensing event. The pixel receiving the response signal ACK may send the polarity information Pol of the generated event to the row AER circuit 1230. The column AER circuit 1220 may generate a column address C_ADDR of the pixel of the sensing event based on the column request CR received from the pixel of the sensing event.

[0106] The row AER circuit 1230 may receive polarity information Pol from a pixel sensing an event. The row AER circuit 1230 may generate a timestamp including information about the time when the event occurs based on the polarity information Pol. For example, the timestamp may be generated by a time marker 1232 provided in the row AER circuit 1230. For example, the time marker 1232 may be implemented using a time tick generated in units of several microseconds to tens of microseconds. The row AER circuit 1230 may send a reset signal RST to the DVS pixel 1211 where the event occurs in response to the polarity information Pol. The reset signal RST may reset the DVS pixel 1211 where the event occurs. In addition, the row AER circuit 1230 may generate a row address R_ADDR of the DVS pixel 1211 where the event occurs. The row AER circuit 1230 may send the timestamp, the polarity information Pol, and the row address R_ADDR to the output buffer 1240.

[0107] The row AER circuit 1230 may control the period during which the reset signal RST is generated. For example, the row AER circuit 1230 may control the period during which the reset signal RST is generated so that no event occurs during a specific period in order to prevent an increase in workload due to excessive events. That is, the row AER circuit 1230 may control the refractory period of event generation.

[0108] The output buffer 1240 may generate a packet based on the timestamp, the column address C_ADDR, the row address R_ADDR, and the polarity information Pol. The output buffer 1240 may add a header indicating the start of the packet to the front end of the packet and add a tail indicating the end of the packet to the rear end of the packet.

[0109] In an embodiment, at least some of the column AER circuit 1220, the row AER circuit 1230, and the output buffer 1240 described above may be DVS logic (eg, Figure 2 DVS logic 2112 in).

[0110] Fig.10 A circuit diagram showing an example configuration of a DVS pixel configuring a pixel array of a dynamic vision sensor according to an example embodiment is shown. The DVS pixel 1211 includes a photoreceptor 1213 and a DVS pixel backend circuit 1215 .

[0111] The photoreceptor 1213 may include a photoelectric conversion device PSD, a logarithmic amplifier LA, and a feedback transistor FB. The logarithmic amplifier LA may output a logarithmic voltage VLOG of a logarithmic scale by amplifying a voltage corresponding to a photocurrent generated by the photoelectric conversion device PSD. The feedback transistor FB may transmit the logarithmic voltage to the DVS pixel back-end circuit 1215 based on the logarithmic voltage.

[0112] The DVS pixel back-end circuit 1215 may perform various processing on the logarithmic voltage VLOG. In an embodiment, the DVS pixel back-end circuit 1215 may amplify the logarithmic voltage VLOG, may compare the amplified voltage with a reference voltage to determine whether the light incident on the photoelectric conversion device PSD is light with an increased intensity or a decreased intensity, and may output an event signal corresponding to the determined value (i.e., an on event or an off event). The event signal output from the DVS pixel back-end circuit 1215 may be polarity information (e.g., Fig. 9 After the DVS pixel back-end circuit 1215 outputs an event signal (ie, a turn-on event or a turn-off event), the DVS pixel back-end circuit 1215 may be reset by a reset signal RST.

[0113] Fig.11 An example configuration of a back-end circuit of a dynamic vision sensor pixel according to an example embodiment is shown. The DVS pixel back-end circuit 1215 may include a differentiator 1216 , a comparator 1217 , and an output logic circuit 1218 .

[0114] The differentiator 1216 may be configured to amplify the voltage VLOG received from the photoreceptor 1213 to generate a voltage VDIFF. For example, the differentiator 1216 may include capacitors C1 and C2, a differential amplifier DA, and a switch SW operated by a reset signal RST. For example, the capacitors C1 and C2 may store electrical energy generated by at least one photoelectric conversion device PSD. For example, considering the shortest time (e.g., refractory period) between two events that may occur successively in one pixel, the capacitance of the capacitors C1 and C2 may be appropriately selected. When the switch SW is turned on by the reset signal RST, the pixel may be initialized. The pixel may be initialized from a row AER circuit (e.g., Fig. 9 The row AER circuit 1230) receives the reset signal RST.

[0115] The comparator 1217 can compare the output voltage VDIFF of the differential amplifier DA with the reference voltage Vref to determine whether the event sensed from the pixel is an on event or an off event. When an event that increases light intensity is detected, the comparator 1217 can output a signal (ON) indicating an on event, and when an event that decreases light intensity is detected, the comparator 1217 can output a signal (OFF) indicating a off event.

[0116] The output logic circuit 1218 may send information about the event generated in the pixel. The information output from the output logic circuit 1218 may include information (e.g., a bit) about whether the generated event is an on event or an off event. The information about the event output from the output logic circuit 1218 may be polarity information (e.g., Fig. 9 The polarity information Pol in the AER circuit (eg, Fig. 9 row AER circuit 1230 in the FIG.

[0117] In an embodiment, the signal generated by the DVS pixel 1211 can be connected to the second pad (eg Figure 2 The second pad PAD2) and the third pad (eg Figure 2 The third pad PAD3 in the embodiment is connected to the third semiconductor die (eg Figure 2 The third semiconductor die DIE3 in the embodiment.

[0118] Meanwhile, the configuration of the pixel shown in the present embodiment is an example, and the present disclosure will be applied to DVS pixels of various configurations configured to determine an event type by detecting a varying light intensity.

[0119] Fig.12 and Fig.13 A top view of a pixel arrangement including phase detection pixels and dynamic vision sensor pixels according to example embodiments is shown.

[0120] Fig.12 The pixel array region (eg, Figure 2 2100). According to an embodiment, the phase detection pixel PPX may be a metal shielding pixel 1010. In order to set the phase detection pixel PPX and the DVS pixel providing a phase detection autofocus (PDAF) function as one image sensor, a dynamic vision sensor (DVS) pixel 1020 may be additionally provided in the pixel array including the metal shielding pixel 1010. However, in this structure, since some of the image sensing pixels IPX are replaced by the DVS pixels 1020, the image signal processor 1300 additionally requires processing such as bad pixel correction (BPC) for the DVS pixels 1020 and the metal shielding pixels 1010. This may place a burden on the BPC algorithm of the image signal processor 1300.

[0121] Fig.13A top view of a pixel arrangement according to an example embodiment is shown, in which some of the metal shielding pixels, which are a type of phase detection pixels PPX, are replaced by DVS pixels 1112. Alternatively, there may be a pixel arrangement in which some of the DVS pixels 1112 are replaced by metal shielding pixels, which are a type of phase detection pixels PPX. In an embodiment, since some of the metal shielding pixels are replaced by DVS pixels 1112, the ratio of the number of metal shielding pixels 1111 and DVS pixels 1112 to the number of multiple pixels may remain the same as before (e.g., 1 / 32). Therefore, the burden of the BPC algorithm of the image signal processor 1300 for processing the BPC of the metal shielding pixels 1111 and the DVS pixels 1112 may be reduced.

[0122] Fig.14 A perspective view of an image sensor including a phase detection pixel and a DVS pixel according to an example embodiment is shown. Here, a configuration of each die of the image sensor when the phase detection pixel and the DVS pixel are included in one device will be described.

[0123] In an embodiment, the first semiconductor die DIE1 may include a pixel array region 2100, and a plurality of image sensing pixels IPX may be disposed in the pixel array region 2100. The image sensing pixels IPX may include a photoelectric conversion device PSD and a CIS pixel circuit (eg, Figure 81100 in the CIS pixel circuit 610). In an embodiment, the metal shielding pixel 1111 and the DVS pixel 1112 may be further disposed in the pixel array region 2100. In an embodiment, the photoelectric conversion device PSD of the metal shielding pixel 1111 and the photoelectric conversion device PSD of the DVS pixel 1112 may be disposed in the pixel array region 2100 of the first semiconductor die DIE1. In an embodiment, the photoelectric conversion device PSD of the metal shielding pixel 1111 and the DVS pixel 1112 may be connected to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 of the second semiconductor die DIE2 through the first connection structure IF1 and the second connection structure IF2, respectively. The charge generated by the photoelectric conversion device PSD may be transferred to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 through the first connection structure IF1 and the second connection structure IF2, respectively. In an embodiment, the first connection structure IF1 and the second connection structure IF2 may mean various configurations for electrically connecting the photoelectric conversion device PSD and the CIS pixel circuit 2200 and the DVS pixel circuit 2300. For example, the first connection structure IF1 and the second connection structure IF2 may include at least one of a wire, a conductive line, a solder ball, a bump, and a through silicon via (TSV). In an embodiment, the first connection structure IF1 may be disposed in a region where the pixel array region 2100 where the photoelectric conversion device PSD is disposed overlaps with the CIS pixel circuit 2200, and the second connection structure IF2 may be disposed in a region where the pixel array region 2100 where the photoelectric conversion device PSD is disposed overlaps with the DVS pixel circuit 2300.

[0124] In an embodiment, the CIS pixel circuit 2200 and the DVS pixel circuit 2300 of the second semiconductor die DIE2 may receive charges from the first semiconductor die DIE1 to generate output signals. The output signals generated by the first semiconductor die DIE1 and / or the second semiconductor die DIE2 may be sent to the third semiconductor die DIE3 through the connection structure connected to the first pad area PAD1, the second pad area PAD2 and / or the third pad area PAD3.

[0125] Fig.15 A circuit diagram showing an example configuration of a portion of an image sensor according to an example embodiment is shown. Specifically, Fig.15 A circuit diagram showing a structure in which the photoelectric conversion devices PSD of the metal shielding pixels 1111 and the DVS pixels 1112 of the first semiconductor die DIE1 are connected to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 of the second semiconductor die DIE2. Fig.15 The left side shows Fig.14 The metal of the first semiconductor die DIE1 shields the photoelectric conversion device PSD of the pixel 1111 and the photoelectric conversion device PSD of the DVS pixel 1112, and Fig.15The right side shows Fig.14 The CIS pixel circuit 2200 and the DVS pixel circuit 2300 of the second semiconductor die DIE2.

[0126] In an embodiment, the charges generated by the photoelectric conversion device PSD of the metal shielding pixel 1111 of the first semiconductor die DIE1 can be transferred to the CIS pixel circuit 2200 through the first connection structure IF1, and the charges generated by the photoelectric conversion device PSD of the DVS pixel 1112 can be transferred to the DVS pixel circuit 2300 through the second connection structure IF2.

[0127] Here, the metal shielding pixel 1111 is shown as a left shielding pixel, but is not limited thereto, and the metal shielding pixel 1111 may be a right shielding pixel.

[0128] Fig.16 A top view of a pixel arrangement according to an example embodiment is shown, in which some of the super PD pixels, which are a type of phase detection pixels PPX, are replaced by DVS pixels 1420 and 1430. Since some of the super PD pixels are replaced by DVS pixels 1420 and 1430, the ratio of the number of phase detection pixels 1410 and 1440 and DVS pixels 1420 and 1430 to the number of multiple pixels can be maintained the same as before (e.g., 1 / 32). Therefore, the burden of the BPC algorithm of the image signal processor 1300 for BPC processing of the phase detection pixels 1410 and 1440 and the DVS pixels 1420 and 1430 can be reduced.

[0129] In an embodiment, when the phase detection pixels 1410 and 1440 and the DVS pixels 1420 and 1430 are provided, the phase detection pixels 1410 and the DVS pixels 1420 and the DVS pixels 1430 and the phase detection pixels 1440 may be alternately provided. Therefore, the phase detection pixels 1410 and 1440 may constitute a pair of super PD pixels.

[0130] Fig.17 A perspective view of an image sensor including phase detection pixels and dynamic vision sensor pixels according to an example embodiment is shown. Here, in order to implement a CMOS image sensor and a dynamic vision sensor simultaneously in one device, a configuration of each die of the image sensor when the phase detection pixels and the DVS pixels are included in the CMOS image sensor will be described.

[0131] In an embodiment, the first semiconductor die DIE1 may include a pixel array region 2100, and a plurality of image sensing pixels IPX may be disposed in the pixel array region 2100. The image sensing pixels IPX may include a photoelectric conversion device PSD and a CIS pixel circuit (eg, Figure 8610 in the CIS pixel circuit 610). In an embodiment, the phase detection pixel 1410 and the DVS pixel 1420 may be further arranged in the pixel array area 2100. In an embodiment, the photoelectric conversion device PSD of the phase detection pixel 1410 and the DVS pixel 1420 may be arranged in the pixel array area 2100 of the first semiconductor die DIE1. In an embodiment, the photoelectric conversion device PSD of the phase detection pixel 1410 and the DVS pixel 1420 may be connected to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 of the second semiconductor die DIE2 through the first connection structure IF1 and the second connection structure IF2, respectively. In an embodiment, the first connection structure IF1 may be arranged in an area where the pixel array area 2100 where the photoelectric conversion device PSD is arranged overlaps with the CIS pixel circuit 2200, and the second connection structure IF2 may be arranged in an area where the pixel array area 2100 where the photoelectric conversion device PSD is arranged overlaps with the DVS pixel circuit 2300. The connection structure of the first semiconductor die DIE1 and the second semiconductor die DIE2 is Fig.14 , so their detailed description will be omitted.

[0132] Fig.18 A circuit diagram illustrating an example configuration of a portion of an image sensor according to example embodiments.

[0133] In an embodiment, the photoelectric conversion devices PSD of the phase detection pixels 1410 and the DVS pixels 1420 of the first semiconductor die DIE1 may be connected to the CIS pixel circuit 2200 and the DVS pixel circuit 2300 disposed on the second semiconductor die DIE2 through the first connection structure IF1 and the second connection structure IF2 connected to the first semiconductor die DIE1 and the second semiconductor die DIE2, respectively. As described above, the phase detection pixels 1410 and the DVS pixels 1420 and the DVS pixels 1430 and the phase detection pixels 1440 may be alternately disposed, and the phase detection pixels 1410 and 1440 may constitute a pair of super PD pixels.

[0134] Fig.19 and Fig. 20 A circuit diagram illustrating an example configuration of a portion of an image sensor according to example embodiments.

[0135] In an embodiment, the second semiconductor die DIE2 may further include a configuration for changing the connection relationship (e.g., a first switch SW1 and a second switch SW2) between the photoelectric conversion device PSD of the DVS pixel and the phase detection pixel PPX and the CIS pixel circuit 2200 and the DVS pixel circuit 2300 on the second semiconductor die DIE2. The first switch SW1 and the second switch SW2 may be configured by the image signal processor 1300 or the row AER (e.g., Fig. 9The row AER circuit 1230 in the circuit is used to generate a switch control signal SWC control.

[0136] Reference Fig.19 In an embodiment, when the first switch SW1 is turned off and the second switch SW2 is turned on, the CMOS image sensor (e.g., the CMOS image sensor 1100) and the dynamic vision sensor (e.g., the dynamic vision sensor 1200) can be operated separately. In an embodiment, when the first switch SW1 is turned on and the second switch SW2 is turned off, the photoelectric conversion devices PSD of the DVS pixels 1112 disposed in the first semiconductor die DIE1 are all connected to the CIS pixel circuit 2200, so that the image sensor 1000 can be operated as a CMOS image sensor (e.g., the CMOS image sensor 1100). In an embodiment, in a state where the first switch SW1 is turned on, the second switch SW2 is turned on, and the control signal TG of the transfer transistor TX is turned off, all the photoelectric conversion devices PSD of the metal shielding pixels 1111 disposed on the first semiconductor die DIE1 can be connected to the DVS pixel circuit 2300.

[0137] Reference Fig. 20 In an embodiment, when the first switch SW1 is turned off and the second switch SW2 is turned on, the CMOS image sensor (e.g., the CMOS image sensor 1100) and the dynamic vision sensor (e.g., the dynamic vision sensor 1200) can be operated separately. That is, the phase detection pixels 1410 and 1440 can constitute a pair of super PD pixels, and the DVS pixels 1420 and 1430 can be operated as a separate dynamic vision sensor. In an embodiment, when the first switch SW1 is turned on and the second switch SW2 is turned off, the photoelectric conversion devices PSD of the DVS pixels 1420 and 1430 disposed on the first semiconductor die DIE1 are both connected to the CIS pixel circuit 2200, so that each of the first pixel 1810 and the second pixel 1820 can constitute a separate super PD pixel to operate as a CMOS image sensor. In an embodiment, all photoelectric conversion devices PSD of the phase detection pixels 1410 and 1440 disposed on the first semiconductor die DIE1 may be connected to the DVS pixels 1420 and 1430 in a state where the first switch SW1 is turned on, the second switch SW2 is turned on, and the control signal TG of the transfer transistor TX is turned off.

[0138] Fig.21 A block diagram of a computing device according to an example embodiment is shown.

[0139] Reference Fig.21 , the computing device 2000 may include a camera 2110 , a controller 2120 , a memory 2130 , and a display 2140 .

[0140] The camera 2110 may include an image sensor 2011. The image sensor 2011 may be implemented as Figures 1 to 20 The image sensor 1000 described above. In an embodiment, the image sensor 2011 may be an image sensor including phase detection pixels and DVS pixels. In an embodiment, a structure in which a DVS pixel circuit and a pixel circuit for phase detection are formed on a semiconductor die different from an image sensing pixel can optimize the size of the image sensor. In an embodiment, since the number of phase detection pixels and DVS pixels satisfies a predetermined ratio (e.g., 1 / 32) relative to the image sensing pixels, the burden on the BPC algorithm of the image sensor processor can be reduced. The camera 2110 can generate an image signal by using the image sensor 2011, can perform image signal processing on the image signal, and can output the processed image signal to the controller 2120.

[0141] The controller 2120 may include a processor 2121. The processor 2121 may control the overall operation of each constituent element of the computing device 2000. The processor 2121 may be implemented as at least one of various processing units, such as a central processing unit (CPU), an application processor (AP), and a graphics processing unit (GPU). In some embodiments, the controller 2120 may be implemented as an integrated circuit or a system on chip (SoC).

[0142] In an embodiment, Fig.21 As shown, the controller 2120 may further include an interface 2122, a memory controller 2123, a display controller 2124, and a bus 2125. In some embodiments, at least some of the interface 2122, the memory controller 2123, the display controller 2124, and the bus 2125 may be disposed outside the controller 2120. In some embodiments, the controller 2120 may further include an image signal processor.

[0143] The interface 2122 may transmit an image signal received from the image sensor 2011 to the memory controller 2123 or the display controller 2124 through the bus 2125 .

[0144] The memory 2130 may store various data and commands. The memory controller 2123 may control the transfer of data or commands to and from the memory 2130 .

[0145] The display controller 2124 may send data to be displayed on the display 2140 to the display 2140 under the control of the processor 2121, and the display 2140 may display a screen based on the received data. In some embodiments, the display 2140 may also include a touch screen. The touch screen may send user input capable of controlling the operation of the computing device 2000 to the controller 2120. The user input may be generated when the user touches the touch screen.

[0146] The bus 2125 may provide a communication function between the constituent elements of the controller 2120. The bus 2125 may include at least one type of bus according to a communication protocol between the constituent elements.

[0147] While embodiments of the disclosure have been described in connection with what are presently considered to be practical embodiments, it is to be understood that the disclosure is not limited to the disclosed embodiments, but on the contrary, the disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. An image sensor, include: A first die including a pixel array region in which a first photoelectric conversion device and a second photoelectric conversion device configured to generate respective charges corresponding to incident light are disposed; as well as A second bare chip includes a first pixel circuit and a second pixel circuit, wherein the first pixel circuit is configured to receive the charge from the first photoelectric conversion device and generate a phase signal of the incident light based on the charge received from the first photoelectric conversion device, and the second pixel circuit is configured to receive the charge from the second photoelectric conversion device and generate an event signal corresponding to the incident light based on the charge received from the second photoelectric conversion device.

2. The image sensor according to claim 1, further comprising: include: A third bare chip includes a first logic circuit configured to receive the phase signal from the first pixel circuit, a second logic circuit configured to receive the event signal from the second pixel circuit, and an image signal processor configured to receive data output from the first logic circuit and the second logic circuit.

3. The image sensor according to claim 2, further comprising: include: a first pad disposed on the first die to be spaced apart from the pixel array region; a second pad disposed on the second die to be spaced apart from the first pixel circuit and the second pixel circuit; as well as A third pad is disposed on the third die to be spaced apart from the first logic circuit, the second logic circuit, and the image signal processor.

4. The image sensor according to claim 3, in, The first pad is electrically connected to the second pad, and the second pad is electrically connected to the third pad.

5. The image sensor according to claim 3, in, A third photoelectric conversion device configured to generate the charges corresponding to the incident light and a third pixel circuit configured to receive the charges from the third photoelectric conversion device to generate an output voltage are also provided in the pixel array area.

6. The image sensor according to claim 5, in, The third pixel circuit is connected to the first pad through a metal layer on the first die.

7. The image sensor according to claim 5, in, The number of the first photoelectric conversion devices and the second photoelectric conversion devices in the pixel array area satisfies a predetermined ratio with respect to the number of the third photoelectric conversion devices.

8. The image sensor according to claim 1, further comprising: include: a first connection structure configured to connect the first photoelectric conversion device and the first pixel circuit, and disposed in a region where the pixel array region and the first pixel circuit overlap; as well as A second connection structure is configured to connect the second photoelectric conversion device and the second pixel circuit, and is provided in a region where the pixel array region and the second pixel circuit overlap.

9. The image sensor according to claim 8, further comprising: include: a first switch including one end electrically connected to the second connection structure and another end electrically connected to the second pixel circuit; as well as The second switch includes one end electrically connected between the first connection structure and the first pixel circuit and the other end electrically connected to one end of the first switch.

10. The image sensor according to claim 9, in, The first switch and the second switch are disposed on the second die.

11. The image sensor according to claim 8, in, The first connection structure and the second connection structure are at least one of a wire, a conductive line, a solder ball, a bump, and a through silicon via.

12. The image sensor according to claim 1, in, The first photoelectric conversion device and the second photoelectric conversion device are arranged adjacent to each other, and The device further includes a micro lens, which is arranged on the first photoelectric conversion device and the second photoelectric conversion device.

13. The image sensor according to claim 1, further comprising: include: A mask layer is disposed on the first photoelectric conversion device, and the first side or the second side of the first photoelectric conversion device is shielded.

14. An image sensor, include: a phase detection pixel including a first photoelectric conversion device configured to generate a charge corresponding to incident light and a first pixel circuit configured to generate an output voltage corresponding to the charge received from the first photoelectric conversion device and a phase signal of the incident light; as well as A dynamic vision sensor pixel includes a second photoelectric conversion device and a second pixel circuit, wherein the second photoelectric conversion device is configured to generate the charge corresponding to the incident light, and the second pixel circuit is configured to generate an event signal by detecting a change in the intensity of the incident light based on the charge received from the second photoelectric conversion device.

15. The image sensor according to claim 14, further comprising: include: a first logic circuit configured to receive the phase signal from the first pixel circuit; a second logic circuit configured to receive the event signal from the second pixel circuit; as well as An image signal processor is configured to receive data output from the first logic circuit and the second logic circuit.

16. The image sensor according to claim 15, in, The image signal processor generates signals that control: a first mode in which the first photoelectric conversion device is connected to the first pixel circuit and the second photoelectric conversion device is connected to the second pixel circuit, a second mode in which the first photoelectric conversion device is connected to the second pixel circuit, and A third mode in which the second photoelectric conversion device is connected to the first pixel circuit.

17. The image sensor according to claim 16, further comprising: include: a first switch disposed between the second photoelectric conversion device and the second pixel circuit and including one end electrically connected to the second photoelectric conversion device and another end electrically connected to the second pixel circuit; as well as a second switch including one end electrically connected between the first photoelectric conversion device and the first pixel circuit and the other end electrically connected to one end of the first switch, wherein, in the first mode, the image signal processor turns on the first switch and turns off the second switch, wherein, in the second mode, the image signal processor turns on the first switch and turns on the second switch, and Wherein, in the third mode, the image signal processor turns off the first switch and turns on the second switch.

18. The image sensor according to claim 14, in, The first photoelectric conversion device and the second photoelectric conversion device are disposed on a semiconductor die different from a semiconductor die on which the first pixel circuit and the second pixel circuit are disposed.

19. The image sensor according to claim 14, in, The first pixel circuit and the second pixel circuit are disposed on a same semiconductor die.

20. An image sensor, include: a first semiconductor die including a first photoelectric conversion device and a second photoelectric conversion device that converts an optical signal into an electrical signal; as well as A second semiconductor die comprising: a first pixel circuit including a first transistor, a second transistor, and a third transistor, the first transistor transmitting the electrical signal received from the first photoelectric conversion device to a floating diffusion node, the second transistor having a gate electrode connected to the floating diffusion node, and the third transistor resetting the floating diffusion node; as well as A second pixel circuit includes an output logic circuit that generates an event signal by detecting a change in intensity of an optical signal based on the electrical signal received from the second photoelectric conversion device.

Citation Information

Patent Citations

  • Method for manufacturing glassy carbon coating layer

    KR1020230069425A