Merging in mixed pixel structure of image pixels and event vision sensor (EVS) pixels

By combining intensity photodiodes and EVS photodiodes in the image sensor and using the programming mode of combined transistors, the problem of image sensor detection efficiency and power consumption under low light conditions is solved, and more efficient object depth and light quantity detection is achieved.

CN118975265APending Publication Date: 2024-11-15SONY SEMICON SOLUTIONS CORP
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202380032948.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-15
Filing Date
2023-03-22
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

When existing image sensors detect object depth and light volume under low light conditions, resolution and power consumption are difficult to take into account, and the detection efficiency of event vision sensor (EVS) photodiodes is low.

Method used

A hybrid image sensor is used, combining intensity photodiodes and EVS photodiodes, and improving ambient light subtraction and pixel response speed by combining the programming mode of transistors.

Benefits of technology

The event detection capability of EVS photodiodes is enhanced under typical contrast and low light conditions, improving the resolution and efficiency of the image sensor and reducing power consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118975265A_ABST
    Figure CN118975265A_ABST
Patent Text Reader

Abstract

Merging in a hybrid pixel structure of image pixels and event vision sensor (EVS) pixels. In one embodiment, an image sensor includes a pixel array including a plurality of pixel circuits and a plurality of merge transistors. The first portions of the plurality of pixel circuits individually include intensity photodiodes. Second portions of the plurality of pixel circuits individually include event vision sensor (EVS) photodiodes. The plurality of merging transistors are configured to merge together at least one of the first portion and the second portion.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates generally to image sensors and more particularly to programmable floating diffusion merging in a hybrid structure of image pixels and event vision sensor (EVS) pixels. Background Art

[0002] An image sensing device typically includes an image sensor, which is typically implemented as an array of pixel circuits, as well as signal processing circuitry and any associated control or timing circuitry. Within the image sensor itself, charge is collected in the photoelectric conversion devices of the pixel circuits as a result of impinging light. There are typically a very large number of individual photoelectric conversion devices (e.g., tens of millions), as well as many signal processing circuit components working in parallel. A large number of photoelectric conversion devices share various components within the signal processing circuitry; for example, one or more columns of photoelectric conversion devices may share a single analog-to-digital converter (ADC) or sample and hold (S / H) circuit.

[0003] In photography applications, the output of the pixel circuit is used to generate an image. In addition to photography, image sensors are used in a variety of applications that can use the collected charge for additional or alternative purposes. For example, in applications such as gaming machines, automated vehicles, telemetry systems, factory inspection, gesture-controlled computer input devices, etc., it may be desirable to detect the depth of objects in three-dimensional space and / or detect the amount of light reflected off objects in the same three-dimensional space.

[0004] In addition, some image sensors support pixel merging (binning) operations. In binning, input pixel values ​​from adjacent pixel circuits are averaged with or without weights to produce output pixel values. Binning results in a reduction in resolution or pixel count in the output image, and can be utilized to allow image sensors to operate efficiently in low light conditions or with reduced power consumption. Summary of the invention

[0005] Various aspects of the present disclosure relate to apparatus, methods and systems for imaging with ambient light subtraction therein. Specifically, the present disclosure is directed to merging to enhance event detection of EVS photodiodes under typical contrast and low light conditions. Additionally, merging in EVS photodiodes can also increase pixel response speed.

[0006] In one aspect of the present disclosure, an image sensor is provided. The image sensor includes a pixel array, the pixel array including a plurality of pixel circuits and a plurality of merging transistors. A first portion of the plurality of pixel circuits individually includes an intensity photodiode. A second portion of the plurality of pixel circuits individually includes an event vision sensor (EVS) photodiode. The plurality of merging transistors are configured to merge at least one of the first portion and the second portion together.

[0007] In another aspect of the present disclosure, a method is provided. The method includes controlling a plurality of merging transistors according to a first mode using a control circuit. The method also includes controlling the plurality of merging transistors with the control circuit to change from the first mode to a second mode. In the second mode, the plurality of merging transistors merge at least one of a first portion of a plurality of pixel circuits and a second portion of a plurality of pixel circuits in a pixel array. The first portion of the plurality of pixel circuits individually includes an intensity photodiode and the second portion of the plurality of pixel circuits individually includes an event vision sensor (EVS) photodiode.

[0008] In another aspect of the present disclosure, an electronic device is provided. The electronic device includes a pixel array, the pixel array includes a plurality of pixel circuits and a plurality of merging transistors. A first portion of the plurality of pixel circuits individually includes an intensity photodiode. A second portion of the plurality of pixel circuits individually includes an event vision sensor (EVS) photodiode. The plurality of merging transistors are configured to merge at least one of the first portion and the second portion together.

[0009] In this way, the above aspects of the present invention provide at least improvements in the technical field of object feature detection and the related technical fields of imaging, image processing and the like.

[0010] The present disclosure may be embodied in various forms, including computer-implemented methods, computer program products, hardware or circuits controlled by computer systems and networks, user interfaces and application programming interfaces; as well as hardware-implemented methods, signal processing circuits, image sensor circuits, application specific integrated circuits, field programmable gate arrays, etc. The foregoing summary is intended only to give a general idea of ​​the various aspects of the present disclosure and is not intended to limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] These and other more detailed and specific features of various embodiments are more fully disclosed in the following description with reference to the accompanying drawings, in which:

[0012] Figure 1 is a diagram illustrating an example imaging environment according to various aspects of the present disclosure;

[0013] Figure 2 is a circuit diagram illustrating an example image sensor according to various aspects of the present disclosure;

[0014] Figure 3 It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a first example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0015] Figure 4 It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a second example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0016] Figure 5 It is to show that according to various aspects of the present disclosure Figure 2 a diagram of a third example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0017] Figure 6 A diagram illustrating an example normal merging mode of four blending unit pixels according to various aspects of the present invention;

[0018] Figure 7 is a diagram illustrating an example horizontal merging pattern of four blending unit pixels according to various aspects of the present invention;

[0019] Figure 8 A circuit for illustrating an example vertically binning mode of four hybrid unit pixels according to various aspects of the present invention;

[0020] Fig. 9 It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a fourth example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0021] Fig.10 is a circuit illustrating example horizontal and vertical binning modes for eight hybrid unit pixels according to various aspects of the present invention;

[0022] Fig.11 It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a fifth example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0023] Fig.12 It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a sixth example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG.

[0024] Fig.13 is a circuit illustrating an example horizontal binning mode for eight blending unit pixels according to various aspects of the present invention;

[0025] Fig.14It is a diagram showing various aspects of the present disclosure. Figure 2 a diagram of a seventh example transistor arrangement for a hybrid unit pixel in an example image sensor of FIG. 1 ; and

[0026] Fig.15 is a flow chart illustrating a method according to various aspects of the present disclosure. DETAILED DESCRIPTION

[0027] In the following description, many details are set forth, such as flow charts, data tables, and system configurations. It will be apparent to those skilled in the art that these specific details are merely exemplary and are not intended to limit the scope of the present application.

[0028] In addition, although the present disclosure focuses on the example of processing circuits used in image sensors, it should be understood that this is only one example of implementation. It will be further understood that the disclosed devices, methods, and systems can be used in any device that needs to detect object features (e.g., facial detection).

[0029] Imaging System

[0030] Figure 1 is a diagram illustrating an example imaging environment 100 according to various aspects of the present disclosure. Figure 1 In the example of , the imaging environment 100 includes an imaging system 101 configured to image an object 102 located at a distance d. The imaging system 101 includes a light generator 111 configured to generate an emitted light wave 120 toward the object 102 and an image sensor 112 configured to receive a reflected light wave 130 from the object 102. The emitted light wave 120 may have a periodic waveform. The image sensor 112 may be any device capable of converting incident radiation into a signal. For example, the image sensor may be a complementary metal oxide semiconductor (CMOS) image sensor (CIS), a charge coupled device (CCD), etc. The imaging system 101 may also include a distance determination circuit, such as a controller 113 (e.g., a microprocessor or other suitable processing device) and a memory 114, which may be operated to perform one or more examples of object feature detection processing (e.g., face detection) and / or time of flight processing. The light generator 111, the image sensor 112, the controller 113, and the memory 114 may be communicatively connected to each other via one or more communication buses.

[0031] For example, light generator 111 may be a light emitting diode (LED), a laser diode, or any other light generating device or combination of devices, and the light waveform may be controlled by controller 113. The light generator may operate in the infrared range to reduce interference from the visible spectrum, but may utilize any wavelength range perceptible to image sensor 112. In some examples, controller 113 may be configured to receive a light intensity image from image sensor 112 from which ambient light has been subtracted, and to detect features of object 102 using the light intensity image. For example, the light intensity image may be an IR or near-IR light intensity image for detection of facial features. Additionally, in some examples, controller 113 may also be configured to receive a depth image from the image sensor and calculate a depth map indicating distances d to different points of object 102.

[0032] Figure 2 is a circuit diagram illustrating an example image sensor 200 according to various aspects of the present disclosure. The image sensor 200 includes an array 201 of pixel circuits 210. The pixel circuits 210 are located at intersections where horizontal signal lines 218 and vertical signal lines 217 cross each other. The horizontal signal lines 218 are operably connected to vertical drive circuits 220 (also called "row scanning circuits") at points outside the pixel array 201, and carry signals from the vertical drive circuits 220 to specific rows of the pixel circuits 210. The pixels in a specific column output analog signals corresponding to the corresponding amounts of incident light to the vertical signal lines 217. For purposes of illustration, in Figure 2 Only a subset of pixel circuits 210 are actually shown in FIG. 2 ; however, in practice, image sensor 200 may have as many as tens of millions of pixel circuits (“megapixels” or MPs) or more.

[0033] Vertical signal lines 217 conduct analog signals for a particular column to column circuits 230, also referred to as "signal processing circuits." Figure 2 A single readout circuit 231 is shown for all columns, but the image sensor 200 may utilize multiple readout circuits 231. The analog electrical signal generated in the photoelectric conversion device 201 in the pixel circuit 210 is retrieved by the readout circuit 231 and then converted to a digital value. This conversion typically requires several circuit elements, such as a sample and hold (S / H) circuit, an analog-to-digital converter (ADC), and timing and control circuits, each of which plays a role in the conversion. For example, the purpose of the S / H circuit may be to sample analog signals from different time phases of the operation of the photodiode, after which the analog signal may be converted to digital form by the ADC.

[0034] Figure 3 It is a diagram showing various aspects of the present disclosure. Figure 2FIG. 3 is a diagram of a first example transistor arrangement 302 of a hybrid unit pixel 300 in an example image sensor 200 of FIG. Figure 3 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0035] Specifically, the hybrid unit pixel 300 includes twelve image pixels and four EVS pixels. Among the twelve image pixels, the hybrid unit pixel 300 includes four red image pixels, four green image pixels, and four blue image pixels.

[0036] like Figure 3 As shown, from left to right, the first row of hybrid unit pixels 300 includes a first red image pixel, a first green image pixel, a second red image pixel, and a second green image pixel. The second row of hybrid unit pixels 300 includes a first EVS pixel, a first blue image pixel, a second EVS pixel, and a second blue image pixel. The third row of hybrid unit pixels 300 includes a third red image pixel, a third green image pixel, a fourth red image pixel, and a fourth green image pixel. The fourth row of hybrid unit pixels 300 includes a third EVS pixel, a third blue image pixel, a fourth EVS pixel, and a fourth blue image pixel.

[0037] like Figure 3 As shown, from left to right, the first row of the first example transistor arrangement 302 includes a first intensity photodiode PD4, a first intensity photodiode PD5, a second intensity photodiode PD4, and a second intensity photodiode PD4. Intensity photodiode PD4 corresponds to a red image pixel, and intensity photodiode PD5 corresponds to a green image pixel. The first intensity photodiode PD4 and the first intensity photodiode PD5 have a gate that shares a floating diffusion FD2. The second intensity photodiode PD4 and the second intensity photodiode PD5 have a gate that shares a floating diffusion FD3.

[0038] like Figure 3 As shown, from left to right, the second row of the first example transistor arrangement 302 includes a first EVS photodiode EVS_PD3, a first intensity photodiode PD6, a second EVS photodiode EVS_PD4, and a second intensity photodiode PD6. Intensity photodiode PD6 corresponds to a blue image pixel. EVS photodiode EVS_PD3 and EVS photodiode EVS_PD4 correspond to EVS pixels. EVS photodiode EVS_PD3 includes a sense node SN2, and EVS photodiode EVS_PD4 includes a sense node SN3.

[0039] The first intensity photodiode PD6 has a gate that shares a floating diffusion FD2 with the gates of the first intensity photodiode PD4 and the first intensity photodiode PD5. The second intensity photodiode PD6 has a gate that shares a floating diffusion FD3 with the gates of the second intensity photodiode PD4 and the second intensity photodiode PD5.

[0040] like Figure 3 As shown, from left to right, the third row of the first example transistor arrangement 302 includes a third intensity photodiode PD1, a third intensity photodiode PD2, a fourth intensity photodiode PD1, and a fourth intensity photodiode PD2. Intensity photodiode PD1 corresponds to a red image pixel and intensity photodiode PD2 corresponds to a green image pixel. The third intensity photodiode PD1 and the third intensity photodiode PD2 have a gate that shares a floating diffusion FD0. The fourth intensity photodiode PD1 and the fourth intensity photodiode PD2 have a gate that shares a floating diffusion FD1.

[0041] like Figure 3 As shown, from left to right, the fourth row of the first example transistor arrangement 302 includes a third EVS photodiode EVS_PD1, a third intensity photodiode PD3, a fourth EVS photodiode EVS_PD2, and a fourth intensity photodiode PD3. The intensity photodiode PD3 corresponds to a blue image pixel. The EVS photodiode EVS_PD1 and the EVS photodiode EVS_PD2 correspond to EVS pixels. The EVS photodiode EVS_PD1 includes a sensing node SN0, and the EVS photodiode EVS_PD2 includes a sensing node SN1.

[0042] The third intensity photodiode PD3 has a gate that shares a floating diffusion FD0 with the gates of the third intensity photodiodes PD1 and PD2. The fourth intensity photodiode PD3 has a gate that shares a floating diffusion FD1 with the gates of the fourth intensity photodiodes PD1 and PD2.

[0043] like Figure 3 As shown, the first example transistor arrangement 302 includes a plurality of AMP transistors, a plurality of LGT transistors, a plurality of select transistors, a plurality of ALSEN transistors, a FDI transistor and a reset transistor. The plurality of AMP transistors include a first AMP transistor, a second AMP transistor, an AMP1_D transistor and an AMP2_D transistor located on RDTI.

[0044] The first AMP transistor is adjacent to and between the first EVS photodiode EVS_PD3, the first intensity photodiode PD6, the third intensity photodiode PD1, and the third intensity photodiode PD2. The second AMP transistor is adjacent to and between the second EVS photodiode EVS_PD4, the second intensity photodiode PD6, the fourth intensity photodiode PD1, and the fourth intensity photodiode PD2. The AMP1_D transistor is adjacent to and between the second EVS photodiode EVS_PD4, the first intensity photodiode PD6, the third intensity photodiode PD2, and the fourth intensity photodiode PD1. The AMP2_D transistor is adjacent to and between the second EVS photodiode EVS_PD4, the first intensity photodiode PD6, the first intensity photodiode PD5, and the second intensity photodiode PD4.

[0045] The plurality of selection transistors include a first selection transistor SEL1 and a second selection transistor SEL2. The first selection transistor SEL1 is adjacent to and located between the first EVS photodiode EVS_PD3 and the third intensity photodiode PD1. The second selection transistor SEL2 is adjacent to and located between the second EVS photodiode EVS_PD4 and the fourth intensity photodiode PD1.

[0046] The plurality of LGT transistors include a first LGT transistor LGT1 and a second LGT transistor LGT2. The first LGT transistor LGT1 is adjacent to the fourth EVS photodiode EVS_PD2 and the third intensity photodiode PD3. The second LGT transistor LGT2 is adjacent to and located between the fourth EVS photodiode EVS_PD2, the third intensity photodiode PD3, the third intensity photodiode PD2, and the fourth intensity photodiode PD1.

[0047] The plurality of ALSEN transistors include a first ALSEN transistor ALSEN0 and a second ALSEN transistor ALSEN1. The first ALSEN transistor ALSEN0 is adjacent to the third EVS photodiode EVS_PD1. The second ALSEN transistor ALSEN1 is adjacent to the fourth EVS photodiode EVS_PD2.

[0048] The reset transistor RST is adjacent to the fourth intensity photodiode PD3. The FDI transistor is adjacent to the third EVS photodiode EVS_PD1 and the third intensity photodiode PD3.

[0049] In the hybrid unit pixel 300, the event pixels have a symmetrical distribution, and the imaging pixels can use a 2XN pattern pixel bin. In addition, the hybrid unit pixel 300 provides simple horizontal pixel merging (binning) due to the symmetrical color filter array within the hybrid unit pixel 400. The hybrid unit pixel 300 is also sufficient for EVS sensitivity and comparison of smaller unit cells of other CFA patterns.

[0050] Figure 4 It is a diagram showing various aspects of the present disclosure. Figure 2 FIG. 4 is a diagram of a second example transistor arrangement 402 of a hybrid unit pixel 400 in an example image sensor of FIG. Figure 4 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0051] The second example transistor arrangement 402 is similar to Figure 3 The first example transistor arrangement 302 of FIG. For example, the hybrid unit pixel 400 includes twelve image pixels and four EVS pixels. However, unlike the first example transistor arrangement 302, the second example transistor arrangement 402 includes four EVS pixels located at the center of the hybrid unit pixel 400 and has six green image pixels and three blue image pixels.

[0052] like Figure 4 As shown, from left to right, the first row of hybrid unit pixels 400 includes a first red image pixel, a first green image pixel, a second red image pixel, and a second green image pixel. The second row of hybrid unit pixels 400 includes a third green pixel, a first EVS pixel, a second EVS pixel, and a first blue image pixel. The third row of hybrid unit pixels 400 includes a third red image pixel, a third EVS pixel, a fourth EVS pixel, and a fourth green image pixel. The fourth row of hybrid unit pixels 300 includes a fifth green image pixel, a second blue image pixel, a sixth green image pixel, and a third blue image pixel.

[0053] like Figure 4 As shown, from left to right, the first row of the second example transistor arrangement 402 includes a first intensity photodiode PD5, a first intensity photodiode PD6, a second intensity photodiode PD5, and a second intensity photodiode PD6. Intensity photodiode PD5 corresponds to a red image pixel, and intensity photodiode PD6 corresponds to a green image pixel. The first intensity photodiode PD5 and the first intensity photodiode PD6 have a gate that shares a floating diffusion FD2. The second intensity photodiode PD5 and the second intensity photodiode PD6 have a gate that shares a floating diffusion FD3.

[0054] like Figure 4 As shown, from left to right, the second row of the second example transistor arrangement 402 includes a first intensity photodiode PD3, a first EVS photodiode EVS_PD1, a second EVS photodiode EVS_PD2, and a first intensity photodiode PD7. Intensity photodiode PD3 corresponds to a green image pixel, and intensity photodiode PD7 corresponds to a blue image pixel. EVS photodiode EVS_PD1 and EVS photodiode EVS_PD2 correspond to EVS pixels.

[0055] The EVS photodiode EVS_PD1 includes a sensing node SN0. The EVS photodiode EVS_PD2 includes a sensing node SN1. The EVS photodiode EVS_PD3 includes a sensing node SN2. The EVS photodiode EVS_PD4 includes a sensing node SN3.

[0056] The first intensity photodiode PD3 has a gate that shares the floating diffusion FD2 with the gates of the first intensity photodiode PD5 and the first intensity photodiode PD6. The first intensity photodiode PD7 has a gate that shares the floating diffusion FD3 with the gates of the second intensity photodiode PD5 and the second intensity photodiode PD6.

[0057] like Figure 4 As shown, from left to right, the third row of the second example transistor arrangement 402 includes a third intensity photodiode PD1, a third EVS photodiode EVS PD3, a fourth EVS photodiode PD4, and a fourth intensity photodiode PD2. The third intensity photodiode PD1 corresponds to a red image pixel, and the fourth intensity photodiode PD2 corresponds to a green image pixel. The third intensity photodiode PD1 has a gate that shares a floating diffusion FD0. The fourth intensity PD2 has a gate that shares a floating diffusion FD1.

[0058] like Figure 4 As shown, from left to right, the fourth row of the second example transistor arrangement 402 includes a fifth intensity photodiode PD3, a second intensity photodiode PD4, a sixth intensity photodiode PD6, and a third intensity photodiode PD4. The fifth intensity photodiode PD3 and the sixth intensity photodiode PD6 correspond to green image pixels. The intensity photodiode PD4 corresponds to a blue image pixel.

[0059] The fifth intensity photodiode PD3 and the second intensity photodiode PD4 have gates that share floating diffusion FD0 with the gate of the third intensity photodiode PD1. The sixth intensity photodiode PD6 and the third intensity photodiode PD4 have gates that share floating diffusion FD1 with the gate of the fourth intensity photodiode PD2.

[0060] like Figure 4 As shown, the second example transistor arrangement 402 includes a plurality of AMP transistors, a plurality of LGT transistors, a plurality of select transistors, a plurality of ALSEN transistors, a FDI transistor and a reset transistor. The plurality of AMP transistors include a first AMP transistor, a second AMP transistor, an AMP1_D transistor and an AMP2_D transistor located on RDTI.

[0061] The first AMP transistor is adjacent to and between the first EVS photodiode EVS_PD1, the third intensity photodiode PD7, the third intensity photodiode PD1, and the second EVS photodiode EVS_PD3. The second AMP transistor is adjacent to and between the second EVS photodiode EVS_PD2, the first intensity photodiode PD7, the fourth EVS photodiode EVS_PD3, and the fourth intensity photodiode PD2. The AMP1_D transistor is adjacent to and between the first EVS photodiode EVS1, the second EVS photodiode EVS_PD2, the third EVS photodiode EVS_PD3, and the fourth EVS photodiode EVS_PD4. The AMP2_D transistor is adjacent to and between the first EVS photodiode EVS_PD1, the second EVS photodiode EVS_PD2, the first intensity photodiode PD6, and the second intensity photodiode PD5.

[0062] The plurality of selection transistors include a first selection transistor SEL1 and a second selection transistor SEL2. The first selection transistor SEL1 is adjacent to and located between the third intensity photodiode PD3 and the third intensity photodiode PD1. The second selection transistor SEL2 is adjacent to and located between the second EVS photodiode EVS_PD2 and the fourth EVS photodiode EVS_PD4.

[0063] The plurality of LGT transistors include a first LGT transistor LGT1 and a second LGT transistor LGT2. The first LGT transistor LGT1 is adjacent to the second intensity photodiode PD4 and the sixth intensity photodiode PD6. The second LGT transistor LGT2 is adjacent to and located between the third EVS photodiode EVS_PD3, the fourth EVS photodiode EVS_PD4, the second intensity photodiode PD4 and the sixth intensity photodiode PD6.

[0064] The plurality of ALSEN transistors include a first ALSEN transistor ALSEN0 and a second ALSEN transistor ALSEN1. The first ALSEN transistor ALSEN0 is adjacent to the fifth intensity photodiode PD3. The second ALSEN transistor ALSEN1 is adjacent to the sixth intensity photodiode PD6.

[0065] The reset transistor RST is adjacent to the third intensity photodiode PD4. The FDI transistor is adjacent to the fifth intensity photodiode PD3 and the second intensity photodiode PD4.

[0066] Figure 5 It is to show that according to various aspects of the present disclosure Figure 2 FIG. 5 is a diagram of a third example transistor arrangement 502 of a hybrid unit pixel 500 in the example image sensor 200 of FIG. Figure 5 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0067] The third example transistor arrangement 502 includes fourteen image pixels and two EVS pixels. Among the fourteen image pixels, the hybrid unit pixel 500 includes four red image pixels, six green image pixels, and four blue image pixels.

[0068] like Figure 5 As shown, from left to right, the first row of hybrid unit pixels 500 includes a first red image pixel, a first green image pixel, a second red image pixel, and a second green image pixel. The second row of hybrid unit pixels 500 includes a third green image pixel, a first blue image pixel, a first EVS pixel, and a second blue image pixel. The third row of hybrid unit pixels 500 includes a third red image pixel, a fourth green image pixel, a fourth red image pixel, and a fifth green image pixel. The fourth row of hybrid unit pixels 500 includes a second EVS pixel, a third blue image pixel, a sixth green image pixel, and a fourth blue image pixel.

[0069] like Figure 5 As shown, from left to right, the first row of the third example transistor arrangement 502 includes a first intensity photodiode PD4, a first intensity photodiode PD5, a second intensity photodiode PD5, and a second intensity photodiode PD6. The first intensity photodiode PD4 and the second intensity photodiode PD5 correspond to red image pixels, and the first intensity photodiode PD5 and the second intensity photodiode PD6 correspond to green image pixels. The first intensity photodiode PD4 and the first intensity photodiode PD5 have gates that share a floating diffusion FD2. The second intensity photodiode PD5 and the second intensity photodiode PD6 have gates that share a floating diffusion FD3.

[0070] like Figure 5As shown, from left to right, the second row of the third example transistor arrangement 502 includes a third intensity photodiode PD6, a first intensity photodiode PD7, a first EVS photodiode EVS_PD4, and a second intensity photodiode PD7. The third intensity photodiode PD6 corresponds to a green image pixel. The intensity photodiode PD7 corresponds to a blue image pixel. The first EVS photodiode EVS_PD4 corresponds to an EVS pixel. The first EVS photodiode EVS_PD4 includes a sensing node SN3.

[0071] The third intensity photodiode PD6 and the first intensity photodiode PD7 have gates that share floating diffusion FD2 with the gates of the first intensity photodiode PD4 and the first intensity photodiode PD5. The second intensity photodiode PD7 has gates that share floating diffusion FD3 with the gates of the second intensity photodiode PD5 and the second intensity photodiode PD6.

[0072] like Figure 5 As shown, from left to right, the third row of the third example transistor arrangement 502 includes a third intensity photodiode PD1, a fourth intensity photodiode PD2, a fourth intensity photodiode PD1, and a fourth intensity photodiode PD2. Intensity photodiode PD1 corresponds to a red image pixel and intensity photodiode PD2 corresponds to a green image pixel. The third intensity photodiode PD1 and the third intensity photodiode PD2 have a gate that shares a floating diffusion FD0. The fourth intensity photodiode PD1 and the fourth intensity photodiode PD2 have a gate that shares a floating diffusion FD1.

[0073] like Figure 5 As shown, from left to right, the fourth row of the third example transistor arrangement 502 includes a second EVS photodiode EVS_PD1, a third intensity photodiode PD3, a sixth intensity photodiode PD6, and a fourth intensity photodiode PD3. Intensity photodiode PD3 corresponds to a blue image pixel. Intensity photodiode PD6 corresponds to a green image pixel. The second EVS photodiode EVS_PD1 corresponds to an EVS pixel. EVS photodiode EVS_PD1 includes a sensing node SN0.

[0074] The third intensity photodiode PD3 has a gate sharing floating diffusion FD0 with gates of third intensity photodiodes PD1 and PD2. The sixth intensity photodiode PD6 and the fourth intensity photodiode PD3 have a gate sharing floating diffusion FD1 with gates of fourth intensity photodiodes PD1 and PD2.

[0075] like Figure 5As shown, the third example transistor arrangement 502 includes a plurality of AMP transistors, a plurality of LGT transistors, a plurality of selection transistors, a plurality of ALSEN transistors, a FDI transistor and a reset transistor. The plurality of AMP transistors include a first AMP transistor, a second AMP transistor, an AMP1_D transistor and an AMP2_D transistor located on RDTI.

[0076] The first AMP transistor is adjacent to and between the third intensity photodiode PD6, the first intensity photodiode PD7, the third intensity photodiode PD1, and the third intensity photodiode PD2. The second AMP transistor is adjacent to and between the first EVS photodiode EVS_PD4, the second intensity photodiode PD7, the fourth intensity photodiode PD1, and the fifth intensity photodiode PD2. The AMP1_D transistor is adjacent to and between the first EVS photodiode EVS_PD4, the first intensity photodiode PD7, the third intensity photodiode PD2, and the fourth intensity photodiode PD1. The AMP2_D transistor is adjacent to and between the first EVS photodiode EVS_PD4, the first intensity photodiode PD5, the second intensity photodiode PD5, and the first intensity photodiode PD7.

[0077] The plurality of selection transistors include a first selection transistor SEL1 and a second selection transistor SEL2. The first selection transistor SEL1 is adjacent to and located between the third intensity photodiode PD6 and the third intensity photodiode PD1. The second selection transistor SEL2 is adjacent to and located between the first EVS photodiode EVS_PD4 and the fourth intensity photodiode PD1.

[0078] The plurality of LGT transistors include a first LGT transistor LGT1 and a second LGT transistor LGT2. The first LGT transistor LGT1 is adjacent to the third intensity photodiode PD3 and the sixth intensity photodiode PD6. The second LGT transistor LGT2 is adjacent to and located between the fourth intensity photodiode PD2, the fourth intensity photodiode PD1, the third intensity photodiode PD3 and the sixth intensity photodiode PD6.

[0079] The plurality of ALSEN transistors include a first ALSEN transistor ALSEN0 and a second ALSEN transistor ALSEN1. The first ALSEN transistor ALSEN0 is adjacent to the second EVS photodiode EVS_PD1. The second ALSEN transistor ALSEN1 is adjacent to the sixth intensity photodiode PD6.

[0080] The reset transistor RST is adjacent to the fourth intensity photodiode PD4. The FDI transistor is adjacent to the second EVS photodiode EVS_PD1 and the third intensity photodiode PD3.

[0081] Figure 6 6 is a diagram illustrating an example normal merging mode 600 of four blending unit pixels 602 to 608 according to various aspects of the present invention. Figure 6 In the example of FIG. 1 , each of the four mixing unit pixels 602 to 608 corresponds to Figure 3 The mixing unit pixel is 300.

[0082] In the example normal pixel binning mode 600, the floating diffusions within the four mixing unit pixels 602 to 608 can be programmed to be binned together. For example, floating diffusions of the same pixel color can be binned together. As shown in the mixing unit pixels 606 and 608, two red pixels can be binned together, and the shared floating diffusion of the two red pixels can be read out.

[0083] Figure 7 is a diagram illustrating an example horizontal merging pattern 700 of four blending unit pixels 702 to 708 according to various aspects of the present invention. Figure 7 In the example of FIG. 1 , each of the four mixing unit pixels 702 to 708 corresponds to Figure 3 The mixing unit pixel is 300.

[0084] Similar to the example normal pixel binning mode 600, in the example horizontal binning mode 700, the floating diffusions within the four blending unit pixels 702 to 708 can be programmed to be pixel binned together. For example, floating diffusions of the same pixel color can be binned together. As shown in the blending unit pixels 706 and 708, two red pixels can be binned together, and the shared floating diffusion of the two red pixels can be read out.

[0085] However, unlike the example normal merge mode 600, the example horizontal merge mode 700 also merges (electrically connects) two adjacent floating diffusions with the ALSEN0 transistor. In other words, when the ALSEN0 transistor is in the on state, the two adjacent floating diffusions are connected together. As shown in the hybrid unit pixels 706 and 708, the four red pixels in each hybrid unit pixel 706 and 708 are merged together and read out together. In this example, when horizontal merging is enabled, the number of column reads for imaging pixels is reduced.

[0086] Figure 8 8 is a circuit diagram illustrating an example vertical binning mode 800 for four blending unit pixels 802 to 808 according to various aspects of the present invention. Figure 8 In the example of FIG. 8 , four mixing unit pixels 802 to 808 include pixels corresponding to Figures 3 to 5 The imaging pixels in the hybrid unit pixels 300 to 500 are imaging pixels. Figure 8As shown, in the example vertical pixel binning mode 800, four hybrid unit pixels 802 to 808 have floating diffusions that are vertically binned together because the FDI transistor in each of the four hybrid unit pixels 802 to 808 is in an on state.

[0087] Fig. 9 It is a diagram showing various aspects of the present disclosure. Figure 2 FIG. 2 is a diagram of a fourth example transistor arrangement 902 of a hybrid unit pixel 900 in an example image sensor 200 of FIG. Fig. 9 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0088] Specifically, the hybrid unit pixel 900 includes 12 image pixels and 4 EVS pixels. Among the twelve image pixels, the hybrid unit pixel 900 includes four red image pixels, four green image pixels, and four blue image pixels.

[0089] The hybrid unit pixel 900 is similar to the hybrid pixel unit 300. Therefore, the description of the hybrid unit pixel 300 is applicable to the hybrid unit pixel 900, and redundant descriptions between the hybrid unit pixel 300 and the hybrid unit pixel 900 are not repeated here. For example, the imaging pixel, the EVS pixel, and the plurality of selection transistors remain similar between the hybrid unit pixel 300 and the hybrid unit pixel 900.

[0090] The difference between the hybrid unit pixel 300 and the hybrid unit pixel 900 is the type and position of the transistors adjacent to the imaging pixel and the EVS pixel. For example, in the hybrid unit pixel 900, the LGT1 transistor and the LGT2 transistor are located at the position of the ALSEN transistor and the FDI transistor of the hybrid unit pixel 300. In addition, in the hybrid unit pixel 900, the AMP1_D transistor and the AMP2_D transistor are located at the position of the ALSEN transistor and the reset transistor of the hybrid unit pixel 300. In addition, in the hybrid unit pixel 900, the VNG transistor and the SNG transistor are located at the position of the LGT1 transistor and the LGT2 transistor of the hybrid pixel 300, respectively. Finally, in the hybrid unit pixel 900, the reset transistor and the TG transistor are located at the position of the AMP2_D transistor and the AMP1_D transistor of the hybrid pixel 300.

[0091] Furthermore, the second hybrid cell pixel is directly adjacent to hybrid cell pixel 900, wherein the second hybrid cell is in a different column and does not share a column readout with hybrid cell pixel 900. The second hybrid cell pixel may generally correspond to hybrid cell pixel 900, except that the FBG transistor is located in the position of the TG transistor.

[0092] The EVS pixel of the hybrid unit pixel 900 generates a photocurrent that flows into the logarithmic converter (LGT). During horizontal and vertical pixel binning, only one logarithmic converter needs to be turned on to receive photocurrent from all EVS pixels in the image sensor 200. The TG transistor (and the FBG transistor in the second hybrid unit pixel) acts as a switch for the photocurrent from the EVS pixel to flow into the logarithmic converter.

[0093] In the hybrid unit pixel 900, the event pixels have a symmetrical distribution, and the sensing node of the EVS pixel can be incorporated with the VNG transistor, the SNG transistor, and the TG transistor (and the FBG transistor with respect to the second hybrid unit pixel) in different combinations.

[0094] Fig.10 1 is a circuit illustrating an example horizontal and vertical binning pattern 1000 for eight blending unit pixels 1002 to 1016 according to various aspects of the present invention. Fig.10 In the example of FIG. 1 , eight mixing unit pixels 1002 to 1016 include Fig. 9 The EVS pixel in the mixing unit pixel 900 corresponds to the EVS pixel.

[0095] like Fig.10 As shown, in the example horizontal and vertical pixel merging pattern 1000, eight hybrid unit pixels 1002 to 1016 have sensing nodes that are vertically and horizontally pixel-merged together because the SNG transistor and the VNG transistor in each of the eight hybrid unit pixels 1002 to 1016 are controlled (e.g., externally controlled) to be in an on state. Fig.10 In the example of , only one of the TG transistor and the FBG transistor is turned on because only one log converter needs to be turned on during merging. However, when different subsets of sensing nodes are merged together, more than one of the TG transistor and the FBG transistor can be turned on, and more than one of the log converters are used to receive photocurrent from different subsets of the merged sensing nodes. In some examples, when all SNG transistors and all VNG transistors are turned on, all EVS pixels in a sensor chip (e.g., image sensor 200) can be merged together to generate a single EVS output.

[0096] exist Fig.10In one example, the fourth hybrid unit pixel 1008 includes a TG transistor TG0, a SNG transistor SNG0, and a VNG transistor VNG0, and the third hybrid unit pixel 1006 includes a TG transistor TG1, a SNG transistor SNG1, and a VNG transistor VNG1. When the TG transistor TG0 is turned off, the TG transistor TG1 is turned on, the SNG transistors SNG0 and SNG1 are turned on, and the VNG transistor VNG0 is turned on, the photocurrent from the third hybrid unit pixel 1006 is added to the photocurrent of the fourth hybrid unit pixel 1008 and is transmitted to the logarithmic converter associated with the fourth hybrid unit pixel 1008.

[0097] In the exemplary horizontal and vertical binning mode 1000, the photocurrents are summed (e.g., in two rows / columns (left / right, top / bottom adjacent pixels)) and transmitted to a logarithmic converter. When the photocurrents are summed, the output voltage increases and the signal-to-noise ratio / background increases. Thus, in the exemplary horizontal and vertical binning mode 1000, the probability of event detection is enhanced under typical contrast and low light conditions compared to a normal, non-binning mode.

[0098] Additionally or alternatively, in some examples, the eight hybrid unit pixels 1002 to 1016 have sensing nodes that can be binned together vertically because the VNG transistor in each of the eight hybrid unit pixels 1002 to 1016 is controlled (e.g., externally controlled) to be in an on state. However, in these examples, the eight hybrid unit pixels 1002 to 1016 have sensing nodes that may not be binned together horizontally because the SNG transistor in each of the eight hybrid unit pixels 1002 to 1016 is controlled (e.g., externally controlled) to be in an off state. In other words, although Fig.10 An example horizontal and vertical pixel binning pattern 1000 of eight blending unit pixels 1002 to 1016 is illustrated, although the eight blending unit pixels 1002 to 1016 may also have a vertical-only pixel binning pattern.

[0099] Fig.11 It is a diagram showing various aspects of the present disclosure. Figure 2 FIG. 1 is a diagram of a fifth example transistor arrangement 1102 of a hybrid unit pixel 1100 in an example image sensor 200 of FIG. Fig.11 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0100] Specifically, the hybrid unit pixel 1100 includes fourteen image pixels and two EVS pixels. Among the fourteen image pixels, the hybrid unit pixel 1100 includes four red image pixels, six green image pixels, and four blue image pixels.

[0101] The hybrid unit pixel 1100 is similar to the hybrid pixel unit 500. Therefore, the description of the hybrid unit pixel 500 is applicable to the hybrid unit pixel 1100, and the redundant description between the hybrid unit pixel 500 and the hybrid unit pixel 1100 is not repeated here. In addition, although the hybrid unit pixel 1100 is similar to the hybrid pixel unit 500, the hybrid unit pixel 1100 has the same transistor configuration as the hybrid unit pixel 900. Therefore, the description of the hybrid unit pixel 900 is applicable to the hybrid unit pixel 1100, and the redundant description between the hybrid unit pixel 900 and the hybrid unit pixel 1100 is not repeated here.

[0102] in addition, Fig.10 The example horizontal and vertical binning pattern 1000 of FIG. 1 is also applicable to the fifth example transistor arrangement 1102. The main difference is the binning of two sense nodes instead of four sense nodes per hybrid cell pixel.

[0103] Fig.12 It is a diagram showing various aspects of the present disclosure. Figure 2 FIG. 1 is a diagram of a sixth example transistor arrangement 1202 of a hybrid unit pixel 1200 in the example image sensor 200 of FIG. Fig.12 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0104] Specifically, the hybrid unit pixel 1200 includes twelve image pixels and four EVS pixels. Among the twelve image pixels, the hybrid unit pixel 1200 includes four red image pixels, four green image pixels, and four blue image pixels.

[0105] The hybrid unit pixel 1200 is similar to the hybrid unit pixel 300. Therefore, the description of the hybrid unit pixel 300 is applicable to the hybrid unit pixel 1200, and the redundant description between the hybrid unit pixel 300 and the hybrid unit pixel 1200 is not repeated here. In addition, although the hybrid unit pixel 1200 is similar to the hybrid pixel unit 300, the hybrid unit pixel 1200 has a transistor configuration that is similar to but slightly different from the hybrid unit pixel 900. Therefore, the description of the hybrid unit pixel 900 is applicable to the hybrid unit pixel 1200, and the redundant description between the hybrid unit pixel 900 and the hybrid unit pixel 1200 is not repeated here.

[0106] The difference between the hybrid unit pixel 900 and the hybrid unit pixel 1200 is the elimination of the VNG transistor. By eliminating the VNG transistor, the sensing nodes of the hybrid unit pixel 1200 cannot be merged in the vertical direction. However, the sensing nodes of the hybrid unit pixel 1200 can still be merged in the horizontal direction with the SNG transistor.

[0107] Fig.13 1 is a circuit illustrating an example horizontal binning pattern 1300 for eight blending unit pixels 1302 to 1316 according to various aspects of the present invention. Fig.13 In the example of FIG. 1 , eight mixing unit pixels 1302 to 1316 include Fig.12 The EVS pixel in the mixing unit pixel 1200 corresponds to the EVS pixel.

[0108] like Fig.13 As shown, in the example horizontal merging mode 1300, eight hybrid unit pixels 1302 to 1316 have sensing nodes that are horizontally merged together because the SNG transistors (there is no VNG transistor) in each of the eight hybrid unit pixels 1302 to 1316 are controlled (e.g., externally controlled) to be in an on state. Fig.13 In the example of , one of the TG transistors in each row is turned on because only one log converter per row needs to be turned on during binning. In some examples, when all SNG transistors are turned on, all EVS pixels in a sensor chip (e.g., image sensor 200) can be binned together row by row to generate multiple EVS outputs from each row.

[0109] In the example horizontal binning mode 1300, the TG transistor of the hybrid unit pixel 1302 is turned off, while the TG transistor of the hybrid unit pixel 1310 is turned on, and the SNG transistors of both the hybrid unit pixels 1302 and 1310 are turned on. The photocurrent at the sense node of the hybrid unit pixel 1302 is transferred from the hybrid unit pixel 1302 to the sense node of the hybrid unit pixel 1310.

[0110] The SNG control signal is a horizontal signal and should always be turned on during the merge mode and should always be turned off in the normal mode. The TG control signal is a vertical signal and is always turned on in the normal mode. One of the TG control signals is turned off in the binning mode and can be used to control the resolution of the EVS pixels in the image sensor 200.

[0111] The left and right photocurrents are summed and sent to a logarithmic converter. The output voltage of each row increases, and the signal-to-noise / background ratio also increases. Therefore, in the example horizontal binning mode 1300, the probability of event detection is enhanced under typical contrast and low light conditions compared to normal, non-binning mode.

[0112] Fig.14 It is a diagram showing various aspects of the present disclosure. Figure 2 FIG. 1 is a diagram of a seventh example transistor arrangement 1402 of a hybrid unit pixel 1400 in the example image sensor 200 of FIG. Fig.14 In the example of Figure 2 The sixteen pixels of the pixel circuit 210 are isolated from each other using rear deep trench isolation (RDTI).

[0113] Specifically, the hybrid unit pixel 1400 includes fourteen image pixels and two EVS pixels. Among the fourteen image pixels, the hybrid unit pixel 1400 includes four red image pixels, six green image pixels, and four blue image pixels.

[0114] The hybrid unit pixel 1400 is similar to the hybrid unit pixel 500. Therefore, the description of the hybrid unit pixel 500 is applicable to the hybrid unit pixel 1400, and the redundant description between the hybrid unit pixel 500 and the hybrid unit pixel 1400 is not repeated here. In addition, although the hybrid unit pixel 1400 is similar to the hybrid pixel unit 500, the hybrid unit pixel 1400 has a transistor configuration similar to the hybrid unit pixel 1200. Therefore, the description of the hybrid unit pixel 1200 is applicable to the hybrid unit pixel 1400, and the redundant description between the hybrid unit pixel 1200 and the hybrid unit pixel 1400 is not repeated here.

[0115] Fig.13 The example horizontal binning pattern 1300 of FIG. 1 is also applicable to the seventh example transistor arrangement 1402. The main difference is the binning of two sense nodes instead of four sense nodes per hybrid cell pixel.

[0116] Fig.15 1 is a flow chart illustrating a method 1500 according to various aspects of the present disclosure. The method includes controlling a plurality of merging transistors according to a first mode with a control circuit (at block 1502). The method also includes controlling the plurality of merging transistors to change from the first mode to a second mode with a control circuit (at block 1504).

[0117] In the second mode, the plurality of binning transistors bin together at least one of a first portion of a plurality of pixel circuits in a pixel array and a second portion of the plurality of pixel circuits, the first portion of the plurality of pixel circuits individually comprising intensity photodiodes and the second portion of the plurality of pixel circuits individually comprising event vision sensor (EVS) photodiodes.

[0118] In some examples, the first mode is a non-merging mode, and in the non-merging mode, the plurality of merging transistors are in an off state.

[0119] In some examples, the second mode is a first merging mode, and the plurality of merging transistors include a plurality of SNG transistors, and in the first merging mode, the control circuit controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

[0120] In some examples, the plurality of merging transistors include a plurality of VNG transistors. In these examples, in a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together column by column based on the pixel array.

[0121] In some examples, the second mode is a first merging mode and the plurality of merging transistors include a plurality of ALSEN transistors. In the first merging mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the first portion of floating diffusions together on a row-by-row basis of the pixel array.

[0122] In some examples, the plurality of merging transistors include a plurality of VNG transistors. In these examples, in a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of floating diffusions together column by column based on the pixel array.

[0123] In some examples, the first mode is a first merging mode and the second mode is a second merging mode, and the plurality of merging transistors include a plurality of SNG transistors. In these examples, in the first merging mode, the control circuit controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

[0124] In some examples, the plurality of merging transistors include a plurality of VNG transistors. In a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together column by column based on the pixel array.

[0125] In some examples, the first mode is a first merging mode and the second mode is a second merging mode. In these examples, the plurality of merging transistors includes a plurality of ALSEN transistors, and in the first merging mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the first portion of floating diffusions together on a row-by-row basis of the pixel array.

[0126] In some examples, the plurality of merging transistors include a plurality of VNG transistors. In these examples, in a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of floating diffusions together column by column based on the pixel array.

[0127] The examples listed below are examples of image sensors, methods, and electronic devices described herein. Example 1: An image sensor comprising: a pixel array comprising a plurality of pixel circuits; and a plurality of merging transistors, wherein a first portion of the plurality of pixel circuits individually comprises intensity photodiodes, and a second portion of the plurality of pixel circuits individually comprises event vision sensor (EVS) photodiodes, and wherein the plurality of merging transistors are configured to merge at least one of the first portion and the second portion together.

[0128] Example 2: The image sensor according to Example 1, wherein the plurality of merging transistors include a plurality of SNG transistors that horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

[0129] Example 3: The image sensor according to any one of Examples 1 or 2, wherein the plurality of merging transistors include a plurality of VNG transistors that vertically merge the sensing nodes of the second portion together column by column based on the pixel array.

[0130] Example 4: The image sensor of any of Examples 1 to 3, wherein the plurality of merging transistors comprises a plurality of ALSEN transistors that horizontally merge the floating diffusions of the first portion together on a row-by-row basis of the pixel array.

[0131] Example 5: The image sensor of any one of Examples 1 to 4, wherein the plurality of merging transistors include a plurality of FDI transistors that vertically merge the floating diffusions of the first portion together on a column-by-column basis on a pixel array.

[0132] Example 6: An image sensor according to any one of Examples 1 to 5, wherein a plurality of pixel circuits form a hybrid unit pixel, wherein a first portion associated with the hybrid unit pixel is twelve intensity photodiodes, wherein a second portion associated with the hybrid unit pixel is four EVS photodiodes, and wherein each of the twelve intensity photodiodes has a gate shared with one of four floating diffusions.

[0133] Example 7: An image sensor according to any one of Examples 1 to 6, wherein a plurality of pixel circuits form a hybrid unit pixel, wherein a first portion associated with the hybrid unit pixel is fourteen intensity photodiodes, wherein a second portion associated with the hybrid unit pixel is four EVS photodiodes, and wherein each of the fourteen intensity photodiodes has a gate shared with one of the four floating diffusions.

[0134] Example 8: The image sensor of Example 7, wherein the fourteen intensity photodiodes include four intensity photodiodes with blue filters, six intensity photodiodes with green filters, and four intensity photodiodes with red filters.

[0135] Example 9: A method comprising: controlling a plurality of merging transistors according to a first mode using a control circuit; and controlling the plurality of merging transistors to change from the first mode to a second mode using a control circuit, wherein, in the second mode, the plurality of merging transistors merge a first portion of a plurality of pixel circuits in a pixel array and at least one of a second portion of a plurality of pixel circuits together, and wherein the first portion of the plurality of pixel circuits individually includes an intensity photodiode and the second portion of the plurality of pixel circuits individually includes an event vision sensor (EVS) photodiode.

[0136] Example 10: The method of Example 9, wherein the first mode is a non-merging mode, and wherein, in the non-merging mode, the plurality of merging transistors are in an off state.

[0137] Example 11: A method according to any one of Examples 9 or 10, wherein the second mode is a first merge mode, and the plurality of merge transistors include a plurality of SNG transistors, and wherein, in the first merge mode, the control circuit system controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on a pixel array.

[0138] Example 12: A method according to any one of Examples 9 to 11, wherein the second mode is a first merging mode, and the plurality of merging transistors include a plurality of VNG transistors, wherein, in the first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together column by column based on a pixel array.

[0139] Example 13: A method according to any one of Examples 9 to 12, wherein the second mode is a first merging mode, and the plurality of merging transistors include a plurality of ALSEN transistors, and wherein, in the first merging mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the floating diffusions of the first portion together row by row based on a pixel array.

[0140] Example 14: The method of Example 13, wherein the plurality of merging transistors include a plurality of VNG transistors, wherein, in a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of floating diffusions together on a column-by-column basis of a pixel array.

[0141] Example 15: A method according to any one of Examples 9 to 14, wherein the first mode is a first merge mode and the second mode is a second merge mode, wherein the plurality of merge transistors include a plurality of SNG transistors, and wherein, in the first merge mode, the control circuit system controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on a pixel array.

[0142] Example 16: The method of Example 15, wherein the plurality of merging transistors include a plurality of VNG transistors, and wherein, in the first merging mode, the control circuit system controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together on a column-by-column basis of the pixel array.

[0143] Example 17: A method according to any one of Examples 9 to 16, wherein the first mode is a first merge mode and the second mode is a second merge mode, wherein the plurality of merge transistors include a plurality of ALSEN transistors, and wherein, in the first merge mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the floating diffusions of the first portion together row by row based on a pixel array.

[0144] Example 18: The method of Example 17, wherein the plurality of merging transistors include a plurality of VNG transistors, wherein, in a first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of floating diffusions together on a column-by-column basis of a pixel array.

[0145] Example 19: An electronic device comprising: a pixel array including a plurality of pixel circuits; and a plurality of merging transistors, wherein a first portion of the plurality of pixel circuits individually comprises an intensity photodiode and a second portion of the plurality of pixel circuits individually comprises an event vision sensor (EVS) photodiode, and wherein the plurality of merging transistors are configured to merge at least one of the first portion and the second portion together.

[0146] Example 20: The electronic device according to Example 19, wherein the plurality of merged transistors include a plurality of SNG transistors configured to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

[0147] in conclusion

[0148] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a particular ordered sequence, such processes may be practiced with the described steps performed in an order different from the order described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of the processes herein are provided for the purpose of illustrating certain embodiments and should in no way be construed as limiting the claims.

[0149] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. After reading the above description, many examples and applications other than the provided examples will be apparent. The scope should not be determined with reference to the above description, but with reference to the full range of equivalents given by the attached claims and these claims. It is expected and anticipated that future developments will occur in the technology discussed herein, and the disclosed systems and methods will be incorporated into such future examples. In short, it should be understood that the present application is capable of modification and variation.

[0150] Unless expressly indicated to the contrary herein, all terms used in the claims are intended to be given their broadest reasonable constructions and their ordinary meanings as understood by those skilled in the art as described herein. Specifically, unless a claim recites an express limitation to the contrary, use of the singular articles "a," "an," "the," and the like should be understood to recite one or more of the indicated elements.

[0151] The Abstract of the present disclosure is provided to allow the reader to quickly determine the nature of the technical disclosure. It is submitted with the understanding that it is not used to interpret or limit the scope or meaning of the claims. In addition, in the above detailed description, it can be seen that for the purpose of streamlining the present disclosure, the various features are combined together in various embodiments. This method of the present disclosure should not be interpreted as reflecting the intention that the claimed embodiments require more features than the features explicitly stated in each claim. On the contrary, as reflected in the following claims, the inventive subject matter lies in less than all the features of a single disclosed embodiment. Therefore, the following claims are hereby incorporated into the detailed description, with each claim independently serving as a separately claimed subject matter.

Claims

1. An image sensor, comprising: A pixel array including a plurality of pixel circuits; as well as Multiple merged transistors, wherein a first portion of the plurality of pixel circuits individually comprises intensity photodiodes and a second portion of the plurality of pixel circuits individually comprises event vision sensor (EVS) photodiodes, and The plurality of merged transistors are configured to merge at least one of the first portion and the second portion together.

2. The image sensor according to claim 1, wherein: The plurality of merging transistors include a plurality of SNG transistors horizontally merging the sensing nodes of the second portion together row by row based on the pixel array.

3. The image sensor according to claim 1, wherein: The plurality of merging transistors include a plurality of VNG transistors that vertically merge the sensing nodes of the second portion together column by column based on the pixel array.

4. The image sensor according to claim 1, wherein: The plurality of merging transistors include a plurality of ALSEN transistors that horizontally merge together the first portion of floating diffusions on a row-by-row basis of the pixel array.

5. The image sensor according to claim 1, wherein: The plurality of merging transistors include a plurality of FDI transistors that vertically merge floating diffusions of the first portion together on a column-by-column basis of the pixel array.

6. The image sensor according to claim 1, wherein: The plurality of pixel circuits form a hybrid unit pixel, wherein the first portion associated with the hybrid unit pixel is twelve intensity photodiodes, wherein the second portion associated with the hybrid unit pixel is four EVS photodiodes, and wherein each of the twelve intensity photodiodes has a gate shared with one of four floating diffusions.

7. The image sensor according to claim 1, wherein: The plurality of pixel circuits form a hybrid unit pixel, wherein the first portion associated with the hybrid unit pixel is fourteen intensity photodiodes, wherein the second portion associated with the hybrid unit pixel is four EVS photodiodes, and wherein each of the fourteen intensity photodiodes has a gate shared with one of four floating diffusions.

8. The image sensor according to claim 7, wherein: The fourteen intensity photodiodes include four intensity photodiodes having blue filters, six intensity photodiodes having green filters, and four intensity photodiodes having red filters.

9. A method comprising: controlling the plurality of merged transistors according to a first mode using a control circuit; as well as controlling the plurality of merging transistors using the control circuit to change from the first mode to a second mode, wherein, in the second mode, the plurality of merging transistors merge at least one of a first portion of a plurality of pixel circuits in a pixel array and a second portion of the plurality of pixel circuits together, and wherein the first portion of the plurality of pixel circuits individually include intensity photodiodes and the second portion of the plurality of pixel circuits individually include event vision sensor (EVS) photodiodes.

10. The method according to claim 9, wherein: The first mode is a non-merging mode, and wherein, in the non-merging mode, the plurality of merging transistors are in an off state.

11. The method according to claim 9, wherein: The second mode is a first merging mode, and the plurality of merging transistors include a plurality of SNG transistors, and wherein, in the first merging mode, the control circuit system controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

12. The method according to claim 9, wherein: The second mode is a first merging mode, and the plurality of merging transistors include a plurality of VNG transistors, wherein in the first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together column by column based on the pixel array.

13. The method according to claim 9, wherein: The second mode is a first merging mode, and the plurality of merging transistors include a plurality of ALSEN transistors, and wherein, in the first merging mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the first portion of floating diffusions together on a row-by-row basis of the pixel array.

14. The method according to claim 13, wherein: The plurality of merging transistors include a plurality of VNG transistors, wherein, in the first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of the floating diffusions together on a column-by-column basis of the pixel array.

15. The method according to claim 9, wherein: The first mode is a first merge mode, and the second mode is a second merge mode, wherein the plurality of merge transistors include a plurality of SNG transistors, and wherein, in the first merge mode, the control circuit system controls the plurality of SNG transistors to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

16. The method according to claim 15, wherein: The plurality of merging transistors include a plurality of VNG transistors, and wherein, in the first merging mode, the control circuitry controls the plurality of VNG transistors to vertically merge the sensing nodes of the second portion together on a column-by-column basis of the pixel array.

17. The method according to claim 9, wherein: The first mode is a first merging mode and the second mode is a second merging mode, wherein the plurality of merging transistors include a plurality of ALSEN transistors, and wherein, in the first merging mode, the control circuit controls the plurality of ALSEN transistors to horizontally merge the floating diffusions of the first portion together row by row based on the pixel array.

18. The method according to claim 17, wherein: The plurality of merging transistors include a plurality of VNG transistors, wherein, in the first merging mode, the control circuit controls the plurality of VNG transistors to vertically merge the first portion of the floating diffusions together on a column-by-column basis of the pixel array.

19. An electronic device comprising: A pixel array including a plurality of pixel circuits; as well as Multiple merged transistors, wherein a first portion of the plurality of pixel circuits individually comprises intensity photodiodes and a second portion of the plurality of pixel circuits individually comprises event vision sensor (EVS) photodiodes, and The plurality of merged transistors are configured to merge at least one of the first portion and the second portion together.

20. The electronic device according to claim 19, wherein: The plurality of merging transistors include a plurality of SNG transistors configured to horizontally merge the sensing nodes of the second portion together row by row based on the pixel array.

Citation Information

Cited By

  • Event-based visual sensor, image sensing device, and method for operating event-based visual sensor

    CN120238760A