Nine-pixel image sensor with phase detection autofocus
By adopting a 1x3 pixel circuit and a 9-unit pixel structure design in the image sensor, combined with the readout circuit and the routing circuit system, phase detection automatic focus is achieved, and the resolution and power consumption improvement in the prior art is difficult to achieve phase detection. Problem, improving the performance and functionality of the image sensor.
Patent Information
- Application Number
- CN202211471421.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-08
- Filing Date
- 2022-11-23
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-11-23
AI Technical Summary
While existing image sensors improve resolution and reduce power consumption, it is difficult to achieve effective phase detection automatic focus, affecting their performance and functionality in a variety of applications.
An image sensor design is adopted that includes a 1x3 pixel circuit and a 9-unit pixel structure, in which each 1x3 pixel circuit contains three photodiodes, which are coupled and grouped through multiple bit lines to form a 3x3 pixel structure, and use a readout circuit and a routing circuit. The system controls the coupling of bit lines to achieve phase detection automatic focus function.
It realizes improving the automatic focus capability of the image sensor without affecting resolution, enhancing its performance and functionality in a variety of applications, including devices such as cameras and mobile phones.
Smart Images

Figure CN116896691B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates generally to image sensors, and particularly, but not exclusively, to image sensors including binned pixels with phase detection autofocus. Background Art
[0002] Image sensors have become ubiquitous and are now widely used in digital cameras, cell phones, surveillance cameras, and in medical, automotive, and other applications. As image sensors are integrated into a wider range of electronic devices, it is desirable to enhance their functionality, performance metrics, and the like in as many ways as possible (e.g., resolution, power consumption, dynamic range, etc.) through both device architecture design and image acquisition processing. The technology used to manufacture image sensors continues to advance rapidly. For example, the demand for higher resolution and lower power consumption has driven further miniaturization and integration of these devices.
[0003] A typical complementary metal oxide semiconductor (CMOS) image sensor operates in response to image light from an external scene being incident on the image sensor. The image sensor includes a pixel array having a photosensitive element (e.g., a photodiode) that absorbs a portion of the incident image light and generates an image charge after absorbing the image light. The image charge generated by the pixel light can be measured as an analog output image signal on a column bit line, which varies with changes in the incident image light. In other words, the amount of image charge generated is proportional to the intensity of the image light, which is read out as an analog signal from the column bit line and converted into a digital value to generate a digital image (i.e., image data) representing the external scene. Summary of the invention
[0004] According to one aspect of the present disclosure, an imaging device is provided. The imaging device includes: a pixel array, which includes: a plurality of 1x3 pixel circuits arranged in rows and columns of the pixel array, wherein each 1x3 pixel circuit includes three photodiodes included in a corresponding column of the 1x3 pixel circuits in the pixel array, wherein the three photodiodes of each 1x3 pixel circuit included in the corresponding column of the 1x3 pixel circuits in the pixel array are included in corresponding three rows of the pixel array; a plurality of bit lines coupled to the plurality of 1x3 pixel circuits, wherein the plurality of bit lines are divided into groups of three bit lines per column of the 1x3 pixel circuits in the pixel array In the embodiment of the present invention, each column of the 1x3 pixel circuits in the pixel array includes a plurality of first groups of the 1x3 pixel circuits coupled to a first bit line of a corresponding group of the 3 bit lines, a plurality of second groups of the 1x3 pixel circuits coupled to a second bit line of the corresponding group of the 3 bit lines, and a plurality of third groups of the 1x3 pixel circuits coupled to a third bit line of the corresponding group of the 3 bit lines; and a plurality of 9-unit (9C) pixel structures, wherein the plurality of 1x3 pixel circuits are further arranged into groups of 3 1x3 pixel circuits per 9C pixel structure to form a plurality of 3x3 pixel structures of the pixel array.
[0005] According to another aspect of the present disclosure, an imaging system is provided. The imaging system includes: a pixel array, which includes: a plurality of 1x3 pixel circuits arranged in rows and columns of the pixel array, wherein each 1x3 pixel circuit includes 3 photodiodes included in a corresponding column of the 1x3 pixel circuits in the pixel array, wherein the 3 photodiodes of each 1x3 pixel circuit included in the corresponding column of the 1x3 pixel circuits in the pixel array are included in corresponding 3 rows of the pixel array; a plurality of bit lines coupled to the plurality of 1x3 pixel circuits, wherein the plurality of bit lines are divided into groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array, wherein each column of the 1x3 pixel circuits in the pixel array includes a first group of the 1x3 pixel circuits coupled to a first bit line of the corresponding group of the 3 bit lines, and a second group of the 1x3 pixel circuits coupled to a second bit line of the corresponding group of the 3 bit lines. a plurality of second groups of 1x3 pixel circuits and a plurality of third groups of 1x3 pixel circuits coupled to the third bit lines of the corresponding groups of the 3 bit lines; and a plurality of 9-unit (9C) pixel structures, wherein the plurality of 1x3 pixel circuits are further arranged into groups of 3 1x3 pixel circuits per 9C pixel structure to form a plurality of 3x3 pixel structures of the pixel array; and a readout circuit coupled to the pixel array to read out signals from the pixel array through the plurality of bit lines, the readout circuit comprising: a plurality of current sources coupled to the plurality of bit lines, wherein each of the plurality of current sources is coupled to a corresponding one of the plurality of bit lines; a plurality of comparators capacitively coupled to the plurality of bit lines; and a routing circuit system coupled between the plurality of bit lines and the plurality of comparators, wherein the routing circuit system is configured to control which of the plurality of bit lines are capacitively coupled to each of the plurality of comparators. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.
[0007] Figure 1 One example of an imaging system including a pixel array according to the teachings of the present invention is described.
[0008] Figure 2A One example of a schematic diagram illustrating a 1x3 pixel circuit coupled to a first bit line of a grouping of 3 bit lines per column of a pixel array in accordance with the teachings of the present disclosure.
[0009] Figure 2B One example of a schematic diagram illustrating a 1x3 pixel circuit coupled to the second bit line of a grouping of 3 bit lines per column of a pixel array in accordance with the teachings of the present disclosure.
[0010] Figure 2C One example of a schematic diagram illustrating a 1x3 pixel circuit coupled to the third bit line of a group of 3 bit lines per column of a pixel array in accordance with the teachings of the present disclosure.
[0011] Figure 2D An example of a 9-cell 3x3 pixel structure including 3 1x3 pixel circuits of a pixel array according to the teachings of the present disclosure is illustrated.
[0012] Figure 2E An example of a group of 9-unit 3x3 pixel structures of a pixel array according to the teachings of the present disclosure is illustrated.
[0013] Figure 2F One example of a group of 9-cell 3x3 pixel structures including phase detection autofocus photodiodes included in a center 2x2 grouping of photodiodes included in each 6x6 pixel structure in a pixel array is illustrated in accordance with the teachings of the present disclosure.
[0014] Figure 3 A detailed schematic diagram illustrating an example of a 6x6 pixel structure that includes four 9-cell 3x3 pixel structures according to the teachings of the present disclosure, the four 9-cell 3x3 pixel structures including a 2x2 arrangement of phase detection autofocus photodiodes included in a central 2x2 grouping of photodiodes included in each 6x6 pixel structure in the pixel array.
[0015] Figure 4 An example of a 6x6 pixel structure including a 9-unit 3x3 pixel structure and 2x2 groupings of phase detection autofocus photodiodes according to the teachings of the present disclosure is illustrated, wherein the 6x6 pixel structure is arranged along the rows of the pixel array in a repeating sequence of a first group, a second group, and then a third group of pixel circuits in the pixel array.
[0016] Figure 5A A detailed schematic diagram illustrating one example of an imaging device including a pixel circuit coupled to a bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator in accordance with the teachings of the present disclosure.
[0017] Figure 5B A detailed schematic diagram illustrating another example of an imaging device including a pixel circuit coupled to a bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator in accordance with the teachings of the present disclosure.
[0018] Figure 6 Detailed diagrams illustrating an example of 9-cell binning readout of all groups of pixel circuits included in a pixel array without reading out phase detection information in accordance with the teachings of the present disclosure are described.
[0019] Figure 7 A detailed schematic diagram illustrating yet another example of an imaging device including a pixel circuit coupled to a bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator in accordance with the teachings of the present disclosure.
[0020] Figure 8 A detailed diagram illustrating another example of a 9-cell binning readout of all groups of pixel circuits included in a pixel array with readout of phase detection information in accordance with the teachings of the present disclosure is illustrated.
[0021] Fig. 9 Detailed diagrams illustrating an example of full resolution readout of all groups of pixel circuits included in a pixel array without reading out phase detection information in accordance with the teachings of the present disclosure are described.
[0022] Corresponding reference characters indicate corresponding components throughout the several views in the drawings. It will be appreciated by those skilled in the art that the elements in the drawings are illustrated for simplicity and clarity, and that the elements are not necessarily drawn to scale. For example, the dimensions of some elements in the drawings may be exaggerated relative to other elements to help improve understanding of the various embodiments of the present invention. In addition, in order to more conveniently understand these various embodiments of the present invention, common but well-understood elements that are useful or necessary in commercially feasible embodiments are generally not depicted. DETAILED DESCRIPTION
[0023] Examples of imaging systems involving a 9-unit pixel image sensor including phase-detection autofocus pixels are described herein. In the following description, numerous specific details are set forth to provide a thorough understanding of the examples. However, one skilled in the relevant art will recognize that the techniques described herein may be practiced without one or more of the specific details or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail in order to avoid obscuring certain aspects.
[0024] References throughout this specification to "one example" or "one embodiment" mean that a particular feature, structure, or characteristic described in connection with the example is included in at least one example of the present invention. Thus, the appearance of the phrase "in one example" or "in one embodiment" in multiple places throughout this specification does not necessarily refer to the same example. Furthermore, particular features, structures, or characteristics may be combined in any suitable manner in one or more examples.
[0025] For ease of description herein, spatially relative terms (e.g., "below," "below," "above," "down," "above," "up," "top," "bottom," "left," "right," "center," "middle," and the like) may be used to describe the relationship of one element or feature relative to another (or some) element or feature, as illustrated in the figure. It should be understood that spatially relative terms are intended to cover different orientations of the device in use or operation other than the orientation depicted in the figure. For example, if the device in the figure is rotated or flipped, the element described as being "below" or "below" or "below" other elements or features will be oriented to be "above" other elements or features. Therefore, the exemplary terms "below" or "below" may cover both the orientations of above and below. The device may be oriented in other ways (rotated ninety degrees or in other orientations), and the spatially relative descriptors used herein may be interpreted accordingly. In addition, it should also be understood that when an element is referred to as being "between two other elements," it may be the only element between the other two elements, or one or more intervening elements may also be present.
[0026] Throughout this specification, several terms of the art are used. These terms have their ordinary meaning in the art to which they belong, unless specifically defined herein or the context of their use would clearly indicate otherwise. It should be noted that element names and symbols (e.g., Si vs. silicon) are used interchangeably throughout this document; however, both have the same meaning.
[0027] As will be discussed, various examples of imaging systems include a pixel array in which a plurality of 1x3 pixel circuits are arranged in rows and columns of the pixel array. Each 1x3 pixel circuit includes 3 photodiodes arranged along a corresponding column. A plurality of bit lines are coupled to the plurality of 1x3 pixel circuits. The plurality of bit lines are divided into groups of 3 bit lines per column of the 1x3 pixel circuits. Each column of the 1x3 pixel circuits in the pixel array includes a plurality of first groups of 1x3 pixel circuits coupled to a first bit line of a corresponding group of 3 bit lines, a plurality of second groups of 1x3 pixel circuits coupled to a second bit line of a corresponding group of 3 bit lines, and a plurality of third groups of 1x3 pixel circuits coupled to a third bit line of a corresponding group of 3 bit lines. The pixel array is further organized into a plurality of 9-unit (9C) pixel structures such that each of the 9C pixel structures includes 3 1x3 pixel structures, which form a 3x3 pixel structure.
[0028] In various examples, the color filter array is disposed above the pixel array. In one example, the color filter array includes red, green, and blue color filters arranged in a mosaic pattern such as a Bayer color filter array, so that each 9C pixel structure is under one of the color filters of the color filter array. In various examples, each 9C pixel structure is disposed under one of the color filters of the color filter array. In various examples, the new 9C pixel structure is arranged into 2x2 groups of 4 9C pixel structures, which form a 6x6 pixel structure. Thus, the four 9C pixel structures included in each 6x6 pixel structure are disposed under the red, green, green, and blue color filters of the Bayer color filter array disposed under the pixel array. In various examples, the center 2x2 grouping of photodiodes included in each 6x6 pixel structure can be configured to provide phase detection autofocus information from the pixel array.
[0029] Thus, in various examples, the pixel array may be configured to be read out as 9C binned pixels through all 3 bit lines per column simultaneously without phase detection information. In another example, the pixel array may be configured to be read out as 9C binned pixels through all 3 bit lines per column simultaneously with phase detection information. In yet another example, the pixel array may be configured to be read out as a full resolution or full size readout. In an example, during full size readout, one of the 3 bit lines per column is active, while the remaining 2 of the 3 bit lines per column are idle or not used.
[0030] In various examples, the circuitry for reading out the pixel circuits of the pixel array includes a current source and a comparator coupled to the bit line. In an example, the bit line is coupled to the comparator by routing circuitry. In various examples, the comparator is configured to compare the bit line coupled to the pixel circuit under the green color filter or under the blue or red color filter. Thus, the routing circuitry is configured to swap or route the bit lines as appropriate so that the corresponding comparator is coupled to compare only the pixel circuit under the green color filter or only the pixel circuit under the blue or red color filter, depending on the particular row of the pixel array being read out at that time.
[0031] To illustrate, Figure 1 An example of an imaging system 100 according to the teachings of the present invention is shown, the imaging system 100 includes a 1x3 pixel circuit and is coupled through a bit line to a readout circuit having a current source, routing circuitry, and a comparator. In particular, Figure 11 illustrates an imaging system 100 including a pixel array 102, bit lines 112, control circuitry 110, readout circuitry 106, and function logic 108. In one example, pixel array 102 is a two-dimensional (2D) array including a plurality of pixel circuits 104 (e.g., P1, P2, ..., Pn) arranged in rows (e.g., R1 to Ry) and columns (e.g., C1 to Cx) to acquire image data of a person, place, object, etc., which may then be used to present an image of the person, place, object, etc.
[0032] In various examples, each pixel circuit 104 may include one or more photodiodes configured to photogenerate image charge in response to incident light. For example, in one example, the pixel circuit 104 may include 3 photodiodes such that each pixel circuit 104 is a 1x3 pixel circuit. As will be discussed, in various examples, there are 3 bit lines per column for each column of the pixel circuit 104. The image charge generated in each photodiode is transferred to a floating diffusion included in each pixel circuit 104, which charge may be converted into an image signal or, in some cases, phase-detection autofocus information, and then read out from each pixel circuit 104 by the readout circuit 106 through the column bit lines 112. As will be discussed, in various examples, the readout circuit 106 may be configured to read out 9C merged image data, phase-detection autofocus data, and / or full-resolution image data through the column bit lines 112. In various examples, the readout circuit 106 may include current sources, routing circuitry, and comparators that may be included in an analog-to-digital converter or otherwise.
[0033] In an example, the digital image data values produced by the analog-to-digital converter in readout circuitry 106 may then be received by function logic 108. Function logic 108 may simply store the digital image data or even manipulate the digital image data by applying post-image effects (e.g., cropping, rotating, removing red eye, adjusting brightness, adjusting contrast, or otherwise).
[0034] In one example, control circuit 104 is coupled to pixel array 102 to control the operation of a plurality of photodiodes in pixel array 102. For example, control circuit 104 may generate a rolling shutter or shutter signal for controlling image acquisition. In other examples, image acquisition is synchronized with a lighting effect such as a flash.
[0035] In one example, the imaging system 100 may be included in a camera, cell phone, laptop computer, or the like. Additionally, the imaging system 100 may be coupled to other hardware parts, such as a processor (general purpose or otherwise), memory elements, outputs (USB ports, wireless transmitters, HDMI ports, etc.), lights / flashlights, electrical inputs (keyboards, touch displays, track pads, mice, microphones, etc.), and / or displays. The other hardware parts may deliver instructions to the imaging system 100, extract image data from the imaging system 100, or manipulate image data supplied by the imaging system 100.
[0036] Figure 2A An example schematic diagram of a pixel circuit 204A included in an imaging system having a photodiode array according to the teachings of the present invention is illustrated. It should be understood that Figure 2A The pixel circuit 204A may be as follows Figure 1 1. An example of one of the pixel circuits 104 included in the pixel array 102 is shown in FIG. 1, and similarly named and numbered elements described above are similarly coupled and function below.
[0037] exist Figure 2A 2, the pixel circuit 204A includes a photodiode 214-0 coupled to a transfer transistor 216-0, a photodiode 214-1 coupled to a transfer transistor 216-1, and a photodiode 214-2 coupled to a transfer transistor 216-2. Thus, each of the plurality of transfer transistors 216-0 to 216-2 is coupled to a respective one of the plurality of photodiodes 214-0 to 214-2. In the depicted example, it should be appreciated that the three photodiodes 214-0, 214-1, and 214-2 form a 1x3 pixel circuit 204A. In other words, in various examples, the three photodiodes 214-0, 214-1, and 214-2 can be viewed as one column of three rows of photodiodes or a 1x3 pixel circuit 204A. As will be discussed below, in various examples, the readout of the 3 photodiodes 214-0, 214-1 and 214-2 may be merged together or may be read out individually for full resolution readout. In another embodiment, one of the 3 photodiodes 214-0, 214-1 and 214-2 may be read out to provide phase detection autofocus information.
[0038] Continuing with the depicted example, shared floating diffusion 218 is coupled to transfer transistor 216-0, transfer transistor 216-1, and transfer transistor 216-2. Thus, each of the plurality of transfer transistors 216-0 to 216-2 is coupled between a respective one of the plurality of photodiodes 214-0 to 214-2 and shared floating diffusion 218. Thus, floating diffusion 218 is a shared floating diffusion configured to receive charge transferred from the plurality of photodiodes 214-0 to 214-2.
[0039] In operation, transfer transistor 216-0 is coupled to be controlled in response to transfer control signal TX0, transfer transistor 216-1 is coupled to be controlled in response to transfer control signal TX1, and transfer transistor 216-2 is coupled to be controlled in response to transfer control signal TX2. Thus, charge photogenerated in photodiode 214-0 in response to incident light is transferred to shared floating diffusion 218 in response to transfer control signal TX0, charge photogenerated in photodiode 214-1 in response to incident light is transferred to shared floating diffusion 218 in response to transfer control signal TX1, and charge photogenerated in photodiode 214-2 in response to incident light is transferred to shared floating diffusion 218 in response to transfer control signal TX2.
[0040] In the example, the dual floating diffusion transistor 224 is also coupled to the shared floating diffusion 218, and the dual floating diffusion capacitor C DFD 228 is coupled to the dual floating diffusion transistor 224, as shown. In an example, the dual floating diffusion transistor 224 can be turned on and off in response to the dual floating diffusion signal DFD to switch between low conversion gain readout or high conversion gain readout to increase the dynamic range of the image sensor. In an example, the reset transistor 226 is coupled between the voltage supply (e.g., AVDD) and the shared floating diffusion transistor 224. In operation, the reset transistor 226 is configured to reset the dual floating diffusion capacitor C in response to the reset control signal RST. DFD The pixel circuit 204A of 228 and the charge in the shared floating diffusion 218 .
[0041] In the illustrated example, the gate of the source follower transistor 220 is coupled to the shared floating diffusion 218. In the example, the drain of the source follower transistor 220 is coupled to a voltage supply (e.g., AVDD), and the source in the source follower transistor 220 is coupled to the first column bit line BL0 212-0 through the row select transistor 222. Therefore, in other words, the source follower transistor 220 and the row select transistor 222 are coupled between the voltage supply (e.g., AVDD) and the first column bit line 212-0. In operation, the row select transistor 222 is configured to output a signal in response to a row select signal RS that represents the charge in the shared floating diffusion 218 from the source follower transistor 220 of the pixel circuit 204A to the first column bit line 212-0.
[0042] As shown in the depicted example, there are three column bit lines for each column of BL0 212-0, BL1 212-1, and BL2 212-2 for each column of pixel cell 204A. As mentioned, pixel cell 204A is coupled to the first bit line BL0 212-0. Thus, since pixel cell 204A is coupled to the first bit line BL0 212-0 of the three bit lines BL0 212-0, BL1 212-1, and BL2 212-2 for each column of pixel cells, pixel cell 204A is considered to be included in the first grouping or first group of pixel cells, which is referred to as group 0 in the present disclosure. As described below Figures 2B to 2C 2, pixel cell 204B coupled to the second bit line BL1 212-1 of the three bit lines BL0 212-0, BL1 212-1, and BL2 212-2 of each column of pixel cells is considered to be included in Group 1. Similarly, pixel cell 204C coupled to the third bit line BL2 212-2 of the three bit lines BL0 212-0, BL1 212-1, and BL2 212-2 of each column of pixel cells is considered to be included in Group 2.
[0043] To illustrate, Figure 2B An example schematic diagram of a pixel circuit 204B included in an imaging system having a photodiode array according to the teachings of the present invention is illustrated. It should be understood that Figure 2B The pixel circuit 204B may be as follows Figure 1 1. Another example of one of the pixel circuits 104 included in the pixel array 102 is shown in FIG. 1, and the similarly named and numbered elements described above are similarly coupled and function below.
[0044] We should further understand that Figure 2B The pixel circuit 204B and Figure 2A The pixel circuit 204A shares many similarities. For example, there are three columns of bit lines BL0 212-0, BL1 212-1 and BL2 212-2 in each column of the pixel unit 204B. However, Figure 2B The pixel circuit 204B and Figure 2A The difference between the pixel circuit 204A is that Figure 2B In the pixel circuit 204B, the source of the source follower transistor 220 is coupled to the second column bit line BL1212-1 through the row select transistor 222, rather than Figure 2A The first column bit line BL0 212-0 is coupled to the three bit lines BL0 212-0, BL1 212-1 and BL2 212-2 of each column of the pixel unit as in the pixel circuit 204A of FIG. In one example, Figure 2A The pixel circuit 204A and Figure 2BPixel circuit 204B may be in the same column of the same pixel array with the same three column bit lines BL0 212-0, BL1 212-1, and BL2 212-2 for each column of pixel cells 204B. However, because pixel cell 204B is coupled to a second bit line BL0 212-1, pixel cell 204B is considered to be included in a second grouping or second set of pixel cells, which is referred to as set 1 in the present disclosure.
[0045] Figure 2C An example schematic diagram of a pixel circuit 204C included in an imaging system having a photodiode array according to the teachings of the present invention is illustrated. It should be understood that Figure 2C The pixel circuit 204C may be as follows Figure 1 1 is yet another example of one of the pixel circuits 104 included in the pixel array 102 shown in , and the similarly named and numbered elements described above are similarly coupled and function below.
[0046] We should further understand that Figure 2C The pixel circuit 204C and Figure 2B The pixel circuit 204B and Figure 2A The pixel circuit 204A shares many similarities. For example, each column of the pixel unit 204C has three columns of bit lines BL0 212-0, BL1 212-1 and BL2 212-2. However, Figure 2C The pixel circuit 204C and Figure 2B The pixel circuit 204B and Figure 2A The difference between the pixel circuit 204A is that Figure 2C In the pixel circuit 204C of FIG. 1 , the source of the source follower transistor 220 is coupled to the third column bit line BL2 212-2 through the row select transistor 222, rather than as in FIG. Figure 2B The pixel circuit 204B of FIG. 204B is coupled to the second column bit line BL1 212-1 of the three bit lines BL0 212-0, BL1 212-1 and BL2 212-2 of each column of the pixel unit, rather than as in FIG. Figure 2A The first column bit line BL0 212-0 is coupled to the three bit lines BL0 212-0, BL1 212-1 and BL2 212-2 of each column of the pixel unit as in the pixel circuit 204A of FIG. In one example, Figure 2A The pixel circuit 204A, Figure 2B The pixel circuit 204B and Figure 2CPixel circuit 204C may be in the same column of the same pixel array with the same three column bit lines BL0 212-0, BL1 212-1, and BL2 212-2 for each column of pixel cells 204C. However, because pixel cell 204C is coupled to a third bit line BL2 212-2, pixel cell 204C is considered to be included in a third grouping or set of pixel cells, which is referred to as set 2 in the present disclosure.
[0047] Figure 2D An example of a 9-unit 3x3 pixel structure 230 including 3 1x3 pixel circuits of a pixel array according to the teachings of the present disclosure is illustrated. Specifically, Figure 2D The example depicted in shows a 9-cell (9C) pixel structure 230, which can be viewed as a 3x3 pixel structure including 3 1x3 pixel circuits 204 arranged side by side to form 3 columns and 3 rows of photodiodes as shown. It should be understood that Figure 2B The three 1x3 pixel circuits 204 may be Figure 2A The pixel circuit 204A, Figure 2B The pixel circuit 204B or Figure 2C 212-0, BL1 212-1, BL2 212-2).
[0048] Figure 2E An example of a group N 236A of 9-cell (9C) 3x3 pixel structures of a pixel array according to the teachings of the present disclosure is illustrated. In various examples, group N 236A includes 9C pixel structures 230 arranged in rows and columns of the pixel array. It should be understood that Figure 2E The 9C pixel structure 230 depicted in FIG. 2 may be Figure 2D 236A, and similarly named and numbered elements described above are similarly coupled and function below. In various examples, N=0, 1, or 2 (e.g., Group 0, Group 1, Group 2) such that the 1x3 pixel circuits included in each 9C pixel structure in Group N 236A are all coupled to a first bit line BL0 212-0, a second bit line BL1 212-1, or a third bit line BL2 212-2, as discussed in detail above.
[0049] Figure 2EThe example depicted in also illustrates a color filter array disposed over the pixel array. In the example, the color filter array includes a color filter array arranged as a mosaic of color filters of three colors, such as red, green, and blue. In one example, the color filter array can be a Bayer color filter array such that the color filters are arranged in a repeating pattern of 2x2 squares of color filters, with repeated blue and green color filters in one row and repeated green and red color filters in an adjacent row.
[0050] like Figure 2E In the example illustrated in FIG. 1 , each of the 9C pixel structures is disposed under one of the color filters of the color filter array. In the depicted example, the blue color filter is indicated by a B label, and the green color filter in the same row as the blue color filter is indicated by a G label. B The red filter is indicated by an R mark, and the green filter in the same row as the red filter is indicated by a G mark. R Thus, it should be understood that the color filters along one diagonal line of the pattern of 2x2 square color filters are blue (B) and red (R), while the color filters along the other diagonal line of the pattern of 2x2 square color filters are both green (G). B and G R ).
[0051] It should be understood that each 2x2 square color filter is disposed on a corresponding 2x2 square 9C pixel structure 230. Thus, since each 9C pixel structure 230 includes Figure 2D As discussed in the above, three 1x3 pixel circuits 204 are arranged side by side, so each 2x2 square of color 9C pixel structure 230 forms a 6x6 pixel structure 232, which is formed by four 9C pixel structures 230 or twelve 1x3 pixel circuits 204.
[0052] Figure 2F An example of a group N 236B of a 9-unit 3x3 pixel structure including phase detection autofocus photodiodes included in a central 2x2 grouping of photodiodes included in each 6x6 pixel structure in a pixel array is illustrated in accordance with the teachings of the present disclosure. Specifically, Figure 2F A group N 236B of a pixel array is illustrated that includes 9C pixel structures 230 arranged in rows and columns of the pixel array. It should be appreciated that Figure 2F Group N 236B and above Figure 2E The group N 236A of the 9C pixel structure 230 discussed in FIG. 1 shares many similarities. For example, similar to Figure 2E Group N 236A, Figure 2FThe group N 236B also includes a 6x6 pixel structure 232 formed by four 9C pixel structures 230 or twelve 1x3 pixel circuits 204. In addition, each of the 9C pixel structures 230 is disposed on a color filter (e.g., B, G, etc.) of a color filter array disposed above the pixel array. B , G R , R).
[0053] Figure 2F Group N 236B with Figure 2E The difference between group N 236A is that included in Figure 2F Some of the photodiodes in group N 236B may be configured to provide phase detection information to the pixel array. Figure 2F , the central 2x2 grouping of photodiodes 234 of each 6x6 pixel structure 232 is configured to provide phase detection autofocus information. It should be appreciated that in the depicted example, each of the central 2x2 groupings of photodiodes 234 of each 6x6 pixel structure 232 is disposed in a respective interior corner of each of the included 4 9C pixel structures 230. Thus, in the example described herein, the 4 photodiodes included in each central 2x2 grouping of photodiodes 234 are disposed in respective B, G, and C pixel structures. B , G R In other examples, it should be appreciated that all of the four photodiodes included in each center 2x2 grouping of photodiodes 234 may be disposed under a green filter or a panchromatic filter, etc. In other words, in examples including photodiodes configured to provide phase detection information, the photodiodes configured to provide phase detection information are disposed under a green filter or a panchromatic filter, etc., while the photodiodes configured to provide image data are disposed under a red filter, a green filter, or a blue filter.
[0054] Figure 3 A detailed schematic diagram illustrating one example of a 6x6 pixel structure 332 including four 9-cell 3x3 pixel structures including a 2x2 arrangement of phase detection autofocus photodiodes included in a central 2x2 grouping of photodiodes included in each 6x6 pixel structure 332 in the pixel array in accordance with the teachings of the present disclosure. It should be appreciated that Figure 3 The 6x6 pixel structure 332 may be Figures 2E to 2F Detailed example of one of the 6x6 pixel structures 232 illustrated in FIG. 2 , and similarly named and numbered elements described above are similarly coupled and function below.
[0055] exist Figure 3In the example depicted in FIG. 1 , the 6x6 pixel structure 332 is illustrated as including a 3x3 blue 9C pixel structure 330B, a 3x3 green 9C pixel structure 330GB in the same row as the 3x3 blue 9C pixel structure 330G, a 3x3 red 9C pixel structure 330, and a 3x3 green 9C pixel structure 330GR in the same row as the 3x3 red 9C pixel structure 330. In the depicted example, the 2x2 phase detection 334 portion is positioned in the center 2x2 grouping of photodiodes to provide phase detection information for the pixel array. In the depicted example, the four photodiodes included in the center 2x2 grouping of photodiodes are illustrated as being disposed at respective B, G, and C phases. B , G R In other examples, it should be appreciated that all of the four photodiodes included in each center 2x2 grouping of photodiodes 234 may be disposed under a green filter or a panchromatic filter, etc. In other words, in examples including photodiodes configured to provide phase detection information, the photodiodes configured to provide phase detection information are disposed under a green filter or a panchromatic filter, etc., while the photodiodes configured to provide image data are disposed under a red filter, a green filter, or a blue filter.
[0056] The depicted example also illustrates that each column of photodiodes included in each respective 1x3 pixel circuit, such as 1x3 pixel circuit 204, is coupled to one of the three bit lines 312 for each column of the 1x3 pixel circuit. Figure 3 In the example depicted in FIG. 2 , it should be appreciated that all 1×3 pixel circuits are coupled to the first bit line (eg, BL0 212-0). Thus, it should be appreciated that Figure 3 212-1), then the example pixel 6x6 pixel structure would be included in Group 1. Similarly, if all 1x3 pixel circuits were coupled to a third bit line (e.g., BL2 212-2), then the example pixel 6x6 pixel structure would be included in Group 2.
[0057] Figure 3The example depicted in also illustrates that the first transfer control signal TX0 316-0B is coupled to control a first transfer control transistor in a row of 1x3 pixel circuits that include a 3x3 blue 9C pixel structure 330B, the second transfer control signal TX1 316-1B is coupled to control a second transfer control transistor in a row of 1x3 pixel circuits that include a 3x3 blue 9C pixel structure 330B, and the third transfer control signal TX2 316-2B is coupled to control a third transfer control transistor in a row of 1x3 pixel circuits that include a 3x3 blue 9C pixel structure 330B. Similarly, the first transfer control signal TX0 316-0R is coupled to control the first transfer control transistor in the row of the 1x3 pixel circuit including the 3x3 red 9C pixel structure 330R, the second transfer control signal TX1 316-1R is coupled to control the second transfer control transistor in the row of the 1x3 pixel circuit including the 3x3 red 9C pixel structure 330R, and the third transfer control signal TX2316-2R is coupled to control the third transfer control transistor in the row of the 1x3 pixel circuit including the 3x3 red 9C pixel structure 330R. Figure 3 The example depicted in further illustrates that the phase detection transfer control signal TXPD 316-P is coupled to control transfer control transistors coupled to the center 2x2 grouping of photodiodes included in the 6x6 pixel structure 332.
[0058] Figure 4 An example of groups 436A, 436B, 436C of a 6x6 pixel structure 432 including a 9-unit 3x3 pixel structure and a central 2x2 grouping of phase detection autofocus photodiodes 434 is illustrated, with groups 436A, 436B, 436C arranged along rows of a pixel array in a repeating sequence of first, second, and then third groups of pixel circuits in the pixel array. In other words, Figure 4 The example depicted in FIG. 4 shows that group 0 436A, group 1 436B, and group 2 436C are arranged in a repeating sequence along the rows of the pixel array. It should be understood that Figure 4 The groups 436A, 436B, 436C depicted in FIG. 4 may each be Figures 2E to 2F 436A, 236B are shown in the example of the groups 236A, 236B shown in FIG, and the similarly named and numbered elements described above are similarly coupled and function below. As discussed above, each of the 1x3 pixel circuits included in group 0 436A is coupled to a first bit line BL0 (e.g., BL0 212-0), each of the 1x3 pixel circuits included in group 1 436B is coupled to a second bit line BL1 (e.g., BL1 212-0), and each of the 1x3 pixel circuits included in group 2 436C is coupled to a third bit line BL2 (e.g., BL2 212-2).
[0059] Figure 5A A detailed schematic diagram illustrating one example of an imaging device including a pixel circuit coupled to a bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator according to the teachings of the present disclosure. It should be understood that Figure 5A The pixel circuit and bit line described in the above Figures 1 to 4 The examples of pixel circuits and bit lines discussed in , and similarly named and numbered elements described above are similarly coupled and function below.
[0060] For example, Figure 5A The example description described in Figure 3 The 6x6 pixel structure 332 shares many similarities with the pixel circuitry of the 6x6 pixel structure 532. Figure 5A 9C pixel structure 532 is illustrated as including a 3x3 9C pixel structure in the upper left corner of the 6x6 pixel structure 532, a 3x3 9C pixel structure in the upper right corner thereof, a 3x3 9C pixel structure in the lower left corner thereof, and a 3x3 9C pixel structure in the lower right corner thereof. In one example, the 3x3 9C pixel structure along the diagonal line from the upper left to the lower right of the 6x6 pixel structure 532 is a blue and red 3x3 9C pixel structure. In the example, the 3x3 9C pixel structure along the other diagonal line from the upper right to the lower left of the 6x6 pixel structure 532 is a green 3x3 9C pixel structure. In the depicted example, the 2x2 phase detection portion is positioned in the center 2x2 grouping of photodiodes to provide phase detection information for the pixel array.
[0061] In the example, each column of the 1x3 pixel circuits in the 6x6 pixel structure 532 includes three corresponding bit lines of the plurality of bit lines 512. For example, the bit lines BL0, BL1, BL2 are included in the first column of the 1x3 pixel circuits in the 6x6 pixel structure 532, the bit lines BL3, BL4, BL5 are included in the second column of the 1x3 pixel circuits in the pixel structure 532, the bit lines BL6, BL7, BL8 are included in the third column of the 1x3 pixel circuits in the pixel structure 532, the bit lines BL9, BL10, BL11 are included in the fourth column of the 1x3 pixel circuits in the pixel structure 532, the bit lines BL12, BL13, BL14 are included in the fifth column of the 1x3 pixel circuits in the pixel structure 532, and the bit lines BL15, BL16, BL17 are included in the sixth column of the 1x3 pixel circuits in the pixel structure 532.
[0062] Figure 5A The specific example depicted in illustratively shows that all 1x3 pixel circuits are coupled to the first of the 3 bit lines (e.g., BL0, BL3, BL6, BL9, BL12, BL15) of each column of the 6x6 pixel structure 532. Thus, it should be appreciated that Figure 5AThe example 6x6 pixel structure 532 depicted in FIG. 5 is included in group 0. It should be further noted that the pixel cells under the 6x6 pixel structure 532 are coupled to the second of the three bit lines (e.g., BL1, BL4, BL7, BL10, BL13, BL16) of each column of the 6x6 pixel structure 532. Thus, it should be understood that Figure 5A The pixel cells under the example 6x6 pixel structure 532 depicted in are included in group 1.
[0063] Figure 5A 516-0B, TX1 516-1B, and TX2 516-2B are coupled to control the top 3 transfer transistors in the top row of the 6x6 pixel structure 532. Similarly the first, second, and third transfer control signals TX0 516-0R, TX1 516-1R, and TX2 516-2R are coupled to control the bottom 3 transfer transistors in the bottom row of the 6x6 pixel structure 532. Figure 5A The example depicted in further illustrates that the phase detection transfer control signal TXPD 516-P is coupled to control transfer control transistors coupled to the center 2x2 grouping of photodiodes included in the 6x6 pixel structure 532.
[0064] In one example, the readout circuit includes a plurality of current sources 538 coupled to the plurality of bit lines 512 to read out an image or phase detection autofocus signal from a pixel circuit of the pixel array, a routing circuit system 540, and a plurality of comparators 542. Figure 5A As shown in the figure, multiple current sources 538 are coupled to multiple bit lines 512 so that each of the bit lines BL0, BL1, BL2, BL3, BL4, BL5, BL6, BL7, BL8, BL9, BL10, BL11, BL12, BL13, BL14, BL15, BL16, and BL17 in the multiple bit lines 512 is coupled to a corresponding current source in the multiple current sources 538.
[0065] In an example, the plurality of comparators 542 include a first comparator 542-B0 configured to compare signals from a blue or red pixel circuit coupled to a first bit line (e.g., BL0) of each 3-bit line grouping, a second comparator 542-B1 configured to compare signals from a blue or red pixel circuit coupled to a second bit line (e.g., BL1) of each 3-bit line grouping, a third comparator 542-B2 configured to compare signals from a blue or red pixel circuit coupled to a third bit line (e.g., BL2) of each 3-bit line grouping, a fourth comparator 542-G0 configured to compare signals from a green pixel circuit coupled to the first bit line (e.g., BL0) of each 3-bit line grouping, a fifth comparator 542-G1 configured to compare signals from a green pixel circuit coupled to a second bit line (e.g., BL1) of each 3-bit line grouping, and a sixth comparator 542-G2 configured to compare signals from a green pixel circuit coupled to a third bit line (e.g., BL2) of each 3-bit line grouping.
[0066] Continuing with the depicted example, routing circuitry 540 is coupled between the plurality of bit lines 512 and the plurality of comparators 542 to route each of the plurality of bit lines 512 to an appropriate one of the plurality of comparators 542 . For example, in a readout operation of a row of pixel circuits including blue and green pixel circuits, the routing circuitry 540 is configured to capacitively couple bit lines BL0, BL3, BL6 from group 0 to a first comparator 542-B0, capacitively couple bit lines BL1, BL4, BL7 from group 1 to a second comparator 542-B1, capacitively couple bit lines BL2, BL5, BL8 from group 2 to a first comparator 542-B1, capacitively couple bit lines BL9, BL12, BL15 from group 0 to a fourth comparator 542-G0, capacitively couple bit lines BL10, BL13, BL16 from group 1 to a fifth comparator 542-G1, and capacitively couple bit lines BL11, BL14, BL17 from group 2 to a sixth comparator 542-G2. As shown in the example, each bit line is capacitively coupled to the plurality of comparators 542 through a respective capacitance C, and the parasitic capacitance is represented by a capacitance Cp coupled to the input of each of the plurality of comparators 542.
[0067] Figure 5B A detailed schematic diagram illustrating another example of an imaging device including a pixel circuit coupled to a bit line, the bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator according to the teachings of the present disclosure. It should be understood that Figure 5B The pixel circuit and bit line described in the above Figures 1 to 4 The examples of pixel circuits and bit lines discussed in , and similarly named and numbered elements described above are similarly coupled and function below. It should be further understood that Figure 5BThe pixel circuit, bit line, current source, routing circuit system and comparator described in Figure 5A The pixel circuit, bit line, current source, routing circuit system and comparator described in are the same, the only difference is: Figure 5B The routing circuitry 540 depicted in FIG. 1 is configured to capacitively couple each of the plurality of bit lines 512 to an appropriate one of the plurality of comparators 540 during a readout operation for a row of pixel circuits including green and red pixel circuits, rather than the readout operation for a row of pixel circuits including blue and green pixel circuits depicted in FIG. Figure 5A . In operation, it should be appreciated that when rows of green and red pixel circuits are read out but not rows of blue and green pixel circuits, either the columns of green pixel circuits or the columns of blue and red pixel circuits are swapped. Thus, routing circuitry 540 is configured to swap inputs to each of the plurality of comparators 542 accordingly depending on which colors are read out from the pixel array.
[0068] For example, Figure 5B In the example depicted in , it is shown that in a readout operation of a row of pixel circuits including green and red pixel circuits, the routing circuit system 540 is configured to capacitively couple bit lines BL9, BL12, BL15 from group 0 to a first comparator 542-B0, capacitively couple bit lines BL10, BL13, BL16 from group 1 to a second comparator 542-B1, capacitively couple bit lines BL11, BL14, BL17 from group 2 to a third comparator 542-B2, capacitively couple bit lines BL0, BL3, BL6 from group 0 to a fourth comparator 542-G0, capacitively couple bit lines BL1, BL4, BL7 from group 1 to a fifth comparator 542-G1, and capacitively couple bit lines BL2, BL5, BL8 from group 2 to a sixth comparator 542-G2. As shown in the example, each bit line is capacitively coupled to the plurality of comparators 542 through a respective capacitance C, and the parasitic capacitance is represented by a capacitance Cp coupled to the input of each of the plurality of comparators 542 .
[0069] Figure 6 A detailed diagram illustrating an example of a 9-cell binning readout of all groups of pixel circuits included in a pixel array without reading out phase detection information in accordance with the teachings of the present disclosure is described. It should be appreciated that Figure 6 The example 9 depicted in the unit merge readout can be Figures 5A to 5B , and similarly named and numbered elements described above are similarly coupled and function below.
[0070] like Figure 6, the 9-cell binning readout of the pixel array occurs in a timing sequence of 4 readouts numbered 0, 1, 2, 3. During timing sequence 0, the blue (B) pixel circuits and the green (G) pixel circuits in the same row as the blue pixel circuits are read out from row addresses 0 / 1 / 2 of group 0, row addresses 12 / 13 / 14 of group 1, and row addresses 24 / 25 / 26 of group 2. B ) pixel circuit. Therefore, briefly returning to reference Figure 5A In the example depicted in FIG, routing circuit system 540 is configured such that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out blue pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, respectively, to read out green pixel circuits in the same row as the blue pixel circuits.
[0071] Next, during timing sequence 1, the red (R) pixel circuits and the green (G) pixel circuits in the same row as the red pixel circuits are read out from row addresses 3 / 4 / 5 of group 0, row addresses 15 / 16 / 17 of group 1, and row addresses 27 / 28 / 29 of group 2. R ) pixel circuit. Therefore, briefly returning to reference Figure 5B , routing circuitry 540 is configured to "swap" bit lines so that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out red pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out green pixel circuits in the same row as the red pixel circuits. It should be noted that when reading out blue and green pixels during timing sequence 0, routing circuitry 540 is not configured to "swap" bit lines as is done during timing sequence 1.
[0072] Next, during timing sequence 2, the blue (B) pixel circuits and the green (G) pixel circuits in the same row as the blue pixel circuits are read out from row addresses 6 / 7 / 8 of group 0, row addresses 18 / 19 / 20 of group 1, and row addresses 30 / 31 / 32 of group 2. B ) pixel circuit. Therefore, briefly returning to reference Figure 5AIn the example depicted in FIG, routing circuit system 540 is configured to not "swap" bit lines so that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out blue pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, respectively, to read out green pixel circuits in the same row as the blue pixel circuits.
[0073] Next, during timing sequence 3, the red (R) pixel circuits and the green (G) pixel circuits in the same row as the red pixel circuits are read out from row addresses 9 / 10 / 11 of group 0, row addresses 15 / 16 / 17 of group 1, and row addresses 33 / 34 / 35 of group 2. R ) pixel circuit. Therefore, briefly returning to reference Figure 5B In the example depicted in , the routing circuit system 540 is configured to "swap" the bit lines so that the comparators 542-B0, 542-B1 and 542-B2 are capacitively coupled to the bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16 and BL11 / BL14 / BL17, BL0 / BL3 / BL6, BL1 / BL4 / BL7 and BL2 / BL5 / BL8, respectively, to read out the red pixel circuits, and the comparators 542-G0, 542-G1 and 542-G2 are capacitively coupled to the bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7 and BL2 / BL5 / BL8, respectively, to read out the green pixel circuits in the same row as the red pixel circuits.
[0074] As can be understood from the 9C merged readout example described above, all 3 bit lines (e.g., BL0, BL1, BL2) of each 3-bit line grouping of each column of the 1x3 pixel circuit are occupied or utilized simultaneously because all 3 groups (e.g., Group 0, Group 1, Group 2) are read out simultaneously.
[0075] Figure 7 A detailed schematic diagram illustrating yet another example of an imaging device including a pixel circuit coupled to a bit line, the bit line coupled to a bit line in a pixel array, a current source, routing circuitry, and a comparator according to the teachings of the present disclosure. It should be understood that Figure 7 The pixel circuit and bit line described in the above Figures 1 to 4 The examples of pixel circuits and bit lines discussed in , and similarly named and numbered elements described above are similarly coupled and function below. It should be further understood that Figure 7 The pixel circuit, bit line, current source, routing circuit system and comparator described in Figures 5A to 5BThe pixel circuit, bit line, current source, routing circuit system and comparator described in are the same, the only difference is: Figure 7 The routing circuit system 740 depicted in is configured to capacitively couple bit lines BL6 / BL7 / BL8 and BL9 / B10 / BL11 of the plurality of bit lines 712 to appropriate ones of the plurality of comparators 740 during a readout operation of phase detection autofocus information from the central 2x2 grouping of photodiodes of the illustrated 6x6 pixel structure 732 of the pixel array.
[0076] In operation, it will be appreciated that when phase detection autofocus information is read out from the central 2x2 grouping of photodiodes of the illustrated 6x6 pixel structure 732, the routing circuitry 740 is configured to couple the bit lines to the inputs of each of the plurality of comparators 742 accordingly. Figure 7 , the phase detection autofocus photodiodes included in the blue 3x3 9C pixel structures of group 0 and the green 3x3 9C pixel structures in the same row as the red 3x3 9C pixel structures of group 0 are coupled to bit line BL6. Similarly, the phase detection autofocus photodiodes included in the blue 3x3 9C pixel structures of group 1 and the green 3x3 9C pixel structures in the same row as the red 3x3 9C pixel structures of group 1 are coupled to bit line BL7. Similarly, the phase detection autofocus photodiodes included in the blue 3x3 9C pixel structures of group 2 and the green 3x3 9C pixel structures in the same row as the red 3x3 9C pixel structures of group 2 are coupled to bit line BL8.
[0077] Similarly, the phase detection auto focus photodiode included in the red 3x3 9C pixel structure of group 0 and the green 3x3 9C pixel structure in the same row as the blue 3x3 9C pixel structure of group 0 is coupled to the bit line BL9. Similarly, the phase detection auto focus photodiode included in the red 3x3 9C pixel structure of group 1 and the green 3x3 9C pixel structure in the same row as the blue 3x3 9C pixel structure of group 1 is coupled to the bit line BL10. Similarly, the phase detection auto focus photodiode included in the red 3x3 9C pixel structure of group 2 and the green 3x3 9C pixel structure in the same row as the blue 3x3 9C pixel structure of group 2 is coupled to the bit line BL11.
[0078] Thus, it should be appreciated that when phase-detection auto-focus information is read out from the central 2x2 grouping of photodiodes of the illustrated 6x6 pixel structure 732, as described above, the routing circuitry 740 is configured to couple the bit lines BL6, BL7, BL8, BL9, BL10, and BL11 to the inputs of the first comparator 742-B0, the second comparator 742-B1, the third comparator 742-B2, the fourth comparator 742-G0, the fifth comparator 742-G1, and the sixth comparator 742-G2, respectively. As shown in the example, each bit line is capacitively coupled to the plurality of comparators 742 through a respective capacitance C, and the parasitic capacitance is represented by the capacitance Cp coupled to the input of each of the plurality of comparators 742.
[0079] Figure 8 A detailed diagram illustrating another example of a 9-cell binning readout of all groups of pixel circuits included in a pixel array with readout of phase detection information according to the teachings of the present disclosure is described. It should be appreciated that Figure 8 The example of readout with phase detection information depicted in 9-cell merged readout can be Figures 5A to 5B and Figure 7 , and similarly named and numbered elements described above are similarly coupled and function below.
[0080] like Figure 8 , a 9-cell binned readout with readout of phase detection information of a pixel array occurs in a timing sequence of 6 readouts numbered 0, 1, 2, 3, 4, 5. During timing sequence 0, a blue (B) pixel circuit and a green (G) pixel circuit in the same row as the blue pixel circuit are read out from row addresses 0 / 1 / 2 of group 0, row addresses 12 / 13 / 14 of group 1, and row addresses 24 / 25 / 26 of group 2. B ) pixel circuit. Therefore, briefly returning to reference Figure 5A In the example depicted in FIG, routing circuit system 540 is configured such that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out blue pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, respectively, to read out green pixel circuits in the same row as the blue pixel circuits.
[0081] Next, during timing sequence 1, the red (R) pixel circuits and the green (G) pixel circuits in the same row as the red pixel circuits are read out from row addresses 3 / 4 / 5 of group 0, row addresses 15 / 16 / 17 of group 1, and row addresses 27 / 28 / 29 of group 2. R ) pixel circuit. Therefore, briefly returning to reference Figure 5B , routing circuitry 540 is configured to "swap" bit lines so that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out red pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out green pixel circuits in the same row as the red pixel circuits. It should be noted that when reading out blue and green pixels during timing sequence 0, routing circuitry 540 is not configured to "swap" bit lines as is done during timing sequence 1.
[0082] Next, during timing sequence 2, the blue (B) pixel circuits and the green (G) pixel circuits in the same row as the blue pixel circuits are read out from row addresses 6 / 7 / 8 of group 0, row addresses 18 / 19 / 20 of group 1, and row addresses 30 / 31 / 32 of group 2. B ) pixel circuit. Therefore, briefly returning to reference Figure 5A In the example depicted in FIG, routing circuit system 540 is configured to not "swap" bit lines so that comparators 542-B0, 542-B1, and 542-B2 are capacitively coupled to bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7, and BL2 / BL5 / BL8, respectively, to read out blue pixel circuits, and comparators 542-G0, 542-G1, and 542-G2 are capacitively coupled to bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16, and BL11 / BL14 / BL17, respectively, to read out green pixel circuits in the same row as the blue pixel circuits.
[0083] Next, during timing sequence 3, the red (R) pixel circuits and the green (G) pixel circuits in the same row as the red pixel circuits are read out from row addresses 9 / 10 / 11 of group 0, row addresses 15 / 16 / 17 of group 1, and row addresses 33 / 34 / 35 of group 2. R ) pixel circuit. Therefore, briefly returning to reference Figure 5BIn the example depicted in , the routing circuit system 540 is configured to "swap" the bit lines so that the comparators 542-B0, 542-B1 and 542-B2 are capacitively coupled to the bit lines BL9 / BL12 / BL15, BL10 / BL13 / BL16 and BL11 / BL14 / BL17, BL0 / BL3 / BL6, BL1 / BL4 / BL7 and BL2 / BL5 / BL8, respectively, to read out the red pixel circuits, and the comparators 542-G0, 542-G1 and 542-G2 are capacitively coupled to the bit lines BL0 / BL3 / BL6, BL1 / BL4 / BL7 and BL2 / BL5 / BL8, respectively, to read out the green pixel circuits in the same row as the red pixel circuits.
[0084] Next, during timing sequence 4, the phase detection autofocus photodiode included in the blue (B) pixel circuit, the green (G) pixel circuit included in the same row as the red pixel circuit are read out from row addresses 2 / 3 of group 0, from row addresses 14 / 15 of group 1, and from row addresses 26 / 27 of group 2. R ) pixel circuit, a phase detection autofocus photodiode in a green (G B ) pixel circuit and the phase detection autofocus photodiode included in the red (R) pixel circuit. Therefore, briefly returning to reference Figure 7 In the example depicted in FIG, routing circuit system 740 is configured to route bit lines such that input comparator 742-B0 is capacitively coupled to bit line BL6, input comparator 742-B1 is capacitively coupled to bit line BL7, input comparator 742-B2 is capacitively coupled to bit line BL8, input comparator 742-G0 is capacitively coupled to bit line BL9, input comparator 742-G1 is capacitively coupled to bit line BL10, and input comparator 742-G2 is capacitively coupled to bit line BL11.
[0085] Next, during timing sequence 5, the phase detection autofocus photodiode included in the blue (B) pixel circuit, the green (G) pixel circuit included in the same row as the red pixel circuit are read out from row addresses 8 / 9 of group 0, row addresses 20 / 21 of group 1, and row addresses 32 / 33 of group 2. R ) pixel circuit, a phase detection autofocus photodiode in a green (G B ) pixel circuit and the phase detection autofocus photodiode included in the red (R) pixel circuit. Therefore, briefly returning to reference Figure 7, the routing circuit system 740 is again configured to route the bit lines such that input comparator 742-B0 is capacitively coupled to bit line BL6, input comparator 742-B1 is capacitively coupled to bit line BL7, input comparator 742-B2 is capacitively coupled to bit line BL8, input comparator 742-G0 is capacitively coupled to bit line BL9, input comparator 742-G1 is capacitively coupled to bit line BL10, and input comparator 742-G2 is capacitively coupled to bit line BL11.
[0086] Fig. 9 Detailed diagram illustrating an example of full resolution readout of all groups of pixel circuits included in a pixel array without reading out phase detection information in accordance with the teachings of the present disclosure. Fig. 9 An example full-resolution readout of all groups of pixel circuits for a pixel array described in Figures 5A to 5B , and similarly named and numbered elements described above are similarly coupled and function below.
[0087] like Fig. 9 , an example full-resolution readout of all groups of pixel circuits included in a pixel array occurs in a timing sequence of 36 readouts numbered 0 to 35. In one example, during full-resolution readout, in each 1x3 pixel circuit being read out, only 1 of the transfer transistors (e.g., TX0, TX1, TX2) is turned on at a time, and only 1 of the groupings of 3 bit lines for each column of the 1x3 pixel circuit is active, and the remaining 2 bit lines of the groupings of 3 bit lines for each column of the 1x3 pixel circuit are idle or unused. In contrast, it should be noted that in the 9C binned readout example described above, all 3 bit lines (e.g., BL0, BL1, BL2) of each 3-bit line grouping of each column of the 1x3 pixel circuit are occupied or utilized at the same time because all 3 groups (e.g., Group 0, Group 1, Group 2) are read out at the same time.
[0088] During timing sequences 0-11, the photodiodes included in group 0, including rows 0-11, are read out. As shown, during timing sequences 0-2 and 6-8, the blue (B) photodiode and the green (G) photodiode included in the same row as the blue photodiode are read out from group 0. B ) photodiode. During timing sequences 0 to 2 and 6 to 8, when the blue (B) photodiode and the green (G) photodiode included in the same row as the blue photodiode are read out, B ) photodiode, routing circuitry 540 does not "swap" the bit lines, such as for example Figure 5A In the description.
[0089] During timing sequences 3 to 5 and 9 to 11, the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out from group 0. R ) photodiode. During timing sequences 3 to 5 and 9 to 11, when the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out, R ) photodiode, routing circuitry 540 "swaps" the bit lines, such as Figure 5B In the description.
[0090] During timing sequences 12-23, the photodiodes included in group 1 including rows 12-23 are read out. As shown, during timing sequences 12-14 and 18-20, the blue (B) photodiodes and the green (G) photodiodes included in the same row as the blue photodiodes are read out from group 1. B ) photodiode. During timing sequences 12 to 14 and 18 to 20, when the blue (B) photodiode and the green (G) photodiode included in the same row as the blue photodiode are read out, B ) photodiode, routing circuitry 540 does not "swap" the bit lines, such as for example Figure 5A In the description.
[0091] During timing sequences 15 to 17 and 21 to 23, the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out from group 1. R ) photodiode. During timing sequences 15 to 17 and 21 to 23, when the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out, R ) photodiode, routing circuitry 540 "swaps" the bit lines, such as Figure 5B In the description.
[0092] During timing sequences 24-35, the photodiodes in group 2 including rows 24-35 are read out. As shown, during timing sequences 24-26 and 30-32, the blue (B) photodiode and the green (G) photodiode included in the same row as the blue photodiode are read out from group 2. B ) photodiode. During timing sequences 24 to 26 and 30 to 32, when the blue (B) photodiode and the green (G) photodiode included in the same row as the blue photodiode are read out, B ) photodiode, routing circuitry 540 does not "swap" the bit lines, such as for example Figure 5A In the description.
[0093] During timing sequences 27 to 29 and 33 to 35, the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out from group 2. R) photodiode. During timing sequences 27 to 29 and 33 to 35, when the red (R) photodiode and the green (G) photodiode included in the same row as the red photodiode are read out, R ) photodiode, routing circuitry 540 "swaps" the bit lines, such as Figure 5B In the description.
[0094] The above description of the examples illustrated in the present invention, including what is described in the abstract, is not intended to be exhaustive or to limit the present invention to the precise forms disclosed. Although specific examples of the present invention are described herein for illustrative purposes, those skilled in the relevant art will recognize that various modifications are feasible within the scope of the present invention.
[0095] In light of the above detailed description, these modifications may be made to the examples of the present invention. The terms used in the appended claims should not be construed to limit the present invention to the specific examples disclosed in the specification. Rather, the scope of the present invention will be determined entirely by the appended claims, which should be interpreted in accordance with established recognized principles of claim interpretation.
Claims
1. An imaging device, comprising: A pixel array comprising: a plurality of 1x3 pixel circuits arranged in rows and columns of the pixel array, wherein each 1x3 pixel circuit includes 3 photodiodes included in a respective column of 1x3 pixel circuits in the pixel array, wherein the 3 photodiodes of each 1x3 pixel circuit included in the respective column of 1x3 pixel circuits in the pixel array are included in respective 3 rows of the pixel array; a plurality of bit lines coupled to the plurality of 1x3 pixel circuits, wherein the plurality of bit lines are divided into groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array, wherein each column of the 1x3 pixel circuits in the pixel array comprises a first plurality of groups of the 1x3 pixel circuits coupled to a first bit line of a corresponding group of the 3 bit lines, a second plurality of groups of the 1x3 pixel circuits coupled to a second bit line of the corresponding group of the 3 bit lines, and a third plurality of groups of the 1x3 pixel circuits coupled to a third bit line of the corresponding group of the 3 bit lines; as well as A plurality of 9-unit pixel structures, wherein the plurality of 1x3 pixel circuits are further arranged into groups of 3 1x3 pixel circuits per 9-unit pixel structure to form a plurality of 3x3 pixel structures of the pixel array.
2. The imaging device of claim 1 , wherein the plurality of 1x3 pixel circuits are arranged along a row of the pixel array in a repeating sequence of one of the first groups of the 1x3 pixel circuits, one of the second groups of the 1x3 pixel circuits, and one of the third groups of the 1x3 pixel circuits.
3. The imaging device of claim 2, wherein each column of the 1x3 pixel circuits in the first plurality of groups of the 1x3 pixel circuits, the second plurality of groups of the 1x3 pixel circuits, and the third plurality of groups of the 1x3 pixel circuits comprises four 1x3 pixel circuits.
4. The imaging device of claim 3, further comprising a color filter array disposed over photodiodes of the pixel array configured to sense image data, wherein the color filter array comprises: a plurality of color filters having a first color; a plurality of color filters having a second color; and A plurality of color filters having a third color, wherein the photodiode of each of the plurality of 9-unit pixel structures configured to sense image data is covered by one of the plurality of color filters having the first color, the plurality of color filters having the second color, or the plurality of color filters having the third color.
5. An imaging device according to claim 4, wherein the multiple 9-unit pixel structures are arranged into groups of 4 9-unit pixel structures to form multiple 6x6 pixel structures of the pixel array, wherein the photodiode of each 6x6 pixel structure configured to sense image data is covered by one of the multiple color filters having the first color and one of the multiple color filters having the second color along a first diagonal of each 6x6 pixel structure, wherein the photodiode of each 6x6 pixel structure configured to sense image data is covered by two of the multiple color filters having the third color along a second diagonal of each 6x6 pixel structure, and wherein the pattern of the multiple color filters over each 6x6 pixel structure is repeated over the rows and columns of the pixel array. 6 . The imaging device according to claim 5 , wherein the first color is blue, wherein the second color is red, and wherein the third color is green.
7. An imaging device according to claim 6, wherein a central 2x2 group of photodiodes included in each 6x6 pixel structure are coupled to provide phase detection information for the pixel array, wherein the photodiodes included in the central 2x2 group of photodiodes included in each 6x6 pixel structure that are coupled to provide phase detection information are covered by a green or full-color filter.
8. The imaging device of claim 7, further comprising a plurality of current sources coupled to the plurality of bit lines.
9. The imaging device of claim 8, wherein each of the plurality of current sources is coupled to a corresponding one of the plurality of bit lines.
10. The imaging device of claim 9, further comprising a plurality of comparators capacitively coupled to the plurality of bit lines.
11. The imaging device of claim 10, further comprising routing circuitry coupled between the plurality of bit lines and the plurality of comparators, wherein the routing circuitry is configured to control which of the plurality of bit lines are capacitively coupled to each of the plurality of comparators.
12. An imaging device according to claim 11, wherein the routing circuit system is configured to: capacitively couple each of the first sub-group of the plurality of comparators to a first corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array or a second corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array to read out image data from more than one of the photodiodes at a time from the 1x3 pixel circuits coupled to each of the plurality of comparators.
13. An imaging device according to claim 12, wherein the 1x3 pixel circuit of the first corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the first color, and wherein the 1x3 pixel circuit of the second corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the second color.
14. An imaging device according to claim 13, wherein the routing circuit system is configured to capacitively couple each of the second sub-grouping of the plurality of comparators to a third corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array or a fourth corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array.
15. An imaging device according to claim 14, wherein the 1x3 pixel circuit of the third corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the third color in the same row of the 1x3 pixel circuit covered by one of the multiple color filters having the first color, and wherein the 1x3 pixel circuit of the fourth corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the third color in the same row of the 1x3 pixel circuit covered by one of the multiple color filters having the second color.
16. The imaging device of claim 11, wherein the routing circuitry is configured to capacitively couple each of the plurality of comparators to one of the plurality of bit lines coupled to one of the center 2x2 groupings of photodiodes included in each 6x6 pixel structure coupled to provide phase detection information for the pixel array.
17. An imaging device according to claim 11, wherein the routing circuit system is configured to: capacitively couple each of the plurality of comparators to one of the bit lines of one of the groups of 3 bit lines per column of the 1x3 pixel circuit in the pixel array to read out image data from one of the photodiodes at a time from the 1x3 pixel circuit, the 1x3 pixel circuit being coupled to the one of the bit lines of one of the groups of 3 bit lines per column of the 1x3 pixel circuit in the pixel array.
18. The imaging device of claim 17, wherein others of the bit lines of the one of the groups of 3 bit lines per column of the 1x3 pixel circuits are configured as idle, the others being coupled to 1x3 pixel circuits that are not being read out.
19. An imaging system comprising: A pixel array comprising: a plurality of 1x3 pixel circuits arranged in rows and columns of the pixel array, wherein each 1x3 pixel circuit includes 3 photodiodes included in a respective column of 1x3 pixel circuits in the pixel array, wherein the 3 photodiodes of each 1x3 pixel circuit included in the respective column of 1x3 pixel circuits in the pixel array are included in respective 3 rows of the pixel array; a plurality of bit lines coupled to the plurality of 1x3 pixel circuits, wherein the plurality of bit lines are divided into groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array, wherein each column of the 1x3 pixel circuits in the pixel array comprises a first plurality of groups of the 1x3 pixel circuits coupled to a first bit line of a corresponding group of the 3 bit lines, a second plurality of groups of the 1x3 pixel circuits coupled to a second bit line of the corresponding group of the 3 bit lines, and a third plurality of groups of the 1x3 pixel circuits coupled to a third bit line of the corresponding group of the 3 bit lines; as well as a plurality of 9-unit pixel structures, wherein the plurality of 1x3 pixel circuits are further arranged into groups of 3 1x3 pixel circuits per 9-unit pixel structure to form a plurality of 3x3 pixel structures of the pixel array; as well as a readout circuit coupled to the pixel array to read out signals from the pixel array through the plurality of bit lines, the readout circuit comprising: a plurality of current sources coupled to the plurality of bit lines, wherein each of the plurality of current sources is coupled to a respective one of the plurality of bit lines; a plurality of comparators capacitively coupled to the plurality of bit lines; as well as Routing circuitry is coupled between the plurality of bit lines and the plurality of comparators, wherein the routing circuitry is configured to control which of the plurality of bit lines are capacitively coupled to each of the plurality of comparators.
20. The imaging system of claim 19, wherein the routing circuit system is configured to capacitively couple each of a first subgroup of the plurality of comparators to a first corresponding one of the groups of three bit lines per column of the 1x3 pixel circuits in the pixel array or a second corresponding one of the groups of three bit lines per column of the 1x3 pixel circuits in the pixel array to read out image data from more than one of the photodiodes at a time from the 1x3 pixel circuits coupled to each of the plurality of comparators.
21. An imaging system according to claim 20, wherein a photodiode configured to sense image data of the 1x3 pixel circuit of the first corresponding one of the group of 3 bit lines is covered by one of a plurality of filters of a filter array having a first color, and wherein a photodiode configured to sense image data of the 1x3 pixel circuit of the second corresponding one of the group of 3 bit lines is covered by one of the plurality of filters having a second color.
22. The imaging system of claim 21 , wherein the routing circuit system is configured to capacitively couple each of the second subgroupings of the plurality of comparators to a third corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array or a fourth corresponding one of the groups of 3 bit lines per column of the 1x3 pixel circuits in the pixel array.
23. An imaging system according to claim 22, wherein a photodiode configured to sense image data of the 1x3 pixel circuit of the third corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the third color in the same row of the 1x3 pixel circuit covered by one of the multiple color filters having the first color, and wherein a photodiode configured to sense image data of the 1x3 pixel circuit of the fourth corresponding one of the group of 3 bit lines is covered by one of the multiple color filters having the third color in the same row of the 1x3 pixel circuit covered by one of the multiple color filters having the second color.
24. The imaging system of claim 19, further comprising a color filter array disposed over photodiodes of the pixel array configured to sense image data, wherein the color filter array comprises: a plurality of color filters having a first color; a plurality of color filters having a second color; and A plurality of color filters having a third color, wherein the photodiode of each of the plurality of 9-unit pixel structures configured to sense image data is covered by one of the plurality of color filters having the first color, the plurality of color filters having the second color, or the plurality of color filters having the third color.
25. An imaging system according to claim 24, wherein the multiple 9-unit pixel structures are arranged into groups of 4 9-unit pixel structures to form multiple 6x6 pixel structures of the pixel array, wherein the photodiode of each 6x6 pixel structure configured to sense image data is covered by one of the multiple color filters having the first color and one of the multiple color filters having the second color along a first diagonal of each 6x6 pixel structure, wherein the photodiode of each 6x6 pixel structure configured to sense image data is covered by two of the multiple color filters having the third color along a second diagonal of each 6x6 pixel structure, and wherein the pattern of the multiple color filters over each 6x6 pixel structure is repeated over the rows and columns of the pixel array.
26. The imaging system of claim 25, wherein the first color is blue, wherein the second color is red, and wherein the third color is green.
27. An imaging system according to claim 26, wherein a central 2x2 grouping of photodiodes included in each 6x6 pixel structure is coupled to provide phase detection information for the pixel array, wherein the photodiodes included in the central 2x2 grouping of photodiodes included in each 6x6 pixel structure that are coupled to provide phase information are covered by a green or panchromatic filter.
28. The imaging system of claim 27, wherein the routing circuitry is configured to capacitively couple each of the plurality of comparators to one of the plurality of bit lines coupled to one of the center 2x2 groupings of photodiodes included in each 6x6 pixel structure coupled to provide phase detection information for the pixel array.
29. The imaging system of claim 19, wherein the routing circuit system is configured to capacitively couple each of the plurality of comparators to one of the bit lines of one of the groups of three bit lines per column of the 1x3 pixel circuits in the pixel array to read out image data from one of the photodiodes at a time from the 1x3 pixel circuits, the 1x3 pixel circuits being coupled to the one of the bit lines of one of the groups of three bit lines per column of the 1x3 pixel circuits in the pixel array.
30. The imaging system of claim 29, wherein others of the bit lines of said one of the groupings of 3 bit lines per column of the 1x3 pixel circuits are configured as idle, the others being coupled to 1x3 pixel circuits that are not being read out.
