Routing for DTOF sensors

By setting the TDC above and below the SPAD subset in the DTOF sensor and adopting a split bus routing method, the signal routing challenge of DTOF sensors at high resolution and high pixel density is solved, achieving higher timing accuracy, lower power consumption and smaller area.

CN118921572APending Publication Date: 2024-11-08STMICROELECTRONICS (RES & DEV) LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411324007.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2020-06-08
Filing Date
2021-06-04
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

At high resolution and high pixel density, DTOF sensors face challenges in signal routing, including timing accuracy and power consumption. Furthermore, the increased number and length of routing lines lead to a larger area.

Method used

By setting the TDC above and below the SPAD subset in the DTOF sensor, the SPAD is divided into two parts and routed to the corresponding top and bottom TDCs using a split bus routing method. The number and length of routing lines are reduced by sharing the routing bus and time capture circuit.

Benefits of technology

It improves timing accuracy, reduces power consumption, achieves higher pixel density and resolution, and reduces sensor area.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921572A_ABST
    Figure CN118921572A_ABST
Patent Text Reader

Abstract

The invention relates to routing for DTOF sensors. A ToF sensor includes a pixel array having a first subset of pixels and a second subset of pixels, a first plurality of TDCs and a second plurality of TDCs, a routing bus having a first plurality of bus drivers and a second plurality of bus drivers, and a controller configured to, when the first subset of pixels is active and the second subset of pixels is inactive, transmit the first plurality of TDCs to the routing bus. Controlling the first plurality of bus drivers to route events from half of the pixels of the first subset to the first plurality of TDCs, and controlling the first plurality of bus drivers and the second plurality of bus drivers to route events from the other half of the pixels of the first subset of pixels to the second plurality of TDCs, and control the first plurality of bus drivers to route events from the second subset of pixels to the first plurality of TDCs when the first subset of pixels is inactive and the second subset of pixels is active.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Related Applications Citations

[0002] This application is a divisional application of the invention patent application with Chinese national application number 202110623662.4, application date June 4, 2021, and invention name “Routing for DTOF Sensors”. Technical Field

[0003] The present disclosure relates generally to electronic systems and methods, and in particular embodiments to routing for direct time-of-flight (DTOF) sensors. Background Art

[0004] DTOF image sensors use time-of-flight (ToF) technology to determine the distance to an object to provide, for example, a 3D depth map. Figure 1 A schematic diagram of a DTOF system 100 is shown. The DTOF system 100 includes an illumination source 106, a single photon avalanche diode (SPAD) array 104, a time-to-digital converter (TDC) 102, and a processor 110. A routing block 112 couples the SPAD array 104 to the TDC 102 (e.g., via metal traces and logic circuits). The SPAD array 104, routing block 112, and TDC 102 are typically implemented in the same integrated circuit (IC).

[0005] A DTOF sensor typically includes an image capture mechanism, (multiple) data converters, frequency and timing generation circuits, and at least a portion of digital signal processing and data compression / storage. Therefore, in some cases, TDC 102, SPAD array 104, timing generator circuit 108, and routing block 112 are collectively referred to as a DTOF sensor. In some cases, the DTOF sensor also includes a processor 110 (or a portion of processor 110).

[0006] During normal operation, for example, at times controlled by timing generator circuit 108, illumination source 106 transmits light pulses 112 toward object 116. Reflected light pulses 114 are sensed by SPAD array 104 and routed to TDC 102 (located outside SPAD array 104). TDC 102 generates a digital representation of the time between the emission of light pulse 112 and the receipt of reflected light pulse 114. Processor 110 then determines the distance to object 116, for example, by generating a ToF histogram based on the output of TDC 102 in a known manner.

[0007] The SPAD array 104 may be formed of a plurality of pixels arranged in rows and columns, wherein each pixel includes one or more SPADs. For each pixel, Figure 2 A conventional DTOF signal chain is shown in FIG. Figure 2As shown, SPAD 202 (of SPAD array 104) is coupled to TDC 206 (of TDC 102) via routing block 204 (where routing block 204 may optionally include an OR tree). Even though SPAD 202 includes 8 SPADs, a different number of SPADs may be used, such as 1, 2, 4, 10, 16, etc. Summary of the invention

[0008] According to one embodiment, a time-of-flight (ToF) sensor includes: a pixel array arranged in rows and columns, the pixel array including a first subset of pixels and a second subset of pixels, each pixel in the pixel array being configured to generate an event signal; a first plurality of time-to-digital converters (TDCs); a second plurality of TDCs; a first routing bus coupled to the first plurality of TDCs and the second plurality of TDCs and the first subset of pixels and the second subset of pixels, the first routing bus including a first plurality of bus drivers associated with the first subset of pixels and a second plurality of bus drivers associated with the second subset of pixels, the first plurality of bus drivers coupled to the second plurality of bus drivers via the second plurality of bus drivers TDCs, and a second plurality of bus drivers are coupled to the first plurality of TDCs via the first plurality of bus drivers; and a controller configured to: when the first pixel subset is active and the second pixel subset is inactive, control the first plurality of bus drivers to route event signals from half of the pixels in the first pixel subset to the first plurality of TDCs, and control the first plurality of bus drivers and the second plurality of bus drivers to route event signals from the other half of the pixels in the first pixel subset to the second plurality of TDCs, and when the first pixel subset is inactive and the second pixel subset is active, control the first plurality of bus drivers to route event signals from the second pixel subset to the first plurality of TDCs.

[0009] According to one embodiment, a method includes: activating a first subset of pixels of a pixel array of a time-of-flight (ToF) sensor, the pixel array being arranged in rows and columns; when the first subset of pixels is active, controlling a first plurality of bus drivers of a first routing bus to route event signals from half of the pixels in the first subset of pixels to a first plurality of TDCs, and controlling the first plurality of bus drivers and a second plurality of bus drivers to route event signals from the other half of the pixels in the first subset of pixels to a second plurality of TDCs, wherein the first plurality of bus drivers are coupled to the second plurality of TDCs via the second plurality of bus drivers, wherein the second plurality of bus drivers are coupled to the first plurality of TDCs via the first plurality of bus drivers, wherein the first plurality of bus drivers are associated with the first subset of pixels, and wherein the second plurality of bus drivers are associated with the second subset of pixels in the pixel array; activating the second subset of pixels; and when the second subset of pixels is active, controlling the first plurality of bus drivers to route event signals from the second subset of pixels to the first plurality of TDCs.

[0010] According to one embodiment, an integrated circuit (IC) includes: a pixel array arranged in rows and columns, the pixel array including a first pixel subset, each pixel in the pixel array being configured to generate an event signal; a plurality of top time-to-digital converters (TDCs) physically disposed at the top of the pixel array; a plurality of bottom TDCs physically disposed at the bottom of the pixel array; a routing bus coupled to the plurality of top TDCs and the plurality of bottom TDCs and the first pixel subset, the routing bus including a plurality of bus drivers associated with the first pixel subset; and a controller configured to: when the first pixel subset is active, control the plurality of bus drivers to route event signals from the upper half of pixels in the first pixel subset to the plurality of top TDCs, and to route event signals from the lower half of pixels in the first pixel subset to the plurality of bottom TDCs, and when the first pixel subset is inactive, control all of the plurality of bus drivers to route the event signals of the routing bus to the plurality of top TDCs.

[0011] According to one embodiment, a time-of-flight (ToF) sensor includes: a pixel array arranged in rows and columns, each pixel in the pixel array being configured to generate an event signal, the pixel array including a pixel subset; a routing bus coupled to the pixel subset; a plurality of time capture circuits coupled to the routing bus; and a controller configured to: when the pixel subset is in an integration mode, route the event signal from a first pixel in the pixel subset to a first time capture circuit among a plurality of time capture circuits via a first routing line of the routing bus, and when the pixel subset is in a readout mode, route data from the first time capture circuit to a readout circuit via a first routing line.

[0012] According to one embodiment, a method includes: setting a subset of pixels in a pixel array of a time-of-flight (ToF) sensor to an integration mode, the pixel array being arranged in rows and columns; routing an event signal from a first pixel in the pixel subset to a first time capture circuit of a plurality of time capture circuits via a first routing line of a routing bus when the pixel subset is in the integration mode; setting the pixel subset to a readout mode; and routing data from the first time capture circuit to a readout circuit via a first routing line when the pixel subset is in the readout mode.

[0013] According to one embodiment, an integrated circuit (IC) includes: a pixel array arranged in rows and columns, each pixel in the pixel array is configured to generate an event signal, the pixel array includes a pixel subset; a routing bus coupled to the pixel subset, the routing bus includes J routing lines, where J is a positive integer greater than 1, and each of the J routing lines is coupled to more than 1 pixel in the pixel subset; a plurality of time capture circuits coupled to the routing bus; and a controller configured to: when the pixel subset is in an integration mode, route the event signal from a first pixel in the pixel subset via a first routing line of the routing bus to a first time capture circuit among a plurality of time capture circuits, and when the pixel subset is in a readout mode, route data from the first time capture circuit via a first routing line to a readout circuit. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] For a more complete understanding of the present invention and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which:

[0015] Figure 1 shows a schematic diagram of a DTOF system;

[0016] Figure 2 A schematic diagram of a conventional DTOF signal chain is shown;

[0017] Figure 3 A top view (not to scale) showing a possible layout of a pixel array of a DTOF image sensor according to an embodiment of the present invention;

[0018] Figure 4A-4C The embodiment according to the present invention is shown Figure 3 different levels of detail that may be achieved for subsets of pixels in a pixel array;

[0019] Figure 5 The embodiment according to the present invention is shown Figure 3 A pixel column of a pixel array;

[0020] Figure 6A-6C The embodiment according to the present invention is shown Figure 3 different levels of detail that may be achieved for subsets of pixels in a pixel array; and

[0021] Figure 7 The embodiment according to the present invention is shown Figure 3 The pixel columns of the pixel array.

[0022] Corresponding numerals and symbols in the different figures generally refer to corresponding parts unless otherwise indicated.The figures are drawn to clearly illustrate the relevant aspects of the preferred embodiments and are not necessarily drawn to scale. DETAILED DESCRIPTION

[0023] The manufacture and use of the disclosed embodiments will be discussed in detail below. However, it should be understood that the present invention provides many applicable inventive concepts that can be embodied in a variety of specific environments. The specific embodiments discussed only illustrate specific ways to make and use the present invention, and do not limit the scope of the present invention.

[0024] The following description shows various specific details to provide a deep understanding of several example embodiments according to the description. The embodiments can be obtained without one or more specific details or in the case of other methods, components, materials, etc. In other cases, known structures, materials or operations are not shown or described in detail to avoid confusing different aspects of the embodiments. References to "one embodiment" in this specification indicate that a specific configuration, structure or feature described relative to the embodiment is included in at least one embodiment. Therefore, phrases such as "in one embodiment" that may appear in different locations of this specification do not necessarily refer to the same embodiment accurately. In addition, in one or more embodiments, specific forms, structures or features can be combined in any appropriate manner.

[0025] Embodiments of the invention will be described in the specific context of routing for (e.g., high density) DTOF image sensors. Embodiments of the invention may be used in other types of sensors, such as other types of SPAD-based image sensors, and non-SPAD-based sensors, such as CMOS sensors (where, for example, the SPAD is replaced with a CMOS sensor, and the logic and tri-state buffers are replaced with, for example, source follower-based readout circuits.

[0026] DTOF image sensors are typically data heavy, requiring many signals to be routed. For example, routing between SPAD 202 and TDC 206 may include metal traces, such as formed in a metal layer of an IC including SPAD array 104 and TDC 102. For example, each SPAD or each group of SPADs 202 may be connected to a full-height column line connected to TDC 206 via a tri-state buffer.

[0027] Some signals, such as the signal between SPAD 202 and TDC 206, are timing sensitive. For such signals, it may be necessary to maintain timing accuracy across routing processes and across process, voltage, and temperature (PVT) variations. Some signals, such as the signal between TDC 206 and processor 110, carry high-frequency data, thereby affecting power consumption. In a high-resolution DTOF sensor (e.g., with hundreds or thousands of SPADs or more), routing DTOF sensor signals can be challenging.

[0028] Some embodiments advantageously reduce the number of routes and / or route lengths in a DTOF image sensor, for example, to improve timing accuracy, and / or reduce power consumption, and / or reduce area, and / or achieve higher pixel density, and / or achieve higher resolution.

[0029] Figure 3 A top view (not to scale) of a possible layout of a pixel array 302 of a DTOF image sensor 300 according to an embodiment of the present invention is shown. The pixel array 302 includes M columns and N rows of pixels 304. Each pixel 304 includes one or more SPADs. The pixel array 302 includes a plurality of pixel subsets 304 (for clarity, the pixels are not shown in FIG. 1 ). Figure 3 Only one subset of pixels, namely, the active pixel subset 306, is shown in FIG.

[0030] During normal operation, different subsets of pixels are sequentially activated to sense light, allowing ToF determination. Figure 3 An active pixel subset 306 is shown. Pixels 304 within the active pixel subset 306 are active, while pixels 304 outside the active pixel subset 306 are inactive. It should be understood that the active subset 306 represents the currently active pixel subset 304, and the position of the active subset 306 can be dynamically changed during the integration process (e.g., sequentially in the vertical direction on each pixel subset).

[0031] Pixels 304 (also referred to as active pixels) within the active pixel subset 306 sense the reflected light pulse 114. When an active pixel 304 is excited by light, the corresponding TDC(s) ( Figure 3 The TDC (not shown) senses events generated by active pixels 304. The (multiple) TDCs then generate corresponding timestamps (based on the received events), which are then used to generate a ToF histogram in a known manner. The process of sensing light by active pixels 304 and the generation of corresponding timestamps and ToF histograms can be referred to as an integration process.

[0032] Once the integration process is complete (eg, over all subsets of pixels of pixel array 302), data associated with pixel 304 (eg, corresponding timestamps or ToF histograms) is read (eg, by processor 110) in a data readout process.

[0033] In some embodiments, M and N may be greater than 100, such as 120, 210, or 360. Other values ​​of M and N may also be used, such as above 360 ​​or below 100. In some embodiments, M may be different from N.

[0034] In some embodiments, each subset of pixels in pixel array 302 (e.g., such as active pixel subset 306) may have M columns and N / k rows, where k is a positive integer greater than or equal to 1. In some embodiments, for example, each subset of pixels may have fewer than M columns, such as M / 2, M / 3, or a different number.

[0035] As a non-limiting example, in one embodiment, N is equal to 360, M is equal to 120, and k is equal to 12. In such an embodiment, each subset of pixels includes 30 pixels per column, and includes 120 columns of pixels 304 .

[0036] During the integration process of such an embodiment, each column Col of the active pixel subset 306 may be processed by (a plurality of) dedicated TDCs and histogram generation circuits (not shown). i (In this example, 3600 active pixels are divided into 120 columns.) Once an active pixel 304 within a pixel subset 306 completes the integration process, such an active pixel becomes inactive, and the next pixel subset (such as the pixel subset immediately below the pixel subset 306) becomes active.

[0037] Once all subsets of pixels 304 of the pixel array 302 have been activated (eg, sequentially) during the integration process, data associated with each pixel 304 (eg, a corresponding timestamp or a ToF histogram) is read during a data readout process.

[0038] In some embodiments, pixel array 302 is implemented in a single monolithic substrate inside an IC. In some embodiments, the single monolithic substrate may also include a TDC, a histogram generation circuit, and an illumination source. In some embodiments, processor 110 or a portion of processor 110 may also be integrated inside an IC.

[0039] In an embodiment of the present invention, routing inside a DTOF sensor is reduced by placing TDCs above and below a subset of SPADs. A split bus routes half of the SPADs in a subset of SPADs to a corresponding top TDC and the other half to a corresponding bottom TDC. In some embodiments, the split bus advantageously allows routing twice the number of SPADs compared to an implementation that routes each column of SPADs to a TDC in a single location (e.g., all TDCs above a subset of SPADs or all TDCs below a subset of SPADs).

[0040] According to an embodiment of the present invention, Figure 4A-4C The columns Col of the pixel subset 400 are shown. iEach pixel subset of pixel array 302 (such as active pixel subset 306) can be implemented as pixel subset 400. It can be understood that the columns Col i It can be any column among the M columns in pixel array 302 .

[0041] like Figure 4A As shown, the column Col of the pixel subset 400 i The system includes a plurality of pixels 304 coupled to corresponding bus driver circuits 415. Each pixel includes a SPAD front-end circuit 410, a SPAD 412, and a buffer 414. Each bus driver circuit 415 includes a plurality of bus drivers (416 or 424) coupled to the routing bus 402. Figure 4A As shown, routing bus 402 is coupled to a plurality of top TDCs 404 and a plurality of bottom TDCs 406. Each bus driver (416 or 424) may route a received signal upward to a corresponding TDC in the plurality of top TDCs 404 or downward to a corresponding TDC in the plurality of bottom TDCs 406.

[0042] even though Figure 4A Each pixel 304 is shown to include a single SPAD 412 coupled to a buffer 414, but it will be appreciated that some embodiments may replace the single SPAD 412 and buffer 414 with multiple SPADs (such as SPAD 202) coupled to an OR tree.

[0043] like Figure 4A and 4B As shown, each SPAD 412 is coupled to at least one bus driver circuit 416 .

[0044] The bus driver 416 is configured to propagate the signal at the output of the buffer 414 upward (via the buffer 420) or downward (via the buffer 422) through the routing bus 402 when the select signal Sel is equal to 1, for example. When the select signal Sel is equal to 0, for example, the signal S 420 The signal is buffered by multiplexer (MUX) 418 into the input of buffer 422, which propagates the signal downward through buffer 422. When the select signal Sel is equal to, for example, 2, the signal S 422The signal is buffered by MUX 418 into the input of buffer 420, which propagates the signal upward through buffer 420. In other words, when the select signal Sel is equal to, for example, 1, the bus driver 416 propagates the signal from the corresponding SPAD 412 (upward or downward), for example, depending on the position of the SPAD relative to the pixel subset 400. Moreover, when the select signal Sel is equal to, for example, 0 or 1, the bus driver behaves like a buffer that buffers the signal from the routing bus 402 upward (for example, when Sel=2) or downward (for example, when Sel=0).

[0045] Buffers 420 and 422 may be implemented in any manner known in the art. For example, in some embodiments, buffers 420 and 422 may be implemented using one or more inverters.

[0046] The bus driver 424 is configured to propagate signals up or down from the routing bus 402. As shown, the bus driver 424 can dynamically reconfigure the direction of the buffering. In some embodiments, the bus driver 424 can be implemented as the bus driver 416.

[0047] The controller 450 is configured to generate a select signal Sel for each of the bus drivers 416 and 424 of the pixel subset 400 to configure them as an upward buffer (e.g., Sel=2), a downward buffer (e.g., Sel=0), or for buffering the event signal of its corresponding SPAD (e.g., Sel=0).

[0048] Some embodiments include one controller 450 per subset of pixels 400. Other embodiments include a single controller 450 for all subsets of pixels in pixel array 302. Other implementations are also possible.

[0049] For example, the controller 450 may be implemented using, for example, combinatorial logic (such as, for example, a finite state machine) coupled to a memory (such as, for example, a register, OTP, ROM, or RAM).

[0050] In some embodiments, when the column Col of the pixel subset 400 i When L pixels 304 are included, routing bus 402 includes L / 2 routing lines. i With 30 pixels 304, routing bus 402 has 15 pixel lines (which are respectively coupled to 15 TDCs 404 and 15 TDCs 406). In some embodiments, L may be higher than 30, such as 40 or higher, or may be lower than 30, such as 20 or lower.

[0051] like Figure 4BAs shown, each routing line of the routing bus 402 is composed of a column Col of the pixel subset 400. i The two pixels 304 in FIG. 4 are shared to propagate the signals associated with their respective SPADs (as shown by the presence of bus driver 416 ).

[0052] Figure 4C Column Col of pixel array 302 according to an embodiment of the present invention is shown. i , showing the physical arrangement of the pixel 304, the routing bus 402 and the corresponding bus driver circuit 415, and the top TDC 404 and the bottom TDC 406, respectively.

[0053] During normal operation, when the pixel subset 400 is active, the controller 450 configures the bus drivers 416 and 424 so that each pixel 304 propagates the event signal associated with its corresponding SPAD 412 using the bus driver 416. The top half of the pixels 304 propagate their respective event signals upward to the top TDC 404 via the bus driver 424 coupled between the respective bus driver 416 and the top TDC 404. The bottom half of the pixels propagate their respective event signals downward to the bottom TDC 406 via the bus driver 424 between the respective bus driver 416 and the bottom TDC 406.

[0054] During normal operation, the subset of pixels below the active subset of pixels operates its bus drivers 416 and 424 as buffers that buffer the signals of the routing bus 402 downward to the bottom TDC 406. In a similar manner, the subset of pixels above the active subset of pixels operates its bus drivers 416 and 424 as buffers that buffer the signals of the routing bus 402 upward to the top TDC 404.

[0055] In some embodiments, the use of bus driver 424 advantageously allows for preservation of the timing accuracy of the event signal generated by SPAD 412. In some embodiments, additional buffers and / or inverters may be used to balance the event signal from SPAD 412.

[0056] In some embodiments, the positions of the bus drivers 416 relative to the positions of the pixels 304 in the pixel subset 400 may be selected to balance the timing. For example, in some embodiments, the pixels 304 closest to the top of the pixel subset 400 (and one pixel closest to the bottom) have their corresponding bus drivers 416 closest to the right, while the pair of pixels 304 closest to the center of the pixel subset 400 have their corresponding bus drivers 416 closest to the left, e.g., to compensate for the longer routing of the pixels closest to the center of the pixel subset 400 compared to the pixels at the edge of the pixel subset 400.

[0057] The SPAD front-end circuit 410 is configured to bias the SPAD 412. In some embodiments, the SPAD front-end circuit has an enable input configured to receive a spad_enable signal (not shown). In such an embodiment, when the spad_enable signal is asserted, the SPAD front-end circuit can enable the SPAD 412. In some embodiments, activating the SPAD includes asserting the spad_enable signal. In some embodiments, activating the SPAD subset includes asserting the spad_enable signal of each SPAD in the SPAD subset. The SPAD front-end circuit 410 can be implemented in any manner known in the art.

[0058] like Figure 4A-4C As shown, some embodiments include the following: i The top TDC 404 at the top and the top TDC 404 at the top of the column Col i Some embodiments may have additional TDC rows embedded in the pixel array 302. For example, Figure 5 Column Col of pixel array 302 according to an embodiment of the present invention is shown. i .

[0059] Figure 5 The embodiments are as follows Figure 4A-4C The embodiment shown operates in a similar manner. However, Figure 5 In the embodiment of the pixel 304, the column Col i In such an embodiment, two split-routing buses 402 are included. In such an embodiment, two active pixel subsets 500 can perform the integration process simultaneously. Some embodiments may include more than two split-routing buses 402.

[0060] In an embodiment of the present invention, routing within a DTOF sensor is reduced by sharing a bus for routing SPAD events (eg, SPAD pulses) from each SPAD subset to the corresponding in-array TDC and histogram generation circuits and for data readout.

[0061] Figure 6A-6C Column Col of a pixel subset 600 according to an embodiment of the present invention is shown. i Each pixel subset of pixel array 302 (such as active pixel subset 306) can be implemented as pixel subset 600. It can be understood that the columns Col i It can be any column among the M columns in pixel array 302 .

[0062] like Fig. 6A As shown, the column Col of the pixel subset 600 iThe system includes a plurality of pixels 304 coupled to a routing bus 620 via corresponding bus driver circuits 602. Figure 6B As shown, routing bus 620 has J routing lines, where J is a positive integer greater than or equal to 1. Routing line 620 j It can be any one of the J routing lines of routing bus 620 .

[0063] Each pixel 304 includes a SPAD front-end circuit 410, a SPAD 412, and a buffer 414. Each bus driver circuit 602 includes a routing line 620 coupled to a routing bus 620. j The tri-state buffer 606 and MUX 604 are shown in FIG. Fig. 6A As shown, routing line 620 j Coupled to a plurality of time capture circuits 608 , wherein each time capture circuit 608 includes a TDC 610 and a histogram generation circuit 612 .

[0064] The plurality of time capture circuits 608 are shared across all subsets of pixels of column Colj, and each column of pixels has its corresponding plurality of time capture circuits 608 .

[0065] During the integration process of the pixel subset 600 (when the pixel subset 600 is active and in integration mode), the read_histogram signal is deasserted (e.g., logic low), the buffer_enable signal is asserted (e.g., logic high), and the spad_enable signal is asserted (e.g., logic high), and the section_enable signal is deasserted (e.g., logic low). During this state, the routing line 620 j is configured to propagate the event signal generated by SPAD 412 to routing line 620 via buffer 414, MUX 604 and tri-state buffer 606 j TDC 610 from routing line 620 j The generated event signal is received, and the histogram generation circuit 612 generates a ToF histogram based on the output of the TDC 610. Since the tri-state buffer 614 is disabled, the routing line 620 is coupled to j Each pixel 304 is isolated from each other so that each pixel 304 can cooperate with the corresponding time capture circuit 608 to perform an integration operation.

[0066] During the readout process (when the pixel subset 600 is in the readout mode), the read_histogram signal is asserted (e.g., logic high), the spad_enable signal is deasserted (e.g., logic low), and the section_enable signal is asserted (e.g., logic high). During this state, the buffer_enable signal is sequentially asserted (e.g., logic high) so that data from each histogram generation circuit 612 (e.g., ToF histogram data, such as counts for each bin) is sequentially propagated to the MUX 604 via the array bus (e.g., where the array bus includes (e.g., vertical) routing lines that connect the tri-state buffers 614, 606, and the TDC 610), and then propagated to the tri-state buffer 606 to enter the routing line 620. j The processor 110 then sequentially receives data from each histogram generation circuit 612 and may perform further processing, for example.

[0067] In some embodiments, the J (e.g., vertical) routing lines of routing bus 620 are repeated in a (e.g., vertical) pattern. For example, if pixel subset 600 has 30 pixels 304 per column, and J is 10, then each pixel subset 600 has 3 pixels coupled to each routing line of routing bus 620. The pattern is for column Col i Repeat for each subset of pixels.

[0068] In this example, there is a column named Col. i There are 30 TDCs 610 (and corresponding histogram generation circuits) associated and coupled to a routing bus 620 (3 TDCs coupled to each of the 10 routing lines of routing bus 620).

[0069] like Figure 6C As shown, each column Col i A column of pixels 304 and a column of time capture circuits 608 are included. In some embodiments, the pixel array 302 includes M columns of pixels 304 alternating with M columns of time capture circuits 608, where M is a positive integer greater than 1. Other arrangements are also possible. For example, in some embodiments, the pixel array 302 includes M / 2 pairs of columns of pixels 304 alternating with M / 2 pairs of columns of time capture circuits 608 (e.g., in a mirrored arrangement).

[0070] The controller 650 is configured to generate read_histogram, buffer_enable, spad_enable and section_enable signals to configure the pixel subset 600, for example for integration or for readout.

[0071] Some embodiments include one controller 650 per subset of pixels 600. Other embodiments include a single controller 650 for all subsets of pixels in pixel array 302. Other implementations are also possible.

[0072] For example, the controller 650 may be implemented using, for example, combinatorial logic (such as, for example, a finite state machine) coupled to a memory (such as, for example, a register, OTP, ROM, or RAM).

[0073] Advantages of some embodiments include reduced routing by sharing a routing bus to route SPAD pulses during integration and to route histogram data during data readout. In some embodiments, the reduction in routing can allow for a higher resolution DTOF sensor to be implemented because the complexity of, for example, routing congestion associated with coupling routing lines to a histogram generation circuit, which may be much larger than a pixel (e.g., may extend over the height of multiple pixels), can be mitigated or avoided. Some embodiments can advantageously enable a very compact implementation because there is no additional area outside the array for the histogram generation circuit.

[0074] Figure 7 Column Col of pixel array 302 according to an embodiment of the present invention is shown. i . Figure 7 The embodiments are as follows Figure 6A-6C The embodiment shown operates in a similar manner. However, Figure 7 The embodiment includes a buffer 704 for buffering the histogram data directly to the routing line 620. j without passing through the bus driver circuit 602.

[0075] Example embodiments of the invention are summarized here. Other embodiments may also be understood from the entire specification and claims submitted herein.

[0076] Example 1. A time-of-flight (ToF) sensor, comprising: a pixel array arranged in rows and columns, the pixel array comprising a first subset of pixels and a second subset of pixels, each pixel in the pixel array being configured to generate an event signal; a first plurality of time-to-digital converters (TDCs); a second plurality of TDCs; a first routing bus coupled to the first plurality of TDCs and the second plurality of TDCs and the first subset of pixels and the second subset of pixels, the first routing bus comprising a first plurality of bus drivers associated with the first subset of pixels and a second plurality of bus drivers associated with the second subset of pixels, the first plurality of bus drivers being coupled to the second plurality of TDCs via the second plurality of bus drivers, and The second plurality of bus drivers are coupled to the first plurality of TDCs via the first plurality of bus drivers; and a controller configured to: when the first pixel subset is active and the second pixel subset is inactive, control the first plurality of bus drivers to route event signals from half of the pixels in the first pixel subset to the first plurality of TDCs, and control the first plurality of bus drivers and the second plurality of bus drivers to route event signals from the other half of the pixels in the first pixel subset to the second plurality of TDCs, and when the first pixel subset is inactive and the second pixel subset is active, control the first plurality of bus drivers to route event signals from the second pixel subset to the first plurality of TDCs.

[0077] Example 2. A ToF sensor according to Example 1, wherein: the first pixel subset includes L pixels, L is a positive integer greater than 1; the second pixel subset includes L pixels; and the first routing bus includes L / 2 routing lines.

[0078] Example 3. A ToF sensor according to one of Examples 1 or 2, wherein L is 30.

[0079] Example 4. The ToF sensor of any of Examples 1 to 3, wherein each routing line in the first routing bus is configured to receive event signals from two pixels in the first subset of pixels.

[0080] Example 5. A ToF sensor according to any one of Examples 1 to 4, wherein the first subset of pixels and the second subset of pixels are physically arranged between the first plurality of TDCs and the second plurality of TDCs.

[0081] Example 6. The ToF sensor of any of Examples 1 to 5, wherein each pixel in the first subset of pixels comprises a single photon avalanche diode (SPAD) coupled to a corresponding bus driver in the first plurality of bus drivers.

[0082] Example 7. A ToF sensor according to one of Examples 1 to 6, wherein each bus driver of the first plurality of bus drivers comprises: a multiplexer; a first buffer having an input coupled to an output of the multiplexer and an output coupled to a first input of the multiplexer; and a second buffer having an input coupled to the output of the multiplexer and an output coupled to a second input of the multiplexer.

[0083] Example 8. A ToF sensor according to one of Examples 1 to 7, wherein the first pixel subset and the second pixel subset correspond to a first pixel column in the pixel array, and the ToF sensor further includes: a second routing bus associated with a second pixel column in the pixel array, wherein the second pixel column includes a third pixel subset; and a third plurality of TDCs and a fourth plurality of TDCs, wherein when the third pixel subset is active, the second routing bus is configured to route event signals from half of the pixels in the third pixel subset to the third plurality of TDCs, and to route event signals from the other half of the pixels in the third pixel subset to the fourth plurality of TDCs.

[0084] Example 9. A ToF sensor according to any one of Examples 1 to 8, wherein the first subset of pixels and the third subset of pixels are configured to be active simultaneously.

[0085] Example 10. The ToF sensor of any one of Examples 1 to 9 further includes an illumination source configured to generate light pulses, wherein pixels in the pixel array are configured to generate event signals from light pulses based on the generated light pulses.

[0086] Example 11. The ToF sensor of any of Examples 1 to 10, further comprising a processor configured to generate a ToF histogram based on outputs of the first plurality of TDCs and outputs of the second plurality of TDCs.

[0087] Example 12. A method comprising: activating a first subset of pixels of a pixel array of a time-of-flight (ToF) sensor, the pixel array being arranged in rows and columns; when the first subset of pixels is active, controlling a first plurality of bus drivers of a first routing bus to route event signals from half of the pixels in the first subset of pixels to a first plurality of TDCs, and controlling the first plurality of bus drivers and a second plurality of bus drivers to route event signals from the other half of the pixels in the first subset of pixels to a second plurality of TDCs, wherein the first plurality of bus drivers are coupled to the second plurality of TDCs via the second plurality of bus drivers, wherein the second plurality of bus drivers are coupled to the first plurality of TDCs via the first plurality of bus drivers, wherein the first plurality of bus drivers are associated with the first subset of pixels, and wherein the second plurality of bus drivers are associated with a second subset of pixels in the pixel array; activating the second subset of pixels; and when the second subset of pixels is active, controlling the first plurality of bus drivers to route event signals from the second subset of pixels to the first plurality of TDCs.

[0088] Example 13. The method of Example 12 further includes receiving event signals from two pixels in the first subset of pixels using routing lines of the first routing bus.

[0089] Example 14. The method according to one of Examples 12 or 13 further includes: generating a plurality of light pulses; and receiving reflected light pulses having the pixel array, wherein the event signal from the pixel in the first pixel subset is based on the reflected light pulse.

[0090] Example 15. The method of any of Examples 12 to 14, further comprising generating a ToF histogram based on outputs from the first plurality of TDCs and outputs from the second plurality of TDCs.

[0091] Example 16. A method according to one of Examples 12 to 15, wherein: the first pixel subset includes L pixels, L is a positive integer greater than 1; the second pixel subset includes L pixels; and the first routing bus includes L / 2 routing lines.

[0092] Example 17. An integrated circuit (IC) comprising: a pixel array arranged in rows and columns, the pixel array including a first subset of pixels, each pixel in the pixel array being configured to generate an event signal; a plurality of top time-to-digital converters (TDCs) physically disposed at the top of the pixel array; a plurality of bottom TDCs physically disposed at the bottom of the pixel array; a routing bus coupled to the plurality of top TDCs and the plurality of bottom TDCs and the first subset of pixels, the routing bus including a plurality of bus drivers associated with the first subset of pixels; and a controller configured to: when the first subset of pixels is active, control the plurality of bus drivers to route event signals from an upper half of pixels in the first subset of pixels to the plurality of top TDCs, and to route event signals from a lower half of pixels in the first subset of pixels to the plurality of bottom TDCs, and when the first subset of pixels is inactive, control all of the plurality of bus drivers to route event signals of the routing bus to the plurality of top TDCs.

[0093] Example 18. The IC of Example 17, wherein each routing line of the routing bus is configured to receive event signals from two pixels in the first subset of pixels.

[0094] Example 19. An IC according to one of Examples 17 or 18, wherein: the first subset of pixels includes L pixels, L is a positive integer greater than 1; and the routing bus includes L / 2 routing lines.

[0095] Example 20. An IC according to one of Examples 17 to 19, wherein each of the plurality of bus drivers comprises: a multiplexer; a first buffer having an input coupled to the output of the multiplexer and an output coupled to a first input of the multiplexer, the output of the first buffer being further coupled to a top TDC of the plurality of top TDCs; and a second buffer having an input coupled to the output of the multiplexer and an output coupled to a second input of the multiplexer, the output of the second buffer being further coupled to a bottom TDC of the plurality of bottom TDCs.

[0096] Example 21. A time-of-flight (ToF) sensor, comprising: a pixel array arranged in rows and columns, each pixel in the pixel array being configured to generate an event signal, the pixel array comprising a pixel subset; a routing bus coupled to the pixel subset; a plurality of time capture circuits coupled to the routing bus; and a controller configured to: when the pixel subset is in an integration mode, route the event signal from a first pixel in the pixel subset to a first time capture circuit among the plurality of time capture circuits via a first routing line of the routing bus, and when the pixel subset is in a readout mode, route data from the first time capture circuit to a readout circuit via the first routing line.

[0097] Example 22. A ToF sensor according to Example 21, wherein the first routing line includes a partial tri-state buffer coupled between the first pixel and a second pixel in the pixel subset, and wherein the controller is further configured to: disable the partial tri-state buffer when the pixel subset is in an integration mode; and enable the partial tri-state buffer when the pixel subset is in a readout mode.

[0098] Example 23. A ToF sensor according to one of Examples 21 or 22, wherein the controller is further configured to: when the subset of pixels is in an integration mode, route an event signal from the second pixel via the first routing line to a second time capture circuit among the plurality of time capture circuits.

[0099] Example 24. A ToF sensor according to one of Examples 21 to 23, wherein the first time capture circuit includes a time-to-digital converter (TDC).

[0100] Example 25. The ToF sensor of any of Examples 21 to 24, wherein the first time capture circuit further comprises a histogram generation circuit, and wherein routing data from the first time capture circuit to the read circuit comprises routing a ToF histogram.

[0101] Example 26. The ToF sensor of any of Examples 21 to 25, wherein each of the plurality of time capture circuits comprises a respective tri-state buffer coupled to the routing bus.

[0102] Example 27. A ToF sensor according to one of Examples 21 to 26, wherein each pixel in the subset of pixels includes a single photon avalanche diode (SPAD) coupled to the routing bus via a corresponding bus driver circuit.

[0103] Example 28. The ToF sensor of any of Examples 21 to 27, wherein each bus driver circuit comprises a tri-state buffer coupled to the routing bus.

[0104] Example 29. A ToF sensor according to one of Examples 21 to 28, wherein each bus driving circuit further comprises a multiplexer having a first input coupled to a corresponding SPAD, a second input coupled to a corresponding time capture circuit among the plurality of time capture circuits, and an output coupled to a corresponding tri-state buffer.

[0105] Example 30. A ToF sensor according to one of Examples 21 to 29, wherein the pixel subset corresponds to a first pixel column in the pixel array, and the ToF sensor further includes: a second routing bus associated with a second pixel column in the pixel array, wherein the second pixel column includes a second pixel subset; and a second plurality of time capture circuits coupled to the second routing bus, wherein when the second pixel subset is in an integration mode, a second routing line of the second routing bus is configured to route an event signal from a second pixel in the second pixel subset to a second time capture circuit in the second plurality of time capture circuits, and when the second pixel subset is in a readout mode, the second routing line is configured to route data from the second time capture circuit to the readout circuit.

[0106] Example 31. A ToF sensor according to any one of Examples 21 to 30, wherein the subset of pixels and the second subset of pixels are configured to be in integration mode simultaneously.

[0107] Example 32. A ToF sensor according to any one of Examples 21 to 31, wherein the reading circuit includes an external processor.

[0108] Example 33. A ToF sensor according to one of Examples 21 to 32, further comprising an illumination source configured to generate light pulses, wherein pixels in the pixel array are configured to generate event signals from light pulses based on the generated light pulses.

[0109] Example 34. A method comprising: setting a subset of pixels in a pixel array of a time of flight (ToF) sensor to an integration mode, the pixel array being arranged in rows and columns; when the pixel subset is in the integration mode, routing an event signal from a first pixel in the pixel subset to a first time capture circuit among a plurality of time capture circuits via a first routing line of a routing bus; setting the pixel subset to a readout mode; and when the pixel subset is in the readout mode, routing data from the first time capture circuit to a readout circuit via the first routing line.

[0110] Example 35. The method according to Example 34 further includes: disabling a partial tri-state buffer coupled between the first pixel and the second pixel in the pixel subset when the pixel subset is in an integration mode; and enabling the partial tri-state buffer when the pixel subset is in a readout mode.

[0111] Example 36. The method of one of Examples 34 or 35, further comprising: routing an event signal from the second pixel via the first routing line to a second time capture circuit among the plurality of time capture circuits when the subset of pixels is in an integration mode.

[0112] Example 37. The method according to one of Examples 34 to 36 further includes: generating a plurality of light pulses; and receiving reflected light pulses having the pixel array, wherein the event signal is based on the reflected light pulses.

[0113] Example 38. An integrated circuit (IC) comprising: a pixel array arranged in rows and columns, each pixel in the pixel array being configured to generate an event signal, the pixel array comprising a pixel subset; a routing bus coupled to the pixel subset, the routing bus comprising J routing lines, wherein J is a positive integer greater than 1, wherein each of the J routing lines is coupled to more than 1 pixel in the pixel subset; a plurality of time capture circuits coupled to the routing bus; and a controller configured to: when the pixel subset is in an integration mode, route the event signal from a first pixel in the pixel subset via a first routing line of the routing bus to a first time capture circuit among the plurality of time capture circuits, and when the pixel subset is in a readout mode, route data from the first time capture circuit via the first routing line to a readout circuit.

[0114] Example 39. The IC of Example 38, wherein each of the J routing lines is coupled to 3 pixels in the subset of pixels.

[0115] Example 40. An IC according to one of Examples 38 or 39, wherein the pixel array includes M pixel columns and M TDC columns in an alternating pattern, where M is a positive integer greater than 1.

[0116] Although the present invention has been described with reference to illustrative embodiments, the description is not intended to be interpreted in a limiting sense. Various modifications and combinations of the exemplary embodiments and other embodiments of the present invention will be clear to those skilled in the art by reference to the specification. Therefore, it is intended that the appended claims cover any such modifications or embodiments.

Claims

1. An integrated circuit IC, comprising: a pixel array arranged in rows and columns, the pixel array comprising a first subset of pixels, each pixel in the pixel array being configured to generate an event signal; a plurality of top time-to-digital converters (TDCs), the plurality of TDCs being physically disposed at the top of the pixel array; a plurality of bottom TDCs, the plurality of bottom TDCs being physically disposed at a bottom of the pixel array; a routing bus coupled to the plurality of top TDCs and the plurality of bottom TDCs and the first subset of pixels, the routing bus including a plurality of bus drivers associated with the first subset of pixels; as well as The controller is configured as: When the first subset of pixels is active, controlling the plurality of bus drivers to route event signals from an upper half of pixels in the first subset of pixels to the plurality of top TDCs and to route event signals from a lower half of pixels in the first subset of pixels to the plurality of bottom TDCs, and When the first subset of pixels is inactive, all of the plurality of bus drivers are controlled to route event signals of the routing bus to the plurality of top TDCs. 2 . The IC of claim 1 , wherein each routing line in the routing bus is configured to receive event signals from two pixels in the first subset of pixels.

3. The IC of claim 1, wherein: The first pixel subset includes L pixels, where L is a positive integer greater than 1; and The routing bus includes L / 2 routing lines.

4. The IC of claim 1 , wherein each of the plurality of bus drivers comprises: Multiplexer; a first buffer having an input coupled to the output of the multiplexer and an output coupled to a first input of the multiplexer, the output of the first buffer also coupled to a top TDC of the plurality of top TDCs; as well as A second buffer has an input coupled to the output of the multiplexer and an output coupled to a second input of the multiplexer, the output of the second buffer also coupled to a bottom TDC of the plurality of bottom TDCs.

5. A time-of-flight ToF sensor, comprising: an array of pixels arranged in rows and columns, each pixel in the array of pixels being configured to generate an event signal, the array of pixels comprising a subset of pixels; a routing bus coupled to the subset of pixels; a plurality of time capture circuits coupled to the routing bus; as well as The controller is configured as: routing an event signal from a first pixel in the subset of pixels to a first time capture circuit of the plurality of time capture circuits via a first routing line of the routing bus when the subset of pixels is in an integration mode, and When the subset of pixels is in a readout mode, data is routed from the first time capture circuit to a readout circuit via the first routing line.

6. The ToF sensor of claim 5 , wherein the first routing line comprises a partial tri-state buffer coupled between the first pixel and a second pixel in the subset of pixels, and wherein the controller is further configured to: disabling the portion of the tri-state buffer when the subset of pixels is in an integration mode; and When the subset of pixels is in a readout mode, the portion of the tri-state buffer is enabled. 7 . The ToF sensor of claim 6 , wherein the controller is further configured to: when the subset of pixels is in an integration mode, route an event signal from the second pixel to a second time capture circuit of the plurality of time capture circuits via the first routing line. 8 . The ToF sensor of claim 5 , wherein the first time capture circuit comprises a time-to-digital converter (TDC).

9. The ToF sensor of claim 8, wherein the first time capture circuit further comprises a histogram generation circuit, and wherein routing data from the first time capture circuit to the readout circuit comprises routing a ToF histogram. 10 . The ToF sensor of claim 5 , wherein each of the plurality of time capture circuits comprises a respective tri-state buffer coupled to the routing bus.

11. The ToF sensor of claim 5, wherein each pixel in the subset of pixels comprises a single photon avalanche diode (SPAD) coupled to the routing bus via a corresponding bus driver circuit. 12 . The ToF sensor of claim 11 , wherein each bus driver circuit comprises a tri-state buffer coupled to the routing bus.

13. The ToF sensor of claim 12, wherein each bus driving circuit further comprises a multiplexer having a first input coupled to a corresponding SPAD, a second input coupled to a corresponding time capture circuit among the plurality of time capture circuits, and an output coupled to a corresponding tri-state buffer.

14. The ToF sensor of claim 5, wherein the subset of pixels corresponds to a first pixel column in the pixel array, the ToF sensor further comprising: a second routing bus associated with a second column of pixels in the pixel array, wherein the second column of pixels includes a second subset of pixels; as well as a second plurality of time capture circuits coupled to the second routing bus, wherein a second routing line of the second routing bus is configured to route an event signal from a second pixel in the second subset of pixels to a second time capture circuit in the second plurality of time capture circuits when the second subset of pixels is in an integration mode, and wherein the second routing line is configured to route data from the second time capture circuit to the readout circuit when the second subset of pixels is in a readout mode. 15 . The ToF sensor of claim 14 , wherein the subset of pixels and the second subset of pixels are configured to be in integration mode simultaneously.

16. The ToF sensor of claim 5, wherein the readout circuit comprises an external processor.

17. The ToF sensor of claim 5, further comprising an illumination source configured to generate light pulses, wherein pixels in the pixel array are configured to generate event signals from light pulses based on the generated light pulses.

18. A method comprising: Setting a subset of pixels in a pixel array of a time-of-flight ToF sensor into an integration mode, the pixel array being arranged in rows and columns; routing an event signal from a first pixel in the subset of pixels to a first time capture circuit of a plurality of time capture circuits via a first routing line of a routing bus when the subset of pixels is in an integration mode; placing the subset of pixels in a readout mode; as well as When the subset of pixels is in a readout mode, data is routed from the first time capture circuit to a readout circuit via the first routing line.

19. The method according to claim 18, further comprising: disabling a portion of a tri-state buffer coupled between the first pixel and a second pixel in the subset of pixels when the subset of pixels is in an integration mode; as well as When the subset of pixels is in a readout mode, the portion of the tri-state buffer is enabled.

20. The method according to claim 19, further comprising: When the subset of pixels is in an integration mode, an event signal is routed from the second pixel via the first routing line to a second time capture circuit of the plurality of time capture circuits.

21. The method of claim 18, further comprising: generating a plurality of light pulses; as well as A reflected light pulse is received using the pixel array, wherein the event signal is based on the reflected light pulse.

22. The method of claim 18, wherein the first time capture circuit comprises a time-to-digital converter (TDC), wherein the first time capture circuit further comprises a histogram generation circuit, and wherein routing data from the first time capture circuit to the read circuit comprises routing a ToF histogram.