Image sensor, control method and device thereof, electronic equipment and storage medium

Abstract

The invention discloses an image sensor, a control method and device thereof, electronic equipment and a storage medium. The image sensor comprises a pixel chip, the pixel chip comprises a pixel array, the pixel array comprises N pixel circuits and N registers, the N registers and the N pixel circuits are in one-to-one correspondence, the registers are connected with the corresponding pixel circuits, each pixel circuit comprises a single photon avalanche transistor, and N is a positive integer; the first end of the signal transmission structure is connected with the pixel chip, the first end of the signal transmission structure is located on the peripheral side of the pixel array, and the signal transmission structure comprises X first transmission structures and Y second transmission structures; the logic chip is provided with a column scanning circuit and a row clock control circuit, the column scanning circuit is connected with the X column registers through the X first transmission structures, and the row clock control circuit is connected with the Y row pixel circuits through the Y second transmission structures.

Description

Technical Field

[0001] The present application belongs to the technical field of image processors, and specifically relates to an image sensor and a control method, device, electronic device and storage medium thereof. Background Art

[0002] SPAD (Single-Photon Avalanche Diode) is currently widely used in dToF (direct Time-of-Flight) image sensor chips. In recent years, researchers have begun to study the use of SPAD to replace PPD (Pinned Photodiode) as the pixel photosensitive element of ordinary visible light RGB (Red, Green, Blue) camera CIS (Contact Image Sensor).

[0003] The pixel circuit architecture of the CMOS (complementary metal-oxide-semiconductor, image sensor chip) single-photon image sensor based on SPAD devices has undergone significant changes compared to the current mainstream CMOS image sensor based on PPD pixels.

[0004] In the related art, the pixels of CMOS single-photon image sensors based on SPAD pixels have the problem of excessively large chip stacking size due to complex circuit structures and numerous components. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an image sensor and a control method, device, electronic device and storage medium thereof, which solve the problem of chip stacking size being too large.

[0006] In a first aspect, an embodiment of the present application provides an image sensor, comprising: a pixel chip, the pixel chip comprising a pixel array, the pixel array comprising N pixel circuits and N registers, the N registers corresponding one-to-one to the N pixel circuits, the registers connected to the corresponding pixel circuits, the pixel circuit comprising a single photon avalanche transistor, and N being a positive integer; a signal transmission structure, a first end of the signal transmission structure connected to the pixel chip, the first end of the signal transmission structure being located on the periphery of the pixel array, the signal transmission structure comprising X first transmission structures and Y second transmission structures, the X first transmission structures corresponding one-to-one to the X-column pixel circuits in the pixel array, the Y second transmission structures corresponding one-to-one to the Y-row pixel circuits in the pixel array, X and Y being positive integers, and X×Y=N; a logic chip, arranged opposite to the pixel chip, the logic chip connected to the second end of the signal transmission structure, a column scanning circuit and a row clock control circuit arranged on the logic chip, the column scanning circuit connected to the X-column registers through the X first transmission structures, and the row clock control circuit connected to the Y-row pixel circuit through the Y second transmission structures.

[0007] In a second aspect, an embodiment of the present application provides a control method, which is applied to the above-mentioned image sensor, and the control method includes: a row clock control circuit in a logic chip transmits a row clock signal to a Y-row pixel circuit through Y second transmission structures; the Y-row pixel circuit in a pixel array responds to the row clock signal, synchronously exposes in a first time period, and stores the image signal obtained by exposure in a corresponding register in a second time period; and the X-column register transmits the image signal to the column scanning circuit in the logic chip through the X first transmission structures in a third time period.

[0008] In a third aspect, an embodiment of the present application provides a control device, which is applied to the above-mentioned image sensor, and the control device includes: a transmission module, which is used for the row clock control circuit in the logic chip to transmit the row clock signal to the Y row pixel circuit through Y second transmission structures; an exposure module, which is used for the Y row pixel circuit in the pixel array to respond to the row clock signal and synchronously expose in a first time period; a storage module, which is used to store the image signal obtained by exposure in the corresponding register in the second time period; and a transmission module, which is used for the X column register to transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures in the third time period.

[0009] In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores programs or instructions that can be executed on the processor, and when the programs or instructions are executed by the processor, the steps of the method of the second aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the second aspect are implemented.

[0011] In a sixth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method of the second aspect.

[0012] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method of the second aspect.

[0013] In the embodiment of the present application, by only setting the pixel array and the corresponding registers of each pixel circuit in the pixel chip, and setting logic circuits such as the column scanning circuit and the row clock control circuit in the logic chip, there is no need to set up additional logic circuits in the pixel chip, and there is no need to set up pixel circuits on the logic chip, so that the stack size of the logic chip is consistent with that of the pixel chip, thereby reducing the size of the overall architecture of the image sensor. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 A schematic diagram of the structure of an image sensor provided in some embodiments of the present application is shown;

[0015] Figure 2 A schematic diagram of the structure of a pixel chip provided in some embodiments of the present application is shown;

[0016] Figure 3 A schematic diagram showing the structure of a logic chip provided in some embodiments of the present application is shown;

[0017] Figure 4 A time schematic diagram of an operating mode of an image sensor provided in some embodiments of the present application is shown;

[0018] Figure 5 A flow chart of a control method provided in some embodiments of the present application is shown;

[0019] Figure 6 shows an operating timing diagram of an image sensor provided in some embodiments of the present application;

[0020] Figure 7 One of the schematic diagrams of register working periods provided in some embodiments of the present application is shown;

[0021] Figure 8 The second schematic diagram of the register working period provided in some embodiments of the present application is shown;

[0022] Fig. 9 A schematic diagram showing the arrangement of sub-pixel arrays provided in some embodiments of the present application is shown;

[0023] Fig.10 The third schematic diagram of the register working period provided in some embodiments of the present application is shown;

[0024] Fig.11 A schematic block diagram of a control device provided in some embodiments of the present application is shown;

[0025] Fig.12 A structural block diagram of an electronic device according to an embodiment of the present application is shown;

[0026] Fig.13 A schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application is shown.

[0027] Figures 1 to 3 The reference numerals in the figures are as follows:

[0028] 100 image sensor, 110 pixel chip, 112 pixel array, 1122 pixel circuit, 1124 register, 120 signal transmission structure, 122 first transmission structure, 124 second transmission structure, 126 third transmission structure, 130 logic chip, 131 column scanning circuit, 132 row clock control circuit, 133 column clock control circuit, 134 image signal processing circuit, 135 port circuit, 136 auxiliary circuit, 137 communication pin. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0031] The following is combined with Figures 1 to 13 , the image sensor and its control method, device, electronic device and storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0032] In some embodiments of the present application, an image sensor is provided. Figure 1 shows a schematic structural diagram of an image sensor provided in some embodiments of the present application, Figure 2 shows a schematic structural diagram of a pixel chip provided in some embodiments of the present application, Figure 3 Schematic diagram of the structure of the logic chip provided in some embodiments of the present application is shown, such as Figure 1 , Figure 2 and Figure 3 As shown, the image sensor 100 includes: a pixel chip 110, the pixel chip 110 includes a pixel array 112, the pixel array 112 includes N pixel circuits 1122 and N registers 1124, the N registers 1124 correspond to the N pixel circuits 1122 one by one, the registers 1124 are connected to the corresponding pixel circuits 1122, the pixel circuits 1122 include single photon avalanche transistors, and N is a positive integer; a signal transmission structure 120, the first end of the signal transmission structure 120 is connected to the pixel chip 110, the first end of the signal transmission structure 120 is located on the peripheral side of the pixel array 112, and the signal transmission structure 120 includes X first transmission structures 122 and Y second transmission structures 124. 4, X first transmission structures 122 correspond one-to-one to X column pixel circuits 1122 in the pixel array 112, Y second transmission structures 124 correspond one-to-one to Y row pixel circuits 1122 in the pixel array 112, X and Y are both positive integers, and X×Y=N; a logic chip 130 is arranged opposite to the pixel chip 110, the logic chip 130 is connected to the second end of the signal transmission structure 120, a column scanning circuit 131 and a row clock control circuit 132 are arranged on the logic chip 130, the column scanning circuit 131 is connected to the X column register 1124 through the X first transmission structures 122, and the row clock control circuit 132 is connected to the Y row pixel circuit 1122 through the Y second transmission structures 124.

[0033] In the embodiment of the present application, the image sensor 100 includes a pixel chip 110, a logic chip 130, and a signal transmission structure 120 arranged between the pixel chip 110 and the logic chip 130, and the first end and the second end of the signal transmission structure 120 are respectively connected to the pixel chip 110 and the logic chip 130.

[0034] The pixel chip 110 includes a pixel array 112, and the pixel array 112 includes N pixel circuits 1122 and N registers 1124. Each register 1124 is connected to each pixel circuit 1122. The pixel circuit 1122 is a pixel circuit 1122 of a single-photon avalanche transistor. After exposure, the pixel circuit 1122 stores the image signal in the corresponding register 1124. The logic chip 130 is stacked below the pixel chip 110. The logic chip 130 includes a column scanning circuit 131 and a row clock control circuit 132. The column scanning circuit 131 is used to read the image signals stored in the N registers 1124 in the pixel chip 110. The row clock control circuit 132 is used to transmit a row clock signal to the pixel chip 110. The pixel circuit 1122 in the pixel array 112 can be timed and controlled by the row clock signal.

[0035] Exemplarily, the row clock control circuit 132 sends a row clock signal to the pixel chip 110, and the pixel chip 110 can control the pixel array 112 to expose in response to the row clock signal, and control the register 1124 to transmit the image signal obtained by exposure according to the first clock information in the row clock signal.

[0036] In the embodiment of the present application, the signal transmission structure 120 includes a first transmission structure 122 and a second transmission structure 124, wherein the first transmission structure 122 is used to transmit the image signal stored in the register 1124 to the logic chip 130, and the second transmission structure 124 is used to transmit the row clock signal of the row clock control circuit 132 in the logic chip 130 to the pixel chip 110.

[0037] Specifically, the number of pixel circuits 1122 in the pixel array 112 is N, and the arrangement of the N pixel circuits 1122 is Y×X, that is, the N pixel circuits 1122 include X columns of pixel circuits 1122 and Y rows of pixel circuits 1122. The number of first transmission structures 122 in the signal transmission structure 120 is set to X, and each first transmission structure 122 corresponds to a single column of pixel circuits 1122, that is, each first transmission structure 122 is used to transmit the image signal in a column of registers 1124 corresponding to a column of pixel circuits 1122. The number of second transmission structures 124 in the signal transmission structure 120 is set to Y, and each second transmission structure 124 corresponds to a single row of pixel circuits 1122, that is, each second transmission structure 124 is used to transmit the row clock signal to the corresponding row of pixel circuits 1122, so as to control the exposure of a row of pixel circuits 1122 and the transmission of the image signal in a row of registers 1124.

[0038] like Figure 2 and Figure 3As shown, exemplarily, the first end of the signal transmission structure 120 is spaced apart from the pixel array 112, and the first end of the signal transmission structure 120 is located at the peripheral side of the pixel array 112, and the first end of the signal transmission structure 120 encloses at least a portion of the pixel array 112. The second end of the signal transmission structure 120 is connected to the peripheral side of the logic chip 130.

[0039] It should be noted that in the related art, there is an architecture in which transmission circuits such as registers 1124 are arranged on chips other than pixel chip 110, which makes pixel chip 110 smaller, but circuits such as registers 1124 are arranged on other chips, which makes other chips larger. In the image sensor 100 structure in which pixel chip 110 and other chips are stacked, the stack sizes of each chip are inconsistent, resulting in a larger volume of the image sensor 100 architecture.

[0040] In the embodiment of the present application, by only setting the pixel array 112 and the register 1124 corresponding to each pixel circuit 1122 in the pixel chip 110, and setting logic circuits such as the column scanning circuit 131 and the row clock control circuit 132 in the logic chip 130, there is no need to set up additional logic circuits in the pixel chip 110, and there is no need to set the pixel circuit 1122 on the logic chip 130, so that the stack size of the logic chip 130 is consistent with that of the pixel chip 110, thereby reducing the size of the overall architecture of the image sensor 100.

[0041] In some embodiments of the present application, the Y registers 1124 in each column of registers 1124 are respectively connected to the corresponding first transmission structure 122 .

[0042] In the embodiment of the present application, the pixel array 112 includes Y rows and X columns of pixel circuits 1122, and each pixel circuit 1122 is correspondingly provided with a register 1124, and the registers 1124 are arranged in Y rows and X columns. There are X registers 1124 in each row of registers 1124, and there are Y registers 1124 in each column of registers 1124.

[0043] In the embodiment of the present application, the Y registers 1124 in each column of registers 1124 are connected in parallel to the first end of the first transmission structure 122. Specifically, the first transmission structure 122 in the signal transmission structure 120 is used to transmit the image signal in the register 1124, the number of the first transmission structures 122 is set to X, and the first end of each first transmission structure 122 is set corresponding to each column of pixel circuits 1122, and each first transmission structure 122 is connected to the register 1124 corresponding to a single column of pixel circuits 1122 one by one, that is, the Y registers 1124 in one column are connected in parallel to the first end of the first transmission structure 122. When the X first transmission structures 122 synchronously transmit the image signal, the image signal in a row of registers 1124 can be transmitted to the logic chip 130 at a time.

[0044] It should be noted that the number of the first transmission structures 122 may be an integer multiple of X. When the number of the first transmission structures 122 is 2X, the image signals in two rows of registers 1124 can be transmitted each time through the 2X transmission structures.

[0045] Exemplarily, after the pixel array 112 is exposed to obtain an image signal, the image signal is stored in the register 1124 corresponding to each pixel circuit 1122. At this time, the image signal is stored in each of the Y×X registers 1124, and each register 1124 in a column of registers 1124 is connected in parallel to the first end of the corresponding first transmission structure 122. After the pixel chip 110 receives the row clock signal, the image signal of the first row is transmitted to the column scanning circuit 131 at time 1, the image signal of the second row is transmitted to the column scanning circuit 131 at time 2, and ... the image signal of the Yth row is transmitted to the column scanning circuit 131 at time y.

[0046] In the embodiment of the present application, by connecting Y registers 1124 in each column of registers 1124 in parallel on the first transmission structure 122, the first transmission structure 122 can transmit the image signals in one row of registers 1124 each time, thereby improving the transmission efficiency of the image signals between the pixel chip 110 and the logic chip 130.

[0047] In some embodiments of the present application, the Y registers 1124 in each column of registers 1124 are connected in series, and the Y registers 1124 are connected to the first transmission structure 122 .

[0048] In the embodiment of the present application, the pixel array 112 includes Y rows and X columns of pixel circuits 1122, and each pixel circuit 1122 is correspondingly provided with a register 1124, and the registers 1124 are arranged in Y rows and X columns. There are X registers 1124 in each row of registers 1124, and there are Y registers 1124 in each column of registers 1124.

[0049] In the embodiment of the present application, the Y registers 1124 in each column of registers 1124 are connected in series, and the Y registers 1124 connected in series are connected to the first end of the first transmission structure 122. Specifically, the first transmission structure 122 in the signal transmission structure 120 is used to transmit the image signal in the register 1124, the number of the first transmission structures 122 is set to X, and the first end of each first transmission structure 122 is set corresponding to each column of pixel circuits 1122, and each first transmission structure 122 is connected to the nearest register 1124 in a single column of pixel circuits 1122. Since the registers 1124 in a column corresponding to the pixel circuits 1122 in a column are connected in series, that is, the Y registers 1124 in a column are connected in series to the first end of the first transmission structure 122, the first transmission structure 122 can transmit the image signal in the registers 1124 in a column. When the X first transmission structures 122 synchronously transmit image signals, at each moment, the image signals flow in the Y registers 1124 connected in series to the first transmission structures 122 until all image signals are transmitted to the column scanning circuit 131 of the logic chip 130 through the first transmission structures 122 .

[0050] Exemplarily, after the pixel array 112 is exposed to obtain an image signal, the image signal is stored in the register 1124 corresponding to each pixel circuit 1122. At this time, the image signal is stored in each of the Y×X registers 1124, and each register 1124 in a column of registers 1124 is connected in parallel to the first end of the corresponding first transmission structure 122. After the pixel chip 110 receives the row clock signal, the image signal of the first row register 1124 is transmitted to the column scanning circuit 131 at time 1, and the image signal of the second row register 1124 is transmitted to the image signal of the first row, ... The image signal of the Yth row register 1124 is transmitted to the Y-1th row register 1124, and the above steps are repeated at the next time until all image signals are transmitted to the logic chip 130 through the first transmission structure 122.

[0051] In the embodiment of the present application, by connecting Y registers 1124 in each column of registers 1124 in series on the first transmission structure 122, during the image signal transmission process, the image signal can flow in the series-connected registers 1124, so that the first transmission structure 122 can transmit the image signal in one row of registers 1124 each time, thereby improving the transmission efficiency of the image signal between the pixel chip 110 and the logic chip 130.

[0052] like Figure 1 and Figure 3 As shown, in some embodiments of the present application, the signal transmission structure 120 further includes X third transmission structures 126 , and the X third transmission structures 126 correspond one-to-one to the X columns of pixel circuits 1122 in the pixel array 112 ;

[0053] The logic chip 130 further includes: a column clock control circuit 133 connected to the X third transmission structures 126 . The column clock control circuit 133 is connected to the X column registers 1124 in the pixel array 112 through the X third transmission structures 126 .

[0054] In the embodiment of the present application, the signal transmission structure 120 also includes X third transmission structures 126, and the logic chip 130 also includes a column clock control circuit 133. The column clock control circuit 133 can transmit a column clock signal to the logic chip 130 through the third transmission structure 126, and perform timing and control on the logic chip 130 through the column clock signal. The third transmission structure 126 is used to transmit the column clock signal from the column clock control circuit 133 to the pixel chip 110.

[0055] Specifically, the number of pixel circuits 1122 in the pixel array 112 is N, and the arrangement of the N pixel circuits 1122 is Y×X, that is, the N pixel circuits 1122 include X columns of pixel circuits 1122 and Y rows of pixel circuits 1122. The number of third transmission structures 126 in the signal transmission structure 120 is set to X, and each third transmission structure 126 corresponds to a single column of pixel circuits 1122, that is, each third transmission structure 126 is used to transmit a column clock signal to a column register 1124, for a column register 1124.

[0056] Exemplarily, in the case where a column clock control circuit 133 is provided on the logic chip 130, the operation of each register 1124 and the transmission of the image signal are controlled by the column clock control circuit 133. When all pixel circuits 1122 on all rows complete the reading and caching of the signal, all rows synchronously enter the signal transmission period. The signal transmission period is divided into a plurality of column signal transmission periods. The pixel array 112 contains X columns, and the register 1124 is a shift register 1124. Then, the signal transmission period is divided into X column signal transmission periods, and the X signal transmission periods include: C1, C2, C3...CX. In each column signal transmission period, a certain column of pixel circuits 1122 shifts and transmits the output registered image signal to the column scanning circuit 131 on the logic chip 130 under the drive of the column clock and control circuit module, until the image signals registered in all registers on this column are transmitted out of the pixel array 112 to the column scanning circuit 131 on the logic chip 130.

[0057] In the embodiment of the present application, a column clock control circuit 133 is provided in the logic chip 130, and a third transmission structure 126 for transmitting the column clock signal of the column clock control circuit 133 is provided in the signal transmission structure, and the number of the third transmission structures 126 is set to be the same as the number of columns of the pixel array 112, so that the column clock signal output by the logic chip 130 can be synchronously transmitted to each column register 1124, thereby improving the signal transmission efficiency between the logic chip 130 and the pixel chip 110.

[0058] like Figure 3 As shown, in some embodiments of the present application, the logic chip 130 also includes: an image signal processing circuit 134, a first end of the image signal processing circuit 134 is connected to the column scanning circuit 131; and a port circuit 135, the port circuit 135 is connected to a second end of the image signal processing circuit 134.

[0059] In an embodiment of the present application, the logic chip 130 also includes an image signal processing circuit 134 and a port circuit 135. The image signal processing circuit 134 is arranged between the column scanning circuit 131 and the port circuit 135. The image signal processing circuit 134 can process the image signal transmitted from the pixel chip 110 to the logic chip 130.

[0060] Specifically, the column scanning circuit 131 in the logic chip 130 is connected to the register 1124 in the pixel chip 110 through the signal transmission structure 120, and the column scanning circuit 131 is also connected to the image signal processing circuit 134 in the logic chip 130. After acquiring the image signal in the pixel chip 110, the column scanning circuit 131 can transmit the image signal to the image signal processing circuit 134 for processing, and the processed image signal is transmitted to the outside of the logic chip 130 through the port circuit 135.

[0061] Figure 4 FIG. 1 shows a time diagram of an operating mode of an image sensor 100 provided in some embodiments of the present application. Figure 4As shown, a frame time includes K subframes, each of which is independent of each other, and the length and number of subframes can be adjusted according to different applications. The beginning of a frame time is the beginning of the 1st subframe, and after the Kth subframe is completed, the signal processing period is entered, that is, the image signal is processed by the image signal processing circuit 134, and when the image signal processing is completed, it is determined that this frame is completed and the next frame time is entered. All subframes of each row of pixel circuits 1122 in each frame time are completely aligned in time sequence, so the pixel circuits 1122 on all rows have the same number of subframes and the time when the subframes are completed is all the same. The duration of the image signal processing period of each row of pixel circuits 1122 is consistent. The signal processing period is mainly the time for the image signal processing circuit 134, the auxiliary circuit 136 and the port circuit 135 located in the logic layer to perform the last image signal processing in the frame, reset the circuit, and prepare for the start of the next frame. All pixel circuits 1122 in the pixel chip 110 can be effectively operated and read within one frame time. At the same time, the operation mode similar to the global shutter can effectively eliminate the jello effect of moving objects produced by the rolling shutter of the traditional image sensor 100.

[0062] In an embodiment of the present application, an image signal processing circuit 134 and a port circuit 135 are provided in the logic chip 130 , so that the logic chip 130 can process the image signal transmitted by the pixel chip 110 through the image signal processing circuit 134 , and transmit the processed image signal to the outside through the port circuit 135 .

[0063] In some embodiments of the present application, the signal transmission structure 120 includes at least one of the following: copper-copper bonding, through silicon via.

[0064] In the embodiment of the present application, the signal transmission structure 120 can be selected as one or a combination of copper-copper bonding (Cu-Cu bonding) and TSV (Trans-Silicon Via).

[0065] In some embodiments of the present application, the logic chip 130 further includes a communication pin 137 (I / O pin), and the signal input outside the chip and the signal output inside the chip are both performed through the communication pin 137 on the logic chip 130 .

[0066] In some embodiments of the present application, a control method is provided, which is applied to the image sensor in any of the above embodiments. Figure 5 : shows a flow chart of a control method provided in some embodiments of the present application, such as Figure 5 As shown, the control method includes:

[0067] Step 502: The row clock control circuit in the logic chip transmits a row clock signal to Y rows of pixel circuits through Y second transmission structures;

[0068] In an embodiment of the present application, the image sensor includes a pixel chip, a logic chip, and a signal transmission structure arranged between the pixel chip and the logic chip, and the signal transmission structure transmits signals between the logic chip and the pixel chip. The pixel chip includes a pixel array, and the pixel array includes N pixel circuits and N registers, each register is connected to each pixel circuit, and the pixel circuit is a pixel circuit of a single-photon avalanche transistor, and the pixel circuit stores the image signal in the corresponding register after exposure. The logic chip, the logic chip is stacked under the pixel chip, and the logic chip includes a column scanning circuit and a row clock control circuit. The column scanning circuit is used to read the image signal stored in the N registers in the pixel chip, and the row clock control circuit is used to transmit a row clock signal to the pixel chip, and the pixel circuit in the pixel array can be timed and controlled by the row clock signal.

[0069] Step 504, the Y-row pixel circuits in the pixel array respond to the row clock signal, synchronously expose in the first time period, and store the image signals obtained by exposure in the corresponding registers in the second time period;

[0070] In the embodiment of the present application, after receiving the row clock signal, the Y row pixel circuit in the pixel array performs exposure in a first period in response to the row clock signal. In a second period after the exposure is completed, the image signal obtained by the exposure of the pixel circuit is stored in a corresponding register.

[0071] Step 506 : X column registers transmit the image signal to the column scanning circuit in the logic chip through X first transmission structures during the third period.

[0072] In the embodiment of the present application, the register corresponding to the X-column pixel circuit transmits the image signal to the column scanning circuit of the logic chip through X first transmission structures during the third time period. The number of pixel circuits in the pixel array is N, and the arrangement of the N pixel circuits is Y×X, that is, the N pixel circuits include X-column pixel circuits and Y-row pixel circuits. The number of first transmission structures in the signal transmission structure is set to X, and each first transmission structure corresponds to a single column of pixel circuits, that is, each first transmission structure is used to transmit the image signal in a column of registers corresponding to a column of pixel circuits.

[0073] Specifically, the first period is the exposure period of the pixel circuit, the second period is the signal reading period of the register, and the third period is the signal transmission period. In the first period, the pixel circuit is exposed to obtain an image signal. In the second period, the pixel circuit transmits the image signal obtained by exposure to the register for storage. In the third period, the register transmits the image signal to the column scanning circuit in the logic chip through the first transmission structure.

[0074] Figure 6 1 shows an operation timing diagram of an image sensor provided in some embodiments of the present application, such as Figure 6 As shown, each subframe includes an exposure period of the pixel circuit, i.e., a first period. The exposure period of the pixel circuit is followed by a register operation period, which includes a second period for transmitting the image signal to the register for storage, and a third period for transmitting the image signal to the column scanning circuit in the logic chip.

[0075] In the embodiment of the present application, by only setting the pixel array and the corresponding registers of each pixel circuit in the pixel chip, and setting the logic circuits such as the column scanning circuit and the row clock control circuit in the logic chip, it is not necessary to set up additional logic circuits in the pixel chip, and it is not necessary to set up pixel circuits on the logic chip, so that the stack size of the logic chip and the pixel chip is consistent, and the size of the overall architecture of the image sensor is reduced. In addition, each pixel circuit starts and ends exposure synchronously within each frame time, and through the operation mode similar to the global shutter, the image sensor will not have the jelly effect unique to the rolling shutter when shooting moving objects, thereby improving the shooting effect of the image sensor.

[0076] In some embodiments of the present application, the Y registers in each column of registers are respectively connected to the corresponding first transmission structure;

[0077] The X columns of pixel circuits in the pixel array transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures in the third time period, including:

[0078] The Y row registers transmit the image signals to the column scanning circuit in turn in Y second sub-periods of the third period, wherein each second sub-period corresponds to the transmission of the image signals in a row of registers.

[0079] In the embodiment of the present application, the Y registers in each column of registers are connected in parallel to the first end of the first transmission structure. The first transmission structure in the signal transmission structure is used to transmit the image signal in the register, the number of the first transmission structures is set to X, and the first end of each first transmission structure is set corresponding to each column of pixel circuits, and each first transmission structure is connected to the registers corresponding to a single column of pixel circuits one by one, that is, the Y registers in a column are connected in parallel to the first end of the first transmission structure. When the X first transmission structures synchronously transmit image signals, the image signals in a row of registers can be transmitted to the logic chip at a time.

[0080] Specifically, the third period includes Y second sub-periods, and each of the Y second sub-periods is used to transmit the image signal in a row of registers to the column scanning circuit of the logic chip. Before the pixel circuit starts to be exposed, the pixel chip receives a first clock signal from the row clock control circuit, and the first period, the second period and the third period, as well as the Y second periods in the third period, can be determined by the first clock signal. After the exposure of the pixel circuit is completed and the image signal obtained by exposure is stored in the corresponding register, the image signals in the Y registers in each column of registers are sequentially transmitted to the column scanning circuit of the logic chip according to the Y second sub-periods in the third period.

[0081] It should be noted that the number of the first transmission structures may be an integer multiple of X. When the number of the first transmission structures is 2X, the image signals in two rows of registers can be transmitted each time through the 2X transmission structures.

[0082] Exemplarily, after the pixel array is exposed to obtain an image signal, the image signal is stored in a register corresponding to each pixel circuit. At this time, image signals are stored in Y×X registers, and each register in a column of registers is connected in parallel to the first end of the corresponding first transmission structure. After the pixel chip receives the row clock signal, the image signal of the first row is transmitted to the column scanning circuit at time 1, the image signal of the second row is transmitted to the column scanning circuit at time 2, and ... the image signal of the Yth row is transmitted to the column scanning circuit at time y.

[0083] In an embodiment of the present application, by connecting Y registers in each column of registers in parallel on the first transmission structure, the first transmission structure can transmit image signals in one row of registers each time, thereby improving the transmission efficiency of image signals between the pixel chip and the logic chip.

[0084] In some embodiments of the present application, the Y registers in each column of registers are connected in series, and the Y registers are connected to the first transmission structure;

[0085] The X columns of pixel circuits in the pixel array transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures in the third time period, including:

[0086] In the M second sub-periods within the third period, each row of registers receives the image signal transmitted by the previous row of registers, and transmits the image signal to the next row of registers, until the image signals in the Y row of registers are all transmitted to the column scanning circuit, M is a positive integer, and M=Y-1.

[0087] In an embodiment of the present application, the Y registers in each column of registers are connected in series, and the Y registers connected in series are connected to the first end of the first transmission structure. Specifically, the first transmission structure in the signal transmission structure is used to transmit the image signal in the register, the number of the first transmission structures is set to X, and the first end of each first transmission structure is set corresponding to each column of pixel circuits, and each first transmission structure is connected to the nearest register in a single column of pixel circuits. Since a column of registers corresponding to a column of pixel circuits is connected in series, that is, the Y registers in a column are connected in series to the first end of the first transmission structure, the first transmission structure can transmit the image signal in a column of registers. When the X first transmission structures synchronously transmit image signals, at each moment, the image signal flows to the first transmission structure in the Y registers connected in series until all image signals are transmitted to the column scanning circuit of the logic chip through the first transmission structure.

[0088] In an embodiment of the present application, the third time period includes M second sub-periods, and the second sub-period is used to transmit the image signal in the current row register to the next row register. The register closest to the first transmission structure transmits the stored image signal to the column scanning circuit of the logic chip.

[0089] Specifically, after the pixel array is exposed to obtain an image signal, the image signal is stored in the register corresponding to each pixel circuit. At this time, the image signal is stored in each of the Y×X registers, and each register in a column of registers is connected in parallel to the first end of the corresponding first transmission structure. After the pixel chip receives the row clock signal, the image signal of the first row register is transmitted to the column scanning circuit at time 1, and the image signal of the second row register is transmitted to the image signal of the first row, ... The image signal of the Yth row register is transmitted to the Y-1th row register, and the above steps are repeated at the next time until all image signals are transmitted to the logic chip through the first transmission structure.

[0090] Figure 7 FIG. 1 shows one of the register working period diagrams provided in some embodiments of the present application, such as Figure 7As shown, during the signal transmission period, the image signal generated by the pixel circuit of the first row will be shifted to the register in the next column of pixels one by one. After M shifts, it is finally transferred out of the pixel chip and reaches the column scanning circuit located on the logic chip. Similarly, for the image signal generated by the pixel circuit of the second row, it needs to be shifted M-1 times before it is finally transferred out of the pixel chip and reaches the column scanning circuit located on the logic chip. For the image signal generated by the pixel circuit in the Yth row, it only needs to be shifted once to transfer out of the pixel chip. It should be noted that after the image signal generated by each row of pixel circuits is transferred out of the pixel chip and reaches the column scanning circuit located on the logic chip, the column scanning circuit immediately performs a column scanning operation to scan and output the image signal generated by the pixel circuit of this row to the image signal processing circuit for subsequent processing. Only after this step is completed will the next round of pixel signal shifting be performed. Among them, the image signal can be a digital signal.

[0091] In the embodiment of the present application, by connecting Y registers in each column of registers in series on the first transmission structure, during the image signal transmission process, the image signal can flow in the series-connected registers, so that the first transmission structure can transmit the image signal in one row of registers each time, thereby improving the transmission efficiency of the image signal between the pixel chip and the logic chip.

[0092] In some embodiments of the present application, the signal transmission structure further includes X third transmission structures, and the X third transmission structures correspond one-to-one to X columns of pixel circuits in the pixel array; the logic chip further includes: a column clock control circuit connected to the X third transmission structures, and the column clock control circuit is connected to the X column registers in the pixel array through the X third transmission structures;

[0093] The X columns of pixel circuits in the pixel array transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures in the third time period, including:

[0094] The column clock control circuit transmits a column clock signal to the N registers to determine X third sub-periods within the third period;

[0095] The X column registers transmit the image signal to the column scanning circuit in X third sub-periods in sequence in response to the column clock signal, wherein each third sub-period corresponds to the transmission of the image signal in one column register.

[0096] In an embodiment of the present application, the signal transmission structure also includes X third transmission structures, and the logic chip also includes a column clock control circuit. The column clock control circuit can transmit a column clock signal to the logic chip through the third transmission structure, and perform timing and control on the logic chip through the column clock signal. The third transmission structure is used for the column clock control circuit to transmit the column clock signal to the pixel chip.

[0097] Specifically, the number of pixel circuits in the pixel array is N, and the arrangement of the N pixel circuits is Y×X, that is, the N pixel circuits include X columns of pixel circuits and Y rows of pixel circuits. The number of third transmission structures in the signal transmission structure is set to X, and each third transmission structure corresponds to a single column of pixel circuits, that is, each third transmission structure is used to transmit a column clock signal to a column of registers, for a column of registers.

[0098] In the embodiment of the present application, the third time period includes X third sub-time periods, and each third sub-time period is a signal transmission time period of a column of registers.

[0099] Figure 8 FIG. 2 shows a second schematic diagram of a register working period provided in some embodiments of the present application, such as Figure 8 As shown, in the case where a column clock control circuit is provided on the logic chip, the operation of each register and the transmission of the image signal are controlled by the column clock control circuit. When all pixel circuits on all rows have completed the reading and caching of the signal, all rows enter the signal transmission period synchronously. The signal transmission period is divided into multiple column signal transmission periods. The pixel array contains X columns, and the register is a shift register, then the signal transmission period is divided into X column signal transmission periods, and the X signal transmission periods include: C1, C2, C3...CX. In each column signal transmission period, a certain column of pixel circuits shifts and transmits the output registered image signal to the column scanning circuit on the logic chip under the drive of the column clock and control circuit module until the image signals registered in all registers on this column are transmitted out of the pixel array to the column scanning circuit on the logic chip.

[0100] In an embodiment of the present application, a column clock control circuit is provided in a logic chip, and a third transmission structure for transmitting the column clock signal of the column clock control circuit is provided in a signal transmission structure, and the number of the third transmission structures is set to be the same as the number of columns of the pixel array, so that the column clock signal output by the logic chip can be synchronously transmitted to each column register, thereby improving the signal transmission efficiency between the logic chip and the pixel chip.

[0101] In some embodiments of the present application, the pixel circuit includes a sub-pixel array, the register corresponding to the pixel circuit includes a sub-register, each sub-pixel in the sub-pixel array is correspondingly provided with a sub-register, the sub-pixel array includes Q columns of sub-pixels, and Q is a positive integer;

[0102] The X columns of pixel circuits in the pixel array transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures in the third time period, including:

[0103] The column clock control circuit transmits a third clock signal to the N registers to determine Z fourth sub-periods within the third period, where Z=X×Q;

[0104] The Q column sub-registers in the X column register respond to the third clock signal and sequentially transmit the image signal to the column scanning circuit in Z fourth sub-periods, wherein each fourth sub-period corresponds to the transmission of the image signal in a column sub-register.

[0105] In an embodiment of the present application, the pixel circuit is an all-in-one pixel circuit, and the all-in-one pixel circuit includes a sub-pixel array, and each sub-pixel array includes a plurality of sub-pixels. When the pixel circuit is an all-in-one pixel circuit, a sub-register is set corresponding to each sub-pixel. In the process of transmitting image signals by the all-in-one pixel circuit, it is necessary to combine the arrangement of the sub-pixel array in the all-in-one pixel circuit. According to the number of columns of the sub-pixel array, the number of fourth time periods within the third time period is determined, and each fourth time period is used to transmit the image signal in the sub-register corresponding to each sub-pixel in the sub-pixel array to the logic chip.

[0106] Specifically, there are X columns of pixel circuits in total, and each pixel circuit includes Q columns of sub-pixels, so the third time period of signal transmission needs to be divided into X×Q segments.

[0107] Fig. 9 Schematic diagrams showing the arrangement of sub-pixel arrays provided in some embodiments of the present application are shown, such as Fig. 9 As shown, the sub-pixel array includes 4 sub-pixels, which are SPAD1, SPAD2, SPAD3 and SPAD4, and the arrangement of the 4 sub-pixels is 2×2.

[0108] Fig.10 FIG. 3 shows a third schematic diagram of a register working period provided in some embodiments of the present application, such as Fig. 9 and Fig.10 As shown, for a sub-pixel array including 4 sub-pixels, the third period of signal transmission is divided into 2X column signal transmission periods including C11, C12, C21...CX1, CX2. In each column signal transmission period, a column of sub-pixels is driven by the column clock and control circuit module to shift and transmit the output registered image signal to the column scanning circuit module on the logic chip until the digital signals registered in all pixel circuit registers on this column are transmitted out of the pixel chip to the column scanning circuit module on the logic chip.

[0109] In an embodiment of the present application, when the pixel circuit is an all-in-one pixel circuit, the number of third sub-periods included in the third time period of signal transmission is set in combination with the number of columns of the sub-pixel array in the all-in-one pixel circuit, and the column clock control signal is transmitted through the column clock control circuit to control the pixel chip to transmit the image signal to the column scanning circuit in the logic chip, thereby further improving the signal transmission efficiency.

[0110] In some embodiments of the present application, the logic chip further includes: an image signal processing circuit, wherein a first end of the image signal processing circuit is connected to the column scanning circuit;

[0111] After the X columns of pixel circuits in the pixel array transmit the image signals to the column scanning circuit in the logic chip through the X first transmission structures in the third time period, the control method further includes:

[0112] The column scanning circuit transmits image signals of K subframes to the image signal processing circuit for processing, where the subframes include a first period, a second period and a third period, and K is a positive integer.

[0113] In an embodiment of the present application, the logic chip also includes an image signal processing circuit and a port circuit. The image signal processing circuit is arranged between the column scanning circuit and the port circuit. The image signal processing circuit can process the image signal transmitted from the pixel chip to the logic chip to improve the imaging effect of the output image.

[0114] Specifically, the column scanning circuit in the logic chip is connected to the register in the pixel chip through a signal transmission structure, and the column scanning circuit is also connected to the image signal processing circuit in the logic chip. After acquiring the image signal in the pixel chip, the column scanning circuit can transmit the image signal to the image signal processing circuit for processing. The processed image signal is transmitted to the outside of the logic chip through the port circuit.

[0115] like Figure 4 As shown, a frame time includes K subframes, each of which is independent of each other, and the length and number of subframes can be adjusted according to different applications. The beginning of a frame time is the beginning of the 1st subframe, and after the Kth subframe is completed, the signal processing period is entered, that is, the image signal is processed by the image signal processing circuit, and when the image signal processing is completed, it is determined that this frame is completed and the next frame time is entered. All subframes of each row of pixel circuits in each frame time are completely aligned in time sequence, so the pixel circuits on all rows have the same number of subframes and the time when the subframes are completed is all the same. The duration of the image signal processing period of each row of pixel circuits is consistent. The signal processing period is mainly the time for the image signal processing circuit, auxiliary circuit and port circuit located in the logic layer to perform the last image signal processing in the frame, reset the circuit, and prepare for the next frame. All pixel circuits in the pixel chip can be effectively operated and read within one frame time, and the operation mode similar to the global shutter can effectively eliminate the jello effect of moving objects produced by the rolling shutter (Rolling Shutter) of traditional image sensors.

[0116] In the control method provided in the embodiment of the present application, the execution subject may be a control device. In the embodiment of the present application, the control method provided in the embodiment of the present application is described by taking the control device executing the control method as an example.

[0117] In some embodiments of the present application, a control device is provided, which is applied to the image sensor in any of the above embodiments. Fig.11 Schematic block diagram of a control device provided in some embodiments of the present application is shown. Fig.11 As shown, the control device 1100 includes:

[0118] A transmission module 1102, used for a row clock control circuit in a logic chip to transmit a row clock signal to Y rows of pixel circuits through Y second transmission structures;

[0119] An exposure module 1104 is used for Y-row pixel circuits in the pixel array to synchronously expose in a first period in response to a row clock signal;

[0120] The storage module 1106 is used to store the image signal obtained by exposure in a corresponding register during the second period of time;

[0121] The transmission module 1102 is used for the X column registers to transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures during the third time period.

[0122] In the embodiment of the present application, by only setting the pixel array and the corresponding registers of each pixel circuit in the pixel chip, and setting the logic circuits such as the column scanning circuit and the row clock control circuit in the logic chip, it is not necessary to set up additional logic circuits in the pixel chip, and it is not necessary to set up pixel circuits on the logic chip, so that the stack size of the logic chip and the pixel chip is consistent, and the size of the overall architecture of the image sensor is reduced. In addition, each pixel circuit starts and ends exposure synchronously within each frame time, and through the operation mode similar to the global shutter, the image sensor will not have the jelly effect unique to the rolling shutter when shooting moving objects, thereby improving the shooting effect of the image sensor.

[0123] In some embodiments of the present application, the Y registers in each column of registers are respectively connected to the corresponding first transmission structure;

[0124] The transmission module 1102 is used for the Y row registers to transmit the image signal to the column scanning circuit in Y second sub-periods of the third period in sequence, wherein each second sub-period corresponds to the transmission of the image signal in a row of registers.

[0125] In an embodiment of the present application, by connecting Y registers in each column of registers in parallel on the first transmission structure, the first transmission structure can transmit image signals in one row of registers each time, thereby improving the transmission efficiency of image signals between the pixel chip and the logic chip.

[0126] In some embodiments of the present application, the Y registers in each column of registers are connected in series, and the Y registers are connected to the first transmission structure;

[0127] The transmission module 1102 is used to receive the image signal transmitted by the previous row of registers in each row of registers within M second sub-periods within the third time period, and transmit the image signal to the next row of registers until the image signals in the Y row of registers are all transmitted to the column scanning circuit, M is a positive integer, and M=Y-1.

[0128] In the embodiment of the present application, by connecting Y registers in each column of registers in series on the first transmission structure, during the image signal transmission process, the image signal can flow in the series-connected registers, so that the first transmission structure can transmit the image signal in one row of registers each time, thereby improving the transmission efficiency of the image signal between the pixel chip and the logic chip.

[0129] In some embodiments of the present application, the signal transmission structure further includes X third transmission structures, and the X third transmission structures correspond one-to-one to X columns of pixel circuits in the pixel array; the logic chip further includes: a column clock control circuit connected to the X third transmission structures, and the column clock control circuit is connected to the X column registers in the pixel array through the X third transmission structures;

[0130] The control device 1100 further includes:

[0131] A determination module, configured for the column clock control circuit to transmit a column clock signal to N registers, and determine X third sub-periods within a third period;

[0132] The transmission module 1102 is used for the X column registers to transmit the image signal to the column scanning circuit in X third sub-periods in response to the column clock signal, wherein each third sub-period corresponds to the transmission of the image signal in one column register.

[0133] In an embodiment of the present application, a column clock control circuit is provided in a logic chip, and a third transmission structure for transmitting the column clock signal of the column clock control circuit is provided in a signal transmission structure, and the number of the third transmission structures is set to be the same as the number of columns of the pixel array, so that the column clock signal output by the logic chip can be synchronously transmitted to each column register, thereby improving the signal transmission efficiency between the logic chip and the pixel chip.

[0134] In some embodiments of the present application, the pixel circuit includes a sub-pixel array, the register corresponding to the pixel circuit includes a sub-register, each sub-pixel in the sub-pixel array is correspondingly provided with a sub-register, the sub-pixel array includes Q columns of sub-pixels, and Q is a positive integer;

[0135] A determination module is used for the column clock control circuit to transmit a third clock signal to N registers, and determine Z fourth sub-periods within the third period, where Z=X×Q;

[0136] The transmission module 1102 is used for the Q column sub-register in the X column register to transmit the image signal to the column scanning circuit in Z fourth sub-periods in sequence in response to the third clock signal, wherein each fourth sub-period corresponds to the transmission of the image signal in a column sub-register.

[0137] In an embodiment of the present application, when the pixel circuit is an all-in-one pixel circuit, the number of third sub-periods included in the third time period of signal transmission is set in combination with the number of columns of the sub-pixel array in the all-in-one pixel circuit, and the column clock control signal is transmitted through the column clock control circuit to control the pixel chip to transmit the image signal to the column scanning circuit in the logic chip, thereby further improving the signal transmission efficiency.

[0138] In some embodiments of the present application, the logic chip further includes: an image signal processing circuit, wherein a first end of the image signal processing circuit is connected to the column scanning circuit;

[0139] The transmission module 1102 is used for the column scanning circuit to transmit the image signals of K subframes to the image signal processing circuit for processing, where the subframe includes a first period, a second period and a third period, and K is a positive integer.

[0140] In an embodiment of the present application, the logic chip also includes an image signal processing circuit and a port circuit. The image signal processing circuit is arranged between the column scanning circuit and the port circuit. The image signal processing circuit can process the image signal transmitted from the pixel chip to the logic chip to improve the imaging effect of the output image.

[0141] In an embodiment of the present application, an image signal processing circuit and a port circuit are provided in the logic chip, so that the logic chip can process the image signal transmitted by the pixel chip through the image signal processing circuit.

[0142] The control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0143] The control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0144] The control device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0145] Optionally, an embodiment of the present application further provides an electronic device, which includes a control device as in any of the above embodiments, and thus has all the beneficial effects of the control method in any of the embodiments, which will not be elaborated herein.

[0146] Optionally, an embodiment of the present application further provides an electronic device, Fig.12 A structural block diagram of an electronic device according to an embodiment of the present application is shown. Fig.12 As shown, the electronic device 1200 includes a processor 1202, a memory 1204, and a program or instruction stored in the memory 1204 and executable on the processor 1202. When the program or instruction is executed by the processor 1202, each process of the above-mentioned control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0147] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0148] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0149] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, a processor 1310 and other components.

[0150] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0151] Wherein, the processor 1310 is used for the row clock control circuit in the logic chip to transmit the row clock signal to the Y row pixel circuits through the Y second transmission structures;

[0152] Processor 1310, for causing Y-row pixel circuits in the pixel array to synchronously expose in a first period in response to a row clock signal;

[0153] The processor 1310 is used to store the image signal obtained by exposure in a corresponding register during the second period of time;

[0154] The processor 1310 is configured to transmit the image signal to the column scanning circuit in the logic chip through the X column registers in the third time period through the X first transmission structures.

[0155] In the embodiment of the present application, by only setting the pixel array and the corresponding registers of each pixel circuit in the pixel chip, and setting the logic circuits such as the column scanning circuit and the row clock control circuit in the logic chip, it is not necessary to set up additional logic circuits in the pixel chip, and it is not necessary to set up pixel circuits on the logic chip, so that the stack size of the logic chip and the pixel chip is consistent, and the size of the overall architecture of the image sensor is reduced. In addition, each pixel circuit starts and ends exposure synchronously within each frame time, and through the operation mode similar to the global shutter, the image sensor will not have the jelly effect unique to the rolling shutter when shooting moving objects, thereby improving the shooting effect of the image sensor.

[0156] Further, the Y registers in each column of registers are respectively connected to the corresponding first transmission structure;

[0157] The processor 1310 is configured to transmit the image signal from the Y row registers to the column scanning circuit in sequence in Y second sub-periods of the third period, wherein each second sub-period corresponds to the transmission of the image signal in a row register.

[0158] In an embodiment of the present application, by connecting Y registers in each column of registers in parallel on the first transmission structure, the first transmission structure can transmit image signals in one row of registers each time, thereby improving the transmission efficiency of image signals between the pixel chip and the logic chip.

[0159] Further, the Y registers in each column of registers are connected in series, and the Y registers are connected to the first transmission structure;

[0160] Processor 1310 is used to receive the image signal transmitted by the previous row of registers in each row of registers and transmit the image signal to the next row of registers in M ​​second sub-periods within the third time period, until the image signals in the Y row of registers are all transmitted to the column scanning circuit, M is a positive integer, and M=Y-1.

[0161] In the embodiment of the present application, by connecting Y registers in each column of registers in series on the first transmission structure, during the image signal transmission process, the image signal can flow in the series-connected registers, so that the first transmission structure can transmit the image signal in one row of registers each time, thereby improving the transmission efficiency of the image signal between the pixel chip and the logic chip.

[0162] Further, the signal transmission structure further includes X third transmission structures, and the X third transmission structures correspond one to one to X columns of pixel circuits in the pixel array; the logic chip further includes: a column clock control circuit connected to the X third transmission structures, and the column clock control circuit is connected to the X column registers in the pixel array through the X third transmission structures;

[0163] Processor 1310, configured for the column clock control circuit to transmit a column clock signal to N registers, and determine X third sub-periods within a third period;

[0164] The processor 1310 is configured to transmit the image signal to the column scanning circuit in X third sub-periods in sequence in response to the column clock signal by the X column registers, wherein each third sub-period corresponds to the transmission of the image signal in one column register.

[0165] In an embodiment of the present application, a column clock control circuit is provided in a logic chip, and a third transmission structure for transmitting the column clock signal of the column clock control circuit is provided in a signal transmission structure, and the number of the third transmission structures is set to be the same as the number of columns of the pixel array, so that the column clock signal output by the logic chip can be synchronously transmitted to each column register, thereby improving the signal transmission efficiency between the logic chip and the pixel chip.

[0166] Further, the pixel circuit includes a sub-pixel array, the register corresponding to the pixel circuit includes a sub-register, each sub-pixel in the sub-pixel array is provided with a corresponding sub-register, the sub-pixel array includes Q columns of sub-pixels, and Q is a positive integer;

[0167] Processor 1310, configured to transmit a third clock signal to N registers via a column clock control circuit, and determine Z fourth sub-periods within a third period, where Z=X×Q;

[0168] The processor 1310 is configured to transmit the image signal to the column scanning circuit in Z fourth sub-periods in sequence in response to the third clock signal in the Q column sub-register in the X column register, wherein each fourth sub-period corresponds to transmitting the image signal in one column sub-register.

[0169] In an embodiment of the present application, when the pixel circuit is an all-in-one pixel circuit, the number of third sub-periods included in the third time period of signal transmission is set in combination with the number of columns of the sub-pixel array in the all-in-one pixel circuit, and the column clock control signal is transmitted through the column clock control circuit to control the pixel chip to transmit the image signal to the column scanning circuit in the logic chip, thereby further improving the signal transmission efficiency.

[0170] Furthermore, the logic chip further includes: an image signal processing circuit, a first end of the image signal processing circuit being connected to the column scanning circuit;

[0171] The processor 1310 is used for the column scanning circuit to transmit the image signals of K subframes to the image signal processing circuit for processing, where the subframes include a first period, a second period and a third period, and K is a positive integer.

[0172] In an embodiment of the present application, the logic chip also includes an image signal processing circuit and a port circuit. The image signal processing circuit is arranged between the column scanning circuit and the port circuit. The image signal processing circuit can process the image signal transmitted from the pixel chip to the logic chip to improve the imaging effect of the output image.

[0173] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or action file obtained by the image capture device (such as a camera) in the action file capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0174] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0175] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0176] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0177] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0178] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0179] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0180] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0181] It should be noted that, in this article, the term "comprises", "includes" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, device, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or device. In the absence of further restrictions, an element defined by the statement "includes one..." does not exclude the presence of other identical elements in the process, device, article or device including the element. In addition, it should be noted that the scope of the devices and apparatuses in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described device may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0182] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment device can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), including a number of instructions for a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) to execute the device of each embodiment of the present application.

[0183] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image sensor, characterized in that: include: A pixel chip, wherein the pixel chip includes a pixel array, wherein the pixel array includes N pixel circuits and N registers, wherein the N registers correspond to the N pixel circuits one by one, the registers are connected to the corresponding pixel circuits, the pixel circuits include single photon avalanche transistors, and N is a positive integer; A signal transmission structure, wherein a first end of the signal transmission structure is connected to the pixel chip, and the first end of the signal transmission structure is located at a peripheral side of the pixel array, and the signal transmission structure includes X first transmission structures and Y second transmission structures, the X first transmission structures correspond one-to-one to the pixel circuits of X columns in the pixel array, and the Y second transmission structures correspond one-to-one to the pixel circuits of Y rows in the pixel array, and X and Y are both positive integers, and X×Y=N; a logic chip, arranged opposite to the pixel chip, the logic chip being connected to the second end of the signal transmission structure, the logic chip being provided with a column scanning circuit and a row clock control circuit, the column scanning circuit being connected to the registers of X columns through X of the first transmission structures, and the row clock control circuit being connected to the pixel circuits of Y rows through Y of the second transmission structures.

2. The image sensor according to claim 1, characterized in that The Y registers in each column of the registers are respectively connected to corresponding first transmission structures.

3. The image sensor according to claim 1, characterized in that The Y registers in each column of the registers are connected in series, and the Y registers are connected to the first transmission structure.

4. The image sensor according to any one of claims 1 to 3, characterized in that: The signal transmission structure further includes X third transmission structures, and the X third transmission structures correspond one-to-one to the pixel circuits in the X columns in the pixel array; The logic chip further includes: A column clock control circuit is connected to the X third transmission structures. The column clock control circuit is connected to the registers in X columns in the pixel array through the X third transmission structures.

5. The image sensor according to any one of claims 1 to 3, characterized in that: The logic chip further includes: An image signal processing circuit, wherein a first terminal of the image signal processing circuit is connected to the column scanning circuit; A port circuit is connected to the second end of the image signal processing circuit.

6. The image sensor according to any one of claims 1 to 3, characterized in that: The signal transmission structure includes at least one of the following: copper-copper bonding and through silicon via.

7. A control method, characterized in that: Applied to the image sensor according to any one of claims 1 to 6, the control method comprises: The row clock control circuit in the logic chip transmits the row clock signal to the Y row pixel circuits through the Y second transmission structures; The pixel circuits of the Y rows in the pixel array respond to the row clock signal, are synchronously exposed in a first period, and store image signals obtained by exposure in corresponding registers in a second period; The X columns of registers transmit the image signal to the column scanning circuit in the logic chip through the X first transmission structures within a third time period.

8. The control method according to claim 7, characterized in that: The Y registers in each column of the registers are respectively connected to corresponding first transmission structures; The pixel circuits of the X columns in the pixel array transmit the image signals to the column scanning circuit in the logic chip through the X first transmission structures in a third time period, including: The registers in the Y rows transmit the image signals to the column scanning circuit in turn in Y second sub-periods of the third period, wherein each second sub-period corresponds to the transmission of the image signals in one row of the registers.

9. The control method according to claim 7, characterized in that: The Y registers in each column of the registers are connected in series, and the Y registers are connected to the first transmission structure; The pixel circuits of the X columns in the pixel array transmit the image signals to the column scanning circuit in the logic chip through the X first transmission structures in a third time period, including: In the M second sub-periods within the third time period, each row of the registers receives the image signal transmitted by the registers in the previous row, and transmits the image signal to the registers in the next row, until the image signals in the registers in the Y rows are all transmitted to the column scanning circuit, M is a positive integer, and M=Y-1.

10. The control method according to claim 7, characterized in that: The signal transmission structure further includes X third transmission structures, and the X third transmission structures correspond one-to-one to the pixel circuits of X columns in the pixel array; the logic chip further includes: a column clock control circuit connected to the X third transmission structures, and the column clock control circuit is connected to the registers of X columns in the pixel array through the X third transmission structures; The pixel circuits of the X columns in the pixel array transmit the image signals to the column scanning circuit in the logic chip through the X first transmission structures in a third time period, including: The column clock control circuit transmits a column clock signal to the N registers to determine X third sub-periods within the third period; The X columns of registers respond to the column clock signal and sequentially transmit the image signal to the column scanning circuit in X third sub-periods, wherein each third sub-period corresponds to the transmission of the image signal in one column of the registers.

11. A control device, characterized in that: The image sensor according to any one of claims 1 to 6, wherein the control device comprises: A transmission module, used for a row clock control circuit in a logic chip to transmit a row clock signal to Y rows of pixel circuits through Y second transmission structures; An exposure module, used for the pixel circuits of the Y rows in the pixel array to be synchronously exposed in a first time period in response to the row clock signal; A storage module, used for storing the image signal obtained by exposure in a corresponding register during the second period; The transmission module is used for transmitting the image signal to the column scanning circuit in the logic chip through X first transmission structures in the X columns of registers within a third time period.

12. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 7 to 10 are implemented.

13. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 7 to 10 are implemented.

Images