Image sensor, image output method and use thereof

The image sensor with shared circuits for APS and EVS pixels in alternating modes addresses noise and size issues, enabling simultaneous output of both image types, reducing sensor size and power consumption.

JP7580731B2Active Publication Date: 2024-11-12SHENZHEN RUISHIZHIXIN TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2022574788
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-03-15
Filing Date
2022-07-11
Publication Date
2024-11-12
Estimated Expiration
2042-07-11

AI Technical Summary

Technical Problem

Existing image sensors combining active pixel sensors (APS) and event-based vision sensors (EVS) suffer from high noise, large size, and inability to simultaneously output both APS and EVS images due to photocurrent replication noise and shared photoelectric conversion devices.

Method used

An image sensor with a pixel array comprising APS and EVS pixels, sharing an input circuit and control circuit, alternates between EVS and APS modes to perform separate photoelectric conversions, allowing simultaneous output of both image types.

Benefits of technology

The solution reduces sensor size by sharing circuits and enables simultaneous output of APS and EVS images without affecting each other's readout processes, reducing noise and power consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580731000001
    Figure 0007580731000001
  • Figure 0007580731000002
    Figure 0007580731000002
  • Figure 0007580731000003
    Figure 0007580731000003
Patent Text Reader

Abstract

The present application provides an image sensor, its image output method and use. The image sensor includes an input circuit that performs a first photoelectric conversion on incident light to generate a photocurrent during a period when the image sensor operates in an EVS mode, and performs a second photoelectric conversion on incident light to generate a photocharge during a period when the image sensor operates in an APS mode, an EVS circuit that outputs a corresponding event signal based on a difference between a first voltage corresponding to the photocurrent and a reference voltage during the first photoelectric conversion, an APS circuit that outputs a corresponding grayscale signal based on a second voltage corresponding to the photocharge during the duration of the first photoelectric conversion, and a control circuit that outputs a corresponding APS image based on the grayscale signal and outputs a corresponding EVS image based on the event signal, and the period when the image sensor operates in one APS mode is between the periods when the image sensor operates in adjacent EVS modes. The present application not only reduces the size of the image sensor, but also realizes outputting one frame of an APS image and outputting multiple frames of EVS images at the same time.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present application relates to the technical field of photosensitive elements, in particular to image sensors, image output methods and uses thereof. [Background technology]

[0002] In the related art, the means of fusing an active pixel sensor (APS) and an event-based vision sensor (EVS) with each other is to form an APS by duplicating the photocurrent generated from the photodiode of the EVS, thereby realizing the mutual fusion of the EVS and the APS. However, such a means is prone to introducing a large amount of noise during the duplication of the photocurrent, which has a serious adverse effect on the imaging quality of the APS, and it is also impossible to realize that one pixel can simultaneously output an APS image and an EVS image during the image output. In addition, both the APS and the EVS require a photoelectric conversion device to detect light, and the photoelectric conversion device occupies a large part of the space of the image sensor, which significantly increases the size of the image sensor. As can be seen from the above, the image sensor using the above fusion means has many disadvantages, such as high power consumption, high noise, and large size.

[0003] For this reason, there is a need to improve the structure of conventional image sensors. Summary of the Invention [Problem to be solved by the invention]

[0004] The present application provides an image sensor, an image output method and use thereof, in order to solve the problems in the related art that an image sensor in which APS and EVS are combined is large in size and one pixel cannot output an APS image and an EVS image simultaneously. [Means for solving the problem]

[0005] In order to solve the above technical problems, the first aspect of the present invention is: 1. An image sensor including a pixel array of a plurality of pixels, The pixel array is configured as two pixel types: APS pixels and EVS pixels; the image sensor includes an input circuit, an APS circuit, an EVS circuit, and a control circuit, the input circuit is connected to the APS circuit and the EVS circuit, the control circuit is connected to the APS circuit and the EVS circuit, the APS pixel includes the input circuit, the APS circuit, and the control circuit, the EVS pixel includes the input circuit, the EVS circuit, and the control circuit, an operation time unit of the input circuit includes a period operating in an EVS mode and a period operating in an APS mode, and one period operating in the APS mode is between adjacent periods operating in the EVS mode, the input circuit performs a first photoelectric conversion on incident light to generate a corresponding photocurrent during a period when the input circuit operates in the EVS mode, and performs a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period when the input circuit operates in the APS mode; The EVS circuit outputs a corresponding event signal based on a difference between a first voltage corresponding to the photocurrent and a reference voltage during the first photoelectric conversion; The APS circuit outputs a corresponding grayscale signal based on a second voltage corresponding to the photocharge during the first photoelectric conversion; The control circuit provides an image sensor that outputs a corresponding EVS image based on the event signal, and outputs a corresponding APS image based on the grayscale signal.

[0006] A second aspect of the present embodiment is 1. An image output method applied to an image sensor including a pixel array of a plurality of pixels, comprising: The pixel array is configured as two pixel types: APS pixels and EVS pixels; the image sensor includes an input circuit, an APS circuit, an EVS circuit, and a control circuit, the input circuit is connected to the APS circuit and the EVS circuit, and the control circuit is connected to the APS circuit and the EVS circuit; the APS pixel includes the input circuit, the APS circuit, and the control circuit, the EVS pixel includes the input circuit, the EVS circuit, and the control circuit, an operation time unit of the input circuit includes a period operating in an EVS mode and a period operating in an APS mode, and one period operating in the APS mode is between adjacent periods operating in the EVS mode, The image output method includes: performing a first photoelectric conversion on incident light to generate a corresponding photocurrent during a period when the input circuit operates in the EVS mode, and performing a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period when the input circuit operates in the APS mode; the EVS circuit outputs a corresponding event signal based on a difference between a first voltage corresponding to the photocurrent and a reference voltage during the first photoelectric conversion; the APS circuit outputs a corresponding grayscale signal based on a second voltage corresponding to the photocharge during the first photoelectric conversion; the control circuit outputs a corresponding EVS image based on the event signal, and outputs a corresponding APS image based on the gradation signal.

[0007] A third aspect of the present embodiment provides a use of the image sensor according to the first aspect of the present embodiment in a photoelectric device. Effect of the Invention

[0008] As can be seen from the above description, compared with the related art, the beneficial effects of the present application are as follows:

[0009] The image sensor includes a pixel array consisting of a plurality of pixels, and the pixel array is configured as two types of pixels, APS pixels and EVS pixels. Specifically, the image sensor includes four types of circuits, an input circuit, an APS circuit, an EVS circuit, and a control circuit, and among these, the operation time unit of the input circuit includes a period in which it operates in the EVS mode and a period in which it operates in the APS mode, and one period in which it operates in the APS mode is between adjacent periods in which it operates in the EVS mode. In the present application, the input circuit is used, during the period operating in EVS mode, to perform a first photoelectric conversion on the incident light (i.e., EVS exposure) to generate a corresponding photocurrent for use by the EVS circuit to obtain a corresponding event signal, and during the period operating in APS mode, to perform a second photoelectric conversion on the incident light (i.e., APS exposure) to generate a corresponding photocharge for use by the APS circuit to obtain a corresponding grayscale signal, and the control circuit is used to output a corresponding APS image based on the grayscale signal, and to output a corresponding EVS image based on the event signal, whereby it can be seen that the APS pixels and the EVS pixels share the same input circuit and the same control circuit, i.e., there is no need to provide an input circuit and a control circuit for each of the APS pixels and the EVS pixels, thereby significantly reducing the size of the image sensor. Importantly, a period in which one APS mode is operated is between adjacent periods in which EVS mode is operated, which means that a portion of the period during which APS exposure is performed (i.e., the period in which APS mode is operated) is separated from the EVS exposure process; and the APS circuit outputs a corresponding grayscale signal based on the second voltage corresponding to the photocharge during the duration of the first photoelectric conversion (i.e., during the next first photoelectric conversion after the second photoelectric conversion is completed, in other words, within the period during which the next EVS mode is operated adjacent to the period in which APS mode is operated), so that the readout of the APS does not affect the exposure and readout of the EVS. This makes it possible to output one frame of APS image and output multiple frames of EVS images; and when one pixel includes both an APS pixel and an EVS pixel, this one pixel can output an APS image and an EVS image simultaneously, which ensures the mutual fusion between APS and EVS. [Brief description of the drawings]

[0010] In order to more clearly describe the technical solutions of the related art or embodiments of the present application, the following briefly describes the drawings to be used in the description of the related art or embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, not all embodiments, and those skilled in the art can also obtain other drawings based on these drawings without creative efforts.

[0011] [Figure 1] FIG. 2 is a first module block diagram of a pixel according to an embodiment of the present application. [Diagram 2] FIG. 2 is a schematic diagram of an operating time unit of an input circuit according to an embodiment of the present application. [Diagram 3] FIG. 2 is a second module block diagram of a pixel according to an embodiment of the present application. [Figure 4] FIG. 2 is a first circuit structure schematic diagram of a pixel according to an embodiment of the present application; [Diagram 5] FIG. 2 is a structural schematic diagram of a pixel array according to an embodiment of the present application; [Figure 6] FIG. 5 is a schematic diagram of a first on / off state of each transistor of a pixel when the pixel structure according to an embodiment of the present application is shown in FIG. 4; [Figure 7] FIG. 7 is a schematic diagram of an output image when the on / off states of each transistor of a pixel according to an embodiment of the present application are as shown in FIG. 6; [Figure 8] FIG. 5 is a schematic diagram of a second on / off state of each transistor of the pixel when the pixel structure according to an embodiment of the present application is shown in FIG. 4; [Figure 9] FIG. 9 is a schematic diagram of an output image when the on / off states of each transistor of a pixel according to an embodiment of the present application are as shown in FIG. 8 . [Figure 10] FIG. 2 is a schematic diagram of a second circuit structure of a pixel according to an embodiment of the present application; [Figure 11] 11 is a schematic diagram of a first on / off state of each transistor of a pixel when the pixel structure according to an embodiment of the present application is shown in FIG. 10 . [Figure 12]FIG. 11 is a schematic diagram of a second on / off state of each transistor of the pixel when the pixel structure according to an embodiment of the present application is shown in FIG. 10 . [Figure 13] FIG. 4 is a schematic diagram of a third circuit structure of a pixel according to an embodiment of the present application; [Figure 14] FIG. 14 is a schematic diagram showing the on / off state of each transistor of a pixel when the pixel structure according to an embodiment of the present application is shown in FIG. 13 . [Figure 15] 2 is a schematic diagram of the flow of an image output method according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] In order to make the objectives, technical solutions and advantages of the present application clearer and easier to understand, the present application will be described clearly and completely below with reference to the embodiments and corresponding drawings, and the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout the text. It should be noted that the embodiments of the present application described below are only used to interpret the present application and are not intended to limit the present application, that is, all other embodiments that a person skilled in the art can obtain without making creative efforts based on the embodiments of the present application are within the scope of the present application. Furthermore, the technical features of the embodiments of the present application described below may be combined, unless they are mutually inconsistent.

[0013] An image sensor is an element that converts incident light on its photosensitive surface into a corresponding electric signal, and generally includes a complementary metal oxide semiconductor (CMOS) image sensor and a dynamic vision sensor (DVS), among which a CMOS image sensor is an active pixel sensor (APS) and a DVS is an event-based vision sensor (EVS). In recent years, APS has been rapidly developed and is increasingly used in fields such as automotive electronics, smart manufacturing, industrial monitoring, and military reconnaissance, but under high resolution and / or high frame rate conditions, huge data is generated, which leads to increased chip power consumption, which means higher requirements for chip transmission bandwidth, data calculation capacity, etc. On the other hand, EVS only detects events where the intensity of incident light changes and outputs an EVS image (i.e., an event image) based on the detected event, so the amount of data in EVS is small, and as a result, the resolution of EVS is also low. In light of this, the technology of integrating APS and EVS with each other has become a focus of the industry.

[0014] In the related art, the means for merging the APS and the EVS with each other is to duplicate the photocurrent generated from the photodiode of the EVS to form the APS, thereby realizing the mutual fusion of the EVS and the APS. However, such a means is prone to introducing a large amount of noise during the duplication of the photocurrent, which has a serious adverse effect on the imaging quality of the APS, and it is also impossible to realize that one pixel can simultaneously output the APS image and the EVS image during the image output. In addition, both the APS and the EVS require a photoelectric conversion device for detecting light, and the photoelectric conversion device occupies most of the space of the image sensor, so that the size of the image sensor is greatly increased. From the above, it can be seen that the image sensor using the above fusion means has many disadvantages such as high power consumption, high noise, and large size. For this reason, the embodiment of the present application provides an image sensor that can be applied to devices that should convert incident light into a corresponding electric signal, such as photoelectric devices such as digital cameras, video cameras, recorders, facsimile machines, image scanners, and digital televisions.

[0015] Referring to Fig. 1, Fig. 1 is a first module block diagram of a pixel according to an embodiment of the present application. The image sensor according to the embodiment of the present application includes a pixel array consisting of a plurality of pixels, the pixel array being configured as two types of pixels, APS pixels and EVS pixels, and the image sensor includes four types of circuits, namely, an input circuit 100, an APS circuit 200, an EVS circuit 300, and a control circuit 400, among which the input circuit 100 is connected to the APS circuit 200 and the EVS circuit 300, and the control circuit 400 is connected to the APS circuit 200 and the EVS circuit 300. Here, it should be explained that the APS pixel includes an input circuit 100, an APS circuit 200, and a control circuit 400, and the EVS pixel includes an input circuit 100, an EVS circuit 300, and a control circuit 400, so that the APS pixel and the EVS pixel share the same input circuit 100 and the same control circuit 400, that is, it is not necessary to provide the input circuit 100 and the control circuit 400 for each of the APS pixel and the EVS pixel. It can be understood that the APS pixel is used to output an APS image, and the EVS pixel is used to output an EVS image, so that if a pixel includes both an APS pixel and an EVS pixel, the pixel can output both an APS image and an EVS image, if a pixel includes only an APS pixel, the pixel can only output an APS image, and if a pixel includes only an EVS pixel, the pixel can only output an EVS image. In the following, the image sensor according to the embodiment of the present application will be described in more detail, taking as an example a case in which one pixel includes both an APS pixel and an EVS pixel in the embodiment of the present application.

[0016] In the embodiment of the present application, the operation time unit of the input circuit 100 includes a period of operation in EVS mode and a period of operation in APS mode, and one period of operation in APS mode is between adjacent periods of operation in EVS mode, and in this specification, the above-mentioned operation time unit may be an operation time for normally outputting one frame of APS image. As an example, further refer to FIG. 2, which is a schematic diagram of the operation time unit of the input circuit according to the embodiment of the present application, where A1, A2, A3 and A4 are all periods of operation in EVS mode, and B1, B2 and B3 are all periods of operation in APS mode.

[0017] Specifically, the input circuit 100 includes a photoelectric conversion element configured to perform photoelectric conversion of incident light, i.e., perform a first photoelectric conversion on the incident light to generate a corresponding photocurrent during a period operating in the EVS mode, and perform a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period operating in the APS mode, the first photoelectric conversion being the EVS exposure, and the second photoelectric conversion being the APS exposure. From the above, it can be seen that a part of the period for performing the APS exposure (i.e., the period operating in the APS mode) is separated from the EVS exposure process, i.e., the EVS exposure and the APS exposure are performed alternately. For example, taking A1, B1, and A2 in FIG. 2 as an example, a part of the period for performing the APS exposure (i.e., B1) is separated from the EVS exposure process (i.e., the continuous period between A1 and A2). Furthermore, the arrangement of the input circuits 100 may be such that one input circuit 100 is provided for each pixel of the pixel array, or only one input circuit 100 is provided so that all pixels of the pixel array share the same input circuit 100, or multiple input circuits 100 are provided so that all pixels in the same array unit of the pixel array share the same input circuit 100, where the pixel array is divided into multiple array units, each array unit including a predetermined number of pixels. As an example, the pixels of each column of the pixel array are one array unit, or the pixels of each row of the pixel array are one array unit.

[0018] Specifically, the EVS circuit 300 is used to output a corresponding event signal according to the difference between the first voltage corresponding to the photocurrent and the reference voltage during the first photoelectric conversion, and the event signal is used to generate a corresponding EVS image. In practical application, when the pixel is outputting an EVS image, the input circuit 100 performs a first photoelectric conversion on the incident light and outputs a corresponding photocurrent to the EVS circuit 300, and then the EVS circuit 300 outputs a corresponding event signal according to the difference between the first voltage corresponding to the received photocurrent and the reference voltage, so as to later generate a corresponding EVS image using the output event signal. Here, it should be explained that the difference between the first voltage and the reference voltage is to represent the intensity change (i.e., increase, decrease or no change) of the incident light, which means that the EVS circuit 300 actually outputs a corresponding event signal according to the intensity change of the incident light, for example, the intensity change of the incident light is determined according to whether the difference between the first voltage and the reference voltage is greater than 0, less than 0, or equal to 0.

[0019] Specifically, the APS circuit 200 is used to output a corresponding grayscale signal based on the second voltage corresponding to the photocharges during the first photoelectric conversion (i.e., during the next first photoelectric conversion after the second photoelectric conversion is completed, in other words, during the next EVS mode operation period adjacent to the APS mode operation period), where the grayscale signal is used to generate a corresponding APS image. For example, taking A1, B1, and A2 in FIG. 2 as an example, the input circuit 100 performs a second photoelectric conversion on the incident light in B1 to generate corresponding photocharges, and the APS circuit 200 outputs a corresponding grayscale signal based on the second voltage corresponding to the generated photocharges in A2. It can be understood that the grayscale signal output process by the APS circuit 200 is actually an APS readout process, and the grayscale signal output process by the APS circuit 200 is performed within the next EVS mode operation period (e.g., A2) adjacent to the APS mode operation period (e.g., B1), while the EVS operation can be continued within A2, that is, the APS readout process does not affect the EVS exposure and readout, so that when one pixel includes both an APS pixel and an EVS pixel, this one pixel can output an APS image and an EVS image simultaneously.

[0020] Specifically, the control circuit 400 is used to output a corresponding APS image according to the grayscale signal, and output a corresponding EVS image according to the event signal. In practical application, when the pixel is outputting an APS image, the APS circuit 200 outputs a corresponding grayscale signal to the control circuit 400 according to the second voltage corresponding to the received photoelectric charge, and then the control circuit 400 outputs a corresponding APS image according to the received grayscale signal to display to the user. Similarly, when the pixel is outputting an EVS image, the EVS circuit 300 outputs a corresponding event signal to the control circuit 400 according to the difference between the first voltage corresponding to the received photocurrent and the reference voltage, and then the control circuit 400 outputs a corresponding EVS image according to the received event signal to display to the user. It should further be explained that the arrangement of the control circuit 400 may be such that one control circuit 400 is provided for each pixel of the pixel array, or that only one control circuit 400 is provided such that all pixels of the pixel array share the same control circuit 400, or that multiple control circuits 400 are provided such that all pixels within the same array unit of the pixel array share the same control circuit 400.

[0021] As described above, when one pixel includes both an APS pixel and an EVS pixel, this one pixel includes at least an APS circuit 200 and an EVS circuit 300, and the input circuit 100 and the control circuit 400 may be shared by this one pixel with other pixels or may be provided separately.

[0022] Also, as described above, the process in which the input circuit 100 performs the second photoelectric conversion on the incident light to generate corresponding photocharges is actually an exposure process when outputting an APS image. Usually, the exposure method of the APS is divided into a global shutter and a rolling shutter. Among these, the global shutter means that all pixels of the pixel array are exposed to light at the same time at a certain time and end the exposure at the same time at another time, and after the exposure ends, all the generated photocharges move from the photosensitive region (i.e., the input circuit 100) to the charge detection amplifier (i.e., the floating diffusion node FD1 below), and then the APS readout circuit 220 reads out all the pixel data (i.e., grayscale signals) of the pixel array one row at a time, and in this process, the time length from reading out the pixel data for the pixels in the first row of the pixel array to reading out the pixel data for the pixels in the last row of the pixel array is the readout time length. In the rolling shutter, the exposure time length of the pixels in each row of the pixel array is the same, but the exposure start and end times of the pixels in different rows of the pixel array are different, that is, the exposure times of the pixels in different rows of the pixel array do not completely overlap, in other words, the exposure start time of the pixels in each row of the pixel array is later than the exposure start time of the pixels in the previous row, and only after the exposure of the pixels in each row of the pixel array is completed can the photocharges generated in this row be transferred from the photosensitive region to the charge detection amplifier, and the APS readout circuit 220 reads the next pixel data only after reading out the pixel data of one row, so the readout time length is the time length from when the APS readout circuit 220 outputs the pixel data of the pixels in the first row of the pixel array to when the APS readout circuit 220 outputs the pixel data of the pixels in the last row of the pixel array.

[0023] The image sensor according to the embodiment of the present application includes a pixel array consisting of a plurality of pixels, and the pixel array is configured as two types of pixels, APS pixels and EVS pixels. Specifically, the image sensor includes four types of circuits, an input circuit 100, an APS circuit 200, an EVS circuit 300, and a control circuit 400, and the operation time unit of the input circuit 100 includes a period operating in the EVS mode and a period operating in the APS mode, and one period operating in the APS mode is between adjacent periods operating in the EVS mode. In the embodiment of the present application, the input circuit 100 is used to perform a first photoelectric conversion (i.e., EVS exposure) on the incident light during the period of operation in the EVS mode, generate a corresponding photocurrent for use by the EVS circuit 300 to obtain a corresponding event signal, and perform a second photoelectric conversion (i.e., APS exposure) on the incident light during the period of operation in the APS mode, generate a corresponding photocharge for use by the APS circuit 200 to obtain a corresponding grayscale signal, and the control circuit 400 is used to output a corresponding APS image based on the grayscale signal, and output a corresponding EVS image based on the event signal. This shows that the APS pixel and the EVS pixel share the same individual input circuit 100 and the same control circuit 400, i.e., there is no need to provide the input circuit 100 and the control circuit 400 for each of the APS pixel and the EVS pixel, which can greatly reduce the size of the image sensor.Importantly, the period of operation in one APS mode is between the periods of operation in the adjacent EVS mode, which means that a portion of the period during which the APS exposure is performed (i.e., the period of operation in the APS mode) is separated from the EVS exposure process, and the APS circuit 200 outputs a corresponding grayscale signal based on the second voltage corresponding to the photocharge during the duration of the first photoelectric conversion (i.e., during the next first photoelectric conversion after the second photoelectric conversion is completed, in other words, within the period of operation in the next EVS mode adjacent to the period of operation in the APS mode), so that the readout of the APS does not affect the exposure and readout of the EVS, thereby realizing the output of one frame of an APS image as well as the output of multi-frame EVS images, and when one pixel includes an APS pixel and an EVS pixel, this one pixel can output an APS image and an EVS image simultaneously, and the mutual fusion between the APS and the EVS is reliably realized.

[0024] In some embodiments, further refer to FIG. 3, which is a second module block diagram of a pixel according to an embodiment of the present application. The EVS circuit 300 may include an EVS transmission circuit 310 and an EVS readout circuit 320, the EVS transmission circuit 310 is connected to the input circuit 100 and the EVS readout circuit 320, and the control circuit 400 is connected to the EVS transmission circuit 310 and the EVS readout circuit 320. Specifically, the EVS transmission circuit 310 is used to output a corresponding first voltage according to the photocurrent during the first photoelectric conversion, and the EVS readout circuit 320 is used to output a corresponding event signal according to the difference between the first voltage and a reference voltage. It can be understood that in this embodiment, the EVS circuit 300 first outputs a corresponding first voltage according to the received photocurrent through the EVS transmission circuit 310, and then outputs a corresponding event signal according to the difference between the received first voltage and a reference voltage through the EVS readout circuit 320, and later uses the output event signal to generate a corresponding EVS image. It should further be explained that the arrangement of the EVS readout circuit 320 may be such that one EVS readout circuit 320 is provided for each pixel of the pixel array, or that only one EVS readout circuit 320 is provided so that all pixels of the pixel array share the same EVS readout circuit 320, or that multiple EVS readout circuits 320 are provided so that all pixels within the same array unit of the pixel array share the same EVS readout circuit 320.

[0025] The APS circuit 200 may include an APS transmission circuit 210 and an APS readout circuit 220, the APS transmission circuit 210 is connected to the input circuit 100 and the APS readout circuit 220, and the control circuit 400 is connected to the APS transmission circuit 210 and the APS readout circuit 220. Specifically, during the duration of the first photoelectric conversion, the APS transmission circuit 210 is used for outputting a corresponding second voltage according to the photocharges, and the APS readout circuit 220 is used for outputting a corresponding grayscale signal according to the second voltage. It can be understood that in this embodiment, the APS circuit 200 first outputs a corresponding second voltage according to the received photocharges through the APS transmission circuit 210, and then outputs a corresponding grayscale signal according to the received second voltage through the APS readout circuit 220, and later uses the output grayscale signal to generate a corresponding APS image. It should further be explained that the arrangement of the APS readout circuit 220 may be such that one APS readout circuit 220 is provided for each pixel of the pixel array, or such that only one APS readout circuit 220 is provided so that all of the pixels of the pixel array share the same APS readout circuit 220, or such that multiple APS readout circuits 220 are provided so that all of the pixels within the same array unit of the pixel array share the same APS readout circuit 220.

[0026] From the above, in this embodiment, when one pixel includes both an APS pixel and an EVS pixel, this one pixel includes at least an APS transmission circuit 210 and an EVS transmission circuit 310, and the APS readout circuit 220 and the EVS readout circuit 320 may be shared with other pixels by this one pixel or may be provided separately.

[0027] For an embodiment, further refer to FIG. 4, which is a first circuit structure schematic diagram of a pixel according to an embodiment of the present application. The APS transmission circuit 210 may include a first transmission branch, a floating diffusion node FD1, and an output branch, where the first transmission branch is connected to the input circuit 100, the control circuit 400, and the floating diffusion node FD1, and the output branch is connected to the floating diffusion node FD1, the control circuit 400, and the APS readout circuit 220. In this embodiment, the first transmission branch is used to trigger an operating state by a control signal TX1 sent by the control circuit 400 during the first photoelectric conversion, and when the first transmission branch is in the operating state, it is used to transmit the photocharges generated by the input circuit 100 to the floating diffusion node FD1. The floating diffusion node FD1 is used to accumulate the photocharges and generate a corresponding second voltage. The output branch is used to trigger an operating state by a control signal SEL sent by the control circuit 400, and when the output branch is in an operating state, the output branch is used to transmit the second voltage at the floating diffusion node FD1 to the APS readout circuit 220, so that the APS readout circuit 220 subsequently outputs a corresponding grayscale signal based on the second voltage received.

[0028] Specifically, the output branch may include a first driving branch and a selection branch, the selection branch is connected to the first driving branch, the control circuit 400 and the APS readout circuit 220, and the first driving branch is further connected to the floating diffusion node FD1. In this embodiment, the first driving branch is used to buffer the potential of the floating diffusion node FD1 and output a second voltage to the selection branch. The selection branch is used to trigger an operating state by a control signal SEL sent by the control circuit 400, and the selection branch is used to transmit the second voltage at the floating diffusion node FD1 to the APS readout circuit 220 when in the operating state, so that the APS readout circuit 220 will later output a corresponding grayscale signal according to the second voltage received.

[0029] In addition, the APS transmission circuit 210 may further include a first decoupling branch, which is connected to the floating diffusion node FD1 and the control circuit 400. In this embodiment, the first decoupling branch is used to trigger an operating state by a control signal RST1 sent by the control circuit 400 after the selection branch finishes transmitting the second voltage to the APS readout circuit 220, and when the first decoupling branch is in an operating state, the photocharges accumulated in the floating diffusion node FD1 are transferred to the outside.

[0030] Specifically, the first reset branch may include a first reset transistor T2, the source of which is connected to the floating diffusion node FD1, the gate of which is connected to the control circuit 400, and the drain of which is connected to the power supply VDD. In this embodiment, the first reset transistor T2 is triggered to be turned on by the control signal RST1 sent by the control circuit 400 after the selection branch finishes transmitting the second voltage to the APS readout circuit 220, and when the first reset transistor T2 is in the on state, the photocharges accumulated in the floating diffusion node FD1 are transferred to the power supply VDD.

[0031] In this embodiment, still referring to FIG. 4, the EVS transmission circuit 310 may include a second reset branch and a second driving branch, the second reset branch and the second driving branch are respectively connected to the input circuit 100, the second reset branch is further connected to the control circuit 400, and the second driving branch is further connected to the EVS readout circuit 320. In this embodiment, the second reset branch is used to trigger an operating state by the control signal RST2 sent by the control circuit 400 during the first photoelectric conversion, and the second reset branch is used to output a corresponding first voltage according to the photocurrent generated by the input circuit 100 when in the operating state. The second driving branch is used to transmit the first voltage generated by the second reset branch to the EVS readout circuit 320, so that the EVS readout circuit 320 outputs a corresponding event signal according to the difference between the first voltage received by the EVS readout circuit 320 and a reference voltage later.

[0032] Specifically, the second de-reset branch may further include a second de-reset transistor T5, the drain and gate of the second de-reset transistor T5 are respectively connected to the power supply VDD, the source of the second de-reset transistor T5 and the second driving branch are respectively connected to the input circuit 100, and the gate of the second de-reset transistor T5 is further connected to the control circuit 400. In this embodiment, the second de-reset transistor T5 is triggered to be in an ON state by the control signal RST2 sent by the control circuit 400 during the first photoelectric conversion, and when the second de-reset transistor T5 is in an ON state, it is used to output a corresponding first voltage according to the photocurrent generated by the input circuit 100, where the photocurrent is equal to the current between the drain and source of the second de-reset transistor T5, the first voltage is equal to the voltage between the drain and source of the second de-reset transistor T5, and the photocurrent and the first voltage have a logarithmic relationship.

[0033] 4, in one specific embodiment of this embodiment, in the APS transmission circuit 210, except for the first reset branch consisting of the first reset transistor T2, the remaining branches may be composed of corresponding transistors, for example, the first transmission branch includes the first transmission transistor T1, the first drive branch includes the first drive transistor T3, and the selection branch includes the selection transistor T4. Correspondingly, in the EVS transmission circuit 310, except for the second reset branch consisting of the second reset transistor T5, the remaining branches may be composed of corresponding transistors, for example, the second drive branch includes the second drive transistor T6.

[0034] In this specific embodiment, the APS transmission circuit 210 may include a first transmission transistor T1, a first reset transistor T2, a first driving transistor T3, a selection transistor T4, and a floating diffusion node FD1, where a first end of the first transmission transistor T1 is connected to the input circuit 100, a second end of the first transmission transistor T1, a source of the first reset transistor T2, and a gate of the first driving transistor T3 are respectively connected to the floating diffusion node FD1, a drain of the first reset transistor T2, and a drain of the first driving transistor T3 are respectively connected to a power supply VDD, a source of the first driving transistor T3 is connected to a drain of the selection transistor T4, and a source of the selection transistor T4 is connected to the APS readout circuit 220, and a third end of the first transmission transistor T1, a gate of the first reset transistor T2, and a gate of the selection transistor T4 are respectively connected to the control circuit 400.

[0035] Specifically, the first reset transistor T2 is used to trigger its OFF state by the control signal RST1 sent by the control circuit 400 during the first photoelectric conversion until the first transmission transistor T1 is turned ON. As an example, the first reset transistor T2 may trigger its ON state or OFF state according to the level state of the control signal RST1, for example, when the control signal RST1 is at a high level, the first reset transistor T2 triggers its ON state, and when the control signal RST1 is at a low level, the first reset transistor T2 triggers its OFF state, and the same applies to other transistors described below.

[0036] Specifically, the first transmission transistor T1 is used to trigger an on state by a control signal TX1 sent by the control circuit 400 after the first reset transistor T2 is turned off during the first photoelectric conversion, where the first transmission transistor T1 is used to transmit the photocharges generated by the input circuit 100 to the floating diffusion node FD1 when in the on state. Furthermore, the first transmission transistor T1 is used to trigger an off state by a control signal TX1 sent by the control circuit 400 after transmitting the photocharges generated by the input circuit 100 to the floating diffusion node FD1 during the first photoelectric conversion, where the first transmission transistor T1 is in the off state and cannot transmit the photocharges generated by the input circuit 100 to the floating diffusion node FD1.

[0037] Specifically, the floating diffusion node FD1 accumulates the photocharges transferred by the first transfer transistor T1 during the first photoelectric conversion to form a corresponding second voltage. It should be noted here that in this specific embodiment, the floating diffusion node FD1 corresponds to a charge detection amplifier.

[0038] Specifically, the first driving transistor T3 is used to transmit the second voltage by the floating diffusion node FD1 to the selection transistor T4 during the first photoelectric conversion. It should be noted here that in this specific embodiment, the first driving transistor T3 corresponds to a source follower amplifier, which can buffer the potential at the floating diffusion node FD1 to output a voltage corresponding to the second voltage to the selection transistor T4.

[0039] Specifically, the selection transistor T4 is used to trigger an ON state by a control signal SEL sent by the control circuit 400 during the first photoelectric conversion, and when the selection transistor T4 is in an ON state, it may transmit the received second voltage to the APS readout circuit 220, so that the APS readout circuit 220 will later output a corresponding grayscale signal based on the received second voltage. Furthermore, the selection transistor T4 is used to trigger an OFF state by a control signal SEL sent by the control circuit 400 after finishing transmitting the received second voltage to the APS readout circuit 220 during the first photoelectric conversion, and when the selection transistor T4 is in an OFF state, it cannot transmit the received second voltage to the APS readout circuit 220.

[0040] Specifically, the first reset transistor T2 is further used to trigger an on-state by the control signal RST1 sent by the control circuit 400 after the selection transistor T4 finishes transmitting the second voltage received by the APS read circuit 220. When the first reset transistor T2 is in an on-state, the floating diffusion node FD1 is short-circuited with the power supply VDD, that is, the photocharges accumulated in the floating diffusion node FD1 are transferred to the power supply VDD, and the floating diffusion node FD1 is reset. Correspondingly, when the first reset transistor T2 is in an off-state, the photocharges accumulated in the floating diffusion node FD1 are not transferred to the power supply VDD, that is, the floating diffusion node FD1 is not reset. It can be understood that, when reading out the APS, photocharges must be accumulated in the floating diffusion node FD1, i.e., the floating diffusion node FD1 must not be reset, so that during the duration of the first photoelectric conversion, before the first transmission transistor T1 is turned on, the first reset transistor T2 must be triggered to be turned off by the control signal RST1 sent by the control circuit 400.

[0041] In this specific embodiment, still referring to FIG. 4, the EVS transmission circuit 310 may include a second reset transistor T5 and a second drive transistor T6, the source of the second reset transistor T5 and the gate of the second drive transistor T6 are respectively connected to the input circuit 100, the drain of the second drive transistor T6 and the drain and gate of the second reset transistor T5 are respectively connected to a power supply VDD, the source of the second drive transistor T6 is connected to the EVS readout circuit 320, and the gate of the second reset transistor T5 is further connected to the control circuit 400. It can be understood that when the drain and gate of the second reset transistor T5 are respectively connected to the power supply VDD, a drain-source voltage and a drain-source current are formed between the drain and source of the second reset transistor T5, and the formed drain-source voltage and drain-source current have a logarithmic relationship.

[0042] Specifically, during the first photoelectric conversion (take FIG. 2 as an example, corresponding to A1 in FIG. 2) and during the first photoelectric conversion (take FIG. 2 as an example, corresponding to A2, A3, and A4 in FIG. 2), after the selection transistor T4 finishes transmitting the second voltage received by the selection transistor T4 to the APS readout circuit 220, or while the selection transistor T4 is transmitting the second voltage received by the selection transistor T4 to the APS readout circuit 220, the second reset transistor T5 is triggered to be turned on by the control signal RST2 sent by the control circuit 400, so as to output a corresponding first voltage to the second driving transistor T6 according to the photocurrent transmitted by the input circuit 100, where the photocurrent is equal to the current between the drain and source of the second reset transistor T5 (i.e., the drain-source current), the first voltage is equal to the voltage between the drain and source of the second reset transistor T5 (i.e., the drain-source voltage), and the photocurrent and the first voltage have a logarithmic relationship.

[0043] Specifically, the second driving transistor T6 is used to transmit the received first voltage to the EVS readout circuit 320, so that the EVS readout circuit 320 subsequently outputs a corresponding event signal based on the difference between the received first voltage and a reference voltage. It should be noted here that in this specific embodiment, the second driving transistor T6 corresponds to a voltage buffer, and therefore outputs a voltage that is equal to the first voltage to the EVS readout circuit 320.

[0044] Specifically, the second reset transistor T5 is further used to trigger an off state by the control signal RST2 sent by the control circuit 400 when performing APS exposure, and when the second reset transistor T5 is in an off state, it cannot output the first voltage to the second driving transistor T6.

[0045] From the above description of this specific embodiment, it can be seen that in this specific embodiment, a total of six transistors are used in APS transmission circuit 210 and EVS transmission circuit 310. In such a case, the photoelectric conversion element of input circuit 100 may employ, but is not limited to, a photodiode or a phototransistor.

[0046] In order to clearly understand this specific embodiment, the specific embodiment will be described in detail below by a specific example.Furthermore, refer to Fig. 5, which is a structural schematic diagram of a pixel array according to an embodiment of the present application, in this example, the pixel array is a 4x4 matrix (i.e., includes a total of 16 pixels), A, B, C, D respectively represent the first row, the second row, the third row, and the fourth row of the pixel array, i.e., the pixel in row A, the pixel in row B, the pixel in row C, and the pixel in row D, respectively, and there are four APS readout circuits to complete parallel readout in the column direction of the pixel array (i.e., the pixels in the same column of the pixel array share the same APS readout circuit). 220 (i.e., a, b, c, and d), for example, when A11, A12, A13, and A14 of the pixels in row A are selected, their pixel data are read out by the four APS readout circuits 220 (i.e., a, b, c, and d), respectively; similarly, after the pixel data of the pixels in row A is read out, the pixels in rows B, C, and D may be read out row by row by the four APS readout circuits 220 (i.e., a, b, c, and d), but when the pixels in row A are selected, the readout channels of the pixels in rows B, C, and D are closed. It can be understood that the above is only an example, and the size of the pixel matrix may be set according to the actual application scenario, such as a 480×640 matrix, and the embodiment of the present application is not particularly limited thereto.

[0047] When the exposure method of the APS is a global shutter, further refer to FIG. 6, which is a schematic diagram of the first on / off state of each transistor of the pixel when the pixel structure according to the embodiment of the present application is shown in FIG. 4, where the control signal is indicated before "-" (for example, when RST2 is written before "-", it represents the control signal RST2), and the row number of the pixel is indicated after "-" (for example, when A is written after "-", it represents the pixel in row A, and when A, B, C, and D are written after "-", it represents the pixel in row A, the pixel in row B, the pixel in row C, and the pixel in row D), and the schematic diagrams of other on / off states are similar. Before time T0, the pixel is outputting the EVS image, and the control circuit 400 controls the RST2 of the pixels in rows A to D to a high level, the gate and drain of the second transfer transistor T5 of the pixels in rows A to D are shorted, and the first transfer transistor T1 of the pixels in rows A to D is turned off. In this case, the input circuit 100 is configured to perform a first photoelectric conversion of the incident light to generate a corresponding photocurrent. The generated photocurrent is transmitted to the second reset transistor T5, so that the second reset transistor T5 generates a corresponding first voltage based on the photocurrent, and the second drive transistor T6 transmits the first voltage to the EVS readout circuit 320, so that the EVS readout circuit 320 determines the intensity change of the incident light based on the difference between the first voltage and a reference voltage, and outputs a corresponding event signal. At time T0, the pixel starts to output the APS image, and the control circuit 400 controls the RST2 of the pixels in rows A to D to a low level, so that the second reset transistor T5 of the pixels in rows A to D is turned off. In this case, the input circuit 100 is configured to perform a second photoelectric conversion of the incident light to generate a corresponding photocharge. At time T1, the control circuit 400 controls RST1 of the pixels in rows A to D to a low level, so that the first reset transistors T2 of the pixels in rows A to D are turned off and the reset of the floating diffusion node FD1 is released. At time t4, the control circuit 400 controls TX1 in the pixels in rows A to D to a high level, so that the first transfer transistors T1 of the pixels in rows A to D are turned on, and at this time, the first transfer transistors T1 of the pixels in rows A to D transfer the photocharges to the respective floating diffusion nodes FD1 to form the corresponding second voltages.The first driving transistor T3 transmits the second voltage to the selection transistor T4. At time T3, the control circuit 400 controls the SEL of the pixel in row A to a high level, which causes the selection transistor T4 of the pixel in row A to be turned on, i.e., A11, A12, A13, and A14 in the pixel in row A are selected, and the pixel data of A11, A12, A13, and A14 in the pixel in row A are read out by the four APS readout circuits 220 (i.e., a, b, c, and d). At time T4, the control circuit 400 controls the SEL of the pixel in row B to a high level, which causes the selection transistor T4 of the pixel in row B to be turned on, i.e., B11, B12, B13, and B14 in the pixel in row B are selected, and the pixel data of B11, B12, B13, and B14 in the pixel in row B are read out by the four APS readout circuits 220 (i.e., a, b, c, and d). At time T5, the control circuit 400 controls the SEL of the pixel in row C to a high level, which turns on the selection transistor T4 of the pixel in row C, i.e., selects C11, C12, C13, and C14 in the pixel in row C, and reads out the pixel data of C11, C12, C13, and C14 in the pixel in row C by the four APS readout circuits 220 (i.e., a, b, c, and d). At time T6, the control circuit 400 controls the SEL of the pixel in row D to a high level, which turns on the selection transistor T4 of the pixel in row D, which turns on the pixel in row D, i.e., selects D11, D12, D13, and D14 in the pixel in row D, and reads out the pixel data of D11, D12, D13, and D14 in the pixel in row D by the four APS readout circuits 220 (i.e., a, b, c, and d). This outputs a complete APS image for one frame.

[0048] In the above process, the time from T3 to T7 is a readout time length, during which the control circuit 400 may control the RST2 of the pixels in rows A to D to a high level, so that the gate and drain of the second reset transistor T5 of the pixels in rows A to D are shorted, and the first transmission transistor T1 of the pixels in rows A to D is turned off. In this case, the input circuit 100 is configured to perform a second photoelectric conversion of the incident light to generate a corresponding photocurrent (i.e., the pixel outputs an EVS image). The generated photocurrent is transmitted to the second reset transistor T5, so that the second reset transistor T5 generates a corresponding first voltage based on the photocurrent, and the second driving transistor T6 transmits the first voltage to the EVS readout circuit 320, so that the EVS readout circuit 320 determines the intensity change of the incident light based on the difference between the first voltage and a reference voltage, and outputs a corresponding event signal. Furthermore, the image outputted in the above process may refer to FIG. 7, which is a schematic diagram of an output image when the on / off state of each transistor of a pixel according to an embodiment of the present application is as shown in FIG.

[0049] It can be understood that in the above process, the SEL of the pixels in rows A to D is set as described above in order to match the timing when the RST1 of the pixels in rows A to D becomes high level, that is, when the pixels in each row of the pixels in rows A, B, C, and D are read out, the corresponding APS readout circuit 220 subtracts the electric signal at the corresponding floating diffusion node FD1 from RST1 to eliminate the imbalance of the charge detection amplifier (i.e., the floating diffusion node FD1). Also, as is clear from the above process, in the embodiment of the present application, only a small part of the time when the EVS image is output is used to perform the exposure of the APS (i.e., the second photoelectric conversion of the incident light), and the EVS operation can be performed within the readout time length of the APS, and the output of the EVS image is not affected.

[0050] When the exposure method of the APS is a rolling shutter, further refer to FIG. 8, which is a schematic diagram of the second on / off state of each transistor of the pixel when the pixel structure according to the embodiment of the present application is shown in FIG. 4. At time T0, the control circuit 400 controls RST2 and RST1 of the pixel in row A to a low level, so that the first reset transistor T2 and the second reset transistor T5 are in an off state. In this case, the input circuit 100 is configured to perform a second photoelectric conversion of the incident light to generate a corresponding photocharge. At time t3, the control circuit 400 controls TX1 of the pixel in row A to a high level, so that the first transfer transistor T1 of the pixel in row A is in an on state, and the first transfer transistor T1 of the pixel in row A transfers the photocharge to the floating diffusion node FD1 to form a corresponding second voltage. The first driving transistor T3 transfers the second voltage to the selection transistor T4. At time T1, the control circuit 400 controls SEL of the pixels in row A to a high level, which causes the selection transistor T4 of the pixels in row A to be turned on, i.e., A11, A12, A13, and A14 in the pixels in row A are selected, and the pixel data of A11, A12, A13, and A14 in the pixels in row A are read out by the four APS readout circuits 220 (i.e., a, b, c, and d). The control circuit 400 also controls RST2 and RST1 of the pixels in row A to a high level and TX1 to a low level, which causes the first reset transistor T2 and the second reset transistor T5 of the pixels in row A to be turned on, and the first transmission transistor T1 to be turned off, i.e., at time T1, the output of the EVS image for the pixels in row A is started. At time T0, the control circuit 400 does not need to control RST1 of the pixels in row A to a low level, and it is sufficient to control RST1 to a low level before the first transmission transistor T1 is turned on.

[0051] Similarly, at times T1 to T2, B11, B12, B13, and B14 of the pixels in row B may be selected as in the above process, and the pixel data of B11, B12, B13, and B14 of the pixels in row B may be read out by four APS readout circuits 220 (i.e., a, b, c, and d); at times T2 to T3, C11, C12, C13, and C14 of the pixels in row C may be selected as in the above process, and the pixel data of B11, B12, B13, and B14 of the pixels in row B may be read out by four APS readout circuits 220 (i.e., a, b, c, and d). The pixel data of C11, C12, C13, and C14 in the pixel of row C may be read out by the four APS readout circuits 220 (i.e., a, b, c, and d), and at the time T3 to T4, as in the above process, D11, D12, D13, and D14 in the pixel of row D may be selected, and the pixel data of D11, D12, D13, and D14 in the pixel of row D may be read out by the four APS readout circuits 220 (i.e., a, b, c, and d). Here, it should be noted that when the pixel of row A outputs an APS image, the pixels of rows B, C, and D can output an EVS image, and the pixels of each row do not affect each other. Moreover, when the APS image corresponding to the pixel of each row is output, the RST2 and RST1 of the pixel of the row are controlled to a high level, so that the second reset transistor T5 and the first reset transistor T2 of the pixel of the row are turned on, and the pixel of the row starts to output an EVS image. Furthermore, the image outputted in the above process may refer to FIG. 9, which is a schematic diagram of an output image when the on / off state of each transistor of a pixel according to an embodiment of the present application is as shown in FIG.

[0052] In the above process, the SEL of the pixels in rows A to D is set as described above in order to match the timing when the RST1 of the pixels in rows A to D becomes low level; that is, when the pixels in each row of the pixels in rows A, B, C and D are read out, the corresponding APS readout circuit 220 subtracts the electric signal at the corresponding floating diffusion node FD1 from RST1 to eliminate the KT / C noise and the imbalance of the charge detection amplifier (i.e., the floating diffusion node FD1) that occurs when the floating diffusion node FD1 is reset and released.

[0053] Furthermore, the rolling shutter can be controlled so that the pixels in the first row are exposed, the pixels in the second row are not exposed, the pixels in the third row are exposed, and the pixels in the fourth row are not exposed, or the pixels are exposed every other row, and for the rows that are not exposed, the pixels may output an EVS image. For example, in the above example, the pixels in row A and the pixels in row C are exposed in a time-division manner and read out in a time-division manner, and the pixels in row B and the pixels in row D are controlled not to be exposed, so that the pixel matrix is ​​a 2×2 matrix corresponding to APS and a 4×4 matrix corresponding to EVS. Such a method can be applied to application fields in which an image is output for an area of ​​interest or application fields in which the requirement for the amount of image information is low. Of course, the rolling shutter may be controlled so that the pixels in the second row output an EVS image even during the time difference between the end of reading out the pixel data of the pixels in the first row and the start of exposure of the pixels in the second row, rather than exposing the pixels in the second row immediately after the pixel data of the pixels in the first row has been read out (for example, at time T1 in Figure 8) (i.e., in Figure 8, RST2 of the pixels in row B is held at a high level even after time T1).

[0054] For another embodiment, further refer to Fig. 10, which is a second circuit structure schematic diagram of a pixel according to an embodiment of the present application. Based on the previous embodiment, the EVS transmission circuit 310 may further include a second transmission branch, which is connected to the second return branch, the second driving branch, the input circuit 100 and the control circuit 400. In this embodiment, the second transmission branch is used to trigger an operating state by the control signal TX2 sent by the control circuit 400 during the first photoelectric conversion, and the second transmission branch is used to transmit the photocurrent generated by the input circuit 100 to the second return branch when in the operating state.

[0055] 10, as one specific embodiment of this embodiment, the second transmission branch may be composed of a second transmission transistor T7. That is, in this specific embodiment, the EVS transmission circuit 310 is provided with one more transmission transistor (i.e., the second transmission transistor T7) than the previous embodiment, in which the source of the second reset transistor T5 and the gate of the second drive transistor T6 are respectively connected to the first terminal of the second transmission transistor T7, the second terminal of the second transmission transistor T7 is connected to the input circuit 100, and the third terminal of the second transmission transistor T7 is connected to the control circuit 400.

[0056] Specifically, the second transmission transistor T7 is used to trigger an on-state by a control signal TX2 sent by the control circuit 400 during the first photoelectric conversion (taking FIG. 2 as an example, corresponding to A1 in FIG. 2) and during the first photoelectric conversion (taking FIG. 2 as an example, corresponding to A2, A3, and A4 in FIG. 2) after the selection transistor T4 finishes transmitting the second voltage received by the selection transistor T4 to the APS readout circuit 220 or while the selection transistor T4 is transmitting the second voltage received by the selection transistor T4 to the APS readout circuit 220. When the second transmission transistor T7 is in an on-state, it is used to transmit the photocurrent generated by the input circuit 100 to the second reset transistor T5.

[0057] Specifically, the second transmission transistor T7 is further used to trigger an off state by the control signal TX2 sent by the control circuit 400 when performing APS exposure. When the second transmission transistor T7 is in an off state, the input circuit 100 cannot transmit the photocurrent to the second reset transistor T5 through the second transmission transistor T7.

[0058] It can be understood that in this specific embodiment, the second transmission transistor T7 plays a similar role to the first transmission transistor T1 of the APS transmission circuit 210. Furthermore, when the exposure mode of the APS is a global shutter, the on / off state of each transistor of the pixel may refer to FIG. 11, and when the exposure mode of the APS is a rolling shutter, the on / off state of each transistor of the pixel may refer to FIG. 12, while the specific operation process can be inferred from the previous embodiment, and is similar to the previous embodiment, except that the input circuit 100 can transmit the photocurrent to the second return transistor T5 through the second transmission transistor T7 only when the second transmission transistor T7 is on.

[0059] From the above description of this specific embodiment, it can be seen that in this specific embodiment, a total of seven transistors are used in APS transmission circuit 210 and EVS transmission circuit 310. In such a case, the photoelectric conversion element of input circuit 100 may be, but is not limited to, a photodiode or a phototransistor. Preferably, the photoelectric conversion element of input circuit 100 is a clamp photodiode.

[0060] For further embodiment, further refer to FIG. 13, which is a third circuit structure schematic diagram of a pixel according to an embodiment of the present application. The APS transmission circuit 210 may include a floating diffusion node FD, an output branch and a return branch, the floating diffusion node FD is connected to the output branch, the input circuit 100 and the return branch, and the output branch is further connected to the APS readout circuit 220. In this embodiment, the return branch is used to trigger a non-operational state by a control signal RST sent by the control circuit 400 during the first photoelectric conversion. The floating diffusion node FD is used to accumulate the photocharges sent by the input circuit 100 to generate a corresponding second voltage when the return branch is in a non-operational state during the first photoelectric conversion. The output branch is used for triggering an operating state by a control signal SEL sent by the control circuit 400, and when the output branch is in an operating state, the output branch is used for transmitting the second voltage at the floating diffusion node FD to the APS readout circuit 220, so that the APS readout circuit 220 subsequently outputs a corresponding grayscale signal based on the second voltage received.

[0061] Specifically, the output branch may include a first driving branch and a selection branch, the selection branch is connected to the first driving branch, the control circuit 400 and the APS readout circuit 220, and the first driving branch is further connected to the floating diffusion node FD. In this embodiment, the first driving branch is used to buffer the potential of the floating diffusion node FD and output the second voltage to the selection branch during the first photoelectric conversion. The selection branch is used to trigger an operating state by the control signal SEL sent by the control circuit 400, and when in the operating state, the selection branch is used to transmit the second voltage at the floating diffusion node FD to the APS readout circuit 220, so that the APS readout circuit 220 will later output a corresponding grayscale signal according to the received second voltage.

[0062] In this embodiment, still referring to FIG. 13, the EVS transmission circuit 310 may include a second driving branch, and the second driving branch is connected to the floating diffusion node FD and the EVS readout circuit 320. In this embodiment, the return branch is further used for triggering an operating state by the control signal RST sent by the control circuit 400 after the selection branch finishes transmitting the received second voltage to the APS readout circuit 220 during the duration of the first photoelectric conversion, and the return branch is used for outputting a corresponding first voltage according to the photocurrent generated by the input circuit 100 when in the operating state. The second driving branch is used for transmitting the first voltage to the EVS readout circuit 320, so that the EVS readout circuit 320 later outputs a corresponding event signal according to the difference between the received first voltage and a reference voltage.

[0063] Specifically, the reversion branch may further include a reversion transistor T1, the source of which is connected to the floating diffusion node FD, the drain and the gate of which are respectively connected to the power supply VDD, and the gate of which is further connected to the control circuit 400. In this embodiment, the reversion transistor T1 is used to trigger an OFF state by a control signal RST sent by the control circuit 400 during the first photoelectric conversion, and to trigger an ON state by a control signal RST sent by the control circuit 400 during the first photoelectric conversion after the selection branch finishes transmitting the second voltage to the APS readout circuit 220, and when the reversion transistor T1 is in an ON state, the reversion transistor T1 is used to output a corresponding first voltage according to the photocurrent generated by the input circuit 100, where the photocurrent is equal to the current between the drain and source of the reversion transistor T1, the first voltage is equal to the voltage between the drain and source of the reversion transistor T1, and the photocurrent and the first voltage have a logarithmic relationship.

[0064] 13, in one specific aspect of this embodiment, in the APS transmission circuit 210, except for the reset branch consisting of the reset transistor T1, the remaining branches may be composed of corresponding transistors, for example, the first drive branch includes a first drive transistor T2, and the selection branch includes a selection transistor T3. Correspondingly, in the EVS transmission circuit 310, the second drive branch may also be composed of corresponding transistors, for example, the second drive branch includes a second drive transistor T4.

[0065] In this embodiment, the APS transmission circuit 210 may include a reset transistor T1, a first drive transistor T2, a selection transistor T3, and a floating diffusion node FD, where the input circuit 100, the EVS transmission circuit 310, the source of the reset transistor T1, and the gate of the first drive transistor T2 are respectively connected to the floating diffusion node FD, the drain of the first drive transistor T2 and the drain and gate of the reset transistor T1 are respectively connected to a power supply VDD, the gate of the reset transistor T1 is further connected to a control circuit 400, the source of the first drive transistor T2 is connected to the drain of the selection transistor T3, the source of the selection transistor T3 is connected to the APS readout circuit 220, and the gate of the selection transistor T3 is connected to the control circuit 400. It can be understood that when the drain and gate of the reset transistor T1 are respectively connected to the power supply VDD, a drain-source voltage and a drain-source current are formed between the drain and source of the reset transistor T1, and the formed drain-source voltage and drain-source current have a logarithmic relationship.

[0066] Specifically, the reset transistor T1 is first triggered to an off state by the control signal RST sent by the control circuit 400 during the first photoelectric conversion.

[0067] Specifically, the floating diffusion node FD is used to accumulate the photocharges generated by the input circuit 100 during the first photoelectric conversion when the recovery transistor T1 is in an off state to form a corresponding second voltage. It should be noted here that in this specific embodiment, the floating diffusion node FD corresponds to a charge detection amplifier.

[0068] Specifically, the first driving transistor T2 is used to transmit the second voltage by the floating diffusion node FD to the selection transistor T3 during the first photoelectric conversion. It should be noted here that in this specific embodiment, the first driving transistor T2 corresponds to a source follower amplifier, which can buffer the potential at the floating diffusion node FD to output a voltage corresponding to the second voltage to the selection transistor T3.

[0069] Specifically, the selection transistor T3 is used to trigger an ON state by a control signal SEL sent by the control circuit 400 during the first photoelectric conversion, and when the selection transistor T3 is in an ON state, the selection transistor T3 may transmit the received second voltage to the APS readout circuit 220, so that the APS readout circuit 220 will output a corresponding grayscale signal according to the received second voltage later. Correspondingly, the selection transistor T3 is further used to trigger an OFF state by a control signal SEL sent by the control circuit 400 after the selection transistor T3 finishes transmitting the received second voltage to the APS readout circuit 220 during the first photoelectric conversion, and when the selection transistor T3 is in an OFF state, the selection transistor T3 cannot transmit the received second voltage to the APS readout circuit 220.

[0070] In this specific embodiment, still referring to FIG. 13, the EVS transmission circuit 310 may include a second drive transistor T4 having a gate connected to the floating diffusion node FD, a source connected to the EVS readout circuit 320, and a drain connected to a power supply VDD.

[0071] Specifically, the reset transistor T1 is further used for triggering an ON state by the control signal RST sent by the control circuit 400 during the first photoelectric conversion (take FIG. 2 as an example, corresponding to A1 in FIG. 2) and during the duration of the first photoelectric conversion (take FIG. 2 as an example, corresponding to A2, A3 and A4 in FIG. 2) after the selection transistor T3 finishes transmitting the second voltage received by it to the APS readout circuit 220, and when the reset transistor T1 is in an ON state, it is used for outputting a corresponding first voltage to the second driving transistor T4 according to the photocurrent transmitted by the input circuit 100, where the photocurrent is equal to the current between the drain and source of the reset transistor T1 (i.e., the drain-source current), the first voltage is equal to the voltage between the drain and source of the reset transistor T1 (i.e., the drain-source voltage), and the photocurrent and the first voltage are in a logarithmic relationship. It can be understood that when the reset transistor T1 is in an OFF state, it cannot output the first voltage to the second driving transistor T4.

[0072] Specifically, the second driving transistor T4 is used to transmit the received first voltage to the EVS readout circuit 320, so that the EVS readout circuit 320 subsequently outputs a corresponding event signal based on the difference between the received first voltage and a reference voltage. It should be noted here that in this specific embodiment, the second driving transistor T4 corresponds to a voltage buffer, so that it can output a voltage that is consistent with the first voltage to the EVS readout circuit 320.

[0073] In this specific embodiment, the APS transmission circuit 210 and the EVS transmission circuit 310 of one pixel share the same reset transistor T1, which makes the size of one pixel smaller and further reduces the size of the entire image sensor. Also, in this specific embodiment, a total of four transistors are used in the APS transmission circuit 210 and the EVS transmission circuit 310, and in such a case, the photoelectric conversion element of the input circuit 100 may adopt a photodiode or a phototransistor, but is not limited thereto.

[0074] In order to clearly understand this specific embodiment, the pixel array shown in FIG. 5 is also taken as an example to describe this specific embodiment in detail below. When the exposure method of the APS is a rolling shutter, further refer to FIG. 14, which is a schematic diagram of the on / off state of each transistor of the pixel when the pixel structure according to the embodiment of the present application is shown in FIG. 13. Before time T0, the pixel is outputting an EVS image, and the control circuit 400 controls the RST of the pixels in rows A to D to a high level, and the gate and drain of the reset transistor T1 are shorted. In this case, the input circuit 100 is configured to perform a first photoelectric conversion of the incident light to generate a corresponding photocurrent. At time T0, the control circuit 400 controls the RST of the pixels in row A to a low level, and the first drive transistor T2 transmits the second voltage formed by the photocharge at the floating diffusion node FD to the selection transistor T3. The control circuit 100 controls SEL of the pixels in row A to a high level, which turns on the selection transistor T3 of the pixels in row A, i.e., selects A11, A12, A13, and A14 in the pixels in row A, and reads out pixel data of A11, A12, A13, and A14 in the pixels in row A by the four APS readout circuits 220 (i.e., a, b, c, and d). At time T1, the control circuit 400 controls RST of the pixels in row A to a high level, which causes the pixels in row A to output an EVS image. Here, it should be explained that the four APS readout circuits 220 (i.e., a, b, c, and d) must complete the readout of the pixels in row A before the rising edge of RST.

[0075] Similarly, at times T1 to T2, B11, B12, B13, and B14 of the pixels in row B may be selected as in the above process, and the pixel data of B11, B12, B13, and B14 of the pixels in row B may be read out by four APS readout circuits 220 (i.e., a, b, c, and d). At times T2 to T3, C11, C12, C13, and C14 of the pixels in row C may be selected as in the above process, and the pixel data of B11, B12, B13, and B14 of the pixels in row B may be read out by four APS readout circuits 220 (i.e., a, b, c, and d). The pixel data of C11, C12, C13, and C14 in the pixels in row C may be read out by the four APS readout circuits 220 (i.e., a, b, c, and d), and at times T3 to T4, as in the above process, D11, D12, D13, and D14 in the pixels in row D may be selected, and the pixel data of D11, D12, D13, and D14 in the pixels in row D may be read out by the four APS readout circuits 220 (i.e., a, b, c, and d).

[0076] It should be noted that the above-mentioned embodiments are merely preferred aspects of the examples of the present application, and are not unique limitations on the specific configuration of one pixel in the examples of the present application. Therefore, a person skilled in the art may flexibly configure the examples of the present application according to actual application scenarios.

[0077] 15, which is a schematic diagram of a flow of an image output method according to an embodiment of the present application. The embodiment of the present application further provides an image output method applied to an image sensor according to an embodiment of the present application, which includes the following steps 1501 to 1504.

[0078] In step 1501, the input circuit performs a first photoelectric conversion on incident light to generate a corresponding photocurrent while operating in the EVS mode, and performs a second photoelectric conversion on incident light to generate a corresponding photocharge while operating in the APS mode.

[0079] In the embodiment of the present application, the input circuit 100 includes a photoelectric conversion element configured to perform photoelectric conversion of incident light, i.e., perform a first photoelectric conversion on the incident light to generate a corresponding photocurrent during a period of operation in the EVS mode, and perform a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period of operation in the APS mode, the first photoelectric conversion being the exposure of the EVS, and the second photoelectric conversion being the exposure of the APS. From the above, it can be seen that a part of the period for performing the APS exposure (i.e., the period of operation in the APS mode) is separated from the exposure process of the EVS, i.e., the exposure of the EVS and the exposure of the APS are alternately performed, and for example, taking A1, B1, and A2 in FIG. 2 as an example, a part of the period for performing the APS exposure (i.e., B1) is separated from the exposure process of the EVS (i.e., the continuous period between A1 and A2).

[0080] In step 1502, the EVS circuit outputs a corresponding event signal based on a difference between a first voltage corresponding to the photocurrent and a reference voltage during a first photoelectric conversion.

[0081] In the embodiment of the present application, the EVS circuit 300 outputs a corresponding event signal according to the difference between the first voltage corresponding to the photocurrent and the reference voltage during the first photoelectric conversion, and the event signal is used to generate a corresponding EVS image. In practical application, when the pixel is outputting an EVS image, the input circuit 100 performs a first photoelectric conversion on the incident light and outputs a corresponding photocurrent to the EVS circuit 300, and then the EVS circuit 300 outputs a corresponding event signal according to the difference between the first voltage corresponding to the received photocurrent and the reference voltage, so as to later generate a corresponding EVS image using the output event signal. Here, it should be explained that the difference between the first voltage and the reference voltage is to represent the intensity change (i.e., increase, decrease or no change) of the incident light, which means that the EVS circuit 300 actually outputs a corresponding event signal according to the intensity change of the incident light, for example, the intensity change of the incident light is determined according to whether the difference between the first voltage and the reference voltage is greater than 0, less than 0, or equal to 0.

[0082] In step 1503, the APS circuit outputs a corresponding grayscale signal based on a second voltage corresponding to the photocharges during the first photoelectric conversion.

[0083] In the embodiment of the present application, the APS circuit 200 outputs a corresponding grayscale signal based on the second voltage corresponding to the photocharge during the first photoelectric conversion (i.e., during the next first photoelectric conversion after the second photoelectric conversion is completed, in other words, during the next EVS mode operation period adjacent to the APS mode operation period), where the grayscale signal is used to generate a corresponding APS image. For example, taking A1, B1, and A2 in FIG. 2 as an example, the input circuit 100 performs a second photoelectric conversion on the incident light in B1 to generate a corresponding photocharge, and the APS circuit 200 outputs a corresponding grayscale signal based on the second voltage corresponding to the generated photocharge in A2. It can be understood that the grayscale signal output process by the APS circuit 200 is actually an APS readout process, and the grayscale signal output process by the APS circuit 200 is performed within the next EVS mode operation period (e.g., A2) adjacent to the APS mode operation period (e.g., B1), while the EVS operation may continue to be performed within A2, that is, the APS readout process does not affect the EVS exposure and readout, so that when one pixel includes both an APS pixel and an EVS pixel, this one pixel can output an APS image and an EVS image simultaneously.

[0084] In step 1504, the control circuit outputs a corresponding APS image based on the grayscale signal, and outputs a corresponding EVS image based on the event signal.

[0085] In the embodiment of the present application, the control circuit 400 outputs a corresponding APS image according to the grayscale signal, and outputs a corresponding EVS image according to the event signal. In practical application, when the pixel is outputting an APS image, the APS circuit 200 outputs a corresponding grayscale signal to the control circuit 400 according to the second voltage corresponding to the received photoelectric charge, and then the control circuit 400 outputs a corresponding APS image according to the received grayscale signal to display to the user. Similarly, when the pixel is outputting an EVS image, the EVS circuit 300 outputs a corresponding event signal to the control circuit 400 according to the difference between the first voltage corresponding to the received photocurrent and the reference voltage, and then the control circuit 400 outputs a corresponding EVS image according to the received event signal to display to the user.

[0086] The steps of a method or algorithm described with reference to the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. The software modules may be located in a Random Access Memory (RAM), memory, a Read Only Memory (ROM), an Electrically Programmable ROM, an Electrically Erasable Programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0087] The above-described embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the implementation may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described herein are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or may be transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, via wire (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, radio, microwave, etc.) from one website site, computer, server, or data center to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device such as an integrated server, data center, etc. that includes one or more available media. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk), and the like.

[0088] It should be noted that each embodiment in the present application is described step by step, each embodiment is described focusing on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. The product embodiments are similar to the method embodiments, so they are described briefly, but the relevant points can be referred to the description of the method embodiments.

[0089] It should be further explained that in the context of this application, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that any such actual relationship or sequence exists between these entities or operations. Moreover, the terms "comprise", "include", or any other variant thereof are intended to cover a non-exclusive inclusion, whereby a process, method, article, or installation that includes a set of elements includes not only those elements, but also other elements not expressly listed or elements inherent to such process, method, article, or installation. In the absence of further limitations, an element qualified by the phrase "comprises a ..." does not exclude the presence of additional identical elements in the process, method, article, or installation that includes said element.

[0090] The above description of the disclosed embodiments enables those skilled in the art to realize or use the contents of the present application. Various modifications of these embodiments will be apparent to those skilled in the art, and the general principles defined in the contents of the present application can be implemented in other embodiments without departing from the spirit or scope of the contents of the present application. Therefore, the contents of the present application are not limited to these embodiments shown in the contents of the present application, but are to be accorded the widest scope consistent with the principles and novel features disclosed in the contents of the present application.

Claims

1. 1. An image sensor including a pixel array of a plurality of pixels, an input circuit, an APS circuit, an EVS circuit, and a control circuit, each of the pixels includes the APS circuit and the EVS circuit, the input circuit is connected to the APS circuit and the EVS circuit, the control circuit is connected to the APS circuit and the EVS circuit, an operation time unit of the input circuit is an operation time length for outputting one frame of an APS image, the operation time unit includes a period of operation in EVS mode and a period of operation in APS mode, and one period of operation in the APS mode is between adjacent periods of operation in the EVS mode, the input circuit is used to perform a first photoelectric conversion on incident light to generate a corresponding photocurrent during a period when the input circuit operates in the EVS mode, and to perform a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period when the input circuit operates in the APS mode; The EVS circuit is used for outputting a corresponding event signal according to a difference between a first voltage corresponding to the photocurrent and a reference voltage during the first photoelectric conversion; The APS circuit is used for outputting a corresponding grayscale signal according to a second voltage corresponding to the photocharges during the first photoelectric conversion; The image sensor according to claim 1, wherein the control circuit is used to output a corresponding EVS image based on the event signal, and to output a corresponding APS image based on the grayscale signal.

2. the EVS circuit includes an EVS transmission circuit and an EVS readout circuit, the EVS transmission circuit is connected to the input circuit and the EVS readout circuit, and the control circuit is connected to the EVS transmission circuit and the EVS readout circuit; The EVS transmission circuit is used to output a corresponding first voltage according to the photocurrent during the first photoelectric conversion; 2. The image sensor of claim 1, wherein the EVS readout circuit is adapted to output a corresponding event signal according to a difference between the first voltage and a reference voltage.

3. The EVS transmission circuit includes a return branch and a driving branch, the return branch and the driving branch are respectively connected to the input circuit, the return branch is further connected to the control circuit, and the driving branch is further connected to the EVS readout circuit; The return branch is used to trigger an operating state according to a first control signal sent by the control circuit during the first photoelectric conversion; The return branch is used for outputting a corresponding first voltage according to the photocurrent when in the working state; 3. The image sensor of claim 2, wherein the drive branch is used to transmit the first voltage to the EVS readout circuitry.

4. The reset branch includes a reset transistor, the drain and gate of the reset transistor are respectively connected to a power supply, the source of the reset transistor and the driving branch are respectively connected to the input circuit, and the gate of the reset transistor is further connected to the control circuit; The reset transistor is used to trigger an on-state by a first control signal sent by the control circuit during the first photoelectric conversion; The reset transistor is used to output a corresponding first voltage according to the photocurrent when in the on-state; 4. The image sensor of claim 3, wherein the photocurrent is equal to a current between the drain and source of the reset transistor, the first voltage is equal to a voltage between the drain and source of the reset transistor, and the photocurrent and the first voltage have a logarithmic relationship.

5. the EVS transmission circuit further includes a transmission branch, the transmission branch being connected to the return branch, the driving branch, the input circuit, and the control circuit; The transmission branch is used to trigger an operating state according to a second control signal sent by the control circuit during the first photoelectric conversion; 5. The image sensor according to claim 3 or 4, wherein the transmission branch transmits the photocurrent to the return branch when in the active state.

6. the APS circuit includes an APS transmission circuit and an APS read circuit, the APS transmission circuit is connected to the input circuit and the APS read circuit, and the control circuit is connected to the APS transmission circuit and the APS read circuit; The APS transmission circuit is used for outputting a corresponding second voltage according to the photocharge during the first photoelectric conversion; 3. The image sensor as claimed in claim 2, wherein the APS readout circuit is used for outputting a corresponding gray scale signal according to the second voltage.

7. the APS transmission circuit includes a transmission branch, a floating diffusion node, and an output branch; the transmission branch is connected to the input circuit, the control circuit and the floating diffusion node, and the output branch is connected to the floating diffusion node, the control circuit and the APS readout circuit; The transmission branch is used to trigger an operating state by a first control signal sent by the control circuit during the first photoelectric conversion, and the transmission branch is used to transmit the photocharges to the floating diffusion node when in the operating state; the floating diffusion node is used to accumulate the photocharges and generate a corresponding second voltage; the output branch is adapted to trigger an operating state in response to a second control signal sent by the control circuit; 7. The image sensor of claim 6, wherein the output branch is used to transmit the second voltage to the APS readout circuit when in the active state.

8. the output branch includes a drive branch and a select branch, the select branch is connected to the drive branch, the control circuit and the APS readout circuit, the drive branch is further connected to the floating diffusion node; the driving branch is used to buffer the potential of the floating diffusion node and output the second voltage to the selection branch; the selective branch is used to trigger an operating state according to a second control signal sent by the control circuit; 8. The image sensor of claim 7, wherein the selection branch is used to transmit the second voltage to the APS readout circuit when in the active state.

9. The APS transmission circuit further includes a return branch, the return branch being connected to the floating diffusion node and the control circuit; the return branch is used to trigger an operating state according to a third control signal sent by the control circuit after the second voltage is transmitted to the APS read circuit; 9. The image sensor according to claim 7, wherein when the reconnection branch is in the actuated state, the photocharges stored in the floating diffusion node are transferred to the outside.

10. the reversion branch includes a reversion transistor having a source connected to the floating diffusion node, a gate connected to the control circuit, and a drain connected to a power supply; the reset transistor is used to trigger an on-state according to a third control signal sent by the control circuit after the second voltage is transmitted to the APS read circuit; 10. The image sensor of claim 9, wherein when the reset transistor is in the on state, the photo-induced charges stored in the floating diffusion node are transferred to the power supply.

11. the APS transmission circuit includes a floating diffusion node, an output branch, and a return branch, the floating diffusion node is connected to the output branch, the input circuit, and the return branch, and the output branch is further connected to the APS readout circuit; The return branch is used to trigger a deactivation state by a first control signal sent by the control circuit during the duration of the first photoelectric conversion; the floating diffusion node is used to accumulate the photo-induced charges and generate a corresponding second voltage when the return branch is in the non-operated state; the output branch is adapted to trigger an operating state in response to a second control signal sent by the control circuit; 7. The image sensor of claim 6, wherein the output branch is used to transmit the second voltage to the APS readout circuit when in the active state.

12. the output branch includes a first drive branch and a selection branch, the selection branch is coupled to the first drive branch, the control circuitry and the APS readout circuitry, the first drive branch is further coupled to the floating diffusion node; the first driving branch is used to buffer the potential of the floating diffusion node and output the second voltage to the selection branch; the selective branch is used to trigger an operating state according to a second control signal sent by the control circuit; The image sensor of claim 11 , wherein the selection branch is used to transmit the second voltage to the APS readout circuit when in the active state.

13. the EVS transmit circuit includes a second drive branch coupled to the floating diffusion node and to the EVS readout circuit; The return branch is further used for triggering an operating state according to a first control signal sent by the control circuit after the second voltage is transmitted to the APS read circuit; The return branch is used for outputting a corresponding first voltage according to the photocurrent when in the working state; 13. The image sensor of claim 11 or 12, wherein the second drive branch is used to transmit the first voltage to the EVS readout circuitry.

14. The retransmission branch includes a retransmission transistor, the source of which is connected to the floating diffusion node, the drain and the gate of which are respectively connected to a power supply, and the gate of which is further connected to the control circuit; the reset transistor is used to trigger an on-state according to a first control signal sent by the control circuit after the second voltage is transmitted to the APS readout circuit, and the reset transistor is used to output a corresponding first voltage according to the photocurrent when in the on-state; 14. The image sensor of claim 13, wherein the photocurrent is equal to a current between a drain and a source of the reset transistor, the first voltage is equal to a voltage between a drain and a source of the reset transistor, and the photocurrent and the first voltage have a logarithmic relationship.

15. All the pixels in the same array unit in the pixel array share the same APS readout circuit, or all the pixels in the pixel array share the same APS readout circuit, or 7. The image sensor of claim 6, wherein every pixel in the pixel array includes one APS readout circuit.

16. All the pixels in the same array unit in the pixel array share the same EVS readout circuit, or all the pixels in the pixel array share the same EVS readout circuit; or 3. The image sensor of claim 2, wherein every pixel in the pixel array includes one of the EVS readout circuits.

17. All the pixels in the same array unit in the pixel array share the same control circuit; or all the pixels in the pixel array share the same control circuit; or 2. The image sensor of claim 1, wherein every pixel in the pixel array includes a respective one of the control circuits.

18. All the pixels in the same array unit in the pixel array share the same input circuit, or all the pixels in the pixel array share the same input circuit, or 2. The image sensor of claim 1, wherein every pixel in the pixel array includes one of the input circuits.

19. 1. An image output method applied to an image sensor including a pixel array of a plurality of pixels, comprising: the image sensor includes an input circuit, an APS circuit, an EVS circuit, and a control circuit, each of the pixels includes the APS circuit and the EVS circuit, the input circuit is connected to the APS circuit and the EVS circuit, the control circuit is connected to the APS circuit and the EVS circuit, an operation time unit of the input circuit is an operation time length for outputting one frame of an APS image, the operation time unit includes a period of operation in an EVS mode and a period of operation in an APS mode, and one period of operation in the APS mode is between adjacent periods of operation in the EVS mode, The image output method includes: performing a first photoelectric conversion on incident light to generate a corresponding photocurrent during a period when the input circuit operates in the EVS mode, and performing a second photoelectric conversion on the incident light to generate a corresponding photocharge during a period when the input circuit operates in the APS mode; the EVS circuit outputs a corresponding event signal based on a difference between a first voltage corresponding to the photocurrent and a reference voltage during the first photoelectric conversion; the APS circuit outputs a corresponding grayscale signal based on a second voltage corresponding to the photocharges during the first photoelectric conversion; the control circuit outputs a corresponding EVS image based on the event signal, and outputs a corresponding APS image based on the gradation signal.

20. Use of an image sensor according to any one of claims 1 to 18 in a photoelectric device.

Citation Information

Patent Citations

  • Image signal processing method and device and electronic equipment

    CN113727079A