High dynamic range image sensor pixel circuit and working method thereof
By combining photoelectric conversion elements, charge storage and transfer circuits and release circuits in the image sensor pixel circuit, the modulation signal and weak shutdown signal are used to adjust charge release, the problem of insufficient photosensitive dynamic range in a strong light environment is solved, and the problem of traditional image sensors is realized Higher photosensitive dynamic range and flexibility enhance the perception of strong light information.
Patent Information
- Application Number
- CN202110949016.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-18
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-08-18
AI Technical Summary
Traditional image sensor pixel circuits have shortcomings in the dynamic range of light sensing, especially in strong light environments, which are difficult to effectively collect image information. The dynamic range is less than 80dB, and it is impossible to achieve the perception ability of the human eye above 100dB.
A high dynamic range image sensor pixel circuit is designed. Through the combination of photoelectric conversion elements, charge storage and transfer circuits, the modulation signal and weak shutdown signal are used to release part of the charge in different periods, adjust the photosensitive ability and ensure low light irradiation. The photosensitive ability and sensitivity remain unchanged, and the photosensitive ability is suppressed when strong light is irradiated, achieving nonlinear photoelectric response.
It effectively expands the dynamic range of the photosensitive image sensor, reduces the risk of image drag and dark current, improves the ability to perceive strong light information, and enhances the flexibility of image acquisition.
Smart Images

Figure CN113542634B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of sensors, and in particular, relates to a high dynamic range image sensor pixel circuit and a working method thereof. Background Art
[0002] Image sensors have been widely used in digital cameras, mobile phones, medical devices, automobiles and other applications. In particular, the rapid development of complementary metal oxide semiconductor (CMOS) image sensor technology has led to higher requirements for the output image quality of image sensors.
[0003] The working principle of the pixel circuit of the image sensor is usually to use a photodiode to convert the received light signal into a photoelectric charge signal. The maximum amount of photoelectric charge that the photodiode can collect during the exposure process is called the charge saturation capacity. The higher the charge saturation capacity, the higher the dynamic range of the pixel to collect object information. In the image sensor pixel circuit of the related technology, the photoelectric response of the photodiode is usually a linear relationship, which is called a linear image sensor; as the exposure increases, the photodiode quickly reaches a saturated state, and it is difficult to collect image information in a strong light environment. The dynamic range of the collected image information is generally less than 80dB. In nature, the human eye is sensitive to weak light, that is, it has high sensitivity when perceiving weak light; and it is insensitive to strong light, that is, it has low sensitivity when perceiving strong light. The human eye's perception of light is characterized by a logarithmic curve relationship, which effectively improves the eye's ability to perceive light, and its dynamic range can reach more than 100dB. It can be seen that compared with the human eye, the ability of the above-mentioned linear image sensor to collect images is obviously poor. Summary of the invention
[0004] The purpose of the present application is to provide a high dynamic range image sensor pixel circuit and a working method thereof, aiming to solve the defect of low photosensitivity dynamic range in traditional high dynamic range image sensor pixel circuits.
[0005] An embodiment of the present application provides a high dynamic range image sensor pixel circuit, comprising:
[0006] A photoelectric conversion element configured to receive a light signal to generate an electric charge;
[0007] a charge storage transfer circuit, connected to the photoelectric conversion element, configured to store the charge to generate an integrated charge signal, and output the integrated charge signal according to a control selection signal;
[0008] The charge storage transfer circuit stores the charge according to the charge output signal to generate an integrated charge signal, the charge output signal is a modulation signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different;
[0009] a release circuit connected to the photoelectric conversion element and the input end of the charge storage transfer circuit, and configured to release part of the charge generated by the photoelectric conversion element according to a weak shutdown signal at least during the process in which the charge storage transfer circuit stores the charge to generate the integrated charge signal;
[0010] The charge readout circuit is connected to the output end of the charge storage transfer circuit and is configured to output an electrical signal according to the integrated charge signal to obtain an image signal.
[0011] The embodiment of the present application further provides a working method of the above-mentioned high dynamic range image sensor pixel circuit, including:
[0012] A charge output signal is input, and a charge storage conversion circuit stores the charge according to the charge output signal to generate an integrated charge signal;
[0013] In the process of inputting the charge output signal, a weak shutdown signal is input, so that the release circuit releases part of the charge generated by the photoelectric conversion element according to the weak shutdown signal at least in the process of the charge storage transfer circuit storing the charge to generate the integrated charge signal; the charge output signal is a modulated signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different;
[0014] A control selection signal is inputted so that the charge storage transfer circuit outputs the integrated charge signal according to the control selection signal to obtain an image signal.
[0015] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: since the release circuit releases part of the charge generated by the photoelectric conversion element according to the weak shutdown signal at least during the process in which the charge storage transfer circuit stores the charge to generate an integrated charge signal; the charge in the photoelectric conversion element irradiated with strong light is partially released through the release circuit, and the charge output signal is a modulated signal including n cycles, and the duration corresponding to each cycle from the first cycle to the nth cycle is different, the photosensitivity of the pixel irradiated with strong light is suppressed, and the photosensitivity sensitivity is reduced, while the photosensitivity and sensitivity of the pixel irradiated with weak light remain unchanged, the photosensitivity dynamic range of the pixel circuit of the high dynamic range image sensor is increased, and the flexibility of adjusting the photosensitivity dynamic range of the pixel circuit of the high dynamic range image sensor is increased. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical invention in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] Figure 1 A schematic diagram of a high dynamic range image sensor pixel circuit provided by an embodiment of the present application;
[0018] Figure 2 An exemplary circuit schematic diagram of a high dynamic range image sensor pixel circuit provided by an embodiment of the present application;
[0019] Figure 3 For the corresponding Figure 2 Key signal timing diagram of high dynamic range image sensor pixel circuit;
[0020] Figure 4 Schematic diagram of potential wells of a high dynamic range image sensor pixel circuit provided in an embodiment of the present application when operating under strong light irradiation
[0021] Figure 5 Schematic diagram of potential wells of a high dynamic range image sensor pixel circuit provided in an embodiment of the present application when operating under weak light irradiation
[0022] Figure 6 A schematic diagram of a photoelectric response curve of a high dynamic range image sensor pixel circuit provided by the related art and an embodiment of the present application. DETAILED DESCRIPTION
[0023] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0024] It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it can be directly on the other element or indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element.
[0025] It should be understood that the orientation or position relationship indicated by terms such as "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.
[0026] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0027] In a related technology, in order to improve the dynamic range of image information acquisition, a high-dose impurity ion injection method is usually used in the photodiode to increase the charge saturation capacity of the photodiode. However, the disadvantage is that the photodiode is completely depleted. The potential is increased, which is prone to image smearing, and the dark current will also increase. Another related technology to improve the dynamic range of image information acquisition is to set two modes of high conversion gain and low conversion gain in the pixel to deal with image acquisition in weak light and strong light environments respectively. Although these two modes can be switched back and forth according to the lighting environment, only one of the two modes can be used at the same time during the operation of the pixel, so the detail information of weak light and strong light images cannot be obtained at the same time.
[0028] Figure 1 The schematic diagram of the structure of the high dynamic range image sensor pixel circuit provided by the preferred embodiment of the present application is shown. For the convenience of explanation, only the part related to the present embodiment is shown, which is described in detail as follows:
[0029] The high dynamic range image sensor pixel circuit includes a photoelectric conversion element 11 , a charge storage transfer circuit 12 , a release circuit 13 and a charge readout circuit 14 .
[0030] The photoelectric conversion element 11 is configured to receive a light signal to generate electric charges.
[0031] The charge storage transfer circuit 12 is connected to the photoelectric conversion element 11, and is configured to store the charge to generate an integrated charge signal, and output the integrated charge signal according to a control selection signal; wherein the charge storage transfer circuit 12 stores the charge according to the charge output signal to generate an integrated charge signal, and the charge output signal is a modulated signal including n cycles, and from the 1st cycle to the nth cycle, the duration corresponding to each cycle is different.
[0032] The release circuit 13 is connected to the input end of the photoelectric conversion element 11 and the charge storage transfer circuit 12, and is configured to release part of the charge generated by the photoelectric conversion element according to a weak shutdown signal at least when the charge storage transfer circuit 12 stores the charge to generate an integrated charge signal.
[0033] The charge readout circuit 14 is connected to the output terminal of the charge storage transfer circuit 12 and is configured to output an electrical signal according to the integrated charge signal to obtain an image signal.
[0034] In one example, from the first cycle to the nth cycle, the integration time corresponding to each cycle gradually decreases or the integration time corresponding to each cycle gradually increases; in this embodiment, the integration time corresponding to each cycle is selected to gradually decrease. Each cycle includes a charge output signal off stage and a charge output signal on stage; the integration time is the duration of the charge output signal off stage of the cycle. In this embodiment, each cycle includes a charge output signal off stage and a charge output signal on stage in sequence.
[0035] By gradually increasing the integration time corresponding to each cycle, the photosensitivity of pixels exposed to strong light is further suppressed and the photosensitivity is further reduced, while the photosensitivity and sensitivity of pixels exposed to weak light are enhanced, making the high dynamic range image sensor pixel circuit more consistent with the human eye's perception of light, which is a logarithmic curve relationship, effectively improving the ability to perceive light and further increasing the photosensitivity dynamic range of the high dynamic range image sensor pixel circuit.
[0036] By gradually reducing the integration time corresponding to each cycle, the photosensitivity of pixels exposed to weak light is further suppressed and the photosensitivity is further reduced, while the photosensitivity and sensitivity of pixels exposed to strong light are enhanced, making the high dynamic range image sensor pixel circuit suitable for strong light perception scenarios.
[0037] In a specific implementation, the ratio of the integration durations of adjacent cycles is between 1 / 2 and 9 / 10, for example, the integration duration of the next cycle is set to 4 / 5 of the previous integration duration. In another example, the integration durations of the cycles may be distributed in an arithmetic progression.
[0038] In one example, the charge output signal is a pulse modulation signal including n pulse periods, and the total duration of the charge output signal is T, where T is a positive number.
[0039] As an example but not limitation, the pulse duration of the pulse modulation signal is a, where a is a positive number and a constant.
[0040] By setting the charge output signal to a pulse modulation signal including n pulse cycles, the photosensitivity of the pixel can be adjusted, thereby further increasing the photosensitivity dynamic range of the pixel circuit of the high dynamic range image sensor.
[0041] The output end of the photoelectric conversion element 11 may be the cathode of the photoelectric conversion element 11. For example, the photoelectric conversion element 11 may be a photodiode. Thus, the charge generated by the photoelectric conversion element 11 when receiving the light signal is negative charge, which improves the mobility of the charge.
[0042] In a specific implementation, the charge readout circuit 14 is further configured to clear the charge in the photoelectric conversion element 11 according to the clear signal.
[0043] The charge in the photoelectric conversion element 11 is cleared by the charge readout circuit 14 according to the clear signal, so that the charge in the photoelectric conversion element 11 is cleared every time an image signal is acquired, thereby improving the acquisition accuracy of the image signal.
[0044] When the charge readout circuit 14 clears the charge in the photoelectric conversion element 11, the release circuit 13 is also configured to clear the charge in the photoelectric conversion element 11 according to the anti-charge crosstalk control signal; wherein the control voltage corresponding to the anti-charge crosstalk control signal is equal to the control voltage corresponding to releasing part of the charge generated by the photoelectric conversion element according to the weak shutdown signal.
[0045] The charge in the photoelectric conversion element 11 is cleared by the release circuit 13, and the charge in the photoelectric conversion element 11 is further cleared, thereby improving the acquisition accuracy of the image signal. The control voltage corresponding to the anti-charge crosstalk control signal is equal to the control voltage corresponding to when part of the charge generated by the photoelectric conversion element is released according to the weak shutdown signal, thereby preventing the interference caused by the potential change of the release circuit 13.
[0046] An embodiment of the present invention further provides a method for operating a pixel circuit of a high dynamic range image sensor, including steps 101a, 101b and step 102.
[0047] Step 101a: During the exposure process, a charge output signal is input, and the charge storage conversion circuit stores the charge according to the charge output signal to generate an integrated charge signal;
[0048] Step 101b: during the process of inputting the charge output signal, inputting a weak shutdown signal, so that the release circuit 13 releases part of the charge generated by the photoelectric conversion element according to the weak shutdown signal at least during the process of the charge storage transfer circuit storing the charge to generate the integrated charge signal;
[0049] The charge output signal is a modulation signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different.
[0050] As an example but not a limitation, step 100a is included before step 101a and step 101b.
[0051] Step 100a: before starting exposure, a clear signal is input, and the charge readout circuit 14 clears the charge in the photoelectric conversion element 11 according to the clear signal; exposure starts.
[0052] During the execution of step 100a, the operating method of the high dynamic range image sensor pixel circuit further includes step 100b.
[0053] Step 100b: inputting an anti-charge crosstalk control signal, and the release circuit 13 clears the charge in the photoelectric conversion element 11 according to the anti-charge crosstalk control signal;
[0054] The control voltage corresponding to the anti-charge crosstalk control signal is equal to the control voltage corresponding to releasing part of the charges generated by the photoelectric conversion element according to the weak shutdown signal.
[0055] Step 102: Input a control selection signal so that the charge storage transfer circuit 12 outputs the integrated charge signal according to the control selection signal to obtain an image signal.
[0056] In one example, from the first cycle to the nth cycle, the integration time length corresponding to each cycle gradually decreases or the integration time length corresponding to each cycle gradually increases;
[0057] Each cycle includes a charge output signal off phase and a charge output signal on phase in sequence; the integration time is the time duration of the charge output signal off phase of the cycle.
[0058] In a specific implementation, the ratio of the integration time lengths of adjacent cycles is between 1 / 2 and 9 / 10; or, the integration time lengths of each cycle are distributed in an arithmetic progression.
[0059] In one example, the charge output signal is a pulse modulation signal including n pulse periods, and the total duration of the charge output signal is T, where T is a positive number.
[0060] In a further example, the pulse duration of the pulse modulation signal is a; a is a positive number and a constant.
[0061] In a specific implementation, step 102 may include step A1 to step A2.
[0062] Step A1: input a control selection signal, and the charge storage transfer circuit 12 outputs an integrated charge signal according to the control selection signal;
[0063] Step A2: The charge readout circuit 14 outputs an electrical signal according to the integrated charge signal.
[0064] In a specific implementation, step A0 may be included before step A1.
[0065] Step A0: A reset control signal is input, and the charge readout circuit 14 outputs a reset signal according to the reset control signal.
[0066] In a specific implementation, during the execution of step 102, the working method of the high dynamic range image sensor pixel circuit further includes step 102b:
[0067] Step 102b: stop exposure, input a charge release signal, and the release circuit 13 clears the charge in the photoelectric conversion element 11 according to the charge release signal output; wherein, the input charge release signal is maintained during the process of outputting the integrated charge signal.
[0068] By clearing the charge in the photoelectric conversion element 11 before exposure and after stopping exposure, the accuracy of acquiring the image signal is improved.
[0069] In a specific implementation, a reset control signal, an anti-charge crosstalk control signal, a charge output signal, a control selection signal, and a charge release signal can be output by the control logic.
[0070] Figure 2 An exemplary circuit structure of a high dynamic range image sensor pixel circuit provided by an embodiment of the present invention is shown. For ease of description, only the part related to the embodiment of the present invention is shown, which is described in detail as follows:
[0071] The charge readout circuit 14 includes a reset transistor 104 , a source follower transistor 105 , and a pixel selection transistor 106 .
[0072] The source of the reset transistor 104 and the gate of the source follower transistor 105 are commonly connected to the input terminal of the charge readout circuit 14, and the input terminal of the charge readout circuit 14 serves as the input terminal of the integrated charge signal;
[0073] The gate of the reset transistor 104 is connected to the reset signal control line to serve as the reset control signal input terminal of the charge readout circuit 14; the drain of the reset transistor 104 is connected to the first power supply VDD, and the drain of the source follower transistor 105 is connected to the second power supply, and the first power supply VDD and the second power supply are the same or different power supplies; the source of the source follower transistor 105 is connected to the drain of the pixel selection transistor 106, and the source of the pixel selection transistor 106 is connected to the output terminal of the charge readout circuit 14, and the output terminal of the charge readout circuit 14 serves as the output terminal of the electrical signal.
[0074] The charge storage transfer circuit 12 includes a charge transfer transistor 102 , a charge storage device 108 , and a charge selection transistor 103 .
[0075] The source of the charge transfer transistor 102 is connected to the charge input terminal of the charge storage transfer circuit 12, the charge input terminal is connected to the output terminal of the photoelectric conversion element, the drain of the charge transfer transistor 102 is connected to the first terminal of the charge storage device 108 and the source of the charge selection transistor 103, the drain of the charge selection transistor 103 is connected to the integrated charge signal output terminal of the charge storage transfer circuit 12; the gate of the charge transfer transistor 102 is connected to the charge input signal control line as the charge output signal input terminal, and the gate of the charge selection transistor 103 is connected to the control selection signal control line as the control selection signal input terminal. The second terminal of the charge storage device 108 is connected to the first voltage, wherein the first voltage can be represented as the second terminal of the charge storage device 108 is grounded or connected to a specified voltage.
[0076] The release circuit 13 includes a charge release transistor 107. In one example, a weak shutdown signal is input to the charge release transistor 107 through a control line during the exposure phase, an anti-crosstalk control signal is input before exposure, and a charge release signal is output during the readout phase. The control voltage corresponding to the anti-crosstalk control signal is equal to the control voltage corresponding to the weak shutdown signal and is less than the control voltage corresponding to the charge release signal.
[0077] The photoelectric conversion element 11 includes but is not limited to a pinned photodiode, a polysilicon gate photodiode, and a current-assisted photodiode; the charge storage device includes but is not limited to a MOS transistor capacitor, a polysilicon gate-insulator-polysilicon gate capacitor, and a metal-insulator-metal capacitor.
[0078] The following is a combination of working principles Figure 2 As shown for further explanation:
[0079] The operation process of collecting a frame of photoelectric signals by the pixel circuit of a high dynamic range image sensor includes three stages: pixel reset stage, photoelectric charge signal collection stage and photoelectric signal output stage.
[0080] The pixel reset stage is the first stage in the operation of collecting photoelectric signals for a frame by the pixel circuit of the high dynamic range image sensor. The specific operation is to turn on the reset transistor 104, the charge transfer transistor 102 and the charge selection transistor 103, and set the charge release transistor 107 to a weak off state (input anti-crosstalk control signal), in order to clear the charge in the photodiode 101 and the charge storage device 108; after the charge in the photodiode 101 and the charge storage device 108 is cleared, the reset transistor 104, the charge transfer transistor 102 and the charge selection transistor 103 are turned off to enter the second stage of photoelectric charge signal collection.
[0081] In the second stage of photoelectric charge signal collection, the photodiode 101 receives the light signal and converts the light signal into a photoelectric charge signal, which is collected in the photodiode 101. The process of the photodiode 101 collecting charge is called an exposure cycle. During this exposure cycle, the charge transfer transistor 102 has multiple opening and closing actions. The period from the charge transfer transistor 102 closing to the next time the charge transfer transistor 102 is opened and closed is called the micro-exposure time (period t). During the exposure cycle, the micro-exposure time is gradually shortened, and a total of N micro-exposure times are N, where N is a natural number greater than 2, and the sum of N micro-exposure times is an exposure cycle (total time T); each opening and closing action of the charge transfer transistor 102 will transfer the photoelectric charge in the photodiode 101 to the charge storage device 108. This method is called charge modulation by the charge transfer transistor 102. After the photodiode 101 is exposed, it enters the third stage of photoelectric signal output.
[0082] In the third stage, the photoelectric signal output stage, the specific operation is to turn on the pixel selection transistor 106, and the reset transistor 104 is turned on to clear the charge in the parasitic capacitance of the floating diffusion active area FD, and then the high dynamic range image sensor pixel circuit outputs a reset signal; then, the charge selection transistor 103 is turned on to transfer the charge in the charge storage device 108 to the floating diffusion active area FD, and then the high dynamic range image sensor pixel circuit outputs a photoelectric signal. After the photoelectric signal is output, the operation of collecting one frame of the photoelectric signal is completed. The collected image signal is equal to the difference between the reset signal and the photoelectric signal.
[0083] In the second stage of photoelectric charge signal collection, the exposure cycle is divided into multiple micro-exposure steps. The charge saturation capacity of the photodiode 101 is lower than that of the photodiode in the related art, so the fully depleted potential of the photodiode 101 is lower, and it is not easy to produce image smearing problems, and the dark current will also be reduced. The charge transfer transistor 102 has a charge modulation function, which is to release part of the charge in the photodiode 101 irradiated by strong light to the positive pole of the power supply through the charge release transistor 107, while the charge in the photodiode 101 irradiated by weak light is completely collected. It can be seen that the photosensitivity of the pixel irradiated by strong light is suppressed, and the photosensitivity is reduced, while the photosensitivity and sensitivity of the pixel irradiated by weak light remain unchanged, so the photoelectric response of the photodiode 101 is a nonlinear mode, and this type of sensor is called a nonlinear image sensor. Therefore, the signal acquisition in the range of strong light illumination intensity can be effectively expanded, and the dynamic range of pixel photosensitivity is improved relative to the related art, and the risk of image smearing and dark current is reduced at the same time.
[0084] Schematic diagram of the specific timing working method of the high dynamic range image sensor pixel circuit to collect photoelectric signals, such as Figure 3 As shown, Figure 3 for Figure 2 The timing diagram corresponding to the high dynamic range image sensor pixel circuit shown in FIG. It can be understood that the timing diagram is an example, and those skilled in the art can make corresponding adjustments based on the common knowledge in the art to obtain other example timing diagrams.
[0085] Figure 3 In the figure, the operation flow of collecting a frame of photoelectric signals by the pixel circuit of the high dynamic range image sensor includes three stages: pixel reset stage 201, photoelectric charge signal collection stage 202 and photoelectric signal output stage 203. The high potential at the gate terminal of the transistor shown indicates that the transistor is in the on state, and the low potential at the gate terminal of the transistor shown indicates that the transistor is in the off state; the read timing is the signal operation timing for reading the pixel circuit in the photoelectric signal processing system module, and the high level indicates the signal output by the pixel circuit is read.
[0086] The pixel reset phase 201 is described as follows:
[0087] The pixel reset stage 201 is the first stage in the operation of collecting photoelectric signals for a frame by the pixel circuit of the high dynamic range image sensor. The specific operation is to set the gate Anti of the charge release transistor 107 to a second low potential, so that the charge release transistor 107 is in a weak off state; the gate SG of the charge storage device 108 and the gate RS of the pixel selection transistor 106 are respectively kept at a low potential; the gate RST of the reset transistor 104, the gate terminal TX of the charge transfer transistor 102 and the gate TXb of the charge selection transistor 103 are set to a high potential, the reset transistor 104, the charge transfer transistor 102 and the charge selection transistor 103 are turned on, and the charge in the photodiode 101 and the charge storage device 108 is cleared; after the clearing is completed, the gate RST of the reset transistor 104, the gate TX of the charge transfer transistor 102 and the gate terminal TXb of the charge selection transistor 103 are set to a low potential, and the charge transfer transistor 102, the charge selection transistor 103 and the reset transistor 104 are turned off. Subsequently, the gate terminal SG of the charge storage device 108 is set to a high potential, the pixel reset phase 201 ends, and the next phase of photoelectric charge signal collection begins.
[0088] The photoelectric charge signal collection stage 202 is described as follows:
[0089] The second stage is the photoelectric charge signal collection stage 202, in which the photodiode 101 receives the light signal, converts the light signal into charge, and collects it in the photodiode 101; the gate Anti of the charge release transistor 107 is kept in a second-low potential state (input a weak shutdown signal), the purpose of which is to keep the charge release transistor 107 in a weak shutdown state; the gate RST of the reset transistor 104, the gate TXb of the charge selection transistor 103 and the gate RS of the pixel selection transistor 106 are all kept in a low potential state.
[0090] The process of collecting charges by the photodiode 101 is called the exposure period T. The gate TX of the charge transfer transistor 102 inputs the charge output signal, which is a pulse modulation signal with a pulse duration a and a period t, and the total duration of the charge output signal is T; a, t and T are all positive numbers; that is, within this exposure period T, the charge transfer transistor 102 has multiple opening and closing actions, and the period from the closing of the charge transfer transistor 102 to the next opening and closing of the charge transfer transistor 102 is called the micro exposure duration t (the period t of the pulse modulation signal), and a total of N micro exposure durations (such as Figure 3As shown in t1, t2, ..., tN), N is a natural number greater than 2, and the sum of N micro-exposure durations is an exposure cycle T (the total duration of the charge output signal T), that is: t1+t2+...+tN=T. From the first cycle to the nth cycle, the integration duration corresponding to each cycle gradually decreases; wherein each cycle includes a charge output signal off stage and a charge output signal on stage in sequence; the integration duration is the duration of the charge output signal off stage of the cycle.
[0091] The duration of each high potential pulse of the charge transfer transistor 102 in the exposure period T can range from 0.05us to 0.5us. Each high potential pulse action of the charge transfer transistor 102 will transfer the charge in the photodiode 101 to the charge storage device 108. This method is called charge modulation by the charge transfer transistor 102. After the photodiode 101 is exposed, it enters the third stage of photoelectric signal output.
[0092] The photoelectric signal output stage 203 is described as follows:
[0093] In the third stage, the photoelectric signal output stage 203, the gate Anti of the charge release transistor 107 is set to a high potential to turn on the charge release transistor 107; the gate RS of the pixel selection transistor 106 is set to a high potential to turn on the pixel selection transistor 106; the gate RST of the reset transistor 104 is set to a high potential to clear the charge in the parasitic capacitance of the floating diffusion active area FD, wherein the floating diffusion active area FD is connected to the drain of the charge selection transistor 103, the source of the reset transistor 104 and the gate of the source follower transistor 105.
[0094] After the clearing is completed, the gate RST of the reset transistor 104 is set to a low potential, and then the pulse SHR in the read timing indicates that the pixel outputs the reset signal R; next, the gate terminal TXb of the charge selection transistor 103 is set to a high potential, followed by the gate SG of the charge storage device 108 being set to a high potential, and the charge in the charge storage device 108 is transferred to the floating diffusion active area FD. After the photoelectric charge transfer is completed, the gate TXb of the charge selection transistor 103 is set to a low potential, and then the pulse SHS in the read timing indicates that the pixel circuit of the high dynamic range image sensor outputs the photoelectric signal S. After the photoelectric signal S is output, the gate Anti of the charge release transistor 107 and the gate RS of the pixel selection transistor 106 are set to low potentials respectively, and the pixel acquisition of a frame of photoelectric signals is completed.
[0095] The image signal Sig collected by the pixel circuit of the high dynamic range image sensor is equal to the reset signal R minus the photoelectric signal S.
[0096] Figure 3In the modulation mode of the charge transfer transistor 102, the potential well schematic diagram of the high dynamic range image sensor pixel circuit under strong light irradiation is shown in FIG. Figure 4 As shown, it is a schematic diagram of the potential well when one of the N micro-exposure durations is about to end. Figure 1 The device portion within the calibrated dashed box 109 is shown.
[0097] Figure 4 , the power supply Vdd, the potential of the photodiode 101 and the potential of the SD region, and the potential states when the charge discharge transistor 107 and the charge transfer transistor 102 are turned off are respectively marked.
[0098] Wherein, Vtx_off is the channel potential when the charge transfer transistor 102 is turned off, Vanti_off is the channel potential when the charge release transistor 107 is in a weakly turned-off state, Vsd is the reset potential of the SD region (charge storage device), and Vdd is the potential of the positive electrode of the first power supply; Vanti_off is higher than Vtx_off, and the difference is greater than 0.1V, for example, it can be 0.2V or 0.5V. Too much charge is collected in the photodiode 101 irradiated by strong light, and the charge exceeding the preset potential of Vanti_off is released to the positive electrode Vdd of the first power supply. The stronger the light intensity, the more charge is released from the photodiode 101.
[0099] The potential well diagram of the photodiode 101 of the high dynamic range image sensor pixel circuit under weak light illumination is shown in FIG. Figure 5 As shown, it is a potential well schematic diagram when one of the N micro-exposure times is about to end. During the exposure period T, the photodiode 101 collects a small amount of charge. The small amount of photoelectric charge is not enough to make the potential well potential of the photodiode 101 lower than the preset potential Vanti_off. Therefore, no charge will be released to the positive electrode Vdd of the first power supply, and all the photoelectric charges are collected.
[0100] It can be seen that the high dynamic range image sensor pixel circuit of the present invention is a nonlinear photoelectric response type. In the present invention, different micro-exposure time periods have different exposure times, different collected photocharges, and different charges released to the positive electrode Vdd of the first power supply, forming a nonlinear response curve.
[0101] The photoelectric response curve diagram of the present invention and related technologies is as follows: Figure 6 shown. Figure 6 In the figure, Qmax is the maximum charge that can be detected by the floating diffusion active area FD of the pixel, Pmax1 is the maximum exposure that can be detected by the linear photoelectric response image sensor of the related art, and Pmax2 is the maximum exposure that can be detected by the nonlinear photoelectric response image sensor of the present invention.
[0102] In the 501 interval, the high dynamic range image sensor pixel circuit operates in a low light environment, the pixel exposure is low, and all photoelectric charges are collected;
[0103] In the 502 interval, the pixel circuit of the high dynamic range image sensor operates in a normal light intensity environment, and a small amount of charge is released during the pixel exposure process;
[0104] In the 503 interval, the high dynamic range image sensor pixel circuit operates in a high intensity lighting environment, the pixel exposure is high, and a large portion of the photoelectric charge is released.
[0105] Figure 6 As shown, the photoelectric response curve of the high dynamic range image sensor pixel circuit of the present invention is a nonlinear mode, which reduces the photoelectric response sensitivity of the pixel when it is illuminated by strong light, and improves the pixel's ability to perceive strong light information, thereby effectively improving the dynamic range of the image captured by the high dynamic range image sensor pixel circuit.
[0106] In the working method of the high dynamic range image sensor pixel circuit of the present invention, since the exposure period is divided into multiple micro-exposure time steps, the amount of charge generated in each micro-exposure time stage is small, and the charge saturation capacity of the photodiode 101 is lower than the charge saturation capacity of the photodiode 101 in the related art. Therefore, the complete depletion potential of the photodiode 101 is low, and it is not easy to produce image ghosting problems, that is, the charge in the photodiode is easy to be extracted, and the dark current will also be reduced.
[0107] The charge transfer transistor 102 has a charge modulation function, which is to release part of the charges in the photodiode 101 irradiated by strong light to the first positive power supply Vdd through the charge release transistor 107, while all the charges in the photodiode 101 irradiated by weak light are collected. It can be seen that the photosensitivity of the pixel irradiated by strong light is suppressed, and the photosensitivity is reduced, while the photosensitivity and sensitivity of the pixel irradiated by weak light remain unchanged.
[0108] The embodiment of the present invention receives a light signal through a photoelectric conversion element to generate a charge; the charge storage transfer circuit stores the charge according to the charge output signal to generate an integrated charge signal, and outputs the integrated charge signal according to the control selection signal; the charge output signal is a modulation signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different; the release circuit releases part of the charge generated by the photoelectric conversion element according to the weak shutdown signal at least in the process of the charge storage transfer circuit storing the charge to generate the integrated charge signal; the charge readout circuit outputs an electrical signal according to the integrated charge signal to obtain an image signal; since the charge in the photoelectric conversion element irradiated with strong light is partially released through the release circuit, and the charge in the photoelectric conversion element irradiated with weak light is completely collected, the photosensitivity of the pixel irradiated with strong light is suppressed, the photosensitivity sensitivity is reduced, and the photosensitivity and sensitivity of the pixel irradiated with weak light remain unchanged, thereby increasing the photosensitivity dynamic range of the pixel circuit of the high dynamic range image sensor. Moreover, from the first cycle to the nth cycle, the duration corresponding to each cycle is different, thereby improving the flexibility of adjusting the photosensitivity dynamic range.
[0109] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0110] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A high dynamic range image sensor pixel circuit, characterized in that: include: A photoelectric conversion element configured to receive a light signal to generate an electric charge; a charge storage transfer circuit, connected to the photoelectric conversion element, configured to store the charge to generate an integrated charge signal, and output the integrated charge signal according to a control selection signal; The charge storage transfer circuit stores the charge according to the charge output signal to generate the integrated charge signal, the charge output signal is a modulation signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different; a release circuit connected to the photoelectric conversion element and the input end of the charge storage transfer circuit, and configured to release part of the charge generated by the photoelectric conversion element according to a weak shutdown signal at least during the process in which the charge storage transfer circuit stores the charge to generate the integrated charge signal; The charge readout circuit is connected to the output end of the charge storage transfer circuit and is configured to output an electrical signal according to the integrated charge signal to obtain an image signal.
2. The high dynamic range image sensor pixel circuit according to claim 1, wherein: From the first cycle to the nth cycle, the integration time length corresponding to each cycle gradually decreases or the integration time length corresponding to each cycle gradually increases; Each of the cycles includes a charge output signal off phase and a charge output signal on phase in sequence; the integration time is the time duration of the charge output signal off phase of the cycle.
3. The high dynamic range image sensor pixel circuit according to claim 2, wherein: The ratio of the integration time lengths of adjacent cycles is between 1 / 2 and 9 / 10; or, the integration time lengths of each cycle are distributed in an arithmetic progression.
4. The high dynamic range image sensor pixel circuit according to claim 1, wherein: The charge output signal is a pulse modulation signal including n pulse cycles, the total duration of the charge output signal is T, T is a positive number, and the pulse duration of the pulse modulation signal is a; a is a positive number and a constant.
5. The high dynamic range image sensor pixel circuit according to claim 1, wherein: The number n of the cycles of the charge output signal is between 4 and 10.
6. The high dynamic range image sensor pixel circuit according to claim 1, wherein: The charge readout circuit is further configured to clear at least the charge in the photoelectric conversion element according to a clear signal.
7. The high dynamic range image sensor pixel circuit according to claim 6, wherein: When the charge readout circuit clears at least the charge in the photoelectric conversion element, the release circuit is further configured to transfer the charge in the photoelectric conversion element according to the anti-charge crosstalk control signal; The control voltage corresponding to the anti-charge crosstalk control signal is equal to the control voltage corresponding to releasing part of the charges generated by the photoelectric conversion element according to the weak shutdown signal.
8. The high dynamic range image sensor pixel circuit according to claim 1, wherein: The charge readout circuit includes a reset transistor, a source follower transistor and a pixel selection transistor; The source of the reset transistor and the gate of the source follower transistor are commonly connected to the charge readout circuit input terminal, and the charge readout circuit input terminal serves as the integrated charge signal input terminal; The gate of the reset transistor is connected to a reset signal control line to serve as a reset control signal input terminal of the charge readout circuit; The drain of the reset transistor is connected to a first power supply, the drain of the source follower transistor is connected to a second power supply, and the first power supply and the second power supply are the same or different power supplies; The source of the source follower transistor is connected to the drain of the pixel selection transistor, the source of the pixel selection transistor is connected to the output end of the charge readout circuit, and the output end of the charge readout circuit serves as the output end of the electrical signal.
9. The high dynamic range image sensor pixel circuit according to any one of claims 1 to 8, characterized in that: The charge storage transfer circuit includes a charge transfer transistor, a charge storage device and a charge selection transistor; The source of the charge transfer transistor is connected to the charge input terminal of the charge storage transfer circuit, the charge input terminal is connected to the output terminal of the photoelectric conversion element, the drain of the charge transfer transistor is connected to the first terminal of the charge storage device and the source of the charge selection transistor, and the drain of the charge selection transistor is connected to the integrated charge signal output terminal of the charge storage transfer circuit; The gate of the charge transfer transistor is connected to the charge input signal control line to serve as a charge output signal input terminal, and the gate of the charge selection transistor is connected to the control selection signal control line to serve as a control selection signal input terminal; The second terminal of the charge storage device is connected to a first voltage.
10. The high dynamic range image sensor pixel circuit according to claim 9, wherein: The release circuit comprises an anti-charge crosstalk transistor, the source of the anti-charge crosstalk transistor is connected to the output end of the photoelectric conversion element, the drain of the anti-charge crosstalk transistor is connected to the control power supply, and the gate of the anti-charge crosstalk transistor is connected to the anti-charge crosstalk transistor control line; Wherein, based on the anti-charge crosstalk transistor control line, the channel potential of the anti-charge crosstalk transistor is controlled to be greater than the channel potential when the charge transfer transistor is turned off, so as to release the partial charge.
11. A method for operating a high dynamic range image sensor pixel circuit according to any one of claims 1 to 10, characterized in that: include: During the exposure process, the charge output signal is input, and the charge storage conversion circuit stores the charge according to the charge output signal to generate an integrated charge signal; In the process of inputting the charge output signal, inputting the weak shutdown signal so that the release circuit releases part of the charge generated by the photoelectric conversion element according to the weak shutdown signal at least in the process of the charge storage transfer circuit storing the charge to generate the integrated charge signal; Wherein, the charge output signal is a modulation signal including n cycles, and from the first cycle to the nth cycle, the duration corresponding to each cycle is different; A control selection signal is input to enable the charge storage transfer circuit to output the integrated charge signal according to the control selection signal to obtain an image signal.
12. The operating method of the high dynamic range image sensor pixel circuit as claimed in claim 11, characterized in that: Before the charge storage conversion circuit stores the charge to generate the integrated charge signal, the charge storage conversion circuit also includes: Before starting exposure, a clear signal is input, and the charge readout circuit clears the charge in the photoelectric conversion element according to the clear signal; when the clear signal is stopped, exposure starts.
13. The operating method of the high dynamic range image sensor pixel circuit as claimed in claim 12, characterized in that: During the input of the clear signal, an anti-charge crosstalk control signal is input, and the release circuit clears the charge in the photoelectric conversion element according to the anti-charge crosstalk control signal; The control voltage corresponding to the anti-charge crosstalk control signal is equal to the control voltage corresponding to releasing part of the charges generated by the photoelectric conversion element according to the weak shutdown signal.
14. The operating method of the high dynamic range image sensor pixel circuit as claimed in claim 11, characterized in that: The input control selection signal enables the charge storage transfer circuit to output the integrated charge signal, and before the integrated charge signal is output and after the exposure is completed, the method further includes: Exposure is stopped, a charge release signal is input, and the release circuit clears the charge in the photoelectric conversion element according to the charge release signal; wherein the charge release signal is kept input during the process of outputting the integrated charge signal.
15. The operating method of the high dynamic range image sensor pixel circuit according to claim 11, characterized in that: The method of inputting the control selection signal to obtain the image signal includes: A control selection signal is input, and the charge storage transfer circuit outputs the integrated charge signal according to the control selection signal; The charge readout circuit outputs an electrical signal based on the integrated charge signal.
16. The operating method of a high dynamic range image sensor pixel circuit according to any one of claims 11 to 15, characterized in that: Before the charge storage transfer circuit outputs the integrated charge signal and after generating the integrated charge signal, the method further includes: A reset control signal is input, and the charge readout circuit outputs a reset signal according to the reset control signal.
