Circuits, methods and equipment for adjusting signal transmission frequency

By dynamically adjusting the threshold electrical signal in the pixel array to control the signal emission frequency, the problem of low image dynamic range and resource waste caused by fixed pixel unit thresholds in the prior art is solved, and flexible signal emission frequency adjustment and resource saving are achieved.

CN116132603BActive Publication Date: 2026-04-03SPIKE VISION (BEIJING) TECHNOLOGY CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-14
Publication Date
2026-04-03

AI Technical Summary

Technical Problem

The fixed threshold of pixel units in existing pulse sequence image sensors results in low image dynamic range, and pixel units with different light intensities suffer from serious resource waste during imaging.

Method used

By statistically analyzing the light intensity information of pixel units in the pixel array, the threshold electrical signal is dynamically adjusted to control the signal emission frequency, thus flexibly adjusting the signal emission frequency of pixel units.

Benefits of technology

It increases the imaging dynamic range of the image sensor, saves resources, and improves the flexibility of the signal transmission frequency of the pixel array.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116132603B_ABST
    Figure CN116132603B_ABST
Patent Text Reader

Abstract

This application discloses a circuit, method, and device for adjusting the signal emission frequency. For each pixel unit in a pixel array, information reflecting the light intensity of the pixel unit is statistically obtained. Based on a preset threshold electrical signal generation strategy, a threshold electrical signal for the pixel unit corresponding to the information reflecting the light intensity is determined. The emission frequency of subsequent signals from the pixel unit is controlled based on the corresponding threshold electrical signal. This application improves the sensitivity of the signal emission frequency of pixel units in a pixel array, increasing the imaging dynamic range of the image sensor.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of image sensor imaging, and in particular to a circuit, a method for adjusting the transmission frequency, and an electronic device with an adjustable signal transmission frequency. Background Technology

[0002] Image sensors have always been a research hotspot, and biomimetic pulse sequence image sensors, as neuromorphic vision sensors, possess the characteristics of high frame rate and low data throughput, meeting the requirements for high-speed imaging. Pulse sequence image sensors, mimicking the imaging method of the retina in primates, record continuous light intensity information in a scene by firing high-density pulse sequences. This enables the capture and recording of high-speed motion and the reconstruction of texture details within the scene, thus holding significant application value in machine vision and dynamic scene capture. Summary of the Invention

[0003] This application provides a circuit and electronic device with adjustable signal emission frequency, which can adjust the signal emission frequency of the corresponding pixel unit based on the light intensity of different pixel units in the pixel array of the image sensor, thereby increasing the imaging dynamic range of the image sensor.

[0004] This application also provides a signal emission frequency adjustment method, which can adjust the signal emission frequency of the corresponding pixel unit based on the light intensity of different pixel units in the pixel array of the image sensor, thereby increasing the imaging dynamic range of the image sensor.

[0005] In one embodiment of this application, a circuit with an adjustable signal emission frequency is provided, comprising: a comparator 202, a threshold electrical signal generation sub-circuit 203, and a signal processing sub-circuit 204, wherein...

[0006] The comparator 202 receives the electrical signal of the first pixel unit, obtains the threshold electrical signal of the first pixel unit from the threshold electrical signal generation sub-circuit 203, and generates a signal and sends it to the signal processing sub-circuit 204 when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit.

[0007] The signal processing sub-circuit 204 counts the signal information of the first pixel unit within a predetermined time, generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time, sends the signal to the threshold electrical signal generation sub-circuit 203, and outputs the signal.

[0008] The threshold electrical signal generation sub-circuit 203 obtains the threshold electrical signal of the first pixel unit according to the threshold control signal and sends it to the comparator 202.

[0009] In the above circuit, the signal includes: a pulse signal, or a level signal, or a value with a limit;

[0010] The signal processing sub-circuit includes a pulse signal processing sub-circuit, or a level signal processing sub-circuit, or a numerical processing sub-circuit with defined parameters.

[0011] In the circuit described above, the comparator 202 is further configured to generate a reset signal and send it to the first pixel unit when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit.

[0012] The circuit described above also includes: a pixel array 201 composed of multiple pixel units arranged in at least one row, a read row selector 206, a reset row selector 207, and an output signal sub-circuit 205;

[0013] The first pixel unit in the pixel array 201 converts the optical signal into an electrical signal, receives a row readout signal from the readout row selector 206, and sends the electrical signal to the comparator 202; according to the reset signal sent by the comparator 202, it selects its own first reset switch, receives a row reset signal from the reset row selector 207, selects its own second reset switch, and performs a reset.

[0014] The output signal sub-circuit 205 is used to receive the signal from the signal processing sub-circuit 204 and output it.

[0015] The circuit described above also includes a column-level readout feedback sub-circuit 208, wherein the comparator 202 is disposed in the column-level readout feedback sub-circuit 208;

[0016] The reset signal is a column reset signal;

[0017] The column-level readout feedback sub-circuit 208 is connected to at least one column of pixel units in the pixel array 201, receives the electrical signal transmitted by the first pixel unit, and when the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates the column reset signal and the signal, sends the column reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit 203.

[0018] In the above circuit, the threshold electrical signal generation sub-circuit 203 is disposed inside or outside the column-level readout feedback sub-circuit 208. Specifically, when the threshold electrical signal generation sub-circuit 203 is disposed inside the column-level readout feedback sub-circuit 208...

[0019] The threshold electrical signal generation sub-circuit 203 in the column-level readout feedback sub-circuit 208 obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal, and sends it to the comparator 202 in the column-level readout feedback sub-circuit 208.

[0020] In the above circuit, the signal processing sub-circuit 204 is disposed in the board-level circuit where the column-level readout feedback sub-circuit 208 is located, and is located inside or outside the column-level readout feedback sub-circuit 208.

[0021] The circuit described above also includes: a region readout feedback sub-circuit 209, wherein the comparator 202 is disposed in the region readout feedback sub-circuit 209;

[0022] The region readout feedback sub-circuit 209 is connected to the pixel unit in the set region of the pixel array 201, receives the electrical signal transmitted by the first pixel unit in the set region, and when the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates the reset signal and the signal, sends the reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit 204.

[0023] In the above circuit, the threshold electrical signal generation sub-circuit 203 is disposed inside or outside the region readout feedback sub-circuit 209. Specifically, when the threshold electrical signal generation sub-circuit 203 is disposed inside the region readout feedback sub-circuit 209...

[0024] The threshold electrical signal generation sub-circuit 203 in the region readout feedback sub-circuit 209 obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal, and sends it to the comparator 202 in the region readout feedback sub-circuit 209.

[0025] In the above circuit, the signal processing sub-circuit 204 is disposed in the board-level circuit where the area readout feedback sub-circuit 209 is located, and is located inside or outside the area readout feedback sub-circuit 209.

[0026] In the circuit described above, the comparator 202 is disposed inside the first pixel unit, wherein,

[0027] When the comparator 202 in the first pixel unit determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates a reset signal and a signal. The reset signal is used to select the first reset switch of the first pixel unit for reset. The comparator 202 in the first pixel unit sends the signal to the signal processing sub-circuit 204.

[0028] In the above circuit, the threshold electrical signal generating sub-circuit 203 is disposed inside the first pixel unit or outside the pixel array 201.

[0029] Wherein, the threshold electrical signal generation sub-circuit 203 is disposed inside the first pixel unit,

[0030] The threshold electrical signal generation sub-circuit 203 in the first pixel unit obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal, and sends it to the comparator 202 in the first pixel unit;

[0031] The circuit further includes: a threshold control signal selector 210, which sends a selection signal of the threshold control signal to the first pixel unit, and selects a third switch in the first pixel unit for receiving the threshold control signal, so that the threshold electrical signal generating sub-circuit 203 in the first pixel unit receives the threshold control signal.

[0032] In the above circuit, the signal processing sub-circuit 204 is disposed outside the pixel array 201, and is configured as at least one. Each signal processing sub-circuit 204 is connected to at least one column of pixel units or at least one set area of ​​pixel units in the pixel array 201, and generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit, and sends it to the threshold electrical signal generating sub-circuit 203.

[0033] In the above circuit, the threshold electrical signal generation sub-circuit 203 includes: a digital-to-analog converter (DAC) or a multiplexer;

[0034] The DAC includes at least one input terminal and one output terminal, wherein each input terminal stores a threshold electrical signal. Under the control of the threshold control signal, the DAC selects one of the input terminals and outputs the threshold electrical signal stored in the input terminal to the comparator 202 through the output terminal.

[0035] The multiplexer includes at least one input terminal, one output terminal, and one control terminal. Each input terminal stores a threshold electrical signal. When the control terminal of the multiplexer receives the threshold control signal, it selects the corresponding input terminal and sends the threshold electrical signal stored in the corresponding input terminal to the comparator 202 through the output terminal.

[0036] In the above circuit, the information of the signal of the first pixel unit includes: the number of signals of the first pixel unit accumulated within the predetermined time; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the number of signals of the first pixel unit according to the preset correspondence between the number of signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0037] Alternatively, the information of the signal of the first pixel unit includes: the average interval between the signals of the first pixel unit accumulated within the predetermined time period; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the average interval between the signals of the first pixel unit according to the preset correspondence between the average interval between the signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0038] Alternatively, the signal of the first pixel unit includes: the minimum interval between the signals of the first pixel unit accumulated within the predetermined time period; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the minimum interval between the signals of the first pixel unit according to the preset correspondence between the minimum interval between the signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0039] In the above circuit, the information of the signal of the first pixel unit includes: the number of signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further used to determine whether the number of signals of the first pixel unit exceeds a set number threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset number of signals of the first pixel unit and the number threshold, and the adjustment level. A threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained based on the threshold electrical signal of the corresponding first pixel unit.

[0040] Alternatively, the information of the signal of the first pixel unit includes: the average interval between the signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further configured to determine whether the average interval between the signals of the first pixel unit exceeds a set average interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the average interval between the signals of the first pixel unit and the average interval threshold and the adjustment level. A threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained based on the threshold electrical signal of the corresponding first pixel unit.

[0041] Alternatively, the signal of the first pixel unit includes: the minimum interval between the signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further configured to determine whether the minimum interval between the signals of the first pixel unit exceeds a set minimum interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the minimum interval between the signals of the first pixel unit and the minimum interval threshold, and the adjustment level. A threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained based on the threshold electrical signal of the corresponding first pixel unit.

[0042] In another embodiment of this application, a pixel unit array circuit includes: a pixel unit array 201 composed of pixel units arranged in at least one row in a row-column manner, wherein the first pixel unit in the pixel unit array 201 includes: a comparator 202 and a threshold electrical signal generation sub-circuit 203, wherein...

[0043] When the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, the first pixel unit generates a reset signal and a signal. The reset signal is used to select its own first reset switch for reset. The comparator 202 sends the signal to the signal processing sub-circuit 204.

[0044] The threshold electrical signal generation sub-circuit 203 in the first pixel unit obtains the threshold electrical signal of the first pixel unit based on the threshold control signal received from the signal processing sub-circuit 204, and sends it to the comparator 202. The threshold control signal is generated by the signal processing sub-circuit 204 based on the information of the signal of the first pixel unit statistically analyzed within a predetermined time, and on the set threshold electrical signal generation strategy and the information of the signal of the first pixel unit obtained within the predetermined time. The threshold control signal is used to select the threshold control signal of the first pixel unit.

[0045] In another embodiment of this application, a method for adjusting a signal transmission frequency includes:

[0046] A. The first pixel unit in the selected passing pixel unit of the pixel array of the circuit converts the light signal into an electrical signal;

[0047] B. When it is determined that the electrical signal of the first pixel unit is greater than the threshold electrical signal of the first pixel unit, a signal is generated. The threshold electrical signal of the first pixel unit is generated by statistically analyzing the signal information of the first pixel unit within a predetermined time, based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time.

[0048] C. Output the signal and return to step A to continue execution.

[0049] In another embodiment of this application, an electronic device for image sensor imaging includes: a signal emission frequency adjustable circuit as described in any of the above claims, and / or a pixel unit array circuit as described above, and / or a chip having the pixel unit array circuit as described above.

[0050] Among the aforementioned electronic devices, the electronic device includes at least one of the following: camera, webcam, audio / video player, navigation device, fixed-location terminal, entertainment device, smartphone, communication device, mobile device, vehicle or facility, industrial equipment, medical device, security device, flight equipment, and home appliance.

[0051] This invention provides a circuit with an adjustable signal emission frequency, comprising: a comparator, a threshold electrical signal generation sub-circuit, and a signal processing sub-circuit. The comparator receives an electrical signal from a first pixel unit, obtains a threshold electrical signal of the first pixel unit from the threshold electrical signal generation sub-circuit, and when it determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit, generates a signal and sends it to the signal processing sub-circuit. The signal processing sub-circuit statistically analyzes the signal information of the first pixel unit within a predetermined time, generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit based on a set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time, sends the signal to the threshold electrical signal generation sub-circuit, and outputs the signal. The threshold electrical signal generation sub-circuit obtains the threshold electrical signal of the first pixel unit according to the threshold control signal and sends it to the comparator. In this embodiment, for pixel units in a pixel array, information reflecting the light intensity of the pixel unit is statistically obtained within a predetermined time; based on a preset threshold electrical signal generation strategy and the signal information statistically obtained within the predetermined time, the emission frequency of subsequent signals of the pixel unit is controlled according to the threshold electrical signal of the corresponding pixel unit. In this way, the emission frequency provided by the pixel units in the pixel array that receive different light intensities is different when they emit signals, which improves the flexibility of the signal emission frequency of the pixel units in the pixel array, saves image sensor resources, and increases the dynamic range of image sensor imaging. Attached Figure Description

[0052] Figure 1 This is a schematic diagram of the pixel unit structure in the pixel array provided in the embodiments of this application;

[0053] Figure 2a A schematic diagram of the overall structure of a circuit with adjustable signal transmission frequency provided in an embodiment of this application;

[0054] Figure 2b A schematic diagram of a circuit structure with adjustable signal transmission frequency provided in an embodiment of this application;

[0055] Figure 3 A schematic diagram of the modularity and signal flow of the first circuit structure provided in the embodiments of this application;

[0056] Figure 4A schematic diagram of the column-level readout feedback sub-circuit when using the first circuit structure is provided in the embodiments of this application;

[0057] Figure 4a This is a schematic diagram illustrating the specific implementation structure of the column-level readout feedback sub-circuit provided in the embodiments of this application;

[0058] Figure 4b This is a schematic diagram of the multiplexer structure for implementing the threshold electrical signal generation sub-circuit in an embodiment of this application;

[0059] Figure 5 A schematic diagram of a circuit structure with adjustable signal transmission frequency provided in an embodiment of this application;

[0060] Figure 6a Three schematic diagrams of a circuit structure with adjustable signal transmission frequency provided in an embodiment of this application;

[0061] Figure 6b This is a schematic diagram of the pixel array circuit structure in the second circuit structure provided in the embodiments of this application;

[0062] Figure 7 A flowchart illustrating a method for adjusting the signal transmission frequency provided in an embodiment of this application;

[0063] Figure 8 This application provides a schematic diagram of a specific example of a signal circuit structure.

[0064] Figure 9 A flowchart illustrating a method for adjusting signal transmission frequency based on a first circuit structure, provided in an embodiment of this application;

[0065] Figure 10 Timing diagrams of various signals involved in a specific example of a method for adjusting the signal transmission frequency based on a first circuit structure provided in the embodiments of this application;

[0066] Figure 11 A flowchart illustrating the method for determining the threshold electrical signal of a corresponding pixel unit in a method for adjusting the signal emission frequency based on a first circuit structure provided in an embodiment of this application;

[0067] Figure 12 This is a schematic diagram of the structure of a pulse camera provided in an embodiment of this application. Detailed Implementation

[0068] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0069] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0070] The technical solution of this application will be described in detail below with reference to specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0071] In one embodiment of the present invention, the imaging array circuit in the pulse sequence image sensor is composed of multiple single-pixel units arranged in an array; the imaging array can also be called a pixel array. The circuit structure of each pixel unit in the pixel array is as follows: Figure 1 As shown, Figure 1 This is a schematic diagram of the pixel unit circuit in the pixel array circuit of a pulse sequence image sensor, including: a photodiode, a reset transistor, a comparator, a self-reset unit, and a readout circuit. Under illumination, the photodiode integrates to generate a photocurrent I. D Photogenerated charge Q is generated. D When the photogenerated charge Q D The comparator determines that the threshold Q has been reached. ref When the self-reset unit resets the photodiode via the reset transistor and restarts integration, it simultaneously generates a pulse signal 1, which is transmitted through the readout circuit when the readout signal arrives. Since the clock period for the readout signal is one frame period, no pulse signal 1 is generated within one frame period. Therefore, when the readout signal arrives, pulse signal 0 is output.

[0072] from Figure 1 As can be seen, the timing of pulse signal emission for each pixel unit is determined by the comparator based on a threshold Q.ref The pulse signal firing frequency for each pixel unit is determined by a comparator in each pixel unit based on a threshold Q. ref It is certain. However, for each pixel unit in the pixel array, its threshold Q... ref It is preset and cannot be adjusted, and the threshold Q is set for each pixel unit in the pixel array. ref Setting all values ​​to the same value will cause the threshold Q of the pulse signal to remain constant regardless of the current light intensity of the pixel unit. ref All are pre-defined and identical. However, for the entire pixel array, the light intensity received by different areas during image recording is not the same, resulting in varying brightness levels; different pixel units correspond to different light intensities. If a uniform threshold Q is used... ref As a criterion for determining whether a pulse signal is generated, pixels with weak received light intensity require a long accumulation period to generate a pulse signal for imaging, resulting in a low dynamic range. Pixels with stronger received light intensity, however, utilize a fixed threshold Q. ref Furthermore, an excessively large photocurrent I leads to an excessively small sampling interval, which in turn results in the over-firing of pulse signals and excessive consumption of the pulse sequence image sensor's resources.

[0073] To address the aforementioned issues, the circuit provided in this embodiment of the invention statistically obtains information about the signal that reflects the current light intensity received by the pixel unit within a predetermined time period for each corresponding pixel unit in the pixel array; determines a threshold electrical signal reflecting the current light intensity information of the pixel unit based on a preset threshold electrical signal generation strategy and the signal information of the pixel unit obtained within the predetermined time period; and controls the frequency of subsequent signal emission by the pixel unit based on the threshold electrical signal of the pixel unit.

[0074] In this way, by selecting the threshold electrical signal used to control the signal generation frequency of the corresponding pixel unit, the emission frequency provided is different. This makes the emission frequency of the signal of the pixel unit with strong light intensity decrease, and the emission frequency of the signal of the pixel unit with weak light intensity increase. This allows for flexible control of the signal emission frequency of the pixel units in the pixel array, increasing the imaging dynamic range of the image sensor and saving image sensor resources.

[0075] The signals described in this application embodiment are digital or analog signals carrying physical quantities that can characterize photocurrent. For example, they can be pulse signals, level signals, or numerical values ​​with limits, etc., and are not limited here. Correspondingly, the signals reflecting the light intensity currently received by the pixel unit include: pulse signals, level signals, or numerical values ​​with limits, etc., and are not limited here.

[0076] Figure 2a The schematic diagram of the overall structure of the circuit with adjustable signal transmission frequency provided in the embodiments of this application is shown in the figure. It includes: a comparator 202, a threshold electrical signal generation sub-circuit 203, and a signal processing sub-circuit 204, wherein...

[0077] The comparator 202 receives the electrical signal sent by the first pixel unit in the pixel array 201, obtains the threshold electrical signal of the first pixel unit from the threshold electrical signal generation sub-circuit 203, and when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit, generates a signal and sends it to the signal processing sub-circuit 204.

[0078] The signal processing sub-circuit 204 counts the signal information of the first pixel unit within a predetermined time, generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time, sends the signal to the threshold electrical signal generation sub-circuit 203, and outputs the signal.

[0079] The threshold electrical signal generation sub-circuit 203 obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal and sends it to the comparator 202.

[0080] In the circuit described above, the signal includes: a pulse signal, a level signal, or a value with a limit.

[0081] The signal processing sub-circuit includes a pulse signal processing sub-circuit, or a level signal processing sub-circuit, or a numerical processing sub-circuit with defined parameters.

[0082] In terms of specific implementation, a pulse signal will be used as an example for detailed explanation.

[0083] In the above circuit, the comparator 202 can be a comparison module or a comparison unit, the signal processing sub-circuit 204 can be a signal processing module or a signal processing unit, and the threshold electrical signal generation sub-circuit 203 can be a threshold electrical signal generation module or a threshold electrical signal generation unit, etc., without limitation. The above description uses the comparator 202, the signal processing sub-circuit 204, and the threshold electrical signal generation sub-circuit 203 as examples.

[0084] In the above circuit, the signal information of the first pixel unit obtained by the signal processing sub-circuit 204 can be the number of signals accumulated within a preset time period, the average interval between signals, or the minimum interval between signals, all of which can reflect the current light intensity of the first pixel unit.

[0085] In the circuit described above, the comparator 202 is further configured to generate a reset signal and send it to the first pixel unit when it determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit. This allows the first pixel unit to be reset.

[0086] In the circuit described above, the timing of the signal output from the pixel units in the pixel array 201 is controlled based on a reset signal, so the circuit also includes a pixel array 201 for imaging. Specifically, the circuit further includes: a pixel array 201 composed of multiple pixel units arranged in at least one row, a readout row selector 206, a reset row selector 207, and an output signal sub-circuit 205; the first pixel unit in the pixel array 201 converts the optical signal into an electrical signal, receives a row readout signal from the readout row selector 206, and sends the electrical signal to the comparator 202; according to the reset signal sent by the comparator 202, it selects its own first reset switch, receives a row reset signal from the reset row selector 207, selects its own second reset switch, and performs a reset; the output signal sub-circuit 205 is used to receive the signal from the signal processing sub-circuit 204 and output it.

[0087] Here, the output signal sub-circuit 205 includes an output pulse signal sub-circuit, or an output level signal sub-circuit, or an output sub-circuit with a defined value. There are no limitations here.

[0088] The circuit described above further includes other units for selecting and controlling the pixel units in the pixel array 201, and units for outputting signals, namely, a read row selector 206, a reset row selector 207, and an output signal sub-circuit 205. Specifically, the read row selector 206 transmits a row read signal to the pixel unit of the corresponding row in the pixel array 201 to select a row of pixel units in the pixel array 201; the reset row selector 207 sends a row reset signal to the pixel unit of the row to select the second reset switch of the first pixel unit in the selected row; and the output signal sub-circuit 205 receives the signal from the signal processing sub-circuit 204 and outputs it.

[0089] In the circuit described above, the pixel array 201 consists of multiple pixel units arranged in a row and column manner, which can be m*n pixel units, that is, m rows and n columns of pixel units, where m and n represent natural numbers.

[0090] In the circuit described above, the pixel array 201 is implemented by a chip circuit, and the read row selector 206, the reset row selector 207, and the output signal sub-circuit 205 are implemented by board-level circuits, such as FPGAs, outside the chip circuit.

[0091] In specific implementations, based on the different positions of the comparator 202, the threshold electrical signal generation sub-circuit 203, and the signal processing sub-circuit 204 in the circuit, there are three different circuit structures.

[0092] In the first circuit structure, comparators 202 for at least one different pixel unit in the same column of the pixel array are integrated into a column-level readout feedback sub-circuit 208. The column-level readout feedback sub-circuit 208 is located in a board-level circuit, and a threshold electrical signal generation sub-circuit 203 and a signal processing sub-circuit 204 are implemented in the board-level circuit. Specifically, the threshold electrical signal generation sub-circuit 203 can be integrated inside or outside the column-level readout feedback sub-circuit 208, and the signal processing sub-circuit 204 is located outside the column-level readout feedback sub-circuit 208.

[0093] Here, the column-level readout feedback sub-circuit 208 can be a column-level readout feedback unit or a column-level readout feedback module, and there is no limitation on this. This application embodiment uses the column-level readout feedback sub-circuit 208 as an example for detailed description.

[0094] The second circuit structure divides the pixel array into different regions and sets up a region readout feedback sub-circuit 209 for each region. Comparators 202 for different pixel units within a region are integrated into the region readout feedback sub-circuit 209 of that region. At least one of the region readout feedback sub-circuits 209 is disposed in a board-level circuit, and a threshold electrical signal generation sub-circuit 203 and a signal processing sub-circuit 204 are implemented in the board-level circuit. Specifically, the threshold electrical signal generation sub-circuit 203 can be integrated inside the region readout feedback sub-circuit 209 or located outside the region readout feedback sub-circuit 209, and the signal processing sub-circuit 204 is located outside the region readout feedback sub-circuit 209.

[0095] Here, the area readout feedback sub-circuit 209 can be an area readout feedback unit or an area readout feedback module, and there is no limitation thereto. This application embodiment uses the area readout feedback sub-circuit 209 as an example for detailed description.

[0096] In the third circuit structure, the comparator 202 is integrated inside each pixel unit in the pixel array 201, the threshold electrical signal generation sub-circuit 203 is inside each pixel unit in each array pixel 201 or implemented in the board-level circuit, and the signal processing sub-circuit 204 is implemented in the board-level circuit.

[0097] In the circuit described above, the threshold electrical signal generated by the threshold electrical signal generation sub-circuit 203 is specifically a threshold voltage signal for the first pixel unit. In this case, the comparator 202 compares the magnitude of the voltage signal of the first pixel unit with the threshold voltage signal.

[0098] The following provides a detailed explanation of these three circuit structures.

[0099] First circuit structure

[0100] In the above general description of the circuit structure, the first circuit structure is used as an example for illustration and description. Specifically, the first circuit structure is as follows: Figure 2b As shown, it includes: a pixel array 201, a column-level readout feedback sub-circuit 208, a threshold electrical signal generation sub-circuit 203, a signal processing sub-circuit 204, and an output signal sub-circuit 205, wherein the threshold electrical signal generation sub-circuit 203 is disposed in the column-level readout feedback sub-circuit 208.

[0101] The pixel array 201 is composed of multiple pixel units arranged in at least one row. The first pixel unit in the row is selected to convert the optical signal into an electrical signal and send it to the column-level readout feedback sub-circuit 208. According to the column reset signal sent by the column-level readout feedback sub-circuit 208, the first reset switch of the unit is turned on, and the unit is reset when its second reset switch is turned on.

[0102] The column-level readout feedback sub-circuit 208 is connected to at least one column of pixel units in the pixel array 201, receives the electrical signal transmitted by the first pixel unit, and when the comparator 202 therein determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates the column reset signal and the signal, sends the column reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit 203;

[0103] The signal processing sub-circuit 204 is connected to the column-level readout feedback sub-circuit 208. It collects information about the signal of the first pixel unit within a predetermined time. Based on the set threshold electrical signal generation strategy and the information about the signal of the first pixel unit obtained within the predetermined time, it generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit. The signal is fed back to the threshold electrical signal generation sub-circuit 203 in the column-level readout feedback sub-circuit 208. The signal of the first pixel unit is output through the output signal sub-circuit 205.

[0104] In the first circuit structure, since the column-level readout feedback sub-circuit 208 controls the reset of at least one column of pixel units, the reset signal sent to the first pixel unit is called the column reset signal.

[0105] In the first circuit structure, the comparator 202 is disposed in the column-level readout feedback sub-circuit 208; when the column-level readout feedback sub-circuit 208 performs the above function, it includes: when the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit, generating a column reset signal and a signal, sending the column reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sending the signal to the signal processing sub-circuit 204.

[0106] Here, the threshold electrical signal generation sub-circuit 203 is located inside or outside the column-level readout feedback sub-circuit 208. The threshold electrical signal generation sub-circuit 203 includes a digital-to-analog converter (DAC) or a multiplexer. The threshold electrical signal generation sub-circuit 203 actually includes multiple input terminals, each storing a different threshold electrical signal. A threshold control signal for selecting the threshold electrical signal of the first pixel unit controls the selection of the corresponding input terminal, and the selected threshold electrical signal is sent as the threshold electrical signal of the first pixel unit to the comparator 202 for processing.

[0107] Here, the signal processing sub-circuit 204 is located inside the column-level readout feedback sub-circuit 208 or outside the column-level readout feedback sub-circuit 208; there is no limitation on this.

[0108] By adopting the first circuit structure, the functional modules for comparison and generation of signals and reset signals can be reused in the same column or even multiple columns of pixel units by multiplexing the column-level readout feedback sub-circuit 208. This can reduce the circuit area occupied by each pixel unit in the pixel array. Under the premise that the number of pixel units is fixed, the circuit size can be reduced and the circuit can be miniaturized.

[0109] Figure 3 This is a schematic diagram of the modularity and signal flow of the first circuit structure provided in the embodiments of this application. As shown in the figure, it includes a pixel array 201, a column-level readout feedback sub-circuit 208, a signal processing sub-circuit 204, and an output signal sub-circuit 205. The column-level readout feedback sub-circuit includes a comparator 202, a multiplexer 2082, a threshold electrical signal generation sub-circuit 203, and an output sub-circuit 2084.

[0110] In a specific implementation, in the pixel array 201, the first pixel unit among the passing pixel units is selected, the optical signal is converted into an electrical signal, and sent to the column-level readout feedback sub-circuit 208; according to the column reset signal sent by the column-level readout feedback sub-circuit 208, its own first reset switch is turned on, and when its own second reset switch is turned on, a reset is performed;

[0111] The comparator 202 in the column-level readout feedback sub-circuit 208, upon receiving an electrical signal, determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203. If the result is greater, a column reset signal and a signal are generated and output to the output sub-circuit 2084. The output sub-circuit 2084 then sends the column reset signal to the first pixel unit via a multiplexer 2082. Finally, the output sub-circuit 2084 sends the signal to the signal processing sub-circuit 204.

[0112] The threshold electrical signal generation sub-circuit 203 in the column-level readout feedback sub-circuit 208 generates a threshold electrical signal for the first pixel unit based on a threshold control signal received from the signal processing sub-circuit 204 for selecting the threshold electrical signal of the first pixel unit, and provides it to the comparator 202 in the column-level readout feedback sub-circuit 208.

[0113] The signal processing sub-circuit 204 collects information about the signal of the first pixel unit within a predetermined time period. Based on the set threshold electrical signal generation strategy and the information about the signal of the first pixel unit obtained within the predetermined time period, it generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit. The signal is fed back to the threshold electrical signal generation sub-circuit 203 in the column-level readout feedback sub-circuit 208, and the signal of the first pixel unit is output through the output signal sub-circuit 205.

[0114] In the circuit described above, the multiplexer 2082 can also be a multiplexing module or a multiplexing unit, and the output sub-circuit 2084 can also be an output module or an output unit; there are no limitations on this. This application uses the multiplexer 2082 or the output sub-circuit 2084 as an example for illustration.

[0115] In the first circuit structure, the signal processing sub-circuit 204 can also output the threshold electrical signal of the first pixel unit through the output signal sub-circuit 205, so that the outside can know the current threshold electrical signal of the pixel unit in the pixel array.

[0116] In the first circuit structure, such as Figure 2bAs shown, one column of pixel units in the pixel array 201 of the circuit corresponds to one column-level readout feedback sub-circuit 208. In one embodiment of this application, multiple columns of pixel units in the pixel array 201 of the circuit correspond to one column-level readout feedback sub-circuit 208. In this case, at different times, the column-level readout feedback sub-circuit 208 interacts with the pixel units in different columns corresponding to it, receiving electrical signals and feedback column reset signals. For example, when three columns of pixel units are connected to one column-level readout feedback sub-circuit 204, then at the first moment of the first third of the frame period, the first column of pixel units interacts with the column-level readout feedback sub-circuit; at the second moment of the second third of the frame period, the second column of pixel units interacts with the column-level readout feedback sub-circuit; and at the third moment of the last third of the frame period, the third column of pixel units interacts with the column-level readout feedback sub-circuit.

[0117] Figure 4 A schematic diagram of the column-level readout feedback sub-circuit using the first circuit structure provided in the embodiments of this application is shown in the figure. It includes: a comparator 202, a multiplexer 2082, a threshold electrical signal generation sub-circuit 203, and an output sub-circuit 2084.

[0118] The comparator 202 receives the electrical signal transmitted by the first pixel unit, and when it determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates a column reset signal of the first pixel unit and a comparison result of the signal, and outputs it to the output sub-circuit 2084.

[0119] The output sub-circuit 2084 latches the comparison result of the first pixel unit, outputs the column reset signal in the comparison result to the multiplexer 2082, and sends the signal in the comparison result to the signal processing sub-circuit 204.

[0120] The multiplexer 2082 is used to select a link between the first pixel unit and send the column reset signal to the first pixel unit through the link.

[0121] The threshold electrical signal generation sub-circuit 203 is used to generate a threshold electrical signal for the first pixel unit based on a threshold control signal received from the signal processing sub-circuit 204 for selecting the threshold electrical signal of the first pixel unit, and provide it to the comparator 202.

[0122] In specific implementation, the comparator 202 in the column-level readout feedback sub-circuit 208 is implemented by a comparator, the output sub-circuit 2084 is implemented by an RS flip-flop and a tri-state gate device, the multiplexer 2082 is implemented by a multiplexer (MUX), and the threshold electrical signal generation sub-circuit 203 is implemented by a DAC or a multiplexer.

[0123] like Figure 4a As shown, Figure 4a This is a schematic diagram illustrating the specific implementation structure of the column-level readout feedback sub-circuit provided in an embodiment of this application. It includes: the comparator 202 comprising a comparator; the output sub-circuit 2084 comprising an RS flip-flop and a tri-state gate; the multiplexer 2082 comprising a multiplexer (MUX); and the threshold signal generation sub-circuit 2083 comprising a DAC.

[0124] One input terminal of the comparator receives the electrical signal transmitted by the first pixel unit, and the other input terminal is connected to the DAC to receive the threshold electrical signal of the first pixel unit. The comparator compares the two signals to obtain the comparison result.

[0125] The comparator outputs the comparison result to the S terminal of the RS flip-flop, the R terminal of the RS flip-flop serves as the reset terminal, and the output of the RS flip-flop is connected to the input terminal of the MUX and the input terminal of the tri-state gate device respectively. The column reset signal in the comparison result is sent to the MUX, and the signal in the comparison result is sent to the tri-state gate device.

[0126] The MUX gate connects to the first pixel unit and sends the column reset signal to the first pixel unit.

[0127] The output of the DAC is connected to the comparator. Multiple input terminals temporarily store different threshold electrical signals. The signal processing sub-circuit 204 controls the selection of one of the input terminals according to the threshold control signal used to select the threshold electrical signal of the first pixel unit. The threshold electrical signal temporarily stored in the selected input terminal is used as the threshold electrical signal of the first pixel unit and sent to the comparator 202.

[0128] When the resistive terminal of the tri-state gate is set to a low level voltage, the output terminal outputs the signal to the signal processing sub-circuit 204. When the resistive terminal of the tri-state gate is set to a high level voltage, the comparison result in the comparator is latched.

[0129] In the specific example above, a tri-state gate device is included between the RS flip-flop and the signal processing sub-circuit 204. The RS flip-flop transmits signals to the signal processing sub-circuit 204 through the tri-state gate device. When it is necessary to protect the output signal sub-circuit or not output a signal, the e-terminal of the tri-state gate device is set to a high-impedance state, thereby disconnecting the RS flip-flop from the signal processing sub-circuit 204.

[0130] In this embodiment, the comparator can also be a multi-bit DAC. In this case, the comparison result is multi-bit data, not just "0" or "1" (0 indicates an invalid column reset signal, which cannot turn on the first reset switch in the corresponding pixel unit, so that the corresponding pixel unit cannot be reset).

[0131] In this embodiment, the RS trigger can be replaced by a D trigger, which is not a limitation.

[0132] In this embodiment, the threshold electrical signal generation sub-circuit 203 can also be implemented by a multiplexer, such as... Figure 4b As shown, Figure 4b This is a schematic diagram of the multiplexer structure for implementing the threshold electrical signal generation sub-circuit 203 in this embodiment. The multiplexer has multiple input channels, each temporarily storing a different threshold electrical signal. After the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit, it sends a threshold control signal to the selection channel port (0 to n-1) below the multiplexer to select the threshold electrical signal of the first pixel unit. The threshold electrical signal corresponding to the selected input channel is used as the threshold electrical signal of the first pixel voltage, i.e., it is sent to the comparator as the threshold electrical signal Ref.

[0133] The second circuit structure

[0134] Figure 5 This is a schematic diagram of a second circuit structure for an adjustable signal emission frequency provided in an embodiment of this application. The circuit structure includes: a pixel array 201, a region readout feedback sub-circuit 209, a threshold electrical signal generation sub-circuit 203, a signal processing sub-circuit 204, and an output signal sub-circuit 205. The threshold electrical signal generation sub-circuit 203 is located within the region readout feedback sub-circuit 209.

[0135] The pixel array 201 is composed of multiple pixel units arranged in at least one row. The first pixel unit in the row is selected to convert the optical signal into an electrical signal and send it to the area readout feedback sub-circuit 209. According to the reset signal sent by the area readout feedback sub-circuit 209, the first reset switch of itself is turned on, and when the second reset switch of itself is turned on, a reset is performed.

[0136] The region readout feedback sub-circuit 209 is connected to the pixel units in the corresponding region of the pixel array 201, respectively, and receives the electrical signal transmitted by the first pixel unit in the set region. When the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates the reset signal and the signal, sends the reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit 204.

[0137] The signal processing sub-circuit 204 is connected to the column-level readout feedback sub-circuit 209. It counts the signal information of the first pixel unit within a predetermined time. Based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time, it feeds back to the threshold electrical signal generation sub-circuit 203 in the region readout feedback sub-circuit 209, and outputs the signal of the first pixel unit through the output signal sub-circuit 205.

[0138] In the second circuit structure, the comparator 202 is disposed in the area readout feedback sub-circuit 209; when the area readout feedback sub-circuit 209 performs the above function, it includes: when the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit, generating a reset signal and a signal, sending the reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sending the signal to the signal processing sub-circuit 204.

[0139] Here, the threshold electrical signal generation sub-circuit 203 is located inside or outside the region readout feedback sub-circuit 209. The threshold electrical signal generation sub-circuit 203 includes a DAC or a multiplexer. The threshold electrical signal generation sub-circuit 203 actually includes multiple input terminals, each storing a different threshold electrical signal. A threshold control signal for selecting the threshold electrical signal of the first pixel unit controls the selection of the corresponding input terminal, and the selected threshold electrical signal is sent as the threshold electrical signal of the first pixel unit to the comparator 202 for processing.

[0140] Here, the signal processing sub-circuit 204 is disposed inside the region readout feedback sub-circuit 209, or disposed outside the region readout feedback sub-circuit 209, which is not limited here.

[0141] By adopting the second circuit structure, the multiplexing region readout feedback sub-circuit 209 enables the pixel units in a region to reuse the functional modules used for comparison, signal generation, and reset signals. This reduces the circuit area occupied by each pixel unit in the pixel array. Under the premise that the number of pixel units is fixed, the circuit size can be reduced, and the circuit can be miniaturized.

[0142] In the second circuit structure, the pixel array 201 is divided into multiple regions. The reset transmission of pixel units within each region is controlled by the region readout feedback sub-circuit 209 based on the threshold electrical signal of the corresponding pixel unit. Within a region, the reset and signal transmission of pixel units located in different columns are completed at different times by the interaction between the region readout feedback sub-circuit 209 and the pixel units in the corresponding columns (the gating and row reset signals of pixel units in different rows within a region can be directly controlled). For example, if three columns of pixel units are located in a region, when connected to the region readout feedback sub-circuit 209 of that region, then at the first moment of the first third of the frame period, the first column of pixel units interacts with the region readout feedback sub-circuit 209; at the second moment of the second third of the frame period, the second column of pixel units interacts with the region readout feedback sub-circuit 209; and at the third moment of the last third of the frame period, the third column of pixel units interacts with the region readout feedback sub-circuit 209.

[0143] The third circuit structure

[0144] like Figure 6a As shown, Figure 6a This is a schematic diagram of a circuit structure for an adjustable signal emission frequency provided in an embodiment of this application. The circuit structure includes: a pixel array 201, a threshold electrical signal generation sub-circuit 203, a signal processing sub-circuit 204, and an output signal sub-circuit 205, wherein...

[0145] The pixel array 201 is composed of multiple pixel units arranged in at least one row. The first pixel unit in the row is selected, and the optical signal is converted into an electrical signal. When the electrical signal is determined to be greater than the threshold electrical signal generated by the electrical signal generation sub-circuit 203, a reset signal and a signal are generated. The reset signal is used to select the first reset switch of the first pixel unit to perform a reset. The signal is sent to the signal processing sub-circuit 204.

[0146] The threshold electrical signal generation sub-circuit 203 generates a threshold electrical signal for the first pixel unit based on a threshold control signal received from the signal processing sub-circuit 204 for selecting the threshold electrical signal of the first pixel unit, and sends it to the first pixel unit.

[0147] The signal processing sub-circuit 204 performs statistics on the received signal within a set time period, and performs statistics on the signal information of the first pixel unit within a predetermined time period. Based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time period, it generates a threshold control signal for selecting the threshold electrical signal of the first pixel unit and sends it to the threshold electrical signal generation sub-circuit 203; and outputs the signal of the first pixel unit through the output signal sub-circuit 205.

[0148] In the third circuit structure, it can be seen that the comparator 202 is disposed inside the first pixel unit. Specifically, when the comparator 202 in the first pixel unit determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, it generates a reset signal and a signal. The reset signal is used to select the first reset switch of the first pixel unit for reset; the comparator 202 in the first pixel sends the signal to the signal processing sub-circuit 204.

[0149] In the third circuit structure, unlike the first two, a reset row selector 207 is not included. Instead, a row reset signal is used to control the selection of the second reset switch of the first pixel unit. Since the comparator 202 is located inside the first pixel unit and is not multiplexed by multiple pixel units, the reset control of the first pixel unit can be directly performed by the reset signal sent by the comparator within the first pixel unit.

[0150] The third circuit structure further includes a threshold control signal selector 210, such as... Figure 6a As shown, a strobe signal is used to send the threshold control signal to the first pixel unit, and a third switch is used to enable the first pixel unit to receive the threshold control signal, so that the threshold electrical signal generating sub-circuit 203 in the first pixel unit receives the threshold control signal.

[0151] In the third circuit structure, the threshold electrical signal generation sub-unit 203 is located inside the first pixel unit; the threshold electrical signal generation sub-circuit 203 includes a DAC or a multiplexer. The threshold electrical signal generation sub-circuit 203 actually includes multiple input terminals, each of which temporarily stores a different threshold electrical signal. When a threshold control signal for selecting the threshold electrical signal of the first pixel unit is received, the corresponding input terminal is selected, and the selected threshold electrical signal is used as the threshold electrical signal of the first pixel unit and sent to the comparator 202 for processing.

[0152] In the third circuit structure, the pixel array serves as a chip-level circuit, and its structure is as follows: Figure 6b As shown, it specifically includes: a pixel unit array 201 composed of pixel units arranged in at least one row, wherein the first pixel unit in the pixel unit array 201 includes: a comparator 202 and a threshold electrical signal generation sub-circuit 203, wherein,

[0153] When the comparator 202 determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit 203, the first pixel unit generates a reset signal and a signal. The reset signal is used to select its own first reset switch for reset. The comparator 202 sends the signal to the signal processing sub-circuit 204.

[0154] The threshold electrical signal generation sub-circuit 203 in the first pixel unit obtains the threshold electrical signal of the first pixel unit based on the threshold control signal received from the signal processing sub-circuit 204, and sends it to the comparator 202. The threshold control signal is a threshold control signal for selecting the first pixel unit generated by the signal processing sub-circuit 204 based on the information of the signal of the first pixel unit statistically analyzed within a predetermined time, the set threshold electrical signal generation strategy, and the information of the signal of the first pixel unit obtained within the predetermined time.

[0155] In the above example, Figure 6b The threshold electrical signal generating sub-circuit 203 in the first pixel unit of the pixel array shown is also used to receive the threshold control signal selection signal sent by the threshold control signal selector 210, select its own third switch, and receive the threshold control signal.

[0156] The third circuit structure is adopted because each pixel unit in the pixel array further integrates a threshold electrical signal generation sub-circuit 203, which allows for rapid adjustment of the signal emission frequency compared to the first or second circuit structure.

[0157] All three circuit structures described above employ the threshold electrical signal generation sub-circuit 203, which specifically includes a digital-to-analog converter (DAC) or a multiplexer.

[0158] The DAC includes at least one input terminal and one output terminal, wherein each input terminal stores a threshold electrical signal. Under the control of the threshold control signal, the DAC selects one of the input terminals and outputs the threshold electrical signal stored in the input terminal to the comparator 202 through the output terminal.

[0159] The multiplexer includes at least one input terminal, one output terminal, and one control terminal, wherein each input terminal stores a threshold electrical signal. When the control terminal of the multiplexer receives the threshold control signal, it selects the corresponding input terminal. The threshold electrical signal stored in the corresponding input terminal is sent to the comparator 202 through the output terminal.

[0160] In the three circuit structures described above, the information of the signal of the first pixel unit can be of various types, such as the number of signals of the first pixel unit, or the average or minimum interval between the signals of the first pixel unit, etc. Furthermore, different threshold electrical signal generation strategies can be set to obtain the corresponding threshold electrical signal of the first pixel unit.

[0161] Specifically, the information of the signal of the first pixel unit includes: the number of signals of the first pixel unit accumulated within the predetermined time; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the number of signals of the first pixel unit according to the preset correspondence between the number of signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0162] Alternatively, the information of the signal of the first pixel unit includes: the average interval between the signals of the first pixel unit accumulated within the predetermined time period; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the average interval between the signals of the first pixel unit according to the preset correspondence between the average interval between the signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0163] Alternatively, the signal of the first pixel unit includes: the minimum interval between the signals of the first pixel unit accumulated within the predetermined time period; the signal processing sub-circuit 204 determines the threshold electrical signal of the first pixel unit corresponding to the minimum interval between the signals of the first pixel unit according to the preset correspondence between the minimum interval between the signals and the threshold electrical signal; and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

[0164] When employing an alternative threshold signal generation strategy, the information of the signal of the first pixel unit includes: the number of signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further configured to determine whether the number of signals of the first pixel unit exceeds a set threshold. If yes, the threshold signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level; if no, the threshold signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level. The set level is set based on the correspondence between a preset difference between the number of signals of the first pixel unit and the threshold and an adjustment level. A threshold control signal for selecting the threshold signal of the corresponding first pixel unit is obtained based on the threshold signal of the corresponding first pixel unit.

[0165] Alternatively, the information of the signal of the first pixel unit includes: the average interval between the signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further configured to determine whether the average interval between the signals of the first pixel unit exceeds a set average interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the average interval between the signals of the first pixel unit and the average interval threshold and the adjustment level. A threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained based on the threshold electrical signal of the corresponding first pixel unit.

[0166] Alternatively, the signal of the first pixel unit includes: the minimum interval between the signals of the first pixel unit accumulated within the predetermined time. The signal processing sub-circuit 204 is further configured to determine whether the minimum interval between the signals of the first pixel unit exceeds a set minimum interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the minimum interval between the signals of the first pixel unit and the minimum interval threshold, and the adjustment level. A threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained based on the threshold electrical signal of the corresponding first pixel unit.

[0167] Figure 7 The flowchart of the signal transmission frequency adjustment method provided in this application embodiment includes the following specific steps:

[0168] Step 701: The first pixel unit among the selected passing pixel units in the pixel array of the circuit converts the optical signal into an electrical signal.

[0169] Step 702: When it is determined that the electrical signal of the first pixel unit is greater than the determined threshold electrical signal of the first pixel unit, a signal is generated. The threshold electrical signal of the first pixel unit is generated based on the information of the signal of the first pixel unit collected within a predetermined time, and on the set threshold electrical signal generation strategy and the information of the signal of the first pixel unit obtained within the predetermined time.

[0170] Step 703: Output the signal and return to step 701 to continue execution.

[0171] The above method further includes: generating a reset signal at the same time as generating the signal, so as to reset the first pixel unit, and after the first pixel unit is reset, returning to step 701 to continue executing the step of issuing the signal.

[0172] In the above method, the information of the signal of the first pixel unit obtained by statistics can reflect the information of the current light intensity of the first pixel unit, such as the number of signals accumulated within a preset time period, the average interval between signals, or the minimum interval between signals, etc., which are not limited here.

[0173] In the above method, the threshold electrical signal generation strategy is actually a preset correspondence between the information of the signals of different first pixel units obtained by statistics and different threshold electrical signals.

[0174] Specifically, the threshold electrical signal of the first pixel unit is generated based on the information of the signal of the first pixel unit collected within a predetermined time period, according to a set threshold electrical signal generation strategy and the information of the signal of the first pixel unit obtained within the predetermined time period, including:

[0175] The information of the signal of the first pixel unit includes: the number of signals of the first pixel unit accumulated within the predetermined time; and the threshold electrical signal of the first pixel unit corresponding to the number of signals of the first pixel unit according to the preset correspondence between the number of signals and the threshold electrical signal.

[0176] Alternatively, the information of the signal of the first pixel unit includes: the average interval between the signals of the first pixel unit accumulated within the predetermined time; and the threshold electrical signal of the first pixel unit corresponding to the average interval between the signals of the first pixel unit is determined according to the preset correspondence between the average interval between the signals and the threshold electrical signal.

[0177] Alternatively, the signal of the first pixel unit includes: the minimum interval between the signals of the first pixel unit accumulated within the predetermined time; and the threshold electrical signal of the first pixel unit corresponding to the minimum interval between the signals of the first pixel unit is determined according to the preset correspondence between the minimum interval between the signals and the threshold electrical signal.

[0178] In the above method, since the information of the signal of the first pixel unit obtained by statistics reflects the information of the current light intensity of the first pixel unit, an information threshold is also preset. When it is determined that the information of the signal of the first pixel unit obtained by statistics is greater than the information threshold, it means that the current light intensity of the first pixel unit is strong, and the corresponding threshold electrical signal needs to be reduced, thereby controlling the frequency of the first pixel unit to emit signals to speed up; when it is determined that the information of the signal of the first pixel unit obtained by statistics is less than the information threshold, it means that the current light intensity of the first speed limiting unit is weak, and the corresponding threshold electrical signal needs to be increased, thereby controlling the frequency of the first pixel unit to emit signals to slow down.

[0179] Here, the amplitude of lowering or raising the corresponding threshold electrical signal is related to the difference between the information of the first pixel unit's signal and the information threshold; the larger the difference, the larger the amplitude. In this case, the threshold electrical signal can be set to multiple levels according to its magnitude. The threshold electrical signal generation strategy set in this embodiment actually presets the correspondence between the difference between the information of the first pixel unit's signal and the information threshold, and the number of adjustment levels of the threshold electrical signal. During adjustment, first, the corresponding threshold electrical signal is judged to be raised or lowered based on the information threshold; then, based on the set correspondence, the number of levels of raising or lowering the corresponding threshold electrical signal is determined; finally, based on the current threshold electrical signal of the first pixel unit, the threshold electrical signal of the corresponding number of levels is raised or lowered to obtain the corresponding threshold electrical signal used by the first pixel unit in the future.

[0180] Specifically, the threshold electrical signal of the first pixel unit is generated based on the information of the signal of the first pixel unit collected within a predetermined time period, according to a set threshold electrical signal generation strategy and the information of the signal of the first pixel unit obtained within the predetermined time period, and also includes:

[0181] Determine whether the number of signals of the first pixel unit exceeds a set threshold. If yes, decrease the threshold electrical signal of the first pixel unit corresponding to the current signal of the first pixel unit by a set level. If no, increase the threshold electrical signal of the first pixel unit corresponding to the current signal of the first pixel unit by a set level. The set level is set according to the correspondence between the preset difference between the number of signals of the first pixel unit and the threshold and the adjustment level.

[0182] Alternatively, determine whether the average interval between the signals of the first pixel unit exceeds a set average interval threshold. If yes, decrease the threshold electrical signal of the first pixel unit corresponding to the signal of the first pixel unit by a set level. If no, increase the threshold electrical signal of the first pixel unit corresponding to the signal of the first pixel unit by a set level. The set level is set according to the correspondence between the preset difference between the average interval between the signals of the first pixel unit and the average interval threshold and the adjustment level.

[0183] Alternatively, determine whether the minimum interval between the signals of the first pixel unit exceeds a set minimum interval threshold. If yes, decrease the threshold electrical signal of the first pixel unit corresponding to the signal of the first pixel unit by a set level. If no, increase the threshold electrical signal of the first pixel unit corresponding to the signal of the first pixel unit by a set level. The set level is set according to the correspondence between the preset difference between the minimum interval between the signals of the first pixel unit and the minimum interval threshold and the adjustment level.

[0184] In the above method, the predetermined time used to statistically analyze the signal information of the first pixel unit is set as needed and is not limited here.

[0185] As can be seen from the above method, this embodiment of the application, for each pixel unit, statistically analyzes the signals emitted within a predetermined time before the current signal emission to obtain information reflecting the current light intensity of the first pixel unit. Then, based on a preset threshold electrical signal generation strategy and the information reflecting the current light intensity of the first pixel unit, the corresponding threshold electrical signal used by the pixel unit at the time of the current signal emission is obtained, thereby controlling the frequency of the current signal emission for that pixel unit. Since the interval between the signal emission from pixel units in the pixel array is on the millisecond level, determining the corresponding threshold electrical signal used by the pixel unit at the time of the current signal emission can reflect the current light intensity of the pixel unit, making the signal emission frequency for the pixel unit adjustable.

[0186] In this embodiment, the generation of the corresponding threshold electrical signal for each pixel unit in the pixel array may occur at the same time or at different times; this is not limited. In one embodiment, the generation of the corresponding threshold electrical signal for each pixel unit occurs at different times, with each pixel unit having its own time for generating the corresponding threshold electrical signal. The threshold electrical signal generation strategy set for each pixel unit may also be the same or different; this is not limited, thereby making the threshold voltage adjustment of each pixel unit more flexible.

[0187] The following is a specific example illustrating an embodiment of this application.

[0188] Figure 8 This is a schematic diagram illustrating a specific example of a signal circuit structure provided in an embodiment of this application. This structure is based on a first readout structure, where the pixel units illustrate specific circuitry. The column-level readout feedback sub-circuit is labeled as the column-level readout feedback module. Figure 4aThe structure is shown. In this specific example, a column of pixel units is cascaded with a column of readout feedback sub-circuits, meaning there is a one-to-one correspondence between a column of pixel units and a column of readout feedback sub-circuits. Of course, multiple columns of pixel units can also be cascaded with a column of readout feedback sub-circuits; this is not a limitation.

[0189] In this example, the circuit structure of the pixel unit includes: a reset signal receiving module, a photosensitive integration module, and an electrical signal output sub-circuit, wherein,

[0190] The reset signal receiving module receives the row reset signal, selects the first reset switch, and receives the column reset signal sent by the connected column-level readout feedback sub-circuit, selects the second reset switch to perform the reset operation, and turns on the photosensitive integration module.

[0191] When the photosensitive integration module is in the conducting state, it converts the optical signal into the electrical signal under illumination conditions and outputs it to the electrical signal output sub-circuit.

[0192] The electrical signal output sub-circuit receives the row readout signal and outputs the electrical signal to the connected column-level readout feedback sub-circuit.

[0193] Specifically, the photosensitive integration module is typically implemented using a photodiode (PD), the reset signal receiving module is implemented by cascading multiple transistors, and the electrical signal output sub-circuit is implemented by a transistor.

[0194] Here, the electrical signal can be either a voltage signal or a current signal; there are no restrictions.

[0195] In the specific implementation of a pixel unit, the circuit structure is as follows: Figure 8 As shown, the reset signal receiving module includes a first transistor and a second transistor, the photosensitive integrating module includes a PD, and the electrical signal output sub-circuit includes a third transistor and a fourth transistor. The first transistor includes an M... RS-SEL The second transistor includes: M RS The third transistor includes: M SF The fourth transistor includes: M SEL .

[0196] The M RS-SEL The gate of the device is the first reset switch, receiving the row reset signal; the source is the second reset switch, receiving the column reset signal; and the drain is connected to the M... RS Gate connection; the M RS The drain of the PD is connected to a high-level voltage signal, and the source is connected to the output of the PD; the input of the PD is grounded; the M SFThe gate of the PD is connected to the output terminal of the M, and the drain is connected to the output terminal of the PD. RS The drain and source are connected to the M. SEL The drain of the M; SEL The source outputs an electrical signal, and the gate receives the row readout signal.

[0197] In this specific implementation, the M is applied SEL Φ on SEL The signal is a readout signal, which transfers the voltage signal on the PD to the column output line of the array and applies it to the M. RS_SEL Φ on RS_SEL For row reset signal, Φ RS The signal is a column reset signal, used to jointly control the reset operation of the PD.

[0198] Of course, other circuit structures can be used for pixel units, and there are no restrictions here.

[0199] In this specific example, the flowchart of a method for adjusting the signal transmission frequency based on the first circuit structure is as follows: Figure 9 As shown, it specifically includes:

[0200] Step 901: In the pixel array, input the threshold control signal of each column of the pixel unit in the i-th row to the column-level readout feedback sub-circuit for selecting the threshold electrical signal, where 0 <= i <= m-1, and m is a natural number;

[0201] Step 902: Select the i-th row of the signal to be read by the row selector and send the row read signal to the pixel unit of the i-th row;

[0202] Step 903: The pixel unit in the i-th row receives the row readout signal, converts the optical signal into an electrical signal, and outputs it to the connected column-level readout feedback sub-circuit. The connected column-level readout feedback sub-circuit compares the electrical signal with the received corresponding threshold electrical signal to obtain the signal of the pixel unit in the i-th row and the column reset signal; and outputs the obtained signal.

[0203] In this step, a signal of 1 indicates that the signal is valid and a column reset signal is generated, while a signal of 0 indicates that the signal is invalid and no column reset signal is generated.

[0204] Step 904: The column-level readout feedback sub-circuit transmits the column reset signal of the pixel unit connected to it in the i-th row to the pixel unit.

[0205] Step 905: Select the i-th row to be reset using the reset row selector, where 0 <= i <= m-1, and m is a natural number; transmit a row reset signal to the pixel unit of the i-th row; the pixel unit that receives the row reset signal and column reset signal performs a reset operation.

[0206] In this step, if the column reset signal is invalid, such as the column reset signal being set to 0, it is determined that no column reset signal has been received, and no reset operation is performed.

[0207] Step 906: Select the pixel unit in the (i+1)th row as the pixel unit to be output signal, and return to step 901 to continue execution.

[0208] Reference Figure 10 , Figure 10 The timing diagrams of various signals involved in the specific example of the method for adjusting the signal transmission frequency based on the first circuit structure provided in the embodiments of this application are as follows.

[0209] In this example, the column-level readout feedback sub-circuit uses a D flip-flop to latch the comparison result, and the trigger terminal of the D flip-flop is D_clk.

[0210] At times t0 to t1, a high-level voltage signal is applied to row SEL[0] in the circuit to select the pixel unit in row 0. The pixel unit in row 0 sends the electrical signal generated by the optical signal to the connected column-level readout feedback sub-circuit.

[0211] The comparator of the column-level readout feedback sub-circuit connected to the pixel unit receives the electrical signal transmitted by the pixel unit at one input terminal, applies the threshold voltage signal of the pixel unit received at the Ref terminal, compares the signal, and sends the comparison result to the D flip-flop. The D flip-flop applies a high-level voltage signal at the D_clk terminal to latch the comparison result into the D flip-flop.

[0212] A high-level voltage signal is applied to the Read terminal of the tri-state gate device in the connected column-level read feedback sub-circuit. The comparison result of the signal latched in the D flip-flop is output. The column reset signal, VRS_pix or 0, is obtained in the MUX of the connected column-level read feedback sub-circuit based on the comparison result latched in the D flip-flop and is output.

[0213] A high-level voltage signal is applied to the RS_SEL[0] signal line to reset each pixel unit in row 0. VRS_pix or 0 in column j (0<=j<=n) is applied to the pixel unit at position (0,j) to determine whether to reset the pixel unit at position (0,j). Each pixel unit in row 0 receives a row reset signal, i.e., a high-level voltage signal applied to the RS_SEL[0] signal line. Pixel units in that row that only receive column reset signals perform a reset operation.

[0214] In this specific example, the threshold electrical signal of the pixel unit in the pixel array is generated by statistically analyzing the signal over a set time period to obtain information reflecting the current light intensity of the first pixel unit. This information is then used to generate the threshold electrical signal based on a set threshold electrical signal generation strategy. The preset threshold electrical signal generation strategy can include various methods, one of which is... Figure 11 As shown, Figure 11 The flowchart of the method for determining the threshold electrical signal of the corresponding pixel unit in the method for adjusting the signal emission frequency based on the first circuit structure provided in the embodiments of this application includes the following specific steps:

[0215] Step 1101: Count the signals of the corresponding pixel units in the pixel array within a set time period;

[0216] Step 1102: For each corresponding pixel unit in the pixel array, calculate the cumulative number of signals emitted by that pixel unit;

[0217] Step 1103: For the corresponding pixel unit, determine whether the cumulative value of the number of signals emitted by the pixel unit exceeds the set cumulative value threshold. If yes, proceed to step 1104; otherwise, proceed to step 1105.

[0218] Step 1104: For pixel units that exceed the accumulated value threshold, reduce the level of the threshold electrical signal of the pixel unit to obtain the current threshold electrical signal of the pixel unit.

[0219] Step 1105: For pixel units that have not exceeded the cumulative threshold, increase the level of the threshold electrical signal of the pixel unit to obtain the current threshold electrical signal of the pixel unit.

[0220] In the specific example above, the threshold electrical signals of the pixel unit are divided into multiple levels in descending order. If the cumulative value of the number of signals emitted by the pixel unit exceeds the set cumulative value threshold, it indicates that the input light intensity of the pixel unit is strong. In this case, the current threshold electrical signal of the pixel unit is reduced by one or more levels. The number of levels reduced is determined by the difference exceeding the threshold, which slows down the emission frequency of subsequent signals of the pixel unit. If the cumulative value of the number of signals emitted by the pixel unit does not exceed the set cumulative value threshold, it indicates that the input light intensity of the pixel unit is weak. In this case, the current threshold electrical signal of the pixel unit is increased by one or more levels. The number of levels decreased is determined by the difference exceeding the threshold, which speeds up the emission frequency of subsequent signals of the pixel unit.

[0221] As can be seen, the embodiments of this application improve the sensitivity of the signal emission frequency of the pixel units in the pixel array by comparing and controlling the signal emission frequency of the corresponding pixel units based on the adjustable threshold electrical signal for the pixel units in the comparator in the circuit, thereby achieving adjustable sensitivity of the signal emission frequency at the pixel level and taking into account the imaging of both bright and dark areas in the pixel array.

[0222] Specifically, in a single pixel unit of the pixel array, for a given light intensity input, a fixed photocurrent I is generated, and the capacitance value on the PD is C. If the threshold voltage obtained in the comparator is Vref, and the voltage on the PD after each reset is Vrst, then a signal is emitted every time the accumulated charge in the pixel unit reaches C*(Vrst-Vref). The interval Δt between the signal emission of this pixel unit is C*(Vrst-Vref) / I. With the capacitance C, photocurrent I, and voltage Vrst remaining constant, changing the threshold voltage Vref will change the interval between signal emission.

[0223] In traditional pulse sequence image sensors, all pixel units share the same threshold voltage Vref. In practice, when the photocurrent I is large, the Δt value is short. Since the signal emission frequency of this pixel unit is limited, to further increase the detected photocurrent I, the threshold voltage Vref needs to be reduced, thus enabling the detection of greater light intensity at the same signal emission frequency. However, for pixel units with smaller photocurrent I, reducing the threshold voltage Vref further increases Δt, requiring a longer time to obtain the corresponding light intensity based on the signal emission interval, which is detrimental to real-time image reconstruction based on the signal. In the embodiments of this application, a separate comparison threshold voltage Vref can be set for different pixel units with different light intensities. Pixel units with high light intensity are assigned a lower threshold voltage Vref, and pixel units with low light intensity are assigned a higher threshold voltage Vref, thus ensuring that different pixel units in the entire pixel array have different signal emission frequencies.

[0224] In another embodiment of this application, an electronic device for image sensor imaging is also provided, the device including the above-described signal transmission frequency adjustable circuit, and / or including the above-described pixel array circuit, and / or a chip having the above-described pixel array circuit.

[0225] Specifically, the device includes at least one of the following: camera, webcam, audio / video player, navigation device, fixed-location terminal, entertainment device, smartphone, communication device, mobile device, vehicle or facility, industrial equipment, medical device, security device, flight equipment, and home appliance.

[0226] In this application embodiment, the camera includes, but is not limited to, pulse cameras, high-speed cameras, industrial inspection cameras, etc. The webcam includes, but is not limited to: vehicle-mounted cameras, mobile phone cameras, traffic cameras, cameras mounted on flying objects, medical cameras, security cameras, or home appliance cameras.

[0227] Taking a pulse camera as an example, the device provided in the embodiments of this application will be described in detail. Figure 12 This is a schematic diagram of the structure of a pulse camera provided in an embodiment of this application. Figure 12 As shown, the pulse camera includes: a lens 1201, a signal circuit 1202, a data processing circuit 1203, a non-volatile memory 1204, a power supply circuit 1205, a volatile memory 1206, a control circuit 1207, and an I / O interface 1208.

[0228] Lens 1201 is used to receive incident light, i.e., light signals, from the subject.

[0229] The signal circuit 1202 is used to convert the optical signal received through the lens 1201 into an electrical signal and generate a signal based on the electrical signal. The signal circuit 1202 may include, for example, the circuit described above with an adjustable signal emission frequency, and / or the pixel array circuit described above, and / or a chip having the pixel array circuit described above.

[0230] The data processing circuit 1203 is used to control the signal readout process. The data processing circuit 1203 includes, for example, an arithmetic processing unit (e.g., CPU) and / or an image processing unit (GPU). For example, it controls the signal readout process of a circuit with an adjustable signal emission frequency, controls the readout row selector to send a row readout signal, and controls the reset row selector to send a reset signal, etc.

[0231] Volatile memory 1206, such as random access memory (RAM), and non-volatile storage device 1204, such as solid state disk (SSD), hybrid hard disk (HHD), secure digital card (SD), mini SD card, etc.

[0232] In one embodiment of the present invention, the pulse camera further includes a display unit for real-time / playback display of signal / image information. The pulse camera described in this embodiment may further include at least one of the following: a wired / wireless transmission interface, such as a WiFi interface, Bluetooth interface, USB interface, RJ45 interface, Mobile Industry Processor Interface (MIPI) interface, Low Voltage Differential Signaling (LVDS) interface, and other interfaces with wired or wireless transmission capabilities.

[0233] The pulse camera provided in this invention can be used to detect visible light, infrared light, ultraviolet light, X-rays, etc., and can be applied to various scenarios, including but not limited to:

[0234] It can be used as an in-vehicle camera installed in various vehicles or facilities, such as for information acquisition and control in vehicle-to-infrastructure (V2I) communication, intelligent transportation, and autonomous driving. For example, it can be installed in high-speed rail and other rail transit vehicles or on rail transit lines as a high-speed rail driving recorder; it can also be installed in autonomous vehicles or vehicles equipped with advanced driver assistance systems (ADAS), such as for detecting and alarming information on vehicles, pedestrians, lanes, and drivers.

[0235] It can be used as a traffic camera installed on traffic signal poles to capture, warn, and coordinate the control of vehicles and pedestrians on urban roads and highways.

[0236] It can be used as an industrial inspection camera, such as being installed on high-speed rail lines for high-speed rail inspection and for high-speed rail safety inspection; it can also be used for specific industrial scenarios such as coal mine conveyor belt breakage detection, substation arc detection, real-time detection of wind turbine blades, and high-speed turbine non-stop inspection for detection and early warning.

[0237] Installed on flyable objects, such as airplanes and satellites, for high-definition imaging of objects in high-speed flight or even high-speed rotation scenarios.

[0238] Industrial applications (machine vision in intelligent manufacturing, etc.), civilian applications (judicial evidence collection, sports refereeing, etc.), and consumer electronics (cameras, film and television media, etc.).

[0239] It can be used as a medical camera to provide high-definition medical imaging in clinical diagnosis and treatment, such as medical care, beauty, and health care.

[0240] It can be used as an action camera or a wearable camera, such as a head-mounted camera or a camera embedded in a wristwatch, to capture various scenes such as sports competitions and daily leisure activities.

[0241] It can also be used as a security camera, mobile phone camera, or home appliance camera, etc.

[0242] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments disclosed in this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those shown in the drawings. For example, two blocks shown connectedly may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0243] Those skilled in the art will understand that the features described in the various embodiments and / or claims of this disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in this application. In particular, without departing from the spirit and teachings of this application, the features described in the various embodiments and / or claims of this application can be combined and / or combined in various ways, and all such combinations and / or combinations fall within the scope of this application.

[0244] This document uses specific embodiments to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the methods and core ideas of this application, and are not intended to limit this application. For those skilled in the art, changes can be made to the specific implementation methods and application scope based on the ideas, spirit and principles of this application. Any modifications, equivalent substitutions, improvements, etc., made should be included within the scope of protection of this application.

Claims

1. A circuit with an adjustable signal transmission frequency, characterized in that, include: The circuit comprises a comparator (202), a threshold electrical signal generation subcircuit (203), and a signal processing subcircuit (204), wherein... The comparator (202) receives the electrical signal of the first pixel unit, obtains the threshold electrical signal of the first pixel unit from the threshold electrical signal generation sub-circuit (203), and generates a signal and sends it to the signal processing sub-circuit (204) when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit. The signal processing sub-circuit (204) counts the signal information of the first pixel unit within a predetermined time period. Based on the set threshold electrical signal generation strategy and the signal information of the first pixel unit obtained within the predetermined time period, the signal information of the first pixel unit includes the number of signals of the first pixel unit accumulated within the predetermined time period, the average interval between the signals of the first pixel unit accumulated within the predetermined time period, or the minimum interval between the signals of the first pixel unit accumulated within the predetermined time period. A threshold control signal for selecting the threshold electrical signal of the first pixel unit is generated, sent to the threshold electrical signal generation sub-circuit (203), and the signal is output. Thus, the subsequent signal emission frequency of the first pixel unit is adjusted by adjusting the threshold electrical signal. The threshold electrical signal generation sub-circuit (203) obtains the threshold electrical signal of the first pixel unit according to the threshold control signal and sends it to the comparator (202). The comparator (202) is further configured to generate a reset signal and send it to the first pixel unit when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit, so that the first pixel unit is reset.

2. The circuit as described in claim 1, characterized in that, The signal includes: a pulse signal, or a level signal, or a value with a limit; The signal processing sub-circuit includes a pulse signal processing sub-circuit, or a level signal processing sub-circuit, or a numerical processing sub-circuit with defined parameters.

3. The circuit as described in claim 2, characterized in that, Also includes: A pixel array (201) consisting of multiple pixel units arranged in at least one row, a read row selector (206), a reset row selector (207), and an output signal sub-circuit (205). The first pixel unit in the pixel array (201) converts the optical signal into an electrical signal, receives a row readout signal from the readout row selector (206), and sends the electrical signal to the comparator (202); according to the reset signal sent by the comparator (202), it selects its own first reset switch, receives a row reset signal from the reset row selector (207), selects its own second reset switch, and performs a reset. The output signal sub-circuit (205) is used to receive the signal from the signal processing sub-circuit (204) and output it.

4. The circuit as described in claim 3, characterized in that, Also includes: A column-level readout feedback sub-circuit (208), wherein the comparator (202) is disposed in the column-level readout feedback sub-circuit (208); The reset signal is a column reset signal; The column-level readout feedback sub-circuit (208) is connected to at least one column of pixel units in the pixel array (201), receives the electrical signal transmitted by the first pixel unit, and when the comparator (202) determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit (203), it generates the column reset signal and the signal, sends the column reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit (204).

5. The circuit as described in claim 4, characterized in that, The threshold electrical signal generation sub-circuit (203) is disposed inside or outside the column-level readout feedback sub-circuit (208), wherein, when the threshold electrical signal generation sub-circuit (203) is disposed inside the column-level readout feedback sub-circuit (208), The threshold electrical signal generation subcircuit (203) in the column-level readout feedback subcircuit (208) obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal and sends it to the comparator (202) in the column-level readout feedback subcircuit (208).

6. The circuit as described in claim 5, characterized in that, The signal processing sub-circuit (204) is located in the board-level circuit where the column-level readout feedback sub-circuit (208) is located, and is located inside or outside the column-level readout feedback sub-circuit (208).

7. The circuit as described in claim 3, characterized in that, Also includes: A region readout feedback sub-circuit (209), wherein the comparator (202) is disposed in the region readout feedback sub-circuit (209); The region readout feedback sub-circuit (209) is connected to the pixel unit in the set region of the pixel array (201), receives the electrical signal transmitted by the first pixel unit in the set region, and when the comparator (202) determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit (203), it generates the reset signal and the signal, sends the reset signal to the first pixel unit to select the first reset switch of the first pixel unit, and sends the signal to the signal processing sub-circuit (204).

8. The circuit as described in claim 7, characterized in that, The threshold electrical signal generation sub-circuit (203) is disposed inside or outside the region readout feedback sub-circuit (209), wherein, when the threshold electrical signal generation sub-circuit (203) is disposed inside the region readout feedback sub-circuit (209), The threshold electrical signal generation subcircuit (203) in the region readout feedback subcircuit (209) obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal and sends it to the comparator (202) in the region readout feedback subcircuit (209).

9. The circuit as described in claim 8, characterized in that, The signal processing sub-circuit (204) is located in the board-level circuit where the area readout feedback sub-circuit (209) is located, and is located inside or outside the area readout feedback sub-circuit (209).

10. The circuit as described in claim 2, characterized in that, The comparator (202) is disposed inside the first pixel unit, wherein, When the comparator (202) in the first pixel unit determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit (203), it generates a reset signal and a signal. The reset signal is used to select the first reset switch of the first pixel unit for reset. The comparator (202) in the first pixel unit sends the signal to the signal processing sub-circuit (204).

11. The circuit as described in claim 10, characterized in that, The threshold electrical signal generating sub-circuit (203) is disposed inside the first pixel unit or outside the pixel array (201). Wherein, the threshold electrical signal generating sub-circuit (203) is disposed inside the first pixel unit, The threshold electrical signal generation sub-circuit (203) in the first pixel unit obtains the threshold electrical signal of the first pixel unit according to the received threshold control signal, and sends it to the comparator (202) in the first pixel unit. The circuit further includes: a threshold control signal selector (210) that sends a selection signal of the threshold control signal to the first pixel unit and selects a third switch in the first pixel unit for receiving the threshold control signal, so that the threshold electrical signal generating sub-circuit (203) in the first pixel unit receives the threshold control signal.

12. The circuit as described in claim 11, characterized in that, The signal processing sub-circuit (204) is disposed outside the pixel array (201), and at least one is configured therein. Each of the signal processing sub-circuits (204) is connected to at least one column of pixel units or at least one set area of ​​pixel units in the pixel array (201) to generate a threshold control signal for selecting the threshold electrical signal of the first pixel unit and send it to the threshold electrical signal generating sub-circuit (203).

13. The circuit as described in claim 3, characterized in that, The threshold electrical signal generation sub-circuit (203) includes: a digital-to-analog converter (DAC) or a multiplexer. The DAC includes at least one input terminal and one output terminal, wherein each input terminal stores a threshold electrical signal. Under the control of the threshold control signal, the DAC selects one of the input terminals and outputs the threshold electrical signal stored in the input terminal to the comparator (202) through the output terminal. The multiplexer includes at least one input terminal, one output terminal, and one control terminal, wherein each input terminal stores a threshold electrical signal. When the control terminal of the multiplexer receives the threshold control signal, it selects the corresponding input terminal and sends the threshold electrical signal stored in the corresponding input terminal to the comparator (202) through the output terminal.

14. The circuit according to any one of claims 1 to 13, characterized in that, When the information of the signal of the first pixel unit is the number of signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) determines the threshold electrical signal of the first pixel unit corresponding to the number of signals of the first pixel unit according to the preset correspondence between the number of signals and the threshold electrical signal, and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit. When the information of the signal of the first pixel unit is the average interval between the signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) determines the threshold electrical signal of the first pixel unit corresponding to the average interval between the signals of the first pixel unit according to the preset correspondence between the average interval between the signals and the threshold electrical signal, and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit. When the signal of the first pixel unit is the minimum interval between the signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) determines the threshold electrical signal of the first pixel unit corresponding to the minimum interval between the signals of the first pixel unit according to the preset correspondence between the minimum interval between the signals and the threshold electrical signal, and obtains a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit according to the threshold electrical signal of the corresponding first pixel unit.

15. The circuit as described in any one of claims 1 to 13, characterized in that, When the information of the signal of the first pixel unit is the number of signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) is further used to determine whether the number of signals of the first pixel unit exceeds a set number threshold. If so, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal. If not, the threshold electrical signal of the first pixel unit corresponding to the signal of the first pixel unit is increased by a threshold electrical signal of a set level, wherein the set level is set according to the correspondence between the preset number of signals of the first pixel unit and the number threshold, and the adjustment level; based on the threshold electrical signal of the corresponding first pixel unit, a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained. When the information of the signal of the first pixel unit is the average interval between the signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) is further configured to determine whether the average interval between the signals of the first pixel unit exceeds a set average interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the average interval between the signals of the first pixel unit and the average interval threshold and the adjustment level. Based on the threshold electrical signal of the corresponding first pixel unit, a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained. When the signal of the first pixel unit is the minimum interval between the signals of the first pixel unit accumulated within the predetermined time, the signal processing sub-circuit (204) is further configured to determine whether the minimum interval between the signals of the first pixel unit exceeds a set minimum interval threshold. If yes, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is reduced by a set level of threshold electrical signal; if no, the threshold electrical signal of the first pixel unit currently corresponding to the signal of the first pixel unit is increased by a set level of threshold electrical signal. The set level is set according to the correspondence between the preset difference between the minimum interval between the signals of the first pixel unit and the minimum interval threshold and the adjustment level. Based on the threshold electrical signal of the corresponding first pixel unit, a threshold control signal for selecting the threshold electrical signal of the corresponding first pixel unit is obtained.

16. A pixel unit array circuit, characterized in that, include: A pixel unit array (201) consisting of pixel units arranged in rows and columns at least in one row, wherein the first pixel unit in the pixel unit array (201) includes: a comparator (202) and a threshold electrical signal generation sub-circuit (203), wherein, When the comparator (202) determines that the electrical signal is greater than the threshold electrical signal of the first pixel unit received from the threshold electrical signal generation sub-circuit (203), a reset signal and a signal are generated. The reset signal is used to select its own first reset switch for reset. The comparator (202) sends the signal to the signal processing sub-circuit (204). The threshold electrical signal generation subcircuit (203) in the first pixel unit obtains the threshold electrical signal of the first pixel unit based on the threshold control signal received from the signal processing subcircuit (204), and sends it to the comparator (202). The threshold control signal is information obtained by the signal processing subcircuit (204) from the signals of the first pixel unit within a predetermined time. The information of the signals of the first pixel unit is the number of signals of the first pixel unit accumulated within the predetermined time, the average interval between the signals of the first pixel unit accumulated within the predetermined time, or the minimum interval between the signals of the first pixel unit accumulated within the predetermined time. The threshold control signal is generated based on the set threshold electrical signal generation strategy and the information of the signals of the first pixel unit obtained within the predetermined time. The threshold control signal is used to select the threshold control signal of the first pixel unit, thereby adjusting the subsequent signal emission frequency of the first pixel unit by adjusting the threshold electrical signal. The comparator (202) is further configured to generate a reset signal and send it to the first pixel unit when it is determined that the electrical signal is greater than the threshold electrical signal of the first pixel unit, so that the first pixel unit is reset.

17. A method for adjusting the signal transmission frequency, characterized in that, include: A. The first pixel unit in the selected passing pixel unit of the pixel array of the circuit converts the light signal into an electrical signal; B. When it is determined that the electrical signal of the first pixel unit is greater than the threshold electrical signal of the first pixel unit, a signal is generated. The threshold electrical signal of the first pixel unit is information about the signals of the first pixel unit collected within a predetermined time. The information about the signals of the first pixel unit includes the number of signals of the first pixel unit accumulated within the predetermined time, the average interval between the signals of the first pixel unit accumulated within the predetermined time, or the minimum interval between the signals of the first pixel unit accumulated within the predetermined time. The signal is generated based on the set threshold electrical signal generation strategy and the information about the signals of the first pixel unit obtained within the predetermined time. C. Output the signal and return to step A to continue execution; Wherein, when it is determined that the electrical signal of the first pixel unit is greater than the threshold electrical signal of the first pixel unit, the method further includes: A reset signal is generated and sent to the first pixel unit to reset the first pixel unit.

18. An electronic device for imaging with an image sensor, characterized in that, include: The circuit with adjustable signal transmission frequency according to any one of claims 1-13, and / or the pixel unit array circuit according to claim 16, and / or the chip having the pixel unit array circuit according to claim 16.

19. The electronic device as claimed in claim 18, characterized in that, The electronic device includes at least one of the following: Cameras, webcams, audio / video players, navigation devices, fixed-location terminals, entertainment devices, smartphones, communication devices, mobile devices, vehicles or facilities, industrial equipment, medical devices, security equipment, flight equipment, and household appliances.

Citation Information

Patent Citations

  • Circuit with adjustable signal emission frequency, pixel unit array circuit and electronic equipment

    CN219181573U

  • Optical pixel and image sensor

    US20100026838A1

  • Split-gate conditional-reset image sensor

    US20160118424A1