Signal processing device, pixel circuit, detection device, and signal processing method

The signal processing device addresses the challenge of separate video and differential signal systems by generating digital signals efficiently, reducing system size and power consumption while maintaining signal linearity.

JP2024168216APending Publication Date: 2024-12-05NIPPON HOSO KYOKAI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023084699
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing technologies for event-based sensors require separate cameras for video and differential signals, leading to system size increase and complex synchronization, and compress analog signals logarithmically, losing linearity.

Method used

A signal processing device with a counter section that counts pulses over time, resets at a predetermined period, and compares values to generate a trigger signal when a threshold is met, allowing for digital video and difference signals without complex synchronization.

Benefits of technology

Enables easy acquisition of digital video and difference signals with reduced system size and power consumption, maintaining signal linearity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168216000001_ABST
    Figure 2024168216000001_ABST
Patent Text Reader

Abstract

To easily acquire a video image signal, and a differential signal indicating that there is a predetermined change of the video image signal.SOLUTION: A signal processing device comprises: an acquisition part that acquires a digital value of one bit that is changed with elapse of time; a counter part that performs a count operation in accordance with a value acquired by the acquisition part, and has the counter value reset at a predetermined period; a memory part that stores a value held at a time before the counter part is reset by being compressed to N times (N is a natural number of two or more); and a trigger signal generation part that compares the value held by the counter part at a specification time of a period with a value stored in the memory part, and generates a trigger signal in the case where the value acquired as a result of the comparison is a predetermined threshold value or larger. The counter part stops a count operation in accordance with the presence / absence of the generation fo the trigger signal.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a signal processing device, a pixel circuit, a detection device, and a signal processing method. [Background technology]

[0002] Conventionally, a technique is known in which, instead of continuously monitoring a sensor value expressed as an analog value, a trigger signal is obtained when the amount of change in the analog value becomes equal to or exceeds a threshold value. Such a technique makes it possible to reduce the amount of communication and achieve a high-speed response. An example of an analog value used in such a technique is the amount of light detected by a photodiode. Also, an example of a sensor that handles such an analog value is a moving image sensor.

[0003] In recent years, in the technical field of motion image sensors, the development of event-based sensors that detect the movement of a subject by outputting a signal corresponding to a change in pixel value (hereinafter, a signal output when the change in pixel value is equal to or greater than a predetermined threshold value may be referred to as a differential signal) instead of acquiring multiple frame images at high speed as a continuous video signal is progressing. Sensors using this type of technology are also called dynamic vision sensors.

[0004] According to the technology described in Non-Patent Document 1, a logarithmic response current-voltage conversion circuit and a differential detection circuit are mounted on a pixel to generate an event trigger, and information on the pixel whose value changes over time is output. Therefore, the sensor described in Non-Patent Document 1 can respond at high speed, can realize power saving, and is expected to be applied to vehicles, etc. However, such a sensor outputs only a differential signal, and another camera must be used in combination to output a video signal. Therefore, when trying to build a system using a video signal and a differential signal, there is a problem that the system becomes large. In addition, according to the technology described in Non-Patent Document 1, the signal obtained by the photodiode is logarithmically compressed to fit within the input range of the differential detection circuit, and there is a problem that the information is compressed and linearity is lost.

[0005] An example of a device for acquiring both a differential signal and a video signal is the technology described in Non-Patent Document 2. According to the technology described in Non-Patent Document 2, each pixel has an event trigger generation function using a differential detection circuit, as well as a readout function using a normal APS (Active Pixel Sensor) method, and can output both a differential signal and a video signal. [Prior art documents] [Non-patent literature]

[0006] [Non-Patent Document 1] T. Finateu et al., “A 1280×720 Back-Illuminated Stacked Temporal Contrast Event-Based Vision Sensor with 4.86μm Pixels, 1.066GEPS Readout, Programmable Event-Rate Controller and Compressive Data-Formatting Pipeline”ISSCC, 5.10, pp.112-113(2020) [Non-Patent Document 2] G. Taverni et al., “Front and Back Illuminated Dynamic and ActivePixel Vision Sensors Comparison”IEEE Transactions on Circuits and Systems-II: Express Briefs, Vol. 65, No. 5 pages 677-681, (2018) Summary of the Invention [Problem to be solved by the invention]

[0007] Here, the differential signal output by the technology described in Non-Patent Document 2 is a digital signal, whereas the video signal is output as an analog value. In order to extract the video signal as a digital signal, it is possible to perform A / D conversion outside the pixel area (for example, in the periphery of the same layer or a different layer) or outside the sensor chip (for example, a different chip). Regardless of which configuration is adopted, the system becomes large and synchronization with the differential signal must be achieved. That is, when both the differential signal and the video signal are used as digital values ​​using the technology described in Non-Patent Document 2, there is a problem that the system becomes large and the control for synchronizing with the differential signal becomes complicated. In addition, the technology described in Non-Patent Document 2, like the technology described in Non-Patent Document 1, logarithmically compresses the signal obtained by the photodiode to fit it within the input range of the differential detection circuit, and there is a problem that the information is compressed and linearity is lost.

[0008] Therefore, the present invention aims to provide a signal processing device, a pixel circuit, a detection device, and a signal processing method that can easily obtain a video signal and a differential signal indicating that a predetermined change has occurred in the video signal as digital values. [Means for solving the problem]

[0009] [1] In order to solve the above problems, a signal processing device according to one embodiment of the present invention includes an acquisition unit that acquires a 1-bit digital value that changes over time, a counter unit that performs a counting operation according to the value acquired by the acquisition unit and resets the counter value at a predetermined period, a memory unit that compresses the value held by the counter unit before the reset by N times (N is a natural number of 2 or more) and stores the compressed value, and a trigger signal generation unit that compares the value held by the counter unit with the value stored in the memory unit at a specific point in the period and generates a trigger signal if the value obtained as a result of the comparison is equal to or greater than a predetermined threshold, and the counter unit stops its counting operation depending on whether the trigger signal is generated or not.

[0010] [2] Moreover, in one aspect of the present invention, in the signal processing device described in [1] above, the specific point in time is a point in time when 1 / N of the period has elapsed since the counter unit was reset.

[0011] [3] Furthermore, in one aspect of the present invention, in the signal processing device described in [1] or [2] above, the counter unit stops counting operation if the trigger signal is not generated at the specific point in time.

[0012] [4] Furthermore, one aspect of the present invention is a signal processing device according to any one of [1] to [3] above, wherein the counter unit and the memory unit each comprise a plurality of 1-bit counter elements connected in series, and the number of counter elements in the counter unit is greater than the number of counter elements in the memory unit.

[0013] [5] Moreover, according to another aspect of the present invention, in the signal processing device according to any one of [1] to [4] above, a compression ratio N of the counter unit is a power of two.

[0014] [6] Moreover, in one aspect of the present invention, in the signal processing device according to any one of [1] to [5] above, a compression ratio N of the counter unit is 4 or 8.

[0015] [7] Furthermore, a pixel circuit according to one embodiment of the present invention includes a photodiode that outputs a current value corresponding to the amount of incident light, an A / D conversion unit that converts the current value output from the photodiode into a 1-bit digital value, and a signal processing device described in [1] to [6] above that acquires the 1-bit digital value converted by the A / D conversion unit, wherein the counter unit included in the signal processing device performs a counting operation corresponding to the amount of light incident on the photodiode, and the counter value is reset at a period corresponding to a frame rate.

[0016] [8] Moreover, according to an aspect of the present invention, in the pixel circuit according to the above [7], a compression ratio N of the counter unit is determined in accordance with the frame rate.

[0017] [9] Furthermore, one aspect of the present invention is a pixel circuit as described in [7] or [8] above, wherein a compression ratio N of the counter unit is determined according to either a first shooting mode for shooting a subject with a lot of movement or a second shooting mode for shooting a subject with a little movement, and the compression ratio N in the first shooting mode is smaller than the compression ratio N in the second shooting mode.

[0018]

[10] Moreover, one aspect of the present invention is a pixel circuit according to any one of [7] to [9] above, further comprising a transfer transistor that controls conduction of current between the photodiode and the A / D conversion unit, and a floating diffusion that is connected between the transfer transistor and the A / D conversion unit and accumulates charge.

[0019]

[11] Furthermore, a detection device according to one embodiment of the present invention includes a detection sensor that converts a specific physical quantity into a current value, an A / D conversion unit that converts the current value detected by the detection sensor into a 1-bit digital value, and a signal processing device according to claim 1 or claim 2 that acquires the 1-bit digital value converted by the A / D conversion unit and changes over time.

[0020]

[12] Furthermore, a signal processing method according to one aspect of the present invention includes an acquisition step of acquiring a 1-bit digital value that changes over time, a counter step of performing a counting operation according to the value acquired by the acquisition step and resetting the counter value at a predetermined period, a memory step of compressing the value held by the counter step before the reset by a factor of N (N is a natural number of 2 or more) and storing the compressed value, and a trigger signal generating step of comparing, at a specific point in time within the period, the value held by the counter step with the value stored in the memory step and generating a trigger signal if the value obtained as a result of the comparison is equal to or greater than a predetermined threshold, and the counter step stops its counting operation according to whether or not the trigger signal is generated. Effect of the Invention

[0021] According to the present invention, a video signal and a differential signal indicating that a predetermined change has occurred in the video signal can be easily obtained as digital values. [Brief description of the drawings]

[0022] [Figure 1] 2 is a schematic diagram showing an example of a solid-state imaging element according to the first embodiment having a three-dimensional structure. FIG. [Diagram 2] 1 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to a first embodiment. [Diagram 3] 4 is a timing chart illustrating pulse generation timing when light is incident on the photodiode according to the first embodiment. [Figure 4] 4 is a timing chart showing the output timing of a trigger signal output by the signal processing device according to the first embodiment and changes in a counter value and a memory value. [Diagram 5] FIG. 11 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to a second embodiment. [Figure 6] FIG. 11 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to a third embodiment. [Figure 7] FIG. 13 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] [Embodiment] First, the matters on which the embodiment is based will be described. The signal processing device, pixel circuit, detection device, and signal processing method according to the present embodiment perform processing on a sensor that detects a temporal variation of a specific physical quantity. Specifically, the sensor that detects a temporal variation of a specific physical quantity may be a sensor that converts a physical quantity into a current value. Examples of sensors that convert a physical quantity into a current value include an image sensor, a light sensor, a magnetic sensor, a pressure sensor, a sound sensor, a temperature sensor, and a humidity sensor. In the following example, an example will be described in which the signal processing device, pixel circuit, detection device, and signal processing method according to the present embodiment are applied to a solid-state imaging element that processes a signal output by using the photoelectric effect of a photodiode. The solid-state imaging element is used in an imaging device or the like.

[0024] [First embodiment] Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

[0025] 1 is a schematic diagram showing an example of a solid-state imaging element according to the first embodiment that is three-dimensionally structured. The solid-state imaging element 5 has a multi-layer structure. The figure shows an example of a three-layer structure having a first layer L1, a second layer L2, and a third layer L3. In each layer, a circuit element is formed by a semiconductor structure. The layers are insulated from each other by an interlayer insulating film. The circuit elements formed in each layer are connected by forming a via hole (contact hole) in the interlayer insulating film.

[0026] A plurality of photodiodes (pixels) are formed on the first layer L1. The photodiodes convert incident light into an electric signal. Specifically, the photodiodes output an electric signal according to the intensity of the incident light by the photoelectric effect. Here, in order to extract the electric signal output by the photodiode, a predetermined electric circuit such as an A / D conversion circuit is required. When a single-layer structure is adopted without the hierarchical structure shown in FIG. 1, the predetermined electric circuit is formed on the same surface as the photodiode, so that the arrangement interval between the plurality of photodiodes becomes large. However, by adopting the hierarchical structure shown in FIG. 1, it is not necessary to provide a predetermined electric circuit between the plurality of photodiodes, and the arrangement interval between the plurality of photodiodes can be reduced. Therefore, by adopting the hierarchical structure, the photodiodes can be arranged at a higher density. That is, a solid-state imaging element 5 with a high resolution can be provided.

[0027] A circuit for converting the electrical signal output by the photodiode into a pulse signal is formed on the second layer L2. Therefore, the circuit formed on the second layer L2 can also be called an A / D conversion circuit. The circuit formed on the second layer L2 may be, for example, an inverter chain circuit in which multiple inverters are connected in series. The inverter chain circuit outputs a voltage of H level or L level according to the input threshold voltage of the inverter element connected to the photodiode.

[0028] In addition, instead of the example in which an inverter chain circuit is formed on the second layer L2, a comparator circuit may be formed. The comparator circuit compares the electrical signal output by the photodiode with a predetermined reference voltage, and outputs a voltage of H level or L level according to the comparison result. Also, the second layer L2 may include a predetermined delay circuit.

[0029] A counter circuit, a memory circuit, and the like are formed on the third layer L3. The counter circuit counts the number of pulse signals output by the circuit formed on the second layer L2. The counter circuit has, for example, a 12-bit counter element, and counts values ​​from 1 to 4096. When the solid-state imaging element 5 outputs a video signal, the counter circuit counts the number of pulses input within a predetermined period, and outputs the counted value to a memory circuit, a control circuit, and the like. When the solid-state imaging element 5 outputs an actuation signal, the counter circuit detects whether the number of pulse signals input at a predetermined time exceeds a predetermined threshold, and outputs a trigger signal to a control circuit (not shown) when it is detected that the threshold has been exceeded. When the trigger signal is output, the counter circuit stops counting the number of pulse signals.

[0030] The counter circuit and the memory circuit of the solid-state imaging element 5 may be formed on different levels. For example, when one pixel has a counter circuit and a memory circuit, the counter circuit and the memory circuit may be formed on different levels by providing a fourth level L4 in addition to the third level L3. That is, the solid-state imaging element 5 is not limited to the example of the three-layer structure shown in the figure, but may have a hierarchical structure of four or more layers, or may not have a hierarchical structure (that is, each element may be formed on a single-phase substrate).

[0031] In the following description, a configuration including one pixel and peripheral circuits (e.g., an A / D conversion circuit and a counter circuit) corresponding to the pixel may be referred to as a pixel circuit 1. In the example shown in Fig. 1, the pixel circuit 1 has a three-layer structure including a first layer L1 to a part of a third layer L3. The pixel circuit 1 may be configured to have a multi-layer structure as shown in the figure, or may be formed on a single-layer substrate.

[0032] 2 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to the first embodiment. An example of the circuit configuration of the pixel circuit 1 will be described with reference to the same figure. The pixel circuit 1 includes a signal processing device 10 and a light amount detection device 20. The signal processing device 10 may be formed on the third hierarchical layer L3, and the light amount detection device 20 may be formed on the first hierarchical layer L1 and the second hierarchical layer L2. In the following description, the functions of the pixel circuit 1 will be described separately for the signal processing device 10 and the light amount detection device 20 for convenience, but part or all of the configuration of the light amount detection device 20 may be included in the signal processing device 10.

[0033] First, the configuration of the light amount detection device 20 will be described. The light amount detection device 20 includes a photodiode 21, an inverter chain 22, and a reset transistor 23. The photodiode 21 may be formed on a first hierarchical level L1, and the inverter chain 22 and the reset transistor 23 may be formed on a second hierarchical level L2. The light amount detection device 20 outputs a pulse signal according to the amount of light incident on the photodiode 21. The pixel circuit 1 can detect the amount of incident light by counting the number of pulse signals output from the light amount detection device 20.

[0034] The photodiode 21 has an anode terminal and a cathode terminal. The anode terminal is grounded, and the cathode terminal is connected to the input terminal of the inverter chain 22. The photodiode 21 generates charges according to the amount of incident light. The charges generated by the photodiode 21 are input to the inverter chain 22 as a voltage value according to the amount of generated charges. Specifically, the charges generated by the photodiode 21 are accumulated in a capacitance component (not shown) that exists between the cathode terminal of the photodiode 21 and the input terminal of the inverter chain 22. The accumulated charges appear as a voltage according to the magnitude of the capacitance component, and are input to the input terminal of the inverter chain 22. It can also be said that the photodiode 21 outputs a current value according to the amount of incident light. The capacitance component is sometimes called a floating diffusion. In addition, the voltage of the cathode terminal of the photodiode 21 is set to a voltage V PD It is sometimes called.

[0035] The inverter chain 22 includes a plurality of inverter elements connected in series. Specifically, the inverter elements may be CMOS (Complementary metal-oxide-semiconductor) inverters. In the example shown in FIG. 2, the inverter chain 22 includes an inverter 221, an inverter 222, ..., an inverter 22n (n is a natural number equal to or greater than 1). Each inverter element has an input terminal and an output terminal, and a voltage level opposite to the voltage level of the input terminal is output to the output terminal. For example, when 1 (high level) is input to the input terminal of each inverter element, 0 (low level) is output to the output terminal of the inverter element. Also, when 0 is input to the input terminal of the inverter element, 1 is output to the output terminal of the inverter element. Each inverter element has an input threshold voltage, and outputs a value according to the voltage value input to the input terminal and the threshold.

[0036] Here, it is preferable that the number of inverter elements provided in the inverter chain 22 is an odd number. By providing an odd number of inverter elements in the inverter chain 22, it becomes possible to invert the signal level in the inverter chain 22 as a whole. In other words, it is preferable that the inverter chain 22 as a whole inverts the voltage level input to the input terminal of the inverter chain 22 and outputs it to the output terminal. The voltage output by the inverter chain 22 is expressed as an output voltage V OUT It is sometimes called.

[0037] Here, the pulse width of the pulse signal output from the light amount detecting device 20 can be increased by increasing the number of inverter elements provided in the inverter chain 22. The pulse width can be decreased by decreasing the number of inverter elements provided in the inverter chain 22. The number of inverter elements provided in the inverter chain 22 may be set according to the pulse width of the pulse signal to be output from the light amount detecting device 20.

[0038] Furthermore, by adjusting the input threshold voltage of the inverter element closest to the photodiode 21, i.e., the inverter 221, among the multiple inverter elements included in the inverter chain 22, it is possible to adjust the amount of light corresponding to one pulse output from the light amount detection device 20. For example, by reducing the input threshold voltage, a pulse is output after more light is incident on the photodiode 21. Also, by increasing the input threshold voltage, a pulse is output after less light is incident on the photodiode 21.

[0039] In order to set the input threshold voltage more flexibly, a comparator circuit (not shown) may be used instead of the first-stage inverter element connected to the inverter chain 22 (the inverter element closest to the photodiode 21 among the multiple inverter elements included in the inverter chain 22, i.e., the inverter 221). The cathode terminal of the photodiode 21 is connected to one end of the input terminal of the comparator circuit. A predetermined reference voltage is input to the other end of the input terminal of the comparator circuit. The comparator circuit outputs a voltage corresponding to the voltage of the input terminal connected to the cathode terminal of the photodiode 21 and the reference voltage to an output terminal. A predetermined delay circuit may be provided in the subsequent stage of the comparator circuit. By using a comparator circuit with a delay circuit, the subsequent delay circuit (for example, an inverter chain) can be omitted.

[0040] Here, the inverter chain 22 serves as an A / D converter that converts an analog value into a digital value. The inverter chain 22 as an A / D converter converts the analog value into a digital value according to a comparison result between an analog value according to the output of the photodiode 21 and a predetermined threshold (for example, an input threshold voltage of an inverter element). It can also be said that the A / D converter converts the current value output from the photodiode 21 into a 1-bit digital value.

[0041] The reset transistor 23 outputs a reset voltage VRST The reset transistor 23 supplies a reset voltage V RST The reset transistor 23 resets the voltage level of the photodiode 21 by supplying a reset voltage V to the photodiode 21. In other words, the reset transistor 23 determines whether or not to apply a reset voltage to the photodiode 21 depending on the digital value output by the inverter chain 22. The reset transistor 23 may be, for example, an N-channel MOSFET (metal-oxide-semiconductor field-effect transistor). When the reset transistor 23 is an N-channel MOSFET, the gate terminal is connected to the output terminal of the inverter chain 22. The source terminal is connected to the reset voltage V RST The drain terminal is connected to the cathode terminal of the photodiode 21.

[0042] Here, when the reset transistor 23 is an enhancement type N-channel MOSFET, the reset voltage V RST is reduced by the threshold value of the reset transistor 23 and transmitted to the photodiode 21. Therefore, the reset transistor 23 may be a depletion-type N-channel MOSFET. It is also possible to use a P-channel MOSFET for the reset transistor 23. In this case, an inverter circuit is inserted in the gate terminal of the reset transistor 23. By using a P-channel MOSFET, the reset voltage V RST can be prevented from being decreased by the threshold value of the reset transistor 23 and being transmitted to the photodiode 21.

[0043] Under normal circumstances, i.e. when no light is incident on the photodiode 21, the voltage V PD is at a high level. The voltage V of the photodiode 21 PD When the input threshold voltage of the inverter 221 is reached, the output voltage V OUTWhen the inverter chain 22 outputs a high level, the source-drain of the reset transistor 23 is turned on, and the reset voltage V RST is supplied, and the voltage V of the photodiode 21 is PD is the reset voltage V RST The inverter chain is inverted again, and the output voltage V OUT When the signal goes to a low level, the source-drain of the reset transistor 23 is turned off. By repeating this operation, a pulse signal appears at the output terminal of the inverter chain 22.

[0044] Next, the configuration of the signal processing device 10 will be described. The signal processing device 10 receives an output value from the light amount detection device 20. The output value from the light amount detection device 20 is an output voltage V OUT is a 1-bit digital value whose value changes over time. The signal processing device 10 performs a counting operation in response to the input signal. The counting operation may be a count-up operation or a count-down operation. The signal processing device 10 outputs a counter value obtained as a result of the counting operation and a differential signal that is output when the counter value exceeds a predetermined threshold. The differential signal is a signal that is output when the change in the counter value is equal to or greater than the predetermined threshold. In the following description, an example of a case in which the signal processing device 10 performs a count-up operation will be described.

[0045] The signal processing device 10 includes a pulse signal acquiring section 11, a counter section 12, a memory section 13, and a trigger signal generating section 14. In the following description, the pulse signal acquiring section 11 may be simply referred to as an acquiring section.

[0046] The pulse signal acquiring unit 11 is a point where the signal processing device 10 and the light amount detecting device 20 are connected to each other. The pulse signal acquiring unit 11 has an output voltage V OUT is input. Output voltage V OUTis a 1-bit digital value that changes over time. Therefore, it can be said that the pulse signal acquisition unit 11 acquires a 1-bit digital value that changes over time. OUT It can also be said that the pulse signal acquiring unit 11 acquires a pulse signal. The value acquired by the pulse signal acquiring unit 11 is input to the counter unit 12.

[0047] The counter unit 12 performs a counting operation according to the value acquired by the pulse signal acquisition unit 11. The counter unit 12 counts the number of pulses generated in a certain period. The certain period is a predetermined cycle. For example, when the pixel circuit 1 is used in a camera capable of shooting a moving image at a predetermined frame rate, the certain period may be a period corresponding to the frame rate used for shooting the moving image. Specifically, the period corresponding to the frame rate may be the reciprocal of the frame rate. The counter unit 12 performs a counting operation for a period corresponding to the frame rate, and the counter value is reset for each period. That is, the counter unit 12 resets the counter value at a predetermined cycle.

[0048] The counter unit 12 includes an enable terminal EN. When the enable terminal EN is at a high level, the counter unit 12 performs a counting operation. When the enable terminal EN is at a low level, the counter unit 12 does not perform a counting operation. Hereinafter, the signal input to the enable terminal EN may be referred to as an enable signal EN.

[0049] In addition, a counter reset signal CRST (not shown) is input to the counter unit 12. When the counter reset signal CRST is at a high level, the counter unit 12 sets the counter value to an initial value. When the counter reset signal CRST is at a low level, the counter unit 12 performs a normal counting operation.

[0050] Memory unit 13 compresses and stores a value held by counter unit 12 at a specific time. In other words, memory unit 13 can also be said to be a latch circuit. Memory unit 13 stores the counter value before counter unit 12 is reset. The compression ratio N of memory unit 13 is preferably an integer of 2 or more. In other words, memory unit 13 compresses and stores the value held by counter unit 12 before it is reset by N times (N is a natural number of 2 or more).

[0051] The trigger signal generating unit 14 compares the value held by the counter unit 12 with the value stored in the memory unit 13, and outputs a trigger signal TR and a code S when the value obtained as a result of the comparison is equal to or greater than a predetermined threshold. In FIG. 2, the value held by the counter unit 12 is indicated as C, and the value stored in the memory unit 13 is indicated as M. The trigger signal generating unit 14 performs a comparison operation at a specific point in time during a specific period during which the counter unit 12 performs a counting operation. The specific point in time may be determined according to the compression rate N of the memory unit 13, for example.

[0052] The trigger signal TR is a signal indicating the presence or absence of a change in the amount of light incident on the photodiode 21. Specifically, the trigger signal TR is a signal indicating whether or not the difference between the number of pulse signals input to the counter unit 12 in a predetermined period and the counter value in the previous period is equal to or greater than a predetermined threshold. The predetermined threshold used for the determination may be determined according to the counter value in the previous period. That is, the trigger signal TR may be a difference signal output when the difference between the number of pulse signals input to the counter unit 12 in a predetermined period and the counter value in the previous period is equal to or greater than a predetermined threshold. As an example, the trigger signal TR may be a signal that becomes a High level (H) when the difference is equal to or greater than a predetermined threshold, and becomes a Low level (L) when the difference is smaller than the predetermined threshold. As another example, the trigger signal TR may be a pulse signal that is output depending on whether or not the difference is equal to or greater than a predetermined threshold.

[0053] The threshold value can be set according to the requirement regarding the difference in the amount of light required to generate an event trigger. For example, by setting the threshold value small, the trigger signal TR is output with a smaller amount of light (in other words, more sensitive). On the other hand, by setting the threshold value large, the trigger signal TR is output with a larger amount of light (in other words, less sensitive).

[0054] 3 is a timing chart for explaining the pulse generation timing when light is incident on the photodiode according to the first embodiment. With reference to the same figure, the output voltage V output by the inverter chain 22 when light is incident on the photodiode 21 is OUT The pulse generation timing of the photodiode 21 will be described. In the figure, the horizontal axis is time, and the voltage V PD The change in the output voltage V of the inverter chain 22 is shown as a waveform W11. OUT is shown as a waveform W12. In the figure, an example in which a constant amount of light continues to be incident on the photodiode 21 will be described.

[0055] In the description given with reference to the figure, the voltage supplied by the reset transistor 23 is referred to as a reset voltage V RST , the input threshold voltage of the inverter chain 22 is set to the threshold voltage V TH The output voltage V OUT is expressed as two values: low level (L) or high level (H).

[0056] Before time t0, no light is incident on the photodiode 21, so the voltage V PD is the reset voltage V RST In this state, since H is input to the inverter chain 22, the output voltage V OUT is L.

[0057] From time t0 to time t11, light is incident on the photodiode 21. In the example shown in FIG. 3, a constant amount of light continues to be incident on the photodiode 21, so that the voltage V PD decreases at a constant rate.

[0058] At time t11, the voltage V of the photodiode 21 PD is the threshold voltage V TH When the output voltage V OUT is inverted and outputs H. The output voltage V OUT When the voltage V PD is the reset voltage V RST Voltage V PD is the reset voltage V RST Then, H is input to the inverter chain 22, and the output voltage V OUT is inverted again to become L.

[0059] Since a constant amount of light continues to be incident on the photodiode 21, the voltage V PD is reset again, V RST Then, the output voltage V of the inverter chain 22 starts to decrease at a constant rate. In this manner, the operation performed at time t11 is repeated. As a result, the output voltage V OUT In the illustrated example, four pulses are output between time t11 and time t14.

[0060] After the inverter chain starts to invert, the voltage V PD is the reset voltage V RST The response time (delay time) until the output voltage V OUT Therefore, the sum of the delay times of the inverter elements included in the inverter chain 22 is the pulse width.

[0061] 4 is a timing chart showing the output timing of the trigger signal output by the signal processing device according to the first embodiment, and the changes in the counter value and memory value. With reference to the figure, the output timing of the trigger signal TR output by the signal processing device 10, and the changes in the counter value and memory value output by the counter unit 12 and the memory unit 13, respectively, will be described.

[0062] In this embodiment, an example in which the signal processing device 10 is applied to the solid-state imaging element 5 will be described. Therefore, each period may be called a frame. In the illustrated example, the period from time 0 to time t1 may be called the first frame, the period from time t1 to time t3 may be called the second frame, the period from time t3 to time t5 may be called the third frame, and the period from time t5 to time t7 may be called the fourth frame.

[0063] 4 shows, with the horizontal axis representing time, changes in the value held by counter unit 12 and changes in the value stored in memory unit 13. In the illustrated example, counter unit 12 holds a 12-bit signal, and memory unit 13 stores a 10-bit signal. Memory unit 13 compresses the value held in counter unit 12 by four times and stores it. That is, in the illustrated example, the compression rate N is 4. In the following description, the value held by counter unit 12 may be referred to as a counter value, and the value stored in memory unit 13 may be referred to as a memory value.

[0064] In addition, the figure shows the temporal changes of the trigger signal TR, the code S, the counter reset signal CRST, and the output signal OUT, with the horizontal axis representing time. These signals are 1-bit digital values. Details of the trigger signal TR, the code S, the counter reset signal CRST, and the enable signal EN have already been described with reference to FIG. 2, so their description will be omitted. The output signal OUT is a 1-bit digital signal that is output when a pixel value is read. The output signal OUT is output when a plurality of pixels provided in the image sensor are read, so it is output in each period regardless of whether the counter value COUT of the pixel circuit 1 is read or not. When the output signal OUT is at a high level, it indicates that the output operation of the counter value COUT, the trigger signal TR, and the code S is being performed. Note that, if code information is not required, the code S may be omitted and only the trigger signal TR may be generated and output.

[0065] First, the first frame will be described. At time 0, the counter reset signal CRST is turned ON and the counter value is reset to 0. After the counter value is reset to 0, the enable signal EN is turned ON and exposure of the first frame is performed. Specifically, the counter unit 12 performs an up-count operation according to the amount of light incident on the photodiode 21. Hereinafter, the frame period may be referred to as T.

[0066] At time t1, the signal value of the first frame is held in the counter unit 12, and the counter values ​​COUT of all pixels are output. Specifically, the output signal OUT is turned ON, and the counter values ​​are read out. The output from each pixel circuit 1 is read out by sequentially selecting the counter units 12, for example, by an XY address method or the like. Similarly, at time t1, a value is transferred from the counter unit 12 to the memory unit 13. In the illustrated example, since the compression rate N is 4, a value obtained by dividing the counter value at time t1 by 4 is transferred to the memory unit 13. In other words, if the value stored in the memory unit 13 is M and the value held in the counter unit 12 is C, then M such that M=C / N is stored in the memory unit 13.

[0067] Here, in the second and subsequent frames, the operation differs depending on the difference from the counter value in the previous frame. In the illustrated example, an example in which there is a difference in the second and fourth frames (more specifically, the difference is equal to or greater than a predetermined threshold) is described, and an example in which there is no difference in the third frame (more specifically, the difference is smaller than a predetermined threshold) is described.

[0068] Next, the second frame will be described. At time t1, the counter reset signal CRST is turned ON, and the counter value is reset to 0 again. After the counter value is reset to 0, the enable signal EN is turned ON, and the second frame is exposed. From the second frame onwards, a determination is made by the trigger signal generating unit 14 when 1 / N of the frame period has elapsed (i.e., when T / N has elapsed). In the determination by the trigger signal generating unit 14, the value held in the counter unit 12 is compared with the value stored in the memory unit 13. If the comparison result shows that the value held in the counter unit 12 is greater than the value stored in the memory unit 13, the code S becomes 1. Conversely, if the value held in the counter unit 12 is smaller than the value stored in the memory unit 13, the code S becomes 0. The trigger signal TR indicates whether or not there is a difference. In the judgment by the trigger signal generating unit 14, the absolute value of the value held in the counter unit 12 and the value stored in the memory unit 13 is calculated, and if the calculated value is equal to or greater than the threshold value, the trigger signal TR becomes 1, and if it is smaller than the threshold value, the trigger signal TR becomes 0. The threshold value used for the judgment is set depending on the requirement of what level of difference in light intensity is required to generate an event signal.

[0069] Here, the second frame is an example of a case where there is a difference. That is, at time t2, the trigger signal TR becomes 1. Also, since the value held in the counter unit 12 is smaller than the value stored in the memory unit 13, the code S becomes 0. In this case, the counter unit 12 continues accumulation for one frame, and outputs the counter value COUT at time t3 when the second frame ends. Also, at time t3, M such that M=C / N is stored in the memory unit 13.

[0070] Next, the third frame will be described. The third frame is an example of a case where there is no difference. That is, at time t4 when T / N has elapsed, the trigger signal generating unit 14 makes a decision and the trigger signal TR becomes 0. In this case, it is determined that there is no need to output the counter value held in the counter unit 12 and update the memory value stored in the memory unit 13. In addition, the enable terminal EN is set to Low, and the counting operation of the counter unit 12 is stopped. That is, the counter unit 12 can also be said to stop the counting operation depending on whether or not the trigger signal TR is generated. By stopping the counting operation of the counter unit 12, it is possible to reduce power consumption. At time t5 at the end of the third frame, the counter value COUT is not output, and the memory value is not updated. In addition to setting the enable terminal EN to Low, the counting operation of the counter unit 12 may be stopped by a method of cutting off the power supplied to the counter unit 12 (i.e., power gating).

[0071] In the illustrated example, from time t4 to time t5 when the next cycle starts, the counter unit 12 holds the value at time t4. However, the present invention is not limited to this example, and the counter value may be reset to 0 by turning on the counter reset signal CRST.

[0072] The fourth frame is an example of a case where there is a difference, similar to the second frame. The fourth frame is performed in substantially the same manner as the second frame, and therefore a detailed description of the similar operations will be omitted. The fourth frame is different from the second frame in that the slope of the counter value is steeper (i.e., the amount of light incident on the photodiode 21 is greater). In this case, the code S is 1.

[0073] The trigger signal TR is sent to an address generation circuit (not shown) provided around the pixel array or within the pixel, and address information (XY coordinates) of the pixel where the trigger signal TR was 1 is output together with the code S.

[0074] In addition, in the first frame, it is preferable to output the output signal OUT from all pixels. In the second frame and after, it is preferable to read out only the video signals of the pixels where the trigger signal TR was 1, rather than outputting all pixels. Here, it takes a certain amount of time for the counter unit 12 of each pixel to output. Therefore, if the output time from the counter unit 12 of each pixel is longer than the period of the pulse output, it is preferable to set the enable signal EN to a low level as shown in the figure and stop the operation of the counter unit 12. By setting the enable signal EN to a low level, it is possible to prevent the count value from changing.

[0075] In the illustrated example, the trigger signal TR and the code S hold their values ​​until the time of determination by the trigger signal generating unit 14 (i.e., time t2, time t4, and time t6). However, the present embodiment is not limited to this example, and it is sufficient that the trigger signal TR and the code S are held until the output signal OUT is output. Therefore, the values ​​of the trigger signal TR and the code S may be reset to 0 at the beginning of each frame, for example, at the timing when the counter reset signal CRST is turned ON.

[0076] Here, the difference can be determined at the point when the period T is divided by the compression rate N only if the amount of light can be considered constant during the period T. In other words, if the photocurrent is I and the signal charge is Q, then this is the case when the relationship Q(t) = It holds. For a signal charge during one frame period Q(T) = I x T, the signal charge at time T / N is Q(T / N) = I x T / N, which is 1 / N of Q(T). However, by multiplying the memory value to be compared by 1 / N, the two can be compared with each other regardless of the value of N.

[0077] When the trigger signal TR is 1, the memory value can be updated by transferring the counter value at the time of T / N as is to obtain a video signal. However, from the viewpoint of improving the S / N ratio, it is possible to obtain a more accurate video signal by determining the memory value by making the exposure time as long as possible (by making the counter value large). Therefore, as described above, it is desirable to update the memory value at the end of the frame period.

[0078] In the above description, a method of outputting all pixels without performing trigger determination only for the first frame has been described. However, the present embodiment is not limited to this example, and even for the first frame, some initial value (for example, 0) may be input to the memory unit 13, and difference determination may be performed from the beginning in the same manner as for the second frame and thereafter.

[0079] [Summary of the first embodiment] According to the embodiment described above, the signal processing device 10 includes a pulse signal acquiring section 11, a counter section 12, a memory section 13, and a trigger signal generating section 14. The pulse signal acquiring section 11 acquires a 1-bit digital value that changes over time, the counter section 12 performs a counting operation according to the value acquired by the pulse signal acquiring section 11, and the count value is reset at a predetermined period (for example, a period according to a frame rate), the memory section 13 compresses the value held by the counter section 12 before the counter section 12 is reset by N times (N is a natural number of 2 or more) and stores it, and the trigger signal generating section 14 compares the value held by the counter section 12 with the value stored in the memory section 13 at a specific time point in the period in which the counter section 12 is reset, and generates a trigger signal TR when the comparison result is equal to or greater than a predetermined threshold. Here, the trigger signal TR is a difference signal indicating that a predetermined change has occurred in the count value. Furthermore, when the signal processing device 10 is applied to the pixel circuit 1, the value held by the counter section 12 is a digital value indicating a video signal. Therefore, the signal processing device 10 can obtain the video signal and the differential signal indicating that a predetermined change has occurred in the video signal with a small circuit scale and without requiring complex calculations. Therefore, the signal processing device 10 can easily obtain the video signal and the differential signal indicating that a predetermined change has occurred in the video signal as digital values.

[0080] Furthermore, the counter unit 12 stops the counting operation depending on whether or not a trigger signal TR is generated. Specifically, the counter unit 12 stops the counting operation when it is determined based on the trigger signal TR that there is no difference from the previous frame. Here, when there is no difference from the previous frame, the same counter value (video signal) as that of the previous frame can be used, so that performing the counting operation consumes power. Therefore, according to this embodiment, the signal processing device 10 stops the counting operation depending on whether or not a trigger signal TR is generated, and therefore power consumption can be suppressed.

[0081] According to the above-described embodiment, the specific time point at which the presence or absence of a difference is determined is the time point when 1 / N of the period (e.g., one frame) at which the counter unit 12 is reset has elapsed. Here, the value held by the counter unit 12 at the end of the previous frame is stored in the memory unit 13. Therefore, according to the present embodiment, the presence or absence of a difference can be easily determined by comparing the counter value compressed to 1 / N at the time when 1 / N has elapsed.

[0082] According to the present embodiment, the specific time point at which the presence or absence of a difference is determined is not limited to the time point when 1 / N has elapsed. For example, it is also possible to determine the presence or absence of a difference at a time point other than the time point when 1 / N has elapsed. When determining the presence or absence of a difference at a time point other than the time point when 1 / N has elapsed, it may be necessary to manipulate the value stored in the memory unit 13.

[0083] Here, the compression rate N applied when the value held in the counter unit 12 is stored in the memory unit 13 corresponds to the effect of reducing power consumption. That is, the larger the compression rate N, the earlier the presence or absence of a difference is determined, and the earlier the counting operation of the counter unit 12 can be stopped, so the effect of reducing power consumption is also greater. On the other hand, the smaller the compression rate N, the later the presence or absence of a difference is determined, and the later the counting operation of the counter unit 12 is stopped, so the effect of reducing power consumption is also smaller. However, if the compression rate N is too large, there is a possibility of erroneous determination in the case where a difference occurs after the determination in a frame where no difference is determined, that is, when the amount of light changes in the middle of one frame. Furthermore, if the compression rate N is too large, and the time until the difference determination is shortened, the effect of shot noise, etc. may occur.

[0084] In order to prevent such erroneous judgment and reduce the influence of shot noise, etc., it is desirable to set a suitable compression rate N. The suitable compression rate N is preferably determined according to, for example, the frame rate. For example, when the frame rate is high, that is, when one period is short, it is preferable to set N small. Also, when the frame rate is low, that is, when one period is long, it is preferable to set N large. Moreover, the compression rate N may be determined according to the time when one period is compressed to 1 / N. Furthermore, the maximum value of the compression rate N may be determined by comparing the time when one period is compressed to 1 / N with a predetermined threshold value.

[0085] Furthermore, when the signal processing device 10 is used in an image capturing device that captures moving images, the compression rate N of the counter unit 12 may be determined according to the image capturing mode of the moving images. For example, when the image capturing device has a first image capturing mode for capturing an object with a lot of movement and a second image capturing mode for capturing an object with a little movement, the compression rate N may be determined according to whether the image capturing mode is the first image capturing mode or the second image capturing mode. In this case, it is preferable that the compression rate N in the first image capturing mode is smaller than the compression rate N in the second image capturing mode.

[0086] [Second embodiment] Next, a second embodiment will be described with reference to Fig. 5. In the second embodiment, specific configurations of the counter unit 12 and the memory unit 13 will be described. The second embodiment can also be said to be a specific example of the first embodiment.

[0087] FIG. 5 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to the second embodiment. With reference to the same figure, an example of a circuit configuration of a pixel circuit 1A will be described. The pixel circuit 1A includes a light amount detection device 20 and a signal processing device 10A. That is, the pixel circuit 1A differs from the first embodiment in that the pixel circuit 1A includes a signal processing device 10A instead of the signal processing device 10. In the description of the pixel circuit 1A, the same components as those in the pixel circuit 1 may be denoted by the same reference numerals and description thereof may be omitted. The signal processing device 10 includes a pulse signal acquisition unit 11, a counter unit 12A, a memory unit 13A, and a trigger signal generation unit 14.

[0088] The counter unit 12A includes an asynchronous counter circuit that counts the number of pulse signals input during a predetermined period. The counter circuit includes a multi-bit counter element. With reference to the same figure, an example of a multi-bit counter element including 12-bit counter elements 121 to 1212 will be described.

[0089] The counter unit 12A can be designed arbitrarily using existing technology. In the following description, as an example, a case where a T flip-flop (T-FF) is used as a counter element will be described. Note that the configuration of the T flip-flop may be realized using a D flip-flop or the like.

[0090] Next, a configuration common to counter elements of multiple bits will be described. A counter element has an input terminal and an output terminal. An output signal from the previous stage is input to the input terminal. A pulse signal acquired by the pulse signal acquisition unit 11 is input to the counter element 121, which is the least significant bit. In the connection between the counter elements, an output signal of the counter element of the previous stage is input to each input terminal. The output terminal outputs a signal from either the non-inverting output terminal or the inverting output terminal of the T flip-flop. The output terminal outputs the signal input to the input terminal to the counter element of the next stage.

[0091] Of the 12-bit counter elements 121 to 1212, the counter element 121, which is the least significant bit, has an enable terminal. A 1-bit digital signal is input to the enable terminal. The 1-bit digital signal input to the enable terminal determines whether the input signal is valid or not. Specifically, by having the enable terminal, the counter element 121 can control the input of the input terminal to be valid or invalid according to the input voltage level. By invalidating the input of the input terminal for the least significant bit, the least significant bit will no longer perform a count operation, and therefore the count operations of the other counter elements provided in the counter unit 12A can also be invalidated.

[0092] Further, a counter reset signal CRST (not shown) may be input to each counter element. When the counter reset signal CRST is at a high level, the counter value of each counter element is set to an initial value, and when the counter reset signal CRST is at a low level, each counter element performs a normal counter operation.

[0093] In the illustrated example, the counter output signal COUT is output from the counter element 1212, which is the most significant bit, but in actual connection, it may be output in parallel from each counter element.

[0094] The memory unit 13A includes a memory circuit that stores the counter value output from the counter unit 12A. The memory circuit includes a multi-bit memory element. With reference to the same figure, an example of a multi-bit memory element including 10-bit memory elements 131 to 1310 will be described.

[0095] The memory unit 13A can be designed arbitrarily using existing technology. In the following description, as an example, a case where a T flip-flop (T-FF) is used as a memory element, similar to the counter unit 12A, will be described. Note that the configuration of the T flip-flop may be realized using a D flip-flop or the like.

[0096] The configuration of the memory element is the same as that of the counter element described above, and therefore the description will be omitted. When a value is transferred from the counter unit 12A to the memory unit 13A, the value is compressed to 1 / 4, so that the 3rd to 12th bits of the counter unit 12A are transferred to correspond to the 1st to 10th bits of the memory unit 13A, respectively.

[0097] Moreover, the comparison by the trigger signal generating unit 14 may be performed using the lowest 10 bits (the 1st bit to the 10th bit). Specifically, the counter elements 121 to 1210 may be compared with the memory elements 131 to 1310. For example, when 4 bits are used as the threshold value, the absolute values ​​of the value held by the counter unit 12A and the value stored in the memory unit 13A are looked at from the most significant bit to detect in which bit a 1 first appears, and if it is the 4th bit or higher, the trigger signal TR may be set to 1.

[0098] As shown in the figure, counter unit 12A and memory unit 13A are both made up of multiple 1-bit counter elements or memory elements connected in series, so if the value of compression rate N is a power of 2, data can be easily transferred and compared simply by shifting the bits. Therefore, it is preferable that compression rate N is a power of 2. More preferably, compression rate N is about 4 or 8. By setting compression rate N to about 4 or 8, the effect of shot noise is reduced, and the effect of reducing power consumption can be obtained.

[0099] [Summary of the second embodiment] By adopting the above configuration, it is possible to output a video signal and a differential signal. Both the video signal and the differential signal are digital signals, and the pixel circuit 1A can output two types of digital signals using a simple circuit configuration consisting of a relatively small number of transistors, namely an inverter chain and a counter (series connection of 1-bit counters). In addition, the relationship between the amount of light and the number of pulses is linear, making it possible to obtain accurate video information and differential information that reflect the subject being photographed.

[0100] By using a three-dimensional structure as shown in FIG. 1, it is possible to prevent an increase in pixel size and realize a sensor that outputs a high-resolution video signal and event information. Furthermore, depending on the application, it is possible to always output only event information, output all-pixel video signals in addition to event information, output only event information and video signals that have changed, or capture images while switching between a plurality of these modes. According to this embodiment, compared to a normal camera, the output of event information makes it possible to detect motion information. Furthermore, according to this embodiment, in modes other than the mode in which all-pixel video signals are output, it becomes possible to reduce data without reducing useful information.

[0101] [Third embodiment] Next, a third embodiment will be described. A pixel circuit 1B according to the third embodiment is a modified example of the pixel circuit 1 or the pixel circuit 1A.

[0102] FIG. 6 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to a third embodiment. With reference to the same figure, an example of a circuit configuration of a pixel circuit 1B will be described. The pixel circuit 1B includes a light amount detection device 20B and a signal processing device 10. That is, the pixel circuit 1B differs from the first and second embodiments in that the pixel circuit 1B includes a light amount detection device 20B instead of the light amount detection device 20. In the description of the pixel circuit 1B, the same components as those of the pixel circuit 1 or the pixel circuit 1A may be denoted by the same reference numerals and description thereof may be omitted. The light amount detection device 20B differs from the light amount detection device 20 in that it has a configuration having an embedded photodiode. The light amount detection device 20B includes a photodiode 21B, which is an embedded photodiode, instead of the photodiode 21, and further includes a transfer transistor 24 and a floating diffusion 25.

[0103] The transfer transistor 24 is provided between the photodiode 21B, which is an embedded photodiode, and the inverter chain 22. The floating diffusion 25 is provided between the transfer transistor 24 and the inverter chain 22. The transfer transistor 24 is controlled by a control unit (not shown), and transfers the charge generated by the photodiode 21B to the floating diffusion 25. That is, the transfer transistor 24 controls the conduction of current between the photodiode 21B and the inverter chain 22 serving as an A / D conversion unit. The floating diffusion 25 accumulates the charge generated by the photodiode 21B.

[0104] [Fourth embodiment] Next, a fourth embodiment will be described. FIG. 7 is a circuit diagram showing an example of a circuit configuration of a pixel circuit according to the fourth embodiment. A detection circuit 1C will be described with reference to the same figure. The detection circuit 1C according to the fourth embodiment is a modified example of the pixel circuit 1, the pixel circuit 1A, or the pixel circuit 1B. The detection circuit 1C differs from the pixel circuit 1 in that it includes a detection sensor 21C instead of the photodiode 21. The detection sensor 21C converts a specific physical quantity into a current value. The detection sensor 21C continuously detects changes in a specific physical quantity. That is, the detection sensor 21C is a sensor that captures a temporal change in a specific physical quantity. The detection circuit 1C can also be applied to a detection device or a measurement device that employs such a detection sensor 21C. The detection circuit 1C can also be widely applied to logic circuits, drive circuits, communication circuits, recording elements, displays, actuators, and the like.

[0105] The effects described in this specification are merely explanatory or exemplary and are not limiting. In other words, the technology according to the present disclosure may have other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects. Furthermore, the present invention is not limited to these embodiments, and various modifications and substitutions can be made within the scope of the present invention. [Explanation of symbols]

[0106] 5. Solid-state imaging element 1. Pixel circuit 10 Signal Processing Device 11 Pulse signal acquisition unit 12 Counter section 13 Memory section 14 Trigger signal generator TR Trigger signal S code 20 Light quantity detection device 21 Photodiode 22 Inverter Chain 23 Reset transistor

Claims

1. An acquisition unit that acquires a 1-bit digital value that changes over time; a counter unit that performs a counting operation in accordance with the value acquired by the acquisition unit and resets the counter value at a predetermined cycle; a memory unit that compresses the value held by the counter unit before resetting the value by N times (N is a natural number of 2 or more) and stores the compressed value; a trigger signal generating unit that compares a value held by the counter unit with a value stored in the memory unit at a specific time point in the cycle, and generates a trigger signal when the value obtained as a result of the comparison is equal to or greater than a predetermined threshold value; The counter section stops the counting operation depending on whether the trigger signal is generated or not. Signal processing device.

2. The specific time point is the time point when 1 / N of the period has elapsed since the counter unit was reset. The signal processing device according to claim 1 .

3. The counter unit stops the counting operation if the trigger signal is not generated at the specific time point.

3. The signal processing device according to claim 1 or 2.

4. The counter unit and the memory unit each include a plurality of 1-bit counter elements connected in series, The number of counter elements included in the counter unit is greater than the number of counter elements included in the memory unit.

3. The signal processing device according to claim 1 or 2.

5. The compression ratio N of the counter is a power of 2.

3. The signal processing device according to claim 1 or 2.

6. The compression ratio N of the counter is 4 or 8. The signal processing device according to claim 5 .

7. a photodiode that outputs a current value according to the amount of incident light; an A / D converter that converts the current value output from the photodiode into a 1-bit digital value; and acquiring a 1-bit digital value converted by the A / D converter, the counter unit of the signal processing device performs a counting operation according to the amount of light incident on the photodiode, and resets a counter value at a period according to a frame rate. Pixel circuit.

8. The compression rate N of the counter unit is determined according to the frame rate.

8. The pixel circuit of claim 7.

9. the compression ratio N of the counter unit is determined according to either a first photographing mode for photographing a subject with a large amount of movement or a second photographing mode for photographing a subject with a small amount of movement; The compression ratio N in the first shooting mode is smaller than the compression ratio N in the second shooting mode.

8. The pixel circuit of claim 7.

10. a transfer transistor that controls conduction of a current between the photodiode and the A / D conversion unit; a floating diffusion connected between the transfer transistor and the A / D conversion unit and configured to accumulate electric charges; The pixel circuit of claim 7 further comprising:

11. A detection sensor that converts a specific physical quantity into a current value; an A / D converter for converting the current value detected by the detection sensor into a 1-bit digital value; 3. The signal processing device according to claim 1, wherein the A / D converter converts the digital signal into a 1-bit digital value that changes over time. A detection device comprising:

12. An acquisition step of acquiring a 1-bit digital value that changes over time; a counter step of performing a counting operation according to the value acquired by the acquisition step and resetting the counter value at a predetermined period; a memory step of compressing the value held by the counter step before resetting the value by N times (N is a natural number of 2 or more) and storing the compressed value; a trigger signal generating step of comparing a value held by the counter step with a value stored in the memory step at a specific time point in the cycle, and generating a trigger signal when the value obtained as a result of the comparison is equal to or greater than a predetermined threshold value, The counter step stops the counting operation depending on whether the trigger signal is generated or not. Signal processing methods.