Imaging device, imaging method, and control program for imaging device

By grouping and synchronizing the exposure of image sensor elements, the imaging device addresses signal saturation and dark output issues, enabling a broader exposure range capture.

JP7593092B2Active Publication Date: 2024-12-03NEC CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2020210945
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-21
Publication Date
2024-12-03
Estimated Expiration
2040-12-21

AI Technical Summary

Technical Problem

Existing imaging devices using CCD and CMOS image sensors face signal saturation and increased dark output due to high light exposure, limiting the range of exposure amounts that can be captured without saturation.

Method used

An imaging device that groups adjacent image sensor elements and controls them to expose and sum outputs at the same timing, reducing charge generation and dark output, thereby suppressing signal saturation and expanding the exposure range.

Benefits of technology

The solution effectively suppresses signal saturation and dark output, allowing for a wider range of exposure amounts to be captured without saturation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593092000001
    Figure 0007593092000001
  • Figure 0007593092000002
    Figure 0007593092000002
  • Figure 0007593092000003
    Figure 0007593092000003
Patent Text Reader

Abstract

To provide an imaging apparatus capable of widening the range of exposure that can be captured, by suppressing an increase in dark output while suppressing the saturation of signals of image sensor elements.SOLUTION: An imaging apparatus includes an array sensor and imaging control means. The array sensor comprises a plurality of image sensor elements arranged in an array. The imaging control means composes a group with a predetermined number of adjacent image sensor elements, and performs a control to add up outputs obtained by exposing the image sensor elements in each group at the same timing.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, an imaging method, and a control program for the imaging apparatus. [Background technology]

[0002] In recent years, charge coupled device (CCD) image sensors and complementary metal oxide semiconductor (CMOS) image sensors have been widely used in imaging devices. In such image sensors, a plurality of pixels, each of which is made up of a photoelectric conversion element, is arranged in an array.

[0003] The sensitivity of each pixel is adjusted appropriately depending on the application, but when light stronger than the expected level is incident, the problem of signal saturation occurs. A method for avoiding such signal saturation is disclosed, for example, in Patent Document 1. In the technology of Patent Document 1, the exposure time within one frame is divided into multiple parts, and exposure is performed in multiple steps, which reduces the amount of charge generated per exposure, thereby preventing signal saturation. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-109503 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology of Patent Document 1, the number of switching times (driving speed) per unit time increases in proportion to the number of divisions, which causes the temperature of the element to rise. As the temperature rises, charges are generated and the offset (dark output) increases, which causes a problem that the range of exposure that can be captured without saturating the signal becomes narrower.

[0006] The present invention has been made in consideration of the above problems, and aims to provide an imaging device that can widen the range of exposure that can be captured by suppressing saturation of the signal of the image sensor element while suppressing an increase in dark output. [Means for solving the problem]

[0007] In order to solve the above problems, the imaging device of the present invention has an array sensor in which a plurality of image sensor elements are arranged in an array, and an imaging control means for summing outputs obtained by exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same time.

[0008] In addition, the imaging method of the present invention includes an imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array, and sums up outputs obtained by exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing.

[0009] In addition, the control program for an imaging device of the present invention causes a computer to control an imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array, and causes the imaging device to execute a process of summing up outputs obtained by exposing, at the same time, image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements. Effect of the Invention

[0010] The effect of the present invention is to provide an imaging device capable of suppressing saturation of signals from image sensor elements while suppressing an increase in dark output, thereby widening the range of exposure amounts that can be used for imaging. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an imaging apparatus according to a first embodiment. [Diagram 2] 1 is a circuit diagram showing an example of a configuration of an image sensor element according to a first embodiment. [Diagram 3] 4 is a timing chart showing the operation of the imaging device according to the first embodiment. [Figure 4] 4 is a timing chart showing the operation of the imaging device of Comparative Example 1. [Diagram 5] 11 is a timing chart showing the operation of the imaging device of Comparative Example 2. [Figure 6] FIG. 11 is a block diagram showing the configuration of an imaging apparatus according to a second embodiment. [Figure 7] FIG. 11 is a block diagram showing a configuration of an imaging control unit of an imaging device according to a second embodiment. [Figure 8] FIG. 11 is a plan view illustrating an example of an array sensor used in an imaging device according to a second embodiment. [Figure 9] FIG. 11 is a schematic diagram showing an imaging device according to a second embodiment. [Figure 10] FIG. 13 is a block diagram showing a group setting unit used in the imaging device of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. However, the embodiments described below are limited in a technically preferable manner for carrying out the present invention, but the scope of the invention is not limited to the following. Note that the same components in each drawing are given the same numbers, and the description may be omitted.

[0013] (First embodiment) 1 is a block diagram showing an imaging device 10 according to a first embodiment. The imaging device 10 includes an array sensor 1 and imaging control means 2.

[0014] The array sensor 1 has a plurality of image sensor elements arranged in an array.

[0015] The imaging control means 2 groups a predetermined number of adjacent image sensor elements P. Then, the image sensor elements P in each group are exposed at the same timing, and the outputs of the image sensor elements in the group are summed up.

[0016] The image sensor element is a photoelectric conversion element that generates a charge according to the amount of exposure. Figure 2 is a circuit diagram showing an example of the configuration of the image sensor element. The image sensor element has a photodiode PD1 and three transistors Tr1, Tr2, and TR3. The image sensor element accumulates the charge generated by the photodiode PD1 in a capacitance Cp, amplifies a signal according to the amount of charge by Tr2, and controls Tr3 to output a signal Sg to a signal line.

[0017] Fig. 3 is a timing chart showing the operation of the image sensor elements P1 and P2 belonging to Gr1 in Fig. 1. Although there are two sets of control circuits, in this embodiment, since transistors belonging to the same group operate at the same timing, the timing chart for the reset signal Rs and the read signal Sr is represented by one.

[0018] First, at time t1, a reset pulse Rs1 is generated. This turns on the transistor Tr1, and the charge accumulated in the capacitance Cp is discharged. Immediately thereafter, Tr1 turns off, and the accumulation of the charge generated in the photodiode PD of the image sensor elements P1 and P2 begins. Next, at time t2, a read pulse Sr1 is generated, and the transistor Tr3 turns on. This causes signals Sg11 and Sg21 corresponding to the accumulated charge of the image sensor elements P1 and P2 to be output to the signal line. The time from time t1 to t2 is the exposure time Te11 and Te21, but Te11=Te21. After the signals Sg11 and Sg21 are read out, a reset pulse Rs2 is generated at time t3, Tr1 turns on, and the accumulated charge is discharged. The time from time t0 to t3 is one frame Tf. Then, the imaging control means 2 adds up the signals Sg11 and Sg21 and processes them as a signal of one pixel.

[0019] By the above operation, an image signal is obtained in which the group Gr1 consisting of the image sensor elements P1 and P2 is treated as one pixel. In this operation, if Sg1 and Sg2 are not saturated, the image signal is not saturated.

[0020] FIG. 4 is a timing chart showing the operation of the imaging device in the imaging method of Comparative Example 1. This is a general operation in which one image sensor element is one pixel in one frame and one exposure is performed. Here, one pixel is exposed with an exposure amount equivalent to the sum of the exposure amounts of two image sensor elements in the imaging operation of this embodiment of FIG. 3. For this reason, FIG. 4 shows only the operation of P1. First, a reset pulse Rso1 is generated at time to1, and the charge of the image sensor element P1 is discharged. Immediately thereafter, Tr1 is turned off, and accumulation of the charge generated in the photodiode PD of the image sensor element P1 is started. Next, a read pulse Sro1 is generated at time to2, and the transistor Tr3 is turned on. As a result, a signal Sgo11 according to the accumulated charge of the image sensor element P1 is output to the signal line. The time from time to1 to to2 is the exposure time Teo1. In the example of Fig. 4, in order to obtain an exposure amount equivalent to the combined exposure amount of the two image sensor elements in Fig. 3 in one exposure of one image sensor element, it is necessary to set the exposure time Teo1 to twice the exposure time Te11 (Te21) in Fig. 3. This increases the amount of accumulated charge, making it easier for saturation of the signal Sgo11 to occur.

[0021] FIG. 5 is a timing chart showing the operation of the imaging device in the imaging method of Comparative Example 2. In Comparative Example 2, the technology of Patent Document 1 is used to perform exposure of one image sensor element twice in one frame, and exposure of the same amount of exposure as in Comparative Example 1 is performed. FIG. 5 shows only the operation of P1. First, at time t'1, a reset pulse Rs'1 is generated, and the charge of the image sensor element P1 is discharged. Immediately thereafter, Tr1 is turned off, and accumulation of the charge generated in the photodiode PD of the image sensor element P1 is started. Next, at time t'2, a read pulse Sr'1 is generated, and the transistor Tr3 is turned on. As a result, a signal Sg'11 according to the accumulated charge of the image sensor element P1 is output to the signal line. The time from time t'1 to t'2 is the first exposure time Te'1 of the exposure divided into two parts. After the signal Sg'11 is read out, a reset pulse Rs'2 is generated at time t'3, Tr1 is turned on, and the accumulated charge is discharged. Next, at time t'4, a reset pulse Rs'3 is generated, and the charge of the image sensor element P1 is discharged. Immediately thereafter, Tr1 is turned off, and the accumulation of the charge generated in the photodiode PD of the image sensor element P1 is started. Next, at time t'5, a read pulse Sr'2 is generated, and the transistor Tr3 is turned on. As a result, a signal Sg'12 corresponding to the accumulated charge of the image sensor element P1 is output to the signal line. The time from time t'4 to t'5 is the second exposure time Te'2 of the exposure divided into two. After the signal Sg'12 is read out, a reset pulse Rs'4 is generated at time t'6, and Tr1 is turned on, and the accumulated charge is discharged. The time from time t0 to t'6 is one frame Tf. Then, the imaging control means 2 adds up the signals Sg'11 and Sg'12 and processes them as a pixel signal of one frame of the image sensor element P1.

[0022] The above operation provides an imaging signal of the image sensor element P1. In the operation of Comparative Example 2, the same exposure as in Comparative Example 1 is performed twice. Therefore, the signals Sg'11 and Sg'12 in Comparative Example 2 are roughly half those in Comparative Example 1, and the signals are less likely to become saturated.

[0023] As described above, in both the operation of the present embodiment in FIG. 3 and the operation of the comparative example 2 in FIG. 5, the amount of charge generated in one exposure can be roughly halved compared to the comparative example 1. This makes it possible to suppress signal saturation in both operations. On the other hand, in the operation of the present embodiment in FIG. 3, the transistors of one image sensor element P are switched three times in one frame, whereas in the comparative example 2 in FIG. 5, the transistors are switched six times. That is, the comparative example requires twice as many switchings. This increases the amount of heat generated by switching, and the temperature rise of the image sensor element P increases. When the temperature of the image sensor element P increases, the dark output increases, and the zero level offset increases, resulting in a smaller range of exposure that can be imaged without saturating the signal. Note that in the example of FIG. 3, the number of image sensor elements P to be grouped is two, and in the example of FIG. 4, the number of exposures to be divided is two, but a similar comparison can be made even if the number of elements and the number of exposure divisions are three or more. And the more this number increases, the greater the difference in temperature rise, the greater the difference in offset, and the greater the difference in the range of exposure that can be imaged without saturating the signal.

[0024] The wavelength of light to which the image sensor element P is sensitive can be selected arbitrarily depending on the application. However, in the case of an infrared image sensor element sensitive to infrared light, the increase in dark current due to heat is large, so that application of this embodiment is particularly effective.

[0025] As described above, according to this embodiment, it is possible to suppress saturation of signals from image sensor elements while suppressing an increase in dark output, thereby widening the range of exposure amounts that can be captured.

[0026] Second Embodiment In this embodiment, a specific configuration example of the imaging device of the first embodiment will be described. Fig. 6 is a block diagram showing the configuration of the imaging device 100 of this embodiment. The imaging device 100 has a light guide unit 110, an array sensor 120, and an imaging control unit 130.

[0027] The light guiding section 110 has an optical system such as a lens, and guides the observation light to the light receiving surface of the array sensor 120 .

[0028] The array sensor 120 has a plurality of image sensor elements arranged in an array, and outputs a light reception signal from each of the image sensor elements to the imaging control unit 130.

[0029] The imaging control unit 130 creates groups of a predetermined number of adjacent image sensor elements constituting the array sensor 120, and divides the area of ​​the array sensor 120 by these groups. Then, it controls so that the exposure timing in each group is the same, and controls so that the output signals in the groups are added together to form one imaging signal. In other words, it controls so that one group becomes one pixel. The imaging control unit 130 can be implemented, for example, in a microcomputer equipped with a processor and a memory.

[0030] 7 is a block diagram showing details of the imaging control unit 130. The imaging control unit 130 has a group setting unit 131, an exposure control unit 132, and a signal processing unit 133. The group setting unit 131 sets a group in which a predetermined number of image sensor elements constituting the array sensor 120 are bundled together. The groups are set so as to divide the area of ​​the array sensor 120. The number of image sensor elements constituting one group can be, for example, a predetermined number, but may also be set according to the magnitude of the signal, as described later.

[0031] The exposure control unit 132 controls the image sensor elements constituting one group so that the exposure timings are the same.

[0032] The signal processing unit 133 sums up the output signals in the groups to generate one imaging signal, and performs control to image each group as one pixel.

[0033] Next, a specific example of an imaging device will be described. Fig. 8 is a plan view of a two-dimensional array sensor 120a in which image sensor elements are arranged in a two-dimensional array of vertical and horizontal directions, as viewed from the light receiving surface. Two-dimensional array sensors are widely used in digital cameras, digital videos, and the like. Each small square in Fig. 8 represents one image sensor element P. In the example of Fig. 8, the image sensor elements P are numbered as P11, P12, ... from the upper left to the right, and P11, P21 from the upper left to the bottom.

[0034] Here, an example will be described in which one group is composed of four image sensor elements P. The groups Gr are also numbered as Gr11, Gr12, ... from the top left to the right, and Gr11, Gr21 from the top left to the bottom.

[0035] Fig. 9 is a schematic diagram showing the configuration of an imaging device 100a using the two-dimensional array sensor 120a of Fig. 8. In the imaging device 100a, observation light is guided to the light receiving surface of the two-dimensional array sensor 120a by a light guide unit 110a. Signals output from each image sensor element P are bundled by group in a control unit 130a, and imaging processing is performed with each group as one pixel.

[0036] 8 and 9, one group is made up of four image sensor elements, but one group may be made up of, for example, 3×3=9 or 4×4=16 image sensor elements, and the number of image sensor elements may be arbitrary. Also, the number of vertical and horizontal groups may not be the same.

[0037] As described above, according to this embodiment, in an imaging device using a widely used two-dimensional array sensor, it is possible to suppress saturation of signals from image sensor elements while suppressing an increase in dark current, thereby ensuring a wide dynamic range.

[0038] (Third embodiment) In the first and second embodiments, an example has been described in which a group is created with a preset number of image sensor elements, but the number of image sensor elements constituting a group may be variable. Fig. 10 is a block diagram showing a group setting unit 131a that performs such grouping.

[0039] The group setting section 131 a includes a signal level determination section 1311 , a grouping setting storage section 1312 , and a grouping setting selection section 1313 .

[0040] The signal level determination unit 1311 monitors the signal level of the signal output from the image sensor element, and determines what level the signal level is from the present to a predetermined period ago with respect to the saturation value.

[0041] The grouping setting storage unit 1312 stores a pattern for grouping the image sensor elements. For example, in the case of a two-dimensional array sensor, any arrangement or pattern, such as 2×2, 3×3, 4×4, 1×2, or 1×3, can be set and stored.

[0042] The grouping setting selection unit 1313 selects a grouping setting stored in the grouping setting storage unit 1312 based on the signal level determined by the signal level determination unit 1311. For example, it is possible to select 4×4 if the signal level is close to the saturation value, and 2×2 if the signal level is below the saturation value. Furthermore, if the signal level is concentrated near the center of the detectable range of the image sensor element, it is possible to select an operation of capturing an image with one image sensor element as one pixel without grouping.

[0043] As described above, according to this embodiment, image sensor elements can be grouped according to signal levels.

[0044] The scope of the present invention also includes a program for causing a computer to execute the processes of the first to third embodiments described above, and a recording medium storing the program. As the recording medium, for example, a magnetic disk, a magnetic tape, an optical disk, a magneto-optical disk, a semiconductor memory, etc. can be used.

[0045] The present invention has been described above by taking the above-mentioned embodiment as an exemplary example. However, the present invention is not limited to the above-mentioned embodiment. That is, the present invention can be applied in various aspects that can be understood by a person skilled in the art within the scope of the present invention.

[0046] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) an array sensor in which a plurality of image sensor elements are arranged in an array; an imaging control means for exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing and summing up the outputs obtained; An imaging device comprising: (Appendix 2) The imaging control means Each of the groups is treated as one pixel and subjected to imaging processing. 2. The imaging device according to claim 1 . (Appendix 3) The imaging control means monitoring an output of the image sensor element; The arrangement of the image sensor elements constituting the group is determined based on the monitoring result of the output. 3. The imaging device according to claim 1 or 2. (Appendix 4) The image sensor element is CMOS image sensor 4. The imaging device according to claim 1, (Appendix 5) The image sensor element is It is an infrared image sensor. 5. The imaging device according to claim 1, (Appendix 6) An imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array, The outputs obtained by exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing are summed up. 13. An imaging method comprising: (Appendix 7) Each of the groups is treated as one pixel and subjected to imaging processing. 7. The imaging method according to claim 6, (Appendix 8) monitoring an output of the image sensor element; The arrangement of the image sensor elements constituting the group is determined based on the monitoring result of the output. 8. The imaging method according to claim 6 or 7, (Appendix 9) The image sensor element is CMOS image sensor 9. The imaging method according to claim 6, wherein (Appendix 10) The image sensor element is It is an infrared image sensor. 10. The imaging method according to claim 6, wherein (Appendix 11) To your computer Controlling an imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array; The imaging device includes: A process of exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing and summing up the outputs obtained by the exposure; 4. A control program for an imaging apparatus, comprising: [Explanation of symbols]

[0047] 1, 120 Array Sensor 2. Imaging control means 10, 100 Imaging device 110 Light guide section 130 Imaging control unit 131 Group Setting Section 132 Exposure control section 133 Signal Processing Unit

Claims

1. an array sensor in which a plurality of image sensor elements are arranged in an array; an imaging control means for exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing and summing up the outputs obtained; having The imaging control means monitoring an output of the image sensor element; The arrangement of the image sensor elements constituting the group is determined based on the monitoring result of the output.

1. An imaging device comprising:

2. The imaging control means Each of the groups is treated as one pixel and subjected to imaging processing.

2. The imaging device according to claim 1 .

3. The image sensor element is It is a CMOS image sensor.

3. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

4. The image sensor element is It is an infrared image sensor.

4. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

5. An imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array, summing outputs obtained by exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing; monitoring an output of the image sensor element; The arrangement of the image sensor elements constituting the group is determined based on the monitoring result of the output.

13. An imaging method comprising:

6. Each of the groups is treated as one pixel and subjected to imaging processing.

6. The imaging method according to claim 5.

7. The image sensor element is It is a CMOS image sensor.

7. The imaging method according to claim 5 or 6.

8. To your computer Controlling an imaging device having an array sensor in which a plurality of image sensor elements are arranged in an array; The imaging device includes: a process of exposing the image sensor elements in a group consisting of a predetermined number of adjacent image sensor elements at the same timing and summing up the outputs obtained by the exposure; monitoring an output of the image sensor element; determining an arrangement of the image sensor elements constituting the group based on the monitoring result of the output; 4. A control program for an imaging apparatus, comprising:

Citation Information

Patent Citations

  • Solid-state image pickup device

    JP1997247535A

  • Image pickup element and image pickup device using the same

    JP2000069491A

  • Imaging device, signal processing method, and program

    JP2013066140A

  • Imaging device

    JP2013258458A

  • Imaging apparatus and imaging method

    JP2015089033A