Imaging device, electronic device, and image generating device

Abstract

To provide a technique advantageous for improving a dynamic range and improving image quality in an imaging apparatus.SOLUTION: An imaging apparatus comprises: an imaging unit in which a plurality of pixels are arranged each including a photoelectric conversion element; a signal processing unit that processes a signal output from the imaging unit; and a storage unit that stores the signal output from the imaging unit and transfers the signal to the signal processing unit. The storage unit stores a plurality of image signals output from the plurality of pixels arranged in the imaging unit as a plurality of sub-frames, and outputs, of the plurality of sub-frames, sub-frames satisfying a predetermined condition as signals for constituting one frame.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device, an electronic device, and an image generating device. [Background technology]

[0002] There is a demand for an expansion of the dynamic range in imaging devices using photoelectric conversion elements such as CMOS image sensors. Patent Document 1 shows that the dynamic range is improved by integrating multiple frame images obtained from the pixels of the image sensor in an integral memory of a DSP provided outside the image sensor. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-259234 A Summary of the Invention [Problem to be solved by the invention]

[0004] Although the technique disclosed in Patent Document 1 can improve the dynamic range, when there are frames containing saturated pixels, the generated image may suffer from uneven brightness or color, resulting in a decrease in image quality.

[0005] An object of the present invention is to provide a technique that is advantageous for improving the dynamic range and image quality in an imaging device. [Means for solving the problem]

[0006] In view of the above problems, an imaging device according to an embodiment of the present invention is an imaging device including an imaging section having a plurality of pixels each including a photoelectric conversion element, a signal processing section that processes a signal output from the imaging section, and a memory section that stores the signal output from the imaging section and transfers it to the signal processing section, wherein the memory section stores a plurality of image signals output by the plurality of pixels arranged in the imaging section as a plurality of subframes, and then outputs a subframe among the plurality of subframes that satisfies a predetermined condition as a signal for constituting a single frame. Effect of the Invention

[0007] According to the present invention, it is possible to provide a technique that is advantageous for improving the dynamic range and image quality in an imaging device. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an outline of the configuration of an imaging apparatus according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an outline of the configuration of a signal processing unit of the imaging apparatus according to the present embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of the arrangement of components of the imaging apparatus according to the present embodiment. [Figure 4] 1 is a block diagram showing an outline of the configuration of an imaging apparatus according to an embodiment of the present invention. [Diagram 5] FIG. 1 is a diagram showing an example of the configuration of a camera incorporating an imaging device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] An imaging device according to an embodiment of the present disclosure will be described with reference to Fig. 1 to Fig. 5. Fig. 1 is a block diagram showing an outline of a configuration example of an imaging device 100 according to the present embodiment. As shown in Fig. 1, the imaging device 100 includes an imaging unit 110, a storage unit 120, and a signal processing unit 130.

[0011] In the imaging unit 110, a plurality of pixels each including a photoelectric conversion element are arranged in a two-dimensional array in a plan view. The plan view refers to a view from a direction perpendicular to the light incidence surface of the substrate described later. The cross section refers to a surface in a direction perpendicular to the light incidence surface of the substrate. When the light incidence surface of the substrate is a rough surface when viewed microscopically, the plan view is defined based on the light incidence surface of the substrate when viewed macroscopically. In the imaging unit 110, light incident on each pixel is converted into an electric signal according to the amount of incident light. For example, the imaging unit 110 may be a CMOS image sensor including a MOS transistor. The imaging unit 110 includes, for example, an analog / digital (A / D) conversion circuit, and can convert an analog signal generated by a photoelectric conversion element arranged in each pixel into a digital signal and output it.

[0012] The storage unit 120 stores the image signal output from the imaging unit 110. Specifically, the storage unit 120 stores the image signal including the pixel values ​​of each of the multiple pixels arranged in the imaging unit 110. The storage unit 120 then transfers the stored image signal to the signal processing unit 130. In this embodiment, the storage unit 120 can be a memory such as a dynamic random access memory (DRAM) that accumulates data of the image signal generated by the imaging unit 110.

[0013] In the configuration shown in FIG. 1, the signal processing unit 130 generates image data from a signal output from the imaging unit 110. The signal processing unit 130 includes a control unit 131 and a processing unit 132. The control unit 131 controls writing of image signals to a DRAM constituting the storage unit 120 and reading of signals written in the storage unit 120 to the processing unit 132. The control unit 131 also controls the processing unit 132. The processing unit 132 performs arithmetic processing such as addition, averaging, division, and bit shift (bit expansion) using a plurality of image signals temporarily stored in the storage unit 120 according to the control of the control unit 131, and generates one image data from the plurality of image signals. More specifically, the processing unit 132 performs high-dynamic-range rendering (HDR) processing to generate image data for display. The image data generated in the imaging device 100 is output from the imaging device 100 and can be displayed on a display unit 190 as shown in FIG. 1, for example. Here, the generation of image data in the processing unit 132 is not essential, and it is sufficient that the processing unit 132 is configured to output data (for example, an image signal) that enables an image to be displayed on the display unit 190.

[0014] Next, HDR processing and output of image data will be described with reference to FIG. 1 and FIG. 2. FIG. 2 is a block diagram showing an outline of an example of the configuration of the control unit 131 of the signal processing unit 130. HDR processing is a process of synthesizing a plurality of image signals each including a pixel value output from each pixel of the imaging unit 110, and obtaining a gradation level greater than that obtained by one imaging. In the following description, in order to simplify the description and the example of the calculation formula, an example of additive synthesis of one image data using N image signals having the same number of gradations will be shown. However, this is not limited to this, and the present disclosure can be applied even when synthesizing a plurality of image signals with different imaging conditions, and in that case, it is sufficient to perform a calculation in which the calculation formula for performing HDR synthesis is appropriately weighted according to the imaging conditions, etc.

[0015] First, when imaging starts, an image signal including pixel values ​​of each pixel of the plurality of pixels arranged in the imaging unit 110 is output from the imaging unit 110 to the storage unit 120. The control unit 131 of the signal processing unit 130 counts the number of image signals stored in the storage unit 120, and after storing N (N is an integer equal to or greater than 2) image signals, outputs them from the processing unit 132 at one time as one piece of image data. That is, the storage unit 120 stores and accumulates image signals for N frames as N subframes, and outputs them to the processing unit 131 as signals for constituting one frame (image). One frame can be generated, for example, from image signals obtained from the plurality of pixels arranged in the imaging unit 110. That is, one frame can be generated from image signals from the first row of the plurality of pixels to the last row of the plurality of pixels. By storing image signals for N times, the number of bits of image data (each signal of one frame) becomes greater than the number of bits of each signal of the plurality of image signals. In other words, even if the capacitance value of the pixels arranged in the imaging unit 110 is small and the signal value is easily saturated, it is possible to increase the dynamic range of the obtained image data by the number of multiple image signals.

[0016] However, there is a possibility that each image signal contains saturated pixels whose pixel values ​​exceed a predetermined threshold value and become saturated. The predetermined threshold value is, for example, a value exceeding the saturation capacity of a photoelectric conversion element arranged in the pixel. When a plurality of image signals including outputs from saturated pixels are combined into one image data, the image quality may deteriorate. For example, when an imaging device includes a color filter that transmits a plurality of different colors and a photoelectric conversion element photoelectrically converts light transmitted through the color filter, color shift may occur. Also, for example, in electronic cameras installed outdoors such as street cameras, LED lighting such as fluorescent lights and traffic lights may change in brightness irregularly, such as causing a flicker phenomenon in which the luminance varies from frame to frame. For this reason, even if the imaging conditions are adjusted in advance, an image signal containing saturated pixel values ​​may be generated.

[0017] Therefore, in this embodiment, when storing an image signal in the storage unit 120, the control unit 131 of the signal processing unit 130 determines whether or not the pixel value of each pixel constituting each image signal (subframe) exceeds a predetermined threshold and reaches saturation. For example, as shown in FIG. 2, the control unit 131 may include a determination unit 201 that determines whether or not the pixel value of each pixel constituting the image signal exceeds a predetermined threshold and reaches saturation. At this time, the control unit 131 of the signal processing unit 130 counts the number of image signals (here, M) including pixel values ​​output from saturated pixels, or the number of image signals (NM) not including pixel values ​​saturated beyond the threshold. For example, as shown in FIG. 2, the control unit 131 of the signal processing unit 130 may include a count unit 202 that counts the number of these image signals. Furthermore, the control unit 131 of the signal processing unit 130 generates a correction coefficient based on the number of image signals including pixel values ​​output from saturated pixels, or the number of image signals not including saturated pixel values, among the multiple image signals. For example, the control unit 131 may include a correction coefficient generating unit 203 for generating a correction coefficient, as shown in Fig. 2. In this embodiment, the correction coefficient may be {N / (NM)}.

[0018] Next, the processing unit 132 of the signal processing unit 130 corrects image signals that do not include saturated pixel values ​​among the multiple image signals according to the correction coefficient, and generates a signal for forming one frame. For example, the processing unit 132 generates one image data that can be data for an image to be displayed on the display unit 190. For example, the processing unit 132 adds image signals that do not include saturated pixel values ​​that are temporarily stored in the storage unit 120, and further performs a calculation of multiplying by a correction coefficient {N / (NM)}. This corrects the fact that, in the process of obtaining image data with N times the bit number by adding image signals N times, the bit number remains at (NM) times due to the addition excluding image signals that include saturated pixel values.

[0019] By the above process, even if the capacity of the pixels arranged in the imaging unit 110 is small, the number of bits of the image data obtained by imaging N times can be increased. Also, by not using an image signal including saturated pixel values ​​during HDR synthesis, it is possible to obtain image data without color shifts. As a result, in this embodiment, it is possible to obtain an imaging device 100 that achieves both improved dynamic range and improved image quality.

[0020] In the above, it has been described that an image signal including pixel values ​​output from saturated pixels is not used for HDR synthesis. In other words, the determination unit 201 of the signal processing unit 130 determines whether or not to exclude an image signal from HDR synthesis depending on whether or not one or more saturated pixels are present among a plurality of pixels in the image signal. However, this is not limited to this. The signal processing unit 130 may generate one image data based on an image signal in which the pixel values ​​of each pixel constituting each image signal satisfy a predetermined condition among a plurality of image signals output by the imaging unit 110 and including pixel values ​​of each pixel of the plurality of pixels.

[0021] For example, the determination unit 201 of the signal processing unit 130 may determine whether or not the number of saturated pixels whose pixel values ​​exceed a predetermined threshold is equal to or less than a predetermined number in each of the multiple image signals. The number of outputs from the saturated pixels included in the image signal used for HDR synthesis may be set appropriately according to the specifications of the imaging device 100. In this case, the processing unit 132 of the signal processing unit 130 may generate one piece of image data based on the image signals among the multiple image signals in which the number of saturated pixels is equal to or less than a predetermined number. Also, in this case, the correction coefficient generation unit 203 of the signal processing unit 130 may generate a correction coefficient based on the number of image signals among the multiple image signals in which the number of saturated pixels is equal to or less than a predetermined number (or exceeds a predetermined number). Furthermore, the processing unit 132 of the signal processing unit 130 may correct the image signals among the multiple image signals in which the number of saturated pixels is equal to or less than a predetermined number (or exceeds a predetermined number) according to the correction coefficient, and generate one piece of image data.

[0022] In addition, the determination of whether a pixel value is saturated may be performed by setting an arbitrary output value of the pixel value of each pixel included in the image signal as a threshold. The pixels arranged in the imaging unit 110 may include a plurality of pixel groups having sensitivity to light in different wavelength bands (for example, an R pixel group having sensitivity in the red wavelength range, a G pixel group having sensitivity in the green wavelength range, and a B pixel group having sensitivity in the blue wavelength range). Depending on the specifications of the imaging device 100, the threshold for whether a pixel value is saturated may be set individually for each pixel color, each output channel, and the like. In other words, the threshold for whether a pixel value is saturated may be different for each of the plurality of pixel groups (for example, an R pixel group, a G pixel group, and a B pixel group).

[0023] In the above embodiment, the image quality is improved by not using an image signal including a saturated pixel value. However, the present invention is not limited to this. For example, the pixel value of a saturated pixel may be corrected based on the pixel value of a pixel adjacent to the saturated pixel among a plurality of pixels arranged in the imaging unit 110, and one piece of image data may be generated based on an image signal not including the saturated pixel and an image signal in which the pixel value of the saturated pixel has been corrected. For example, consider a case where a pixel included in the R pixel group is saturated in an image signal acquired from the imaging unit 110 including an R pixel group, a G pixel group, and a B pixel group. In this case, a relative ratio of the output for each color may be obtained from the RGB output of the image signal not including the saturated pixel, and the output of a pixel whose pixel value is saturated may be estimated and corrected from the output of the G pixel or B pixel adjacent to the saturated pixel. In other words, the signal processing unit 130 (for example, the correction coefficient generating unit 203) may correct the signal value of a saturated pixel based on the pixel value of a pixel of a pixel group (G pixel group or B pixel group) different from the pixel group including the saturated pixel (R pixel group) among a plurality of pixel groups. Furthermore, a position (coordinates, area, etc.) in the image signal may be determined based on a predetermined condition, and correction may be performed based on the position.

[0024] In this embodiment, in order to hold the number of bits corresponding to the number of times the image signal was acquired, the process of multiplying the data obtained by adding the image signal (NM) times by {N / (NM)} as a correction coefficient was performed, but it is also possible to only exclude the image signal including the pixel value output from the saturated pixel. In addition, for example, an appropriate weighting coefficient may be added to the correction coefficient {N / (NM)} so that the output is appropriate for the dynamic range. In this case, the weighting coefficient may be generated by referring to the pixel values ​​other than the saturated pixels of the image signal including the pixel value output from the saturated pixel, or the weighting coefficient may be generated by providing a separate detection unit or the like that detects the amount of light incident on the pixel. It is sufficient to perform appropriate weighting on the image data after adding up a plurality of image signals.

[0025] In the present embodiment, a DRAM is used as the storage unit 120. However, this is not limited to this. Any appropriate storage device such as a volatile memory or a non-volatile memory may be used as long as the above-mentioned processing can be performed at high speed. Alternatively, a DRAM may be used as the storage unit 120, and image data output from the imaging device 100 may be stored (recorded) in a non-volatile memory such as a hard disk or a flash memory.

[0026] Furthermore, the above-mentioned arithmetic processing may be shared among any of the blocks as long as it can be realized by the signal processing unit 130 including the storage unit 120, the control unit 131, and the processing unit 132. In this embodiment, the control unit 131 performs processing such as control of writing and reading from the storage unit 120, counting the number of image signals output from the imaging unit 110, determining whether or not a pixel value is equal to or less than a threshold (determining saturation), excluding image signals including pixel values ​​output from saturated pixels, and generating correction coefficients, but this is not limited to the above. Each function may be performed separately or by a configuration in which they are appropriately combined. Also, for example, the arithmetic processing performed by the processing unit 132 may be performed by the control unit 131.

[0027] An example of the arrangement of each component of the imaging device 100 of this embodiment will be described with reference to FIG. 3(a) to FIG. 3(c). When a plurality of image signals are synthesized to generate one image data as described above, high-speed processing is required to maintain the speed of generating image data, such as capturing a moving image. For this reason, it is preferable that the imaging device 100 includes a semiconductor chip having a stacked structure in which the length of the wiring pattern for transferring various signals can be shortened. A semiconductor chip having a stacked structure is a structure in which a plurality of semiconductor layers are stacked via a wiring layer. By arranging the imaging unit 110 and the signal processing unit 130 on one semiconductor chip having a stacked structure, high-speed image processing can be realized. Note that it is not necessary to arrange all the components of the imaging unit 110, the storage unit 120, and the signal processing unit 130 on one semiconductor chip. For example, as described later, the storage unit 120 may be arranged on a certain board, and the board and the board having the imaging unit 110 may not be stacked on each other.

[0028] For example, when the imaging device 100 has the configuration shown in Fig. 1, the configuration shown in Fig. 3(a) or the configuration shown in Fig. 3(c) can be adopted. Fig. 3(a) discloses the imaging device 100 including a substrate 410 and a substrate 420 arranged in a stacked manner. The substrate 410 includes the imaging unit 110, and the substrate 420 includes the signal processing unit 130 and the storage unit 120. In this case, light may be incident from the substrate 410 side (the upper side in Fig. 3(a)). The light incident side is the same in the configurations of Fig. 3(b) and Fig. 3(c). The substrates 410 and 420 include a semiconductor substrate such as silicon and a wiring unit including a wiring pattern and an interlayer insulating layer.

[0029] 3(c), the imaging device 100 may include a substrate 410, a substrate 420, and a substrate 430 arranged in a stacked manner. In this case, for example, the substrate 410 includes the imaging unit 110, the substrate 430 includes the storage unit 120, and the substrate 420 includes the signal processing unit 130. The substrate 430 is arranged between the substrates 410 and 420. The substrates 420 and 430 may be stacked in an interchangeable manner. In other words, the substrate 420 having the signal processing unit 130 may be arranged between the substrate 430 having the storage unit 120 and the substrate 410.

[0030] 4, the substrate 410 has the imaging unit 110, and the substrate 420 has the signal processing unit 130, as shown in FIG 3(b). In this case, the storage unit 120 is disposed on a different semiconductor chip, as described above. The semiconductor chip on which the substrates 410 and 420 are stacked, and the semiconductor chip on which the storage unit 120 is disposed, may be disposed, for example, in the same semiconductor package.

[0031] When the imaging device 100 is a stacked chip, each configuration may not be completed on one substrate as shown in FIG. 3(a) to FIG. 3(c). For example, in the configuration shown in FIG. 3(a), the storage unit 120 may be disposed on both the substrate 410 and the substrate 420. Also, for example, in the configuration shown in FIG. 3(c), the signal processing unit 130 may be disposed on both the substrate 420 and the substrate 430. In this case, for example, the function of the control unit 131 of the signal processing unit 130 may be mounted on the substrate 420, and the function of the processing unit 132 of the signal processing unit 130 may be mounted on the substrate 430. An appropriate arrangement may be selected according to the specifications required for the imaging device 100.

[0032] As shown in Fig. 3(b) and Fig. 4, when the board on which the storage unit 120 is arranged is not stacked with the board on which the imaging unit 110 is arranged, the number of wirings between the imaging unit 110 and the storage unit 120 increases and the circuit design may become more complex than when the boards are stacked. However, by not stacking the board having the storage unit 120 and the board having the imaging unit 110, it may be possible to use a storage unit 120 with a larger capacity. As a result, the number of image signals that can be used to expand the dynamic range increases, making it possible to obtain an image with a larger dynamic range and improved image quality.

[0033] In the above embodiment, the imaging device 100 in which the signal processing unit 130 performs HDR synthesis on the image signals captured by the imaging unit 110 has been described, but the present disclosure is not limited thereto. For example, the signal processing unit 130 may be used alone. That is, an image signal from an imaging unit arranged in an imaging device other than the imaging device 100 may be input to the signal processing unit 130 (which may also be called an image generating device), and the signal processing unit 130 may perform HDR synthesis to generate image data. Furthermore, each step of the method for generating image data described above may be implemented by a computer or the like arranged outside the imaging device 100.

[0034] An application example of the imaging device 100 according to the above embodiment will be described below. Fig. 5 is a schematic diagram of an electronic device EQP equipped with the imaging device 100. Fig. 5 shows a camera as an example of the electronic device EQP. Here, the concept of a camera includes not only a device whose main purpose is to capture images, but also a device that has an auxiliary imaging function (for example, a personal computer or a mobile terminal such as a smartphone).

[0035] The imaging device 100 may be a semiconductor chip having a stacked structure in which the imaging unit 110 is provided. The imaging device 100 is housed in a semiconductor package PKG as shown in FIG. 5. When the imaging device 100 has a configuration as shown in FIG. 3, the storage unit 120 may be disposed in the semiconductor package PKG. The package PKG may include a base to which the imaging device 100 is fixed, a cover such as glass facing the imaging device 100, and a conductive connection member such as a bonding wire or bump that connects a terminal provided on the base to a terminal provided on the imaging device 100. The device EQP may further include at least one of an optical system OPT, a control device CTRL, a processing device PRCS, a display device DSPL, and a storage device MMRY.

[0036] The optical system OPT forms an image on the imaging device 100, and may be, for example, a lens, a shutter, or a mirror. The control device CTRL controls the operation of the imaging device 100, and may be, for example, a semiconductor device such as an ASIC. The processing device PRCS processes the signal output from the imaging device 100, and may be, for example, a semiconductor device such as a CPU or an ASIC. The display device DSPL may be an EL display device or a liquid crystal display device that displays image data obtained by performing the above-mentioned HDR synthesis in the imaging device 100. The memory device MMRY is a magnetic device or a semiconductor device that stores the HDR-synthesized image data obtained in the imaging device 100. The memory device MMRY may be a volatile memory such as an SRAM or a DRAM, or a non-volatile memory such as a flash memory or a hard disk drive. The mechanical device MCHN has a moving part or a propulsion part such as a motor or an engine. The mechanical device MCHN in the camera can drive parts of the optical system OPT for zooming, focusing, and shutter operation. In the device EQP, the image data output from the imaging device 100 is displayed on the display device DSPL, and transmitted to the outside by a communication device (not shown) included in the device EQP. For this reason, the device EQP may further include a memory device MMRY and a processing device PRCS in addition to the memory circuit unit and the arithmetic circuit unit included in the signal processing unit 130 and the memory unit 120 of the imaging device 100.

[0037] A camera incorporating the imaging device 100 can be used as a surveillance camera, or an on-board camera mounted on transportation equipment such as automobiles, railroad cars, ships, aircraft, or industrial robots. In addition, a camera incorporating the imaging device 100 can be used not only in transportation equipment but also in a wide range of equipment that uses object recognition, such as an intelligent transport system (ITS).

[0038] The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-mentioned embodiments are supplied to a system or device via a network or various storage media, and one or more processors (e.g., CPU or MPU) in a computer of the system or device read and execute the programs. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0039] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0040] 100: imaging device, 110: imaging section, 130: signal processing section

Claims

1. An imaging device including an imaging section in which a plurality of pixels each including a photoelectric conversion element is arranged, a signal processing section that processes an image signal output from the imaging section, and a storage section that stores the image signal output from the imaging section and transfers the image signal to the signal processing section, the storage unit stores a plurality of image signals output from the imaging unit as a plurality of subframes; The signal processing unit includes: (1) determining, for each subframe, whether the number of saturated pixels, the pixel values ​​of which exceed a predetermined threshold, is equal to or less than a predetermined number; (2) selecting a subframe in which the number of saturated pixels is equal to or less than the predetermined number from the plurality of subframes stored in the storage unit; (3) generating one frame based on a signal obtained by adding up pixel values ​​of the selected subframes for each of the plurality of pixels; 1. An imaging device comprising:

2. The signal processing unit includes: generating a correction coefficient based on the number of image signals having the number of saturated pixels equal to or less than the predetermined number; The imaging apparatus according to claim 1 , wherein the selected subframe is corrected in accordance with the correction coefficient.

3. the plurality of pixels include a plurality of pixel groups each having sensitivity to light in a different wavelength band; 3. The imaging device according to claim 1, wherein the signal processing unit determines, for each of the plurality of image signals, for each of the plurality of pixel groups, whether or not the number of saturated pixels is equal to or less than the predetermined number.

4. 4. The imaging device according to claim 3, wherein the threshold value is different for each of the plurality of pixel groups.

5. The signal processing unit includes: determining for each of the selected subframes whether there are any saturated pixels whose pixel values ​​exceed the predetermined threshold; correcting a pixel value of the saturated pixel based on pixel values ​​of pixels adjacent to the saturated pixel among the plurality of pixels; 2. The imaging device according to claim 1, wherein data of the one frame is generated based on an image signal that does not include the saturated pixels in the selected subframe and an image signal in which pixel values ​​of the saturated pixels in the selected subframe are corrected.

6. the plurality of pixels include a plurality of pixel groups each having sensitivity to light in a different wavelength band; 6. The imaging device according to claim 5, wherein the signal processing unit corrects the signal value of the saturated pixel based on a pixel value of a pixel of a pixel group other than a pixel group including the saturated pixel among the plurality of pixel groups.

7. The imaging device includes a first substrate and a second substrate arranged in a stack, the first substrate includes the imaging unit, 7. The imaging device according to claim 1, wherein the second substrate includes the signal processing unit.

8. The imaging device according to claim 7 , wherein the second substrate includes the storage unit.

9. The imaging device further includes a third substrate arranged to be stacked on the first substrate, The imaging device according to claim 7 , wherein the third substrate includes the storage unit.

10. 10. The imaging device according to claim 1, wherein the number of bits of each signal of the one frame is greater than the number of bits of each of the plurality of image signals.

11. An imaging device according to any one of claims 1 to 10; A control device for controlling an operation of the imaging device; An electronic device comprising:

Images