Imaging device, control method, and control program

Abstract

Provided are an imaging device, a control method, and a control program capable of suppressing the effect of noise on image data readout.　A digital camera (100) comprises: a system control unit (11); an imaging element (5) having a plurality of pixels (61) including a first pixel group (60A); a first sub-substrate (65A) connected to the first pixel group (60A) and capable of read out image data of the first pixel group (60A); and a third sub-substrate (65C) connected to the first pixel group (60A) and capable of reading out image data of the first pixel group (60A). The system control unit (11) performs control to set the circuit used to read out the image data of the first pixel group (60A) from either the first sub-substrate (65A) or the third sub-substrate (65C), in accordance with the noise occurrence condition.

Description

Imaging device, control method, and control program

[0001] The present invention relates to an imaging device, a control method, and a control program.

[0002] Patent Document 1 describes an imaging device that includes multiple ADC blocks at different positions on the imaging element surface, multiple reference signal generation units with different positive and negative slopes, a circuit that generates a reference signal RAMP1 whose voltage changes in an upward direction over time and a reference signal RAMP2 whose voltage changes in a downward direction over time, and a switching unit that switches between RAMP1 and RAMP2, and in which a magnetic field influence determination unit calculates the influence of the noise frequency based on the detected noise frequency, and, depending on the calculation result, determines whether to use an upslope type or a downslope type of one of the multiple reference signals for dark subjects, so as to reduce the influence of magnetic noise.

[0003] Patent document 2 describes an imaging device having an imaging unit that outputs image data photoelectrically converted by a plurality of pixels arranged in a matrix, a random number generating unit that generates random numbers, a reading unit that specifies a pixel position on the matrix of the imaging unit in accordance with the random number generated by the random number generating unit and reads out image data, and an address adding unit that adds address data indicating the pixel position from which the image data was read out to the image data read out by the reading unit.

[0004] Patent Document 3 describes a stacked light receiving sensor that includes a first substrate and a second substrate bonded to the first substrate, the first substrate including a pixel array section in which a plurality of unit pixels are arranged in a two-dimensional matrix, the second substrate including a converter that converts analog pixel signals output from the pixel array section into digital image data, and a processing section that executes processing based on a neural network calculation model on data that is based on the image data, at least a portion of the converter being arranged on a first side of the second substrate, and the processing section being arranged on a second side of the second substrate that is opposite to the first side.

[0005] Japanese Patent Publication No. 2020-057891 Japanese Patent Publication No. 2013-012983 Japanese Patent Publication No. 2020-025263

[0006] One embodiment of the technique of the present disclosure provides an imaging device, a control method, and a control program that can suppress the influence of noise on the reading of image data.

[0007] (1) An imaging device comprising: a processor; an imaging element having a plurality of pixels including a first pixel region; a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region; and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, wherein the processor controls to set one of the first circuit and the second circuit to be used to read out image data of the first pixel region according to a noise generation state.

[0008] (2) The imaging device according to (1), wherein the processor switches between reading out the image data of the first pixel region using the first circuit and the second circuit, or reading out the image data of the first pixel region using either the first circuit or the second circuit, depending on the noise generation state.

[0009] (3) The imaging device according to (1) or (2), wherein the processor performs the control based on an operating state of a noise generating source.

[0010] (4) The imaging device according to (3), wherein the processor performs the control based on a positional relationship between the noise generating source and the first and second circuits, and an operating state of the noise generating source.

[0011] (5) The imaging device according to (4), wherein the processor controls, when the noise generating source is in operation, the image data of the first pixel region to be read out by one of the first circuit and the second circuit, whichever circuit is farther from the noise generating source.

[0012] (6) The imaging device according to any one of (3) to (5), wherein the noise source includes a power supply circuit.

[0013] (7) The imaging device according to any one of (3) to (6), wherein the noise source includes a drive circuit for moving the imaging element.

[0014] (8) The imaging device according to any one of (3) to (7), wherein the noise source includes a drive circuit for a display device included in the imaging device.

[0015] (9) The imaging device according to any one of (3) to (8), wherein the noise source includes a drive circuit for a mechanical shutter provided in correspondence with the imaging element.

[0016] (10) The imaging device according to any one of (3) to (9), wherein the noise source includes a drive circuit for a lens included in the imaging device.

[0017] (11) The imaging device according to any one of (3) to (10), wherein the noise source includes a drive circuit for a recording device included in the imaging device.

[0018] (12) The imaging device according to any one of (3) to (11), in which the noise generating source includes a charging device provided in the imaging device.

[0019] (13) The imaging device according to any one of (3) to (12), in which the noise source includes a light emitting device provided in the imaging device.

[0020] (14) The imaging device according to any one of (3) to (13), wherein the noise source includes a device externally connected to the imaging device.

[0021] (15) The imaging device according to any one of (1) to (14), wherein the processor detects the noise occurrence state and performs the control based on the detected noise occurrence state.

[0022] (16) The imaging device according to (15), wherein the processor determines which of the first circuit and the second circuit to use for reading out the image data of the first pixel region based on the result of detecting the noise occurrence state while changing which of the first circuit and the second circuit to use for reading out the image data of the first pixel region.

[0023] (17) The imaging device according to any one of (1) to (16), wherein the processor controls the first circuit and the second circuit to read out image data of the first pixel region in accordance with a photosensitivity set in an imaging device including the imaging device.

[0024] (18) The imaging device according to (17), wherein the processor reads out image data of the first pixel region using the first circuit and the second circuit when the photosensitivity is lower than a predetermined value.

[0025] (19) A control method for an imaging device including a processor, an imaging element having a plurality of pixels including a first pixel region, a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region, and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, wherein the processor controls to set one of the first circuit and the second circuit to be used to read out image data of the first pixel region according to a noise generation state.

[0026] (20) A control program for an imaging device including a processor, an imaging element having a plurality of pixels including a first pixel region, a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region, and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, the control program causing the processor to execute a process of controlling to set one of the first circuit and the second circuit to be used to read out image data of the first pixel region according to a noise generation state.

[0027] According to the present invention, it is possible to provide an imaging device, a control method, and a control program that can suppress the influence of noise on the reading of image data.

[0028] 10 is a diagram showing an example of the configuration of a digital camera 100 to which the imaging device of the present invention is applied. It is a plan view schematic diagram showing the general configuration of the image sensor 5 shown in FIG. 1. It is a diagram showing an example of a pixel substrate 66 on which an imaging surface 60 is provided. It is a flowchart showing an example of on / off control of each sub-substrate. It is a diagram showing an example of correspondence information between on / off of operation of a noise generation source and a circuit used for readout. It is an example (part 1) of setting a drive mode of a sub-substrate according to a noise generation situation. It is an example (part 2) of setting a drive mode of a sub-substrate according to a noise generation situation. It is an example (part 3) of setting a drive mode of a sub-substrate according to a noise generation situation. It is an example (part 4) of setting a drive mode of a sub-substrate according to a noise generation situation. It is a flowchart showing another example of on / off control of each sub-substrate. It is a modified example of the on / off control of each sub-substrate shown in FIG. 10. It is a flowchart showing an example of switching of on / off control of each sub-substrate according to ISO sensitivity. It is a diagram showing an example of a control unit provided on the pixel substrate 66. It is a diagram showing an example of the configuration of each sub-substrate. It is a block diagram showing the external appearance of a smartphone 200. It is a block diagram showing the configuration of the smartphone 200.

[0029] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0030] <Example of the Configuration of a Digital Camera 100 to which an Imaging Apparatus of the Present Invention is Applied> FIG. 1 is a diagram showing an example of the configuration of a digital camera 100 to which an imaging apparatus of the present invention is applied.

[0031] 1 is a digital camera including a lens device 40 having an imaging lens 1, an aperture 2, a lens control unit 4, a lens drive unit 8, and an aperture drive unit 9, and a main body 100A. The main body 100A includes an imaging unit 50, a system control unit 11, an operation unit 14, a display device 22, a memory 16 including a RAM (Random Access Memory) and a ROM (Read Only Memory), a memory control unit 15 that controls data recording to and data reading from the memory 16, a digital signal processing unit 17, and an external memory control unit 20 that controls data recording to and data reading from a recording medium 21.

[0032] The lens device 40 may be detachable from the main body 100A, or may be integrated with the main body 100A. The imaging lens 1 includes a focus lens that is movable in the optical axis direction. This focus lens is a lens for adjusting the focus of the imaging optical system that includes the imaging lens 1 and the diaphragm 2, and is composed of a single lens or multiple lenses. When the focus lens moves in the optical axis direction, the position of the principal point of the focus lens changes along the optical axis, changing the focal position on the subject side. Note that the focus lens may be a liquid lens whose principal point in the optical axis direction can be changed by electrical control.

[0033] The lens control unit 4 of the lens device 40 is configured to be able to communicate with the system control unit 11 of the main body 100A via a wired or wireless connection. In accordance with commands from the system control unit 11, the lens control unit 4 controls the focus lens included in the imaging lens 1 via the lens drive unit 8 to change the position of the principal point of the focus lens, and controls the aperture value of the aperture 2 via the aperture drive unit 9.

[0034] The imaging unit 50 includes an imaging element 5 that captures an image of a subject through an imaging optical system including an imaging lens 1 and an aperture 2 , and an imaging element driving unit 10 that drives the imaging element 5 .

[0035] The imaging element 5 has an imaging surface 60 (see FIG. 2) on which a plurality of pixels 61 are arranged two-dimensionally, and converts a subject image formed on the imaging surface 60 by an imaging optical system into pixel signals by the plurality of pixels 61 and outputs the pixel signals. A CMOS (complementary metal-oxide-semiconductor) image sensor, for example, is preferably used as the imaging element 5. The following description will be given assuming that the imaging element 5 is a CMOS image sensor.

[0036] The system control unit 11, which controls the entire electrical control system of the digital camera 100, drives the image sensor 5 via the image sensor drive unit 10, and outputs the subject image captured through the imaging optical system of the lens device 40 as an image signal.

[0037] The image sensor driver 10 generates a drive signal based on a command from the system controller 11 and supplies the drive signal to the image sensor 5, thereby driving the image sensor 5. The hardware configuration of the image sensor driver 10 is an electric circuit configured by combining circuit elements such as semiconductor elements.

[0038] An instruction signal from the user is input to the system control unit 11 through the operation unit 14. The operation unit 14 includes a touch panel integrated with a display surface 22b (to be described later), various buttons, and the like.

[0039] The system control unit 11 controls the entire digital camera 100, and its hardware configuration consists of various processors that execute programs, including an imaging control program, to perform processing. The programs executed by the system control unit 11 are stored in the ROM of the memory 16.

[0040] The various types of processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes programs to perform various processes, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), or a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration designed specifically to perform specific processing. More specifically, the structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.

[0041] The system control unit 11 may be configured with one of various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA).

[0042] The display device 22 includes a display surface 22b configured by an organic EL (Electro Luminescence) panel, a liquid crystal panel, or the like, and a display controller 22a that controls the display on the display surface 22b.

[0043] The memory control unit 15 , digital signal processing unit 17 , external memory control unit 20 and display controller 22 a are interconnected by a control bus 24 and a data bus 25 , and are controlled by commands from the system control unit 11 .

[0044] The imaging device of the present invention is configured, for example, by an imaging section 50 and a system control section 11. The imaging device of the present invention may also be configured by the imaging section 50.

[0045] <Schematic Configuration of Image Sensor 5 Shown in Fig. 1> Fig. 2 is a plan view schematic diagram showing the schematic configuration of the image sensor 5 shown in Fig. 1. The image sensor 5 has an imaging surface 60 on which a plurality of pixels 61 are two-dimensionally arranged in a row direction X and a column direction Y perpendicular to the row direction X. The plurality of pixels 61 include a ranging pixel 61b that receives one of a pair of light beams that have passed through two different portions of a pupil region of the imaging optical system aligned in the row direction X and detects a signal corresponding to the amount of received light, a ranging pixel 61c that receives the other of the pair of light beams and detects a signal corresponding to the amount of received light, and a normal pixel 61a that receives both of the pair of light beams and detects a signal corresponding to the amount of received light.

[0046] 2 , pixel lines 62 each including a plurality of normal pixels 61 a arranged in the row direction X and pixel lines 63 each including ranging pixels 61 b ​​and ranging pixels 61 c arranged alternately in the row direction X are arranged alternately in the column direction Y on the imaging surface 60. It is sufficient that the pixel lines 63 include a plurality of pairs of ranging pixels 61 b ​​and ranging pixels 61 c, and they may also include normal pixels 61 a in addition to these pairs. Hereinafter, when there is no need to distinguish between the pixel lines 62 and 63, they will also be simply referred to as pixel lines. The imaging element 5 further includes a drive circuit 64 that drives the pixels 61 arranged on the imaging surface 60 and a signal processing circuit 65 that processes pixel signals read out to signal lines from each pixel 61 in each pixel line arranged on the imaging surface 60.

[0047] In the following description, one end of the imaging surface 60 in the column direction Y (upper side in the figure) in FIG. 2 will be referred to as the upper end, and the other end of the imaging surface 60 in the column direction Y (lower side in the figure) will be referred to as the lower end.

[0048] The drive circuit 64 independently drives each pixel line based on a signal from the image sensor drive unit 10, resets each pixel 61 included in each pixel line (discharges the charge accumulated in the photoelectric conversion element), and reads out pixel signals corresponding to the charge accumulated in the photoelectric conversion element of each pixel 61 to a signal line.

[0049] The signal processing circuit 65 performs correlated double sampling on the pixel signals read out to the signal lines from the pixels 61 in the pixel line, converts the pixel signals after the correlated double sampling processing into digital signals, and outputs the digital signals to the data bus 25 (see FIG. 1). The signal processing circuit 65 is controlled by the image sensor driving unit 10.

[0050] The digital signal processing unit 17 performs signal processing such as demosaic processing and gamma correction processing on the pixel signals output from the image sensor 5 to the data bus 25 to generate captured image data.

[0051] The digital camera 100 is equipped with a continuous shooting mode in which multiple captured image data are generated in succession in response to a single image capture instruction and recorded on the recording medium 21 .

[0052] In continuous shooting mode, the system control unit 11 drives the image sensor 5 by the image sensor drive unit 10 using the rolling shutter method to capture an image of a subject. Rolling shutter driving includes rolling reset driving and rolling readout driving. Rolling reset driving is a driving method that resets each pixel 61 in a pixel line and starts exposure of each pixel 61, sequentially changing the pixel line. Rolling readout driving is a driving method that reads signals from each pixel 61 in an exposed pixel line and ends exposure of that pixel line, sequentially changing the pixel line.

[0053] In the continuous shooting mode, when the system control unit 11 receives an image capture instruction, it continuously performs recording imaging control, which records captured image data, displays a live view image on the display surface 22b, and causes the image sensor 5 to output pixel signals to be used for distance measurement. In addition, between each of the multiple times of recording imaging control, the system control unit 11 performs display imaging control at least once, which causes the image sensor 5 to display a live view image on the display surface 22b and output pixel signals to be used for distance measurement.

[0054] The ranging is, for example, a phase difference ranging used in phase difference AF (Auto Focus). For example, the ranging is a process of performing a correlation calculation between a first pixel signal group output from each ranging pixel 61 b ​​included in the same pixel line 63 and a second pixel signal group output from each ranging pixel 61 c, and deriving a drive amount of the focus lens required to focus on a target subject based on the result of the correlation calculation.

[0055] The correlation calculation is a process of calculating the area S[d] enclosed by two data waveforms when the data waveform consisting of the first pixel signal group and the data waveform consisting of the second pixel signal group are shifted by a shift amount d, by changing the shift amount d among multiple values.

[0056] <Pixel substrate 66 on which imaging surface 60 is provided> Figure 3 is a diagram showing an example of a pixel substrate 66 on which the imaging surface 60 is provided. The pixel substrate 66 shown in Figure 3 is, for example, a silicon substrate. The imaging surface 60 is provided on, for example, one surface of the pixel substrate 66. In this example, the pixels 61 of the imaging surface 60 are grouped into a first pixel group 60A and a second pixel group 60B. In the example of Figure 3, the first pixel group 60A and the second pixel group 60B are each a pixel group that is arranged contiguously.

[0057] The pixel substrate 66 is also provided with a first sub-substrate 65A, a second sub-substrate 65B, a third sub-substrate 65C, and a fourth sub-substrate 65D. The first sub-substrate 65A and the third sub-substrate 65C are connected to the first pixel group 60A and are capable of reading out image data for the first pixel group 60A. The second sub-substrate 65B and the fourth sub-substrate 65D are connected to the second pixel group 60B and are capable of reading out image data for the second pixel group 60B. The reading out process includes converting analog signals into digital signals and outputting the converted digital signals.

[0058] The readout process of the first pixel group 60A can be performed by at least one of the first sub-substrate 65A and the third sub-substrate 65C. For example, the readout process of the first pixel group 60A can be performed by either the first sub-substrate 65A or the third sub-substrate 65C. Alternatively, the readout process of the first pixel group 60A can be performed by both the first sub-substrate 65A and the third sub-substrate 65C. For example, the pixels of the first pixel group 60A can be divided into two groups, and the readout process of one group can be performed by the first pixel group 60A, and the readout process of the other group can be performed by the third sub-substrate 65C.

[0059] Similarly, the readout process for the second pixel group 60B can be performed by at least one of the second sub-substrate 65B and the fourth sub-substrate 65D.

[0060] The first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D are configured to correspond to the drive circuit 64 and the signal processing circuit 65 shown in FIG. 2, for example.

[0061] 3, the pixels 61 on the imaging surface 60 are divided into two groups (a first pixel group 60A and a second pixel group 60B), but the pixels 61 on the imaging surface 60 may be divided into one group (no grouping) or into three or more groups. A plurality of sub-substrates (two in the example of FIG. 3) are provided for each group of pixels 61 on the imaging surface 60.

[0062] 3, the sub-substrates (first sub-substrate 65A, second sub-substrate 65B, third sub-substrate 65C, and fourth sub-substrate 65D) are provided on the same surface of the pixel substrate 66 as the surface on which the imaging surface 60 is provided, but this configuration is not limited to this. For example, a laminated structure may be used in which the sub-substrates are provided on the surface of the pixel substrate 66 opposite to the surface on which the imaging surface 60 is provided. In this way, the sub-substrates may be arranged laminated on a substrate (pixel substrate 66) on which a plurality of pixels (each pixel 61 of the imaging surface 60) are provided.

[0063] Each pixel 61 of the imaging surface 60 is an example of a "plurality of pixels" according to the present invention. One of the first pixel group 60A and the second pixel group 60B is an example of a "first pixel region" according to the present invention. For example, if the first pixel group 60A is an example of a "first pixel region," the first sub-substrate 65A is an example of a "first circuit" according to the present invention, and the third sub-substrate 65C is an example of a "second circuit" according to the present invention. Alternatively, if the second pixel group 60B is an example of a "first pixel region," the second sub-substrate 65B is an example of a "first circuit" according to the present invention, and the fourth sub-substrate 65D is an example of a "second circuit" according to the present invention.

[0064] For example, the system control unit 11 controls the setting of the circuits to be used for reading out image data of the first pixel group 60A (first pixel region) among the first sub-board 65A (first circuit) and the third sub-board 65C (second circuit) in accordance with the noise generation status in the digital camera 100. The system control unit 11 also controls the setting of the circuits to be used for reading out image data of the second pixel group 60B (first pixel region) among the second sub-board 65B (first circuit) and the fourth sub-board 65D (second circuit) in accordance with the noise generation status in the digital camera 100.

[0065] The noise generation state refers to, for example, the generation state of magnetic flux noise that affects the readout of image data on the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D (first circuit and second circuit). Affecting the readout of image data means, for example, the generation of image noise. For example, periodic magnetic flux noise generated from a power supply circuit or the like becomes noise in the AD conversion reference power supply in the AD conversion unit of the sub-board (see, for example, FIG. 14 ), which may cause striped noise (beat noise) in the readout image.

[0066] In the example of Figure 3, the first pixel group 60A is read out by the first sub-substrate 65A and the third sub-substrate 65C, and the second pixel group 60B is read out by the second sub-substrate 65B and the fourth sub-substrate 65D (the first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D are in the on state).

[0067] Here, for each of the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D, a state in which reading is performed is referred to as ON, and a state in which reading is not performed is referred to as OFF. The system control unit 11 may perform control to turn off the power supply of any of the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D that is in the OFF state.

[0068] <On / Off Control of Each Sub-Board> Figure 4 is a flowchart showing an example of on / off control of each sub-board. The system control unit 11 executes, for example, the process shown in Figure 4. This process is executed, for example, for each image capture. Here, the reading of image data from the first pixel group 60A will be described, but the same applies to the reading of image data from the second pixel group 60B.

[0069] First, the system control unit 11 determines whether a predetermined noise generating source in the digital camera 100 is on or off (step S11). Whether the noise generating source is on or off is an example of the operating status of the noise generating source. Examples of noise generating sources will be described later.

[0070] Next, the system control unit 11 selects one of the first sub-substrate 65A and the third sub-substrate 65C to use for reading out the first pixel group 60A, based on the on / off state of the noise generating source determined in step S11 (step S12). The sub-substrate to use for reading out the first pixel group 60A is at least one of the first sub-substrate 65A and the third sub-substrate 65C.

[0071] Next, the system control unit 11 controls the sub-substrate selected in step S12 from the first sub-substrate 65A and the third sub-substrate 65C to read out the first pixel group 60A (step S13), and ends the series of processes.

[0072] <Information on correspondence between ON / OFF of noise generating source operation and circuits used for readout> Fig. 5 is a diagram showing an example of information on correspondence between ON / OFF of noise generating source operation and circuits used for readout. Here, a case where the noise generating source is a power supply coil will be described.

[0073] For example, suppose that a power coil is disposed near the third sub-board 65C and the fourth sub-board 65D, and when this power coil is turned on, the magnetic flux noise generated by this power coil has a relatively large effect on the reading of image data on the third sub-board 65C and the fourth sub-board 65D. In this case, correspondence information 81 shown in FIG. 5, for example, is stored in a memory (e.g., memory 16) of the digital camera 100.

[0074] In the correspondence information 81, for each on / off operation of the power coil, a sub-substrate among the first sub-substrate 65A and the third sub-substrate 65C used to read out the first pixel group 60A is associated with a sub-substrate among the second sub-substrate 65B and the fourth sub-substrate 65D used to read out the second pixel group 60B.

[0075] In the correspondence information 81, when the power coil is turned on, the first sub-substrate 65A is associated with the sub-substrate used to read out the first pixel group 60A, and the second sub-substrate 65B is associated with the sub-substrate used to read out the second pixel group 60B. In addition, when the power coil is turned off, the correspondence information 81 also corresponds to the first sub-substrate 65A and the third sub-substrate 65C as the sub-substrates used to read out the first pixel group 60A, and the second sub-substrate 65B and the fourth sub-substrate 65D as the sub-substrates used to read out the second pixel group 60B.

[0076] For example, in step S11 shown in Fig. 4, the system control unit 11 determines whether the operation of the power coil is on or off. In this case, in step S12 shown in Fig. 4, the system control unit 11 selects one of the first sub-substrate 65A and the third sub-substrate 65C to be used for reading out the first pixel group 60A, and one of the second sub-substrate 65B and the fourth sub-substrate 65D to be used for reading out the second pixel group 60B, based on the result of the determination of whether the operation of the power coil is on or off and on the correspondence information 81.

[0077] For example, when the power supply coil is turned on, the system control unit 11 selects the first sub-substrate 65A as the sub-substrate to be used for reading out the first pixel group 60A, and the second sub-substrate 65B as the sub-substrate to be used for reading out the second pixel group 60B. This allows readout to be performed using the first sub-substrate 65A and the second sub-substrate 65B without using the third sub-substrate 65C and the fourth sub-substrate 65D, which are relatively susceptible to the influence of magnetic flux noise from the power supply coil, thereby suppressing the influence of magnetic flux noise (the generation of image noise).

[0078] Furthermore, when the operation of the power supply coil is turned off, the system control unit 11 selects the first sub-substrate 65A and the third sub-substrate 65C as the sub-substrates to be used for reading out the first pixel group 60A, and selects the second sub-substrate 65B and the fourth sub-substrate 65D as the sub-substrates to be used for reading out the second pixel group 60B. As a result, when the effect of magnetic flux noise from the power supply coil is small (or nonexistent), the first pixel group 60A can be read out by the first sub-substrate 65A and the third sub-substrate 65C, and the second pixel group 60B can be read out by the second sub-substrate 65B and the fourth sub-substrate 65D, thereby improving the readout speed.

[0079] In the example of Figure 5, a configuration has been described in which control is performed based on correspondence information 81 between the on / off operation of one noise generation source (one power supply coil) and the sub-board used for readout, but a configuration in which control is performed based on correspondence information between a combination of on / off operations of multiple noise generation sources and the sub-board used for readout may also be used.

[0080] Furthermore, if the noise generating source is included in a device that can be interchangeably attached to the digital camera 100, a memory (e.g., memory 16) of the digital camera 100 stores, for each device that can be attached to the digital camera 100, information on whether the noise generating source operates on or off when that device is attached and the sub-board used for readout. The system control unit 11 identifies the device attached to the digital camera 100, specifies the noise generating source based on the identification result, and determines whether the specified noise generating source operates on or off.

[0081] 6 to 9 show examples of setting the sub-substrate drive mode according to the noise generation situation. In the example of Fig. 6, the system control unit 11 sets the first sub-substrate 65A as the sub-substrate that performs the readout process for the first pixel group 60A and the second sub-substrate 65B as the sub-substrate that performs the readout process for the second pixel group 60B, based on the on / off status of the noise generation source. In this case, the first sub-substrate 65A performs the readout process for the first pixel group 60A, and the second sub-substrate 65B performs the readout process for the second pixel group 60B. Meanwhile, the third sub-substrate 65C and the fourth sub-substrate 65D are turned off and do not perform readout.

[0082] 7, the system control unit 11 sets the third sub-substrate 65C as the sub-substrate that performs readout processing for the first pixel group 60A, and the fourth sub-substrate 65D as the sub-substrate that performs readout processing for the second pixel group 60B, based on the on / off status of the noise generation source. In this case, the third sub-substrate 65C performs readout processing for the first pixel group 60A, and the fourth sub-substrate 65D performs readout processing for the second pixel group 60B. Meanwhile, the first sub-substrate 65A and the second sub-substrate 65B are turned off and do not perform readout.

[0083] 8, the system control unit 11 sets the first sub-substrate 65A as the sub-substrate that performs readout processing for the first pixel group 60A, and the fourth sub-substrate 65D as the sub-substrate that performs readout processing for the second pixel group 60B, based on the on / off status of the noise generation source. In this case, the first sub-substrate 65A performs readout processing for the first pixel group 60A, and the fourth sub-substrate 65D performs readout processing for the second pixel group 60B. Meanwhile, the second sub-substrate 65B and the third sub-substrate 65C are turned off and do not perform readout.

[0084] 9, the system control unit 11 sets the third sub-substrate 65C as the sub-substrate that performs readout processing for the first pixel group 60A, and the second sub-substrate 65B as the sub-substrate that performs readout processing for the second pixel group 60B, based on the on / off status of the noise generation source. In this case, the third sub-substrate 65C performs readout processing for the first pixel group 60A, and the second sub-substrate 65B performs readout processing for the second pixel group 60B. Meanwhile, the first sub-substrate 65A and the fourth sub-substrate 65D are turned off and do not perform readout.

[0085] As shown in Figure 3, the state in which the first pixel group 60A is read out using the first sub-substrate 65A and the third sub-substrate 65C and the second pixel group 60B is read out using the second sub-substrate 65B and the fourth sub-substrate 65D (the state in which the first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C and the fourth sub-substrate 65D are on) is called the first driving mode.

[0086] Furthermore, as shown in Figure 6, the state in which the first pixel group 60A is read out by the first sub-substrate 65A and the second pixel group 60B is read out by the second sub-substrate 65B (the first sub-substrate 65A and the second sub-substrate 65B are on, and the third sub-substrate 65C and the fourth sub-substrate 65D are off) is called the second driving mode.

[0087] Furthermore, as shown in Figure 7, the state in which the first pixel group 60A is read out by the third sub-substrate 65C and the second pixel group 60B is read out by the fourth sub-substrate 65D (the first sub-substrate 65A and the second sub-substrate 65B are off, and the third sub-substrate 65C and the fourth sub-substrate 65D are on) is called the third driving mode.

[0088] Furthermore, as shown in Figure 8, the state in which the first pixel group 60A is read out by the first sub-substrate 65A and the second pixel group 60B is read out by the fourth sub-substrate 65D (the first sub-substrate 65A and the fourth sub-substrate 65D are on, and the second sub-substrate 65B and the third sub-substrate 65C are off) is called the fourth driving mode.

[0089] Furthermore, as shown in Figure 9, the state in which the first pixel group 60A is read out by the third sub-substrate 65C and the second pixel group 60B is read out by the second sub-substrate 65B (the second sub-substrate 65B and the third sub-substrate 65C are on, and the first sub-substrate 65A and the fourth sub-substrate 65D are off) is called the fifth driving mode.

[0090] In this way, the system control unit 11 performs control to set the circuit to be used to read out image data of the first pixel region (first pixel group 60A or second pixel group 60B) from the first circuit (first sub-substrate 65A or second sub-substrate 65B) and the second circuit (third sub-substrate 65C or fourth sub-substrate 65D) depending on the noise generation status. For example, the system control unit 11 determines the operating status of the noise generation source, and performs control to set the circuit to be used to read out image data of the first pixel region from the first circuit or second circuit based on the determined operating status. In other words, the system control unit 11 switches the drive mode (from the first drive mode to the fifth drive mode) based on the operating status of the noise generation source.

[0091] This makes it possible to switch between reading out the image data of the first pixel region using the first circuit and the second circuit and reading out the image data of the first pixel region using either the first circuit or the second circuit, depending on the noise occurrence status. Therefore, for example, when there is relatively little noise, the readout speed can be improved by reading out the image data of the first pixel region using the first circuit and the second circuit. On the other hand, when there is relatively much noise, the influence of noise on the readout of the image data can be suppressed by reading out the image data of the first pixel region using the circuit that is relatively less affected by noise, out of the first circuit and the second circuit.

[0092] <Control Based on the Positional Relationship Between Noise Generation Sources and Sub-Circuit Boards> The system control unit 11 may control the switching of drive modes based on the positional relationship between the noise generation sources and the sub-circuit boards, in addition to the operating status of the noise generation sources. For example, the distance (an example of the positional relationship) from each noise generation source is stored in a memory (e.g., memory 16) of the digital camera 100 for each sub-circuit board.

[0093] For example, for the first pixel group 60A, the system control unit 11 sets the sub-substrate, out of the first sub-substrate 65A and the third sub-substrate 65C, whichever is farther from the noise generation source that is turned on (in operation), as the sub-substrate that reads out the image data of the first pixel group 60A. Similarly, for the second pixel group 60B, the system control unit 11 sets the sub-substrate, out of the second sub-substrate 65B and the fourth sub-substrate 65D, whichever is farther from the noise generation source that is turned on, as the sub-substrate that reads out the image data of the second pixel group 60B.

[0094] In addition, when there are multiple noise generating sources that are operating on, the system control unit 11 may calculate the amount of noise that each of the first sub-substrate 65A and the third sub-substrate 65C receives based on the positional relationship (distance) between the multiple noise generating sources that are operating on and the first sub-substrate 65A and the third sub-substrate 65C, and set the sub-substrate of the first sub-substrate 65A or the third sub-substrate 65C that has the smaller amount of noise as the sub-substrate that reads out the image data of the first pixel group 60A.

[0095] In addition, when there are multiple noise generating sources that are operating on, the system control unit 11 may calculate the amount of noise that each of the second sub-substrate 65B and the fourth sub-substrate 65D will receive based on the positional relationship (distance) between the multiple noise generating sources that are operating on and the second sub-substrate 65B and the fourth sub-substrate 65D, and set the sub-substrate of the second sub-substrate 65B or the fourth sub-substrate 65D that has the smaller amount of noise as the sub-substrate that reads out the image data of the second pixel group 60B.

[0096] Furthermore, if the noise source is included in a device that can be interchangeably attached to digital camera 100, the memory of digital camera 100 (e.g., memory 16) stores, for each device that can be attached to digital camera 100, the positional relationship between the noise source and each sub-board when that device is attached. System control unit 11 identifies the devices attached to digital camera 100 and, based on the identification results, specifies the positional relationship between the noise source and each sub-board.

[0097] <Examples of Noise Sources> The noise sources are electronic components that generate magnetic flux noise that affects the reading of image data on the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D. For example, the noise sources are electronic components provided inside the digital camera 100. Alternatively, the noise sources may be electronic devices externally connected to the digital camera 100.

[0098] The noise source includes, for example, a power supply circuit built into the digital camera 100. The power supply circuit built into the digital camera 100 includes a coil or the like that generates magnetic flux noise.

[0099] The noise source may also include a drive circuit for moving the image sensor 5. The drive circuit for moving the image sensor 5 is a drive circuit for BIS (Body Image Stabilization) that moves the image sensor 5 during image capture for the purpose of correcting camera shake, for example.

[0100] The noise source may also include a drive circuit for a display device included in the digital camera 100. The display device is, for example, the display device 22 shown in FIG. 1 . Alternatively, the display device may be an EFV (Electronic Viewfinder) provided in the digital camera 100.

[0101] The noise source may also include a drive circuit for a mechanical shutter (for example, a focal plane shutter) provided in correspondence with the image sensor 5. The drive circuit for the mechanical shutter includes a motor that generates magnetic flux noise in order to scan (for example, wind up) the shutter with a large current.

[0102] The noise source may also include a drive circuit for the lens device 40 included in the digital camera 100. The drive circuit for the lens device 40 is, for example, the lens drive unit 8 or the aperture drive unit 9 shown in FIG. 1 . The drive circuit for the lens device 40 includes a motor or the like that generates magnetic flux noise. The lens device 40 may be a fixed lens that is fixed to the body of the digital camera 100, or an interchangeable lens that is detachable from the body of the digital camera 100. If the lens device 40 is an interchangeable lens, the drive circuit for the lens device 40 may be a drive circuit provided in the lens device 40, or may be a drive circuit provided on the body of the digital camera 100. If the lens device 40 is an interchangeable lens, the location of the drive circuit (e.g., a motor) for the lens device 40 may differ depending on the model of the lens device 40.

[0103] The noise source may also include a drive circuit for a recording device included in the digital camera 100. The drive circuit for a recording device included in the digital camera 100 is, for example, the memory control unit 15 or the external memory control unit 20 shown in FIG.

[0104] The noise source may also include a charging device provided in the digital camera 100. The charging device provided in the digital camera 100 is, for example, a device including a charging coil provided inside the digital camera 100. For example, when capturing an image while charging the digital camera 100, magnetic flux noise from the charging device may affect the reading of image data.

[0105] The noise source may also include a light emitting device (flash) provided in the digital camera 100. The light emitting device provided in the digital camera 100 may be a light emitting device built into the digital camera 100, or may be a light emitting device externally attached to the digital camera 100. The state in which the light emitting device is in operation on may include a charging state (charge state) and a discharging state (light emitting state) of the light emitting device.

[0106] <Other Examples of Operational Status of Noise Generating Source> Although the on / off operation of the noise generating source has been described as an example of the operational status of the noise generating source, the operational status of the noise generating source is not limited to this. For example, the operational status of the noise generating source may be various operational statuses of the noise generating source that may affect the noise generation status. For example, the operational status of the noise generating source may be the operation mode or operation level of the noise generating source.

[0107] Alternatively, the operating status of the noise generating source may be a variable state of a component or device that has the noise generating source. For example, if the noise generating source is a movable monitor (e.g., display device 22), the operating status of the noise generating source may be the movable state of the movable monitor (e.g., tilt state, angle, etc.). For example, the system control unit 11 may determine the operating status of the movable monitor and, based on the determination result, set a sub-board that reads image data.

[0108] <Another Example of On / Off Control of Each Sub-Board> Fig. 10 is a flowchart showing another example of on / off control of each sub-board. The system control unit 11 may execute the process shown in Fig. 10, for example.

[0109] First, the system control unit 11 sets the sub-board drive mode to the first drive mode shown in Figure 3 (step S21). This turns on the first sub-board 65A, second sub-board 65B, third sub-board 65C, and fourth sub-board 65D. Next, the system control unit 11 detects the occurrence of noise that affects the readout of image data (step S22). The method for detecting the occurrence of noise will be described later.

[0110] Next, the system control unit 11 determines whether the amount of noise is less than the threshold based on the detection result of step S22 (step S23). If the amount of noise is less than the threshold (step S23: Yes), the system control unit 11 proceeds to step S37.

[0111] If the amount of noise is not less than the threshold in step S23 (step S23: No), the system control unit 11 sets the sub-board drive mode to the second drive mode shown in Fig. 6 (step S24). This turns on the first sub-board 65A and the second sub-board 65B, and turns off the third sub-board 65C and the fourth sub-board 65D. Next, the system control unit 11 detects the occurrence of noise that affects the readout of image data (step S25).

[0112] Next, the system control unit 11 determines whether the amount of noise is less than the threshold based on the detection result of step S25 (step S26). If the amount of noise is less than the threshold (step S26: Yes), the system control unit 11 proceeds to step S37.

[0113] If the amount of noise is not less than the threshold in step S26 (step S26: No), the system control unit 11 sets the sub-board drive mode to the third drive mode shown in Fig. 7 (step S27). This causes the first sub-board 65A and second sub-board 65B to be turned off, and the third sub-board 65C and fourth sub-board 65D to be turned on. Next, the system control unit 11 detects the occurrence of noise that affects the readout of image data (step S28).

[0114] Next, the system control unit 11 determines whether the amount of noise is less than the threshold based on the detection result of step S28 (step S29). If the amount of noise is less than the threshold (step S29: Yes), the system control unit 11 proceeds to step S37.

[0115] If the amount of noise is not less than the threshold in step S29 (step S29: No), the system control unit 11 sets the sub-board drive mode to the fourth drive mode shown in Fig. 8 (step S30). This turns on the first sub-board 65A and the fourth sub-board 65D, and turns off the second sub-board 65B and the third sub-board 65C. Next, the system control unit 11 detects the occurrence of noise that affects the readout of image data (step S31).

[0116] Next, the system control unit 11 determines whether the amount of noise is less than the threshold based on the detection result of step S31 (step S32). If the amount of noise is less than the threshold (step S32: Yes), the system control unit 11 proceeds to step S37.

[0117] If the amount of noise is not less than the threshold in step S32 (step S32: No), the system control unit 11 sets the sub-board drive mode to the fifth drive mode shown in Fig. 9 (step S33). This turns on the second sub-board 65B and the third sub-board 65C, and turns off the first sub-board 65A and the fourth sub-board 65D. Next, the system control unit 11 detects the occurrence of noise that affects the readout of image data (step S34).

[0118] Next, the system control unit 11 determines whether the amount of noise is less than the threshold based on the detection result of step S34 (step S35). If the amount of noise is less than the threshold (step S35: Yes), the system control unit 11 proceeds to step S37.

[0119] In step S35, if the amount of noise is not less than the threshold value (step S35: No), the system control unit 11 sets the driving mode of the sub-board to the driving mode with the smallest amount of noise detected in steps S22, S25, S28, S31, and S34, out of the first to fifth driving modes set in steps S21, S24, S27, S30, and S33 (step S36), and proceeds to step S37.

[0120] In step S37, the system control unit 11 determines the drive mode of the sub-board set at that time as the drive mode to be used for actual image capture (step S37), and then performs a series of processes. That is, the system control unit 11 captures an image in the drive mode determined in step S37, and outputs image data obtained by the image capture. The image data may be output, for example, by recording it in non-volatile memory or displaying it on a display.

[0121] In this way, the system control unit 11 may detect the noise occurrence state. In this case, the system control unit 11 performs control to set the circuits of the first sub-substrate 65A (first circuit) and the third sub-substrate 65C (second circuit) to be used for reading out image data of the first pixel group 60A (first pixel region) based on the detected noise occurrence state. Furthermore, the system control unit 11 performs control to set the circuits of the second sub-substrate 65B (first circuit) and the fourth sub-substrate 65D (second circuit) to be used for reading out image data of the second pixel group 60B (first pixel region) based on the detected noise occurrence state.

[0122] For example, the system control unit 11 detects the noise generation situation while changing the sub-board used to read out image data among the sub-boards, and based on the detected results, determines the sub-board to be used to read out image data during actual imaging.

[0123] 10, the system control unit 11 detects the noise generation status while changing the sub-board used to read out image data from among the sub-boards, and when the amount of noise falls below a threshold, determines the sub-board at that time as the sub-board to be used to read out image data in actual imaging. This makes it possible to shorten the time it takes to determine the sub-board to be used to read out image data in actual imaging.

[0124] 10, the system control unit 11 detects the noise generation status while changing the sub-board used to read out image data from among the sub-boards, and if the amount of noise does not fall below the threshold in any case, determines the combination of sub-boards with the smallest amount of noise as the sub-board to be used to read out image data in actual imaging. This makes it possible to read out image data using the combination of sub-boards with the smallest amount of noise.

[0125] Figure 11 shows a modified example of the on / off control of each sub-board shown in Figure 10. The system control unit 11 may determine the combination of sub-boards that results in the smallest amount of noise as the sub-board to be used for reading image data in actual imaging, not just when the amount of noise is below the threshold. For example, as shown in Figure 11, the system control unit 11 may execute steps S21, S22, S24, S25, S27, S28, S30, S31, S33, S34, S36, and S37 of the control shown in Figure 10.

[0126] Furthermore, these controls based on the detection results of the noise generation state may be combined with the above-mentioned control based on the on / off of the operation of the noise generation source. For example, in the example of Fig. 10, the noise generation state is detected by changing the drive mode of the sub-board from the first drive mode to the fifth drive mode, that is, the candidate drive modes are changed from the first drive mode to the fifth drive mode, but these candidate drive modes may be changed by turning on / off the operation of the noise generation source.

[0127] For example, correspondence information between on / off combinations of operations for each noise source and candidate drive modes is stored in a memory (e.g., memory 16) of the digital camera 100. The system control unit 11 then derives candidate drive modes based on the on / off combinations of operations for each noise source and this correspondence information.

[0128] The system control unit 11 then detects the noise generation state while sequentially setting the derived drive mode candidates, and when the amount of noise falls below a threshold, determines the drive mode at that time as the drive mode (sub-board) to be used for reading image data in actual imaging. Alternatively, the system control unit 11 may determine, from among the derived drive modes, the drive mode that produces the smallest amount of noise as the drive mode (sub-board) to be used for reading image data in actual imaging.

[0129] <Controlling the on / off of each sub-board according to the model of the attached device> If the noise source is included in a device that is interchangeably attached to the digital camera 100, the system control unit 11 may identify the device attached to the digital camera 100 and determine the above-mentioned candidate driving modes based on the identification result.

[0130] As an example, suppose that a certain interchangeable lens device 40 has a noise generating source (e.g., a motor) located near the first sub-board 65A when attached to the digital camera 100. When the system control unit 11 recognizes that this lens device 40 has been attached to the digital camera 100, it sets the candidate drive modes to the third drive mode and the fifth drive mode, in which the first sub-board 65A is turned off.

[0131] The system control unit 11 then sequentially sets the third drive mode and the fifth drive mode, and determines the drive mode in which the amount of noise is below the threshold as the drive mode (sub-board) to be used for reading image data in actual imaging. Alternatively, the system control unit 11 determines the drive mode in which the amount of noise is minimized, out of the third drive mode and the fifth drive mode, as the drive mode (sub-board) to be used for reading image data in actual imaging.

[0132] In this way, it is possible to reduce the time required to determine the drive mode to be used for reading image data during actual imaging by narrowing down the candidate drive modes depending on the model of the device, including the noise source, attached to digital camera 100. Note that candidate drive modes for the model of interchangeable lens device 40 are stored in, for example, a memory (e.g., memory 16) of digital camera 100.

[0133] <Method for Detecting the State of Noise Occurrence> The state of noise occurrence can be detected, for example, based on sensing values ​​obtained from an OB (Optical Black) region provided in the image sensor 5. That is, because the OB region is light-shielded, the sensing values ​​obtained from the OB region are not affected by the optical state and change depending on the state of noise occurrence. Therefore, the system control unit 11 can detect the state of noise occurrence based on the sensing values ​​obtained from the OB region.

[0134] Furthermore, by providing a magnetic flux sensor near the image sensor 5 of the digital camera 100, the noise generation state may be detected based on the sensing value obtained by the magnetic flux sensor.

[0135] Furthermore, the detection of the noise occurrence state may be performed based on image noise contained in an image read out by reading image data from the image sensor 5. For example, the system control unit 11 detects the noise occurrence state based on image noise contained in image data read out in a state in which exposure of the image sensor 5 to light is blocked by the shutter of the image capture unit 50. Alternatively, the system control unit 11 may detect the noise occurrence state based on image noise contained in image data read out for live view or the like.

[0136] <Switching ON / OFF Control of Each Sub-Circuit According to ISO Sensitivity> Fig. 12 is a flowchart showing an example of switching ON / OFF control of each sub-circuit according to ISO sensitivity. When capturing an image in the digital camera 100, the system control unit 11 may execute, for example, the process shown in Fig. 12.

[0137] First, the system control unit 11 acquires the ISO sensitivity setting for image capture in the digital camera 100 (step S41). The ISO sensitivity is a photosensitivity (a signal amplification level in an image sensor) established by the ISO (International Organization for Standardization).

[0138] Next, the system control unit 11 determines whether the ISO sensitivity acquired in step S41 is less than the threshold value TH (step S42). If the ISO sensitivity is not less than the threshold value TH (step S42: No), the system control unit 11 performs on / off control of each sub-board according to the noise generation status (based on the operating state of the noise generation source and the detection result of the noise generation status) as described above, performs imaging (step S43), and ends the series of processes.

[0139] In step S42, if the ISO sensitivity is less than the threshold value TH (step S42: Yes), that is, if the ISO sensitivity is low, the effect of magnetic flux noise is not noticeable (image noise is not noticeable). In this case, the system control unit 11 turns on each sub-board (i.e., performs image capture in the first drive mode) regardless of the noise generation state (step S44), and ends the series of processes.

[0140] In this way, the system control unit 11 may control the readout of image data by the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D (both the first circuit and the second circuit) according to the ISO sensitivity (photosensitivity) set for capturing an image by the digital camera 100 (image sensor 5). For example, when the ISO sensitivity is lower than a predetermined value, the system control unit 11 reads image data by the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D (both the first circuit and the second circuit). Furthermore, when the ISO sensitivity is equal to or higher than the predetermined value, the system control unit 11 controls which of the first sub-board 65A, the second sub-board 65B, the third sub-board 65C, and the fourth sub-board 65D (the first circuit and the second circuit) is to be used to read image data, based on the operating status of the noise generating source and the detection results of the noise generation status, as described above.

[0141] In other words, when the ISO sensitivity is low and the impact of noise is small, the readout speed can be improved by reading out image data using the first sub-board 65A, the second sub-board 65B, the third sub-board 65C and the fourth sub-board 65D (both the first circuit and the second circuit) regardless of the noise generation conditions.

[0142] <Controller provided on pixel substrate 66> Fig. 13 is a diagram showing an example of a controller provided on the pixel substrate 66. Although the configuration has been described in which the drive mode of the sub-substrate is controlled by the system controller 11 external to the pixel substrate 66 (image sensor 5), the drive mode of the sub-substrate may also be controlled by a controller provided in the pixel substrate 66. In the example of Fig. 13, a controller 68 is provided on the pixel substrate 66. The controller 68 can be configured by various processors, similar to the system controller 11.

[0143] The control of the drive mode of the sub-substrate described above may be performed by the control unit 68 instead of the system control unit 11. Furthermore, the control of the drive mode of the sub-substrate described above may be performed by any one of the first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D (for example, any one of the control units 73A to 73D shown in FIG. 14).

[0144] 14 is a diagram showing an example of the configuration of each sub-board. For example, the first sub-board 65A includes an AD conversion unit 71A, an IF unit 72A, and a control unit 73A.

[0145] The AD conversion unit 71A converts image data read from the pixels of the first pixel group 60A from analog signals to digital signals. The IF unit 72A is an interface that outputs the image data converted into digital signals by the AD conversion unit 71A to the outside of the first sub-substrate 65A (e.g., to the data bus 25). The control unit 73A controls each unit of the first sub-substrate 65A, including the IF unit 72A and the AD conversion unit 71A.

[0146] Similarly, the second sub-board 65B includes an AD conversion unit 71B, an IF unit 72B, and a control unit 73B. The third sub-board 65C includes an AD conversion unit 71C, an IF unit 72C, and a control unit 73C. The fourth sub-board 65D includes an AD conversion unit 71D, an IF unit 72D, and a control unit 73D.

[0147] (Variation 1) In the above embodiment, the case where the phase difference method is used as the distance measurement method (AF method) has been described, but the distance measurement method may be a contrast method used in contrast AF. Also, the distance measurement method may be a hybrid method that combines the phase difference method and the contrast method.

[0148] (Variation 2) The imaging device of the present invention is not limited to the digital camera 100 whose main purpose is to capture images, but can also be applied to various information terminals having an imaging function, such as smartphones, tablet terminals, notebook personal computers, etc. Next, the configuration of a smartphone 200, which is another embodiment of the imaging device of the present invention, will be described.

[0149] <Appearance of Smartphone 200> Fig. 15 shows the appearance of smartphone 200. Smartphone 200 shown in Fig. 15 has a flat housing 201, and is provided with a display input unit 204 on one surface of housing 201, in which a display panel 202 as a display unit and an operation panel 203 as an input unit are integrated.

[0150] The housing 201 also includes a speaker 205, a microphone 206, an operation unit 207, and a camera unit 208. The configuration of the housing 201 is not limited to this, and for example, it is also possible to adopt a configuration in which the display unit and the input unit are independent, or a configuration having a folding structure or a sliding mechanism.

[0151] <Configuration of Smartphone 200> FIG. 16 is a block diagram showing the configuration of the smartphone 200.

[0152] As shown in FIG. 16 , the main components of the smartphone include a wireless communication unit 210, a display input unit 204, a call unit 211, an operation unit 207, a camera unit 208, a memory unit 212, an external input / output unit 213, a GNSS (Global Navigation Satellite System) receiving unit 214, a motion sensor unit 215, a power supply unit 216, and a main control unit 220.

[0153] The smartphone 200 also has, as its main function, a wireless communication function for performing mobile wireless communication via a base station device BS (not shown) and a mobile communication network NW (not shown).

[0154] The wireless communication unit 210 performs wireless communication with a base station device BS included in the mobile communication network NW in accordance with instructions from the main control unit 220. Using this wireless communication, various file data such as audio data and image data, e-mail data, etc. are sent and received, and web data, streaming data, etc. are received.

[0155] The display input unit 204 is a so-called touch panel that, under the control of the main control unit 220, displays images (still images and moving images) or text information, etc. to visually convey information to the user and detects user operations on the displayed information, and is equipped with a display panel 202 and an operation panel 203.

[0156] The display panel 202 uses a liquid crystal display (LCD), an organic electroluminescence display (OELD), or the like as a display device.

[0157] The operation panel 203 is a device placed so that an image displayed on the display surface of the display panel 202 can be seen, and detects one or more coordinates operated by a user's finger or a stylus. When this device is operated by the user's finger or a stylus, a detection signal generated by the operation is output to the main control unit 220. Next, the main control unit 220 detects the operation position (coordinates) on the display panel 202 based on the received detection signal.

[0158] As shown in Figure 16, the display panel 202 and operation panel 203 of a smartphone 200, which is an example of one embodiment of the imaging device of the present invention, are integrated to form a display input unit 204, and the operation panel 203 is positioned so that it completely covers the display panel 202.

[0159] When such an arrangement is adopted, operation panel 203 may also have a function for detecting user operations in areas outside display panel 202. In other words, operation panel 203 may have a detection area for the overlapping portion that overlaps display panel 202 (hereinafter referred to as a display area), and a detection area for the remaining outer edge portion that does not overlap display panel 202 (hereinafter referred to as a non-display area).

[0160] The size of the display area and the size of the display panel 202 may be exactly the same, but they do not necessarily have to be the same. The operation panel 203 may also have two sensitive areas: an outer edge portion and an inner portion. The width of the outer edge portion is designed appropriately depending on the size of the housing 201, etc.

[0161] Furthermore, the position detection method used in the operation panel 203 may be a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, or the like, and any method may be used.

[0162] The call unit 211 is equipped with a speaker 205 or a microphone 206, and converts the user's voice input through the microphone 206 into voice data that can be processed by the main control unit 220 and outputs it to the main control unit 220, or decodes voice data received by the wireless communication unit 210 or the external input / output unit 213 and outputs it from the speaker 205.

[0163] Also, as shown in FIG. 15, for example, the speaker 205 can be mounted on the same surface as the display input unit 204, and the microphone 206 can be mounted on the side of the housing 201.

[0164] The operation unit 207 is a hardware key using a key switch or the like, and receives instructions from the user. For example, as shown in Fig. 15 , the operation unit 207 is a push-button switch mounted on the side surface of the housing 201 of the smartphone 200, which turns on when pressed with a finger or the like, and turns off when the finger is released due to the restoring force of a spring or the like.

[0165] The storage unit 212 stores the control program and control data of the main control unit 220, application software, address data associated with names or telephone numbers of communication partners, data of sent and received e-mails, web data downloaded by web browsing, downloaded content data, and also temporarily stores streaming data, etc. The storage unit 212 is composed of an internal storage unit 217 built into the smartphone and an external storage unit 218 having a removable external memory slot.

[0166] The internal memory unit 217 and the external memory unit 218 constituting the memory unit 212 are realized using storage media such as a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., MicroSD (registered trademark) memory, etc.), a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

[0167] The external input / output unit 213 serves as an interface with all external devices connected to the smartphone 200, and is used to directly or indirectly connect to other external devices via communication (e.g., Universal Serial Bus (USB), Institute of Electrical and Electronics Engineers (IEEE) 1394, Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee (registered trademark), etc.) or a network (e.g., Ethernet (registered trademark), wireless LAN (Local Area Network), etc.).

[0168] Examples of external devices connected to the smartphone 200 include a wired / wireless headset, a wired / wireless external charger, a wired / wireless data port, a memory card connected via a card socket, a SIM (Subscriber Identity Module Card) / UIM (User Identity Module Card) card, an external audio / video device connected via an audio / video I / O (Input / Output) terminal, a wirelessly connected external audio / video device, a wired / wirelessly connected smartphone, a wired / wirelessly connected personal computer, a wired / wirelessly connected personal computer, and earphones.

[0169] The external input / output unit 213 can transmit data received from such external devices to each component inside the smartphone 200, or transmit data inside the smartphone 200 to external devices.

[0170] The GNSS receiving unit 214 receives GNSS signals transmitted from the GNSS satellites ST1 to STn in accordance with instructions from the main control unit 220, executes positioning calculation processing based on the received multiple GNSS signals, and detects a position consisting of the latitude, longitude, and altitude of the smartphone 200. When the GNSS receiving unit 214 can acquire position information from the wireless communication unit 210 or the external input / output unit 213 (for example, a wireless LAN), it can also detect the position using the position information.

[0171] The motion sensor unit 215 includes, for example, a three-axis acceleration sensor, and detects the physical movement of the smartphone 200 in accordance with instructions from the main control unit 220. By detecting the physical movement of the smartphone 200, the direction of movement or acceleration of the smartphone 200 is detected. The detection result is output to the main control unit 220.

[0172] The power supply unit 216 supplies power stored in a battery (not shown) to each unit of the smartphone 200 in accordance with instructions from the main control unit 220 .

[0173] The main control unit 220 includes a microprocessor, operates according to the control program and control data stored in the storage unit 212, and controls all the units of the smartphone 200. The microprocessor of the main control unit 220 has the same functions as the system control unit 11. The main control unit 220 also includes a mobile communication control function that controls all the units of the communication system to perform voice communication or data communication via the wireless communication unit 210, and an application processing function.

[0174] The application processing function is realized by the main control unit 220 operating in accordance with the application software stored in the storage unit 212. Examples of the application processing function include an infrared communication function that controls the external input / output unit 213 to perform data communication with a connected device, an email function that sends and receives emails, and a web browsing function that views web pages.

[0175] The main control unit 220 also has an image processing function for displaying video on the display input unit 204 based on image data (still image or moving image data) such as received data or downloaded streaming data.

[0176] The image processing function refers to a function in which the main control unit 220 decodes the image data, performs image processing on the decoded result, and displays the image on the display input unit 204 .

[0177] Furthermore, the main control unit 220 executes display control for the display panel 202 and operation detection control for detecting user operations via the operation unit 207 and the operation panel 203 .

[0178] By executing display control, the main control unit 220 displays software keys such as icons or scroll bars for launching application software, or displays a window for creating e-mail, etc. The scroll bar refers to a software key that accepts instructions to move the displayed portion of an image, such as a large image that cannot fit in the display area of ​​the display panel 202.

[0179] In addition, by executing operation detection control, the main control unit 220 detects user operations through the operation unit 207, accepts operations on the above icons and input of character strings into the input field of the above window through the operation panel 203, or accepts requests to scroll the displayed image through the scroll bar.

[0180] Furthermore, by executing operation detection control, the main control unit 220 determines whether the operation position on the operation panel 203 is an overlapping portion (display area) that overlaps the display panel 202 or an outer edge portion (non-display area) that does not overlap the display panel 202, and is equipped with a touch panel control function that controls the sensitive area of ​​the operation panel 203 or the display position of the software key.

[0181] The main control unit 220 can also detect a gesture operation on the operation panel 203 and execute a preset function in response to the detected gesture operation.

[0182] Gesture operation is not a simple touch operation as in the past, but rather refers to an operation of drawing a path with a finger or the like, specifying multiple positions simultaneously, or combining these to draw a path for at least one of multiple positions.

[0183] The camera section 208 includes the image capturing section 50 in the digital camera 100 shown in FIG.

[0184] The captured image data generated by the camera unit 208 can be stored in the storage unit 212 or output via the external input / output unit 213 or the wireless communication unit 210 .

[0185] In the smartphone 200 shown in FIG. 15 , the camera unit 208 is mounted on the same surface as the display input unit 204, but the mounting position of the camera unit 208 is not limited to this, and it may be mounted on the back surface of the display input unit 204.

[0186] The camera unit 208 can also be used for various functions of the smartphone 200. For example, an image acquired by the camera unit 208 can be displayed on the display panel 202, or an image from the camera unit 208 can be used as one of the operation inputs for the operation panel 203.

[0187] Furthermore, when the GNSS receiving unit 214 detects a position, it can also detect the position by referring to an image from the camera unit 208. Furthermore, it can also refer to an image from the camera unit 208 to determine the optical axis direction of the camera unit 208 of the smartphone 200 or determine the current usage environment without using a triaxial acceleration sensor or by using the image in combination with a triaxial acceleration sensor. Of course, the image from the camera unit 208 can also be used in application software.

[0188] In addition, image data of still or video images can be added with location information acquired by the GNSS receiving unit 214, audio information acquired by the microphone 206 (which may be converted to text information by the main control unit, etc.), posture information acquired by the motion sensor unit 215, etc., and stored in the memory unit 212 or output via the external input / output unit 213 or wireless communication unit 210.

[0189] In the smartphone 200 configured as described above, as in the digital camera 100, the influence of noise on the reading of image data can be suppressed.

[0190] Although various embodiments have been described above, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present invention. Furthermore, the components of the above embodiments may be combined in any manner as long as they do not deviate from the spirit of the invention.

[0191] This application is based on a Japanese patent application (Patent Application No. 2024-045108) filed on March 21, 2024, the contents of which are incorporated herein by reference.

[0192] The present invention is highly convenient and effective when applied to digital cameras and the like.

[0193] REFERENCE SIGNS LIST 1 imaging lens 2 aperture 4 lens control unit 5 imaging element 8 lens driving unit 9 aperture driving unit 10 imaging element driving unit 11 system control unit 14, 207 operation unit 15 memory control unit 16 memory 17 digital signal processing unit 20 external memory control unit 21 recording medium 22 display device 22a display controller 22b display surface 24 control bus 25 data bus 40 lens device 50 imaging unit 60 imaging surface 60A first pixel group 60B second pixel group 61 pixel 61a normal pixel 61b, 61c ranging pixel 62, 63 pixel line 64 drive circuit 65 signal processing circuit 65A first sub-substrate 65B second sub-substrate 65C third sub-substrate 65D fourth sub-substrate 66 pixel substrate 68, 73A to 73D control unit 71A to 71D AD conversion unit 72A to 72D IF unit 81 Correspondence information 100 Digital camera 100A Main body unit 200 Smartphone 201 Housing 202 Display panel 203 Operation panel 204 Display input unit 205 Speaker 206 Microphone 208 Camera unit 210 Wireless communication unit 211 Call unit 212 Memory unit 213 External input / output unit 214 GNSS receiving unit 215 Motion sensor unit 216 Power supply unit 217 Internal memory unit 218 External memory unit 220 Main control unit

Claims

1. An imaging device comprising: a processor; an imaging element having a plurality of pixels including a first pixel region; a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region; and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, wherein the processor controls to set which of the first circuit and the second circuit is to be used to read out image data of the first pixel region according to noise generation conditions.

2. An imaging device according to claim 1, wherein the processor switches between reading out image data of the first pixel region using the first circuit and the second circuit, and reading out image data of the first pixel region using either the first circuit or the second circuit, depending on the noise generation status.

3. An imaging device according to claim 1, wherein the processor performs the control based on the operating status of a noise generating source.

4. An imaging device according to claim 3, wherein the processor performs the control based on the positional relationship between the noise generating source and the first and second circuits, and on the operating status of the noise generating source.

5. An imaging device according to claim 4, wherein the processor controls, when the noise generating source is in operation, the image data of the first pixel region to be read out by one of the first circuit and the second circuit, whichever is farther from the noise generating source.

6. An imaging device according to claim 3, wherein the noise source includes a power supply circuit.

7. An imaging device according to claim 3, wherein the noise source includes a drive circuit for moving the imaging element.

8. An imaging device according to claim 3, wherein the noise source includes a drive circuit for a display device provided in the imaging device.

9. An imaging device according to claim 3, wherein the noise source includes a drive circuit for a mechanical shutter provided in correspondence with the imaging element.

10. An imaging device according to claim 3, wherein the noise source includes a drive circuit for a lens provided in the imaging device.

11. An imaging device according to claim 3, wherein the noise source includes a drive circuit for a recording device provided in the imaging device.

12. An imaging device according to claim 3, wherein the noise source includes a charging device provided in the imaging device.

13. An imaging device according to claim 3, wherein the noise source includes a light emitting device provided in the imaging device.

14. An imaging device according to claim 3, wherein the noise source includes a device externally connected to the imaging device.

15. An imaging device according to claim 1, wherein the processor detects the noise occurrence state and performs the control based on the detected noise occurrence state.

16. An imaging device according to claim 15, wherein the processor determines which of the first circuit and the second circuit to use for reading out image data of the first pixel region based on the results of detecting the noise generation state while changing which of the first circuit and the second circuit to use for reading out image data of the first pixel region.

17. An imaging device according to any one of claims 1 to 16, wherein the processor controls the first circuit and the second circuit to read out image data of the first pixel region in accordance with a photosensitivity set in an imaging device including the imaging device.

18. An imaging device according to claim 17, wherein the processor reads out image data of the first pixel region using the first circuit and the second circuit when the photosensitivity is lower than a predetermined value.

19. A control method for an imaging device comprising a processor, an imaging element having a plurality of pixels including a first pixel region, a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region, and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, wherein the processor controls to set one of the first circuit and the second circuit to be used to read out image data of the first pixel region according to a noise generation state.

20. A control program for an imaging device comprising a processor, an imaging element having a plurality of pixels including a first pixel region, a first circuit connected to the first pixel region and capable of reading out image data of the first pixel region, and a second circuit connected to the first pixel region and capable of reading out image data of the first pixel region, the control program causing the processor to execute a process of controlling the setting of one of the first circuit and the second circuit to be used to read out image data of the first pixel region according to noise generation conditions.

Images