Imaging device, control method, and control program
By controlling power supply to different pixel groups and circuits based on the readout area, the imaging device optimizes power usage, addressing the challenge of high power consumption in continuous shooting modes.
Patent Information
- Application Number
- PCT/JP2024/045416
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-29
- Filing Date
- 2024-12-23
- Publication Date
- 2025-09-04
AI Technical Summary
Existing imaging devices face challenges in reducing power consumption, particularly during continuous shooting modes where multiple captured image data are generated in succession.
The imaging device employs a processor to control the power supply to different pixel groups and circuits based on the readout area, turning off power to circuits when they are not needed, thereby optimizing power usage.
This approach effectively reduces power consumption by selectively powering only the necessary circuits during image capture, enhancing energy efficiency without compromising image quality.
Smart Images

Figure JP2024045416_04092025_PF_FP_ABST
Abstract
Description
Imaging device, control method, and control program
[0001] The present invention relates to an imaging device, a control method, and a control program.
[0002] Patent document 1 describes an electronic device in which an image sensor includes a first image sensor region that captures light incident through an optical system under first image sensor conditions and generates a detection signal for detecting the focus of the optical system, and a second image sensor region that captures light incident through the optical system under second image sensor conditions different from the first image sensor conditions and generates an image signal, and a control unit includes a setting unit that sets the position at which the first image sensor region and the second image sensor region are to be disposed, and an analysis unit that analyzes the luminance distribution of the subject and extracts a specific region at which light from a specific subject is incident on the image sensor, and the setting unit sets the first image sensor region and the second image sensor region in the specific region extracted by the analysis unit.
[0003] Patent Document 2 describes an imaging element that includes a normal pixel group, a phase difference pixel group, a normal exposure control unit that controls the charge accumulation start / end timing of the normal pixel group, and a phase difference exposure control unit that controls the charge accumulation start / end timing of the phase difference pixel group independently of the normal exposure control unit.
[0004] Patent document 3 describes an imaging device having an imaging element having a pixel area in which a plurality of pixels are arranged in a matrix, processing means for processing image signals read out from the pixel area, generation means for generating a pattern of pixels to be read out based on one of a plurality of different compression rates set for each of a plurality of divided areas obtained by dividing the pixel area, and control means for turning off the processing means corresponding to pixels from which signals are not to be read out based on the generated pattern, and setting means for setting one of a plurality of different compression rates for each of the plurality of divided areas, and the imaging device sets a lower compression rate for a divided area among the plurality of divided areas that will capture images with higher image quality.
[0005] Japanese Patent Publication No. 2017-118579 Japanese Patent Publication No. 2017-041735 Japanese Patent Publication No. 2018-182543
[0006] One embodiment of the technique of the present disclosure provides an imaging device, a control method, and a control program that can reduce power consumption.
[0007] (1) An imaging device comprising: a processor; a plurality of pixels including a first pixel and a second pixel; a first circuit connected to the first pixel and performing a readout process of image data for the first pixel; and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, wherein the processor sets a readout region among the plurality of pixels for reading out image data, controls the power supply to the first circuit based on the relationship between the readout region and the first pixel, and controls the power supply to the second circuit based on the relationship between the readout region and the second pixel.
[0008] (2) The imaging device according to (1), wherein the processor controls the power supply of the first circuit to be turned on when the readout area includes the first pixel, and the power supply of the first circuit to be turned off when the readout area does not include the first pixel.
[0009] (3) The imaging device according to (2), wherein the processor controls the power supply of the second circuit to be turned on when the readout area includes the second pixel, and the power supply of the second circuit to be turned off when the readout area does not include the second pixel.
[0010] (4) The imaging device according to (3), wherein, when the readout area includes the first pixel and the second pixel, the processor controls to turn off the power supply of the second circuit during a readout period of the first pixel and to turn off the power supply of the first circuit during a readout period of the second pixel.
[0011] (5) The imaging device according to any one of (1) to (4), wherein the first pixel and the second pixel are pixels having different functions.
[0012] (6) The imaging device according to any one of (1) to (5), wherein the first pixel and the second pixel are pixels of different types.
[0013] (7) The imaging device according to (5) or (6), wherein the first pixel is a pixel for recording an image, and the second pixel is a pixel for detecting a phase difference.
[0014] (8) The imaging device according to any one of (2) to (4), wherein the first circuit and the second circuit have a plurality of processing units to which power is supplied, and turning off the power supply means turning off the power supply of at least one of the plurality of processing units.
[0015] (9) The imaging device according to (8), wherein the plurality of processing units include at least one of a conversion unit that converts an analog signal into a digital signal, an output unit that outputs the digital signal, and a control unit that controls at least one of the conversion unit and the output unit.
[0016] (10) The imaging device according to any one of (1) to (9), wherein the first circuit and the second circuit are stacked on a substrate on which the plurality of pixels are provided.
[0017] (11) The imaging device according to any one of (1) to (10), wherein the processor controls the power supply to the first circuit and the second circuit in accordance with a frame rate of video imaging by the imaging device.
[0018] (12) The imaging device according to any one of (1) to (11), wherein the first pixels and the second pixels are pixel groups that are arranged consecutively.
[0019] (13) A control method for an imaging device including a processor, a plurality of pixels including a first pixel and a second pixel, a first circuit connected to the first pixel and performing a readout process of image data for the first pixel, and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, wherein the processor sets a readout area from among the plurality of pixels for reading out image data, controls the power supply to the first circuit based on the relationship between the readout area and the first pixel, and controls the power supply to the second circuit based on the relationship between the readout area and the second pixel.
[0020] (14) A control program for an imaging device including a processor, a plurality of pixels including a first pixel and a second pixel, a first circuit connected to the first pixel and performing a readout process of image data for the first pixel, and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, the control program causing the processor to execute the following processes: set a readout area among the plurality of pixels for reading out image data; control the power supply to the first circuit based on the relationship between the readout area and the first pixel; and control the power supply to the second circuit based on the relationship between the readout area and the second pixel.
[0021] According to the present invention, it is possible to provide an imaging device, a control method, and a control program that can reduce power consumption.
[0022] 10A and 10B are diagrams illustrating an example of the configuration of a digital camera 100 to which an imaging device is applied. FIG. 10B is a plan view schematic diagram illustrating the general configuration of the imaging element 5 illustrated in FIG. 1. FIG. 10C is a diagram illustrating an example of a pixel substrate 66 on which an imaging surface 60 is provided. FIG. 10D is a flowchart illustrating an example of power supply control for each sub-substrate. FIG. 10E is an example of power supply control for each sub-substrate according to the readout area (part 1). FIG. 10F is an example of power supply control for each sub-substrate according to the readout area (part 2). FIG. 10G is an example of power supply control for each sub-substrate according to the readout area (part 3). FIG. 10H is an example of power supply control for each sub-substrate according to the readout area (part 4). FIG. 10H is a flowchart illustrating another example of power supply control for each sub-substrate. FIG. 10I is a diagram illustrating an example of a control unit provided on the pixel substrate 66. FIG. 10I is a diagram illustrating an example of the configuration of each sub-substrate. FIG. 10I is an example of power supply control for each sub-substrate according to the readout area (part 1). FIG. 10I is an example of power supply control for each sub-substrate according to the readout area (part 2). FIG. 10I is a flowchart illustrating an example of power supply control switching according to the frame rate. FIG. 10I is an external view of a smartphone 200. FIG. 2 is a block diagram showing the configuration of a smartphone 200.
[0023] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0024] <Example of the Configuration of a Digital Camera 100 to which an Imaging Apparatus of the Present Invention is Applied> FIG. 1 is a diagram showing an example of the configuration of a digital camera 100 to which an imaging apparatus of the present invention is applied.
[0025] 1 is a digital camera including a lens device 40 having an imaging lens 1, an aperture 2, a lens control unit 4, a lens drive unit 8, and an aperture drive unit 9, and a main body 100A. The main body 100A includes an imaging unit 50, a system control unit 11, an operation unit 14, a display device 22, a memory 16 including a RAM (Random Access Memory) and a ROM (Read Only Memory), a memory control unit 15 that controls data recording to and data reading from the memory 16, a digital signal processing unit 17, and an external memory control unit 20 that controls data recording to and data reading from a recording medium 21.
[0026] The lens device 40 may be detachable from the main body 100A, or may be integrated with the main body 100A. The imaging lens 1 includes a focus lens that is movable in the optical axis direction. This focus lens is a lens for adjusting the focus of the imaging optical system that includes the imaging lens 1 and the diaphragm 2, and is composed of a single lens or multiple lenses. When the focus lens moves in the optical axis direction, the position of the principal point of the focus lens changes along the optical axis, changing the focal position on the subject side. Note that the focus lens may be a liquid lens whose principal point in the optical axis direction can be changed by electrical control.
[0027] The lens control unit 4 of the lens device 40 is configured to be able to communicate with the system control unit 11 of the main body 100A via a wired or wireless connection. In accordance with commands from the system control unit 11, the lens control unit 4 controls the focus lens included in the imaging lens 1 via the lens drive unit 8 to change the position of the principal point of the focus lens, and controls the aperture value of the aperture 2 via the aperture drive unit 9.
[0028] The imaging unit 50 includes an imaging element 5 that captures an image of a subject through an imaging optical system including an imaging lens 1 and an aperture 2 , and an imaging element driving unit 10 that drives the imaging element 5 .
[0029] The imaging element 5 has an imaging surface 60 (see FIG. 2) on which a plurality of pixels 61 are arranged two-dimensionally, and converts a subject image formed on the imaging surface 60 by an imaging optical system into pixel signals by the plurality of pixels 61 and outputs the pixel signals. A CMOS (complementary metal-oxide-semiconductor) image sensor, for example, is preferably used as the imaging element 5. The following description will be given assuming that the imaging element 5 is a CMOS image sensor.
[0030] The system control unit 11, which controls the entire electrical control system of the digital camera 100, drives the image sensor 5 via the image sensor drive unit 10, and outputs the subject image captured through the imaging optical system of the lens device 40 as an image signal.
[0031] The image sensor driver 10 generates a drive signal based on a command from the system controller 11 and supplies the drive signal to the image sensor 5, thereby driving the image sensor 5. The hardware configuration of the image sensor driver 10 is an electric circuit configured by combining circuit elements such as semiconductor elements.
[0032] An instruction signal from the user is input to the system control unit 11 through the operation unit 14. The operation unit 14 includes a touch panel integrated with a display surface 22b (to be described later), various buttons, and the like.
[0033] The system control unit 11 controls the entire digital camera 100, and its hardware configuration consists of various processors that execute programs, including an imaging control program, to perform processing. The programs executed by the system control unit 11 are stored in the ROM of the memory 16.
[0034] The various types of processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes programs to perform various processes, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), or a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration designed specifically to perform specific processing. More specifically, the structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.
[0035] The system control unit 11 may be configured with one of various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA).
[0036] The display device 22 includes a display surface 22b configured by an organic EL (Electro Luminescence) panel, a liquid crystal panel, or the like, and a display controller 22a that controls the display on the display surface 22b.
[0037] The memory control unit 15 , digital signal processing unit 17 , external memory control unit 20 and display controller 22 a are interconnected by a control bus 24 and a data bus 25 , and are controlled by commands from the system control unit 11 .
[0038] The imaging device of the present invention is configured, for example, by an imaging section 50 and a system control section 11. The imaging device of the present invention may also be configured by the imaging section 50 alone.
[0039] <Schematic Configuration of Image Sensor 5 Shown in Fig. 1> Fig. 2 is a plan view schematic diagram showing the schematic configuration of the image sensor 5 shown in Fig. 1. The image sensor 5 has an imaging surface 60 on which a plurality of pixels 61 are two-dimensionally arranged in a row direction X and a column direction Y perpendicular to the row direction X. The plurality of pixels 61 include a ranging pixel 61b that receives one of a pair of light beams that have passed through two different portions of a pupil region of the imaging optical system aligned in the row direction X and detects a signal corresponding to the amount of received light, a ranging pixel 61c that receives the other of the pair of light beams and detects a signal corresponding to the amount of received light, and a normal pixel 61a that receives both of the pair of light beams and detects a signal corresponding to the amount of received light.
[0040] 2 , pixel lines 62 each including a plurality of normal pixels 61 a arranged in the row direction X and pixel lines 63 each including ranging pixels 61 b and ranging pixels 61 c arranged alternately in the row direction X are arranged alternately in the column direction Y on the imaging surface 60. It is sufficient that the pixel lines 63 include a plurality of pairs of ranging pixels 61 b and ranging pixels 61 c, and they may also include normal pixels 61 a in addition to these pairs. Hereinafter, when there is no need to distinguish between the pixel lines 62 and 63, they will also be simply referred to as pixel lines. The imaging element 5 further includes a drive circuit 64 that drives the pixels 61 arranged on the imaging surface 60 and a signal processing circuit 65 that processes pixel signals read out to signal lines from each pixel 61 in each pixel line arranged on the imaging surface 60.
[0041] In the following description, one end of the imaging surface 60 in the column direction Y (upper side in the figure) in FIG. 2 will be referred to as the upper end, and the other end of the imaging surface 60 in the column direction Y (lower side in the figure) will be referred to as the lower end.
[0042] The drive circuit 64 independently drives each pixel line based on a signal from the image sensor drive unit 10, resets each pixel 61 included in each pixel line (discharges the charge accumulated in the photoelectric conversion element), and reads out pixel signals corresponding to the charge accumulated in the photoelectric conversion element of each pixel 61 to a signal line.
[0043] The signal processing circuit 65 performs correlated double sampling on the pixel signals read out to the signal lines from the pixels 61 in the pixel line, converts the pixel signals after the correlated double sampling processing into digital signals, and outputs the digital signals to the data bus 25 (see FIG. 1). The signal processing circuit 65 is controlled by the image sensor driving unit 10.
[0044] The digital signal processing unit 17 performs signal processing such as demosaic processing and gamma correction processing on the pixel signals output from the image sensor 5 to the data bus 25 to generate captured image data.
[0045] The digital camera 100 is equipped with a continuous shooting mode in which multiple captured image data are generated in succession in response to a single image capture instruction and recorded on the recording medium 21 .
[0046] In continuous shooting mode, the system control unit 11 drives the image sensor 5 by the image sensor drive unit 10 using the rolling shutter method to capture an image of a subject. Rolling shutter driving includes rolling reset driving and rolling readout driving. Rolling reset driving is a driving method that resets each pixel 61 in a pixel line and starts exposure of each pixel 61, sequentially changing the pixel line. Rolling readout driving is a driving method that reads signals from each pixel 61 in an exposed pixel line and ends exposure of that pixel line, sequentially changing the pixel line.
[0047] In the continuous shooting mode, when the system control unit 11 receives an image capture instruction, it continuously performs recording imaging control, which records captured image data, displays a live view image on the display surface 22b, and causes the image sensor 5 to output pixel signals to be used for distance measurement. In addition, between each of the multiple times of recording imaging control, the system control unit 11 performs display imaging control at least once, which causes the image sensor 5 to display a live view image on the display surface 22b and output pixel signals to be used for distance measurement.
[0048] The ranging is, for example, a phase difference ranging used in phase difference AF (Auto Focus). For example, the ranging is a process of performing a correlation calculation between a first pixel signal group output from each ranging pixel 61 b included in the same pixel line 63 and a second pixel signal group output from each ranging pixel 61 c, and deriving a drive amount of the focus lens required to focus on a target subject based on the result of the correlation calculation.
[0049] The correlation calculation is a process of calculating the area S[d] enclosed by two data waveforms when the data waveform consisting of the first pixel signal group and the data waveform consisting of the second pixel signal group are shifted by a shift amount d, by changing the shift amount d among multiple values.
[0050] <Pixel Substrate 66 on Which Imaging Surface 60 is Provided> Figure 3 is a diagram showing an example of a pixel substrate 66 on which the imaging surface 60 is provided. The pixel substrate 66 shown in Figure 3 is, for example, a silicon substrate. The imaging surface 60 is provided on, for example, one surface of the pixel substrate 66. In this example, the pixels 61 of the imaging surface 60 are grouped into a first pixel group 60A, a second pixel group 60B, a third pixel group 60C, and a fourth pixel group 60D. In the example of Figure 3, the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D are each a pixel group that is arranged contiguously.
[0051] The pixel substrate 66 is provided with a first sub-substrate 65A, a second sub-substrate 65B, a third sub-substrate 65C, and a fourth sub-substrate 65D. The first sub-substrate 65A is connected to the first pixel group 60A and performs a readout process of image data for the first pixel group 60A. The readout process includes converting analog signals to digital signals and outputting the converted digital signals.
[0052] Similarly, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D are connected to the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D, respectively, and perform readout processing of image data for the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D, respectively. The first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D have a configuration corresponding to, for example, the drive circuit 64 and the signal processing circuit 65 shown in FIG.
[0053] 3, the pixels 61 on the imaging surface 60 are divided into four groups (first pixel group 60A, second pixel group 60B, third pixel group 60C, and fourth pixel group 60D), but the pixels 61 on the imaging surface 60 may be divided into two or three groups, or five or more groups. A sub-substrate is provided for each group of pixels 61 on the imaging surface 60.
[0054] 3, the sub-substrates (first sub-substrate 65A, second sub-substrate 65B, third sub-substrate 65C, and fourth sub-substrate 65D) are provided on the same surface of the pixel substrate 66 as the surface on which the imaging surface 60 is provided, but this configuration is not limited to this. For example, a laminated structure may be used in which the sub-substrates are provided on the surface of the pixel substrate 66 opposite to the surface on which the imaging surface 60 is provided. In this way, the sub-substrates may be arranged laminated on a substrate (pixel substrate 66) on which a plurality of pixels (each pixel 61 of the imaging surface 60) are provided.
[0055] Each pixel 61 on the imaging surface 60 is an example of a "plurality of pixels" according to the present invention. Of the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D, one pixel group is an example of a "first pixel" according to the present invention, and another pixel group is an example of a "second pixel" according to the present invention. For example, the first pixel group 60A can be an example of a "first pixel," and the second pixel group 60B can be an example of a "second pixel." In this case, the first sub-substrate 65A is an example of a "first circuit" according to the present invention, and the second sub-substrate 65B is an example of a "second circuit" according to the present invention.
[0056] The system control unit 11 sets a readout area for reading out image data from each pixel 61 on the imaging surface 60, controls the power supply to a first circuit (e.g., the first sub-substrate 65A) based on the relationship between the readout area and a first pixel (e.g., the first pixel group 60A), and controls the power supply to a second circuit (e.g., the second sub-substrate 65B) based on the relationship between the readout area 67 and a second pixel (e.g., the second pixel group 60B). Control of the power supply involves, for example, switching the power supply between on (a state in which power is supplied) and off (a state in which power is not supplied).
[0057] <Control of power supply to each sub-board> Figure 4 is a flowchart showing an example of control of power supply to each sub-board. The system control unit 11 executes, for example, the process shown in Figure 4. This process is executed, for example, for each image capture. Here, control of power supply to the first sub-board 65A and the second sub-board 65B will be described, but the same applies to control of power supply to the third sub-board 65C and the fourth sub-board 65D.
[0058] First, the system control unit 11 determines a readout area for each pixel 61 on the imaging surface 60 (step S11). The readout area can be determined by any method. As an example, the readout area is determined based on the results of image recognition. For example, the system control unit 11 determines the area of a specific subject detected by image recognition as the readout area.
[0059] Next, the system control unit 11 determines whether the readout region determined in step S11 includes pixels of the first pixel group 60A (step S12).
[0060] In step S12, if the determined readout region includes the pixels of the first pixel group 60A (step S12: Yes), the system control unit 11 turns on the power of the first sub-substrate 65A corresponding to the first pixel group 60A (step S13), and proceeds to step S15. If the determined readout region does not include the pixels of the first pixel group 60A (step S12: No), the system control unit 11 turns off the power of the first sub-substrate 65A corresponding to the first pixel group 60A (step S14), and proceeds to step S15.
[0061] Next, the system control unit 11 determines whether the readout region determined in step S11 includes pixels of the second pixel group 60B (step S15).
[0062] In step S15, if the determined readout region includes pixels of the second pixel group 60B (step S15: Yes), the system control unit 11 turns on the power of the second sub-substrate 65B corresponding to the second pixel group 60B (step S16), and ends the series of processes. If the determined readout region does not include pixels of the second pixel group 60B (step S15: No), the system control unit 11 turns off the power of the second sub-substrate 65B corresponding to the second pixel group 60B (step S17), and ends the series of processes.
[0063] <Example of Controlling Power Supply to Each Sub-Board According to Readout Area> Figures 5 to 8 show examples of controlling power supply to each sub-board according to readout area. In Figures 5 to 8, readout area 67 is the readout area determined by system control unit 11.
[0064] 5, the readout region 67 includes only the pixels of the first pixel group 60A among the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 turns on the power supply to the first sub-substrate 65A and turns off the power supplies to the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D.
[0065] 6 , the readout region 67 is two regions, and includes only the pixels of the first pixel group 60A and the third pixel group 60C among the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 turns on the power to the first sub-substrate 65A and the third sub-substrate 65C, and turns off the power to the second sub-substrate 65B and the fourth sub-substrate 65D. In this way, the readout region 67 is not limited to a single closed region of continuous pixels.
[0066] 7, the readout region 67 is a region spanning the first pixel group 60A and the second pixel group 60B, and includes only the pixels of the first pixel group 60A and the second pixel group 60B among the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 turns on the power to the first sub-substrate 65A and the second sub-substrate 65B, and turns off the power to the third sub-substrate 65C and the fourth sub-substrate 65D.
[0067] 8, the readout region 67 is a region spanning the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D, and includes the pixels of the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 turns on the power supplies of the first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D.
[0068] In this way, the system control unit 11 sets a readout area 67 from among multiple pixels (each pixel 61 on the imaging surface 60) for reading out image data, controls the power supply to a first circuit (e.g., the first sub-substrate 65A) based on the relationship between the readout area 67 and a first pixel (e.g., the first pixel group 60A), and controls the power supply to a second circuit (e.g., the second sub-substrate 65B) based on the relationship between the readout area 67 and a second pixel (e.g., the second pixel group 60B).
[0069] For example, the system control unit 11 controls the power supply to the first circuit to be turned on when the readout region 67 includes at least any of the first pixels, and to be turned off when the readout region 67 does not include any of the first pixels. Furthermore, the system control unit 11 controls the power supply to the second circuit to be turned on when the readout region 67 includes at least any of the second pixels, and to be turned off when the readout region 67 does not include any of the second pixels. In other words, when the readout region 67 of each pixel 61 on the imaging surface 60 is limited, the system control unit 11 controls the power supply to be turned on only for the sub-board assigned to the limited readout region 67, and to be turned off for the other sub-boards.
[0070] As a result, even in an imaging device equipped with a plurality of sub-boards, it is possible to reduce power consumption by turning off the power to some of the sub-boards depending on the readout area.
[0071] <Another Example of Controlling Power Supply to Each Sub-Substrate> Figure 9 is a flowchart showing another example of control of power supply to each sub-substrate. The system control unit 11 may execute the process shown in Figure 9, for example. Here, control is described for a case where only the first pixel group 60A, the second pixel group 60B, and the first sub-substrate 65A and the second sub-substrate 65B are present. However, the same applies to control when the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, the fourth pixel group 60D, the first sub-substrate 65A, the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D are present. Assume that the power supplies to the first sub-substrate 65A and the second sub-substrate 65B are initially off.
[0072] First, the system control unit 11 determines the readout area (step S21). The determination of the readout area is the same as the determination of the readout area in step S11 of FIG. 4. The readout area determined in step S21 is assumed to be Xst≦x<Xend, Yst≦y<Yend. Here, the readout area is assumed to be a single rectangular area. Xst is the position of the left edge of the rectangular area, Xend is the position of the right edge of the rectangular area, Yst is the position of the top edge of the rectangular area, and Yend is the position of the bottom edge of the rectangular area. One pixel in the readout area is represented as pixel (x, y). The system control unit 11 also sets the initial value of x to Xst (x = Xst) and the initial value of y to Yst (y = Yst).
[0073] Next, the system control unit 11 determines whether the pixel (x, y) is a pixel of the first pixel group 60A (step S22). If the pixel (x, y) is a pixel of the first pixel group 60A (step S22: Yes), the system control unit 11 turns on the power supply of the first sub-substrate 65A (step S23).
[0074] Next, the system control unit 11 determines whether the pixel (x, y) is a pixel of the first pixel group 60A (step S24). If the pixel (x, y) is a pixel of the first pixel group 60A (step S24: Yes), the system control unit 11 reads out the pixel (x, y) using the first sub-substrate 65A (step S25).
[0075] Next, the system control unit 11 determines whether x = Xend and y = Yend are satisfied, i.e., whether all pixels in the readout area have been read out (step S26). If not all pixels in the readout area have been read out in step S26 (step S26: No), the system control unit 11 increments x and y (step S27) and returns to step S23. Incrementing x and y means, for example, incrementing x (adding 1) if x < Xend, and incrementing y (adding 1) if x = Xend.
[0076] In step S26, if all pixels in the readout area have been read out (step S26: Yes), the system control unit 11 ends the series of processes.
[0077] In step S24, if pixel (x, y) is not a pixel of the first pixel group 60A (step S24: No), that is, if pixel (x, y) is a pixel of the second pixel group 60B, the system control unit 11 turns off the power to the first sub-substrate 65A (step S28) and proceeds to step S29.
[0078] In step S22, if pixel (x, y) is not a pixel of the first pixel group 60A (step S22: No), that is, if pixel (x, y) is a pixel of the second pixel group 60B, the system control unit 11 proceeds to step S29.
[0079] In step S29, the system control unit 11 turns on the power supply of the second sub-board 65B (step S29).
[0080] Next, the system control unit 11 determines whether the pixel (x, y) is a pixel of the second pixel group 60B (step S30). If the pixel (x, y) is a pixel of the second pixel group 60B (step S30: Yes), the system control unit 11 reads out the pixel (x, y) using the second sub-substrate 65B (step S31).
[0081] Next, the system control unit 11 determines whether x=Xend and y=Yend are satisfied, i.e., whether all pixels in the readout area have been read out (step S32). If not all pixels in the readout area have been read out (step S32: No), the system control unit 11 increments x and y (step S33) and returns to step S30.
[0082] In step S32, if all pixels in the readout area have been read out (step S32: Yes), the system control unit 11 ends the series of processes.
[0083] In step S30, if pixel (x, y) is not a pixel of the second pixel group 60B (step S30: No), that is, if pixel (x, y) is a pixel of the first pixel group 60A, the system control unit 11 turns off the power to the second sub-substrate 65B (step S34) and proceeds to step S23.
[0084] In this way, when the readout area 67 includes a first pixel (e.g., a first pixel group 60A) and a second pixel (e.g., a second pixel group 60B), the system control unit 11 may perform control to turn off the power supply to the second circuit (e.g., the second sub-substrate 65B) during the readout period of the first pixel, and to turn off the power supply to the first circuit (e.g., the first sub-substrate 65A) during the readout period of the second pixel.
[0085] This makes it possible to reduce power consumption by turning off the power supply to the first circuit or the second circuit depending on the pixel being read out in the readout region 67, even if the readout region 67 includes the first pixel and the second pixel.
[0086] <Another Example of First Pixels and Second Pixels> Fig. 10 is a diagram showing another example of first pixels and second pixels. In Fig. 3 and other figures, the configuration in which the pixels 61 on the imaging surface 60 are grouped according to their location on the imaging surface 60 (upper left, upper right, lower left, lower right) has been described, but the present invention is not limited to this configuration. For example, the pixels 61 on the imaging surface 60 may be grouped according to their type or function.
[0087] 10 , the pixels 61 on the imaging surface 60 are grouped so that the recording image pixels used to generate an ornamental image are grouped as a first pixel group 60A (first pixels), and the phase difference detection pixels (second pixels) used for phase difference AF (Auto Focus) are grouped as a second pixel group 60B. In this example, the phase difference detection pixels that make up the second pixel group 60B are arranged in line units on the imaging surface 60.
[0088] 10, a first sub-substrate 65A connected to the first pixel group 60A and a second sub-substrate 65B connected to the second pixel group 60B are provided. The first sub-substrate 65A reads out data from the first pixel group 60A, which are pixels for recording images. The second sub-substrate 65B reads out data from the second pixel group 60B, which are pixels for phase difference detection.
[0089] Even when grouping pixels according to type or function in this way, they may be further grouped according to location. For example, the first pixel group 60A shown in Figure 10 may be further grouped, and a sub-substrate may be provided for each of these groups.
[0090] <Control of power supply to each sub-board corresponding to Fig. 10> Fig. 11 is a flowchart showing an example of control of power supply to each sub-board corresponding to Fig. 10. In the example of Fig. 10, the system control unit 11 may perform, for example, the processing shown in Fig. 11.
[0091] First, the system control unit 11 determines a readout area for each pixel 61 on the imaging surface 60 (step S41). The determination of the readout area is similar to the determination of the readout area in step S11 of Fig. 4. Next, the system control unit 11 determines whether the readout area determined in step S41 includes pixels for recording images (pixels of the first pixel group 60A) (step S42).
[0092] In step S42, if the determined readout area includes pixels for recording image (step S42: Yes), the system control unit 11 turns on the power of the first sub-substrate 65A corresponding to the pixels for recording image (step S43), and proceeds to step S45. If the determined readout area does not include pixels for recording image (step S42: No), the system control unit 11 turns off the power of the first sub-substrate 65A corresponding to the pixels for recording image (step S44), and proceeds to step S45.
[0093] Next, the system control unit 11 determines whether the readout region determined in step S41 includes phase difference detection pixels (pixels of the second pixel group 60B) (step S45).
[0094] In step S45, if the determined readout region includes phase difference detection pixels (step S45: Yes), the system control unit 11 turns on the power of the second sub-substrate 65B corresponding to the phase difference detection pixels (step S46), and ends the series of processes. If the determined readout region does not include phase difference detection pixels (step S45: No), the system control unit 11 turns off the power of the second sub-substrate 65B corresponding to the phase difference detection pixels (step S47), and ends the series of processes.
[0095] <Controller provided on pixel substrate 66> Fig. 12 is a diagram showing an example of a controller provided on the pixel substrate 66. Although the configuration has been described in which the power supply to each sub-substrate is controlled by the system controller 11 external to the pixel substrate 66 (image sensor 5), the power supply to each sub-substrate may also be controlled by a controller provided in the pixel substrate 66. In the example of Fig. 12, a controller 68 is provided on the pixel substrate 66. The controller 68 can be configured by various processors, similar to the system controller 11.
[0096] The control of the power supply to each of the sub-boards described above may be performed by the control unit 68 instead of the system control unit 11. Furthermore, the control of the power supply to each of the sub-boards described above may be performed by any one of the first sub-board 65A, second sub-board 65B, third sub-board 65C, and fourth sub-board 65D (for example, any one of the control units 73A to 73D shown in FIG. 13).
[0097] <Configuration of each sub-board> Figure 13 is a diagram showing an example of the configuration of each sub-board. For example, the first sub-board 65A includes an AD conversion unit 71A, an IF unit 72A, and a control unit 73A. The AD conversion unit 71A, the IF unit 72A, and the control unit 73A are each processing units to which power is supplied, and are an example of the "plurality of processing units" of the present invention.
[0098] The AD conversion unit 71A converts image data read from the pixels of the first pixel group 60A from analog signals to digital signals. The IF unit 72A is an interface that outputs the image data converted into digital signals by the AD conversion unit 71A to the outside of the first sub-substrate 65A (e.g., to the data bus 25). The control unit 73A controls each unit of the first sub-substrate 65A, including the IF unit 72A and the AD conversion unit 71A. When powering off the first sub-substrate 65A, the system control unit 11 (or the control unit 68) may turn off the power to only part of the AD conversion unit 71A, the IF unit 72A, and the control unit 73A, instead of powering off the entire first sub-substrate 65A.
[0099] Similarly, the second sub-board 65B includes an AD conversion unit 71B, an IF unit 72B, and a control unit 73B. When turning off the power to the second sub-board 65B, the system control unit 11 (or the control unit 68) may turn off the power to some of these processing units included in the first sub-board 65A.
[0100] The third sub-board 65C includes an AD conversion unit 71C, an IF unit 72C, and a control unit 73C. When the system control unit 11 (or the control unit 68) turns off the power to the second sub-board 65B, it may turn off the power to some of these processing units included in the second sub-board 65B.
[0101] The fourth sub-board 65D includes an AD conversion unit 71D, an IF unit 72D, and a control unit 73D. When the system control unit 11 (or the control unit 68) turns off the power to the fourth sub-board 65D, the system control unit 11 (or the control unit 68) may turn off the power to some of these processing units included in the fourth sub-board 65D.
[0102] 14 and 15 show examples of partial power supply control for each sub-substrate according to the readout area. In the example of Fig. 14, similar to the example of Fig. 5, the readout area 67 includes only the pixels of the first pixel group 60A among the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 may turn on the power of each processing unit of the first sub-substrate 65A and turn off the power of only the AD conversion units 71B to 71D among the processing units of the second sub-substrate 65B, the third sub-substrate 65C, and the fourth sub-substrate 65D.
[0103] 15, similarly to the example of Fig. 7, the readout region 67 is a region spanning the first pixel group 60A and the second pixel group 60B, and includes only the pixels of the first pixel group 60A and the second pixel group 60B among the first pixel group 60A, the second pixel group 60B, the third pixel group 60C, and the fourth pixel group 60D. In this case, the system control unit 11 may turn on the power of each processing unit of the first sub-substrate 65A and the second sub-substrate 65B, and turn off the power of only the IF units 72C and 72D among the processing units of the third sub-substrate 65C and the fourth sub-substrate 65D.
[0104] In this way, turning off the power supply to each sub-board may be turning off the power supply to some of the multiple processing units that each sub-board has.
[0105] <Switching of Power Supply Control According to Frame Rate> Fig. 16 is a flowchart showing an example of switching of power supply control according to the frame rate. When capturing video in the digital camera 100, the system control unit 11 may execute, for example, the process shown in Fig. 16.
[0106] First, the system control unit 11 acquires the setting value of the frame rate for video capture in the digital camera 100 (step S51). Next, the system control unit 11 determines whether the frame rate indicated by the setting value acquired in step S51 is less than a threshold value TH (step S52).
[0107] In step S52, if the frame rate is less than the threshold value TH (step S52: Yes), the system control unit 11 performs video capture while controlling the power on / off of each sub-board according to the readout area, as described above (step S53), and then ends the series of processes.
[0108] In step S52, if the frame rate is not less than the threshold value TH (step S52: No), the system control unit 11 keeps the power of each sub-board on to capture video regardless of the readout area (step S54), and ends the series of processes.
[0109] In this way, when capturing video using the digital camera 100 (image sensor 5), the system control unit 11 may control the power supply to each sub-board according to the readout area in accordance with the frame rate of the video. For example, when the frame rate is high, the system control unit 11 may always turn on the power to each sub-board regardless of the readout area. This prevents the power supply to each sub-board from being controlled according to the readout area when the frame rate of the video is high, thereby preventing a decrease in video capture processing performance.
[0110] (Variation 1) In the above embodiment, the case where the phase difference method is used as the distance measurement method (AF method) has been described, but the distance measurement method may be a contrast method used in contrast AF. Also, the distance measurement method may be a hybrid method that combines the phase difference method and the contrast method.
[0111] (Variation 2) The imaging device of the present invention is not limited to the digital camera 100 whose main purpose is to capture images, but can also be applied to various information terminals having an imaging function, such as smartphones, tablet terminals, notebook personal computers, etc. Next, the configuration of a smartphone 200, which is another embodiment of the imaging device of the present invention, will be described.
[0112] <Appearance of Smartphone 200> Fig. 17 shows the appearance of smartphone 200. Smartphone 200 shown in Fig. 17 has a flat housing 201, and is provided with a display input unit 204 on one surface of housing 201, in which a display panel 202 as a display unit and an operation panel 203 as an input unit are integrated.
[0113] The housing 201 also includes a speaker 205, a microphone 206, an operation unit 207, and a camera unit 208. The configuration of the housing 201 is not limited to this, and for example, it is also possible to adopt a configuration in which the display unit and the input unit are independent, or a configuration having a folding structure or a sliding mechanism.
[0114] <Configuration of Smartphone 200> FIG. 18 is a block diagram showing the configuration of the smartphone 200.
[0115] As shown in FIG. 18 , the main components of the smartphone include a wireless communication unit 210, a display input unit 204, a call unit 211, an operation unit 207, a camera unit 208, a memory unit 212, an external input / output unit 213, a GNSS (Global Navigation Satellite System) receiving unit 214, a motion sensor unit 215, a power supply unit 216, and a main control unit 220.
[0116] The smartphone 200 also has, as its main function, a wireless communication function for performing mobile wireless communication via a base station device BS (not shown) and a mobile communication network NW (not shown).
[0117] The wireless communication unit 210 performs wireless communication with a base station device BS included in the mobile communication network NW in accordance with instructions from the main control unit 220. Using this wireless communication, various file data such as audio data and image data, e-mail data, etc. are sent and received, and web data, streaming data, etc. are received.
[0118] The display input unit 204 is a so-called touch panel that, under the control of the main control unit 220, displays images (still images and moving images) or text information, etc. to visually convey information to the user and detects user operations on the displayed information, and is equipped with a display panel 202 and an operation panel 203.
[0119] The display panel 202 uses a liquid crystal display (LCD), an organic electroluminescence display (OELD), or the like as a display device.
[0120] The operation panel 203 is a device placed so that an image displayed on the display surface of the display panel 202 can be seen, and detects one or more coordinates operated by a user's finger or a stylus. When this device is operated by the user's finger or a stylus, a detection signal generated by the operation is output to the main control unit 220. Next, the main control unit 220 detects the operation position (coordinates) on the display panel 202 based on the received detection signal.
[0121] As shown in Figure 18, the display panel 202 and operation panel 203 of a smartphone 200, which is an example of one embodiment of the imaging device of the present invention, are integrated to form a display input unit 204, and the operation panel 203 is positioned so that it completely covers the display panel 202.
[0122] When such an arrangement is adopted, operation panel 203 may also have a function for detecting user operations in areas outside display panel 202. In other words, operation panel 203 may have a detection area for the overlapping portion that overlaps display panel 202 (hereinafter referred to as a display area), and a detection area for the remaining outer edge portion that does not overlap display panel 202 (hereinafter referred to as a non-display area).
[0123] The size of the display area and the size of the display panel 202 may be exactly the same, but they do not necessarily have to be the same. The operation panel 203 may also have two sensitive areas: an outer edge portion and an inner portion. The width of the outer edge portion is designed appropriately depending on the size of the housing 201, etc.
[0124] Furthermore, the position detection method used in the operation panel 203 may be a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, or the like, and any method may be used.
[0125] The call unit 211 is equipped with a speaker 205 or a microphone 206, and converts the user's voice input through the microphone 206 into voice data that can be processed by the main control unit 220 and outputs it to the main control unit 220, or decodes voice data received by the wireless communication unit 210 or the external input / output unit 213 and outputs it from the speaker 205.
[0126] Also, as shown in FIG. 17, for example, the speaker 205 can be mounted on the same surface as the display input unit 204, and the microphone 206 can be mounted on the side of the housing 201.
[0127] The operation unit 207 is a hardware key using a key switch or the like, and receives instructions from the user. For example, as shown in Fig. 17 , the operation unit 207 is a push-button switch mounted on the side surface of the housing 201 of the smartphone 200, which turns on when pressed with a finger or the like, and turns off when the finger is released due to the restoring force of a spring or the like.
[0128] The storage unit 212 stores the control program and control data of the main control unit 220, application software, address data associated with names or telephone numbers of communication partners, data of sent and received e-mails, web data downloaded by web browsing, downloaded content data, and also temporarily stores streaming data, etc. The storage unit 212 is composed of an internal storage unit 217 built into the smartphone and an external storage unit 218 having a removable external memory slot.
[0129] The internal memory unit 217 and the external memory unit 218 constituting the memory unit 212 are realized using storage media such as a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., MicroSD (registered trademark) memory, etc.), a RAM (Random Access Memory), a ROM (Read Only Memory), etc.
[0130] The external input / output unit 213 serves as an interface with all external devices connected to the smartphone 200, and is used to directly or indirectly connect to other external devices via communication (e.g., Universal Serial Bus (USB), Institute of Electrical and Electronics Engineers (IEEE) 1394, Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee (registered trademark), etc.) or a network (e.g., Ethernet (registered trademark), wireless LAN (Local Area Network), etc.).
[0131] Examples of external devices connected to the smartphone 200 include a wired / wireless headset, a wired / wireless external charger, a wired / wireless data port, a memory card connected via a card socket, a SIM (Subscriber Identity Module Card) / UIM (User Identity Module Card) card, an external audio / video device connected via an audio / video I / O (Input / Output) terminal, a wirelessly connected external audio / video device, a wired / wirelessly connected smartphone, a wired / wirelessly connected personal computer, a wired / wirelessly connected personal computer, and earphones.
[0132] The external input / output unit 213 can transmit data received from such external devices to each component inside the smartphone 200, or transmit data inside the smartphone 200 to external devices.
[0133] The GNSS receiving unit 214 receives GNSS signals transmitted from the GNSS satellites ST1 to STn in accordance with instructions from the main control unit 220, executes positioning calculation processing based on the received multiple GNSS signals, and detects a position consisting of the latitude, longitude, and altitude of the smartphone 200. When the GNSS receiving unit 214 can acquire position information from the wireless communication unit 210 or the external input / output unit 213 (for example, a wireless LAN), it can also detect the position using the position information.
[0134] The motion sensor unit 215 includes, for example, a three-axis acceleration sensor, and detects the physical movement of the smartphone 200 in accordance with instructions from the main control unit 220. By detecting the physical movement of the smartphone 200, the direction of movement or acceleration of the smartphone 200 is detected. The detection result is output to the main control unit 220.
[0135] The power supply unit 216 supplies power stored in a battery (not shown) to each unit of the smartphone 200 in accordance with instructions from the main control unit 220 .
[0136] The main control unit 220 includes a microprocessor, operates according to the control program and control data stored in the storage unit 212, and controls all the units of the smartphone 200. The microprocessor of the main control unit 220 has the same functions as the system control unit 11. The main control unit 220 also includes a mobile communication control function that controls all the units of the communication system to perform voice communication or data communication via the wireless communication unit 210, and an application processing function.
[0137] The application processing function is realized by the main control unit 220 operating in accordance with the application software stored in the storage unit 212. Examples of the application processing function include an infrared communication function that controls the external input / output unit 213 to perform data communication with a connected device, an email function that sends and receives emails, and a web browsing function that views web pages.
[0138] The main control unit 220 also has an image processing function for displaying video on the display input unit 204 based on image data (still image or moving image data) such as received data or downloaded streaming data.
[0139] The image processing function refers to a function in which the main control unit 220 decodes the image data, performs image processing on the decoded result, and displays the image on the display input unit 204 .
[0140] Furthermore, the main control unit 220 executes display control for the display panel 202 and operation detection control for detecting user operations via the operation unit 207 and the operation panel 203 .
[0141] By executing display control, the main control unit 220 displays software keys such as icons or scroll bars for launching application software, or displays a window for creating e-mail, etc. The scroll bar refers to a software key that accepts instructions to move the displayed portion of an image, such as a large image that cannot fit in the display area of the display panel 202.
[0142] In addition, by executing operation detection control, the main control unit 220 detects user operations through the operation unit 207, accepts operations on the above icons and input of character strings into the input field of the above window through the operation panel 203, or accepts requests to scroll the displayed image through the scroll bar.
[0143] Furthermore, by executing operation detection control, the main control unit 220 determines whether the operation position on the operation panel 203 is an overlapping portion (display area) that overlaps the display panel 202 or an outer edge portion (non-display area) that does not overlap the display panel 202, and is equipped with a touch panel control function that controls the sensitive area of the operation panel 203 or the display position of the software key.
[0144] The main control unit 220 can also detect a gesture operation on the operation panel 203 and execute a preset function in response to the detected gesture operation.
[0145] Gesture operation is not a simple touch operation as in the past, but rather refers to an operation of drawing a path with a finger or the like, specifying multiple positions simultaneously, or combining these to draw a path for at least one of multiple positions.
[0146] The camera section 208 includes the image capturing section 50 in the digital camera 100 shown in FIG.
[0147] The captured image data generated by the camera unit 208 can be stored in the storage unit 212 or output via the external input / output unit 213 or the wireless communication unit 210 .
[0148] In the smartphone 200 shown in FIG. 17 , the camera unit 208 is mounted on the same surface as the display input unit 204, but the mounting position of the camera unit 208 is not limited to this, and it may be mounted on the back surface of the display input unit 204.
[0149] The camera unit 208 can also be used for various functions of the smartphone 200. For example, an image acquired by the camera unit 208 can be displayed on the display panel 202, or an image from the camera unit 208 can be used as one of the operation inputs for the operation panel 203.
[0150] Furthermore, when the GNSS receiving unit 214 detects a position, it can also detect the position by referring to an image from the camera unit 208. Furthermore, it can also refer to an image from the camera unit 208 to determine the optical axis direction of the camera unit 208 of the smartphone 200 or determine the current usage environment without using a triaxial acceleration sensor or by using the image in combination with a triaxial acceleration sensor. Of course, the image from the camera unit 208 can also be used in application software.
[0151] In addition, image data of still images or videos can be added with location information acquired by the GNSS receiving unit 214, audio information acquired by the microphone 206 (which may be converted to text information by the main control unit, etc.), posture information acquired by the motion sensor unit 215, etc., and stored in the memory unit 212 or output via the external input / output unit 213 or wireless communication unit 210.
[0152] In the smartphone 200 configured as described above, similar to the digital camera 100, power consumption can be reduced.
[0153] Although various embodiments have been described above, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present invention. Furthermore, the components of the above embodiments may be combined in any manner as long as they do not deviate from the spirit of the invention.
[0154] This application is based on a Japanese patent application (Patent Application No. 2024-030174) filed on February 29, 2024, the contents of which are incorporated herein by reference.
[0155] The present invention is highly convenient and effective when applied to digital cameras and the like.
[0156] REFERENCE SIGNS LIST 1 imaging lens 4 lens control unit 5 imaging element 8 lens driving unit 9 aperture driving unit 10 imaging element driving unit 11 system control unit 14, 207 operation unit 15 memory control unit 16 memory 17 digital signal processing unit 20 external memory control unit 21 recording medium 22 display device 22a display controller 22b display surface 25 data bus 40 lens device 50 imaging unit 60 imaging surface 60A first pixel group 60B second pixel group 60C third pixel group 60D fourth pixel group 61 pixel 61a normal pixel 61b, 61c ranging pixel 62, 63 pixel line 64 driving circuit 65 signal processing circuit 65A first sub-substrate 65B second sub-substrate 65C third sub-substrate 65D fourth sub-substrate 66 pixel substrate 67 readout area 68, 73A to 73D Control unit 71A, 71B, 71C, 71D AD conversion unit 72A, 72B, 72C, 72D IF unit 100 Digital camera 100A Main body unit 200 Smartphone 201 Housing 202 Display panel 203 Operation panel 204 Display input unit 205 Speaker 206 Microphone 208 Camera unit 210 Wireless communication unit 211 Call unit 212 Memory unit 213 External input / output unit 214 GNSS receiving unit 215 Motion sensor unit 216 Power supply unit 217 Internal memory unit 218 External memory unit 220 Main control unit ST1 to STn GNSS satellite
Claims
1. An imaging device comprising: a processor; a plurality of pixels including a first pixel and a second pixel; a first circuit connected to the first pixel and performing a readout process of image data for the first pixel; and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, wherein the processor sets a readout area among the plurality of pixels for reading out image data, controls the power supply to the first circuit based on the relationship between the readout area and the first pixel, and controls the power supply to the second circuit based on the relationship between the readout area and the second pixel.
2. An imaging device according to claim 1, wherein the processor controls to turn on the power supply of the first circuit when the readout area includes the first pixel, and to turn off the power supply of the first circuit when the readout area does not include the first pixel.
3. An imaging device according to claim 2, wherein the processor controls to turn on the power supply of the second circuit when the readout area includes the second pixel, and to turn off the power supply of the second circuit when the readout area does not include the second pixel.
4. An imaging device according to claim 3, wherein, when the readout region includes the first pixel and the second pixel, the processor controls to turn off the power supply to the second circuit during a readout period for the first pixel, and to turn off the power supply to the first circuit during a readout period for the second pixel.
5. An imaging device according to claim 1, wherein the first pixel and the second pixel are pixels having different functions.
6. An imaging device according to claim 1, wherein the first pixel and the second pixel are different types of pixels.
7. An imaging device according to claim 5, wherein the first pixel is a pixel for recording an image, and the second pixel is a pixel for detecting a phase difference.
8. An imaging device according to claim 2, wherein the first circuit and the second circuit have a plurality of processing units to which power is supplied, and turning off the power supply means turning off the power supply to at least one of the plurality of processing units.
9. An imaging device according to claim 8, wherein the plurality of processing units include at least one of a conversion unit that converts an analog signal into a digital signal, an output unit that outputs the digital signal, and a control unit that controls at least one of the conversion unit and the output unit.
10. An imaging device according to claim 1, wherein the first circuit and the second circuit are stacked on a substrate on which the plurality of pixels are provided.
11. An imaging device according to claim 1, wherein the processor controls the power supply to the first circuit and the second circuit in accordance with a frame rate of video imaging by the imaging device.
12. An imaging device according to claim 1, wherein the first pixels and the second pixels are each a group of pixels arranged contiguously.
13. A control method for an imaging device comprising a processor, a plurality of pixels including a first pixel and a second pixel, a first circuit connected to the first pixel and performing a readout process of image data for the first pixel, and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, wherein the processor sets a readout area from among the plurality of pixels for reading out image data, controls the power supply to the first circuit based on the relationship between the readout area and the first pixel, and controls the power supply to the second circuit based on the relationship between the readout area and the second pixel.
14. A control program for an imaging device comprising a processor, a plurality of pixels including a first pixel and a second pixel, a first circuit connected to the first pixel and performing a readout process of image data for the first pixel, and a second circuit connected to the second pixel and performing a readout process of image data for the second pixel, the control program causing the processor to execute the following processes: set a readout area from among the plurality of pixels for reading out image data; control the power supply to the first circuit based on the relationship between the readout area and the first pixel; and control the power supply to the second circuit based on the relationship between the readout area and the second pixel.
Citation Information
Patent Citations
Image sensor, imaging apparatus and cellular phone
JP2015130648A
Image pickup device and imaging apparatus
JP2015156581A
Image sensor, processing method, and electronic apparatus
JP2016184843A
Image pick-up device and imaging apparatus
JP2019068247A