Image capturing apparatus, method of controlling the same, and storage medium

Abstract

To provide an imaging apparatus capable of correcting a flicker generated in an image photographed in an arbitrary exposure time even in photographing a moving body, and to provide a control method thereof and a program.SOLUTION: In the imaging apparatus 100 that reads an image using an imaging element having a pixel array, after detection of a flicker frequency from an image read from the imaging element, reading of a first image exposed for an arbitrary exposure time from the imaging element, and simultaneous reading of a plurality of images from the imaging element are performed, a flicker region where a flicker occurs in the first image is detected using the detected flicker frequency and the plurality of read images, and the flicker in the flicker region is corrected.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an imaging device, a control method and a program thereof, and more particularly to an imaging device that corrects flicker, a control method and a program thereof. [Background technology]

[0002] When capturing an image of a light source that flickers rapidly, such as an LED, with an exposure time faster than the flicker, uneven flickering (hereafter referred to as flicker) occurs in the captured image. It is known that flicker can be suppressed by setting the exposure time to an integer multiple of the flicker frequency. However, this method does not allow the user to capture an image with a desired exposure time, and subject blur occurs in scenes where the subject moves vigorously. For this reason, methods have been proposed to correct flicker that occurs in images captured with a desired exposure time.

[0003] For example, Patent Document 1 discloses a technique in which, when photographing a subject including a flickering light source, a flicker area is first detected from the photographed image. Next, when a first image is photographed with an arbitrary exposure time, if flicker occurs in the first image, a second image is photographed in which the flicker occurrence is suppressed. Then, the technique corrects the flicker by combining the flicker area of ​​the second image with the first image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-119788 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology disclosed in Patent Document 1, flicker areas are detected by comparing consecutively captured images, so in scenes where the subject moves vigorously, it is difficult to distinguish whether the difference is due to the movement of the subject or flicker. Therefore, when capturing moving subjects, it is difficult to generate images with flicker corrected.

[0006] In view of the above, the present invention provides an imaging device capable of correcting flicker that occurs in an image captured with an arbitrary exposure time even when capturing a moving subject, as well as a control method and program for the imaging device. [Means for solving the problem]

[0007] In order to solve the above problem, the imaging device of claim 1 of the present invention is an imaging device that reads out an image using an imaging element having a plurality of pixels, and is characterized by having: a frequency detection means that detects a flicker frequency from the image read out from the imaging element; an image read out means that reads out a first image exposed with an arbitrary exposure time from the imaging element; a simultaneous image read out means that simultaneously reads out a plurality of images from the imaging element; a flicker area detection means that detects a flicker area in which flicker occurs in the first image using the flicker frequency detected by the frequency detection means and the plurality of images read out by the simultaneous image read out means; and a correction means that corrects the flicker in the flicker area. [Effects of the Invention]

[0008] According to the present invention, it is possible to correct flicker that occurs in an image captured with an arbitrary exposure time even when capturing a moving subject. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a hardware configuration of an imaging apparatus according to an embodiment of the present invention. [Figure 2] 2 is a diagram for explaining a method for simultaneously reading out a plurality of images by the image sensor in FIG. 1. FIG. [Figure 3] 10A and 10B are diagrams for explaining changes in flicker due to differences in exposure time and readout start timing. [Figure 4] 10 is a flowchart of a shooting control process according to an embodiment of the present invention. [Figure 5] 5 is a timing chart of capturing simultaneous readout images executed in step S403 of FIG. 4. [Figure 6] FIG. 5 is a diagram for explaining the flicker region detection process in step S404 of FIG. DETAILED DESCRIPTION OF THE INVENTION

[0010] Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0011] FIG. 1 is a block diagram showing the hardware configuration of an image capturing apparatus 100 according to an embodiment of the present invention.

[0012] In FIG. 1, an imaging device 100 includes an imaging element 101, a flicker frequency detection unit 102, a flicker area detection unit 103, an image processing unit 104, a system control unit 105, an operation unit 106, a display unit 107, and a recording unit .

[0013] The imaging device 100 is, for example, an interchangeable lens digital camera, can be fitted with any lens, and has both still and moving image capture functions. The imaging device 100 is also capable of capturing still images continuously at high speed, for example, capturing 40 still images per second. However, the capture speed is merely an example of this embodiment and is not limited to this.

[0014] The image sensor 101 performs photoelectric conversion on the optical image of the subject at each pixel to generate electric charges according to the amount of incident light, converts these into electrical signals, and then converts them into digital image data for output. The image sensor 101 also has an electronic shutter function that adjusts the amount of incident light on each pixel, and is capable of controlling the exposure time of the image signal. The image sensor 101 is also capable of simultaneously reading out multiple images at different readout times. Details will be described later.

[0015] The flicker frequency detector 102 (frequency detection means) calculates the frequency of the flicker based on the image signal obtained from the image sensor 101 .

[0016] The flicker area detection unit 103 (flicker area detection means) detects a flicker area on the image plane using a plurality of images obtained from the image sensor 101 and read out simultaneously.

[0017] The image processing unit 104 (correction means) generates an image in which the effects of flicker have been reduced (flicker corrected) using the image obtained from the image sensor 101 and the flicker area detected by the flicker area detection unit 103. At this time, the image processing unit 104 generates the image using a trained model that has been trained to correct the flicker area based on multiple images taken at different shutter speeds and the detected flicker area. Here, the multiple images taken at different shutter speeds include at least images taken at a shutter speed that reduces flicker and images taken at an arbitrary shutter speed. However, the image processing method is an example of this embodiment and is not limited to this.

[0018] The system control unit 105 incorporates a CPU, ROM, and RAM (not shown in FIG. 1), and controls the entire imaging device 100 by the CPU loading a program stored in the ROM into the RAM 105c and executing it.

[0019] The operation unit 106 is made up of operation members such as various switches, buttons, and a touch panel that accept various operations from the user, a line-of-sight detection device, a voice recognition device, or a combination of these.

[0020] The system control unit 105 controls various operations of the imaging device 100 in response to signals based on operations on the operation unit 106 .

[0021] The display unit 107 is a display device such as an LCD or organic EL that displays image data, menus, etc. The display unit 107 has an electronic viewfinder (EVF) function that is turned on or off based on the control of the system control unit 105. The display unit 107 also displays a menu screen or the like that allows the user to operate and input various settings, processes, etc. for the imaging device 100.

[0022] The recording unit 108 records the image data output from the image sensor 101, the flicker area detected by the flicker area detection unit 103, the image generated by the image processing unit 104, and the like.

[0023] Next, a method for simultaneously reading out a plurality of images by the image sensor 101 will be described with reference to Fig. 2. In this embodiment, the image sensor 101 simultaneously reads out two types of images at different read times.

[0024] In FIG. 2, the image sensor 101 has a pixel array 201 on its image plane, which is configured by arranging a plurality of pixels in a two-dimensional array.

[0025] Three types of color filters, red (R), green (G), and blue (B), are arranged in a Bayer array above each pixel of the pixel array 201. Specifically, two types of pixel rows, R rows (i.e., odd-numbered rows shown in FIG. 2) including pixels with red color filters and B rows (i.e., even-numbered rows shown in FIG. 2) including pixels with blue color filters, are arranged alternately.

[0026] The simultaneous readout of two images is performed from different pixel rows in the same shooting cycle (a three-row cycle in this embodiment). In each shooting cycle, the first readout is performed by adding two pixel rows with the same color filter, and the second readout is performed using the pixel rows not used in the first readout. This allows for the simultaneous readout of two types of images.

[0027] In this embodiment, the number of pixels used in the second readout is smaller than the number of pixels used in the first readout, so the readout time for the second readout is shorter than the readout time for the first readout. As described above, multiple images are read out simultaneously at different readout times.

[0028] In addition, in this embodiment, the first readout is performed by adding two pixel rows having the same color filter in a three-row cycle, but the pixel addition rate may be changed, or pixel addition may not be performed. Furthermore, the method is not limited to this embodiment as long as the readout time can be controlled to be different between the first readout and the second readout. For example, the readout time for each of the first readout and the second readout may be controlled by changing the number of pixels used in the first readout and the second readout.

[0029] Next, changes in flicker due to differences in exposure time and readout start timing will be described using Figure 3. In this embodiment, we will describe a case where image capture is performed using a rolling shutter method in which each pixel in the pixel array 201 is reset and read out sequentially row by row under an LED light source that blinks with a blinking period T31. The graph shows time on the horizontal axis and the pixel readout position on the vertical axis, with s1 to s3 respectively representing the reset timing of each pixel in the pixel array 201 and r1 to r3 respectively representing the readout timing of each pixel in the pixel array 201.

[0030] The recorded image 301 represents an image affected by flicker on the image plane due to the LED when shooting with the first readout at an exposure time T32 and a readout time T33. Also, the start timing of shooting is made to coincide with the on-off cycle T31 of the flicker.

[0031] The recorded image 302 represents an image affected by flicker on the image plane due to the LED when shooting with the second readout at the same start timing and the same exposure time T32 as the recorded image 301, and at a readout time T34 (<T33) shorter than that of the recorded image 301. Since the readout time of the recorded image 302 is shorter than that of the recorded image 301, the number of flicker stripes is reduced. That is, as shown in the recorded image 301 and the recorded image 302, when shooting is performed at different readout times, the manner of flicker generation changes.

[0032] Also, the recorded image 303 represents an image affected by flicker on the image plane due to the LED when shooting under the same conditions as the recorded image 302, except that the start timing of shooting is delayed by a differential time T35. Thus, when the start timing of shooting is shifted from the on-off cycle T31 of the flicker by the differential time T35, the manner of flicker stripe generation changes compared to the recorded image 302 as in the recorded image 303. That is, as shown in the recorded image 302 and the recorded image 303, when the on-off cycle of the flicker and the start timing of shooting are different, the manner of flicker generation changes.

[0033] Next, the shooting control process according to this embodiment will be described with reference to the flowchart of FIG. 4. Specifically, this process is executed by a CPU incorporated in the system control unit 105 loading a program stored in the ROM into the RAM 105c. Hereinafter, the execution subject of this process will simply be the system control unit 105.

[0034] In step S401, the system control unit 105 controls the flicker frequency detection unit 102 to execute a flicker frequency detection process that detects the flicker frequency from the image read from the image sensor 101. In this embodiment, a method known as a flicker frequency detection method is used, in which an image is divided into multiple regions and differences in the amount of light in images obtained by continuous image capture are detected and compared. However, the flicker frequency detection method is not limited to this and may be replaced with another detection method depending on the purpose.

[0035] In step S402, the system control unit 105 determines whether flickerless shooting is necessary to perform flicker correction, based on the frequency detected in step S401. In this embodiment, if the flicker frequency detected in step S401 falls within a certain range, it is determined that flickerless shooting is necessary (YES in step S402), and the process proceeds to step S403. On the other hand, if the flicker frequency does not fall within the certain range, it is determined that flickerless shooting is unnecessary (NO in step S402), and the process proceeds to step S408. Note that the method for determining whether flickerless shooting is necessary is not limited to the method of this embodiment. For example, if the user selects whether to detect a flicker area using the operation unit 106, the method may be replaced with another method depending on the purpose, such as determining whether to perform flickerless shooting based on the selection result.

[0036] In step S403, the system control unit 105 (simultaneous image readout means) controls the image sensor 101 to capture a simultaneous readout image. In this embodiment, two types of images are captured simultaneously multiple times by this capture. Details of capturing the simultaneous readout image will be described later with reference to FIG. 5.

[0037] In step S404, the system control unit 105 controls the flicker area detection unit 103 to perform flicker area detection processing using the two types of images captured in step S403. Details of the flicker area detection processing will be described later with reference to FIG.

[0038] In step S405, the system control unit 105 (image reading means) controls the image sensor 101 to an arbitrary exposure time to capture a first image. The arbitrary exposure time is, for example, an exposure time according to the shooting conditions set by the user using the operation unit 106.

[0039] In step S406, the system control unit 105 controls the image sensor 101 to an exposure time that suppresses flickering, and captures a second image. The exposure time that suppresses flickering is, for example, an integer multiple of the flicker frequency detected in step S401. To suppress the effects of moving objects, steps S405 and S406 are performed at a capture rate of 40 images per second, i.e., at intervals of 0.025 ms. The interval between the capture of the first and second images is not limited to this, and is preferably as short as possible to suppress the effects of moving objects. In addition, while the second image is captured after the exposure timing of the first image in this embodiment, this is not a limitation as long as the first and second images are captured continuously at high speed. For example, the second image may be captured before the exposure timing of the first image or both before and after the exposure timing. However, it is preferable to capture one second image before and after the exposure timing of the first image, rather than capturing one second image before or after the exposure timing of the first image. This improves the accuracy of determining whether the change between the three images (the first image and the two second images) is due to the influence of a moving subject or flicker, thereby improving the processing accuracy of the next step S407.

[0040] In step S407, the system control unit 105 controls the image processing unit 104 to perform flicker correction processing on the first image acquired in step S405. Specifically, in this embodiment, the flicker correction processing is processing in which the image processing unit 104 replaces the area where flicker occurs in the first image acquired in step S405 with the second image acquired in step S406. At this time, the image processing unit 104 uses a trained model trained based on training data to input the detected flicker area, the first image, and the second image, and outputs an image in which the area where flicker occurs in the first image is complemented with the second image. Note that the means for performing the flicker correction processing are not limited to this, and the means may be switched depending on the purpose. For example, the difference in gain of the flicker area detected in step S404 may be calculated from the first image acquired in step S405 and the second image acquired in step S406, and the flicker occurring in the first image may be corrected according to the calculation result. The system control unit 105 records the first image that has undergone the flicker correction process in the recording unit 108 in step S407, and then ends this process.

[0041] In step S408, if it is determined in step S402 that flickerless shooting will not be performed, the image sensor 101 is controlled to an arbitrary exposure time to capture an image, as in step S405, and the captured image is then recorded in the recording unit 108, after which the process ends.

[0042] Next, a method for capturing a simultaneous readout image executed in step S403 will be described with reference to the timing chart of FIG.

[0043] In step S403, the system control unit 105 controls the image sensor 101 to have a shooting cycle T51, an exposure time for the first readout T52, a readout time for the first readout T53, an exposure time for the second readout T54, and a readout time for the second readout T55.

[0044] In this embodiment, the exposure time T52 of the first readout and the exposure time T54 of the second readout are set to the same time, and the readout time T53 of the first readout and the readout time T55 of the second readout are controlled to be different times, thereby performing three simultaneous readouts. By setting T52=T54 in this way, the difference between the image of the first readout and the image of the second readout becomes small, and similarly, erroneous detection of things other than flicker can be reduced.

[0045] However, if two or more types of images can be read out simultaneously in the same shooting cycle to obtain images with different exposure times for the same scene, and differences in areas other than flicker (such as differences in moving objects) can be reduced, control different from that of this embodiment may be used.

[0046] For example, the exposure time T52 for the first readout and the exposure time T54 for the second readout may be controlled to be different times rather than being the same as in this embodiment. The difference in exposure time due to this control results in a difference in the appearance of flicker stripes, and flicker can be detected as a difference. However, it should be noted that the difference in areas other than flicker will also be large, which may lead to false detection.

[0047] Furthermore, the readout time T53 of the first readout and the readout time T55 of the second readout may be controlled to be the same time, rather than being set to different values ​​as in this embodiment.

[0048] The system control unit 105 controls the image sensor 101 to capture images so that the second readout cycle (=T54+T55) overlaps with the first readout cycle (=T52+T53). This reduces the difference in areas other than flicker (such as the difference in moving objects), thereby reducing false detections of things other than flicker.

[0049] The simultaneous reading of the first reading and the second reading is repeated the number of times equal to or greater than the value obtained by dividing the reciprocal of the flicker frequency detected in step S401 (hereinafter referred to as the flicker period) by the shorter of the exposure time T52 of the first reading and the exposure time T54 of the second reading (< flicker period). As a result, the total exposure time of the images used for flicker detection can ensure an exposure time equal to or greater than the flicker period. When T52 = T54 as in this embodiment, if T52 is set to be shorter than the flicker period and the simultaneous reading of the first reading and the second reading is repeated the number of times equal to or greater than the value obtained by dividing the flicker period by T52, the same effect can be obtained.

[0050] At this time, the system control unit 105 controls the imaging period T51 of multiple simultaneous readings to be a period different from the flicker period and performs imaging. If the imaging period T51 is the same as the flicker period, the stripes of the flicker will be fixed (a phenomenon in which a specific stripe state is maintained in the captured image), and an area that cannot be detected as flicker will occur in the difference image. Therefore, in this embodiment, the imaging period T51 is set to a period different from the flicker frequency, improving the detection accuracy of the flicker.

[0051] As shown in the example of FIG. 5, it is preferable to make the reading times of the first reading image and the second reading image different (T53 ≠ T55), for example, control to T53 < flicker period < T55 for imaging. As a result, there is a time difference in the reading of each line. When taking the difference between the first reading image and the second reading image, the appearance of the flicker stripes is different, so the flicker can be detected as a difference.

[0052] Also, the control method of this simultaneous reading may be switched according to the detected frequency and the on-off method.

[0053] Also, the control method may be switched according to the exposure time and the reading time, such as performing the second reading for multiple periods during the period of the first reading (= T52 + T53).

[0054] Next, the flicker region detection process in step S404 will be described with reference to Fig. 6. In this embodiment, simultaneous readout of two types of images is executed three times, and the flicker region detection process is executed using these images.

[0055] The two types of images obtained by simultaneous readout consist of an image obtained by the first readout (hereinafter referred to as the first readout image) and an image obtained by the second readout (hereinafter referred to as the second readout image). As described above, the first readout image and the second readout image are images obtained at different readout times, and therefore flicker occurs in different ways. Furthermore, the first readout image and the second readout image are captured at timings where the exposure times overlap, and therefore the images have little difference in areas other than the flicker area 611. Therefore, by taking the difference between the first readout image 601 and the second readout image 602, as in the first simultaneous readout in FIG. 6, it is possible to extract almost the entire flicker area 611, as shown in the difference image 603.

[0056] However, there is a slight difference between the start timing of capturing the first readout image 601 and the second readout image 602 and the flicker cycle, and the difference image 603 includes areas where flicker occurs but are not detected as flicker areas 611. For this reason, in this embodiment, the second and third simultaneous readouts are also performed at a start timing different from that of the first simultaneous readout.

[0057] The first first readout image 601 and the second first readout image 604 were captured at different start times, and therefore the way in which flicker occurs is different, as described above with reference to Fig. 3. Therefore, in the second difference image 606 obtained by taking the difference between the second first readout image 604 and the second second readout image 605, a different area is extracted as the difference from the first difference image 603.

[0058] Similarly, a third difference image 609, which is the difference between the third first readout image 607 and the third second readout image 608, has an area extracted that is different from the first difference image 603 and the second difference image 606.

[0059] Therefore, by adding the first difference image 603, the second difference image 606, and the third difference image 609, it is possible to obtain a flicker region detection result 610. At this time, as shown in the flicker region detection result 610, by capturing the number of images obtained by dividing the flicker cycle by the exposure time in step S403, it is possible to prevent the flicker region from being overlooked in detection.

[0060] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0061] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An imaging device that reads out an image using an imaging element having a plurality of pixels, comprising: a frequency detection means that detects a flicker frequency from an image read out from the imaging element; an image readout means that reads out a first image exposed at an arbitrary exposure time from the imaging element; a simultaneous image readout means that simultaneously reads out multiple images from the imaging element; a flicker area detection means that detects a flicker area in which flicker occurs in the first image using the flicker frequency detected by the frequency detection means and the multiple images read out by the simultaneous image readout means; and a correction means that corrects the flicker in the flicker area. (Configuration 2) The imaging device according to configuration 1, wherein the flicker area detection means detects the flicker area from a difference image of the plurality of images. (Configuration 3) The imaging device described in configuration 1 or 2, characterized in that the simultaneous image readout means reads out the multiple images at a cycle shorter than a flicker cycle, which is the reciprocal of the flicker frequency detected by the frequency detection means. (Configuration 4) The imaging device according to any one of configurations 1 to 3, wherein the plurality of images include images read out at different readout times. (Configuration 5) The imaging device according to any one of configurations 1 to 4, wherein the plurality of images include images read out at different readout times. (Configuration 6) An imaging device described in any one of configurations 1 to 5, characterized in that the correction means corrects flicker in the flicker area using the flicker area, the first image, and a second image captured with an exposure time that is an integer multiple of the flicker frequency. (Configuration 7) The imaging device according to configuration 6, wherein the first image and the second image are captured in rapid succession. (Configuration 8) The imaging device according to configuration 7, wherein the correction means uses a second image taken either before or after the exposure timing of the first image, or both. (Configuration 9) An imaging device described in any one of configurations 6 to 8, characterized in that the correction means has a trained model that estimates an image in which the area of ​​the first image where flicker occurs is complemented with the second image from the flicker area, the first image, and the second image. (Configuration 10) The imaging device according to any one of configurations 1 to 9, wherein the plurality of images are images read out from different pixels among the plurality of pixels in the same shooting cycle. (Configuration 11) The imaging device according to configuration 10, wherein the plurality of images are read out in the same shooting cycle so that their respective readout cycles overlap. (Method 1) A control method for an imaging device that reads out images using an imaging element having a plurality of pixels, the control method comprising: a frequency detection step of detecting a flicker frequency from an image read out from the imaging element; an image readout step of reading out a first image exposed with an arbitrary exposure time from the imaging element; a simultaneous image readout step of simultaneously reading out multiple images from the imaging element; a flicker area detection step of detecting a flicker area in the first image where flicker is occurring using the flicker frequency detected in the frequency detection step and the multiple images read out in the simultaneous image readout step; and a correction step of correcting the flicker in the flicker area. (Program 1) A program for causing a computer to function as each of the means of the imaging device described in any one of configurations 1 to 11. [Explanation of symbols]

[0062] 100 Imaging device 101 Image sensor 102 Flicker frequency detector 103 Flicker area detection unit 104 Image processing section 105 System control section 106 Operation section 107 Display section 108 Recording Section 201 pixel array

Claims

1. An imaging device that reads out an image using an imaging element having a plurality of pixels, a frequency detection means for detecting a flicker frequency from an image read from the imaging device; an image reading means for reading a first image exposed for an arbitrary exposure time from the image sensor; a simultaneous image readout means for simultaneously reading out a plurality of images from the imaging element; a flicker region detection means for detecting a flicker region in the first image where flicker occurs, using the flicker frequency detected by the frequency detection means and the plurality of images read out by the simultaneous image readout means; a correction means for correcting flicker in the flicker region; An imaging device comprising:

2. 2. The imaging apparatus according to claim 1, wherein the flicker area detecting means detects the flicker area from a difference image of the plurality of images.

3. 2. The imaging device according to claim 1, wherein said simultaneous image readout means reads out said plurality of images at a cycle shorter than a flicker cycle which is the reciprocal of the flicker frequency detected by said frequency detection means.

4. The imaging device according to claim 1 , wherein the plurality of images include images read out at different readout times.

5. The imaging device according to claim 1 , wherein the plurality of images include images exposed with the same exposure time.

6. 2. The imaging device according to claim 1, wherein the correction means corrects flicker in the flicker area using the flicker area, the first image, and a second image captured with an exposure time that is an integer multiple of the flicker frequency.

7. 7. The imaging apparatus according to claim 6, wherein the first image and the second image are captured in rapid succession.

8. 8. The imaging device according to claim 7, wherein the correction means uses a second image taken either before or after the exposure timing of the first image, or both.

9. The imaging device according to claim 6, characterized in that the correction means has a trained model that estimates an image in which the area of ​​the first image where flicker occurs is complemented with the second image from the flicker area, the first image, and the second image.

10. 2. The imaging apparatus according to claim 1, wherein the plurality of images are images read out from different pixels among the plurality of pixels in the same imaging cycle.

11. 11. The imaging apparatus according to claim 10, wherein the plurality of images are read out in the same shooting cycle so that their readout cycles overlap.

12. A control method for an imaging device that reads out an image using an imaging element having a plurality of pixels, comprising: a frequency detection step of detecting a flicker frequency from an image read from the imaging device; an image reading step of reading a first image exposed for an arbitrary exposure time from the image sensor; a simultaneous image reading step of simultaneously reading out a plurality of images from the imaging element; a flicker region detection step of detecting a flicker region in the first image where flicker occurs, using the flicker frequency detected in the frequency detection step and the plurality of images read out in the simultaneous image readout step; a correction step of correcting flicker in the flicker region; A control method comprising:

13. A program for causing a computer to function as each of the means of the imaging device according to claim 1.

Images