Imaging device, control method for imaging device, and program

Abstract

In a configuration that acquires multiple consecutive frames and generates still images and videos using those frames, this invention provides a mechanism that can generate still images corresponding to a set storage time for still images. [Solution] When the still image storage time is longer than the video storage time, the imaging device 100 changes the imaging frame rate so that the unexposed time is minimized, and generates a video based on multiple frames obtained from video shooting at the changed imaging frame rate. The imaging device 100 also generates a still image by summarizing and averaging a predetermined number of consecutive frames, determined based on the still image storage time, from among the multiple frames obtained from video shooting at the changed imaging frame rate.

Description

Technical Field

[0004] , , , , , , , , , , , , , , , , , , ,

[0003]

[0001] The present invention relates to an imaging device, a control method for an imaging device, and a program.

Background Art

[0002] An imaging device that captures a still image during video shooting is known. In such an imaging device, during video shooting, the device is temporarily switched to the still image shooting mode, or a video frame obtained by video shooting is recorded as a still image, thereby realizing still image shooting during video shooting. However, when switching to the still image shooting mode during video shooting to record a still image, there is a problem that the recording of the video is interrupted. Further, when generating a still image by extracting a video frame without interrupting the recording of the video, there are problems such as obtaining a still image with an exposure time depending on the recording frame rate of the video, and a frame with an exposure different from that of the video frame being recorded as the still image. Also, in any case, when considering long-second shooting of a still image, frame stop cannot be avoided.

[0003] On the other hand, when generating a still image using a video frame obtained by video shooting, a number of video frames determined based on the recording frame rate of the video and the accumulation time of the still image are synthesized (see, for example, Patent Documents 1 and 2). Thereby, it becomes possible to generate a good still image with an exposure time independent of the recording frame rate of the video without interrupting the recording of the video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

[0005] However, in the technologies described in Patent Documents 1 and 2 mentioned above, the number of video frames to be synthesized is determined based on the video recording frame rate and the still image storage time. Therefore, for example, if the set still image storage time is longer than the video storage time, it may not be possible to generate still images corresponding to the set still image storage time.

[0006] The present invention aims to provide a mechanism that can generate still images corresponding to a set storage time for still images in a configuration that acquires a series of consecutive frames and generates still images and videos using those frames. [Means for solving the problem]

[0007] To achieve the above objective, the present invention provides an imaging device that acquires a plurality of consecutive frames and generates still images and moving images using the plurality of frames, comprising control means for controlling moving image shooting and setting means for setting the storage time for still images and the storage time for moving images, wherein when the storage time for still images is longer than the storage time for moving images, the control means performs the following: control to change the imaging frame rate in moving image shooting so as to minimize the unexposed time between acquiring consecutive frames in moving image shooting; control to generate a moving image based on the plurality of frames obtained from the plurality of frames obtained from the plurality of frames obtained from the moving image shooting at the changed imaging frame rate, by summarizing and averaging a predetermined number of consecutive frames determined based on the storage time for still images, to generate a still image. [Effects of the Invention]

[0008] According to the present invention, in a configuration that acquires a plurality of consecutive frames and generates still images and videos using the plurality of frames, it is possible to generate still images corresponding to a set storage time for still images. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram schematically showing the configuration of the imaging device according to this embodiment. [Figure 2] This flowchart shows the procedure for capturing both video and still images using the imaging device shown in Figure 1. [Figure 3] This figure shows an example of changing the imaging settings for S208 in Figure 2. [Figure 4] This figure shows an example of imaging control in Pattern 1 of Figure 3. [Figure 5] This figure shows an example of imaging control in Pattern 2 of Figure 3. [Figure 6] This figure shows an example of imaging control in Pattern 3. [Figure 7] This figure shows an example of imaging control in a situation where the unexposed time is such that the imaging frame rate cannot be changed while maintaining a multiple of the recording frame rate. [Modes for carrying out the invention]

[0010] (First example) The embodiments of the present invention will be described below with reference to the drawings. Note that the following embodiments do not limit the invention to the claims. While multiple features are described in the embodiments, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the accompanying drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0011] First, a first embodiment of the present invention will be described. Figure 1 is a schematic block diagram showing the configuration of the imaging device 100 according to this embodiment. In Figure 1, the imaging device 100 includes an image sensor 101, an AD converter 102, an imaging control unit 103, a system control unit 107, a user operation unit 108, a display unit 109, and a recording unit 110.

[0012] An optical image of a subject is formed on the imaging surface of the imaging device 101 via an optical system (not shown). The optical system (not shown) is, for example, a lens unit composed of a plurality of lenses, a lens drive unit, and the like. The lens unit may be integrated with the imaging device 100 or configured to be replaceable with respect to the imaging device 100. The AD converter 102 is a converter for converting an analog signal output from the imaging device 101 into a digital signal. The AD converter 102 outputs the converted digital signal to the shooting control unit 103.

[0013] The shooting control unit 103 is composed of a circuit and a program group having an image processing function including an imaging cycle control unit 104, a moving image recording control unit 105, and a still image synthesis processing unit 106.

[0014] The imaging cycle control unit 104 controls the imaging frame rate of a moving image using the recording settings of still images and moving images set by the user operation unit 108 by the photographer according to a shooting instruction from the system control unit 107. Details of the operation will be described later.

[0015] The moving image recording control unit 105 determines the frames to be recorded in a moving image based on the recording settings of still images and moving images set by the user operation unit 108 by the photographer and the imaging frame rate changed by the imaging cycle control unit 104. Details of the operation will be described later.

[0016] The still image synthesis processing unit 106 generates a still image by adding and averaging a predetermined number of frames based on the recording settings of still images set by the user operation unit 108 by the photographer and the imaging frame rate changed by the imaging cycle control unit 104. Details of the operation will be described later.

[0017] The system control unit 107 is composed of a CPU, a memory, etc. (not shown) and controls the overall operation of the imaging device 100 system. Further, the system control unit 107 also functions as a data intermediary between the data obtained by image processing and between each block. The control program executed by the system control unit 107 is stored in a memory (not shown) in advance.

[0018] The user operation unit 108 is an operation member such as various switches and dials provided in the imaging device 100. The photographer can control the setting of shooting parameters, the shooting operation, etc. using the user operation unit 108. The operation information of the user operation unit 108 by the photographer is output to the system control unit 107.

[0019] The display unit 109 is a display such as an LCD, and displays the image at the time of shooting transferred from the system control unit 107, the image data stored in the recording unit 110, and various setting screens. The recording unit 110 records the image data transferred via the system control unit 107 and reads out the recorded data with respect to a recording medium such as an SD card or a CF card.

[0020] Next, a moving image / still image shooting process in which the imaging device 100 performs still image shooting according to an instruction received from the photographer during moving image shooting will be described.

[0021] Figure 2 is a flowchart showing the procedure of the moving image / still image shooting process executed by the imaging device 100 in FIG. 1. This moving image / still image shooting process is realized by the CPU in the system control unit 107 executing a control program recorded in the memory.

[0022] In FIG. 2, first, in S201, the system control unit 107 determines the recording settings for the moving image according to the operation of the user operation unit 108 by the photographer. Thereby, the imaging parameters used for moving image shooting are set. The imaging parameters used for moving image shooting are various parameters such as the recording frame rate of the moving image, the accumulation time (Tv) of the moving image, and the ISO sensitivity. The set imaging parameters are held by the system control unit 107.

[0023] Next, in S202, the system control unit 107 determines the still image recording settings according to the user operation unit 108 performed by the photographer. This sets the imaging parameters used for still image shooting. These imaging parameters include various parameters such as the still image storage time and ISO sensitivity. The set imaging parameters are held by the system control unit 107.

[0024] Next, in S203, the system control unit 107 starts recording video based on the video recording settings, in accordance with the video recording instruction from the photographer. Specifically, the system control unit 107 instructs the shooting control unit 103 to execute video recording based on the video recording settings. Upon receiving this instruction, the shooting control unit 103 controls the exposure to the video recording frame rate and video storage time held by the system control unit 107 in S201. As a result, a pixel signal is output from the image sensor 101.

[0025] Next, in S204, the system control unit 107 initiates still image capture if the photographer operates the user operation unit 108 to issue a still image capture instruction while video is being recorded. Specifically, the system control unit 107 instructs the shooting control unit 103 to execute still image capture based on the still image recording settings.

[0026] Next, in S205, the system control unit 107 controls the imaging period control unit 104 to determine whether the set storage time for still images is longer than the set storage time for video. The set storage time for still images is the storage time used for still image shooting, which was held by the system control unit 107 in S202. The set storage time for video is the storage time used for video shooting, which was held by the system control unit 107 in S201. If it is determined that the set storage time for still images is longer than the storage time for video, this process proceeds to S206.

[0027] In S206, the system control unit 107 controls the imaging period control unit 104 to calculate the unexposed time. The unexposed time is the time between acquiring consecutive frames during video recording, that is, the time obtained by subtracting the exposure time of the frames that make up the video from the video recording time, and is obtained by subtracting the video's set storage time from the reciprocal of the video's recording frame rate.

[0028] Next, in S207, the system control unit 107 controls the imaging period control unit 104 to determine whether the unexposed time calculated in S206 is '0' or not. If it is determined that the unexposed time is not '0', the process proceeds to S208.

[0029] In S208, the system control unit 107 controls the imaging period control unit 104 to change the imaging settings in order to generate still images from frames obtained during video recording. For example, the system control unit 107 determines the imaging settings, i.e., the imaging frame rate and storage time used for video recording and still image recording, so that the unexposed time is minimized.

[0030] Figure 3 shows an example of changing the imaging settings of S208 in Figure 2.

[0031] For example, in Pattern 2 of Figure 3, the video recording frame rate is 30p, and the video storage time is 1 / 60s. In this case, the unexposed time is 1 / 60s, and in S208, the imaging frame rate is changed to 60p so that this unexposed time is minimized (0). In order not to affect video recording, the imaging frame rate and storage time are basically determined while maintaining a multiple of the recording frame rate in the video recording settings determined in S201.

[0032] Furthermore, for example, as shown in Pattern 3 of Figure 3, if the ISO sensitivity of the video determined in S201 differs from the ISO sensitivity of the still image determined in S202, the ISO sensitivity used for shooting is changed to the ISO sensitivity of the still image determined in S202. In this embodiment, there is no time lag in the execution of processing in S204 to S208, and the still image is generated based on the frame obtained from imaging based on the settings changed in S208.

[0033] Returning to Figure 2, in S209, the system control unit 107 controls the video recording control unit 105 to determine whether the only imaging parameter changed in S208 is the imaging frame rate (labeled "imaging period" in Figure 2). If it is determined that the only imaging parameter changed in S208 is the imaging frame rate, the process proceeds to S210. If it is determined that the parameter changed in S208 is not only the imaging frame rate, that is, if an imaging parameter other than the imaging frame rate, such as ISO sensitivity, has been changed, the process proceeds to S211.

[0034] In S210, the system control unit 107 controls the video recording control unit 105 to perform image development processing on the frames that have been downsampled by the imaging frame rate from the multiple frames obtained during shooting. Details of the processing will be described later. After this, the process proceeds to S212.

[0035] In S211, the system control unit 107 controls the video recording control unit 105 to perform image development processing on a frame obtained by averaging a predetermined number of consecutive frames from the multiple frames obtained during shooting. Details of the processing will be described later. After this, the process proceeds to S212.

[0036] If it is determined in S205 that the still image storage time is less than or equal to the video storage time, this process proceeds to S212. Also, if it is determined in S208 that the unexposed time is '0', this process proceeds to S212.

[0037] In S212, the system control unit 107 performs the process of recording as a video frame. For example, if it is determined in S205 that the still image storage time is less than or equal to the video storage time, or if it is determined in S208 that the unexposed time is '0', the frame obtained from shooting is recorded as a video frame. Alternatively, the frame that has been processed in S210 or S211 is recorded as a video frame.

[0038] Here, an example of the imaging control performed during processing S207 to S212 will be explained using Figures 3 to 6. Figures 4 to 6 all show the relationship between frame rate and exposure time, with frames recorded as video frames being represented by white fills, and frames that are thinned out during video recording being represented by pattern fills. All patterns are explained assuming a video recording frame rate of 30p and a still image accumulation time of 1s.

[0039] Figure 4 shows an example of imaging control in Pattern 1 of Figure 3. Pattern 1 is the pattern in which the unexposed time calculated in S206 is '0' (i.e., YES in S207), and there is no need to change the imaging parameters, and the frames obtained from the shooting are recorded as video frames as they are.

[0040] Figure 5 shows an example of imaging control in Pattern 2 of Figure 3. Pattern 2 is an example where only the imaging frame rate among the imaging parameters is changed in S208. In Pattern 2, the video recording frame rate is 30p and the video storage time is 1 / 60s. In this case, the unexposed time calculated in S206 is 1 / 60s, and in S208, the imaging frame rate is changed to 60p so that this unexposed time is minimized (0). In Pattern 2, development processing is performed on the frames that are downsampled by the imaging frame rate from the multiple frames obtained during shooting, and the developed frames are recorded as video frames. As a result, even if the imaging frame rate is changed to minimize the unexposed time (0), it is possible to generate a video based on the video recording settings set by the photographer.

[0041] Figure 6 shows an example of imaging control in Pattern 3 of Figure 3. Pattern 3 is an example where the ISO sensitivity set for video and still images is different, and the imaging parameters are changed to prioritize the settings for still images. In this case, to achieve the same exposure as the original video settings (accumulation time 1 / 60s, ISO sensitivity 100) while prioritizing the ISO sensitivity for still images, the video accumulation time needs to be changed to 1 / 120s. Also, because there will be unexposed time, the imaging frame rate itself is also changed to 120p. Furthermore, in order to obtain an image with an exposure time equivalent to before the change, development processing is performed on a frame obtained by averaging two consecutive frames captured at 120p, and the developed frame is recorded as a video frame. However, since the video recording frame rate is 30p, the images are averaged and then downsampled every two frames from the image generated at 60p before being recorded. By controlling the system in this way, when the ISO sensitivity set for video and still images differs, it is possible to generate a still image based on the still image recording settings set by the photographer, and a video corresponding to the video recording settings set by the photographer. In this embodiment, the explanation prioritizes the settings for still images, but a configuration prioritizing the settings for video is also possible.

[0042] Returning to Figure 2, in S213, the system control unit 107 controls the still image synthesis processing unit 106 to perform still image generation processing. In S213, based on the set storage time for still images, a predetermined number of consecutive frames captured at the imaging frame rate changed in S208 are added together using an average to generate a still image with the same exposure as the video. In still image generation, without the control of steps S209 to S212, the number of frames to be added to correspond to the storage time is calculated from the final imaging frame rate and the set storage time for still images, and this number of consecutive frames are added together using an average. For example, in pattern 1, the imaging frame rate for video is 30p, so 30 consecutive frames are added together using an average. In pattern 2, the imaging frame rate for video is 60p, so 60 frames are added together using an average. In pattern 3, the imaging frame rate is 120p, so 120 frames are added together using an average. Here, examples of synthesis processing using additive synthesis and average synthesis are shown, but it is not limited to these, and synthesis processing may be performed using other methods depending on the purpose. Once the S213 process is complete, this process will terminate.

[0043] According to the embodiment described above, when the still image storage time is longer than the video storage time, the imaging frame rate is changed to minimize the unexposed time, and a video is generated based on multiple frames obtained from video shooting with the changed imaging frame rate. Furthermore, a still image is generated by additive averaging of a predetermined number of consecutive frames, determined based on the still image storage time, from among the multiple frames obtained from video shooting with the changed imaging frame rate. This makes it possible to generate a still image corresponding to the set still image storage time in a configuration that acquires multiple consecutive frames and generates a still image and a video using those multiple frames. Note that by performing additive averaging of frames, it is possible to obtain a still image with a slower shutter speed and unchanged exposure, thereby lowering the apparent sensitivity. On the other hand, by performing simple additive averaging, it is also possible to obtain a still image with a slower shutter speed and increased exposure.

[0044] In the embodiment described above, the video-still image capture process shown in Figure 2 is implemented by the CPU in the system control unit 107 executing a control program stored in memory. However, the configuration is not limited to this. For example, the shooting control unit 103 may be equipped with a CPU and memory, and the CPU in the shooting control unit 103 may execute a control program stored in this memory to implement the video-still image capture process shown in Figure 2.

[0045] (Second example) Next, a second embodiment of the present invention will be described. In the second embodiment, the imaging control described in the first embodiment described above will be explained in the case of an unexposed period where the imaging frame rate cannot be changed while maintaining a multiple of the recording frame rate. The configuration of the imaging device 100 is the same as in the first embodiment described above, so its description will be omitted. Also, the video-still image capture process in Figure 2 described above is basically the same as in the first embodiment, with only the processing in S208 and S213 being different. Below, S208 and S213, which differ from the video-still image capture process in Figure 2 described above, will be explained.

[0046] In S208, the system control unit 107 controls the imaging period control unit 104 to change the imaging settings in order to generate still images from frames obtained from video recording. However, when attempting to change the imaging frame rate to maintain a multiple of the recording frame rate so that the unexposed time is minimized (0), this may not be possible due to constraints on the optical sensor's readout time and the relationship with the recording frame rate.

[0047] Figure 7 shows an example of imaging control when the unexposed time is such that the imaging frame rate cannot be changed while maintaining a multiple of the recording frame rate. In the example in Figure 7, the recording frame rate of the video is 30p and the set storage time of the video is 1 / 50s. In this case, the unexposed time is 1 / 80s, but since the set storage time of the video is 1 / 50s, the imaging frame rate cannot be changed to 60p. Therefore, imaging is performed by irregularly changing the imaging frame rate to minimize the unexposed time. In the example in Figure 7, imaging is performed by alternating exposures of 1 / 50s of the video exposure time and 1 / 80s of other exposure times corresponding to the unexposed time to minimize the unexposed time. For the video frames, frames from other exposure times are skipped and recorded.

[0048] In the still image synthesis in S213, instead of simple averaging, gain is applied to frames obtained from imaging with different exposure times so that they have the same exposure as frames obtained from the video's exposure time. Furthermore, based on the set storage time for still images, a predetermined number of consecutive frames (frames obtained from imaging with different exposure times have the gain applied) are combined using averaging. This generates a still image with the same exposure as the video's exposure conditions.

[0049] By controlling it in this way, when the exposure time is such that the imaging frame rate cannot be changed while maintaining a multiple of the recording frame rate, it is possible to generate a video based on the video recording settings and a still image corresponding to the still image recording settings.

[0050] (Third example) Next, a third embodiment of the present invention will be described. In the third embodiment, the case in which the set storage time for still images and the sum of the storage times for a predetermined number of frames of video do not match will be explained regarding the imaging control shown in the second embodiment. Note that the configuration of the imaging device 100 is the same as in the first embodiment, so its explanation will be omitted. Also, similar to the second embodiment, the case in which the video recording frame rate is 30p, the set storage time for video is 1 / 50s, and the set storage time for still images is 0.6s will be explained. In this case, the unexposed time is 1 / 80s. Frames with a storage time of 1 / 50s and decimated frames with a storage time of 1 / 80s are repeated alternately. In the generation of still images in S213, the sum of the storage times does not match 0.6s in this state. In such cases, the number of video frames to be combined is determined so as to be closest to the set storage time for still images. For example, if we consider two consecutive frames and a decimated frame as one set, the sum of the storage time becomes 0.5975s when there are 18 sets and one decimated frame, which is the closest value.

[0051] By controlling it in this way, if the set storage time for still images and the total storage time for a predetermined number of frames of a video do not match, it is possible to generate a video based on the video recording settings and still images corresponding to the still image recording settings.

[0052] It should be noted that the embodiments described above are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features.

[0053] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0054] Furthermore, the disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An imaging device that acquires a plurality of consecutive frames and generates still images and videos using the plurality of frames, comprising control means for controlling video shooting and setting means for setting the storage time for still images and the storage time for videos, wherein when the storage time for still images is longer than the storage time for videos, the control means performs the following: control to change the imaging frame rate in video shooting so as to minimize the unexposed time between acquiring consecutive frames in video shooting; control to generate a video based on the plurality of frames obtained by video shooting with the changed imaging frame rate; and control to generate a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained by video shooting with the changed imaging frame rate, which are determined based on the storage time for still images. (Configuration 2) The imaging apparatus according to Configuration 1, characterized in that the unexposed time is the time obtained by subtracting the video storage time from the reciprocal of the video recording frame rate. (Configuration 3) When only the imaging frame rate is changed in order to generate the still image, the control means generates a video based on frames that have been thinned out from a plurality of frames obtained from the video recording at the changed imaging frame rate, as described in Configuration 1 or 2. (Configuration 4) When the imaging frame rate and other imaging parameters are changed in order to generate the still image, the control means generates a video based on a frame obtained by summing and averaging a predetermined number of consecutive frames from a plurality of frames obtained in the video recording with the changed imaging frame rate, as described in any one of Configurations 1 to 3. (Configuration 5) The imaging device according to any one of Configurations 1 to 4, characterized in that, in the control for changing the imaging frame rate in video recording, the imaging frame rate is changed while maintaining a multiple of the recording frame rate of the video so as to minimize the unexposed time. (Configuration 6) In the case of an unexposed period in which it is not possible to change the imaging frame rate while maintaining a multiple of the recording frame rate of the video, the control means applies a predetermined gain to the frames obtained from imaging during other exposure periods corresponding to the unexposed period, and generates a still image using the frames that have been processed with the predetermined gain, as described in Configuration 5. (Configuration 7) A control method for an imaging device that acquires a plurality of consecutive frames and generates still images and videos using the plurality of frames, comprising a control step for controlling video shooting and a setting step for setting the storage time for still images and the storage time for videos, wherein when the storage time for still images is longer than the storage time for videos, the control step is characterized by performing the following: control to change the imaging frame rate in video shooting so as to minimize the unexposed time between acquiring consecutive frames in video shooting; control to generate a video based on the plurality of frames obtained by video shooting with the changed imaging frame rate; and control to generate a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained by video shooting with the changed imaging frame rate, which are determined based on the storage time for still images. (Configuration 8) A program that causes a computer to execute a control method for an imaging device that acquires a plurality of consecutive frames and generates still images and videos using the plurality of frames, wherein the control method for the imaging device comprises a control step for controlling video shooting and a setting step for setting the storage time for still images and the storage time for videos, and when the storage time for still images is longer than the storage time for videos, the control step is characterized by performing the following: control to change the imaging frame rate in video shooting so as to minimize the unexposed time between acquiring consecutive frames in video shooting; control to generate a video based on a plurality of frames obtained from the video shooting with the changed imaging frame rate; and control to generate a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained from the video shooting with the changed imaging frame rate, which are determined based on the storage time for still images. [Explanation of Symbols]

[0055] 100 Imaging device 103 Imaging Control Unit 104 Imaging period control unit 105 Video Recording Control Unit 106 Still Image Synthesis Processing Unit 107 System Control Unit

Claims

1. An imaging device that acquires multiple consecutive frames and generates still images and videos using the multiple frames, A control means for controlling video recording, It includes setting means for setting the storage time for still images and the storage time for videos, An imaging device characterized in that, when the storage time of the still images is longer than the storage time of the video, the control means performs the following: control to change the imaging frame rate in the video shooting so as to minimize the unexposed time between acquiring consecutive frames in the video shooting; control to generate a video based on a plurality of frames obtained in the video shooting with the changed imaging frame rate; and control to generate a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained in the video shooting with the changed imaging frame rate, which are determined based on the storage time of the still images.

2. The imaging apparatus according to claim 1, characterized in that the unexposed time is the time obtained by subtracting the video storage time from the reciprocal of the video recording frame rate.

3. The imaging apparatus according to claim 1, characterized in that, when only the imaging frame rate is changed in order to generate the still image, the control means generates a video based on frames thinned out from a plurality of frames obtained from the video recording at the changed imaging frame rate.

4. The imaging apparatus according to claim 1, characterized in that, when the imaging frame rate and other imaging parameters are changed in order to generate the still image, the control means generates a video based on a frame obtained by summing and averaging a predetermined number of consecutive frames among a plurality of frames obtained in the video recording with the changed imaging frame rate.

5. The imaging apparatus according to claim 1, characterized in that, in the control for changing the imaging frame rate in the aforementioned video recording, the imaging frame rate is changed while maintaining a multiple of the recording frame rate of the video so as to minimize the unexposed time.

6. The imaging apparatus according to claim 5, characterized in that, in the case of an unexposed period in which it is not possible to change the imaging frame rate while maintaining a multiple of the recording frame rate of the aforementioned video, the control means applies a predetermined gain to frames obtained from imaging during other exposure periods corresponding to the unexposed period, and generates a still image using the frames that have been processed with the predetermined gain.

7. A control method for an imaging device that acquires multiple consecutive frames and generates still images and videos using the multiple frames, A control process that controls video recording, The system includes a setting step for setting the storage time for still images and the storage time for video. A method for controlling an imaging device, characterized in that, when the storage time of the still images is longer than the storage time of the video, the control step includes: controlling the image capture frame rate in the video shooting so as to minimize the unexposed time between acquiring consecutive frames in the video shooting; controlling the generation of a video based on a plurality of frames obtained in the video shooting with the changed image capture frame rate; and generating a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained in the video shooting with the changed image capture frame rate, which are determined based on the storage time of the still images.

8. A program that causes a computer to execute a control method for an imaging device that acquires multiple consecutive frames and generates still images and videos using the multiple frames, The control method for the imaging device is as follows: A control process that controls video recording, The system includes a setting step for setting the storage time for still images and the storage time for video. The program is characterized in that, when the storage time of the still images is longer than the storage time of the video, the control step includes: controlling the image capture frame rate in the video recording so as to minimize the unexposed time between acquiring consecutive frames in the video recording; controlling the generation of a video based on a plurality of frames obtained from the video recording with the changed image capture frame rate; and generating a still image by summarizing and averaging a predetermined number of consecutive frames from the plurality of frames obtained from the video recording with the changed image capture frame rate, which are determined based on the storage time of the still images.

Images