Control device, imaging device, control method, and storage medium

Abstract

The present invention addresses the problem of providing a control device, an imaging device, a control method, and a storage medium capable of suppressing a sudden change in brightness between a plurality of frames obtained by performing imaging by an imaging device in conjunction with switching of light transmittance of an electronic dimming filter. The control device includes a processor. The processor acquires a plurality of divided exposures determined on the basis of the change time and the target exposure of the imaging device, and performs control such that the plurality of divided exposures are applied to at least the exposures of a plurality of frames obtained by imaging by the imaging device within the change time. The change time is the time required for the light transmittance of an electronic dimming filter mounted on the imaging device to change from a first light transmittance to a second light transmittance at which the target exposure can be achieved.

Description

Technical Field

[0001] The present disclosure relates to a control device, a photographing device, a control method, and a storage medium. Background Art

[0002] Japanese Patent Application Laid-Open No. 2023-121787 discloses an imaging device that sets exposure conditions based on the characteristics of a transmittance control element. The imaging device described in Japanese Patent Application Laid-Open No. 2023-121787 includes a processor. In the imaging device described in Japanese Patent Application Laid-Open No. 2023-121787, the processor calculates a first exposure condition range based on the imaging device's photometry. If the first exposure condition range is not included in a second exposure condition range to which the control range obtained by the transmittance control element is applicable, the processor changes the exposure conditions of the imaging device so that the calculated first exposure condition range is included in the second exposure condition range.

[0003] Japanese Patent Application Laid-Open No. 2020-034590 discloses an imaging device comprising an element for controlling light transmission and a light-receiving element for receiving light that has passed through the element. The imaging device described in Japanese Patent Application Laid-Open No. 2020-034590 includes a calculation unit that estimates the time required for the color removal process of the element for controlling light transmission. If the color removal time estimated by the calculation unit exceeds a threshold, the sensitivity of the light-receiving element is increased.

[0004] Japanese Patent Laid-Open No. 2005-045648 discloses an exposure control method for a photographic device, which comprises: a photographic lens having an aperture opening; a solid-state photographing element; a plurality of exposure adjustment mechanisms; a mechanism for determining the brightness of a subject; and an exposure control mechanism for controlling the plurality of exposure adjustment mechanisms according to the brightness of the subject to obtain a target exposure value.

[0005] In the imaging device described in Japanese Patent Laid-Open No. 2005-045648, the plurality of exposure adjustment mechanisms include a first exposure adjustment mechanism that adjusts the exposure amount by moving an ND filter forward and backward relative to the aperture opening, and a second exposure adjustment mechanism that is composed of at least one of an exposure adjustment mechanism that adjusts the exposure amount by adjusting the opening area of ​​the aperture opening, an exposure adjustment mechanism that adjusts the exposure amount by adjusting the electronic shutter speed of a solid-state imaging element, and an exposure adjustment mechanism that controls the exposure amount by controlling the gain of an amplifier of an image signal obtained from the solid-state imaging element.

[0006] In the exposure control method for a camera described in Japanese Patent Application Laid-Open No. 2005-045648, the first exposure adjustment mechanism is controlled so that when the subject brightness is below a predetermined level, the first exposure adjustment mechanism is maintained in a state where the ND filter is not applied to the aperture, i.e., the ND filter is fully open. When the subject brightness is above the predetermined level, the first exposure adjustment mechanism is maintained in a state where the ND filter is applied to the entire area of ​​the aperture, i.e., the ND filter is fully closed. Furthermore, in the exposure control method for a camera described in Japanese Patent Application Laid-Open No. 2005-045648, when the first exposure adjustment mechanism transitions between the ND filter fully open state and the ND filter fully closed state, the second exposure adjustment mechanism is controlled so that the second exposure adjustment mechanism generates an exposure change that offsets the exposure change associated with the state transition of the first exposure adjustment mechanism.

[0007] International Publication No. 2021 / 193814 discloses an imaging device that sets exposure conditions based on the characteristics of a transmittance control element. The imaging device described in International Publication No. 2021 / 193814 includes a processor that calculates a first exposure condition range based on the imaging device's photometry. If the first exposure condition range is not included in a second exposure condition range to which the control range obtained by the transmittance control element can be applied, the processor changes the exposure conditions of the imaging device so that the calculated first exposure condition range is included in the second exposure condition range. Furthermore, during imaging, the processor controls exposure using the transmittance control element within the second exposure condition range.

[0008] Japanese Patent Application Laid-Open No. 2018-198403 discloses an imaging device including an ND filter unit, a first exposure determination mechanism, a second exposure determination mechanism, and a control mechanism. In the imaging device described in Japanese Patent Application Laid-Open No. 2018-198403, the ND filter unit includes ND filters with multiple densities, and the density of the ND filter inserted into the optical path can be changed. The first exposure determination mechanism determines a first exposure control value, which includes the density of the ND filter and is used for exposure control when imaging a subject. The second exposure determination mechanism determines a second exposure control value, which includes a density different from the first exposure control value. The control mechanism controls the exposure when imaging the subject based on the exposure control value determined by the second exposure determination mechanism and the first or second exposure determination mechanism. The first exposure control value includes a greater number of changeable densities of the ND filter unit than the second exposure control value. The control mechanism switches the first exposure control value to the second exposure control value at a predetermined timing.

[0009] In the imaging device described in Japanese Patent Laid-Open No. 2005-045648, the plurality of exposure adjustment mechanisms include a first exposure adjustment mechanism that adjusts the exposure amount by moving an ND filter forward and backward relative to the aperture opening, and a second exposure adjustment mechanism that is composed of at least one of an exposure adjustment mechanism that adjusts the exposure amount by adjusting the opening area of ​​the aperture opening, an exposure adjustment mechanism that adjusts the exposure amount by adjusting the electronic shutter speed of a solid-state imaging element, and an exposure adjustment mechanism that controls the exposure amount by controlling the gain of an amplifier of an image signal obtained from the solid-state imaging element.

[0010] In the exposure control method for a camera described in Japanese Patent Application Laid-Open No. 2005-045648, the first exposure adjustment mechanism is controlled so that when the subject brightness is below a predetermined level, the first exposure adjustment mechanism is maintained in a state where the ND filter is not applied to the aperture, i.e., the ND filter is fully open. When the subject brightness is above the predetermined level, the first exposure adjustment mechanism is maintained in a state where the ND filter is applied to the entire area of ​​the aperture, i.e., the ND filter is fully closed. Furthermore, in the exposure control method for a camera described in Japanese Patent Application Laid-Open No. 2005-045648, when the first exposure adjustment mechanism transitions between the ND filter fully open state and the ND filter fully closed state, the second exposure adjustment mechanism is controlled so that the second exposure adjustment mechanism generates an exposure change that offsets the exposure change associated with the state transition of the first exposure adjustment mechanism.

[0011] Japanese Patent Application Publication No. 2013-157688 discloses a camera device having an exposure state determination mechanism, an exposure control mechanism, an ND filter, and an ND control mechanism. In the camera device described in Japanese Patent Application Publication No. 2013-157688, the exposure state determination mechanism determines the exposure state. Furthermore, the exposure control mechanism adjusts the exposure based on the exposure state. Furthermore, the ND filter can be inserted and removed from the optical path to adjust the exposure. Furthermore, the ND control mechanism determines whether to insert or remove the ND filter based on specified conditions for motion picture photography. Furthermore, the exposure control mechanism uses the ND filter to adjust the exposure when the specified conditions are met, and does not use the ND filter to adjust the exposure when the specified conditions are not met.

[0012] Japanese Patent Application Laid-Open No. 2017-009952 discloses a camera device comprising: an optical mechanism for forming an image of a subject; a first dimming mechanism located on the optical axis of the optical mechanism and capable of adjusting light intensity by varying the size of the aperture opening, the adjustment range of the first dimming mechanism varying according to the focal length; a second dimming mechanism located on the optical axis of the optical mechanism and capable of adjusting transmitted light intensity by varying the transmittance, the adjustment performance of the second dimming mechanism being greater than the adjustment resolution of the first dimming mechanism; and a control mechanism for controlling the operation of the first and second dimming mechanisms to ensure appropriate exposure during photography. In the camera device described in Japanese Patent Application Laid-Open No. 2017-009952, the control mechanism uses the first and second dimming mechanisms to adjust light intensity when the first dimming mechanism has a wider light intensity adjustment range than the second dimming mechanism, and uses the first dimming mechanism to adjust light intensity when the first dimming mechanism has a narrower light intensity adjustment range than the second dimming mechanism.

[0013] International Publication No. 2017 / 061169 discloses a camera device capable of switching between a liquid crystal dimming element and transparent glass. Summary of the Invention

[0014] A first embodiment of the present disclosure provides a control device, an imaging device, a control method, and a storage medium capable of suppressing a sudden change in brightness between a plurality of frames obtained by imaging with an imaging device due to switching of the transmittance of an electronic neutral density filter.

[0015] A second embodiment of the present disclosure provides a control device, an imaging device, a control method, and a storage medium capable of maintaining constant brightness of a plurality of frames obtained by imaging using an imaging device even while the aperture is driven.

[0016] The third embodiment of the present disclosure provides a control device, a shooting device, a control method and a storage medium that are capable of suppressing abrupt changes in brightness between multiple frames in a process of causing the exposure of multiple frames obtained by shooting a shooting device during a period of switching from one state in which an electronic ND filter mounted on the shooting device is used and the other state in which the electronic ND filter is not used to reach a target exposure.

[0017] Means for solving problems

[0018] In a first embodiment of the present disclosure, the first method of the present disclosure is a control device including a processor, wherein the processor obtains a plurality of split exposures determined by a change time required for a second transmittance change based on a target exposure and a target exposure of a shooting device, and performs control for applying the plurality of split exposures to at least a plurality of frames of exposure obtained by shooting based on the shooting device within the change time, wherein the change time is the time required for the transmittance of an electronic neutral density filter mounted on the shooting device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

[0019] In the first embodiment of the present disclosure, the second embodiment of the present disclosure is a control device of the first embodiment, multiple frames are obtained by shooting based on a predetermined frame rate, the number of multiple frames is determined based on the change time and the predetermined frame rate, and multiple split exposures are determined based on the target exposure and the number.

[0020] In the first embodiment of the present disclosure, the third embodiment of the present disclosure is a control device of the first embodiment or the second embodiment, wherein when the change time exceeds the first threshold value, the split exposure of the process of changing from the first transmittance to the second transmittance in a plurality of split exposures is adjusted based on a plurality of ideal transmittances and a plurality of first actual transmittances, wherein the plurality of ideal transmittances determine the process of ideally changing from the first transmittance to the second transmittance when the change time is less than the first threshold value, and the plurality of first actual transmittances determine the process of actually changing from the first transmittance to the second transmittance when the change time is less than the first threshold value.

[0021] In the first embodiment of the present disclosure, a fourth aspect of the present disclosure is the control device of the third aspect, wherein the first threshold value is a value determined based on an ideal waiting time until the light transmittance changes from the first light transmittance to the second light transmittance.

[0022] In the first embodiment of the present disclosure, the fifth embodiment of the present disclosure is a control device of the third embodiment or the fourth embodiment, which determines, between the first transmittance and the second transmittance, a third transmittance so that the change time is below the first threshold value when the change time exceeds the first threshold value, and multiple first actual transmittances are determined based on the first transmittance and the third transmittance.

[0023] In the first embodiment of the present disclosure, the sixth embodiment of the present disclosure is a control device of the fifth embodiment, wherein the first threshold value is a value greater than the value set at the current time point when the change time exceeds the first threshold value and the number of times the difference between the first transmittance and the second transmittance converges to a predetermined range continues for a predetermined number of times.

[0024] In the first embodiment of the present disclosure, the seventh embodiment of the present disclosure is a control device of the sixth embodiment, wherein the first threshold value is a value determined based on multiple change times obtained within the prescribed number of times when the change time exceeds the first threshold value and the number of times the difference converges to a state within a predetermined range continues for a prescribed number of times.

[0025] In the first embodiment of the present disclosure, the eighth embodiment of the present disclosure is a control device of the fifth embodiment, which maintains multiple split exposures when the change time exceeds the first threshold and the number of times the difference between the first transmittance and the second transmittance converges to a predetermined range continues for a specified number of times.

[0026] In the first embodiment of the present disclosure, the ninth embodiment of the present disclosure is a control device of any one of the fifth to eighth embodiments, wherein a plurality of first actual transmittances are determined to be a process of changing from a first transmittance to a second transmittance when a change time is less than a first threshold and the transmittance changes from the first transmittance to the second transmittance through a third transmittance.

[0027] In the first embodiment of the present disclosure, the tenth embodiment of the present disclosure is a control device of any one of the fifth to ninth embodiments, wherein when the change time exceeds the first threshold value and the maximum difference between multiple ideal transmittances and multiple first actual transmittances, i.e., the first maximum difference, exceeds a predetermined difference, the split exposure of the process of changing from the first transmittance to the second transmittance in the multiple split exposures is adjusted based on the multiple ideal transmittances and the multiple second actual transmittances, and the multiple second actual transmittances determine the process of changing from the first transmittance to the second transmittance through multiple intermediate transmittances with the change time being less than the first threshold value, and the maximum difference between the multiple intermediate transmittances and the multiple ideal transmittances, i.e., the second maximum difference, is smaller than the first maximum difference.

[0028] In the first embodiment of the present disclosure, the eleventh embodiment of the present disclosure is a control device of the tenth embodiment. When the first maximum difference exceeds the predetermined difference and the time required to change from the first transmittance to the third transmittance, that is, the transmittance change time, is less than the second threshold, the split exposure of the process of changing from the first transmittance to the second transmittance in multiple split exposures is adjusted based on multiple ideal transmittances and multiple second actual transmittances.

[0029] In the first embodiment of the present disclosure, the twelfth mode of the present disclosure is a control device of any one of the third to eleventh modes, and the adjustment of the split exposure in the process of changing from a first transmittance to a second transmittance in multiple split exposures is achieved by adjusting at least one of the multiple exposure factors defining the split exposure based on the difference between the ideal transmittance and the first actual transmittance.

[0030] In the first embodiment of the present disclosure, a thirteenth aspect of the present disclosure is a control device according to any one of the third to twelfth aspects, wherein the transmittance when the change time is equal to or less than the first threshold value changes based on a plurality of ideal transmittances.

[0031] In the first embodiment of the present disclosure, a fourteenth aspect of the present disclosure is a control device according to any one of the third to thirteenth aspects, wherein when the variation time is equal to or less than the first threshold value, the plurality of divided exposures correspond to the plurality of ideal transmittances.

[0032] In the first embodiment of the present disclosure, a fifteenth aspect of the present disclosure is the control device of any one of the third to fourteenth aspects, wherein the plurality of ideal light transmittances monotonically change between the first light transmittance and the second light transmittance.

[0033] In the first embodiment of the present disclosure, the sixteenth embodiment of the present disclosure is a control device of any one of the third to fifteenth embodiments, wherein when the change time is below the first threshold, multiple split exposures change monotonically from the split exposure corresponding to the first transmittance to the target exposure.

[0034] In the first embodiment of the present disclosure, the seventeenth embodiment of the present disclosure is a control device of any one of the third to sixteenth embodiments, the shooting device has a movable aperture, and the first threshold value when the driving time of the aperture when driving the aperture to achieve target exposure exceeds the first threshold value is a value greater than the driving time.

[0035] In the first embodiment of the present disclosure, an eighteenth aspect of the present disclosure is a photographing device including the control device of any one of the first to seventeenth aspects; and an image sensor for photographing.

[0036] In the first embodiment of the present disclosure, the nineteenth embodiment of the present disclosure is a control method, comprising: obtaining a plurality of split exposures determined based on a varying time and a target exposure of a shooting device; and performing control to apply the plurality of split exposures to at least the exposure of a plurality of frames obtained by shooting based on the shooting device within the varying time, wherein the varying time is the time required for the transmittance of an electronic neutral density filter mounted on the shooting device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

[0037] In the first embodiment of the present disclosure, the twentieth embodiment of the present disclosure is a program for causing a computer to perform processing, the processing including: obtaining a plurality of split exposures determined based on a varying time and a target exposure of a shooting device; and performing control to apply the plurality of split exposures to at least the exposure of a plurality of frames obtained by shooting based on the shooting device within the varying time, wherein the varying time is the time required for the transmittance of an electronic neutral density filter mounted on the shooting device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

[0038] In a second embodiment of the present disclosure, the first embodiment of the present disclosure is a control device comprising a processor, which controls the exposure of multiple frames obtained by shooting based on the shooting device based on the transmittance of an electronic neutral density filter mounted on a shooting device with a movable aperture and the driving time of the aperture.

[0039] In a second embodiment of the present disclosure, the second mode of the present disclosure is a control device of the first mode, and the processor controls the exposure of multiple frames by applying multiple split exposures determined by the relationship between the change time required for the transmittance to change from a first transmittance to a second transmittance that can achieve the target exposure of the shooting device and the driving time of the aperture to the exposure of multiple frames.

[0040] In the second embodiment of the present disclosure, the third embodiment of the present disclosure is a control device of the second embodiment, which performs a first control when the change time and the drive time exceed a first threshold value. The first control is a control in which the change time is set to be within the drive time, and a plurality of first split exposures determined based on the actual change time from the first transmittance to the second transmittance, i.e., the actual change time and the drive time, are used as a plurality of split exposures for exposure control of a plurality of frames.

[0041] In the second embodiment of the present disclosure, the fourth mode of the present disclosure is a control device of the second mode or the third mode, which performs a second control when the change time and / or the driving time is below the first threshold value. The second control is to use multiple second split exposures determined based on the ideal change time from the first transmittance to the second transmittance, that is, the ideal change time and the driving time, as multiple split exposures to control the exposure of multiple frames.

[0042] In the second embodiment of the present disclosure, the fifth embodiment of the present disclosure is a control device of the second embodiment, which performs a first control when the difference between the change time and the drive time exceeds a second threshold value. The first control is a control in which the change time is set to be within the drive time, and a plurality of first split exposures determined based on the actual change time from the first transmittance to the second transmittance, i.e., the actual change time and the drive time, are used as a plurality of split exposures for exposure control of a plurality of frames.

[0043] In the second embodiment of the present disclosure, the sixth embodiment of the present disclosure is a control device of the second embodiment or the fifth embodiment, which performs a second control when the difference between the change time and the drive time is below the second threshold value. The second control is to use multiple second split exposures determined based on the ideal change time from the first transmittance to the second transmittance, that is, the ideal change time and the drive time, as multiple split exposures to control the exposure of multiple frames.

[0044] In the second embodiment of the present disclosure, the seventh embodiment of the present disclosure is a control device of any one of the third to sixth embodiments, and multiple first split exposures are determined based on the number of frames and the target exposure, and the number of frames is determined based on the number of frames corresponding to the actual change time, i.e., the first number of frames, and the number of frames corresponding to the driving time, i.e., the second number of frames.

[0045] In the second embodiment of the present disclosure, the eighth embodiment of the present disclosure is a control device of the seventh embodiment, and multiple first split exposures are determined based on multiple first actual transmittances that determine the actual change process from the first transmittance to the second transmittance within the actual change time, the aperture value of the aperture, and the sensitivity and / or shutter speed set for the shooting device corresponding to the target exposure.

[0046] In the second embodiment of the present disclosure, the ninth embodiment of the present disclosure is a control device of the eighth embodiment. When the change time and the driving time exceed the third threshold value, it is decided between the first transmittance and the second transmittance to set the change time to the third transmittance within the driving time, and multiple first actual transmittances are determined based on the first transmittance and the third transmittance.

[0047] In the second embodiment of the present disclosure, the tenth embodiment of the present disclosure is a control device of the eighth embodiment. When the difference between the change time and the driving time exceeds a fourth threshold, it is decided to set the change time to the third transmittance within the driving time between the first transmittance and the second transmittance, and multiple first actual transmittances are determined based on the first transmittance and the third transmittance.

[0048] In the second embodiment of the present disclosure, the eleventh embodiment of the present disclosure is a control device of the fourth embodiment or the sixth embodiment, and multiple second split exposures are determined based on the number of frames and the target exposure, and the number of frames is determined based on the number of frames corresponding to the ideal change time, i.e., the third number of frames, and the number of frames corresponding to the driving time, i.e., the fourth number of frames.

[0049] In the second embodiment of the present disclosure, the twelfth embodiment of the present disclosure is a control device of the eleventh embodiment, and multiple second split exposures are determined based on multiple ideal transmittances that determine the process of ideally changing from the first transmittance to the second transmittance within the ideal change time, the aperture value of the aperture, and the sensitivity and / or shutter speed set for the shooting device corresponding to the target exposure.

[0050] In the second embodiment of the present disclosure, the thirteenth mode of the present disclosure is a control device of any one of the second to twelfth modes, and when the change time and the driving time exceed the fifth threshold value, and the difference between the fourth transmittance and the second transmittance so that the change time is within the driving time, that is, the first difference, exceeds the predetermined difference, the split exposure of the process of changing from the first transmittance to the second transmittance in multiple split exposures is determined based on multiple second actual transmittances of the process in which the change time changes from the first transmittance through multiple intermediate transmittances to the second transmittance within the driving time, and the maximum difference between the multiple intermediate transmittances and the second transmittance, that is, the maximum difference, is less than the first difference.

[0051] In the second embodiment of the present disclosure, the fourteenth embodiment of the present disclosure is a control device of any one of the second to twelfth embodiments, and when the difference between the change time and the driving time exceeds the sixth threshold value, and the change time is set to the difference between the fourth transmittance and the second transmittance within the driving time, that is, the first difference exceeds the predetermined difference, the split exposure of the process of changing from the first transmittance to the second transmittance in the multiple split exposures is determined based on the multiple second actual transmittances of the process in which the change time changes from the first transmittance through multiple intermediate transmittances to the second transmittance within the driving time, and the maximum difference between the multiple intermediate transmittances and the second transmittance, that is, the maximum difference, is less than the first difference.

[0052] In the second embodiment of the present disclosure, the fifteenth embodiment of the present disclosure is a control device of the thirteenth embodiment, in which when the change time and the driving time exceed the seventh threshold, the first difference exceeds the predetermined difference, and the time required to change from the first transmittance to the fourth transmittance, that is, the transmittance change time, is less than the eighth threshold, the split exposure of the process of changing from the first transmittance to the second transmittance in multiple split exposures is determined based on multiple second actual transmittances.

[0053] In the second embodiment of the present disclosure, the sixteenth embodiment of the present disclosure is a control device of the fourteenth embodiment, in which when the difference between the change time and the driving time exceeds the ninth threshold value, the first difference exceeds the predetermined difference, and the time required for the change from the first transmittance to the fourth transmittance, that is, the transmittance change time, is less than the tenth threshold value, the split exposure of the process of changing from the first transmittance to the second transmittance in the multiple split exposures is determined based on multiple second actual transmittances.

[0054] In the second embodiment of the present disclosure, the seventeenth embodiment of the present disclosure is a control device of the fifteenth or sixteenth embodiment, and multiple first split exposures are determined based on the frame number and the target exposure. The frame number is determined based on the fifth frame number, which is the number of frames required to change from the first transmittance through multiple second actual transmittances to the second transmittance, and the sixth frame number, which is the number of frames corresponding to the driving time.

[0055] In the second embodiment of the present disclosure, the eighteenth embodiment of the present disclosure is a control device of the seventeenth embodiment, and multiple first split exposures are determined based on multiple third actual transmittances of the process of changing from a first transmittance through multiple intermediate transmittances to a second transmittance within a driving time, the aperture value of the aperture, and the sensitivity and / or shutter speed set for the shooting device corresponding to the target exposure.

[0056] In the second embodiment of the present disclosure, the nineteenth embodiment of the present disclosure is a control device of any one of the second to eighteenth embodiments, and when the transmittance cannot follow the change of the aperture value of the aperture, the exposure of multiple frames is determined based on the first transmittance and the driving time.

[0057] In a second embodiment of the present disclosure, a twentieth aspect of the present disclosure is a control device according to any one of the second to nineteenth aspects, wherein, when the transmittance cannot follow a change in the aperture value of the diaphragm, and the change in the aperture value is less than a first predetermined change, the exposure of the plurality of frames is determined based on the first transmittance and the drive time.

[0058] In a second embodiment of the present disclosure, the twenty-first embodiment of the present disclosure is a control device of any one of the second to twentieth embodiments, which updates the exposure of the multiple frames by a method corresponding to the tracking of the transmittance with respect to the difference between the aperture value before the update and the aperture value after the update when the change in the aperture value caused by the update exceeds the second predetermined change during the control of the exposure of the multiple frames.

[0059] In the second embodiment of the present disclosure, a twenty-second aspect of the present disclosure is the control device according to any one of the first to twenty-first aspects, wherein the plurality of frames are obtained by capturing images at a predetermined frame rate.

[0060] In the second embodiment of the present disclosure, a twenty-third aspect of the present disclosure is a photographing device including the control device of any one of the first to twenty-second aspects; and an image sensor for photographing.

[0061] In the second embodiment of the present disclosure, the twenty-fourth embodiment of the present disclosure is a control method, comprising: controlling the exposure of multiple frames obtained by shooting based on the shooting device based on the transmittance of an electronic dimmer filter mounted on a shooting device with a movable aperture and the driving time of the aperture.

[0062] In the second embodiment of the present disclosure, the twenty-fifth embodiment of the present disclosure is a program for causing a computer to perform processing, the processing including: controlling the exposure of multiple frames obtained by shooting based on the shooting device based on the transmittance of an electronic dimmer filter mounted on a shooting device with a movable aperture and the driving time of the aperture.

[0063] In a third embodiment of the present disclosure, the first embodiment of the present disclosure is a control device including a processor, which, when switching from one state of use in which an electronic neutral density filter mounted on a photographing device is used and a state of non-use in which the electronic neutral density filter is not used, obtains a target exposure of the photographing device after switching, and controls the exposure of a plurality of frames obtained by photographing the photographing device within a switching time required for switching from at least one state to the other to change monotonically toward the target exposure.

[0064] In a third embodiment of the present disclosure, the second aspect of the present disclosure is the control device of the first aspect, and applies a plurality of split exposures determined based on a first number of frames corresponding to a switching time and a target exposure to exposure of a plurality of frames.

[0065] In the first or second embodiment of the present disclosure, a third aspect of the present disclosure is a control device according to the third aspect, wherein the plurality of divided exposures are monotonically changed in a sequence applied to exposures of the plurality of frames.

[0066] In the third embodiment of the present disclosure, the fourth mode of the present disclosure is a control device of the second mode or the third mode, and the split exposure is determined based on the target exposure, the exposure currently set for the shooting device, the ratio of the range of the electronic dimmer filter affected by the frame to the frame, and the remaining number of frames corresponding to the remaining time until the switching is completed.

[0067] In the third embodiment of the present disclosure, the fifth aspect of the present disclosure is a control device of any one of the second to fourth aspects, wherein the plurality of frames are obtained by shooting based on a predetermined frame rate, and the first number of frames is determined based on the switching time and the predetermined frame rate.

[0068] In the third embodiment of the present disclosure, the sixth embodiment of the present disclosure is a control device of any one of the second to fifth embodiments, which updates the target exposure when the change in brightness of the photographic object exceeds the reference change during the period in which multiple split exposures are sequentially applied to the exposure of multiple frames, and updates the multiple split exposures based on the second frame number corresponding to the remaining time until the switching is completed and the updated target exposure.

[0069] In the third embodiment of the present disclosure, the seventh embodiment of the present disclosure is a control device of any one of the second to sixth embodiments, which updates the target exposure when a change instruction to change the target exposure is given from the outside during the period when multiple split exposures are sequentially applied to the exposure of multiple frames, and updates the multiple split exposures based on the third frame number corresponding to the remaining time until the switching is completed and the updated target exposure.

[0070] In the third embodiment of the present disclosure, the eighth aspect of the present disclosure is a control device according to any one of the first to seventh aspects, which notifies or reports that the target exposure deviates from the exposure range when the target exposure deviates from the exposure range that can be followed by switching.

[0071] In the third embodiment of the present disclosure, the ninth embodiment of the present disclosure is a control device of any one of the first to eighth embodiments, which maintains the exposure currently set for the shooting device under the condition that a stop instruction for stopping the switching is given from the outside when the target exposure deviates from the exposure range that can be followed by switching.

[0072] In the third embodiment of the present disclosure, the tenth embodiment of the present disclosure is a control device of any one of the first to tenth embodiments, wherein when in use, the electronic dimming filter is inserted into the optical path of the shooting device, and when not in use, the electronic dimming filter is detached from the optical path.

[0073] In the third embodiment of the present disclosure, the eleventh embodiment of the present disclosure is a control device of the tenth embodiment, and the shooting device has a transparent filter having an optical path length equivalent to the optical path length of the electronic dimming filter, and the electronic dimming filter and the transparent filter are selectively inserted and removed from the optical path. In the use state, the electronic dimming filter is inserted into the optical path, and the transparent filter is detached from the optical path. In the non-use state, the transparent filter is inserted into the optical path, and the electronic dimming filter is detached from the optical path.

[0074] In the third embodiment of the present disclosure, a twelfth aspect of the present disclosure is an imaging device including the control device according to any one of the first to eleventh aspects; and an image sensor for imaging.

[0075] In the third embodiment of the present disclosure, the thirteenth embodiment of the present disclosure is a control method, comprising: obtaining a target exposure of the shooting device after switching from one to the other of a use state in which an electronic dimming filter mounted on the shooting device is used and a non-use state in which the electronic dimming filter is not used; and controlling the exposure of multiple frames obtained by shooting by the shooting device within a switching time required for switching from at least one side to the other to change monotonically to the target exposure.

[0076] In the third embodiment of the present disclosure, the fourteenth embodiment of the present disclosure is a program for causing a computer to perform processing, wherein the processing includes obtaining a target exposure of the shooting device after switching from one to the other of a use state in which an electronic neutral density filter mounted on the shooting device is used and a non-use state in which the electronic neutral density filter is not used; and controlling the exposure of multiple frames obtained by shooting by the shooting device within a switching time required for switching from at least one side to the other to change monotonically to the target exposure. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] Figure 1 This is a schematic configuration diagram showing an example of the overall configuration of the imaging device.

[0078] Figure 2 This is a schematic configuration diagram showing an example of the hardware configuration of the optical system and electrical system of the imaging device.

[0079] Figure 3 This is a conceptual diagram showing an example of a method of monotonically changing the brightness of a frame by changing the transmittance of an electronic ND filter within a target number of frames.

[0080] Figure 4 This is a conceptual diagram showing an example of a method in which the transmittance of the electronic ND filter is changed to achieve a target exposure, but the target exposure cannot be achieved within the target frame number (i.e., the transmittance of the electronic ND filter is not changed in time before the target frame number is reached).

[0081] Figure 5 This is a block diagram showing an example of how the system controller operates.

[0082] Figure 6 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0083] Figure 7 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0084] Figure 8 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0085] Figure 9 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0086] Figure 10 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0087] Figure 11AThis is a flowchart showing an example of the flow of the exposure control process according to the first embodiment.

[0088] Figure 11B yes Figure 11A Continuation of the flowchart shown.

[0089] Figure 12A This is a flowchart showing an example of the flow of the exposure control process according to the second embodiment.

[0090] Figure 12B yes Figure 12A Continuation of the flowchart shown.

[0091] Figure 12C yes Figure 12A Continuation of the flowchart shown.

[0092] Figure 13A This is a flowchart showing an example of the flow of exposure control processing according to the third embodiment.

[0093] Figure 13B yes Figure 13B Continuation of the flowchart shown.

[0094] Figure 14A This is a flowchart showing an example of the flow of exposure control processing according to the fourth embodiment.

[0095] Figure 14B yes Figure 14A Continuation of the flowchart shown.

[0096] Figure 14C yes Figure 14B Continuation of the flowchart shown.

[0097] Figure 14D yes Figure 14B as well as Figure 14C Continuation of the flowchart shown.

[0098] Figure 15 This is a conceptual diagram showing an example of a portion of the processing content of the exposure control processing according to the fourth embodiment performed by the processor.

[0099] Figure 16 This is a flowchart showing an example of the flow of exposure control processing according to the fifth embodiment.

[0100] Figure 17 This is a conceptual diagram showing an example of changes in transmittance and aperture value when the current aperture value is changed toward the target aperture value until the target number of frames is reached and the brightness of a plurality of frames is kept constant.

[0101] Figure 18This is a conceptual diagram showing an example of changes in transmittance and aperture value when the transmittance of the electronic ND filter is changed but the change in transmittance of the electronic ND filter is insufficient before the target frame number is reached.

[0102] Figure 19 This is a block diagram showing an example of how the system controller operates.

[0103] Figure 20 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is fixed.

[0104] Figure 21 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is fixed.

[0105] Figure 22 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is fixed.

[0106] Figure 23 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is fixed.

[0107] Figure 24 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is fixed.

[0108] Figure 25 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is changed and the electronic ND filter cannot follow the amount of change in the aperture value.

[0109] Figure 26 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is changed and the electronic ND filter cannot follow the amount of change in the aperture value.

[0110] Figure 27 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is changed and the electronic ND filter cannot follow the amount of change in the aperture value.

[0111] Figure 28 This is a conceptual diagram showing an example of a portion of the exposure control processing performed by the processor when the aperture value is changed and the electronic ND filter can follow the amount of change in the aperture value.

[0112] Figure 29This is a conceptual diagram showing an example of conditions for performing the first control or the second control when the aperture value is changed and the electronic ND filter can follow the amount of change in the aperture value.

[0113] Figure 30 This is a conceptual diagram showing an example of the content of the first control.

[0114] Figure 31 This is a conceptual diagram showing an example of the content of the first control.

[0115] Figure 32 This is a conceptual diagram showing an example of the content of the first control.

[0116] Figure 33 This is a conceptual diagram showing an example of the content of the first control.

[0117] Figure 34 This is a conceptual diagram showing an example of the content of the first control.

[0118] Figure 35 This is a conceptual diagram showing an example of the content of the second control.

[0119] Figure 36 This is a conceptual diagram showing an example of the content of the second control.

[0120] Figure 37 This is a conceptual diagram showing an example of the content of the second control.

[0121] Figure 38 This is a conceptual diagram showing an example of the content of the second control.

[0122] Figure 39 This is a conceptual diagram showing an example of the content of the second control.

[0123] Figure 40A This is a flowchart showing an example of the flow of exposure control processing according to the seventh embodiment.

[0124] Figure 40B yes Figure 40A Continuation of the flowchart shown.

[0125] Figure 40C yes Figure 40B Continuation of the flowchart shown.

[0126] Figure 40D yes Figure 40A Continuation of the flowchart shown.

[0127] Figure 40E yes Figure 40A Continuation of the flowchart shown.

[0128] Figure 40F yes Figure 40EContinuation of the flowchart shown.

[0129] Figure 40G yes Figure 40E Continuation of the flowchart shown.

[0130] Figure 41 This is a flowchart showing an example of the flow of exposure control processing according to the eighth embodiment.

[0131] Figure 42A This is a flowchart showing an example of the flow of exposure control processing according to the ninth embodiment.

[0132] Figure 42B yes Figure 42A Continuation of the flowchart shown.

[0133] Figure 42C This is a flowchart showing an example of the flow of exposure control processing according to the ninth embodiment.

[0134] Figure 42D yes Figure 42C Continuation of the flowchart shown.

[0135] Figure 42E This is a flowchart showing an example of the flow of exposure control processing according to the ninth embodiment.

[0136] Figure 42F yes Figure 42E Continuation of the flowchart shown.

[0137] Figure 43A This is a flowchart showing an example of the flow of exposure control processing according to the tenth embodiment.

[0138] Figure 43B yes Figure 43A Continuation of the flowchart shown.

[0139] Figure 43C yes Figure 43A Continuation of the flowchart shown.

[0140] Figure 44 This is a conceptual diagram showing an example of how a plurality of predicted light transmittances including a plurality of intermediate light transmittances change.

[0141] Figure 45 This is a flowchart showing a modified example of the exposure control processing flow in each embodiment.

[0142] Figure 46 This is a conceptual diagram showing an example of how the ND area changes.

[0143] Figure 47 This is a block diagram showing an example of how the system controller operates.

[0144] Figure 48 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0145] Figure 49 This is a conceptual diagram showing an example of a part of the processing content of the exposure control processing performed by the processor.

[0146] Figure 50 This is a flowchart showing an example of the flow of exposure control processing according to the eleventh embodiment.

[0147] Figure 51 This is a conceptual diagram showing an example of a method of calculating and setting multiple divided exposures applied to exposure of frames from the zeroth frame to the fifth frame included in a plurality of frames obtained by performing live view image shooting.

[0148] Figure 52A This is a flowchart showing an example of the flow of exposure control processing according to the twelfth embodiment.

[0149] Figure 52B yes Figure 52A Continuation of the flowchart shown.

[0150] Figure 53A This is a flowchart showing an example of exposure control processing according to the thirteenth embodiment.

[0151] Figure 53B yes Figure 53A Continuation of the flowchart shown.

[0152] Figure 54A This is a flowchart showing an example of exposure control processing according to the fourteenth embodiment.

[0153] Figure 54B yes Figure 54A Continuation of the flowchart shown.

[0154] Figure 54C yes Figure 54B Continuation of the flowchart shown.

[0155] Figure 55 This is a flowchart showing an example of exposure control processing according to the fifteenth embodiment. DETAILED DESCRIPTION

[0156] Hereinafter, an example of an embodiment of a control device, an imaging device, a control method, and a storage medium according to the present disclosure will be described with reference to the accompanying drawings.

[0157] The first embodiment of the present disclosure provides a control device, an imaging device, a control method, and a storage medium capable of suppressing abrupt changes in brightness between multiple frames captured by an imaging device due to switching of the transmittance of an electronic neutral density filter. These embodiments are described below using the first to sixth embodiments as examples. Furthermore, the second embodiment of the present disclosure provides a control device, an imaging device, a control method, and a storage medium capable of maintaining a constant brightness across multiple frames captured by an imaging device even while the aperture is being driven. These embodiments are described below using the seventh to tenth embodiments as examples. Furthermore, the third embodiment of the present disclosure provides a control device, an imaging device, a control method, and a storage medium capable of suppressing abrupt changes in brightness across multiple frames captured by the imaging device while switching between a state in which an electronic neutral density filter is used and a state in which the electronic neutral density filter is not used. These embodiments are described below using the eleventh to fifteenth embodiments as examples.

[0158] First, the terms used in the following description are explained.

[0159] CPU stands for Central Processing Unit. GPU stands for Graphics Processing Unit. GPGPU stands for General-purpose computing on graphics processing units. APU stands for Accelerated Processing Unit. TPU stands for Tensor processing unit. NVM stands for Non-volatile memory. RAM stands for Random Access Memory. IC stands for Integrated Circuit. ASIC stands for Application Specific Integrated Circuit. PLD stands for Programmable Logic Device. FPGA stands for Field-Programmable Gate Array. SoC stands for System-on-a-chip. SSD stands for "Solid State Drive." USB stands for "Universal Serial Bus." EEPROM stands for "Electrically Erasable and Programmable Read Only Memory." I / F stands for "Interface." UI stands for "User Interface." CMOS stands for "Complementary Metal Oxide Semiconductor." CCD stands for "Charge Coupled Device." fps stands for "Frame per second." MF stands for "Manual focus." AF stands for "Auto focus." AE stands for "Auto Exposure."ND stands for “Neutral Density.” EL stands for “Electro Luminescence.”

[0160] In the following description, a processor (hereinafter referred to as a "processor") may be a single physical or virtual computing device, or a combination of multiple physical or virtual computing devices. Furthermore, a processor may be a single computing device, or a combination of multiple computing devices. Examples of computing devices include a CPU, GPU, GPGPU, APU, or TPU.

[0161] In the following description, the term "memory" is a memory such as RAM that temporarily stores information and is used as a working memory by a processor.

[0162] In the following description, the symbol "storage" refers to one or more nonvolatile storage devices that store various programs and parameters. Examples of nonvolatile storage devices include flash memory, magnetic disks, and magnetic tapes. Another example of storage is cloud storage.

[0163] In the following embodiments, the symbolized external I / F is responsible for sending and receiving various information between multiple interconnected devices. An example of an external I / F is a USB interface. A communication I / F including a communication processor and an antenna, etc., can be applied to the external I / F. The communication I / F is responsible for communication between multiple computers. Examples of communication standards applicable to the communication I / F include wireless communication standards such as 5G, Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0164] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" may mean only A, only B, or a combination of A and B. Furthermore, in this specification, even when three or more items are linked together using "and / or," the same concept as "A and / or B" applies.

[0165] [First embodiment]

[0166] As an example, Figure 1As shown, the imaging device 10 is a device for imaging a subject, and includes a system controller 12, an imaging device body 16, and an interchangeable lens 18. The imaging device 10 is an example of a "photographic device" in the present disclosure, and the system controller 12 is an example of a "control device" and a "computer" in the present disclosure. The system controller 12 is built into the imaging device body 16 and controls the entire imaging device 10. The interchangeable lens 18 is interchangeably mounted on the imaging device body 16. A focus ring 18A is provided on the interchangeable lens 18. The focus ring 18A is operated by a user of the imaging device 10 (hereinafter referred to as a "user") or the like when the user manually adjusts the focus of the imaging device 10 on the subject.

[0167] exist Figure 1 In the example shown, a digital camera with an interchangeable lens is shown as an example of the imaging device 10. However, this is merely an example; a digital camera with a fixed lens may also be used. Furthermore, the present disclosure is also applicable to smart devices, wearable devices, movie cameras, television cameras, surveillance cameras, endoscopes, cell observation devices, ophthalmic observation devices, surgical microscopes, and the like. Smart devices, wearable devices, movie cameras, television cameras, surveillance cameras, endoscopes, cell observation devices, ophthalmic observation devices, surgical microscopes, and the like are examples of "imaging devices" in the present disclosure.

[0168] The camera body 16 is provided with an image sensor 20. The image sensor 20 is an example of an "image sensor" in the present disclosure. The image sensor 20 is a CMOS image sensor. The image sensor 20 captures an image of a subject. When the interchangeable lens 18 is attached to the camera body 16, subject light, representing the subject, passes through the interchangeable lens 18 and is formed on the image sensor 20. The image sensor 20 then generates image data representing the image of the subject.

[0169] In the first embodiment, a CMOS image sensor is exemplified as the image sensor 20 , but the present disclosure is not limited thereto. For example, the present disclosure is also applicable even if the image sensor 20 is another type of image sensor such as a CCD image sensor.

[0170] A release button 22 and a dial 24 are provided on the upper surface of the camera body 16. The dial 24 is operated when setting the action mode of the camera system and the action mode of the playback system, and by operating the dial 24, the camera mode, playback mode, and setting mode are selectively set as the action mode in the camera 10. The camera mode is an action mode in which the camera 10 performs shooting. Shooting is achieved by operating a mechanical shutter (not shown) and / or an electronic shutter (not shown). The playback mode is an action mode in which an image (for example, a still image and / or a moving image) obtained by shooting for recording in the camera mode is reproduced. The setting mode is an action mode set for the camera 10 when setting various setting values ​​used in controls associated with shooting.

[0171] The release button 22 functions as both a shooting preparation indicator and a shooting indicator, and is capable of detecting a press operation in two stages: a shooting preparation indicator state and a shooting indicator state. The shooting preparation indicator state refers to, for example, a state in which the button is pressed from the standby position to an intermediate position (e.g., a half-pressed position), while the shooting indicator state refers to a state in which the button is pressed to a final position (e.g., a fully pressed position) beyond the intermediate position. Due to the configuration of the camera 10, the shooting preparation indicator state can be a state in which the user's finger is in contact with the release button 22, and the shooting indicator state can be a state in which the user's finger performing the operation has transitioned from contact with the release button 22 to release.

[0172] On the back surface of the imaging device body 16 , a pointer key 26 and a touch panel display 32 are provided.

[0173] The touch panel display 32 includes a display 28 and a touch panel 30 (see also Figure 2 As an example of the display 28, an EL display (for example, an organic EL display or an inorganic EL display) is cited. The display 28 may not be an EL display but may be another type of display such as a liquid crystal display.

[0174] The display 28 displays images and / or text information, etc. When the camera 10 is in the shooting mode, the display 28 is used for shooting live view images, that is, for displaying live view images obtained by continuous shooting. Here, "live view images" refer to dynamic images for display based on image data obtained by shooting by the image sensor 20. Shooting to obtain live view images (hereinafter also referred to as "shooting for live view images") is performed, for example, based on a frame rate of 60fps. 60fps is just an example, and the frame rate can be less than 60fps (for example, 30fps) or more than 60fps (for example, 180fps).

[0175] The display 28 is also used to display a still image obtained by performing still image capture when the camera 10 is instructed to capture a still image via the release button 22. Furthermore, the display 28 is also used to display, for example, a reproduced image when the camera 10 is in playback mode. Furthermore, when the camera 10 is in setup mode, the display 28 is also used to display a menu screen for selecting various menus and a setup screen for setting various setting values ​​used in control related to capture.

[0176] The touch panel 30 is a light-transmitting touch panel and overlaps the surface of the display area of ​​the display 28. The touch panel 30 receives instructions from the user (e.g., shooting preparation instructions and / or shooting instructions) by sensing contact with a pointer such as a finger or a stylus.

[0177] In the first embodiment, an external touch panel display in which the touch panel 30 overlaps the surface of the display area of ​​the display 28 is used as an example of the touch panel display 32. However, this is merely an example. For example, an on-cell or in-cell touch panel display may also be used as the touch panel display 32.

[0178] The instruction keys 26 accept various instructions. Here, "various instructions" include, for example, instructions for displaying a menu screen, instructions for selecting one or more menus, instructions for confirming selected content, instructions for deleting selected content, instructions for zooming in, zooming out, and frame-by-frame playback. These instructions can also be made via the touch panel 30.

[0179] As an example, Figure 2 As shown, the image sensor 20 includes a photoelectric conversion element 72. The photoelectric conversion element 72 has a light receiving surface 72A. The photoelectric conversion element 72 is arranged in the imaging device body 16 so that the center of the light receiving surface 72A coincides with the optical axis OA (see also FIG. Figure 1 The photoelectric conversion element 72 includes a plurality of photosensitive pixels arranged in a matrix, and the light receiving surface 72A is formed by the plurality of photosensitive pixels. Each photosensitive pixel includes a microlens (not shown). Each photosensitive pixel is a physical pixel having a photodiode (not shown), which performs photoelectric conversion on received light and outputs an electrical signal corresponding to the amount of light received.

[0180] In addition, in multiple photosensitive pixels, red (R), green (G) or blue (B) color filters (not shown) are arranged in a matrix in a predetermined pattern array (for example, a Bayer array, a G-strip R / G full checkerboard, an X-Trans (registered trademark) array or a honeycomb array, etc.).

[0181] The interchangeable lens 18 includes a photographing lens 40. The photographing lens 40 includes an objective lens 40A, a zoom lens 40B, and a movable aperture 40C. The movable aperture 40C is an example of a "movable aperture" in the present disclosure.

[0182] The objective lens 40A, the variator lens 40B, and the diaphragm 40C are arranged in this order along the optical axis OA from the subject side (object side) to the imaging device body 16 side (image side).

[0183] The interchangeable lens 18 also includes a control device 36, a first actuator 37, and a second actuator 38. The control device 36 controls the entire interchangeable lens 18 in accordance with instructions from the imaging device body 16. The control device 36 is, for example, a computer comprising a CPU, NVM, and RAM. The RAM of the control device 36 temporarily stores various information and serves as working memory. In the control device 36, the CPU reads necessary programs from the NVM and controls the entire imaging lens 40 by executing the programs read from the RAM.

[0184] Here, a computer is used as an example of the control device 36. However, this is merely an example, and devices including ASICs, FPGAs, and / or PLDs may also be used. Furthermore, the control device 36 may be implemented using a combination of hardware and software configurations.

[0185] The first actuator 37 includes a zoom sliding mechanism (not shown) and a zoom motor (not shown). The zoom sliding mechanism is mounted with a zoom lens 40B that can slide along the optical axis OA. Furthermore, the zoom sliding mechanism is connected to the zoom motor, and the zoom sliding mechanism receives power from the zoom motor to operate, thereby moving the zoom lens 40B along the optical axis OA.

[0186] The second actuator 38 includes a power transmission mechanism (not shown) and an aperture motor (not shown). The aperture 40C has an opening 40C1, and the size of the opening 40C1 is variable. For example, the opening 40C1 is formed by a plurality of aperture blades 40C2. The plurality of aperture blades 40C2 are connected to the power transmission mechanism. In addition, the aperture motor is connected to the power transmission mechanism, and the power transmission mechanism transmits the power of the aperture motor to the plurality of aperture blades 40C2. The plurality of aperture blades 40C2 are moved by the power transmitted from the power transmission mechanism, thereby changing the size of the opening 40C1. The aperture 40C adjusts the exposure by changing the size of the opening 40C1.

[0187] The magnification motor and the aperture motor are connected to the control device 36, and the control device 36 controls the driving of the magnification motor and the aperture motor. In addition, in this first embodiment, a stepping motor is used as an example of the magnification motor and the aperture motor. Therefore, the magnification motor and the aperture motor operate in synchronization with the pulse signal according to the command from the control device 36. In addition, here, an example is shown in which the magnification motor and the aperture motor are provided in the interchangeable lens 18, but this is just an example, and at least one of the magnification motor and the aperture motor may also be provided in the shooting device body 16. The structure and / or operation method of the interchangeable lens 18 can be changed as needed.

[0188] In the imaging device 10, in the imaging mode, the MF mode and the AF mode are selectively set according to instructions given to the imaging device body 16. The MF mode is a manual focus operation mode. In the MF mode, for example, when the user operates the focus ring 18A, the zoom lens 40B moves along the optical axis OA by an amount corresponding to the amount of operation of the focus ring 18A, thereby adjusting the focus.

[0189] In AF mode, the camera body 16 calculates a focus position corresponding to the subject distance and moves the variator lens 40B to the calculated focus position to adjust the focus. Here, the focus position refers to the position of the variator lens 40B on the optical axis OA in the focused state.

[0190] In the imaging mode, the imaging device 10 selectively sets the manual exposure mode and the AE mode according to the instruction given to the imaging device body 16. The manual exposure mode is an operation mode for manually adjusting the exposure, and the AE mode is an operation mode for automatically setting the exposure.

[0191] The imaging device body 16 includes an image sensor 20, a system controller 12, an image memory 46, a UI device 48, an external I / F 50, a photoelectric conversion element driver 54, an ND filter driver 55, a motor driver 56, and an input / output interface 70. Furthermore, the image sensor 20 includes a photoelectric conversion element 72 and an A / D converter 74.

[0192] The system controller 12, image memory 46, UI device 48, external I / F 50, photoelectric converter driver 54, ND filter driver 55, motor driver 56, and A / D converter 74 are connected to the input / output interface 70. Furthermore, the control device 36 for the interchangeable lens 18 is also connected to the input / output interface 70.

[0193] The system controller 12 includes a processor 64, a storage 66, and a memory 68. Here, the processor 64 is an example of a "processor" in the present disclosure.

[0194] The processor 64, the storage 66, and the memory 68 are connected via a bus 75, and the bus 75 is connected to the input / output interface 70. Figure 2 In the example shown, for ease of illustration, one bus is shown as the bus 75, but multiple buses may be used. The bus 75 may be a serial bus or a parallel bus including a data bus, an address bus, and a control bus.

[0195] The memory 66 is a non-transitory storage medium that can be read by a computer and stores various parameters and various programs. The various programs include the exposure control processing program PG described later (see Figure 5 ). An example of the storage 66 is an EEPROM. The memory 68 temporarily stores various information and is used as a working memory. An example of the memory 68 is a RAM.

[0196] The processor 64 reads out a necessary program from the storage 66 and executes the read program in the memory 68. The processor 64 controls the entire imaging device 10 according to the program executed in the memory 68. Figure 2 In the illustrated example, the image memory 46 , the UI device 48 , the external I / F 50 , the photoelectric converter driver 54 , the ND filter driver 55 , the motor driver 56 , the control unit 36 ​​, and the like are controlled by the system controller 12 .

[0197] The photoelectric conversion element 72 is connected to the photoelectric conversion element driver 54. The photoelectric conversion element driver 54 supplies a shooting timing signal that specifies the timing of shooting by the photoelectric conversion element 72 to the photoelectric conversion element 72 in accordance with an instruction from the processor 64. The photoelectric conversion element 72 performs reset, exposure, and output of an electrical signal in accordance with the shooting timing signal supplied from the photoelectric conversion element driver 54. Examples of the shooting timing signal include a vertical synchronization signal and a horizontal synchronization signal.

[0198] When the interchangeable lens 18 is attached to the camera body 16, subject light incident on the taking lens 40 is formed on the light-receiving surface 72A by the taking lens 40. Under the control of the photoelectric conversion element driver 54, the photoelectric conversion element 72 performs photoelectric conversion on the subject light received by the light-receiving surface 72A, and outputs an electrical signal corresponding to the light intensity of the subject light as analog image data representing the subject light to the A / D converter 74. Specifically, the A / D converter 74 reads the analog image data from the photoelectric conversion element 72 in units of one frame and for each horizontal line using an exposure-sequential readout method.

[0199] The A / D converter 74 digitizes the analog image data to generate a RAW image 79. The RAW image 79 is an image in which R pixels, G pixels, and B pixels are arranged in a mosaic pattern.

[0200] The processor 64 acquires the RAW image 79 from the A / D converter 74 and performs image processing on the acquired RAW image 79 .

[0201] The frame 80 is stored in the image memory 46 . The frame 80 is an image obtained by performing image processing on the RAW image 79 by the processor 64 .

[0202] The UI device 48 includes a display 28, and the processor 64 causes the display 28 to display various information. The UI device 48 includes a reception device 76. The reception device 76 includes a touch panel 30 and a hard key unit 78. The hard key unit 78 includes the indicator key 26 (see Figure 1 The processor 64 operates according to various instructions received by the touch panel 30.

[0203] The external I / F 50 is responsible for sending and receiving various information between devices outside the shooting device 10 (hereinafter also referred to as "external devices"). External devices such as smart devices, personal computers, servers, USB memories, memory cards and / or printers (not shown) are directly or indirectly connected to the external I / F 50. In addition, the external I / F 50 is connected to a network (not shown). The external I / F 50 is responsible for sending and receiving information between a communication device such as a server on the network (not shown) and the system controller 12. For example, the external I / F 50 sends information corresponding to a request from the system controller 12 to the communication device via the network. In addition, the external I / F 50 receives information sent from the communication device and outputs the received information to the system controller 12 via the input / output interface 70.

[0204] The camera 10 includes an electronic ND filter 58 and a transparent glass 60. The electronic ND filter 58 is an example of an "electronic neutral density filter" in the present disclosure. The electronic ND filter 58 and the transparent glass 60 are mounted on the camera body 16. The electronic ND filter 58 and the transparent glass 60 are positioned closer to the subject than the light-receiving surface 72A. The electronic ND filter 58 and the transparent glass 60 are arranged in this order from the subject side to the image side. While the electronic ND filter 58 and the transparent glass 60 are mounted on the camera body 16, this is merely an example. Alternatively, at least the electronic ND filter 58 of the electronic ND filter 58 and the transparent glass 60 may be mounted on the interchangeable lens 18.

[0205] The electronic ND filter 58 is an electronic variable neutral density filter made of a material containing liquid crystal molecules whose orientation changes with an applied voltage. The electronic ND filter 58 changes its transmittance with an applied voltage, thereby uniformly adjusting the amount of light passing through the electronic ND filter 58. The transmittance of the electronic ND filter 58 can be seamlessly changed. Therefore, for example, by changing the transmittance of the electronic ND filter 58 while maintaining the aperture value, a target exposure (e.g., an appropriate exposure for the brightness of the subject of the camera 10) can be achieved while maintaining the depth of field. Furthermore, by changing the transmittance of the electronic ND filter 58 while maintaining the aperture value, the brightness of the frame 80 can be adjusted to the target brightness while maintaining the depth of field. Furthermore, for example, when the aperture value changes, the transmittance of the electronic ND filter 58 can be changed to compensate for the increase or decrease in exposure associated with the change in the aperture value, allowing a constant exposure to be maintained even during the aperture value change.

[0206] The electronic ND filter 58 is connected to the ND filter driver 55 . The ND filter driver 55 controls the light transmittance of the electronic ND filter 58 by applying a voltage to the electronic ND filter 58 in accordance with an instruction from the system controller 12 .

[0207] The transparent glass 60 is a light-transmitting glass plate. As an example of a light-transmitting glass plate, a transparent glass plate is given. The optical path length of the transparent glass 60 is the same as the optical path length of the electronic ND filter 58. Furthermore, although the transparent glass 60 is illustrated here, the transparent glass plate is merely an example, and the present disclosure also applies to a light-transmitting filter having an optical path difference equivalent to that of the electronic ND filter 58 (for example, a translucent glass plate having an optical path difference equivalent to that of the electronic ND filter 58). Furthermore, in this first embodiment, the transparent glass 60 is an example of a "light-transmitting filter" in the present disclosure.

[0208] The imaging device 10 includes a shift mechanism 62. The shift mechanism 62 is mounted on the imaging device body 16. The shift mechanism 62 includes a motor 62A. An example of the motor 62A is a stepping motor. The shift mechanism 62 transmits power generated by the motor 62A to the electronic ND filter 58 and the transparent glass 60, thereby shifting the electronic ND filter 58 and the transparent glass 60 in a direction transverse to the optical axis OA.

[0209] The motor 62A is connected to the motor driver 56 and operates under the control of the motor driver 56 in accordance with instructions from the system controller 12. The motor 62A is mechanically connected to the electronic ND filter 58 and the transparent glass 60 via a plurality of gears. The motor 62A applies power to the electronic ND filter 58 and the transparent glass 60 in accordance with instructions from the system controller 12 and under the control of the motor driver 56, thereby selectively inserting the electronic ND filter 58 and the transparent glass 60 into or removing them from the optical path.

[0210] Specifically, in a usage state (hereinafter, also referred to simply as the "usage state") in which the electronic ND filter 58 is used, the electronic ND filter 58 is inserted into the optical path, and the transparent glass 60 is removed from the optical path. On the other hand, in a non-usage state (hereinafter, also referred to simply as the "non-usage state") in which the electronic ND filter 58 is not used, the transparent glass 60 is inserted into the optical path, and the electronic ND filter 58 is removed from the optical path. Furthermore, in the first embodiment, as an example of the usage state, a state in which the electronic ND filter 58 is used within the effective pixel region of the photoelectric conversion element 72 (in other words, a state in which the electronic ND filter 58 affects the range of the frame 80 displayed on the display 28) is described.

[0211] The multiple gears mechanically connecting the motor 62A, the electronic ND filter 58, and the transparent glass 60 impart power in the direction of rotation of the motor 62A to the electronic ND filter 58 and power in the direction opposite to the direction of rotation of the motor 62A to the transparent glass 60. For example, when the motor 62A generates power for forward rotation, the electronic ND filter 58 is imparted with power for forward rotation, while the transparent glass 60 is imparted with power for reverse rotation. Alternatively, when the motor 62A generates power for reverse rotation, the transparent glass 60 is imparted with power for forward rotation, while the electronic ND filter 58 is imparted with power for reverse rotation. In this way, by imparting power from the motor 62A to both the electronic ND filter 58 and the transparent glass 60, one of the electronic ND filter 58 and the transparent glass 60 is inserted into the optical path, while the other is removed from the optical path. The optical path length of the electronic ND filter 58 is the same as that of the transparent glass 60 , so even if the electronic ND filter 58 is removed from the optical path, the transparent glass 60 is inserted into the optical path, thereby maintaining the same optical path length as when the electronic ND filter 58 is inserted into the optical path.

[0212] For example, since the optical path length of the electronic ND filter 58 is the same as that of the transparent glass 60, when not in use, even if the electronic ND filter 58 is removed from the optical path, the transparent glass 60 is inserted into the optical path, thereby maintaining the same optical path length as when the electronic ND filter 58 is inserted into the optical path. Furthermore, when in use, even if the transparent glass 60 is removed from the optical path, the electronic ND filter 58 is inserted into the optical path, thereby maintaining the same optical path length as when the transparent glass 60 is inserted into the optical path.

[0213] However, as an example, Figure 3 As shown, when a plurality of frames 80 are obtained by shooting a live view image in AE mode, it is preferable to change the brightness of the frames 80 monotonically rather than abruptly during the transition from the current frame 80 to the frame 80 after the target number A of frames 80. Thus, it is necessary to appropriately set the exposure appropriate for each of the plurality of frames 80.

[0214] In the first embodiment, the electronic ND filter 58 is installed in the imaging device 10. Therefore, the exposure suitable for the frame 80 is determined based on the transmittance of the electronic ND filter 58, the aperture value (i.e., F-number) of the aperture 40C, the shutter speed (e.g., the shutter speed of the mechanical shutter when a mechanical shutter is used, or the shutter speed of the electronic shutter when an electronic shutter is used), and the sensitivity (e.g., ISO sensitivity) of the photoelectric conversion element 72. Here, for example, the transmittance of the electronic ND filter 58 is controlled to control the exposure of the frame 80 while the aperture value (hereinafter simply referred to as "aperture value") of the aperture 40C, the shutter speed, and the sensitivity (hereinafter simply referred to as "sensitivity") of the photoelectric conversion element 72 are fixed.

[0215] The transmittance of the electronic ND filter 58 at the timing when the imaging device 10 starts the exposure calculation, that is, the current transmittance TR current To achieve the target exposure EX for making the brightness of the frame 80 the target brightness target Target transmittance TR target In the case of changes, according to the current transmittance TR current and target transmittance TR target The relationship between the current transmittance TR current Target transmittance TR target The time required until the change, that is, the change time T, is different. When the transmittance of the electronic ND filter 58 changes from the current transmittance TR current Target transmittance TR targetWhen the amount of change is monotonically changed, the brightness difference between the frames 80 also changes monotonically. If the target number of frames A is consistent with the required number of frames B (=(frame rate FR used for live view image shooting) × (change time T)), which is the number of frames required during the change time T, then the transmittance of the electronic ND filter 58 reaches the target transmittance TR at the time when the frame 80 of the target number of frames A is obtained. target , and accordingly, the target exposure EX is also achieved target .

[0216] However, as an example, Figure 4 As shown, according to the current transmittance TR current and target transmittance TR target Sometimes the number of frames B is required to exceed the target number of frames A. In this case, the transmittance of the electronic ND filter 58 does not reach the target transmittance TR until the time when the frame 80 of the target number of frames A is obtained. target , target exposure EX target The implementation of is also delayed. Figure 4 In the example shown, the target transmittance TR is achieved. target and achieve target exposure EX target The target frame number A is delayed by 2 frames.

[0217] Therefore, in the first embodiment, in order to achieve the target exposure EX by the target number of frames A, target , and the brightness of frame 80 is changed monotonically with the brightness change amount until the target frame number A, as an example, Figure 5 As shown, exposure control processing is performed by processor 64. Memory 66 stores an exposure control program PG. Exposure control program PG is an example of a "program" in the present disclosure. Processor 64 reads exposure control program PG from memory 66 and stores the read exposure control program PG on memory 68. Exposure control processing is implemented by processor 64 executing exposure control program PG. An example of exposure control processing is described below.

[0218] Figures 6 to 10 This is an example of the content of the exposure control processing performed by the processor 64. First, as an example, Figure 6 As shown, when the exposure calculation start timing arrives, processor 64 calculates a light metering value 90 indicating the brightness of the subject based on frame 80 obtained by live view imaging. Alternatively, light metering value 90 may be measured by an exposure meter (not shown).

[0219] The processor 64 calculates the target exposure EX based on the metered light value 90. target, as the exposure for making the brightness of the frame 80 used in the calculation of the metering value 90 the target brightness. In addition, the processor 64 calculates the target exposure EX target Corresponding target transmittance TR target , that is, to achieve the target exposure EX target Target transmittance TR target .

[0220] For example, based on the shutter speed, aperture value, sensitivity, and target exposure EX set for the imaging device 10 at the current time point target Calculate target transmittance TR target Target transmittance TR target The calculation of target transmittance is performed using the target transmittance calculation formula 91. The target transmittance calculation formula 91 is a combination of shutter speed, aperture value, sensitivity and target exposure EX target As an independent variable, the target transmittance TR target An operation expression that is a dependent variable.

[0221] The processor 64 obtains the transmittance set for the electronic ND filter 58 at the current time, that is, the current transmittance TR current Furthermore, the processor 64 uses the change time calculation formula 92 to calculate the current transmittance TR obtained from current Towards the calculated target transmittance TR target The time required for the target light transmittance TR to change is the change time T1. target and the current transmittance TR current In the first embodiment, the target exposure EX is calculated as follows: target This is an example of the “target exposure” of the present disclosure. The current transmittance TR current This is an example of the “first light transmittance” of the present disclosure, and the target light transmittance TR target This is an example of the “second light transmittance” in the present disclosure.

[0222] As an example, Figure 7 As shown, the processor 64 determines whether the change time T1 exceeds the threshold value TH1. In the first embodiment, the threshold value TH1 is an example of the "first threshold value" of the present disclosure. The threshold value TH1 is based on the transmittance of the electronic ND filter 58 from the current transmittance TR current Target transmittance TR target The ideal waiting time before the target exposure EX is changed (in other words, the time from the start timing of exposure calculation to the achievement of target exposure EX under the conditions of fixed aperture value, shutter speed and sensitivity) targetThe threshold value TH1 may be a fixed value or a variable value that changes according to given instructions or various conditions. As an example of the threshold value TH1, the transmittance of the electronic ND filter 58 is changed from the current transmittance TR current Target transmittance TR target The ideal upper limit of the waiting time until the change. The transmittance of the electronic ND filter 58 is changed from the current transmittance TR current Target transmittance TR target The upper limit of the ideal standby time until the light transmittance changes is merely an example; a value lower than the upper limit within the permissible range may be used. Furthermore, threshold TH1 may be a time determined by the user, a time determined according to the type of shooting mode, or a time specified within a range of several percent to several tens of percent of the maximum time obtained from a table that determines the time for the light transmittance of the electronic ND filter 58 to change (for example, a time equivalent to 50% of the maximum time obtained from a table that determines the time for the light transmittance of the electronic ND filter 58 to change).

[0223] When the change time T1 does not exceed the threshold value TH1 (in other words, when the magnitude relationship of “change time T1 ≦ threshold value TH1” holds), that is, when the transmittance of the electronic ND filter 58 changes from the current transmittance TR current Expose EX to the target target If the time required for the change to occur falls within the ideal time, processor 64 calculates the number of frames required to complete the change period T1, i.e., required number of frames B1, based on change period T1 and frame rate FR (e.g., a frame rate equivalent to the above-described frame rate). For example, required number of frames B1 is calculated as "(change period T1) x (frame rate FR)".

[0224] The processor 64 is based on the target exposure EX target Multiple split exposures EX are obtained by changing the time T1 div Multiple Split Exposure EX div The target exposure EX is obtained by target Calculate multiple split exposures EX based on the required number of frames B1 div Use the split exposure calculation formula 93 to perform multiple split exposures EX div The split exposure calculation formula 93 is to calculate the current transmittance TR current 、Target Exposure EX target and the required number of frames B1 as independent variables, multiple split exposures EX div Here, multiple split exposures EX div The number of split exposures EX is equal to the required number of frames B1. div .

[0225] Multiple Split Exposure EX div From the current transmittance TR current Corresponding Split Exposure EX div To target exposure EX target Changes monotonically. For example, multiple split exposures EX div From the current transmittance TR current Corresponding Split Exposure EX div To target exposure EX target Linear change: Although linear change is exemplified here, it may also change exponentially, as long as it changes monotonically.

[0226] Multiple Split Exposure EX div and determines from the current transmittance TR current Target transmittance TR target Ideally, the process of changing (for example, from the current transmittance TR current Target transmittance TR target The current transmittance TR of the process (changing with a certain amount of change) current , multiple ideal transmittances TR ideal And the target transmittance TR target Corresponding. Figure 7 In the example shown, the current transmittance TR current Corresponding to the required frame number B1 of “0”, the ideal transmittance TR ideal The target light transmittance TR corresponds to the required frame number B1 of "1", "2", "3" and "4" respectively. target This corresponds to "5" of the required frame number B1. The transmittance of the electronic ND filter 58 is based on the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target Change. Current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target From the current transmittance TR current To target transmittance TR target Changes monotonically. Figure 7 In the example shown, the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target The required frame number B1 changes monotonically from "0" to "5".

[0227] From the current transmittance TR current Corresponding Split Exposure EX div To target exposure EX targetThe monotonous change of the exposure of the frame 80 is achieved by making the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target From the current transmittance TR current To target transmittance TR target This is achieved by monotonically changing the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target From the current transmittance TR current To target transmittance TR target An example of monotonically changing is to make the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target From the current transmittance TR current To target transmittance TR target An example of a change between frames 80 with a certain amount of change (for example, a linear amount of change or an exponential function amount of change).

[0228] The processor 64 applies a plurality of split exposures EX to the exposure of a plurality of frames 80 obtained by shooting for live view images within the change time T1. div For example, the processor 64 performs the control according to the corresponding split exposure EX set for each frame. div Here, split exposure EX div For example, the setting of the electronic ND filter 58 can realize the split exposure EX while maintaining the shutter speed, aperture value and sensitivity. div That is, while maintaining the shutter speed, aperture value and sensitivity, the split exposure EX calculated based on each frame 80 is set. div In order to perform live view image shooting, the transmittance of the electronic ND filter 58 is controlled.

[0229] On the other hand, as an example, Figure 8 As shown, when the change time T1 exceeds the threshold TH1, that is, when the current transmittance TR current Expose EX to the target target If the time required for the change to occur does not converge within the ideal time, the processor 64 uses the transmittance calculation formula 94 to calculate the transmittance within the range where the change time T1 converges to below the threshold value TH1, that is, the transmittance TR within the change time. InTime The transmittance of the electronic ND filter 58 is represented by the transmittance calculation formula 94, which is a combination of the change time T1, the threshold value TH1, and the current transmittance TRcurrent And the target transmittance TR target As the independent variable, the transmittance TR during the change time InTime As the dependent variable, in the first embodiment, the light transmittance TR changes during the time InTime This is an example of the “third light transmittance” in the present disclosure.

[0230] The processor 64 uses the change time calculation formula 96 to calculate the time required to change the transmittance of the electronic ND filter 58 from the current transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target The time required for the change is the change time T2. The change time calculation formula 96 is to convert the current transmittance TR current , Transmittance TR during the changing time InTime And the target transmittance TR target An operation expression in which the independent variable is used and the change time T2 is used as the dependent variable.

[0231] The processor 64 calculates the required number of frames B2, which is the number of frames required during the period of change time T2, based on the change time T2 and the frame rate FR. For example, the required number of frames B2 is calculated as "(change time T2) x (frame rate FR)".

[0232] The processor 64 is based on the required number of frames B2 and the target exposure EX target And the current transmittance TR current Calculate multiple split exposure EX div Use the split exposure calculation formula 98 to perform multiple split exposures EX div The split exposure calculation formula 98 is the required number of frames B2, target exposure EX target And the current transmittance TR current As independent variables, multiple split exposures EX div Here, multiple split exposures EX div The number of split exposures EX is equal to the required number of frames B2. div .

[0233] The processor 64 is based on the plurality of split exposures EX div And calculate multiple ideal transmittances TR with known transmittance ideal And multiple actual transmittances TR real Here, the known transmittance refers to the current transmittance TR current , target transmittance TR target And the transmittance TR during the changing time InTime . Multiple ideal transmittances TR ideal And multiple actual transmittances TR realThe calculation of transmittance is performed using the transmittance calculation formula 100. The transmittance calculation formula 100 is a combination of multiple split exposures EX div 、Current transmittance TR current , target transmittance TR target And the transmittance TR during the changing time InTime As independent variables, multiple ideal transmittances TR ideal And multiple actual transmittances TR real An operation expression that is a dependent variable.

[0234] Multiple actual transmittances TR real The change time T2 is determined to be less than the threshold value TH1 and the transmittance of the electronic ND filter 58 is changed from the current transmittance TR current Target transmittance TR target Here, the actual change refers to the time in which the transmittance of the electronic ND filter 58 can be changed from the current transmittance TR current Target transmittance TR target In the case of actually changing the transmittance of the electronic ND filter 58, the transmittance of the electronic ND filter 58 is preferably changed from the current transmittance TR current Target transmittance TR target The change of TR is below the threshold value TH1 in time, so the transmittance of the electronic ND filter 58 changes from the current transmittance TR current To target transmittance TR target It does not change monotonically with a certain amount of change.

[0235] When the change time T1 exceeds the threshold value TH1 and live view imaging is performed, a plurality of actual transmittances TR are set for the electronic ND filter 58. real This is because, when shooting for live view images, even if the change time T1 exceeds the threshold value TH1, a plurality of ideal transmittances TR are set for the electronic ND filter 58. ideal When the current transmittance TR current Target transmittance TR target The change in is not completed within the time below the threshold TH1.

[0236] exist Figure 8 In the example shown, the change time T2 is equal to or less than the threshold value TH1 and the transmittance of the electronic ND filter 58 is changed from the current transmittance TR current Target transmittance TR target The multiple transmittances of the process that actually changes, that is, the multiple actual transmittances TR realAn example of determining the change time T2 to be less than the threshold value TH1 and from the current transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target Multiple transmittances of varying processes.

[0237] exist Figure 8 In the example shown, at the current transmittance TR current and target transmittance TR target The transmittance TR during the change time is determined to make the change time T2 less than the threshold value TH1. InTime . Multiple actual transmittances TR real Based on the current transmittance TR current and the transmittance TR during the changing time InTime Decision. That is, Figure 8 In the example shown, the current transmittance TR current Transmittance TR during the change time InTime The plurality of light transmittances that change monotonically (for example, the plurality of light transmittances that change linearly) include the light transmittance TR within the change time. InTime The actual light transmittances TR are determined to be real .

[0238] Current transmittance TR current And multiple actual transmittances TR real From the current transmittance TR current Transmittance TR during the change time InTime Changes monotonically. Figure 8 In the example shown, the current transmittance TR current And multiple actual transmittances TR real From the current transmittance TR current Transmittance TR during the change time InTime Changes linearly.

[0239] The processor 64 adjusts the transmittance of the electronic ND filter 58 to the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target However, the transmittance of the electronic ND filter 58 is adjusted according to the current transmittance TR while maintaining the shutter speed, aperture value and sensitivity. current , multiple actual transmittances TR real And the target transmittance TR target When the light transmittance of the electronic ND filter 58 changes, the current light transmittance TR is maintained while the shutter speed, aperture value and sensitivity are maintained. current , multiple ideal transmittances TR idealAnd the target transmittance TR target Compared with the case where the brightness changes between frames 80, the brightness change between frames 80 increases.

[0240] Therefore, in the present first embodiment, even if the transmittance of the electronic ND filter 58 is adjusted according to the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target In order to maintain the shutter speed, aperture value and sensitivity under the transmittance of the electronic ND filter 58, the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target The brightness of the frame 80 is changed at the same level. First, as an example, Figure 9 As shown, the processor 64 calculates a plurality of actual light transmittances TR using the frame 80 obtained within the required frame number B2 as a unit. real With multiple ideal transmittance TR ideal The difference δ1 between the exposures is an indicator of the magnitude of the change in brightness between the frames 80. In other words, the difference δ1 indicates the degree of deviation from the ideal brightness of the frame 80 (i.e., the difference in the actual transmittance TR real The exposure achieved is consistent with the ideal transmittance TR ideal degree of exposure deviation achieved).

[0241] Exposure is defined by shutter speed, aperture value, and sensitivity in addition to the transmittance of the electronic ND filter 58. Therefore, the difference δ1 can be made zero by adjusting the shutter speed, aperture value, and / or sensitivity. Therefore, the processor 64 adjusts the exposure to the current transmittance TR based on the difference δ1. current , multiple actual transmittances TR real And the target transmittance TR target Corresponding multiple split exposure EX div (ie, from the current transmittance TR current Change to target transmittance TR target Each split exposure EX div In other words, the processor 64 supplements the difference δ1 with the shutter speed, aperture value and / or sensitivity to make it consistent with the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target Corresponding multiple split exposure EX div and the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target Corresponding multiple split exposure EXdiv In other words, the number of frames B2 contains each frame 80, so that the actual transmittance TR real Split Exposure EX div Become the ideal light transmittance TR ideal Split Exposure EX div In this manner, the shutter speed, the aperture value and / or the sensitivity are adjusted using an adjustment value corresponding to the difference δ1 (eg, an adjustment value determined according to the difference δ1).

[0242] In the process of using multiple actual transmittance TR real When shooting a live view image as the transmittance of the electronic ND filter 58, for example, Figure 10 As shown in FIG. 1 , by adjusting the sensitivity based on the adjustment values ​​α1 to α4 for adjusting the sensitivity, the difference δ1 is compensated. In this way, by adjusting the sensitivity based on the adjustment values ​​α1 to α4 corresponding to the difference δ1, the transmittance of the electronic ND filter 58 is adjusted to the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target Changes can also be achieved while maintaining shutter speed, aperture value and sensitivity to achieve and use multiple actual transmittance TR real The split exposure EX of the same level as the transmittance of the electronic ND filter 58 is div .

[0243] Adjustment values ​​α1 to α4 are each uniquely determined based on the difference δ1 calculated per frame 80. For example, adjustment values ​​α1 to α4 are calculated using adjustment value equation 102, which uses difference δ1 as the independent variable and the adjustment value for adjusting sensitivity as the dependent variable. While sensitivity adjustment based on difference δ1 is described here, this is merely an example. Alternatively, shutter speed and / or aperture value can be adjusted based on difference δ1. In this case, the adjustment values ​​for shutter speed and / or aperture value can be calculated using the same equation as adjustment value equation 102.

[0244] When live view imaging is performed within the change time T2, the processor 64 sets the sensitivity adjusted based on the difference δ1 calculated in units of frames 80, the shutter speed determined for each frame 80, and the aperture value determined for each frame 80, for the imaging device 10. In addition, the processor 64 sets the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target= is set to the transmittance of the electronic ND filter 58. Thus, in the live view image shooting within the change time T2, by setting the sensitivity adjusted based on the difference δ1 calculated in units of frames 80 as described above, the shutter speed determined for each frame 80, the aperture value determined for each frame 80, the current transmittance TR current , multiple actual transmittances TR real And the target transmittance TR target , multiple split exposures EX that change monotonically are applied to the exposure of multiple frames 80 div .

[0245] In addition, in the first embodiment, shooting with live view images is an example of "shooting by a shooting device" in the present disclosure. In addition, in the first embodiment, the change times T1 and T2 are examples of "change times" in the present disclosure. In addition, in the first embodiment, the frame rate FR is an example of "predetermined frame rate" in the present disclosure. In addition, in the first embodiment, multiple ideal light transmittances TR ideal This is an example of the “plurality of ideal light transmittances” disclosed in the present invention. In addition, in the first embodiment, the plurality of actual light transmittances TR real This is an example of the "plurality of first actual transmittances" in the present disclosure. Furthermore, in the first embodiment, the shutter speed, aperture value, sensitivity, and transmittance of the electronic ND filter 58 are examples of the "plurality of exposure factors" in the present disclosure. Furthermore, in the first embodiment, the difference δ1 is an example of the "degree of difference between the ideal transmittance and the first actual transmittance" in the present disclosure.

[0246] Next, refer to Figure 11A as well as Figure 11B The operation of the imaging device 10 will be described. Figure 11A as well as Figure 11B Shown at the current transmittance TR current This is an example of a flow of exposure control processing performed by the processor 64 on the condition that the transmittance of the electronic ND filter 58 is set and the start timing of the exposure calculation arrives (in other words, the timing pre-specified as the timing for adjusting the exposure of the frame 80 obtained by performing live view image shooting arrives) when live view image shooting is performed in AF mode. Figure 11A as well as Figure 11B The illustrated flow of the exposure control process is an example of the “control method” of the present disclosure.

[0247] exist Figure 11A In the exposure control process shown, first, in step ST10, the processor 64 acquires a frame 80 generated by performing live view image shooting. After the process of step ST10 is performed, the exposure control process proceeds to step ST12.

[0248] In step ST12, processor 64 calculates light metering value 90 based on frame 80 acquired in step ST10. After the process of step ST12 is performed, the exposure control process proceeds to step ST14.

[0249] In step ST14, the processor 64 calculates the target exposure EX based on the metered light value 90. target This is the exposure for making the brightness of the frame 80 used in calculating the light metering value 90 equal to the target brightness. After the process of step ST14 is performed, the exposure control process proceeds to step ST16.

[0250] In step ST16, the processor 64 calculates the target exposure EX target Corresponding target transmittance TR target After the process of step ST16 is performed, the exposure control process moves to step ST18.

[0251] In step ST18, the processor 64 obtains the current transmittance TR set for the electronic ND filter 58 at the current time point. current After the process of step ST18 is performed, the exposure control process moves to step ST20.

[0252] In step ST20, the processor 64 calculates the value of the light transmittance of the electronic ND filter 58 from the current light transmittance TR current Target transmittance TR target The time required for the change is the change time T1. After the process of step ST20 is performed, the exposure control process moves to step ST22.

[0253] In step ST22, the processor 64 determines whether the change time T1 exceeds the threshold value TH1. In step ST22, if the change time T1 does not exceed the threshold value TH1, the determination is negative, and the exposure control process transfers to step ST24. In step ST22, if the change time T1 exceeds the threshold value TH1, the determination is positive, and the exposure control process transfers to step ST24. Figure 11B Step ST28 is shown.

[0254] In step ST24 , the processor 64 calculates the required number of frames B1 based on the change time T1 and the frame rate FR. After the process of step ST24 is performed, the exposure control process proceeds to step ST26 .

[0255] In step ST26, the processor 64 calculates the target exposure EX based on the required number of frames B1 and the target exposure EX. target And the current transmittance TR current Calculate multiple split exposure EX divAfter the process of step ST26 is performed, the exposure control process is transferred to Figure 11B Step ST42 is shown.

[0256] exist Figure 11B In step ST28 shown in FIG. 1 , the processor 64 calculates the current light transmittance TR based on the change time T1, the threshold TH1, and the current light transmittance TR current And the target transmittance TR target Calculate the transmittance in the range where the change time T1 converges to below the threshold TH1, that is, the transmittance TR during the change time InTime as the light transmittance of the electronic ND filter 58. After the process of step ST28 is performed, the exposure control process shifts to step ST30.

[0257] In step ST30, the processor 64 calculates the light transmittance TR based on the current light transmittance TR. current , Transmittance TR during the changing time InTime And the target transmittance TR target , calculate the transmittance of the electronic ND filter 58 from the current transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target The time required for the change is the change time T2. After the process of step ST30 is performed, the exposure control process proceeds to step ST32.

[0258] In step ST32 , the processor 64 calculates the required number of frames B2 based on the change time T2 and the frame rate FR. After the process of step ST32 is performed, the exposure control process proceeds to step ST34 .

[0259] In step ST34, the processor 64 calculates the target exposure EX based on the required number of frames B2 and the target exposure EX. target And the current transmittance TR current Calculate multiple split exposure EX div After the process of step ST34 is performed, the exposure control process moves to step ST36.

[0260] In step ST36, the processor 64 performs the following operations based on the plurality of divided exposures EX div 、Current transmittance TR current , target transmittance TR target And the transmittance TR during the changing time InTime , calculate multiple actual transmittances TR real And multiple ideal transmittance TR ideal After the process of step ST36 is performed, the exposure control process moves to step ST38.

[0261] In step ST38, the processor 64 calculates a plurality of actual light transmittances TR using the frame 80 within the required frame number B2 as a unit. real With multiple ideal transmittance TR ideal That is, in step ST38, the actual transmittance TR is calculated for each frame 80 included in the required number of frames B2. real and ideal transmittance TR ideal After the process of step ST38 is performed, the exposure control process shifts to step ST40.

[0262] In step ST40, the processor 64 adjusts the defined split exposure EX using the adjustment value corresponding to the difference δ1 for each frame 80 included in the required number of frames B2. div After the process of step ST40 is performed, the exposure control process shifts to step ST42.

[0263] Here, when N is set to a natural number with an initial value of "1", in step ST42, the processor 64 causes the imaging device 10 to perform the exposure control operation based on the divided exposure EX for the Nth frame. div For example, when the exposure control process is transferred from step ST26 to step ST42, in step ST42, the processor 64 causes the imaging device 10 to perform the plurality of divided exposures EX calculated by performing the process of step ST26. div Split exposure EX for the Nth frame in div On the other hand, when the exposure control process shifts from step ST40 to step ST42, in step ST42, the processor 64 sets the sensitivity adjusted based on the difference δ1 calculated for the Nth frame, the shutter speed determined for the Nth frame, and the aperture value determined for the Nth frame to the imaging device 10, and sets the current transmittance TR to the electronic ND filter 58. current , multiple actual transmittances TR real And the target transmittance TR target Based on the transmittance for the Nth frame in , the imaging device 10 is caused to perform imaging. After the process of step ST42 is performed, the exposure control process proceeds to step ST44.

[0264] In step ST44, the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX target In step ST44, if the exposure at the Nth frame does not reach the target exposure EX targetIn the case of , the determination is negative, and the exposure control process transfers to step ST46. In step ST46, the processor 64 adds "1" to N. After the process of step ST46 is performed, the exposure control process transfers to step ST42. In step ST44, the exposure of the Nth frame reaches the target exposure EX target In the case of , the judgment is affirmative and the exposure control processing ends.

[0265] As described above, in the imaging device 10 of the first embodiment, live view imaging is performed based on the frame rate FR to obtain a plurality of frames 80. At the change time T1 (i.e., the transmittance of the electronic ND filter 58 changes from the current transmittance TR current Target transmittance TR target The time required for the change) does not exceed the threshold TH1 (ie, based on the time required for the change from the current transmittance TR current Target transmittance TR target In the case of a value determined by the ideal waiting time until the change occurs), the required number of frames B1 (i.e., the number of frames required during the change time T1) is calculated based on the change time T1 and the frame rate FR. target Multiple split exposures EX determined by the required number of frames B1 div This is applied to the exposure of a plurality of frames 80 obtained by capturing live view images within the change time T1.

[0266] On the other hand, when the change time T1 exceeds the threshold value TH1, based on the change time T2 (ie, from the current transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target The required number of frames B2 (i.e., the number of frames required during the change time T2) and the frame rate FR are calculated. target Multiple split exposures EX determined by the required number of frames B2 div This is applied to the exposure of a plurality of frames 80 obtained by capturing live view images within the change time T2.

[0267] Therefore, according to the imaging device 10 of the first embodiment, it is possible to suppress a sudden change in brightness between a plurality of frames 80 obtained by performing live view imaging accompanied by switching of the transmittance of the electronic ND filter 58 .

[0268] In the imaging device 10 of the first embodiment, when the change time T1 exceeds the threshold value TH1, the transmittance of the electronic ND filter 58 is changed from the current transmittance TR to the current transmittance TR while the shutter speed, aperture value, and sensitivity are fixed. currentTransmittance TR after changing time InTime Target transmittance TR target Multiple divided exposures EX corresponding to multiple frames 80 in the case of change div Based on multiple ideal transmittance TR ideal (ie, determine the current transmittance TR current Target transmittance TR target multiple transmittances of the ideally changing process) and multiple actual transmittances TR real (That is, it is determined that the change time T2 is less than the threshold value TH1 and the transmittance of the electronic ND filter 58 changes from the current transmittance TR current Target transmittance TR target Therefore, the exposure of multiple frames 80 can be adjusted by following the transmittance of the electronic ND filter 58 from the current transmittance TR current Target transmittance TR target The actual change (i.e., from the current transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target changes in the

[0269] In the imaging device 10 of the first embodiment, when the change time T1 exceeds the threshold value TH1, the current transmittance TR current and the transmittance TR during the changing time InTime (ie, the transmittance at which the change time T1 is less than or equal to the threshold value TH1) determines a plurality of actual transmittances TR real . Multiple actual transmittances TR real The change time T2 is determined to be less than the threshold value TH1 and the transmittance TR current Transmittance TR after changing time InTime Target transmittance TR target The current transmittance TR changes from current Target transmittance TR target And, the transmittance of the electronic ND filter 58 is changed from the current transmittance TR to the current transmittance TR under the condition that the shutter speed, aperture value and sensitivity are fixed. current Transmittance TR after changing time InTime Target transmittance TR target Multiple divided exposures EX corresponding to multiple frames 80 in the case of change div Based on the transmittance TR within the time period of the change InTime Multiple actual transmittances TR real And multiple ideal transmittance TR idealTherefore, even when the change time T1 exceeds the threshold value TH1, a plurality of split exposures EX1 for making the change time T1 equal to or less than the threshold value TH1 can be applied to the exposure of the plurality of frames 80 obtained by shooting the live view image. div .

[0270] In the imaging device 10 of the first embodiment, the transmittance of the electronic ND filter 58 is changed from the current transmittance TR to the current transmittance TR under the condition that the shutter speed, aperture value, and sensitivity are fixed. current Transmittance TR after changing time InTime Target transmittance TR target Multiple divided exposures EX corresponding to multiple frames 80 in the case of change div The adjustment is made based on the difference δ1 (ie, the actual transmittance TR real and ideal transmittance TR ideal Therefore, even if the actual transmittance TR real and ideal transmittance TR ideal There is a gap between them, and multiple ideal transmittances TR can be easily achieved. ideal In addition, here, the example of adjusting the sensitivity is given, but this is just an example, and it is sufficient to adjust the adjustment value determined by the difference δ1, the sensitivity, the shutter speed and / or the aperture value.

[0271] In the imaging device 10 according to the first embodiment, when the change time T1 is equal to or less than the threshold value TH1, the transmittance of the electronic ND filter 58 is based on the plurality of ideal transmittances TR ideal Therefore, the exposure of multiple frames 80 can easily follow the change of the transmittance of the electronic ND filter 58 from the current transmittance TR when the time T1 is less than the threshold value TH1. current Target transmittance TR target changes.

[0272] In the imaging device 10 of the first embodiment, when the change time T1 is equal to or less than the threshold value TH1, the plurality of divided exposures EX div With multiple ideal transmittance TR ideal Therefore, the exposure of the plurality of frames 80 can be easily followed by the change in the transmittance of the electronic ND filter 58 from the current transmittance TR when the change time T1 is less than or equal to the threshold value TH1. current Target transmittance TR target changes.

[0273] In the imaging device 10 of the first embodiment, when the change time T1 is equal to or less than the threshold value TH1, the plurality of ideal light transmittances TR ideal At the current transmittance TR current and target transmittance TR target Therefore, it is possible to suppress a sudden change in brightness between a plurality of frames 80 obtained by performing live view image shooting.

[0274] In the imaging device 10 of the first embodiment, when the change time T1 is equal to or less than the threshold value TH1, the plurality of divided exposures EX div From the current transmittance TR current Corresponding Split Exposure EX div To target exposure EX target Changes monotonically. From the current transmittance TR current Corresponding Split Exposure EX div To target exposure EX target The monotonous change of the exposure of the frame 80 is achieved by making the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target From the current transmittance TR current To target transmittance TR target This is achieved by monotonically changing. This makes it possible to suppress abrupt brightness changes between a plurality of frames 80 obtained by capturing live view images.

[0275] [Second embodiment]

[0276] In the first embodiment described above, the threshold value TH1 is fixed regardless of the change time T1. However, in the second embodiment, an example in which the threshold value TH1 is changed according to the change time T1 will be described.

[0277] In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the second embodiment, the differences from the first embodiment are mainly described.

[0278] In this second embodiment, referring to Figures 12A to 12C The flowchart shown in FIG. 1 is an example of the exposure control process of the second embodiment. Figures 12A to 12C The flowchart shown includes the same steps as those described in the first embodiment. Figure 11A as well as Figure 11B The flowchart shown in the figure repeats multiple steps, so the following is a Figures 12A to 12CThe steps included in the flowchart are the same as those described in the first embodiment. Figure 11A as well as Figure 11B The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0279] Figures 12A to 12C The flowchart shown is the same as Figure 11A as well as Figure 11B The flowchart shown in FIG. 1 is different in that step ST22 is replaced with steps ST100 to ST132 .

[0280] exist Figure 12A In step ST100 shown, the processor 64 stores the change time T1 calculated in step ST20 in the memory 68 in a FIFO format. Thus, a plurality of change times T1 are stored in time series in the memory 68. After the process of step ST100 is performed, the exposure control process proceeds to step ST102.

[0281] In step ST102, the processor 64 determines whether the latest change time T1 stored in the memory 68 exceeds the threshold value TH1. In step ST102, if the latest change time T1 stored in the memory 68 does not exceed the threshold value TH1, the determination is negative and the exposure control process is transferred to step ST103. Figure 12C In step ST102, if the latest change time T1 stored in the memory 68 exceeds the threshold value TH1, the determination is affirmative, and the exposure control process is transferred to Figure 12B Step ST104 is shown.

[0282] exist Figure 12B In step ST104, the processor 64 calculates the current transmittance TR under the condition that the shutter speed, aperture value and sensitivity are fixed. current and target transmittance TR target The absolute value of the exposure difference between the two, that is, the ... current The exposure achieved is related to the target transmittance TR target The absolute value of the difference in exposure achieved is the difference δ2. The difference δ2 corresponds to the current transmittance TR current and target transmittance TR target The absolute value of the difference.

[0283] Here, the method of calculating the absolute value of the difference is given as an example, but a ratio can also be applied instead of the absolute value of the difference. In addition, the difference δ2 corresponds to the current transmittance TR current and target transmittance TR target The absolute value of the difference between the two values ​​can therefore be used instead of the difference δ2 to apply the current transmittance TRcurrent and target transmittance TR target The degree of difference (for example, the absolute value or ratio of the difference).

[0284] In the next step ST106, processor 64 determines whether difference δ2 is less than threshold TH2. Threshold TH2 represents the exposure difference required to achieve a change in brightness between frames 80 that exceeds a threshold level. An example of an exposure difference that achieves a change in brightness between frames 80 that exceeds a threshold level is an exposure difference that causes visual discomfort to the user. An example of threshold TH2 is a value previously determined through actual device-based experiments and / or computer simulations, as the lower limit for the exposure difference required to cause visual discomfort to the user due to brightness changes between frames 80. This lower limit for the exposure difference required to cause visual discomfort to the user due to brightness changes between frames 80 is merely an example; a value exceeding the lower limit within an acceptable range is also possible. Threshold TH2 can be a fixed value or a variable value that changes according to given instructions or various conditions. Threshold TH2 can be determined by the user or based on the type of shooting mode.

[0285] In step ST106, if the difference δ2 is smaller than the threshold TH2, the determination is affirmative, and the exposure control process shifts to step ST108. In step ST106, if the difference δ2 is not smaller than the threshold TH2, the determination is negative, and the exposure control process shifts to step ST110.

[0286] The small difference counter is used in the process of step ST108 and the process of step ST110. The small difference counter measures the current transmittance TR under the condition that the shutter speed, aperture value and sensitivity are fixed. current The exposure achieved is determined by the target transmittance TR target A counter for the number of times a small difference in exposure is achieved (ie, the number of times the determination result of "difference δ2 < threshold value TH2" in step ST106 is continued). The initial count value of the small difference counter is "0".

[0287] In step ST108 , the processor 64 increments the count value of the small difference counter by 1. After the process of step ST108 is performed, the exposure control process moves to step ST112 .

[0288] In step ST110 , the processor 64 resets the count value of the small difference counter to the initial count value. After the process of step ST110 is performed, the exposure control process moves to step ST112 .

[0289] In step ST112, processor 64 determines whether the count value of the small difference counter exceeds threshold TH3. Threshold TH3 is determined based on the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness (e.g., noise) rather than subject brightness. An example of threshold TH3 is a value previously determined through actual device-based experiments and / or computer simulations as the upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness rather than subject brightness. This upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness is merely an example; it may also be a value within an allowable range that is lower than the upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness rather than subject brightness. Threshold TH3 may be a fixed value or a variable value that changes according to given instructions or various conditions. The threshold value TH3 may be a value determined by the user or a value determined according to the type of imaging mode.

[0290] In step ST112, if the count value of the small difference counter does not exceed the threshold value TH3, the determination is negative, and the exposure control process is transferred to step ST113. Figure 11B In step ST28 shown in FIG. In step ST112, when the count value of the small difference counter exceeds the threshold value TH3, the determination is affirmative, and the exposure control process shifts to step ST114.

[0291] In step ST114, processor 64 changes threshold TH1 to a value greater than the value currently set. An example of a value greater than the value currently set is the longest change time. The longest change time refers to the longest change time T1 among the multiple change times T1 stored in memory 68 at the current time. Note that the longest change time is merely an example; any change time T1 greater than threshold TH1 at the current time among the multiple change times T1 stored in memory 68 at the current time will suffice. Alternatively, threshold TH1 may be changed to a value greater than the value currently set based on a rule determined independently of the multiple change times T1 stored in memory 68 at the current time (e.g., a rule in which a coefficient that increases threshold TH1 is multiplied by threshold TH1). Furthermore, the extent to which threshold TH1 is increased may be determined based on user instructions or various conditions. After step ST14, exposure control processing moves to step ST116.

[0292] In step ST116, the processor 64 turns on the threshold change flag indicating that the threshold TH1 has been changed. After the processing of step ST116, the exposure control processing is transferred to Figure 11B Step ST28 is shown.

[0293] exist Figure 12C In step ST118 shown, the processor 64 resets the count value of the small difference counter to the initial count value. After the process of step ST118 is performed, the exposure control process moves to step ST120.

[0294] In step ST120, processor 64 determines whether the threshold change flag is on. If the threshold change flag is not on in step ST120, the determination is negative, and the exposure control process moves to step ST24. If the threshold change flag is on in step ST120, the determination is positive, and the exposure control process moves to step ST122.

[0295] In step ST122, the processor 64 determines whether the latest change time T1 stored in the memory 68 is less than or equal to the default threshold value TH1. The default threshold value TH1 is a value previously determined to be smaller than the threshold value TH1 currently set. If, in step ST122, the latest change time T1 stored in the memory 68 is not less than or equal to the default threshold value TH1, the determination is negative, and the exposure control process proceeds to step ST24. If, in step ST122, the latest change time T1 stored in the memory 68 is less than or equal to the default threshold value TH1, the determination is positive, and the exposure control process proceeds to step ST124.

[0296] The short change time counter is used in the process of step ST124. The short change time counter counts the number of times the determination result of "change time T1 ≤ default threshold TH1" in step ST122 continues. The initial count value of the short change time counter is "0".

[0297] In step ST124 , the processor 64 increments the count value of the short change time counter by 1. After the process of step ST124 is performed, the exposure control process moves to step ST126 .

[0298] In step ST126, processor 64 determines whether the count value of the short change time counter exceeds threshold TH4. Threshold TH4 is determined based on the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness (e.g., noise) rather than subject brightness. An example of threshold TH4 is a value previously determined through actual device-based experiments and / or computer simulations as the upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness rather than subject brightness. This upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness is merely an example; it may also be a value within an allowable range that is lower than the upper limit of the number of times that the determination in step ST106 that "difference δ2 < threshold TH2" is likely to persist due to factors other than subject brightness rather than subject brightness. Threshold TH4 may be a fixed value or a variable value that changes according to given instructions or various conditions. The threshold value TH4 may be a value determined by the user or a value determined according to the type of imaging mode.

[0299] In step ST126, if the count value of the short change time counter does not exceed the threshold value TH4, the determination is negative, and the exposure control process transfers to step ST24. In step ST126, if the count value of the short change time counter exceeds the threshold value TH4, the determination is positive, and the exposure control process transfers to step ST128. The count value of the short change time counter exceeding the threshold value TH4 means that there is a high possibility that the brightness of the subject has hardly changed. In such a case, it is preferable not to perform exposure control as much as possible. Figure 11B The processing of steps ST28 to ST40 shown in FIG. Figure 12C The processing of step ST24 and the processing of step ST26 are shown in FIG. Figure 11B Compared with the processing of steps ST28 to ST40 shown in FIG. Figure 12C The processing of step ST24 and the processing of step ST26 shown have a small number of steps and a small processing load.

[0300] Therefore, in order to make the exposure control process Figure 11B The processing of steps ST28 to ST40 shown in FIG. 1 is easier to enter Figure 11A After the processing of step ST24 and step ST26, the processor 64 changes the threshold value TH1 currently set to the default threshold value TH1 in step ST128. After the processing of step ST128, the exposure control process proceeds to step ST130.

[0301] In step ST130 , the processor 64 turns off the threshold change flag. After the process of step ST130 , the exposure control process proceeds to step ST132 .

[0302] In step ST132, the processor 64 resets the count value of the short change time counter to the initial count value. After the process of step ST132 is performed, the exposure control process shifts to step ST24.

[0303] Furthermore, in the second embodiment, the difference δ2 is an example of the "difference between the first and second transmittances" in the present disclosure. Furthermore, in the second embodiment, the count value of the small difference counter (see step ST112) is an example of the "number of times the difference between the first and second transmittances falls within a predetermined range" in the present disclosure. Furthermore, in the second embodiment, the threshold TH3 is an example of the "predetermined number of times" in the present disclosure.

[0304] As described above, in the imaging device 10 of the second embodiment, when the change time T1 exceeds the threshold value TH1 and the current transmittance TR current and target transmittance TR target When the number of times the difference (difference δ2 in the second embodiment) of the state that converges to a predetermined range (below threshold TH2 in the second embodiment) continues for a predetermined number of times (when the count value of the small difference counter exceeds threshold TH3 in the second embodiment), threshold TH1 is changed to a value larger than the value set at the current time point. As a result, the change time T1 is less likely to exceed threshold TH1 than before the change of threshold TH1, so Figure 11B Compared with the processing of steps ST28 to ST40 shown in FIG. Figure 12C The process of step ST24 and the process of step ST26 are shown. Figure 12C The processing of step ST24 and the processing of step ST26 shown are the same as those of step Figure 11B Compared with the processing of steps ST28 to ST40 shown in the figure, the number of steps is small, so the processing load can be reduced.

[0305] In addition, the change time T1 exceeds the threshold TH1, and the current transmittance TR current and target transmittance TR targetWhen the number of times the difference converges within a predetermined range continues for a predetermined number of times (in the second embodiment, when the count value of the small difference counter exceeds threshold value TH3), threshold value TH1 is changed to a value determined based on change time T1 obtained from the time the count value of the small difference counter exceeds threshold value TH3 (for example, the longest change time). Therefore, compared to a case where the user determines the changed value of threshold value TH1 (i.e., a case where threshold value TH1 is changed according to an instruction from the user), threshold value TH1 can be easily changed to a value that change time T1 is unlikely to exceed.

[0306] [Third embodiment]

[0307] In the second embodiment, the case where the change time T1 exceeds the threshold TH1 and the current transmittance TR current and target transmittance TR target When the number of times the difference between the two states converges within a predetermined range for a predetermined number of times, Figure 11B The processing of steps ST28 to ST40 shown in the figure is to change the transmittance of the electronic ND filter 58 from the current transmittance TR to the current transmittance TR under the condition that the shutter speed, aperture value and sensitivity are fixed. current Transmittance TR after changing time InTime Target transmittance TR target Multiple divided exposures EX corresponding to multiple frames 80 in the case of change div , the sensitivity is adjusted by the adjustment value determined by the difference δ1. However, in the third embodiment, the change time T1 exceeds the threshold TH1 and the current transmittance TR current and target transmittance TR target When the number of times the difference between the values ​​of EX and EX is within a predetermined range continues for a predetermined number of times, multiple split exposures are maintained. div Example of method.

[0308] In the third embodiment, the same components as those in the first and second embodiments are denoted by the same reference numerals, and their descriptions are omitted. In the third embodiment, the differences from the second embodiment are mainly described.

[0309] In this third embodiment, referring to Figure 13A The flowchart shown in FIG and 13B illustrates an example of the exposure control process of the third embodiment. Figure 13A as well as Figure 13B The flowchart shown includes the same steps as those described in the second embodiment. Figures 12A to 12C The flowchart shown in the figure repeats multiple steps, so the following is a Figure 13A as well as Figure 13BThe flowchart shown includes multiple steps similar to those described in the second embodiment. Figures 12A to 12C The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0310] Figure 13A as well as Figure 13B The flowchart shown is the same as Figures 12A to 12C Compared with the flowchart shown in FIG. 1 , the present invention is different in that step ST200 is provided instead of step ST102 , steps ST114 and ST116 are removed, and steps ST120 to ST132 are removed.

[0311] exist Figure 13A In step ST200 shown in FIG. 1 , the processor 64 determines whether the latest change time T1 stored in the memory 68 exceeds the threshold value TH1. In step ST200, if the latest change time T1 stored in the memory 68 does not exceed the threshold value TH1, the determination is negative, and the exposure control process is transferred to step ST200. Figure 13B In step ST200, if the latest change time T1 stored in the memory 68 exceeds the threshold value TH1, the determination is affirmative, and the exposure control process shifts to step ST104.

[0312] exist Figure 13A If the determination in step ST112 is affirmative, the exposure control process is transferred to Figure 13B Step ST202 is shown.

[0313] In step ST202, the processor 64 converts the multiple divided exposures EX calculated at the current time point into div (i.e., in Figure 11B The multiple divided exposures EX calculated in step ST34 are shown as follows: div ) is stored in a pre-determined storage area in the memory 68, that is, a divided exposure storage area, thereby maintaining a plurality of divided exposures EX calculated at the current time point. div After the process of step ST202 is performed, the exposure control process is transferred to Figure 11B Step ST42 is shown.

[0314] The exposure control process is transferred from step ST202 to Figure 11B In the case of step ST42 shown in FIG. Figure 11B In step ST42 shown in FIG. 1 , the processor 64 causes the imaging device 10 to perform the multi-exposure image capture based on the plurality of divided exposures EX maintained as the divided exposure storage area. div Split exposure EX for the Nth frame in divThus, the plurality of divided exposures EX stored in the divided exposure storage area are applied to the exposure of the plurality of frames 80 obtained by performing the live view image shooting. div . Maintain multiple split exposure EX in the split exposure storage area div is the multiple split exposures EX calculated at the current time point div (i.e., in Figure 11B The multiple divided exposures EX calculated in step ST34 are shown as follows: div ), you can not Figure 11B The processing of steps ST36 to ST40 shown in the figure means that Figure 11B The processing of steps ST36 to ST40 shown in FIG. div Frequent adjustments.

[0315] [Fourth embodiment]

[0316] In the first embodiment, regardless of the difference δ1, the sensitivity of each frame 80 is adjusted using the adjustment value determined based on the difference δ1, thereby converting the split exposure EX calculated as the actual exposure into div Adjust for ideal split exposure EX div However, for example, the larger the difference δ1, the larger the sensitivity adjustment value, and therefore the noise generated by the sensitivity adjustment may also increase. In addition, in addition to the sensitivity, even when the shutter speed and aperture value are adjusted according to the adjustment value determined by the difference δ1, since the larger the difference δ1, the larger the adjustment value, the greater the physical load is applied to the shutter and aperture 40C due to the operation of the shutter and the operation of the aperture 40C, which may also become a factor in shortening the life of the shutter and aperture 40C. Therefore, in this fourth embodiment, a method for suppressing the split exposure EX calculated to be the actual exposure is described. div The ideal split exposure EX div An example of how to adjust the amount of adjustment such as sensitivity.

[0317] In the fourth embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the fourth embodiment, the differences from the first embodiment are mainly described.

[0318] In this fourth embodiment, referring to Figures 14A to 14D The flowchart shown in FIG. 1 is an example of the exposure control process of the fourth embodiment. Figures 14A to 14D The flowchart shown includes the same steps as those described in the first embodiment. Figure 11A as well as Figure 11B The flowchart shown in the figure repeats multiple steps, so the following is a Figures 14A to 14D The steps included in the flowchart are the same as those described in the first embodiment. Figure 11A as well as Figure 11B The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0319] Figures 14A to 14D The flowchart shown is the same as Figure 11A as well as Figure 11B The flowchart shown in FIG. 1 is different in that step ST300 to step ST316 are included instead of step ST40 .

[0320] exist Figure 14A In the flowchart shown in FIG. 1 , after the process of step ST22 is performed, the exposure control process is transferred to step Figure 14B Step ST28 is shown. Figure 14B In the flowchart shown, after the process of step ST38 is performed, the exposure control process moves to step ST300.

[0321] In step ST300 , processor 64 determines whether the maximum value of difference δ1 calculated in step ST38 exceeds threshold TH5 . The maximum value of difference δ1 is an example of the “first maximum difference degree” of the present disclosure, and threshold TH5 is an example of the “predetermined difference degree” of the present disclosure.

[0322] Threshold TH5 represents the upper limit of the difference δ1 used to determine the adjustment value. This adjustment value is designed to minimize the user's visual perception of image quality degradation due to noise and other factors when sensitivity is adjusted using the adjustment value corresponding to the difference δ1. The upper limit is merely an example; a value lower than the upper limit within the acceptable range may also be used. While the sensitivity adjustment method described here is merely an example, this is merely an example. The threshold TH5 is determined similarly when adjusting the shutter speed and / or aperture value.

[0323] Threshold TH5 can be determined in advance through actual device testing and / or computer simulations, serving as the upper limit of difference δ1 used to achieve an adjustment value at which image quality degradation due to noise, etc., caused by sensitivity adjustment, is not visually noticeable to the user. The upper limit of difference δ1 used to achieve an adjustment value at which image quality degradation due to noise, etc., caused by sensitivity adjustment, is not visually noticeable to the user is merely an example; a value lower than the upper limit of difference δ1 used to achieve an adjustment value at which image quality degradation due to noise, etc., caused by sensitivity adjustment, is not visually noticeable to the user is also acceptable. Furthermore, threshold TH5 can be a fixed value or a variable value that changes according to given instructions or various conditions. Threshold TH5 can be a user-determined value or a value determined by the type of shooting mode.

[0324] In step ST300, if the maximum value of the difference δ1 calculated in step ST38 does not exceed the threshold value TH5, the determination is negative, and the exposure control process shifts to step ST300. Figure 14D In step ST300 , if the maximum value of the difference δ1 calculated in step ST38 exceeds the threshold value TH5 , the determination is affirmative, and the exposure control process shifts to step ST302 .

[0325] In step ST302, the processor 64 calculates the current transmittance TR current Transmittance TR during the time of change InTime The time required for the change is the change time T3. The calculation of the change time T3 is performed in the same manner as the calculation of the change time T1 and the change time T2 described in the first embodiment. current And the transmittance TR during the changing time InTime The change time T3 is calculated from the arithmetic expression using the change time T3 as the independent variable and the change time T3 as the dependent variable. After the process of step ST302 is performed, the exposure control process proceeds to step ST304.

[0326] In step ST304, processor 64 determines whether change time T3 is less than threshold value TH6. Here, change time T3 is an example of "transmittance change time" in the present disclosure, and threshold value TH6 is an example of "second threshold value" in the present disclosure.

[0327] The threshold TH6 is set in order to pass the current transmittance TR current The transmittance TR during the exposure time is changed InTimeWhen sensitivity is adjusted to achieve a desired exposure change, the lower limit of the change time T3 is set so that the noise generated by the sensitivity adjustment does not visually affect the image quality of frame 80 to a level that is perceived. The lower limit is merely an example; a value exceeding the lower limit within the allowable range may also be used. While the example of adjusting sensitivity is provided here, this is merely an example. Threshold TH6 is determined in the same manner when adjusting shutter speed and / or aperture value.

[0328] The threshold TH6 can also be used as a threshold in order to obtain the current transmittance TR current The transmittance TR during the exposure time is changed InTime When the sensitivity is adjusted due to the exposure change, the lower limit of the change time T3 at which the noise generated by the sensitivity adjustment does not affect the image quality of the frame 80 at a visually perceptible level is determined in advance through experiments based on actual equipment and / or computer simulations. current The transmittance TR during the exposure time is changed InTime When the sensitivity is adjusted to achieve the exposure change, the lower limit of the time during which the noise generated by the sensitivity adjustment may affect the image quality of frame 80 at a visually perceptible level is just an example, and it may also be within the allowable range to exceed the limit in order to obtain the image quality of the frame 80 through the current transmittance TR. current The transmittance TR during the exposure time is changed InTime When sensitivity is adjusted to achieve a change in exposure, the lower limit of the time during which noise generated by the sensitivity adjustment may visually affect the image quality of frame 80 to a level that is perceived. Furthermore, threshold TH6 may be a fixed value or a variable value that changes according to given instructions or various conditions. Threshold TH6 may be a value determined by the user or according to the type of shooting mode.

[0329] In step ST304, if the change time T3 is not less than the threshold value TH6 (that is, if the change time T3 is equal to or greater than the threshold value TH6), the determination is negative, and the exposure control process is transferred to step ST305. Figure 14D Step ST24 is shown. Thus, the same method as the first embodiment is used to perform Figure 14D The process of step ST24 and step ST26 shown in FIG. 24 is performed, and after the process of step ST26 is performed, the process of steps ST42 to ST46 is performed. In step ST304, if the change time T3 is less than the threshold value TH6, the determination is negative, and the exposure control process is transferred to step ST305. Figure 14C Step ST306 is shown.

[0330] exist Figure 14CIn step ST306, the processor 64 calculates a plurality of intermediate transmittances TR mid To update multiple actual transmittances TR real (Refer to Figure 15 ). Multiple intermediate transmittances TR mid is the light transmittance of the electronic ND filter 58 from the current light transmittance TR current After multiple intermediate transmittances TR mid Target transmittance TR target The time required for the change is below the threshold value TH1 and is equal to the ideal transmittance TR ideal Here, the multiple actual light transmittances TR updated by performing the process of step ST306 are real (Refer to Figure 15 ) is an example of the “multiple second actual transmittances” disclosed in the present invention, and the multiple intermediate transmittances TR mid This is an example of "multiple intermediate transmittances" in the present disclosure, the maximum value of difference δ1 is an example of "the first maximum degree of difference" in the present disclosure, and the maximum value of difference δ3 is an example of "the second maximum degree of difference" in the present disclosure. After the processing of step ST306 is performed, the exposure control process shifts to step ST308.

[0331] In step ST308, the processor 64 calculates the light transmittance of the electronic ND filter 58 so as to be equal to the current light transmittance TR current , multiple actual transmittances TR real (Refer to Figure 15 ) and target transmittance TR target The time required for the sequential change of the change is the change time T4. The calculation of the change time T4 is performed in the same manner as the calculation of the change time T1 and the change time T2 described in the first embodiment. The change time T4 is calculated by using the current transmittance TR current , multiple actual transmittances TR real (Refer to Figure 15 ) and target transmittance TR target As an independent variable, the calculation expression is calculated using the change time T4 as a dependent variable. After the process of step ST308 is performed, the exposure control process proceeds to step ST310.

[0332] In step ST310, processor 64 calculates the required number of frames (B3) required for the duration of change time T4, based on change time T4 and frame rate FR, in a manner similar to the first embodiment described above. For example, required number of frames B3 is calculated as "(change time T4) x (frame rate FR)." After step ST310, exposure control processing proceeds to step ST312.

[0333] In step ST312, the processor 64 performs the same procedure as in the first embodiment described above based on the required number of frames B3 and the target exposure EX target And the current transmittance TR current Calculate multiple split exposure EX div Multiple Split Exposure EX div The calculation of is performed in the same manner as in the first embodiment. div By using the required frame number B3, target exposure EX target And the current transmittance TR current As an independent variable, multiple split exposure EX div After the process of step ST312 is performed, the exposure control process proceeds to step ST314.

[0334] In step ST314, the processor 64 calculates a plurality of actual light transmittances TR , using the frame 80 within the required frame number B3 as a unit, in the same manner as in the first embodiment. real With multiple ideal transmittance TR ideal The difference in exposure between δ4 (refer to Figure 15 ). That is, in step ST314, the actual light transmittance TR is calculated for each frame 80 included in the required number of frames B3. real and ideal transmittance TR ideal After the process of step ST314 is performed, the exposure control process moves to step ST316.

[0335] In step ST316, the processor 64 adjusts the defined split exposure EX using the adjustment value corresponding to the difference δ4 for each frame 80 included in the required number of frames B3 in the same manner as in the first embodiment. div One of the exposure factors is the sensitivity (refer to Figure 15 After the process of step ST316 is performed, the exposure control process is transferred to Figure 14D Step ST42 is shown.

[0336] exist Figure 14D In step ST42 shown in FIG. 1 , the processor 64 causes the imaging device 10 to perform the exposure control operation based on the divided exposure EX for the Nth frame. div For example, when the exposure control process is transferred from step ST26 to step ST42, in step ST42, the processor 64 causes the imaging device 10 to perform the plurality of divided exposures EX calculated by performing the process of step ST26. div Split exposure EX for the Nth frame in div On the other hand, in the exposure control process Figure 14C When the step ST316 shown in the figure shifts to the step ST42, in step ST42, the processor 64 sets the sensitivity adjusted based on the difference δ4 calculated for the Nth frame, the shutter speed determined for the Nth frame, and the aperture value determined for the Nth frame to the imaging device 10, and sets the current transmittance TR to the electronic ND filter 58. current , multiple actual transmittances TR real And the target transmittance TR target That is, in the first embodiment, the difference δ1 is supplemented based on the sensitivity and the like, and the current transmittance TR is adjusted. current , multiple actual transmittances TR real And the target transmittance TR target Corresponding multiple split exposure EX div and the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target Corresponding multiple split exposure EX div In contrast, in the fourth embodiment, the difference δ4 is compensated based on the sensitivity and the like, and the current transmittance TR is adjusted accordingly. current , multiple actual transmittances TR real And the target transmittance TR target Corresponding multiple split exposure EX div and the current transmittance TR current , multiple ideal transmittances TR ideal And the target transmittance TR target Corresponding multiple split exposure EX div Consistent adjustments (see Figure 15 ).

[0337] As described above, in the imaging device 10 of the fourth embodiment, the transmittance TR within the variation time is included based on the variation width ratio. InTime Multiple actual transmittances TR real Small multiple actual transmittance TR real (Right now, Figure 15 The shown one contains multiple intermediate transmittances TR mid Multiple actual transmittances TR real ) and multiple ideal transmittances TR ideal (Refer to Figure 15 ) calculates the difference δ4. Then, by adjusting the sensitivity etc. based on the adjustment value determined according to the difference δ4, the plurality of divided exposures EX calculated as the actual exposure are converted to div Adjusting for ideal multiple split exposure EX divTherefore, it is possible to suppress the use of the actual exposure calculated for the plurality of divided exposures EX div Thus, it is possible to suppress the adjustment amount related to the adjustment of the sensitivity, etc. by using the actual exposure calculated for the multiple split exposures EX div The adjustment of sensitivity, etc. involves a large adjustment amount and may cause adverse conditions.

[0338] In the fourth embodiment, when the change time T3 is less than the threshold value TH6, the transmittance TR within the change time is calculated based on the fluctuation width ratio. InTime Multiple actual transmittances TR real Small multiple actual transmittance TR real (Right now, Figure 15 The shown one contains multiple intermediate transmittances TR mid Multiple actual transmittances TR real ) and multiple ideal transmittances TR ideal (Refer to Figure 15 ), calculate the difference δ4. Then, by adjusting the sensitivity based on the adjustment value determined based on the difference δ4, the multiple divided exposures EX calculated as the actual exposure are converted to div Adjusting for ideal multiple split exposure EX div Therefore, it is possible to suppress the use of the split exposure EX due to the change time T3 being too short. div The occurrence of a situation where the adjustment amount involved in adjusting the sensitivity, etc. increases.

[0339] [Fifth embodiment]

[0340] In the first embodiment described above, the example of the method based on the premise of a fixed aperture value is given, but in order to achieve the target exposure EX target When the aperture value changes (i.e., when the aperture 40C is driven), it is considered that the change time T1 does not converge to the drive time of the aperture 40C (i.e., the time required from the start to the end of the drive of the aperture 40C). Therefore, in this fifth embodiment, an example of setting the threshold value TH1 to the drive time of the aperture 40C when the change time T1 does not converge to the drive time of the aperture 40C will be described.

[0341] In the fifth embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the fourth embodiment, the differences from the first embodiment are mainly described.

[0342] In this fifth embodiment, referring to Figure 16 The flowchart shown in FIG. 1 is an example of the exposure control process of the fifth embodiment. Figure 15The flowchart shown includes the same steps as those described in the first embodiment. Figure 11A as well as Figure 11B The flowchart shown in the figure repeats multiple steps, so the following is a Figure 15 The steps included in the flowchart are the same as those described in the first embodiment. Figure 11A as well as Figure 11B The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0343] Figure 15 The flowchart shown is the same as Figure 11A as well as Figure 11B The flowchart shown in FIG. 1 is different in that steps ST400 to ST406 are included instead of steps ST16 and ST18 .

[0344] exist Figure 15 In step ST400, the processor 64 calculates the target exposure EX target Corresponding target transmittance TR target and target exposure EX target The corresponding target aperture value. For example, the target transmittance TR target And the target aperture value by using the shutter speed, sensitivity and target exposure EX target As an independent variable, the target transmittance TR target and the target aperture value as dependent variables. After the process of step ST400 is performed, the exposure control process moves to step ST402.

[0345] In step ST402, the processor 64 obtains the current transmittance TR current After the process of step ST402 is performed, the exposure control process moves to step ST404.

[0346] In step ST404, the processor 64 determines whether the aperture drive time T5 exceeds the threshold value TH1. Here, the aperture drive time T5 is the time required to drive the aperture 40C to achieve the target aperture value (in other words, the time required from the start to the end of driving the aperture 40C), that is, the time required to drive the aperture 40C from the current aperture value to the target aperture value. The aperture drive time T5 is calculated based on the current aperture value obtained in step ST402 and the target aperture value calculated in step ST400. For example, the aperture drive time T5 is calculated using an equation with the current aperture value and the target aperture value as independent variables and the aperture drive time T5 as a dependent variable.

[0347] In step ST404, if the diaphragm drive time T5 does not exceed the threshold value TH1, the exposure control process proceeds to step ST20. In step ST404, if the diaphragm drive time T5 exceeds the threshold value TH1, the exposure control process proceeds to step ST406.

[0348] In step ST406, processor 64 sets the aperture drive time T5 to threshold TH1. That is, the current value of threshold TH1 is changed to aperture drive time T5. While the example herein illustrates a method in which the current value of threshold TH1 is changed to aperture drive time T5, the current value of threshold TH1 can also be changed to a value that exceeds aperture drive time T5 within the permissible range. The value exceeding aperture drive time T5 within the permissible range can be a fixed value or a variable value that changes based on a given instruction and / or various conditions. After step ST406, exposure control processing shifts to step ST20.

[0349] As a result, the change time T1 converges to the diaphragm drive time T5 , and thus it is possible to suppress a problem caused by the change time T1 not converging to the diaphragm drive time T5 .

[0350] [Sixth embodiment]

[0351] In the above embodiments, various differences (e.g., differences δ1, δ2, δ3, and δ4) are calculated. However, ratios can be used instead of differences, as long as the difference between the two comparison objects is significant. Furthermore, in the above embodiments, differences are compared with threshold values. However, when comparing ratios with threshold values ​​instead of differences, threshold values ​​corresponding to ratios can be used instead of threshold values ​​corresponding to differences.

[0352] In the first to sixth embodiments described above, the time required for the light transmittance of the electronic ND filter 58 to change, i.e., the change time (e.g., change times T1, T2, T3, and T4), is exemplified. However, the number of frames may also be used as the change time. In other words, the concept of the change time may also include the number of frames.

[0353] In the first to sixth embodiments described above, various maximum values ​​(such as the maximum value of the difference δ1 and the maximum value of the difference δ3 ) are exemplified. However, any of the maximum values ​​described above means a maximum value within a predetermined range.

[0354] In the first to sixth embodiments described above, monotonic changes are exemplified, but monotonic changes refer to, for example, linear changes or changes in exponential functions, etc. Examples of monotonic changes include monotonic increases and monotonic decreases.

[0355] In the above-mentioned first to sixth embodiments, the exposure control processing is illustrated when shooting live view images, but the present disclosure is not limited to this. For example, if continuous shooting is performed, such as shooting for recording dynamic images, continuous shooting with a certain shooting interval, or continuous shooting with different shooting intervals, the above-mentioned exposure control processing can be applied.

[0356] While the first to sixth embodiments described above illustrate an example in which the exposure control program PG is stored in the memory 66, the present disclosure is not limited thereto. For example, the exposure control program PG may be stored in a portable computer-readable storage medium such as an SSD or USB memory device. The exposure control program PG stored in the non-transitory storage medium is installed in the system controller 12 of the imaging device 10. The processor 64 performs exposure control processing according to the exposure control program PG.

[0357] Alternatively, the exposure control program PG may be stored in a storage device such as another computer or server connected to the imaging device 10 via a network, downloaded in response to a request from the imaging device 10 , and installed in the system controller 12 .

[0358] Furthermore, the entire exposure control program PG does not need to be stored in a storage device such as another computer or server device connected to the imaging device 10 or in the memory 66 , and a portion of the exposure control program PG may be stored.

[0359] In addition, Figure 1 as well as Figure 2 The illustrated imaging device 10 includes a built-in system controller 12 , but the present disclosure is not limited thereto. For example, the system controller 12 may be provided outside the imaging device 10 .

[0360] In the first to sixth embodiments described above, the system controller 12 is exemplified, but the present disclosure is not limited thereto. A device including an ASIC, FPGA, and / or PLD may be used in place of the system controller 12. Furthermore, a combination of hardware and software configurations may be used in place of the system controller 12.

[0361] The various processors described below can be used as hardware resources for performing the exposure control processing described in the first through sixth embodiments. Examples of processors include general-purpose processors (CPUs) that function as hardware resources for performing the exposure control processing described in the first through sixth embodiments by executing software (i.e., programs). Other examples of processors include dedicated circuits (e.g., FPGAs, PLDs, and ASICs) with circuitry specifically designed for performing specific processing. Each processor has built-in or connected memory, and each processor performs the exposure control processing described in the first through sixth embodiments using memory.

[0362] The hardware resources for performing the exposure control processing of the first through sixth embodiments described above may consist of a single processor or a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, the hardware resources for performing the exposure control processing of the first through sixth embodiments described above may consist of a single processor.

[0363] As examples of a single processor, there is a first embodiment in which a single processor is composed of a combination of one or more CPUs and software, and this processor functions as a hardware resource for performing the exposure control processing of the first to sixth embodiments. A second embodiment in which a processor, such as a SoC, is used to implement the overall functionality of a system including multiple hardware resources for performing the exposure control processing of the first to sixth embodiments, using a single IC chip. In this manner, the exposure control processing of the first to sixth embodiments is implemented using one or more of the various processors described above as hardware resources.

[0364] Furthermore, as the hardware structure of these various processors, more specifically, circuits combining semiconductor devices and other circuit elements can be used. Furthermore, the exposure control processes described in the first to sixth embodiments are merely examples. Therefore, it is naturally possible to delete unnecessary steps, add new steps, or change the processing order without departing from the main purpose.

[0365] [Seventh embodiment]

[0366] However, as an example, Figure 17 As shown, when a plurality of frames 80 are obtained by shooting a live view image, when the aperture value of the aperture 40C (hereinafter referred to as "aperture value") is changed from the current aperture value FV1 to the current aperture value FV2, current Towards the target aperture value, that is, the target aperture value FV1 target When the aperture value FV1 changes monotonically, the brightness of the frame 80 also changes. In this case, it is preferable to change the aperture value FV1 from the current frame 80 to the current frame 80.current Towards target aperture value FV1 target The brightness is kept constant during the change of the number of frames required, that is, the target number of frames A11 and the subsequent frame 80. That is, it is preferable to keep the brightness constant during the change of the current aperture value FV1. current Towards target aperture value FV1 target During the period until the change, the target exposure EX1 is maintained as the target exposure target .

[0367] As one method for achieving this purpose, consider a method of changing the transmittance TR1 of the electronic ND filter 58 in accordance with the change in the aperture value FV1 while maintaining the shutter speed (for example, the shutter speed of the mechanical shutter when a mechanical shutter is used or the shutter speed of the electronic shutter when an electronic shutter is used) and the sensitivity of the photoelectric conversion element 72 (for example, ISO sensitivity) during the process of changing from the current frame 80 to the frame 80 after the target frame number A11, thereby compensating for the brightness that changes with the change in the aperture value FV1.

[0368] exist Figure 17 In the example shown, the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 to the current transmittance TR1 according to the change of the aperture value FV1. current Target transmittance TR1 target Change, the current transmittance TR1 current The target light transmittance TR1 is the light transmittance TR1 of the electronic ND filter 58 at the timing when the imaging device 10 starts exposure calculation. target The target exposure EX1 for maintaining the brightness of the frame 80 at the target brightness can be achieved. target .

[0369] The aperture value changes monotonically (in Figure 17 In the example shown, the change is linear), so if the transmittance TR1 of the electronic ND filter 58 is changed monotonically from the current transmittance TR1 to current Target transmittance TR1 target However, in order to achieve this, the target frame number A11 and the elapsed time T (i.e., the brightness between the current transmittance TR1 and the target frame number A11) must be the same. current Target transmittance TR1 target The number of frames required during the period (time required for the change) is the required number of frames B11 (=(frame rate FR1 used for shooting live view images) × (change time T)), and the transmittance TR1 of the electronic ND filter 58 reaches the target transmittance TR1 at the time when the frame 80 of the target frame number A11 is obtained. target .

[0370] However, as an example, Figure 18 As shown, according to the current transmittance TR1 current With target transmittance TR1 target Sometimes the number of frames B11 is required to exceed the target number of frames A11. In this case, the transmittance TR1 of the electronic ND filter 58 does not reach the target transmittance TR1 until the time when the frame 80 of the target number of frames A11 is obtained. target Thus, if the time required for the change of the aperture value FV1 does not coincide with the change time T, the target exposure EX1 cannot be set within the target frame number A11. target Continue to maintain a certain level. Figure 18 In the example shown, the transmittance TR1 of the electronic ND filter 58 reaches the target transmittance TR1. target Delayed by 2 frames from the target frame number A11.

[0371] Therefore, in the seventh embodiment, in order to make the transmittance TR1 of the electronic ND filter 58 follow the change of the aperture value FV1 within the target frame number A11 and to keep the brightness of the frame 80 constant (in other words, to make the target exposure EX1 target For example, Figure 19 As shown, the exposure control process is performed by the processor 64. The memory 66 stores the exposure control process program PG1. The exposure control process program PG1 is an example of a "program" in the present disclosure. The processor 64 reads the exposure control process program PG1 from the memory 66 and executes the read exposure control process program PG1 on the memory 68. The exposure control process is implemented by the processor 64 executing the exposure control process program PG1. The following describes an example of the exposure control process.

[0372] Figures 20 to 39 This is an example of the content of the exposure control processing performed by the processor 64. First, as an example, Figure 20 As shown, when the exposure calculation start timing arrives, processor 64 calculates a light metering value 1090 indicating the brightness of the subject based on frame 80 obtained by performing live view image shooting. Alternatively, light meter 1090 may be measured using an exposure meter (not shown).

[0373] The processor 64 calculates the target exposure EX1 based on the metered light value 1090. target , as the exposure for making the brightness of frame 80 used in the calculation of the metering value 1090 the target brightness. In addition, the processor 64 calculates the target exposure EX1 target Corresponding target transmittance TR1 target , that is, it can achieve target exposure EX1 target Target transmittance TR1 targetFor example, based on the shutter speed SP1, aperture value FV1, sensitivity SE1 and target exposure EX1 set for the imaging device 10 at the current time point target , calculate the target transmittance TR1 target Target transmittance TR1 target The calculation of target transmittance calculation formula 1091 is performed. The target transmittance calculation formula 1091 is a combination of shutter speed SP1, aperture value FV1, sensitivity SE1 and target exposure EX1. target As an independent variable, the target transmittance TR1 target An operation expression that is a dependent variable.

[0374] The processor 64 determines whether a change instruction to the aperture value FV1 different from the current aperture value FV1 has been given to the imaging device 10, that is, whether the aperture value FV1 has been changed from the current aperture value FV1 to the current aperture value FV1. current Towards target aperture value FV1 target Here, if the aperture value change instruction is not given to the imaging device 10, the aperture value FV1 at the current time, that is, the current aperture value FV1 is maintained. current . While maintaining the current aperture value FV1 current As an example, Figures 20 to 24 As shown, the processor 64 performs control to monotonically change the exposure applied to a plurality of frames 80 .

[0375] As an example, Figure 20 As shown, while maintaining the current aperture value FV1 current In the case of the current time point, the processor 64 obtains the transmittance TR1 set for the electronic ND filter 58, that is, the current transmittance TR1 current Furthermore, the processor 64 uses the change time calculation formula 1092 to calculate the current transmittance TR1 obtained from the current Towards the calculated target transmittance TR1 target The ideal change time is the change time T11. current Target transmittance TR1 target Ideally, the change time is from the current transmittance TR1 current Target transmittance TR1 target Monotonically changing time. Monotonically changing means changing at a constant amount (e.g., linear or exponential). The changing time equation 1092 is the target transmittance TR1. target And the current transmittance TR1 current In the seventh embodiment, the target exposure EX1 is calculated as follows:target This is an example of the “target exposure” disclosed in the present invention. The current transmittance TR1 current This is an example of the “first light transmittance” of the present disclosure, and the target light transmittance TR1 target This is an example of the “second light transmittance” in the present disclosure.

[0376] As an example, Figure 21 As shown, the processor 64 determines whether the change time T11 exceeds the threshold value TH11. In the seventh embodiment, the threshold value TH11 is based on the change in the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1. current Target transmittance TR1 target The ideal waiting time until the target exposure EX1 is achieved is the ideal waiting time until the target exposure EX1 is achieved under the conditions that the aperture value FV1, shutter speed SP1 and sensitivity SE1 are fixed. target The threshold TH11 may be a fixed value or a variable value that changes according to given instructions or various conditions. As an example of the threshold TH11, the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 to the current transmittance TR1. current Target transmittance TR1 target The threshold value TH11 may be a time determined by the user, a time determined according to the type of shooting mode, or a time specified within a range of several percent to several tens of percent of the maximum time obtained from a table that determines the time for the transmittance TR1 of the electronic ND filter 58 to change (for example, a time equivalent to 50% of the maximum time obtained from a table that determines the time for the transmittance TR1 of the electronic ND filter 58 to change).

[0377] When the change time T11 does not exceed the threshold value TH11 (in other words, when the magnitude relationship of “change time T11≦threshold value TH11” holds), that is, when the transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current Expose EX1 to the target target If the time required for the change to occur falls within the ideal time, processor 64 calculates the number of frames required to pass through change time T11, i.e., frame rate B1, based on change time T11 and frame rate FR1 (e.g., a frame rate equivalent to the above-mentioned frame rate). For example, frame rate B1 is calculated as "(change time T11) x (frame rate FR1)".

[0378] The processor 64 is based on the target exposure EX1 target Multiple split exposures EX1 are obtained by changing the time T11 div1 Multiple Split Exposure EX1 div1The target exposure EX1 is obtained by target Calculate multiple split exposures EX1 using frame rate B1 div1 Use the split exposure calculation formula 1093 to perform multiple split exposures EX1 div1 The split exposure calculation formula 1093 is to calculate the current transmittance TR1 current Target exposure EX1 target and frame rate B1 as independent variables, multiple split exposures EX1 div1 Here, multiple split exposures EX1 div1 This is a split exposure EX1 with the same number of frames as the frame rate B1. div1 .

[0379] Multiple Split Exposure EX1 div1 From the current transmittance TR1 current Corresponding split exposure EX1 div1 To target exposure EX1 target Changes monotonically. For example, multiple split exposures EX1 div1 From the current transmittance TR1 current Corresponding split exposure EX1 div1 To target exposure EX1 target Linear change: Although linear change is exemplified here, it may also change exponentially, as long as it changes monotonically in accordance with the change in the aperture value FV1.

[0380] Multiple Split Exposure EX1 div1 and determines from the current transmittance TR1 current Target transmittance TR1 target Ideally, the process of changing (for example, the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 current Target transmittance TR1 target The current transmittance TR1 of the process of changing with a certain amount of change current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target Corresponding. Figure 21 In the example shown, the current transmittance TR1 current Corresponding to the frame rate B1 of “0”, the ideal transmittance TR1 ideal1 The target transmittance TR1 corresponds to the frame rates “1”, “2”, “3” and “4” of B1 respectively. target Corresponds to "5" of the frame rate B1.

[0381] The light transmittance TR1 of the electronic ND filter 58 is based on the current light transmittance TR1 current , multiple ideal transmittances TRideal1 And the target transmittance TR1 target Change. Current transmittance TR1 current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target From the current transmittance TR1 current To target transmittance TR1 target Changes monotonically. Figure 21 In the example shown, the current transmittance TR1 current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target The frame rate B1 changes monotonically from "0" to "5".

[0382] From the current transmittance TR1 current Corresponding split exposure EX1 div1 To target exposure EX1 target The monotonic change of the exposure of the frame 80 is achieved by making the current transmittance TR1 constant while the shutter speed SP1, sensitivity SE1 and aperture value FV1 are fixed. current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target From the current transmittance TR1 current To target transmittance TR1 target This is achieved by monotonically changing the current transmittance TR1. current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target From the current transmittance TR1 current To target transmittance TR1 target An example of monotonically changing is to make the current transmittance TR1 current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target From the current transmittance TR1 current To target transmittance TR1 target An example of a change with a constant amount of change between frames 80.

[0383] The processor 64 applies a plurality of split exposures EX1 to the exposure of a plurality of frames 80 obtained by performing live view image shooting within the change time T11. div1 For example, the processor 64 sets the corresponding split exposure EX1 for the imaging device 10 for each frame. div1 Here, the split exposure EX1 div1For example, the setting is to enable split exposure EX1 for the electronic ND filter 58 while maintaining the shutter speed SP1, the aperture value FV1, and the sensitivity SE1. div1 That is, while maintaining the shutter speed SP1, the aperture value FV1 and the sensitivity SE1, the split exposure EX1 calculated for each frame 80 is set. div1 In order to perform live view image shooting, the transmittance TR1 of the electronic ND filter 58 is controlled.

[0384] On the other hand, as an example, Figure 22 As shown, when the change time T11 exceeds the threshold value TH11, that is, when the transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current Expose EX1 to the target target If the time required for the change to converge to the ideal time does not converge to the ideal time, the processor 64 uses the transmittance calculation formula 1094 to calculate the transmittance TR1 within the range where the change time T11 converges to the threshold value TH11, that is, the transmittance TR1 within the change time InTime1 The transmittance TR1 of the electronic ND filter 58 is obtained by converting the change time T11, the threshold TH11, and the current transmittance TR1 into a transmittance calculation formula 1094. current And the target transmittance TR1 target As an independent variable, the transmittance TR1 during the change time InTime1 An operation expression that is a dependent variable.

[0385] The processor 64 uses the change time calculation formula 1096 to calculate the time required to change the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 current Transmittance TR1 after changing time InTime1 Target transmittance TR1 target The time required for the change is the change time T21. The change time calculation formula 1096 is to convert the current transmittance TR1 current , Transmittance TR1 during the changing time InTime1 And the target transmittance TR1 target An operation expression in which the change time T21 is used as an independent variable and the change time T21 is used as a dependent variable.

[0386] The processor 64 calculates the required number of frames B21, which is the number of frames required during the period of change time T21, based on the change time T21 and the frame rate FR1. For example, the required number of frames B21 is calculated as "(change time T21) x (frame rate FR1)".

[0387] The processor 64 is based on the required number of frames B21, the target exposure EX1 target And the current transmittance TR currentCalculate multiple split exposures EX1 div1 Use the split exposure calculation formula 1098 to perform multiple split exposures EX1 div1 Calculation.

[0388] Split exposure calculation formula 1098 is to convert the required number of frames B21, target exposure EX1 target And the current transmittance TR1 current As an independent variable, multiple split exposures EX1 div1 Here, multiple split exposures EX1 div1 This is a split exposure EX1 with the same number of frames as the required number of frames B21. div1 .

[0389] The processor 64 is based on the plurality of divided exposures EX1 div1 And given the known transmittance, calculate multiple ideal transmittances TR1 ideal1 And multiple actual transmittance TR1 real1 Here, the known transmittance refers to the current transmittance TR1 current 、Target transmittance TR1 target And the transmittance TR1 during the changing time InTime1 . Multiple ideal transmittance TR1 ideal1 And multiple actual transmittance TR1 real1 The calculation of transmittance is performed using the transmittance calculation formula 1100. The transmittance calculation formula 1100 is a combination of multiple split exposures EX1 div1 、Current transmittance TR1 current 、Target transmittance TR1 target And the transmittance TR1 during the changing time InTime1 As an independent variable, multiple ideal transmittances TR1 ideal1 And multiple actual transmittance TR1 real1 An operation expression that is a dependent variable.

[0390] Multiple actual transmittance TR1 real1 The change time T21 is determined to be less than the threshold value TH11 and the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 current Target transmittance TR1 target Here, the actual change means that the transmittance TR1 of the electronic ND filter 58 can be changed from the current transmittance TR1 to the value TR1 within the time below the threshold TH11. current Target transmittance TR1 target When the transmittance TR1 of the electronic ND filter 58 is actually changed, the transmittance TR1 of the electronic ND filter 58 is preferably changed from the current transmittance TR1 to the current transmittance TR1.current Target transmittance TR1 target Since the change in TR1 is timely within the time period below the threshold value TH11, the transmittance TR1 of the electronic ND filter 58 does not change monotonically with a constant change amount.

[0391] When the change time T11 exceeds the threshold value TH11 and live view image shooting is performed, a plurality of actual transmittances TR1 are set for the electronic ND filter 58. real1 This is because, when shooting for live view images, even though the change time T11 exceeds the threshold value TH11, a plurality of ideal transmittances TR1 are set for the electronic ND filter 58. ideal1 When the current transmittance TR1 current Target transmittance TR1 target The change in is not completed within the time below the threshold TH11.

[0392] exist Figure 22 In the example shown, it is shown that the change time T21 is determined to be less than the threshold value TH11 and the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 current Target transmittance TR1 target The multiple transmittances TR1 of the process that actually changes, that is, as the multiple actual transmittances TR1 real1 An example of determining the change time T21 is less than the threshold value TH11 and the transmittance TR1 is changed from the current value. current Transmittance TR1 after changing time InTime1 Target transmittance TR1 target The multiple transmittance TR1 of the process changes. Figure 22 In the example shown, at the current transmittance TR1 current With target transmittance TR1 target The transmittance TR1 during the change time is determined to make the change time T21 less than the threshold value TH11. InTime1 . Multiple actual transmittance TR1 real1 Based on the current transmittance TR1 current And the transmittance TR1 during the changing time InTime1 Decision. That is, Figure 22 In the example shown, from the current transmittance TR1 current Transmittance TR1 within the change time InTime1 The plurality of light transmittances TR1 that change monotonically (for example, the plurality of light transmittances TR1 that change linearly) include the light transmittance TR1 within the change time. InTime1 It is determined to be a plurality of actual transmittances TR1 real1 .

[0393] Current transmittance TR1 currentAnd multiple actual transmittance TR1 real1 From the current transmittance TR1 current Transmittance TR1 within the change time InTime1 Changes monotonically. Figure 22 In the example shown, the current transmittance TR1 current And multiple actual transmittance TR1 real1 From the current transmittance TR1 current Transmittance TR1 within the change time InTime1 Changes linearly.

[0394] The processor 64 adjusts the transmittance TR1 of the electronic ND filter 58 to the current transmittance TR1. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target However, while maintaining the shutter speed SP1, the aperture value FV1, and the sensitivity SE1, the transmittance TR1 of the electronic ND filter 58 is adjusted to the current transmittance TR1. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target When the transmittance TR1 of the electronic ND filter 58 changes, the shutter speed SP1, the aperture value FV1 and the sensitivity SE1 are maintained, and the current transmittance TR1 is used. current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target Compared with the case where the brightness changes between frames 80, the change in brightness between frames 80 becomes larger.

[0395] Therefore, in the seventh embodiment, even if the transmittance TR1 of the electronic ND filter 58 is adjusted to the current transmittance TR1 current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target In order to maintain the shutter speed SP1, the aperture value FV1 and the sensitivity SE1 under the transmittance TR1 of the electronic ND filter 58, the current transmittance TR1 is used. current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target The brightness of the frame 80 is changed at the same level. First, as an example, Figure 23 As shown, the processor 64 calculates multiple actual transmittances TR1 using the frame 80 obtained within the required frame number B21 as a unit. real1 With multiple ideal transmittance TR1 ideal1The difference δ11 between the exposures is an indicator of the magnitude of the change in brightness between the frames 80. In other words, the difference δ11 indicates the degree of deviation from the ideal brightness of the frame 80 (i.e., the difference in the actual transmittance TR1). real1 The exposure achieved is consistent with the ideal transmittance TR1 ideal1 degree of exposure deviation achieved).

[0396] Exposure is defined by shutter speed SP1, aperture value FV1, and sensitivity SE1 in addition to the transmittance TR1 of the electronic ND filter 58. Therefore, the difference δ11 can be set to zero by adjusting the shutter speed SP1, aperture value FV1, and / or sensitivity SE1. Therefore, the processor 64 adjusts the current transmittance TR1 based on the difference δ11. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target Corresponding multiple split exposure EX1 div1 (ie, from the current transmittance TR1 current Change to target transmittance TR1 target Each split exposure of the process EX1 div1 In other words, the processor 64 compensates the difference δ11 with the shutter speed SP1, the aperture value FV1 and / or the sensitivity SE1 to make it consistent with the current transmittance TR1. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target Corresponding multiple split exposure EX1 div1 And the current transmittance TR1 current , multiple ideal transmittance TR1 ideal1 And the target transmittance TR1 target Corresponding multiple split exposure EX1 div1 In other words, the number of frames B21 contains each frame 80, so that the actual transmittance TR1 real1 Split exposure EX1 div1 Become the ideal light transmittance TR1 ideal1 Split exposure EX1 div1 In this manner, the shutter speed SP1, the aperture value FV1 and / or the sensitivity SE1 are adjusted using an adjustment value corresponding to the difference δ11 (for example, an adjustment value determined according to the difference δ11).

[0397] In the use of multiple actual transmittance TR1 real1 In the case of shooting a live view image using the transmittance TR1 of the electronic ND filter 58, for example, Figure 24As shown, the difference δ11 is compensated by adjusting the sensitivity SE1 based on the adjustment values ​​α1 to α4 for adjusting the sensitivity SE1.

[0398] Thus, by adjusting the sensitivity SE1 based on the adjustment values ​​α1 to α4 corresponding to the difference δ11, the transmittance TR1 of the electronic ND filter 58 is adjusted to the current transmittance TR1. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target It is also possible to achieve and use multiple actual transmittances TR1 while maintaining the shutter speed SP, aperture value FV1 and sensitivity SE1. real1 The split exposure EX1 is the same level as the case of the transmittance TR1 of the electronic ND filter 58 div1 .

[0399] Adjustment values ​​α1 to α4 are each uniquely determined based on the difference δ11 calculated per frame 80. For example, adjustment values ​​α1 to α4 are calculated using adjustment value equation 1102, which uses difference δ11 as the independent variable and the adjustment value for adjusting sensitivity SE1 as the dependent variable. While the example herein illustrates adjusting sensitivity SE1 based on difference δ11, this is merely an example. Alternatively, shutter speed SP1 and / or aperture value FV1 may be adjusted based on difference δ11. In this case, adjustment values ​​for shutter speed SP1 and / or aperture value FV1 can be calculated using the same equation as adjustment value equation 1102.

[0400] When live view imaging is performed within the change time T21, the processor 64 sets the sensitivity SE1 adjusted based on the difference δ11 calculated in units of frames 80, the shutter speed SP1 determined for each frame 80, and the aperture value FV1 determined for each frame 80, in the imaging device 10. In addition, the processor 64 sets the current transmittance TR1 to current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target The transmittance TR1 of the electronic ND filter 58 is set. In this way, during the live view image shooting within the change time T21, by setting the sensitivity SE1 adjusted based on the difference δ11 calculated in units of frames 80 as described above, the shutter speed SP1 determined for each frame 80, the aperture value FV1 determined for each frame 80, and the current transmittance TR1, current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target , multiple split exposures EX1 that change monotonically are applied to the exposure of multiple frames 80 div1 .

[0401] In the seventh embodiment, live view imaging is an example of “imaging by an imaging device” in the present disclosure. In the seventh embodiment, frame rate FR1 is an example of “predetermined frame rate” in the present disclosure.

[0402] exist Figures 20 to 24 In the example shown, the current aperture value FV1 is maintained. current In the case of the processor 64, the exposure applied to the plurality of frames 80 is monotonically changed, but when the current aperture value FV1 is set to current Towards target aperture value FV1 target For example, if the Figures 25 to 39 As shown, the processor 64 controls the exposure to maintain a constant level across a plurality of frames 80 .

[0403] As an example, Figure 25 As shown, the processor 64 determines whether an aperture value change instruction is given to the imaging device 10. Here, when the aperture value change instruction is given to the imaging device 10, the processor 64 starts to change the aperture value FV1 of the aperture 40C from the current aperture value FV1 current Towards target aperture value FV1 target Control of change.

[0404] As an example, Figure 25 As shown, the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1 current Towards target aperture value FV1 target If the aperture value FV1 changes, the processor 64 determines whether the electronic ND filter 58 can follow the change in the aperture value FV1 (here, as an example, from the current aperture value FV1 current Towards target aperture value FV1 target That is, it is determined whether the transmittance TR1 of the electronic ND filter 58 can be made to compensate for the brightness change accompanying the change in the aperture value FV1 (in other words, whether the exposure difference corresponding to the change in the aperture value FV1 can be compensated by changing the transmittance TR1 of the electronic ND filter 58). In the seventh embodiment, the transmittance TR1 of the electronic ND filter 58 is an example of the "transmittance of the electronic neutral density filter" in the present disclosure.

[0405] Figures 25 to 27 This shows that when the electronic ND filter 58 cannot follow the amount of change in the aperture value FV1, the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1. current Towards target aperture value FV1 target An example of the changed control content.

[0406] As an example, Figure 25 As shown, when the electronic ND filter 58 cannot follow the change in the aperture value FV1, the processor 64 performs the operation based on the current aperture value FV1. current , target aperture value FV1 target 、Current transmittance TR1 current and target exposure EX1 target , calculate the target sensitivity SE1 target and target shutter speed SP1 target Target sensitivity SE1 target It refers to the ability to be combined with other exposure factors (here, as an example, the current aperture value FV1 current , target aperture value FV1 target 、Current transmittance TR1 current and target shutter speed SP1 target )Together we achieve target exposure EX1 target Target sensitivity SE1. Target shutter speed SP1 target It refers to the ability to be combined with other exposure factors (here, as an example, the current aperture value FV1 current , target aperture value FV1 target 、Current transmittance TR1 current and target sensitivity SE1 target )Together we achieve target exposure EX1 target The shutter speed is SP1.

[0407] Target sensitivity SE1 target and target shutter speed SP1 target The calculation is performed using the exposure factor equation 1104. The exposure factor equation 1104 is the current aperture value FV1 current , target aperture value FV1 target 、Current transmittance TR1 current and target exposure EX1 target As an independent variable, the target sensitivity SE1 target and target shutter speed SP1 target As a dependent variable, the operation formula. In the seventh embodiment, the exposure factor represents a factor that defines exposure. Exposure is defined by multiple exposure factors, including transmittance TR1, aperture value FV1, sensitivity SE1, and shutter speed SP1.

[0408] In addition, when the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1 current Towards target aperture value FV1 target In the case of changes, the processor 64 based on the current aperture value FV1 current And the target aperture value FV1 targetCalculate the driving time of the aperture 40C, that is, the aperture driving time T1 FV Aperture drive time T1 FV The aperture value FV1 of the aperture 40C is increased from the current aperture value FV1 current Towards target aperture value FV1 target The time required for the change. Use the aperture drive time calculation formula 1106 to calculate the aperture drive time T1 FV The aperture drive time calculation formula 1106 is to calculate the current aperture value FV1 current And the target aperture value FV1 target As an independent variable, the aperture drive time T1 FV As the calculation formula of the dependent variable. In the seventh embodiment, the aperture drive time T1 FV This is an example of the “aperture driving time” in the present disclosure.

[0409] As an example, Figure 26 As shown, the processor 64 generates the iris drive time T1 based on the iris drive time T1. FV And the frame rate FR1, calculation and aperture drive time T1 FV The corresponding number of frames, that is, after the aperture drive time T1 FV The number of frames obtained by shooting the live view image during the period is the required number of frames B31. For example, the required number of frames B31 is calculated by "(aperture drive time T1 FV )×(frame rate FR1)”. In the seventh embodiment, the required number of frames B31 is an example of the “second number of frames”, “fourth number of frames”, and “sixth number of frames” in the present disclosure.

[0410] The processor 64 calculates the number of frames required based on the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target Calculate multiple predicted aperture values ​​FV1 pred0 Multiple predicted aperture values ​​FV1 pred0 They are respectively predicted from the current aperture value FV1 current To the target aperture value FV1 target The value of the aperture value FV1 used for each frame 80 obtained so far. Multiple predicted aperture values ​​FV1 pred0 Contains the current aperture value FV1 current And the target aperture value FV1 target Multiple predicted aperture values ​​FV1 pred0 The calculation of the aperture value is performed using the aperture value calculation formula 1107. The aperture value calculation formula 1107 is the required number of frames B31, the current aperture value FV1 current And the target aperture value FV1 target As independent variables, multiple predicted aperture values ​​FV pred0An operation expression that is a dependent variable.

[0411] The processor 64 calculates the light transmittance TR1 based on the current light transmittance TR1. current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred0 , calculate multiple split exposures EX1 div2 Current sensitivity SE1 current The current shutter speed SP1 is the sensitivity SE1 set for the imaging device 10 at the current time. current It is the shutter speed SP1 set for the imaging device 10 at the current time. Multiple split exposures EX1 div2 The number of predicted aperture values ​​FV1 pred0 Multiple split exposure EX1 div2 They are respectively the aperture drive time T1 FV The exposure of the multiple frames 80 obtained during the period is based on the current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred0 Predicted exposure. Use the split exposure calculation formula 1108 to perform multiple split exposures EX1 div2 The split exposure calculation formula 1108 is to calculate the current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred0 As an independent variable, multiple split exposures EX1 div2 An operation expression that is a dependent variable.

[0412] The processor 64 is based on the target exposure EX1 target and multiple split exposure EX1 div2 Calculate multiple exposure differences EX1 diff Multiple exposure difference EX1 diff Target exposure EX1 target EX1 with multiple split exposures div2 Here, the difference is shown as an example, but it can also be a ratio as long as it represents the target exposure EX1 target With Split Exposure EX1 div2 The difference index can be used.

[0413] The processor 64 is based on a plurality of exposure differences EX1 diffCalculate multiple sensitivity adjustment values ​​Δ1a and shutter speed adjustment values ​​Δ1b. The number of multiple sensitivity adjustment values ​​Δ1a and multiple exposure differences EX1 diff The number of shutter speed adjustment values ​​Δ1b is also the same as the number of exposure differences EX1 diff The multiple sensitivity adjustment values ​​Δ1a are to obtain the sensitivity of the image after the aperture drive time T1. FV The brightness of the multiple frames 80 obtained during the period is kept at a certain required sensitivity SE1 and used for the current sensitivity SE1 current The shutter speed adjustment value Δ1b is to obtain the shutter speed after the aperture drive time T1 has passed. FV The brightness of the multiple frames 80 obtained during the period is kept at a certain shutter speed SP1 and the current shutter speed SP1 current The calculation of the multiple sensitivity adjustment values ​​Δ1a and shutter speed adjustment values ​​Δ1b is performed using the adjustment value calculation formula 1109. The adjustment value calculation formula 1109 is a formula that converts the multiple exposure differences EX1 diff The calculation formula has a plurality of sensitivity adjustment values ​​Δ1 a as independent variables and a plurality of shutter speed adjustment values ​​Δ1 b as dependent variables.

[0414] The processor 64 uses the multiple sensitivity adjustment values ​​Δ1a to adjust the current sensitivity SE1 current Thus, the same number of sensitivity adjustment values ​​Δ1a as the sensitivity adjustment values ​​SE1 are obtained. In addition, the processor 64 uses the multiple shutter speed adjustment values ​​Δ1b to adjust the current sensitivity SE1. current Thus, the same number of adjusted shutter speeds SP1 as the plurality of shutter speed adjustment values ​​Δ1b are obtained.

[0415] During the aperture drive time T1 FV When live view image shooting is performed, the exposure of the plurality of frames 80 obtained by performing live view image shooting is determined by the current transmittance TR1. current And aperture drive time T1 FV The obtained multiple sensitivity adjustment values ​​Δ1a are the multiple adjusted sensitivities SE1 and the target sensitivity SE1 target , multiple shutter speeds SP1 adjusted by multiple shutter speed adjustment values ​​Δ1b, target shutter speed SP1 target , multiple predicted aperture values ​​FV1 pred0 And the current transmittance TR1 current For example, Figure 27 As shown, the processor 64 is in the aperture driving time T1 FV Based on the current transmittance TR1 current, multiple sensitivities SE1 adjusted based on multiple sensitivity adjustment values ​​Δ1a, target sensitivity SE1 target , a plurality of shutter speeds SP1 adjusted based on a plurality of shutter speed adjustment values ​​Δ1b, a target shutter speed SP1 target And multiple predicted aperture values ​​FV1 pred0 The exposure of the camera 10 is such that the camera 10 performs live view image shooting. FV The exposure of the plurality of frames 80 obtained by capturing live view images is kept constant.

[0416] exist Figures 25 to 27 In the example shown, the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1 to the current aperture value FV1 when the electronic ND filter 58 cannot follow the change in the aperture value FV1. current Towards target aperture value FV1 target An example of a change in control content, in contrast, Figures 28 to 39 This shows that the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1 to the value FV2 when the electronic ND filter 58 can follow the change in the aperture value FV1. current Towards target aperture value FV1 target An example of the control content of the change. If the electronic ND filter 58 can follow the change in the aperture value FV1, the aperture value FV1 of the aperture 40C is changed from the current aperture value FV1 current Towards target aperture value FV1 target In the control of changes, based on the transmittance TR1 and the aperture drive time T1 FV The exposure of the plurality of frames 80 obtained by performing live view image capturing is controlled.

[0417] As an example, Figure 28 As shown, when the electronic ND filter 58 can follow the change in the aperture value FV1, the processor 64 performs the operation based on the current aperture value FV1. current And the target aperture value FV1 target Calculate the aperture drive time T1 FV Aperture drive time T1 FV The calculation is based on Figure 25 The example shown is carried out in the same manner.

[0418] In addition, when the electronic ND filter 58 can track the amount of change in the aperture value FV1, the processor 64 adjusts the exposure value based on the target exposure EX1. target , target aperture value FV1 target And multiple current exposure factors, calculate and target exposure EX1 target Corresponding target transmittance TR1 targetHere, the current exposure factor means the exposure factor that defines the current exposure. The multiple current exposure factors used here are the current transmittance TR1 current , current aperture value FV1 current 、Current sensitivity SE1 current and the current shutter speed SP1 current Target transmittance TR1 target The calculation of target transmittance is performed using the target transmittance calculation formula 1110. The target transmittance calculation formula 1110 is the target exposure EX1 target , target aperture value FV1 target As well as multiple current exposure factors as independent variables, the target transmittance TR1 target An operation expression that is a dependent variable.

[0419] The processor 64 calculates the target transmittance TR1 based on the target transmittance TR1. target And the current transmittance TR1 current Calculate the change time T11. The calculation of the change time T11 is based on Figure 20 The example shown is carried out in the same manner.

[0420] In the seventh embodiment, when the electronic ND filter 58 can follow the change in the aperture value FV1, the Figure 28 The aperture drive time T1 shown FV and Figure 28 The multiple split exposures EX1 are determined by the change time T11 shown in FIG. div3 (Refer to Figure 32 ) or multiple split exposures EX1 div4 (Refer to Figure 37 ) is applied by passing the aperture drive time T1 FV The exposure of the plurality of frames 80 obtained by capturing the live view image is performed during the period, thereby controlling the exposure of the plurality of frames 80. Figures 29 to 39 An example of the control content for realizing this control is shown in FIG. Figures 29 to 34 , it is shown that by dividing the exposure EX1 into multiple div3 (Refer to Figure 32 ) applies after the aperture drive time T1 FV An example of a method for controlling the exposure of multiple frames 80 by taking a live view image during a period of time. Figures 35 to 39 , it is shown that by dividing the exposure EX1 into multiple div4 (Refer to Figure 37 ) applies after the aperture drive time T1 FV An example of a method of controlling the exposure of multiple frames 80 by capturing a live view image during a period of time.

[0421] As an example, Figure 29 As shown, the processor 64 determines the aperture drive time T1 FV The threshold value TH21 is the value of the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1. current Target transmittance TR1 target The ideal waiting time until the target exposure EX1 is achieved is the ideal waiting time until the target exposure EX1 is achieved under the condition that the shutter speed SP1 and the sensitivity SE1 are fixed. target The ideal time until the time is reached) and is based on the aperture value FV1 from the current aperture value FV1 current Towards target aperture value FV1 target The value is determined by the ideal waiting time until the change. As the transmittance TR1 based on the electronic ND filter 58 is changed from the current transmittance TR1 current Target transmittance TR1 target The ideal waiting time until the aperture value FV1 changes from the current aperture value FV1 current Towards target aperture value FV1 target An example of a value determined by an ideal waiting time until the light transmittance TR1 of the electronic ND filter 58 changes from the current light transmittance TR1 current Target transmittance TR1 target The upper limit of the ideal waiting time until the change, and the current aperture value FV1 current Towards target aperture value FV1 target The larger of the upper limits of the ideal standby time until the transmittance TR1 of the electronic ND filter 58 changes. Threshold TH21 may be a fixed value or a variable value that changes according to given instructions or various conditions. Furthermore, threshold TH21 may be a time determined by the user, a time determined according to the type of shooting mode, or a time specified within a range of several percent to several tens of percent of the maximum time obtained from a table that determines the time for the transmittance TR1 of the electronic ND filter 58 to change (for example, a time equivalent to 50% of the maximum time obtained from a table that determines the time for the transmittance TR1 of the electronic ND filter 58 to change).

[0422] During the aperture drive time T1 FV When the change time T11 and the threshold value TH21 are exceeded, the processor 64 performs the first control 1112 to control the aperture drive time T1112. FVWhen the change time T11 is less than or equal to the threshold value TH21, the processor 64 performs the second control 1114. In the seventh embodiment, the threshold value TH21 is an example of the "first threshold value," "third threshold value," "fifth threshold value," and "seventh threshold value" of the present disclosure. In the seventh embodiment, the first control 1112 is an example of the "first control" of the present disclosure, and the second control 1114 is an example of the "second control" of the present disclosure.

[0423] Figures 29 to 34 An example of the content of the first control 1112 is shown. The first control 1112 includes the following steps: current Target transmittance TR1 target The time required for the change is set as the aperture drive time T1 FV inside, and will be based on the current transmittance TR1 current Target transmittance TR1 target The actual change time and the aperture drive time T1 FV The multiple split exposures EX1 div3 (Refer to Figure 32 ) is applied to the exposure control of multiple frames 80 obtained by shooting for live view images.

[0424] To implement the first control 1112, as an example, Figure 30 As shown, the processor 64 generates the iris drive time T1 based on the iris drive time T1. FV (Refer to Figure 28 ), change time T11 (refer to Figure 28 ), current transmittance TR1 current And the target transmittance TR1 target Calculate the transmittance TR1 during the driving time InTime2 . Transmittance TR1 during driving time InTime2 Exists in the current transmittance TR1 current With target transmittance TR1 target The transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 current Target transmittance TR1 target The time required for the change is set as the aperture drive time T1 FV By changing the transmittance of the electronic ND filter 58 from the current transmittance TR1 current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target The transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current Target transmittance TR1 target The time required for the change to converge to the transmittance TR1 within the driving timeInTime2 Inside.

[0425] Transmittance TR1 during driving time InTime2 The calculation of transmittance is performed using the transmittance calculation formula 1116. The transmittance calculation formula 1116 is to convert the aperture drive time T1 FV , change time T11, current transmittance TR1 current And the target transmittance TR1 target As an independent variable, the transmittance TR1 during the driving time InTime2 As the calculation formula of the dependent variable. In the seventh embodiment, the light transmittance TR1 during the driving time is InTime2 This is an example of the “third light transmittance” and the “fourth light transmittance” in the present disclosure.

[0426] The processor 64 is based on the aperture drive time T1 FV And frame rate FR1, calculate the number of frames B31. The calculation of the number of frames B31 is based on Figure 26 The example shown is calculated using the same method.

[0427] The processor 64 calculates the number of frames required based on the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target Calculate multiple predicted aperture values ​​FV1 pred1 Multiple predicted aperture values ​​FV1 pred1 is with Figure 26 The multiple predicted aperture values ​​FV1 shown pred0 Aperture value synonymous with Figure 26 The example shown is calculated using the same method.

[0428] As an example, Figure 31 As shown, the processor 64 calculates the transmittance TR1 during the driving time. InTime2 、Current transmittance TR1 current And the target transmittance TR1 target , calculate the transmittance TR1 of the electronic ND filter 58 during the aperture driving time T1 FV From the current transmittance TR1 current Target transmittance TR1 target The actual change time is the change time T31. In other words, the change time T31 can also be said to be the time required to change the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 to the current transmittance TR1. current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target The time required for the change. The change time T31 is calculated using the change time calculation formula 1118. The change time calculation formula 1118 is the light transmittance TR1 during the driving time. InTime2 、Current transmittance TR1current And the target transmittance TR1 target The calculation formula uses the change time T31 as the independent variable and the dependent variable. In the seventh embodiment, the change time T31 is an example of the "actual change time" in the present disclosure.

[0429] Based on the change time T31 and the frame rate FR1, the processor 64 calculates the number of frames corresponding to the change time T31, that is, the number of frames required during the change time T31, i.e., the required number of frames B41. For example, the required number of frames B41 is calculated as "(change time T31) x (frame rate FR1)." In the seventh embodiment, the required number of frames B41 is an example of the "first number of frames" in this disclosure.

[0430] The processor 64 is based on the required number of frames B41, the target exposure EX1 target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred1 , calculate multiple predicted transmittances TR1 pred1 . Multiple predicted transmittance TR1 pred1 It is determined by the change time T31 from the current transmittance TR1 current Target transmittance TR1 target The actual change in transmittance during the aperture drive time T1. FV The transmittance TR1 of the electronic ND filter 58 can be increased from the current transmittance TR1 current Target transmittance TR1 target When the transmittance TR1 of the electronic ND filter 58 is actually changed, the transmittance TR1 of the electronic ND filter 58 is preferably changed from the current transmittance TR1 to the current transmittance TR1. current Target transmittance TR1 target Changes in aperture drive time T1 FV In time, the transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current To target transmittance TR1 target Changing non-monotonically with a certain amount of change.

[0431] In addition, multiple predicted transmittances TR1 pred1 The exposures are applied to the plurality of frames 80 obtained during the elapse of the change time T31, respectively, according to the required number of frames B41, the target exposure EX1 target, target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred1 Predicted transmittance TR1.

[0432] Multiple predicted transmittance TR1 pred1 The calculation is performed using the predicted transmittance calculation formula 1119. The predicted transmittance calculation formula 1119 is a combination of the required number of frames B41, the target exposure EX1 target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred1 As an independent variable, multiple predicted transmittance TR1 pred1 An operation expression that is a dependent variable.

[0433] Here, multiple predicted aperture values ​​FV1 pred1 It is based on the multiple aperture values ​​FV1 calculated based on the required frame number B31, so the multiple predicted transmittances TR1 pred1 It can also be said that there are a plurality of light transmittances TR1 determined based on the required number of frames B31 and the required number of frames B41.

[0434] In addition, the required number of frames B41 is calculated based on the change time T31. The change time T31 is the time required to change the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 to the current transmittance TR1. current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target Therefore, multiple predicted transmittances TR1 pred1 It can also be said that it is based on the current transmittance TR1 current And the transmittance TR1 during driving time InTime2 And determine the multiple transmittances.

[0435] In addition, in the seventh embodiment, a plurality of predicted light transmittances TR1 pred1 This is an example of the “plurality of first actual transmittances” in the present disclosure.

[0436] As an example, Figure 32 As shown, the processor 64 sets the larger of the required number of frames B31 and the required number of frames B41 as the maximum number of frames B1. max1 , based on the maximum number of frames B1max1 and target exposure EX1 target Export multiple split exposures EX1 div3 Here, in order to keep the brightness of the plurality of frames 80 obtained by shooting the live view image constant, the plurality of split exposures EX1 div3 are the same value. That is, the processor 64 is responsible for the maximum number of frames B1 max1 Frames 80 were assigned with target exposure EX1 target Exposure of the same value as Split Exposure EX1 div3 .

[0437] Here, the maximum number of frames B1 is shown as an example. max1 , but can also replace the maximum number of frames B1 max1 Instead, the average value of the required number of frames B31 and the required number of frames B41 is used.

[0438] The processor 64 is based on the plurality of divided exposures EX1 div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 , calculate multiple predicted sensitivities SE1 pred1 and multiple predicted shutter speeds SP1 pred1 .

[0439] Split Exposure EX1 div3 Defined by multiple exposure factors. Define split exposure EX1 div3 Multiple exposure factors represent the predicted transmittance TR1 pred1 , predicted aperture value FV1 pred1 , predicted sensitivity SE1 pred1 And predicted shutter speed SP1 pred1 .

[0440] Based on multiple split exposure EX1 div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 Calculated multiple predicted sensitivities SE1 pred1 They are respectively from the current aperture value FV1 current To the target aperture value FV1 target The value obtained by predicting the sensitivity SE1 used for each frame 80 obtained so far. div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 Calculated multiple predicted shutter speeds SP1 pred1 Is the current aperture value FV1 current To the target aperture value FV1 targetThe value is obtained by predicting the shutter speed SP1 used for each frame 80 obtained so far.

[0441] Multiple predicted sensitivities SE1 pred1 and multiple predicted shutter speeds SP1 pred1 The calculation of the exposure factor calculation formula 1120 is performed. The exposure factor calculation formula 1120 is a calculation formula that converts the multiple split exposures EX1 div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 As independent variables, multiple predicted sensitivity SE1 pred1 and multiple predicted shutter speeds SP1 pred1 An operation expression that is a dependent variable.

[0442] In this way, based on multiple split exposures EX1 div3 Calculate multiple predicted sensitivities SE1 pred1 and multiple predicted shutter speeds SP1 pred1 Based on target exposure EX1 target Calculate the predicted sensitivity SE1 at multiple pred1 and multiple predicted shutter speeds SP1 pred1 Multiple split exposures used in the calculation of EX1 div3 Therefore, multiple predicted sensitivities SE1 pred1 and multiple predicted shutter speeds SP1 pred1 It can also be said that it is the same as the target exposure EX1 target The exposure factor is set for the camera 10 accordingly.

[0443] When live view image shooting is performed within the change time T31, the exposure of the plurality of frames 80 obtained by performing live view image shooting is determined by defining the plurality of divided exposures EX1. div3 Multiple predicted transmittances TR1 pred1 , multiple predicted aperture values ​​FV1 pred1 , multiple predicted sensitivities SE1 pred1 , multiple predicted shutter speeds SP1 pred1 Decide.

[0444] For example, Figure 33 As shown, the processor 64 uses a plurality of predicted transmittances TR1 within the change time T31. pred1 , multiple predicted aperture values ​​FV1 pred1 , multiple predicted sensitivities SE1 pred1 , multiple predicted shutter speeds SP1 pred1Thus, the exposure of the plurality of frames 80 obtained by performing live view image shooting within the change time T31 is applied with a plurality of split exposures EX1. div3 As a result, the exposure of the plurality of frames 80 obtained by performing live view image capturing during the elapse of the variation time T31 is kept constant.

[0445] As an example, Figure 34 As shown, when the first control 1112 is not performed, during the aperture driving time T1 FV When the change time T11 exceeds the threshold value TH21, the required number of frames B31 exceeds the target number of frames A111, which is the number of frames required until the threshold value TH21 is passed. current and target transmittance TR1 target The relationship between the transmittance TR1 of the electronic ND filter 58 and the current transmittance TR1 is current To target transmittance TR1 target The change needs to exceed the aperture drive time T1 FV This means that the change time T11 does not converge to the aperture drive time T1 FV Therefore, in the seventh embodiment, the processor 64 performs the first control 1112 as described above, as an example, Figure 34 As shown, the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 current After including the drive time transmittance TR1 InTime2 Multiple predicted transmittances TR1 pred1 (ie, to change the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 current Target transmittance TR1 target Changes in aperture drive time T1 FV The multiple transmittances TR1) determined in a timely manner are changed to the target transmittance TR1 target Thus, the transmittance of the electronic ND filter 58 can be increased from the current transmittance TR1 to current Target transmittance TR1 target Changes in aperture drive time T1 FV In time.

[0446] In addition, the decision includes multiple predicted transmittances TR1 pred1 Multiple exposure factors (refer to Figures 30 to 33 ), so that the transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current Change to target transmittance TR1 target Maintain target exposure EX1 untiltarget The plurality of exposure factors are applied to the exposure of the plurality of frames 80 obtained by capturing the live view image within the change time T31. Thus, the brightness of the plurality of frames 80 obtained by capturing the live view image within the change time T31 can be kept constant.

[0447] Figures 35 to 39 An example of the content of the second control 1114 is shown. The second control 1114 includes the following contents: current Target transmittance TR1 target Ideally, the time to change the aperture drive time T1 FV The multiple split exposures EX1 div4 The present invention is applied to the exposure control of a plurality of frames 80 obtained by performing live view image capturing.

[0448] To implement the second control 1114, as an example, Figure 35 As shown, the processor 64 generates the iris drive time T1 based on the iris drive time T1. FV and frame rate FR1, calculate the required number of frames B31. The required number of frames B31 is required to Figure 26 The same method is used to calculate the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target , calculate multiple predicted aperture values ​​FV1 pred2 Multiple predicted aperture values ​​FV1 pred2 With and in Figure 30 In the example shown, multiple predicted aperture values ​​FV1 are calculated. pred2 Calculate in the same way.

[0449] As an example, Figure 36 As shown, the processor 64 calculates the frame rate B1 based on the change time T11 and the frame rate FR1. The frame rate B1 is the number of frames corresponding to the change time T11, that is, the number of frames obtained by shooting the live view image during the change time T11. Figure 21 In the present embodiment, the change time T11 is an example of the "ideal change time" of the present disclosure, and the frame rate B1 is an example of the "first frame number" and the "third frame number" of the present disclosure.

[0450] The processor 64 is based on the frame rate B1, the target exposure EX1 target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1current And multiple predicted aperture values ​​FV1 pred2 , calculate multiple predicted transmittances TR1 pred2 . Multiple predicted transmittance TR1 pred2 It is determined by the change time T11 from the current transmittance TR1 current Target transmittance TR1 target Ideally vary the transmittance of the process.

[0451] Multiple predicted transmittance TR1 pred2 The calculation of the light transmittance is performed using the predicted light transmittance calculation formula 1122. The predicted light transmittance calculation formula 1122 is a combination of the frame rate B1 and the target exposure EX1. target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred2 As an independent variable, multiple predicted transmittance TR1 pred2 Here, multiple predicted aperture values ​​FV1 pred2 It is based on the multiple aperture values ​​FV1 calculated based on the required frame number B31, so the multiple predicted transmittances TR1 pred2 It can also be said that the plurality of transmittances TR1 are determined based on the frame rate B1 and the required number of frames B31. pred2 This is an example of “a plurality of ideal light transmittances” in the present disclosure.

[0452] As an example, Figure 37 As shown, the processor 64 sets the larger of the required number of frames B11 and the required number of frames B31 as the maximum number of frames B1. max2 , based on the maximum number of frames B1 max2 and target exposure EX1 target Export multiple split exposures EX1 div4 Here, in order to keep the brightness of the plurality of frames 80 obtained by shooting the live view image constant, the plurality of split exposures EX1 div4 are the same value. That is, the processor 64 is responsible for the maximum number of frames B1 max2 Frames 80 were assigned with target exposure EX1 target Exposure of the same value as Split Exposure EX1 div4 .

[0453] Here, the maximum number of frames B1 is shown as an example. max2 , but can also replace the maximum number of frames B1 max2Instead, the average value of the required number of frames B11 and the required number of frames B31 is used.

[0454] The processor 64 is based on the plurality of divided exposures EX1 div4 , multiple predicted transmittance TR1 pred2 And multiple predicted aperture values ​​FV1 pred2 , calculate multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred2 .

[0455] Split Exposure EX1 div4 Defined by multiple exposure factors. Define split exposure EX1 div3 Multiple exposure factors represent the predicted transmittance TR1 pred2 , predicted aperture value FV1 pred2 , predicted sensitivity SE1 pred2 And predicted shutter speed SP1 pred2 .

[0456] Based on multiple split exposure EX1 div4 , multiple predicted transmittance TR1 pred2 And multiple predicted aperture values ​​FV1 pred2 Calculated multiple predicted sensitivities SE1 pred2 They are respectively from the current aperture value FV1 current To the target aperture value FV1 target The value obtained by predicting the sensitivity SE1 used for each frame 80 obtained so far. div4 , multiple predicted transmittance TR1 pred2 And multiple predicted aperture values ​​FV1 pred2 Calculated multiple predicted shutter speeds SP1 pred2 Is the current aperture value FV1 current To the target aperture value FV1 target The value is obtained by predicting the shutter speed SP1 used for each frame 80 obtained so far.

[0457] Multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred2 The calculation of the exposure factor formula 1124 is performed. The exposure factor formula 1124 is a formula that converts the multiple split exposures EX1 div4 , multiple predicted transmittance TR1 pred2 And multiple predicted aperture values ​​FV1 pred2 As independent variables, multiple predicted sensitivity SE1 pred2 and multiple predicted shutter speeds SP1 pred2 An operation expression that is a dependent variable.

[0458] In this way, based on multiple split exposures EX1 div4 Calculate multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred2 . For multiple predicted sensitivity SE1 pred2 and multiple predicted shutter speeds SP1 pred2 Calculation of multiple split exposures EX1 div4 Based on target exposure EX1 target Therefore, multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred2 It can also be said that it is the same as the target exposure EX1 target The exposure factor is set for the camera 10 accordingly.

[0459] When live view image shooting is performed within the change time T11, the exposure of a plurality of frames 80 obtained by performing live view image shooting is determined by defining a plurality of divided exposures EX1. div4 Multiple predicted transmittances TR1 pred2 , multiple predicted aperture values ​​FV1 pred2 , multiple predicted sensitivities SE1 pred2 , multiple predicted shutter speeds SP1 pred2 Decide.

[0460] For example, Figure 38 As shown, the processor 64 uses multiple predicted transmittances TR1 within the change time T11. pred2 , multiple predicted aperture values ​​FV1 pred2 , multiple predicted sensitivities SE1 pred2 , multiple predicted shutter speeds SP1 pred2 Thus, the exposure of the plurality of frames 80 obtained by performing live view image shooting within the change time T11 is applied with a plurality of split exposures EX1. div4 As a result, the exposure of the plurality of frames 80 obtained by performing live view image capturing during the elapse of the variation time T11 is kept constant.

[0461] In the seventh embodiment, the processor 64 performs the second control 1114, as an example, Figure 39 As shown, within the change time T11, the aperture value of the aperture 40C is changed from the current aperture value FV1 current Towards target aperture value FV1 target changes, and the transmittance TR1 of the electronic ND filter 58 changes from the current transmittance TR1 current Along multiple predicted transmittance TR1 pred2(ie, the monotonically changing transmittance TR1) toward the target transmittance TR1 target In addition, the decision includes multiple predicted transmittances TR1 pred2 Multiple exposure factors to maintain target exposure EX1 target (Refer to Figures 35 to 38 ), multiple exposure factors are applied to the exposure of multiple frames 80 obtained by capturing live view images within the change time T11. This allows the brightness of multiple frames 80 obtained by capturing live view images within the change time T11 to be kept constant.

[0462] Next, refer to Figures 40A to 40G The operation of the imaging device 10 will be described. Figures 40A to 40G Shows the current transmittance TR1 current This is an example of a process for exposure control processing performed by the processor 64 on the condition that the transmittance TR1 of the electronic ND filter 58 is set and the start timing of the exposure calculation arrives (in other words, the timing pre-specified as the timing for adjusting the exposure of the frame 80 obtained by performing live view image shooting arrives). Figures 40A to 40G The illustrated flow of the exposure control process is an example of the “control method” of the present disclosure.

[0463] exist Figure 40A In the exposure control process shown, first, in step ST110, processor 64 acquires frame 80 generated by performing live view image shooting. After the process of step ST110 is performed, the exposure control process proceeds to step ST112.

[0464] In step ST112, processor 64 calculates light metering value 1090 based on frame 80 acquired in step ST110. After the process of step ST112 is performed, the exposure control process proceeds to step ST114.

[0465] In step ST114, the processor 64 calculates the target exposure EX1 based on the metered light value 1090. target This is the exposure for achieving the target brightness for the brightness of the frame 80 used in calculating the light metering value 1090. After the process of step ST114 is performed, the exposure control process proceeds to step ST116.

[0466] In step ST115, the processor 64 determines whether an aperture value change instruction has been given to the imaging device 10. In step ST115, if an aperture value change instruction has not been given to the imaging device 10, the determination is negative, and the exposure control process is transferred to step ST116. Figure 40BIn step ST115 , if an aperture value change instruction is given to the imaging device 10 , the determination is affirmative, and the exposure control process moves to step ST148 .

[0467] exist Figure 40B In step ST116, the processor 64 calculates the target exposure EX1 target Corresponding target transmittance TR1 target After the process of step ST116 is performed, the exposure control process moves to step ST118.

[0468] In step ST118, the processor 64 obtains the current transmittance TR1 set for the electronic ND filter 58 at the current time point. current After the process of step ST118 is performed, the exposure control process moves to step ST120.

[0469] In step ST120, the processor 64 calculates the value of the current transmittance TR1 of the electronic ND filter 58. current Target transmittance TR1 target After the process of step ST120 is performed, the exposure control process moves to step ST122.

[0470] In step ST122, the processor 64 determines whether the change time T11 exceeds the threshold value TH11. In step ST122, if the change time T11 does not exceed the threshold value TH11, the determination is negative, and the exposure control process transfers to step ST124. In step ST122, if the change time T11 exceeds the threshold value TH11, the determination is positive, and the exposure control process transfers to step ST125. Figure 40C Step ST128 is shown.

[0471] In step ST124, the processor 64 calculates the frame rate B1 based on the change time T11 and the frame rate FR1. After the process of step ST124 is performed, the exposure control process moves to step ST126.

[0472] In step ST126, the processor 64 calculates the target exposure EX1 based on the frame rate B1. target And the current transmittance TR1 current Calculate multiple split exposures EX1 div1 After the process of step ST126 is performed, the exposure control process is transferred to Figure 40C Step ST142 is shown.

[0473] exist Figure 40CIn step ST128 shown in FIG. 1 , the processor 64 calculates the current light transmittance TR1 based on the change time T11, the threshold TH11, and the current light transmittance TR1. current And the target transmittance TR1 target Calculate the transmittance TR1 within the range where the change time T11 converges to the threshold value TH11, that is, the transmittance TR1 within the change time InTime1 It is the light transmittance TR1 of the electronic ND filter 58. After the process of step ST128 is performed, the exposure control process shifts to step ST130.

[0474] In step ST130, the processor 64 calculates the light transmittance TR1 based on the current light transmittance TR1. current , Transmittance TR1 during the changing time InTime1 And the target transmittance TR1 target , calculate the transmittance TR1 of the electronic ND filter 58 from the current transmittance TR1 current Transmittance TR1 after changing time InTime1 Target transmittance TR1 target The time required for the change is the change time T21. After the process of step ST130 is performed, the exposure control process moves to step ST132.

[0475] In step ST132, the processor 64 calculates the required number of frames B21 based on the change time T21 and the frame rate FR1. After the process of step ST132 is performed, the exposure control process moves to step ST134.

[0476] In step ST134, the processor 64 calculates the required number of frames B21, the target exposure EX1, and the target exposure EX21. target And the current transmittance TR1 current Calculate multiple split exposures EX1 div1 After the process of step ST134 is performed, the exposure control process moves to step ST136.

[0477] In step ST136, the processor 64 performs the following operations based on the plurality of divided exposures EX1 div1 、Current transmittance TR1 current 、Target transmittance TR1 target And the transmittance TR1 during the changing time InTime1 , calculate multiple actual transmittances TR1 real1 And multiple ideal transmittance TR1 ideal1 After the process of step ST136 is performed, the exposure control process moves to step ST138.

[0478] In step ST138, the processor 64 calculates a plurality of actual light transmittances TR1 in units of frames 80 within the required number of frames B21. real1With multiple ideal transmittance TR1 ideal1 That is, in step ST138, the actual transmittance TR1 is calculated for each frame 80 included in the required number of frames B21. real1 With ideal transmittance TR1 ideal1 The exposure difference δ11 between them is obtained. After the process of step ST138 is performed, the exposure control process moves to step ST140.

[0479] In step ST140, the processor 64 adjusts the defined split exposure EX1 using the adjustment value corresponding to the difference δ11 for each frame 80 included in the required number of frames B21. div1 After the process of step ST140 is performed, the exposure control process shifts to step ST142.

[0480] Here, when N is set to a natural number with an initial value of "1", in step ST142, the processor 64 causes the imaging device 10 to perform the split exposure EX1 for the Nth frame. div1 For example, when the exposure control process is transferred from step ST126 to step ST142, in step ST142, the processor 64 causes the imaging device 10 to perform the plurality of divided exposures EX1 calculated by performing the process of step ST126. div1 Split exposure EX1 for the Nth frame in div1 On the other hand, when the exposure control process shifts from step ST140 to step ST142, in step ST142, the processor 64 sets the sensitivity SE1 adjusted based on the difference δ11 calculated for the Nth frame, the shutter speed SP1 determined for the Nth frame, and the aperture value FV1 determined for the Nth frame to the imaging device 10, and sets the current transmittance TR1 to the electronic ND filter 58. current , multiple actual transmittance TR1 real1 And the target transmittance TR1 target Based on the transmittance TR1 for the Nth frame in , the imaging device 10 is caused to perform imaging for the Nth frame. After the process of step ST142 is performed, the exposure control process proceeds to step ST144.

[0481] In step ST144, the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX1. target In step ST144, the exposure at the Nth frame does not reach the target exposure EX1 targetIn the case of , the determination is negative, and the exposure control process transfers to step ST146. In step ST146, the processor 64 adds "1" to N. After the process of step ST146 is performed, the exposure control process transfers to step ST142. In step ST144, the exposure of the Nth frame reaches the target exposure EX1 target In the case of , the judgment is affirmative and the exposure control processing ends.

[0482] exist Figure 40A In step ST148 shown in FIG, the processor 64 determines whether the electronic ND filter 58 can follow the change in the aperture value FV1. In step ST148, if the electronic ND filter 58 cannot follow the change in the aperture value FV1, the determination is negative, and the exposure control process is transferred to step ST148. Figure 40D In step ST148, if the electronic ND filter 58 can follow the change in the aperture value FV1, the determination is affirmative, and the exposure control process is transferred to step ST150. Figure 40E Step ST172 shown.

[0483] exist Figure 40D In step ST150 shown in FIG. 1 , the processor 64 processes the aperture value FV1 based on the current aperture value FV1. current , target aperture value FV1 target 、Current transmittance TR1 current and target exposure EX1 target , calculate the target sensitivity SE1 target and target shutter speed SP1 target After the process of step ST150 is performed, the exposure control process moves to step ST152.

[0484] In step ST152, the processor 64 calculates the current aperture value FV1 based on the current aperture value FV1. current And the target aperture value FV1 target Calculate the aperture drive time T1 FV After the process of step ST152 is performed, the exposure control process moves to step ST154.

[0485] In step ST154, the processor 64 generates the iris drive time T1 based on the iris drive time T1. FV The frame rate FR1 is calculated as the required number of frames B31. After the process of step ST154 is performed, the exposure control process proceeds to step ST156.

[0486] In step ST156, the processor 64 calculates the number of frames required based on the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target Calculate multiple predicted aperture values ​​FV1 pred0After the process of step ST156 is performed, the exposure control process moves to step ST158.

[0487] In step ST158, the processor 64 calculates the current transmittance TR1 based on the current transmittance TR1. current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred0 , calculate multiple split exposures EX1 div2 After the process of step ST158 is performed, the exposure control process moves to step ST160.

[0488] In step ST160, the processor 64 performs the following operations based on the target exposure EX1. target and multiple split exposure EX1 div2 Calculate multiple exposure differences EX1 diff After the process of step ST160 is performed, the exposure control process moves to step ST162.

[0489] In step ST162, the processor 64 calculates the exposure difference EX1 based on the plurality of exposure differences EX1. diff , calculated to supplement multiple exposure differences EX1 diff After the process of step ST162 is performed, the exposure control process moves to step ST164.

[0490] In step ST164, the processor 64 uses the plurality of sensitivity adjustment values ​​Δ1a to adjust the current sensitivity SE1 current In addition, the processor 64 uses a plurality of shutter speed adjustment values ​​Δ1b to adjust the current shutter speed SP1 current After the process of step ST164 is performed, the exposure control process moves to step ST166.

[0491] In step ST166, the processor 64 uses the current transmittance TR1 current , the adjusted sensitivity SE1 for the Nth frame, the adjusted shutter speed SP1 for the Nth frame, and the predicted aperture value FV1 for the Nth frame pred0 After the exposure of the image pickup device 10 is set to N, the image pickup device 10 is caused to shoot the image for the Nth frame. After the process of step ST166 is performed, the exposure control process moves to step ST168.

[0492] In step ST168, the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX1. target In step ST168, if the exposure at the Nth frame does not reach the target exposure EX1 targetIn the case of , the determination is negative, and the exposure control process transfers to step ST170. In step ST170, the processor 64 adds "1" to N. After the process of step ST170 is performed, the exposure control process transfers to step ST166. In step ST168, the exposure of the Nth frame reaches the target exposure EX1 target In the case of , the judgment is affirmative and the exposure control processing ends.

[0493] exist Figure 40E In step ST172 shown in FIG. 17 , the processor 64 performs the operation based on the target exposure EX1. target , target aperture value FV1 target And multiple current exposure factors, calculate and target exposure EX1 target Corresponding target transmittance TR1 target After the process of step ST172 is performed, the exposure control process moves to step ST174.

[0494] In step ST174, the processor 64 obtains the current transmittance TR1 current After the process of step ST174 is performed, the exposure control process moves to step ST176.

[0495] In step ST176, the processor 64 performs the following operations based on the target exposure ratio TR1: target And the current transmittance TR1 current , calculated from the current transmittance TR1 current Target transmittance TR1 target The time required for the ideal change of is the change time T11. After the process of step ST176 is performed, the exposure control process moves to step ST178.

[0496] In step ST178, the processor 64 calculates the current aperture value FV1 based on the current aperture value FV1. current And the target aperture value FV target Calculate the aperture drive time T1 FV .

[0497] After the process of step ST178 is performed, the exposure control process moves to step ST180.

[0498] In step ST180, the processor 64 determines the aperture drive time T1. FV And whether the change time T11 exceeds the threshold value TH21. In step ST180, the aperture drive time T1 FV and the change time T11 do not exceed the threshold value TH21 (ie, in the case where the aperture drive time T1 FVand / or the change time T11 is less than the threshold value TH21), the determination is negative, and the exposure control process is transferred to Figure 40G In step ST1106 shown in FIG. In step ST180, during the aperture drive time T1 FV If both the change time T11 and the threshold value TH21 are exceeded, the determination is affirmative, and the exposure control process is transferred to Figure 40F Step ST182 is shown.

[0499] exist Figure 40F In step ST182 shown in FIG. 18 , the processor 64 performs the operation based on the aperture drive time T1. FV , change time T11, target transmittance TR1 target And the current transmittance TR1 current , the calculation will be based on the current transmittance TR1 current Target transmittance TR1 target The time required for the change is set as the aperture drive time T1 FV The transmittance within the driving time is TR1 InTime2 After the processing of step ST182 is performed, the exposure control processing moves to step ST184.

[0500] In step ST184, the processor 64 generates the iris drive time T1 based on the iris drive time T1. FV The frame rate FR1 is calculated as the required number of frames B31. After the process of step ST184 is performed, the exposure control process moves to step ST186.

[0501] In step ST186, the processor 64 calculates the number of frames required based on the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target Calculate multiple predicted aperture values ​​FV1 pred1 After the processing of step ST186 is performed, the exposure control processing is transferred to step ST188.

[0502] In step ST188, the processor 64 calculates the light transmittance TR1 during the driving time. InTime2 、Current transmittance TR1 current And the target transmittance TR1 target , calculate the transmittance TR1 of the electronic ND filter 58 during the aperture driving time T1 FV From the current transmittance TR1 current Target transmittance TR1 target The actual change time is the change time T31. After the process of step ST188 is performed, the exposure control process proceeds to step ST190.

[0503] In step ST190, the processor 64 calculates the required number of frames B41 based on the change time T31 and the frame rate FR1. After the process of step ST190 is performed, the exposure control process proceeds to step ST192.

[0504] In step ST192, the processor 64 calculates the required number of frames B41, the target exposure EX1, and the target exposure EX2. target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred1 , calculate multiple predicted transmittances TR1 pred1 (ie, the predicted transmittance TR1 of each frame 80 obtained within the required number of frames B41 pred1 ). After the processing of step ST192 is performed, the exposure control processing is transferred to step ST194.

[0505] In step ST194, the processor 64 selects the larger of the required number of frames B31 and the required number of frames B41 as the maximum number of frames B1. max1 After the processing of step ST194 is performed, the exposure control processing is transferred to step ST196.

[0506] In step ST196, the processor 64 calculates the maximum number of frames B1 based on the maximum number of frames B1. max1 and target exposure EX1 target Export multiple split exposures EX1 div3 After the processing of step ST196 is performed, the exposure control processing is transferred to step ST198.

[0507] In step ST198, the processor 64 performs the following operations based on the plurality of divided exposures EX1 div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 , calculate multiple predicted sensitivities SE1 pred1 And predicted shutter speed SP1 pred1 After the processing of step ST198 is performed, the exposure control processing moves to step ST1100.

[0508] In step ST1100, the processor 64 uses the predicted transmittance TR1 for the Nth frame. pred1 , predicted aperture value FV1 for frame N pred1 , predicted sensitivity SE1 for frame N pred1 , predicted shutter speed SP1 for frame Npred1 The exposure control process is transferred to step ST1102 after the process of step ST1100 is performed.

[0509] In step ST1102, the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX1. target In step ST1102, the exposure at the Nth frame does not reach the target exposure EX1 target In the case of , the determination is negative, and the exposure control process transfers to step ST1104. In step ST1104, the processor 64 adds "1" to N. After the process of step ST1104 is performed, the exposure control process transfers to step ST1100. In step ST1102, the exposure of the Nth frame reaches the target exposure EX1 target In the case of , the judgment is affirmative and the exposure control processing ends.

[0510] exist Figure 40G In step ST1106 shown in FIG. 1 , the processor 64 performs the operation based on the aperture drive time T1. FV The frame rate FR1 is calculated as the required number of frames B31. After the process of step ST1106 is performed, the exposure control process moves to step ST1108.

[0511] In step ST1108, the processor 64 calculates the number of frames required based on the number of frames B31 and the current aperture value FV1. current And the target aperture value FV1 target Calculate multiple predicted aperture values ​​FV1 pred2 After the processing of step ST186 is performed, the exposure control processing is transferred to step ST1110.

[0512] In step ST1110, the processor 64 calculates the frame rate B1 based on the change time T11 and the frame rate FR1. After the process of step ST1110 is performed, the exposure control process moves to step ST1112.

[0513] In step ST1112, the processor 64 calculates the target exposure EX1 based on the frame rate B1. target , target aperture value FV1 target , current aperture value FV1 current 、Current transmittance TR1 current 、Current sensitivity SE1 current 、Current shutter speed SP1 current And multiple predicted aperture values ​​FV1 pred1 , calculate multiple predicted transmittances TR1 pred2 (ie, the predicted transmittance TR1 of each frame 80 obtained within the frame rate B1 pred1). After the processing of step ST1112 is performed, the exposure control processing is transferred to step ST1114.

[0514] In step ST1114, the processor 64 selects the larger of the frame rate B1 and the required number of frames B31 as the maximum number of frames B1. max2 After the processing of step ST1114 is performed, the exposure control processing is transferred to step ST1116.

[0515] In step ST1116, the processor 64 calculates the maximum number of frames B1 based on the maximum number of frames B1. max2 and target exposure EX1 target Export multiple split exposures EX1 div4 After the processing of step ST1116 is performed, the exposure control processing is transferred to step ST1118.

[0516] In step ST1118, the processor 64 performs the following operations based on the plurality of divided exposures EX1 div4 , multiple predicted transmittance TR1 pred2 And multiple predicted aperture values ​​FV1 pred2 , calculate multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred1 After the processing of step ST1118 is performed, the exposure control processing is transferred to step ST1120.

[0517] In step ST1120, the processor 64 uses the predicted transmittance TR1 for the Nth frame. pred2 , predicted aperture value FV1 for frame N pred2 , predicted sensitivity SE1 for frame N pred2 , predicted shutter speed SP1 for frame N pred2 The image capturing device 10 is caused to capture the image by exposure. After the process of step ST1120 is performed, the exposure control process moves to step ST1122.

[0518] In step ST1122, the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX1. target In step ST1122, the exposure at the Nth frame does not reach the target exposure EX1 target In the case of , the determination is negative, and the exposure control process transfers to step ST1124. In step ST1124, the processor 64 adds "1" to N. After the process of step ST1124 is performed, the exposure control process transfers to step ST1120. In step ST1122, the exposure of the Nth frame reaches the target exposure EX1 target In the case of , the judgment is affirmative and the exposure control processing ends.

[0519] As described above, in the imaging device 10 of the seventh embodiment, live view imaging is performed at the frame rate FR1 to obtain a plurality of frames 80. Furthermore, based on the transmittance TR1 of the electronic ND filter 58 and the aperture drive time T1 FV , controlling a plurality of frames 80 obtained by shooting for live view images.

[0520] Therefore, even while the diaphragm 40C is being driven, the brightness of the plurality of frames 80 obtained by performing live view image capturing can be kept constant.

[0521] In the imaging device 10 of the seventh embodiment, the transmittance TR1 of the electronic ND filter 58 is changed from the current transmittance TR1 to the current transmittance TR1. current Target transmittance TR1 target The time required for the change is the same as the aperture drive time T1 FV Multiple split exposures EX1 determined by the relationship between div3 or multiple split exposure EX1 div4 The exposure of the plurality of frames 80 obtained by shooting the live view image is respectively applied (i.e., the exposure determined for each frame 80 in order to make the brightness of each frame 80 constant). current Target transmittance TR1 target Does the time required for the change converge to the aperture drive time T1? FV The brightness of the plurality of frames 80 obtained by shooting for live view images can be kept constant throughout the entire image.

[0522] In addition, in the imaging device 10 of the seventh embodiment, when the current transmittance TR1 current Target transmittance TR1 target The time required for the change and the aperture drive time T1 FV When the threshold value TH21 is exceeded, the first control 1112 is performed. By performing the first control 1112, the current transmittance TR1 is current Target transmittance TR1 target The time required for the change is the aperture drive time T1 FV Inside, and, based on the current transmittance TR1 current Target transmittance TR1 target The actual changing time (ie, the changing time T31) and the aperture driving time T1 FV The multiple split exposures EX1 div3 Each is suitable for exposure of a plurality of frames 80 obtained by shooting live view images. Therefore, even if the current transmittance TR1 currentTarget transmittance TR1 target The time required for the change and the aperture drive time T1 FV Even if the threshold value TH21 is exceeded, the brightness of the plurality of frames 80 obtained by performing live view image shooting can be kept constant.

[0523] In addition, in the imaging device 10 of the seventh embodiment, when the current transmittance TR1 current Target transmittance TR1 target The time required for the change (ie, the change time T11) and / or the aperture drive time T1 FV If the threshold value TH21 is below, the second control 1114 is performed. By performing the second control 1114, based on the current transmittance TR1 current Target transmittance TR1 target The time required for ideal change (ie, change time T11) and the aperture drive time T1 FV The multiple split exposures EX1 div4 Each is suitable for exposure of a plurality of frames 80 obtained by shooting live view images. Therefore, even if the current transmittance TR1 current Target transmittance TR1 target The time required for the change and / or the aperture drive time T1 FV Even if the brightness is equal to or less than the threshold value TH21, the brightness of the plurality of frames 80 obtained by performing live view image shooting can be kept constant.

[0524] In the imaging device 10 of the seventh embodiment, the larger one of the required number of frames B31 and the required number of frames B41 (ie, the maximum number of frames B11) is selected. max1 )Determine multiple split exposures EX1 div3 Thus, a plurality of split exposures EX1 are determined based on the smaller of the required number of frames B31 and the required number of frames B41. div3 Compared with the case of multiple split exposure EX1 div3 This is applicable to the exposure of more frames 80, so the brightness of more frames 80 can be kept constant. In addition, the multiple split exposures EX1 can be determined based on the average number of frames of the required number of frames B31 and the required number of frames B41. div3 In this case, a plurality of split exposures EX1 are determined based on the smaller of the required number of frames B31 and the required number of frames B41. div3 Compared with the case of multiple split exposure EX1 div3 Since this is applicable to the exposure of a larger number of frames 80 , the brightness of a larger number of frames 80 can be kept constant.

[0525] In addition, in the imaging device 10 of the seventh embodiment, based on a plurality of predicted light transmittances TR1 pred1 , multiple predicted aperture values ​​FV1 pred1 , multiple predicted sensitivities SE1 pred1 And predicted shutter speed SP1 pred1 Determine multiple split exposures EX1 div3 That is, by setting multiple predicted transmittances TR1 pred1 , multiple predicted aperture values ​​FV1 pred1 , multiple predicted sensitivities SE1 pred1 And predicted shutter speed SP1 pred1 Based on the live view image, multiple split exposures EX1 are applied to multiple frames 80 div3 Therefore, the brightness of the plurality of frames 80 obtained by performing live view image capturing can be kept constant.

[0526] In addition, in the imaging device 10 of the seventh embodiment, when the current transmittance TR1 current Target transmittance TR1 target The time required for the change (ie, the change time T11) and the aperture drive time T1 FV In the first control 1112 when the threshold value TH21 is exceeded, the current transmittance TR1 current With target transmittance TR1 target The transmittance TR1 during the driving time is determined by InTime2 , multiple predicted transmittance TR1 pred1 Based on the current transmittance TR1 current And the transmittance TR1 during driving time InTime2 In addition, multiple predicted transmittances TR1 pred1 Including the transmittance TR1 during driving time InTime2 . Multiple predicted transmittance TR1 pred1 Determine from the current transmittance TR1 current Target transmittance TR1 target Thus, from the current transmittance TR1 current Target transmittance TR1 target During the change process, there is a transmittance TR1 within the driving time. InTime2 Multiple predicted transmittances TR1 pred1 , so with the current transmittance TR1 current Target transmittance TR1 target Compared with the monotonic change, it can be achieved faster from the current transmittance TR1 current Target transmittance TR1 target In addition, multiple predicted transmittances TR1pred1 Define multiple split exposures EX1 div3 Therefore, for the exposure of the plurality of frames 80 obtained by shooting the live view image, it is possible to apply the exposure factor for making the current transmittance TR1 current Target transmittance TR1 target The change time is in the aperture drive time T1 FV Multiple split exposures within EX1 div3 .

[0527] In the imaging device 10 of the seventh embodiment, the larger one of the frame rate B1 and the required number of frames B31 (ie, the maximum number of frames B1) is selected. max2 )Determine multiple split exposures EX1 div4 Thus, a plurality of split exposures EX1 are determined based on the smaller of the frame rate B1 and the required number of frames B31. div4 Compared with the case of multiple split exposure EX1 div4 This is applicable to the exposure of more frames 80, so the brightness of more frames 80 can be kept constant. In addition, the multiple split exposures EX1 can be determined based on the frame rate B1 and the average number of frames required B31. div4 In this case, a plurality of split exposures EX1 are determined based on the smaller of the frame rate B1 and the required number of frames B31. div4 Compared with the case of more than 80 frames, multiple split exposures EX1 are applied. div4 , thus making it possible to maintain the brightness of more frames 80 constant.

[0528] In addition, in the imaging device 10 of the seventh embodiment, based on a plurality of predicted light transmittances TR1 pred2 , multiple predicted aperture values ​​FV1 pred2 , multiple predicted sensitivities SE1 pred2 And predicted shutter speed SP1 pred2 Determine multiple split exposures EX1 div4 That is, by setting multiple predicted transmittances TR1 pred2 , multiple predicted aperture values ​​FV1 pred2 , multiple predicted sensitivities SE1 pred2 And predicted shutter speed SP1 pred2 Based on the live view image, multiple split exposures EX1 are applied to multiple frames 80 div4 Therefore, the brightness of the plurality of frames 80 obtained by performing live view image capturing can be kept constant.

[0529] In addition, in the imaging device 10 of the seventh embodiment, when the electronic ND filter 58 cannot follow the change in the aperture value FV1, the aperture drive time T1 is set to FV The exposure of the plurality of frames 80 obtained by shooting the live view image is determined by the current transmittance TR1. current And aperture drive time T1 FV The obtained multiple sensitivity adjustment values ​​Δ1a are the multiple adjusted sensitivities SE1 and the target sensitivity SE1 target , multiple shutter speeds SP1 adjusted by multiple shutter speed adjustment values ​​Δ1b, target shutter speed SP1 target , multiple predicted aperture values ​​FV1 pred0 And the current transmittance TR1 current For example, during the aperture drive time T1 FV In order to use the current transmittance TR1 current , multiple sensitivities SE1 adjusted based on multiple sensitivity adjustment values ​​Δ1a, target sensitivity SE1 target , a plurality of shutter speeds SP1 adjusted based on a plurality of shutter speed adjustment values ​​Δ1b, a target shutter speed SP1 target And multiple predicted aperture values ​​FV1 pred0 The exposure is performed to shoot a live view image for the imaging device 10. Thus, by the aperture driving time T1 FV The exposure of the plurality of frames 80 obtained by capturing live view images is kept constant.

[0530] Furthermore, in the seventh embodiment, the method based on a plurality of divided exposures EX1 is given. div3 , multiple predicted transmittance TR1 pred1 And multiple predicted aperture values ​​FV1 pred1 Calculate multiple predicted sensitivities SE1 pred1 and multiple predicted shutter speeds SP1 pred1 This is just an example, and multiple predicted sensitivities SE1 can also be calculated. pred1 or multiple predicted shutter speeds SP1 pred1 For example, it is possible to use multiple split exposures EX1 div3 , multiple predicted transmittance TR1 pred1 , multiple predicted aperture values ​​FV1 pred1 And the current sensitivity SE1 current Calculate multiple predicted shutter speeds SP1 pred1 , can also be based on multiple split exposure EX1 div3 , multiple predicted transmittance TR1 pred1 , multiple predicted aperture values ​​FV1 pred1and the current shutter speed SP1 current Calculate multiple predicted sensitivities SE1 pred1 For multiple predicted sensitivities SE1 pred2 and multiple predicted shutter speeds SP1 pred2 The same can be said.

[0531] [Eighth Embodiment]

[0532] In the seventh embodiment, Figure 40A If the determination in step ST148 shown in FIG. 1 is affirmative (i.e., if the electronic ND filter 58 can follow the change in the aperture value FV1), the operation is performed regardless of the change in the aperture value FV1. Figure 40E The processing after step ST172 is described in detail, but in the eighth embodiment, the processor 64 selectively performs the processing according to the condition of the change amount of the aperture value FV1. Figure 40D The processing of steps ST150 to ST170 shown in FIG. Figure 40E An example of the processing method after step ST172 is shown.

[0533] In the eighth embodiment, the same components as those in the seventh embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the eighth embodiment, the differences from the seventh embodiment are mainly described.

[0534] In this eighth embodiment, referring to Figure 41 The flowchart shown in FIG. 1 is an example of the exposure control process of the eighth embodiment. Figure 41 The flowchart shown includes the same steps as those described in the seventh embodiment. Figures 40A to 40G The flowchart shown in the figure repeats multiple steps, so the following is a Figure 41 The flowchart shown includes multiple steps similar to those described in the seventh embodiment. Figures 40A to 40G The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0535] Figure 41 The flowchart shown is the same as Figures 40A to 40G Compared with the flowchart shown in FIG. 1 , the difference is that in step ST148 and step ST172 (see Figure 40E ) has step ST1200.

[0536] exist Figure 41 In step ST1200 included in the exposure control process shown, the processor 64 determines whether the change in the aperture value FV1 used in the determination of step ST148 exceeds the threshold value TH31. The threshold value TH31 is based on the fact that the transmittance of the electronic ND filter 58 cannot be changed from the current transmittance TR1.current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target As a value determined based on the time when the electronic ND filter 58 cannot change the transmittance from the current transmittance TR1 current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target An example of a value determined by the time of change is that the transmittance of the electronic ND filter 58 cannot be changed from the current transmittance TR1 current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target As an example of the threshold TH31, the transmittance of the electronic ND filter 58 cannot be increased from the current transmittance TR1. current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target The upper limit of the time of change is a value determined in advance by experiments based on actual equipment and / or computer simulation. The transmittance of the electronic ND filter 58 cannot be increased from the current transmittance TR1 current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target The upper limit of the time of change is merely an example; a value lower than the upper limit within the permissible range may also be used. Furthermore, threshold TH31 may be a fixed value or a variable value that changes according to given instructions or various conditions. Threshold TH31 may be user-defined or may be determined based on the type of shooting mode.

[0537] In step ST1200, if the amount of change in the aperture value FV1 used in the determination of step ST148 exceeds the threshold value TH31, the determination is affirmative, and the processor 64 performs Figure 40E In step ST1200, if the amount of change in the aperture value FV1 used in the determination of step ST148 does not exceed the threshold value TH31 (i.e., if the amount of change in the aperture value FV1 used in the determination of step ST148 is below the threshold value TH31), the determination is negative, and the processor 200 performs Figure 40D The processing of steps ST150 to ST170 shown in the figure. In the eighth embodiment, the threshold value TH31 is an example of the "first predetermined change amount" of the present disclosure.

[0538] If the amount of change in the aperture value FV1 used in the determination of step ST148 exceeds the threshold value TH31, it is determined that the transmittance of the electronic ND filter 58 can be increased from the current transmittance TR1 to the current transmittance TR1.current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target In this case, Figure 40E The processing after step ST172 shown is performed by the processor 64.

[0539] On the other hand, when the amount of change in the aperture value FV1 used in the determination of step ST148 does not exceed the threshold value TH31 (that is, when the amount of change in the aperture value FV1 used in the determination of step ST148 is equal to or less than the threshold value TH31), it is determined that the transmittance of the electronic ND filter 58 cannot be increased from the current transmittance TR1. current Transmittance TR1 after driving time InTime2 Target transmittance TR1 target Change (ie, the number of frames is not enough to set the transmittance TR1 during the driving time InTime2 In this case, Figure 40D The processing of steps ST150 to ST170 shown in FIG. Figure 40D The processes of steps ST150 to ST170 shown do not include setting or using the transmittance TR1 within the driving time. InTime2 processing.

[0540] Therefore, whether the change amount of the aperture value FV1 used in the determination of step ST148 exceeds the threshold value TH31 or the change amount of the aperture value FV1 used in the determination of step ST148 does not exceed the threshold value TH31, the aperture value FV1 can be adjusted by the aperture drive time T1. FV The exposure of the plurality of frames 80 obtained by capturing live view images is kept constant.

[0541] [Ninth embodiment]

[0542] In the seventh embodiment, the amount of change in the aperture value FV1 (i.e., the amount of change from the current aperture value FV1) during the period in which the exposure of the plurality of frames 80 obtained by performing live view image shooting is controlled (i.e., during the period in which the exposure control process is performed) is taken. current To the target aperture value FV1 target However, in the ninth embodiment, an example of a method in which the amount of change in the aperture value FV1 is changed while the exposure of multiple frames 80 obtained by shooting a live view image is controlled is described.

[0543] In the ninth embodiment, the same components as those in the seventh embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the ninth embodiment, the differences from the seventh embodiment are mainly described.

[0544] In this ninth embodiment, referring to Figures 42A to 42F The flowchart shown in FIG. 1 is an example of the exposure control process of the ninth embodiment. Figures 42A to 42F The flowchart shown includes the same steps as those described in the seventh embodiment. Figures 40A to 40G The flowchart shown in the figure repeats multiple steps, so the following is a Figures 42A to 42F The flowchart shown includes multiple steps similar to those described in the seventh embodiment. Figures 40A to 40G The same steps in the flowchart shown are marked with the same step numbers and the description thereof is omitted.

[0545] Figures 42A to 42F The flowchart shown is the same as Figures 40A to 40G The difference from the flowchart shown in FIG. 1 is that steps ST1300 to ST1310 are included instead of steps ST1102 and ST1104 (see FIG. 1301 ). Figure 42A as well as Figure 42B ), instead of step ST1122 and step ST1124, there are steps ST1312 to ST1322 (refer to Figure 42C as well as Figure 42D ), and steps ST1324 to ST1334 (see Figure 42E as well as Figure 42F ).

[0546] exist Figure 42A In step ST1300 shown in FIG. 1 , the processor 64 determines whether the exposure of the Nth frame reaches the target exposure EX1. target In step ST1200, the exposure at the Nth frame does not reach the target exposure EX1 target In the case of a negative determination, the exposure control process is transferred to Figure 42B In step ST1300, the exposure of the Nth frame reaches the target exposure EX1 target In the case of , the judgment is affirmative and the exposure control processing ends.

[0547] exist Figure 42B In step ST1302 shown in FIG. 1303 , the processor 64 determines whether the target aperture value FV1 is updated due to a request from the user. target In the ninth embodiment, the change amount of the aperture value FV1 refers to the change amount from the current aperture value FV1 to the current aperture value FV1. current To the target aperture value FV1 target In addition, in the ninth embodiment, for the sake of convenience, the target aperture value FV1 is used. targetThe target aperture value FV1 set by the user at the current time point target Different new value (ie, new target aperture value FV1 target ), and the description is based on the premise that the amount of change in the aperture value FV1 changes.

[0548] Threshold TH41 is a value based on the amount of change in aperture value FV1 that prevents the user from visually recognizing the change in brightness between frames 80 associated with the change in aperture value FV1. As an example of a value based on the amount of change in aperture value FV1 that prevents the user from visually recognizing the change in brightness between frames 80 associated with the change in aperture value FV1, an upper limit value for the amount of change in aperture value FV1 that prevents the user from visually recognizing the change in brightness between frames 80 associated with the change in aperture value FV1 is provided. As an example of threshold TH41, a value previously determined through actual device testing and / or computer simulation is provided as an upper limit value for the amount of change in aperture value FV1 that prevents the user from visually recognizing the change in brightness between frames 80 associated with the change in aperture value FV1. The upper limit value for the amount of change in aperture value FV1 that prevents the user from visually recognizing the change in brightness between frames 80 associated with the change in aperture value FV1 is merely an example; a value lower than the upper limit value within the allowable range may also be provided. The threshold value TH41 may be a fixed value or a variable value that changes according to a given instruction or various conditions. The threshold value TH41 may be a value determined by the user or a value determined according to the type of shooting mode.

[0549] In step ST1302, if the amount of change in aperture value FV1 according to the instruction given by the user does not exceed threshold value TH41, the determination is negative and "1" is added to N. Then, the exposure control process shifts to Figure 42A In step ST1302, if the amount of change in aperture value FV1 exceeds threshold value TH41 according to the instruction given by the user, the determination is affirmative, and the exposure control process shifts to step ST1304.

[0550] In steps ST1304 to ST1308, the processor 64 performs Figure 40A The processes of steps ST110 to ST114 are the same as those shown in the figure. After the process of step ST1308 is performed, the exposure control process moves to step ST1310.

[0551] In step ST1310, the processor 64 obtains the new target aperture value FV1 indicated by the user. target (i.e., updated target aperture value FV1 target ) and the predicted aperture value FV1 for the Nth frame pred1Here, the difference is shown as the change amount of the aperture value FV1. However, it can also be a ratio as long as it represents the new target aperture value FV1 instructed by the user. target The predicted aperture value FV1 used for the Nth frame pred1 In addition, the aperture value FV1 indicated by the user and the predicted aperture value FV1 for the Nth frame are pred1 The difference is an example of the "degree of difference between the aperture value before and after the update" in the present disclosure. After step ST1310, the exposure control process shifts to step ST148. After step ST148, the change in aperture value FV1 obtained in step ST1310 is used in the same manner as described in the seventh embodiment. For example, in step ST148, it is determined whether the change in aperture value FV1 obtained in step ST1310 can be tracked by the electronic ND filter 58.

[0552] If the change in the aperture value FV1 obtained in step ST1310 cannot be tracked by the electronic ND filter 58, the processor 64 performs Figure 40D The processing of steps ST150 to ST170 shown in FIG. 1 is similar to the seventh embodiment described above, and the aperture driving time T1 is used. FV The exposure of the plurality of frames 80 obtained by shooting live view images is kept constant. In addition, if the change in the aperture value FV1 obtained in step ST1310 can be tracked by the electronic ND filter 58, the processor 64 performs Figure 40E The processing after step ST172 is similar to the seventh embodiment described above, and the maximum number of frames B1 is pro...

Claims

1. A control device comprising a processor, The processor Acquire multiple split exposures determined based on the change time and the target exposure of the imaging device, performing control to apply the plurality of divided exposures to exposures of at least a plurality of frames obtained by performing imaging by the imaging device within the variation time, The change time is the time required for the transmittance of the electronic neutral density filter mounted on the imaging device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

2. The control device according to claim 1, The plurality of frames are obtained by performing the shooting based on a predetermined frame rate, The number of the plurality of frames is determined based on the change time and the predetermined frame rate, The plurality of divided exposures are determined based on the target exposure and the number of exposures.

3. The control device according to claim 1, When the change time exceeds a first threshold, The split exposures in the process of changing from the first transmittance to the second transmittance in the plurality of split exposures are adjusted based on a plurality of ideal transmittances and a plurality of first actual transmittances, The plurality of ideal transmittances are determined in a process in which the first transmittance ideally changes to the second transmittance when the change time is below the first threshold. The plurality of first actual transmittances are determined to be processes in which the first transmittance is actually changed to the second transmittance when the change time is equal to or less than the first threshold.

4. The control device according to claim 3, The first threshold value is a value determined based on an ideal waiting time until the first light transmittance changes to the second light transmittance.

5. The control device according to claim 3, When the change time exceeds the first threshold, A third light transmittance is determined between the first light transmittance and the second light transmittance so that the change time is less than or equal to the first threshold value. The plurality of first actual light transmittances are determined based on the first light transmittance and the third light transmittance.

6. The control device according to claim 5, When the change time exceeds the first threshold and the number of times the difference between the first light transmittance and the second light transmittance falls within a predetermined range continues for a predetermined number of times, the first threshold is a value larger than the value currently set.

7. The control device according to claim 6, The first threshold value, when the change time exceeds the first threshold value and the number of times the difference degree is within the predetermined range continues for the predetermined number of times, is a value determined based on a plurality of the change times obtained within the predetermined number of times.

8. The control device according to claim 5, When the change time exceeds the first threshold value and the number of times the difference between the first light transmittance and the second light transmittance falls within a predetermined range continues for a predetermined number of times, the plurality of divided exposures are maintained.

9. The control device according to claim 5, The plurality of first actual transmittances determine a process of change from the first transmittance to the second transmittance when the change time is less than or equal to the first threshold and the transmittance changes from the first transmittance to the second transmittance via the third transmittance.

10. The control device according to claim 5, When the change time exceeds the first threshold, and the maximum difference between the plurality of ideal light transmittances and the plurality of first actual light transmittances, namely the first maximum difference, exceeds a predetermined difference, The split exposures in the process of changing from the first transmittance to the second transmittance in the plurality of split exposures are adjusted based on the plurality of ideal transmittances and a plurality of second actual transmittances, The plurality of second actual transmittances are determined during a process in which the first transmittance changes to the second transmittance through a plurality of intermediate transmittances when the first transmittance is below the first threshold at the change time. The maximum difference between the plurality of intermediate light transmittances and the plurality of ideal light transmittances, ie, the second maximum difference, is smaller than the first maximum difference.

11. The control device according to claim 10, When the first maximum difference exceeds the predetermined difference and the time required to change from the first transmittance to the third transmittance, that is, the transmittance change time, is less than a second threshold, The divided exposures in a process of changing from the first light transmittance to the second light transmittance among the plurality of divided exposures are adjusted based on the plurality of ideal light transmittances and the plurality of second actual light transmittances.

12. The control device according to claim 3, The adjustment of the split exposure in the process of changing from the first transmittance to the second transmittance in the multiple split exposures is achieved by adjusting at least one of the multiple exposure factors defining the split exposure based on the difference between the ideal transmittance and the first actual transmittance.

13. The control device according to claim 3, The transmittance when the change time is equal to or less than the first threshold value changes based on the plurality of ideal transmittances.

14. The control device according to claim 3, When the change time is less than the first threshold, The plurality of divided exposures correspond to the plurality of ideal transmittances.

15. The control device according to claim 3, The plurality of ideal light transmittances monotonically vary between the first light transmittance and the second light transmittance.

16. The control device according to claim 3, When the change time is less than the first threshold, The plurality of divided exposures monotonically change from the divided exposure corresponding to the first transmittance to the target exposure.

17. The control device according to claim 3, The photographing device has a movable aperture. When a driving time of the diaphragm when the diaphragm is driven to achieve the target exposure exceeds the first threshold, the first threshold is a value equal to or greater than the driving time.

18. A photographing device comprising: The control device according to claim 1; and An image sensor is used for the shooting.

19. A control method comprising: Obtaining a plurality of split exposures determined based on the change time and the target exposure of the imaging device; and performing control to apply the plurality of divided exposures to exposures of at least a plurality of frames obtained by performing imaging by the imaging device within the variation time, The change time is the time required for the transmittance of the electronic neutral density filter mounted on the imaging device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

20. A computer-readable storage medium storing a program for causing a computer to perform a process comprising: Obtaining a plurality of split exposures determined based on the change time and the target exposure of the imaging device; and performing control to apply the plurality of divided exposures to exposures of at least a plurality of frames obtained by performing imaging by the imaging device within the variation time, The change time is the time required for the transmittance of the electronic neutral density filter mounted on the imaging device to change from a first transmittance to a second transmittance capable of achieving the target exposure.

Images