Control device, imaging device, control method, and program

Abstract

To provide a control device, an imaging device, a control method, and a program that can suppress abrupt changes in brightness between multiple frames in the process of bringing the exposure of multiple frames obtained by imaging with the imaging device to a target exposure while switching from one state to the other, where an electronic neutral density filter mounted on the imaging device is used, to the other, where the electronic neutral density filter is not used.SOLUTION: A control device includes a processor, which, when switching from one of a use state in which an electronic neutral density filter mounted on the image capture device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquires a target exposure for the image capture device after the switching and performs control to monotonically change the exposure of multiple frames obtained by capturing images with the image capture device at least within a switching time required for switching from one state to the other, toward the target exposure.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to a control device, an imaging device, a control method, and a program. [Background technology]

[0002] Patent Document 1 discloses an imaging device having an exposure state determination means, an exposure control means, an ND filter, and an ND control means. In the imaging device described in Patent Document 1, the exposure state determination means determines the exposure state. The exposure control means adjusts the exposure according to the exposure state. The ND filter is insertable into and removable from the optical path to adjust the exposure. The ND control means determines whether to insert or remove the ND filter based on predetermined conditions during video shooting. The exposure control means adjusts the exposure using the ND filter if the predetermined conditions are met, and adjusts the exposure without using the ND filter if the predetermined conditions are not met.

[0003] Patent Document 2 discloses an imaging device having an optical means for forming an image of a subject, a first light-attenuating means located on the optical axis of the optical means and capable of adjusting the amount of light by changing the size of an aperture and whose adjustment range changes depending on the focal length, a second light-attenuating means located on the optical axis of the optical means and capable of adjusting the amount of passing light by changing the transmittance and whose adjustment performance is coarser than the adjustment resolution of the first light-attenuating means, and a control means for controlling the operation of the first and second light-attenuating means to optimize exposure during photography. In the imaging device described in Patent Document 2, the control means adjusts the amount of light using the first and second light-attenuating means when the light-attenuating range of the first light-attenuating means is wider than that of the second light-attenuating means, and adjusts the light amount using the first light-attenuating means when the light-attenuating range of the first light-attenuating means is narrower than that of the second light-attenuating means.

[0004] Patent Document 3 discloses an imaging device that is switchable between a liquid crystal light control element and clear glass. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-157688 [Patent Document 2] Japanese Patent Application Laid-Open No. 2017-009952 [Patent Document 3] International Publication No. 2017 / 061169 Summary of the Invention

[0006] One embodiment of the present disclosure provides a control device, an imaging device, a control method, and a program that can suppress sudden changes in brightness between multiple frames in the process of bringing the exposure of multiple frames obtained by imaging with the imaging device to a target exposure while switching from one state to the other, where an electronic neutral density filter mounted on the imaging device is used, to the other, where the electronic neutral density filter is not used. [Means for solving the problem]

[0007] A first aspect of the present disclosure is a control device that includes a processor, and when the processor switches from one of a use state in which an electronic neutral density filter mounted on the imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, obtains a target exposure for the imaging device after the switch, and performs control to monotonically change the exposure of multiple frames obtained by imaging by the imaging device at least within the switching time required to switch from one state to the other, toward the target exposure.

[0008] A second aspect of the present disclosure is a control device according to the first aspect, in which multiple split exposures determined based on a first frame number, which is the number of frames corresponding to a switching time, and a target exposure are applied to the exposure of multiple frames.

[0009] A third aspect of the present disclosure is a control device according to the third aspect, in which the order in which the multiple split exposures are applied to the exposures of the multiple frames changes monotonically.

[0010] A fourth aspect of the present disclosure is a control device according to the second or third aspect, in which the split exposure is determined based on a target exposure, an exposure currently set for the imaging device, a proportion of the frame to which the electronic neutral density filter affects the frame, and a number of remaining frames corresponding to the time remaining until the switching is completed.

[0011] A fifth aspect of the present disclosure is a control device according to any one of the second to fourth aspects, wherein a plurality of frames are obtained by capturing images based on a default frame rate, and the first number of frames is determined based on the switching time and the default frame rate.

[0012] A sixth aspect of the present disclosure is a control device according to any one of the second to fifth aspects, in which, if a change in brightness of an object to be imaged exceeds a reference change amount while multiple split exposures are being applied sequentially to the exposure of multiple frames, the target exposure is updated, and the multiple split exposures are updated based on a second number of frames, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure.

[0013] A seventh aspect of the present disclosure is a control device according to any one of the second to sixth aspects, in which, when a change instruction to change the target exposure is given from outside while multiple split exposures are being applied sequentially to the exposure of multiple frames, the target exposure is updated, and the multiple split exposures are updated based on a third frame number, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure.

[0014] An eighth aspect of the present disclosure is a control device according to any one of the first to seventh aspects, in which, when the target exposure is outside an exposure range that can be tracked by switching, a notification or alert is given that the target exposure is outside the exposure range.

[0015] A ninth aspect of the present disclosure is a control device according to any one of the first to eighth aspects, in which, when the target exposure is outside the exposure range that can be tracked by switching, the exposure currently set for the imaging device is maintained, provided that an instruction to stop switching is given from outside.

[0016] A tenth aspect of the present disclosure is a control device according to any one of the first to tenth aspects, wherein, in a use state, an electronic neutral density filter is inserted into the optical path of the imaging device, and, in a non-use state, the electronic neutral density filter is removed from the optical path.

[0017] An eleventh aspect of the present disclosure is a control device according to the tenth aspect, wherein the imaging device includes a light-transmitting filter having an optical path length equivalent to the optical path length of the electronic neutral density filter, and the electronic neutral density filter and the light-transmitting filter are selectively inserted into and removed from the optical path, and in a used state, the electronic neutral density filter is inserted into the optical path and the light-transmitting filter is removed from the optical path, and in a non-used state, the light-transmitting filter is inserted into the optical path and the electronic neutral density filter is removed from the optical path.

[0018] A twelfth aspect of the present disclosure is an imaging device including the control device according to any one of the first to eleventh aspects and an image sensor used for imaging.

[0019] A thirteenth aspect of the present disclosure is a control method that includes, when switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, obtaining a target exposure of the imaging device after the switch, and performing control to monotonically change the exposure of multiple frames obtained by imaging by the imaging device at least within the switching time required for switching from one state to the other, toward the target exposure.

[0020] A fourteenth aspect of the present disclosure is a program for causing a computer to execute processing including, when switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, obtaining a target exposure of the imaging device after switching, and performing control to monotonically change the exposure of multiple frames obtained by imaging by the imaging device at least within the switching time required to switch from one state to the other, toward the target exposure. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a schematic diagram illustrating an example of the overall configuration of an imaging device. [Figure 2] FIG. 1 is a schematic diagram illustrating an example of a hardware configuration of an optical system and an electrical system of an imaging apparatus. [Figure 3] FIG. 1 is a conceptual diagram showing an example of how the ND region changes. [Figure 4] FIG. 2 is a block diagram showing an example of how the system controller operates. [Figure 5] FIG. 4 is a conceptual diagram showing an example of a part of the processing contents of exposure control processing performed by a processor. [Figure 6] FIG. 4 is a conceptual diagram showing an example of a part of the processing contents of exposure control processing performed by a processor. [Figure 7] 6 is a flowchart showing an example of the flow of exposure control processing according to the first embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of how to calculate and set multiple split exposures to be applied to the exposure of frames 0 to 5 included in multiple frames obtained by capturing live view images. [Figure 9A] 10 is a flowchart showing an example of the flow of exposure control processing according to the second embodiment. [Figure 9B] This is a continuation of the flowchart shown in FIG. 9A. [Figure 10A] 11 is a flowchart showing an example of exposure control processing according to the third embodiment. [Figure 10B] This is a continuation of the flowchart shown in FIG. 10A. [Figure 11A] 13 is a flowchart showing an example of exposure control processing according to the fourth embodiment. [Figure 11B] This is a continuation of the flowchart shown in FIG. 11A. [Figure 11C] This is a continuation of the flowchart shown in FIG. 11B. [Figure 12] 13 is a flowchart showing an example of exposure control processing according to the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, examples of embodiments of a control device, an imaging device, a control method, and a program according to the present disclosure will be described with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". GPGPU is an abbreviation for "General-purpose computing on graphics processing units". APU is an abbreviation for "Accelerated Processing Unit". TPU is an abbreviation for "Tensor processing unit". NVM is an abbreviation for "Non-volatile memory". RAM is an abbreviation for "Random Access Memory". IC is an abbreviation for "Integrated Circuit". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". SSD is an abbreviation for "Solid State Drive". USB is an abbreviation for "Universal Serial Bus". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". I / F is an abbreviation for "Interface". UI is an abbreviation for "User Interface". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". fps is an abbreviation for "Frames per second". MF is an abbreviation for "Manual focus". AF is an abbreviation for "Auto focus". AE is an abbreviation for "Auto Exposure". ND is an abbreviation for "Neutral Density". EL is an abbreviation for "Electro Luminescence".

[0025] In the following description, a coded processor (hereinafter simply referred to as a "processor") may be a single physical or virtual computing device, or a combination of multiple physical or virtual computing devices. Furthermore, a processor may be a single type of computing device, or a combination of multiple types of computing devices. Examples of computing devices include a CPU, a GPU, a GPGPU, an APU, or a TPU.

[0026] In the following description, a signed memory is a memory such as a RAM in which information is temporarily stored, and is used as a work memory by a processor.

[0027] In the following description, the term "storage" refers to one or more nonvolatile storage devices that store various programs, various parameters, etc. Examples of nonvolatile storage devices include flash memory, magnetic disks, and magnetic tapes. Another example of storage is cloud storage.

[0028] In the following embodiments, the external I / F with a symbol controls the exchange of various information between multiple devices connected to each other. An example of the external I / F is a USB interface. A communication I / F including a communication processor, an antenna, etc. may be applied to the external I / F. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0030] [First embodiment] As shown in FIG. 1 as an example, an imaging device 10 is a device that captures an image of a subject, and includes a system controller 12, an imaging device body 16, and an interchangeable lens 18. The imaging device 10 is an example of an "imaging device" according to the present disclosure, and the system controller 12 is an example of a "control device" and a "computer" according to the present disclosure. The system controller 12 is built into the imaging device body 16 and controls the entire imaging device 10. The interchangeable lens 18 is interchangeably attached to the imaging device body 16. The interchangeable lens 18 is provided with a focus ring 18A. The focus ring 18A is operated by a user of the imaging device 10 (hereinafter simply referred to as "user") when the user manually adjusts the focus of the imaging device 10 on a subject.

[0031] 1 shows an interchangeable-lens digital camera as an example of the imaging device 10, but this is merely an example and a fixed-lens digital camera may also be used. The present disclosure is also applicable to smart devices, wearable terminals, cinema cameras, television broadcasting video cameras, surveillance video cameras, endoscopes, cell observation devices, ophthalmic observation devices, surgical microscopes, etc. Smart devices, wearable terminals, cinema cameras, television broadcasting video cameras, surveillance video cameras, endoscopes, cell observation devices, ophthalmic observation devices, surgical microscopes, etc. are examples of the "imaging device" according to the present disclosure.

[0032] The imaging device body 16 is provided with an image sensor 20. The image sensor 20 is an example of an "image sensor" according to the present disclosure. The image sensor 20 is a CMOS image sensor. The image sensor 20 captures an image of a subject, which is the imaging target. When an interchangeable lens 18 is attached to the imaging device body 16, subject light, which is light representing the subject, passes through the interchangeable lens 18 and is focused on the image sensor 20, and image data representing the image of the subject is generated by the image sensor 20.

[0033] In the first embodiment, a CMOS image sensor is exemplified as the image sensor 20, but the present disclosure is not limited to this, and the present disclosure also applies when the image sensor 20 is another type of image sensor, such as a CCD image sensor.

[0034] A release button 22 and a dial 24 are provided on the top surface of the imaging device body 16. The dial 24 is operated when setting the operation mode of the imaging system and the operation mode of the playback system, and by operating the dial 24, the imaging device 10 is selectively set as an operation mode among the imaging mode, playback mode, and setting mode. The imaging mode is an operation mode that causes the imaging device 10 to capture an image. The image is captured by operating a mechanical shutter (not shown) and / or an electronic shutter (not shown). The playback mode is an operation mode that plays back images (e.g., still images and / or moving images) obtained by capturing an image for recording in the imaging mode. The setting mode is an operation mode that is set for the imaging device 10 when, for example, setting various setting values ​​used in image capture-related controls.

[0035] The release button 22 functions as an imaging preparation instruction section and an imaging instruction section, and is capable of detecting two stages of pressing operation: an imaging preparation instruction state and an imaging instruction state. The imaging preparation instruction state refers to a state in which the button is pressed from a standby position to an intermediate position (e.g., a half-pressed position), for example, and the imaging instruction state refers to a state in which the button is pressed beyond the intermediate position to a final pressed position (e.g., a fully pressed position). Depending on the configuration of the imaging device 10, the imaging preparation instruction state may be a state in which the user's finger is in contact with the release button 22, and the imaging instruction state may be a state in which the operating user's finger has moved from a state in which it is in contact with the release button 22 to a state in which it is released.

[0036] On the rear surface of the imaging device main body 16, instruction keys 26 and a touch panel display 32 are provided.

[0037] The touch panel display 32 includes a display 28 and a touch panel 30 (see also FIG. 2). An example of the display 28 is an EL display (e.g., an organic EL display or an inorganic EL display). The display 28 may be a different type of display, such as a liquid crystal display, instead of an EL display.

[0038] The display 28 displays images and / or text information, etc. When the imaging device 10 is in imaging mode, the display 28 is used to capture images for live view images, i.e., to display live view images obtained by continuous imaging. Here, a "live view image" refers to a moving image for display based on image data obtained by imaging by the image sensor 20. The imaging performed to obtain a live view image (hereinafter also referred to as "image capture for live view images") is performed based on a frame rate of, for example, 60 fps. 60 fps is merely an example, and a frame rate less than 60 fps (e.g., 30 fps) or greater than 60 fps (e.g., 180 fps) may also be used.

[0039] The display 28 is also used to display a still image obtained by capturing a still image when an instruction to capture a still image is given to the imaging device 10 via the release button 22. The display 28 is also used to display a playback image when the imaging device 10 is in playback mode. Furthermore, the display 28 is also used to display a menu screen on which various menus can be selected when the imaging device 10 is in setting mode, and a setting screen for setting various setting values ​​used in imaging-related controls.

[0040] The touch panel 30 is a transmissive touch panel that is overlaid on the surface of the display area of ​​the display 28. The touch panel 30 receives instructions from the user (for example, an instruction to prepare for imaging and / or an instruction to capture an image, etc.) by detecting contact with a pointer such as a finger or a stylus pen.

[0041] In the first embodiment, an out-cell type touch panel display in which the touch panel 30 is overlaid on the surface of the display area of ​​the display 28 is given as an example of the touch panel display 32, but this is merely an example. For example, an on-cell type or an in-cell type touch panel display can also be used as the touch panel display 32.

[0042] The instruction keys 26 accept various instructions. Here, "various instructions" refers to, for example, an instruction to display a menu screen, an instruction to select one or more menus, an instruction to confirm a selection, an instruction to erase a selection, an instruction to zoom in, zoom out, and frame-by-frame advance. These instructions may also be given via the touch panel 30.

[0043] As an example, as shown in FIG. 2, the image sensor 20 includes a photoelectric conversion element 72. The photoelectric conversion element 72 has a light-receiving surface 72A. The photoelectric conversion element 72 is disposed within the imaging device body 16 so that the center of the light-receiving surface 72A coincides with the optical axis OA (see also FIG. 1). The photoelectric conversion element 72 has a plurality of photosensitive pixels arranged in a matrix, and the light-receiving surface 72A is formed by the plurality of photosensitive pixels. Each photosensitive pixel has a microlens (not shown). Each photosensitive pixel is a physical pixel having a photodiode (not shown), which photoelectrically converts received light and outputs an electrical signal according to the amount of received light.

[0044] In addition, the multiple photosensitive pixels have red (R), green (G), or blue (B) color filters (not shown) arranged in a matrix in a predetermined pattern arrangement (e.g., Bayer arrangement, G-stripe R / G complete checkerboard, X-Trans (registered trademark) arrangement, honeycomb arrangement, etc.).

[0045] The interchangeable lens 18 includes an imaging lens 40. The imaging lens 40 has an objective lens 40A, a variable magnification lens 40B, and a movable diaphragm 40C.

[0046] The objective lens 40A, the variable magnification lens 40B, and the aperture 40C are arranged in this order along the optical axis OA from the subject side (object side) to the imaging device body 16 side (image side).

[0047] The interchangeable lens 18 also includes a control device 36, a first actuator 37, and a second actuator 38. The control device 36 controls the entire interchangeable lens 18 in accordance with instructions from the imaging device body 16. The control device 36 is a device having a computer including, for example, a CPU, NVM, RAM, etc. The RAM of the control device 36 temporarily stores various types of information and is used as work memory. In the control device 36, the CPU reads necessary programs from the NVM and executes the various read programs on the RAM to control the entire imaging lens 40.

[0048] Although a device having a computer is given here as an example of the control device 36, this is merely an example, and devices including ASIC, FPGA, and / or PLD may also be applied. Furthermore, the control device 36 may be, for example, a device realized by a combination of hardware and software configurations.

[0049] The first actuator 37 includes a magnification change slide mechanism (not shown) and a magnification change motor (not shown). A magnification change lens 40B is attached to the magnification change slide mechanism so as to be slidable along the optical axis OA. A magnification change motor is also connected to the magnification change slide mechanism, and the magnification change slide mechanism operates by receiving power from the magnification change motor to move the magnification change lens 40B along the optical axis OA.

[0050] The second actuator 38 includes a power transmission mechanism (not shown) and an aperture motor (not shown). The aperture 40C has an opening 40C1, the size of which is variable. The opening 40C1 is formed, for example, by a plurality of aperture blades 40C2. The plurality of aperture blades 40C2 are connected to the power transmission mechanism. The power transmission mechanism is also connected to an aperture motor, which transmits the power of the aperture motor to the plurality of aperture blades 40C2. The plurality of aperture blades 40C2 operate in response to the power transmitted from the power transmission mechanism, thereby changing the size of the aperture 40C1. The aperture 40C adjusts the exposure by changing the size of the aperture 40C1.

[0051] The magnification motor and the aperture motor are connected to the control device 36, and the control device 36 controls the driving of each of the magnification motor and the aperture motor. In the first embodiment, a stepping motor is used as an example of the magnification motor and the aperture motor. Therefore, the magnification motor and the aperture motor operate in synchronization with pulse signals in response to commands from the control device 36. Also, while an example is shown here in which the magnification motor and the aperture motor are provided in the interchangeable lens 18, this is merely an example, and at least one of the magnification motor and the aperture motor may be provided in the imaging device body 16. The components and / or operation method of the interchangeable lens 18 can be changed as necessary.

[0052] In the imaging mode, the imaging device 10 selectively sets MF mode and AF mode in accordance with instructions given to the imaging device body 16. MF mode is an operating mode in which the focus is adjusted manually. In MF mode, for example, when the user operates the focus ring 18A or the like, the variable magnification lens 40B moves along the optical axis OA by an amount corresponding to the amount of operation of the focus ring 18A or the like, thereby adjusting the focus.

[0053] In AF mode, the imaging device body 16 calculates the in-focus position according to the subject distance, and adjusts the focus by moving the variable magnification lens 40B toward the calculated in-focus position. Here, the in-focus position refers to the position on the optical axis OA of the variable magnification lens 40B when the subject is in focus.

[0054] In the imaging mode, the imaging device 10 selectively sets either the manual exposure mode or the AE mode in accordance with instructions given to the imaging device body 16. The manual exposure mode is an operating mode in which exposure is adjusted manually, while the AE mode is an operating mode in which exposure is set automatically.

[0055] The imaging device main body 16 includes an image sensor 20, a system controller 12, an image memory 46, a UI device 48, an external I / F 50, a photoelectric conversion element driver 54, an ND filter driver 55, a motor driver 56, and an input / output interface 70. The image sensor 20 also includes a photoelectric conversion element 72 and an A / D converter 74.

[0056] The input / output interface 70 is connected to the system controller 12, image memory 46, UI device 48, external I / F 50, photoelectric conversion element driver 54, ND filter driver 55, motor driver 56, and A / D converter 74. The input / output interface 70 is also connected to the control device 36 of the interchangeable lens 18.

[0057] The system controller 12 includes a processor 64, storage 66, and memory 68. Here, the processor 64 is an example of a "processor" according to the present disclosure.

[0058] The processor 64, storage 66, and memory 68 are connected via a bus 75, which is connected to an input / output interface 70. Although the example shown in Fig. 2 shows a single bus as the bus 75 for convenience of illustration, multiple buses may be used. The bus 75 may be a serial bus or a parallel bus including a data bus, an address bus, a control bus, etc.

[0059] The storage 66 is a computer-readable non-transitory storage medium that stores various parameters and various programs. The various programs include an exposure control processing program PG (see FIG. 5), which will be described later. An example of the storage 66 is an EEPROM. The memory 68 temporarily stores various information and is used as a work memory. An example of the memory 68 is a RAM.

[0060] The processor 64 reads out a necessary program from the storage 66 and executes the read program in the memory 68. The processor 64 controls the entire imaging device 10 in accordance with the program executed on the memory 68. That is, in the example shown in Fig. 2, the image memory 46, the UI device 48, the external I / F 50, the photoelectric conversion element driver 54, the ND filter driver 55, the motor driver 56, the control device 36, etc. are controlled by the system controller 12.

[0061] The photoelectric conversion element 72 is connected to a photoelectric conversion element driver 54. The photoelectric conversion element driver 54 supplies an imaging timing signal that defines the timing of imaging performed by the photoelectric conversion element 72 to the photoelectric conversion element 72 in accordance with instructions from the processor 64. The photoelectric conversion element 72 performs resetting, exposure, and output of an electrical signal in accordance with the imaging timing signal supplied from the photoelectric conversion element driver 54. Examples of imaging timing signals include a vertical synchronization signal and a horizontal synchronization signal.

[0062] When the interchangeable lens 18 is attached to the imaging device body 16, subject light incident on the imaging lens 40 is imaged on the light-receiving surface 72A by the imaging lens 40. Under the control of the photoelectric conversion element driver 54, the photoelectric conversion element 72 photoelectrically converts the subject light received by the light-receiving surface 72A and outputs an electrical signal corresponding to the amount of subject light to the A / D converter 74 as analog image data indicating the subject light. Specifically, the A / D converter 74 reads out the analog image data from the photoelectric conversion element 72 in units of one frame and for each horizontal line using an exposure sequential readout method.

[0063] The A / D converter 74 digitizes the analog image data to generate a RAW image 79. The RAW image 79 is an image in which R pixels, G pixels, and B pixels are arranged in a mosaic pattern.

[0064] The processor 64 acquires the RAW image 79 from the A / D converter 74 and performs image processing on the acquired RAW image 79 .

[0065] The image memory 46 stores a frame 80. The frame 80 is an image obtained by the processor 64 performing image processing on the RAW image 79.

[0066] The UI device 48 includes a display 28, and the processor 64 displays various types of information on the display 28. The UI device 48 also includes a reception device 76. The reception device 76 includes a touch panel 30 and a hard key unit 78. The hard key unit 78 is a plurality of hard keys including the instruction keys 26 (see FIG. 1). The processor 64 operates in accordance with various instructions received by the touch panel 30.

[0067] The external I / F 50 controls the exchange of various information with devices external to the imaging device 10 (hereinafter also referred to as "external devices"). External devices (not shown), such as a smart device, a personal computer, a server, a USB memory, a memory card, and / or a printer, are directly or indirectly connected to the external I / F 50. The external I / F 50 is also connected to a network (not shown). The external I / F 50 controls the exchange of information between the system controller 12 and a communication device (not shown), such as a server on the network. For example, the external I / F 50 transmits information in response to a request from the system controller 12 to the communication device via the network. The external I / F 50 also receives information transmitted from the communication device and outputs the received information to the system controller 12 via the input / output interface 70.

[0068] The imaging device 10 includes an electronic ND filter 58 and a clear glass 60. Here, the electronic ND filter 58 is an example of an "electronic neutral density filter" according to the present disclosure. The electronic ND filter 58 and the clear glass 60 are mounted on the imaging device body 16. The electronic ND filter 58 and the clear glass 60 are disposed on the subject side of the light receiving surface 72A. The electronic ND filter 58 and the clear glass 60 are disposed in this order from the subject side to the image side. Note that, while an example in which the electronic ND filter 58 and the clear glass 60 are mounted on the imaging device body 16 has been given here, this is merely an example, and at least the electronic ND filter 58 of the electronic ND filter 58 and the clear glass 60 may be mounted on the interchangeable lens 18.

[0069] The electronic ND filter 58 is an electronic variable neutral density filter made of a material containing liquid crystal molecules whose orientation changes when a voltage is applied. The electronic ND filter 58 adjusts the amount of light passing through the electronic ND filter 58 by changing its transmittance depending on the applied voltage. The transmittance of the electronic ND filter 58 can be seamlessly changed. Therefore, for example, when the aperture value is maintained, the transmittance of the electronic ND filter 58 can be changed to adjust the brightness of the frame 80 to a target brightness while maintaining the depth of field. Furthermore, when the aperture value is changed, the transmittance of the electronic ND filter 58 can be changed to compensate for the increase or decrease in exposure that accompanies the change in aperture value, thereby maintaining a constant brightness across multiple frames 80 even while the aperture value is changing.

[0070] An ND filter driver 55 is connected to the electronic ND filter 58. The ND filter driver 55 controls the transmittance of the electronic ND filter 58 by applying a voltage to the electronic ND filter 58 in accordance with instructions from the system controller 12.

[0071] The clear glass 60 is a glass plate having translucency. An example of a glass plate having translucency is a transparent glass plate. The optical path length of the clear glass 60 is the same as the optical path length of the electronic ND filter 58. Note that, although the clear glass 60 is illustrated here, a transparent glass plate is merely an example, and the present disclosure also applies to a filter having an optical path difference equivalent to that of the electronic ND filter 58 and having translucency (for example, a translucent glass plate having the same optical path difference as that of the electronic ND filter 58). Note that, in the present first embodiment, the clear glass 60 is an example of a "translucent filter" according to the present disclosure.

[0072] The imaging device 10 includes a shift mechanism 62. The shift mechanism 62 is mounted on the imaging device body 16. The shift mechanism 62 has a motor 62A. An example of the motor 62A is a stepping motor. The shift mechanism 62 transmits power generated by the motor 62A to the electronic ND filter 58 and the clear glass 60, thereby shifting the electronic ND filter 58 and the clear glass 60 in a direction transverse to the optical axis OA.

[0073] A motor driver 56 is connected to the motor 62A, and the motor 62A operates under the control of the motor driver 56 in accordance with instructions from the system controller 12. The motor 62A is mechanically connected to the electronic ND filter 58 and the clear glass 60 via a plurality of gears. The motor 62A applies power to the electronic ND filter 58 and the clear glass 60 under the control of the motor driver 56 in accordance with instructions from the system controller 12, thereby selectively inserting the electronic ND filter 58 and the clear glass 60 into or removing them from the optical path.

[0074] That is, in a usage state in which the electronic ND filter 58 is used (hereinafter also simply referred to as the "usage state"), the electronic ND filter 58 is inserted into the optical path, and the clear glass 60 is removed from the optical path. On the other hand, in a non-usage state in which the electronic ND filter 58 is not used (hereinafter also simply referred to as the "non-usage state"), the clear glass 60 is inserted into the optical path, and the electronic ND filter 58 is removed from the optical path. Note that in the first embodiment, an example of a usage state is a state in which the electronic ND filter 58 is used within the effective pixel area of ​​the photoelectric conversion element 72 (in other words, a state in which the electronic ND filter 58 affects the range of the frame 80 displayed on the display 28).

[0075] A plurality of gears mechanically connecting the motor 62A to the electronic ND filter 58 and the clear glass 60 imparts power in the rotational direction of the motor 62A to the electronic ND filter 58, and power in the opposite direction to the rotational direction of the motor 62A to the clear glass 60. For example, when forward rotation power is generated by the motor 62A, forward rotation power is imparted to the electronic ND filter 58, and reverse rotation power is imparted to the clear glass 60. When reverse rotation power is generated by the motor 62A, forward rotation power is imparted to the clear glass 60, and reverse rotation power is imparted to the electronic ND filter 58. In this way, by applying power from the motor 62A to the electronic ND filter 58 and the clear glass 60, one of the electronic ND filter 58 and the clear glass 60 is inserted into the optical path, and the other is removed from the optical path. Because the optical path length of the electronic ND filter 58 and the optical path length of the clear glass 60 are the same, even if the electronic ND filter 58 is removed from the optical path when not in use, the clear glass 60 is inserted into the optical path, so the same optical path length as when the electronic ND filter 58 is inserted into the optical path is maintained. Also, even if the clear glass 60 is removed from the optical path when in use, the electronic ND filter 58 is inserted into the optical path, so the same optical path length as when the clear glass 60 is inserted into the optical path is maintained.

[0076] Switching from one of the use state and the non-use state to the other is initiated based on an instruction given to the imaging device 10 by the user and / or various conditions. Switching from one of the use state and the non-use state to the other takes a time equivalent to multiple frames from the start of switching to the end of switching. For example, when switching from the non-use state to the use state, the area over which the electronic ND filter 58 overlaps with the effective pixel area of ​​the photoelectric conversion element 72 gradually changes during the switching from the non-use state to the use state. That is, the area over which the electronic ND filter 58 overlaps with the effective pixel area of ​​the photoelectric conversion element 72 gradually expands. On the other hand, when switching from the use state to the non-use state, the area over which the electronic ND filter 58 overlaps with the effective pixel area of ​​the photoelectric conversion element 72 gradually changes during the switching from the use state to the non-use state. That is, the area over which the electronic ND filter 58 overlaps with the effective pixel area of ​​the photoelectric conversion element 72 gradually narrows.

[0077] For example, as shown in FIG. 3, if the plurality of frames 80 obtained by capturing live view images are a plurality of frames 80 including the 0th frame 80 to the 5th frame 80, when the non-use state is switched to the use state while the 0th frame 80 to the 5th frame 80 are obtained, an ND region R is formed, which is a region where the electronic ND filter 58 overlaps with the effective pixel region of the photoelectric conversion element 72 during the change from the 0th frame 80 to the 5th frame 80. NDThe width of the frame 80 gradually changes. As a result, the brightness of the entire frame 80 changes between frames 80. In this case, the difference in brightness between the 0th frame 80 and the 5th frame 80 becomes very large (for example, the difference in brightness between each frame 80 becomes several times (for example, approximately twice)). In the example shown in FIG. 3, if the difference in brightness between the 0th frame 80 and the 5th frame 80 is very large, there is a concern that this may cause visual discomfort to the user or detract from the appearance of the multiple frames 80. The same can be said for switching from a use state to a non-use state.

[0078] In view of these circumstances, in the first embodiment, as an example, exposure control processing is performed by the processor 64, as shown in FIG. 4. An exposure control processing program PG is stored in the storage 66. The exposure control processing program PG is an example of a "program" according to the present disclosure. The processor 64 reads the exposure control processing program PG from the storage 66 and executes the read exposure control processing program PG in the memory 68. The exposure control processing is realized by the processor 64 executing the exposure control processing program PG. An example of the exposure control processing will be described below.

[0079] 5 and 6 show an example of the contents of the exposure control process performed by the processor 64. First, as shown in Fig. 5 as an example, when the timing to start exposure calculation arrives, the processor 64 calculates a photometric value 90 indicating the brightness of the subject based on a frame 80 obtained by capturing an image for a live view image. Note that the photometric value 90 may be measured by an exposure meter (not shown).

[0080] Processor 64 also determines whether a switching operation from one of the in-use state and the out-of-use state to the other has started. If a switching operation from one of the in-use state and the out-of-use state to the other has not started (i.e., no switching from one of the in-use state and the out-of-use state to the other) processor 64 determines a target exposure EX according to photometric value 90. target1 Get Target Exposure EX target1 The target exposure EX indicates the exposure to be targeted for the next frame (in other words, the exposure set in the image capture device 10 as the appropriate exposure for the next frame). target1 is calculated based on the photometric value 90 and the current transmittance 92, which is the current transmittance of the electronic ND filter 58 or the clear glass 60 currently inserted in the optical path. target1 The calculation of is performed using a target exposure calculation formula 93. The target exposure calculation formula 93 uses the photometric value 90 and the current transmittance 92 as independent variables, and calculates the target exposure EX target1 is an arithmetic expression with as the dependent variable.

[0081] The processor 64 sets the target exposure EX as the exposure for the next frame for the image capture device 10. target1 After setting the above, the image pickup device 10 is caused to pick up an image for the next frame.

[0082] On the other hand, as shown in FIG. 6 as an example, when a switching operation from one of the use state and the non-use state to the other is started, the processor 64 sets the target exposure EX , which is the appropriate exposure to be set for the image capture device 10 after switching from one of the use state and the non-use state to the other. target2 For example, target exposure EX target2 is calculated based on the photometric value 90 and the transmittance of the destination (in other words, the transmittance after switching from one of the use state and the non-use state to the other), that is, the transmittance of the electronic ND filter 58 or the clear glass 60 inserted in the optical path at the time when switching from one of the use state and the non-use state to the other is completed. target2The calculation of is performed using a target exposure calculation formula 95. The target exposure calculation formula 95 uses the photometric value 90 and the switchover transmittance 94 as independent variables, and calculates the target exposure EX target2 is an arithmetic expression with as the dependent variable.

[0083] Furthermore, when a switching operation from one of the in-use state and the out-of-use state to the other is initiated, the processor 64 acquires a switching time T, which is the time required to switch from one of the in-use state and the out-of-use state to the other. The switching time T is measured in advance in a test using an actual device. For example, the measured switching time T is stored in a predetermined storage area (e.g., storage 66), and is acquired by the processor 64 from the predetermined storage area.

[0084] Based on the switching time T and the frame rate FR (for example, a frame rate equivalent to the frame rate described above), the processor 64 calculates the required number of frames A1, which is the number of frames corresponding to the switching time T, i.e., the number of frames obtained within the switching time T (i.e., the number of frames 80 obtained by capturing live view images within the switching time T). The required number of frames A1 is calculated by "(switching time T) x (frame rate FR)".

[0085] The processor 64 determines the number of frames required, A1, and the target exposure, EX. target2 Based on this, the target exposure EX is calculated from the exposure currently set for the image capture device 10 (hereinafter also referred to as the "current exposure"). target2 Multiple split exposures that vary monotonically towards EX div Calculate multiple split exposures EX div The calculation of is performed using a divided exposure calculation formula 96. The divided exposure calculation formula 96 is based on the current exposure, the number of frames required A1, and the target exposure EX target2 is used as an independent variable, and multiple split exposures EX div is an arithmetic expression with as the dependent variable.

[0086] Multiple Split Exposure EX div is the target exposure from the current exposure EX target2 Multiple split exposures EXdiv are multiple exposures that are applied to the exposure of multiple frames 80 obtained by capturing live view images within the switching time T, and change monotonically in the order that they are applied to the exposure of multiple frames 80 obtained by capturing live view images within the switching time T. Here, a monotonous change refers to, for example, a linear change. Note that a linear change is merely an example, and a monotonous change such as an exponential change may also be used.

[0087] Multiple Split Exposure EX div Each of the divided exposures EX is defined by the shutter speed (for example, the shutter speed of the mechanical shutter when a mechanical shutter is used, or the shutter speed of the electronic shutter when an electronic shutter is used), the aperture value (i.e., F-number) of the aperture 40C, and the sensitivity (for example, ISO sensitivity) of the photoelectric conversion element 72. div Target Exposure EX target2 The monotonous change towards is achieved by controlling the shutter speed, the aperture value of the aperture 40C (hereinafter simply referred to as "aperture value"), and / or the sensitivity of the photoelectric conversion element 72 (hereinafter simply referred to as "sensitivity").

[0088] The processor 64 converts the exposures of the plurality of frames 80 obtained by capturing live view images within the switching time T into a plurality of split exposures EX div For each frame, the imaging device 10 is set to perform the corresponding divided exposure EX div After setting the target exposure EX, the image capturing device 10 is caused to capture an image. As a result, the exposure of the multiple frames 80 obtained by capturing live view images within the switching time T is set to the target exposure EX. target2 changes monotonically towards

[0089] In the first embodiment, the switching time T is an example of the "switching time" according to the present disclosure, the frame rate FR is an example of the "default frame rate" according to the present disclosure, the required number of frames A1 is an example of the "first number of frames" according to the present disclosure, and the target exposure EX target2is an example of a "target exposure" according to the present disclosure, and the multiple frames 80 obtained by capturing live view images are an example of a "multiple frames" according to the present disclosure, and the multiple split exposures EX div is an example of "multiple split exposures" according to the present disclosure.

[0090] Next, the operation of the imaging device 10 will be described with reference to Fig. 7. Fig. 7 shows an example of the flow of exposure control processing executed by the processor 64 on the condition that the timing to start exposure calculation has arrived when imaging for a live view image is being performed (in other words, the timing designated in advance as the timing for adjusting the exposure of a frame 80 obtained by imaging for a live view image has arrived). The flow of exposure control processing shown in Fig. 7 is an example of a "control method" according to the present disclosure.

[0091] 7, first, in step ST10, processor 64 acquires frame 80 generated by capturing an image for a live view image. After the processing of step ST10 is executed, the exposure control processing proceeds to step ST12.

[0092] In step ST12, the processor 64 calculates a photometric value 90 based on the frame 80 acquired in step ST10. After the processing of step ST12 is executed, the exposure control processing proceeds to step ST14.

[0093] In step ST14, processor 64 determines whether a switching operation from one of the used state and the unused state to the other has started. If a switching operation from one of the used state and the unused state to the other has not started in step ST14, the determination is negative, and the exposure control process proceeds to step ST16. If a switching operation from one of the used state and the unused state to the other has started in step ST14, the determination is positive, and the exposure control process proceeds to step ST20.

[0094] In step ST16, the processor 64 calculates the target exposure EX according to the photometric value 90. target1 After the processing of step ST16 is executed, the exposure control processing proceeds to step ST18.

[0095] In step ST18, the processor 64 sets the target exposure EX for the next frame to the image capture device 10. target1 After setting the exposure control value, the image capturing device 10 is caused to capture an image for the next frame. After the process of step ST18 is executed, the exposure control process ends.

[0096] In step ST20, the processor 64 calculates the target exposure EX based on the photometric value 90 and the destination transmittance 94. target2 After the process of step ST20 is executed, the exposure control process proceeds to step ST22.

[0097] In step ST22, processor 64 acquires the switching time T. After the processing of step ST22 is executed, the exposure control processing proceeds to step ST24.

[0098] In step ST24, the processor 64 calculates the required number of frames A1 based on the switching time T and the frame rate FR. After the processing of step ST24 is executed, the exposure control processing proceeds to step ST26.

[0099] In step ST26, the processor 64 calculates the number of frames required A1 and the target exposure EX target2 and based on multiple split exposure EX div After the process of step ST26 is executed, the exposure control process proceeds to step ST28.

[0100] Here, assuming that N is a natural number with an initial value of "1", in step ST28, the processor 64 calculates the number of divided exposures EX calculated by executing the process of step ST26. div Split exposure EX for the Nth frame divIn step ST28, the processor 64 causes the imaging device 10 to perform an image capture. div After setting the shutter speed, aperture value, and sensitivity that define the exposure, the image capturing apparatus 10 is caused to capture an image. After the processing of step ST28 is executed, the exposure control processing proceeds to step ST30.

[0101] In step ST30, the processor 64 determines whether the exposure of the Nth frame is the target exposure EX target2 In step ST30, it is determined whether the exposure of the Nth frame reaches the target exposure EX target2 If the exposure of the Nth frame does not reach the target exposure EX, the determination is negative, and the exposure control process proceeds to step ST32. In step ST32, processor 64 adds "1" to N. After the process of step ST32 is executed, the exposure control process proceeds to step ST28. In step ST30, the exposure of the Nth frame is set to the target exposure EX. target2 If the value reaches , the determination is affirmative and the exposure control process ends.

[0102] As described above, in the imaging device 10 according to the first embodiment, when the imaging device 10 is switched from one of the use state and the non-use state to the other, the target exposure EX set for the imaging device 10 after the switching is target2 Then, the exposure of the plurality of frames 80 obtained by capturing live view images within the switching time T is calculated by subtracting the target exposure EX from the current exposure. target2 As a result, the exposure of the plurality of frames 80 obtained by capturing images for live view images within the switching time T changes from the current exposure to the target exposure EX target2 Therefore, the exposure of the plurality of frames 80 obtained by capturing live view images while switching from one of the use state and the non-use state to the other is set as the target exposure EX target2 In the process of reaching the predetermined value, a sudden change in brightness between a plurality of frames 80 can be suppressed.

[0103] Furthermore, in the imaging device 10 according to the first embodiment, when the imaging device 10 is not in use, the clear glass 60 is inserted into the optical path, and the electronic ND filter 58 is removed from the optical path. The optical path lengths of the electronic ND filter 58 and the clear glass 60 are the same. Therefore, even if the electronic ND filter 58 is removed from the optical path when the imaging device 10 is not in use, the clear glass 60 is inserted into the optical path, so the same optical path length as when the electronic ND filter 58 is inserted into the optical path can be maintained. On the other hand, when the imaging device 10 is in use, the electronic ND filter 58 is inserted into the optical path, and the clear glass 60 is removed from the optical path. The optical path lengths of the electronic ND filter 58 and the clear glass 60 are the same. Therefore, even if the clear glass 60 is removed from the optical path when the imaging device 10 is in use, the electronic ND filter 58 is inserted into the optical path, so the same optical path length as when the clear glass 60 is inserted into the optical path can be maintained.

[0104] [Second embodiment] In the first embodiment, a plurality of divided exposures EX div is monotonically changed in the order in which it is applied to a plurality of frames 80 obtained by capturing live view images within the switching time T. In the second embodiment, however, the ND region R ND Split exposure EX adjusted according to the width of the div is applied as the exposure of the corresponding frame 80.

[0105] In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted. In addition, in the second embodiment, the differences from the first embodiment will be mainly described.

[0106] As an example, as shown in FIG. 8, a plurality of frames 80 obtained by capturing live view images within the switching time T include a frame 80 in a non-use state (i.e., a frame 80 in a non-use state where the ND region R ND Frame 80 in which the ratio of the ND area to the effective pixel area is 0%) to the fifth frame 80 in the use state (i.e., frame 80 in which the ratio of the ND area to the effective pixel area is 0%) NDThis includes frame 80, where the percentage is 100%.

[0107] When multiple frames 80 are obtained by capturing live view images, the processor 64 determines the split exposure EX to be applied to the next frame 80 (in other words, the frame for exposure setting), which is the frame 80 obtained after the frame 80 for which the current exposure is set. div Target Exposure EX target2 and the current exposure EX, which is the exposure currently set for the image capture device 10. current and the ND area R for the effective pixel area ND (in other words, the ratio of the ND region R ND ND area ratio ND R and the remaining number of frames N rf (i.e., the number of frames that can be obtained in the remaining time from the current frame, which is the currently obtained frame 80, until the switching from one of the use state and the non-use state to the other is completed). Then, the processor 64 calculates the calculated split exposure EX div is set in the image capture device 10 as the exposure for the next frame.

[0108] Split Exposure EX applied to next frame div is the ND area ratio ND R But now Exposed EX current is set to the frame 80 at which the switch from the unused state to the used state is completed, and is defined by the following formulas (1) and (2). That is, the processor 64 determines the split exposure EX to be applied to the next frame using the following formulas (1) and (2). div Calculate.

[0109] (Split exposure EX div ) = (coefficient α) × (target exposure EX target2 -current exposure current )+current exposure current ·····(1)

[0110] (Coefficient α) = (1-ND area ratio ND R ) / (Number of remaining frames N rf )·····(2)

[0111] In the example shown in FIG. 8, when the first frame is the exposure setting target frame, the number of remaining frames N rf is "5" (the number of frames obtained from the current time until the switching to the use state is completed is "5"). Therefore, the ND area ratio ND R Assuming that the value of EX changes at a constant rate, the next frame (i.e., the first frame) to the fifth frame are split-exposure EX div In the 0th frame, the split exposure EX of the next frame (i.e., the 1st frame) is calculated. div is the ND area ratio ND R is estimated to be 20%, and the calculated split exposure EX div is set as the exposure for the next frame (i.e., the first frame).

[0112] Split Exposure EX set up as above div When the first frame is captured, the number of remaining frames is N rf After the first frame is captured, the divided exposure EX is applied to the exposure of the second frame 80, which is the next frame for exposure setting. div The ND area ratio ND of the first frame at the time of calculation is R When the ratio of the ND area to the ND area becomes 24%, the remaining 4 frames contain 76% of the non-ND area (i.e., the ND area R ND Areas other than the ND area R ND Assuming that the values ​​change evenly, multiple split exposures EX from the next frame (i.e., the second frame) to the fifth frame are taken. div In the first frame, the split exposure EX of the next frame (i.e., the second frame) is recalculated. div is the ND area ratio ND R is estimated to be 43% and calculated as split exposure EX div is set as the exposure for the next frame (i.e., the second frame).

[0113] Split Exposure EX set up as above div When the second frame is captured, the number of remaining frames is N rf After the second frame is captured, the divided exposure EX is applied to the exposure of the third frame 80, which is the next frame for exposure setting. div The ND area ratio ND of the second frame at the time of calculation is R When the ratio becomes 46%, the remaining 3 frames will be divided into 54% of the non-ND area and the ND area R ND Assuming that the values ​​change evenly, the next frame (i.e., the third frame) to the fifth frame are divided into multiple exposures, EX div In the second frame, the split exposure EX of the next frame (i.e., the third frame) is calculated again. div is the ND area ratio ND R is estimated to be 64% and calculated as split exposure EX div is set as the exposure for the next frame (i.e., the third frame).

[0114] Split Exposure EX set up as above div When the third frame is captured, the number of remaining frames is N rf After the third frame is captured, the divided exposure EX is applied to the exposure of the fourth frame 80, which is the next frame for exposure setting. div The ND area ratio ND of the third frame is calculated R When the ratio becomes 65%, the remaining 35% of the non-ND area is converted to the ND area R ND Assuming that the values ​​change evenly, the next frame (i.e., the 4th frame) and the 5th frame are split into multiple exposures. div In the third frame, the split exposure EX of the next frame (i.e., the fourth frame) is calculated. div is the ND area ratio ND R is estimated to be 82.5% and calculated as split exposure EX div is set as the exposure for the next frame (i.e., the fourth frame).

[0115] Split Exposure EX set up as above div When the fourth frame is captured, the number of remaining frames is N rf After the fourth frame is captured, the divided exposure EX is applied to the exposure of the fifth frame 80, which is the next frame for exposure setting. div The ND area ratio ND of the fourth frame is calculated. R When the ratio becomes 84%, the remaining 16% of the non-ND area is converted to the ND area R ND Assuming that changes, the split exposure EX of the next frame (i.e., the 5th frame) div In the fourth frame, the split exposure EX of the next frame (i.e., the fifth frame) is calculated. div is the ND area ratio ND R is assumed to be 100% and the calculated split exposure EX div is set as the exposure for the next frame (i.e., the fifth frame).

[0116] Next, an example of the flow of exposure control processing according to the second embodiment will be described with reference to Figures 9A and 9B. However, since the flowcharts shown in Figures 9A and 9B include multiple steps that overlap with the flowchart shown in Figure 7 described in the first embodiment, hereinafter, the same steps as those in the flowcharts shown in Figures 9A and 9B that are the same as those in the flowchart shown in Figure 7 described in the first embodiment will be assigned the same step numbers, and their description will be omitted.

[0117] 9A and 9B differ from the flowchart shown in Fig. 7 in that steps ST100 to ST104 are provided between step ST26 and step ST28. In the flowcharts shown in Fig. 9A and 9B, if the determination in step ST14 is negative, the exposure control process proceeds to step ST16 shown in Fig. 9B, and the process of step ST16 and the process of step ST18 are executed in order by processor 64, similarly to the first embodiment.

[0118] In step ST100 shown in FIG. 9A, the processor 64 calculates the number of remaining frames N rf and ND area ratio ND R Obtain the ND area ratio ND R is the number of remaining frames N rf Calculated based on the ND area ratio ND R The calculation is based on the number of remaining frames N rf is the independent variable, and the ND area ratio ND R The exposure control process is performed using an arithmetic expression with the following dependent variable: After the process of step ST102 is executed, the exposure control process proceeds to step ST102.

[0119] In step ST102, the processor 64 calculates the number of remaining frames N rf and the current frame number and the ND area ratio ND R The coefficient α is calculated based on the above equation (2). After the process of step ST102 is executed, the exposure control process proceeds to step ST104.

[0120] In step ST104, processor 64 calculates the coefficient α and the target exposure EX target2 And now Exposure EX current Split exposure of next frame based on EX div Calculate the next frame's split exposure EX div is calculated using the above-mentioned formula (1). After the process of step ST104 is executed, the exposure control process proceeds to step ST28.

[0121] As described above, in the imaging device 10 according to the second embodiment, the target exposure EX is set for each of the exposures of the multiple frames 80 obtained by capturing live view images. target2 And now Exposure EX current and ND area ratio ND R and the remaining number of frames N rf Split exposure EX calculated based on div Therefore, the ND region ratio ND is applied to each exposure of the plurality of frames 80 obtained by capturing images for live view images.R and the remaining number of frames N rf Split exposure EX calculated without taking into account div is applied, the ND region ratio ND R and the remaining number of frames N rf Split Exposure EX div As a result, it is possible to more effectively suppress abrupt changes in brightness between a plurality of frames 80 obtained by capturing images for live view images.

[0122] [Third embodiment] In the first embodiment, the target exposure EX is adjusted from the exposure range that can be tracked by switching from one of the use state and the non-use state to the other. target2 Regardless of whether the split exposure EX is off or not, the split exposure EX is applied to the exposure of each of the multiple frames 80 obtained by capturing live view images. div is calculated, and the calculated split exposure EX div is applied as the exposure of the corresponding frame 80. In the third embodiment, however, the target exposure EX target2 An example in which different processing is executed depending on whether or not the lock is broken will be described.

[0123] In the third embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted. In the third embodiment, the differences from the first embodiment will be mainly described.

[0124] In this third embodiment, an example of exposure control processing according to this third embodiment will be described with reference to the flowcharts shown in Figures 10A and 10B. However, since the flowcharts shown in Figures 10A and 10B include multiple steps that overlap with the flowchart shown in Figure 7 described in the first embodiment, in the following, among the multiple steps included in the flowcharts shown in Figures 10A and 10B, the same steps as those in the flowchart shown in Figure 7 described in the first embodiment will be assigned the same step numbers, and descriptions thereof will be omitted.

[0125] 10A and 10B differ from the flowchart shown in Fig. 7 in that step ST200 is provided between step ST20 and step ST22, and in that steps ST202 to ST206 are provided. If the determination is negative in step ST14 shown in Fig. 10A, the exposure control process proceeds to step ST16 shown in Fig. 10B.

[0126] In step ST200 shown in FIG. 10A, processor 64 calculates the target exposure EX calculated in step ST20. target2 In step ST200, it is determined whether the target exposure EX calculated in step ST20 is within the exposure range that can be followed by switching from one of the use state and the non-use state to the other. target2 In step ST200, if the target exposure EX calculated in step ST20 is within the exposure range that can be followed by switching from one of the use state and the non-use state to the other, the determination is affirmative, and the exposure control process proceeds to step ST22. target2 However, if the exposure range falls outside the range that can be followed by switching from one of the use state and the non-use state to the other, the determination is negative, and the exposure control process proceeds to step ST202 shown in FIG. 10B.

[0127] In step ST202 shown in FIG. 10B, processor 64 calculates the target exposure EX target2For example, the processor 64 may display a target exposure EX on the display 28. target2 The target exposure EX is displayed by displaying visual information (e.g., text and / or an image) indicating that the target exposure EX is outside the exposure range that can be tracked by switching from one of the use state and the non-use state to the other. target2 The user is notified or informed that the exposure range that can be followed by switching from one of the use state and the non-use state to the other has fallen outside the exposure range that can be followed by switching from the use state to the non-use state. After the processing of step ST202 is executed, the exposure control processing proceeds to step ST204.

[0128] Although an example of displaying visual information on the display 28 has been given here, this is merely an example, and visual information may be displayed on the display of a device (e.g., a smart device) connected to the external I / F 50. target2 However, by switching from one of the use state and the non-use state to the other, information indicating that the exposure is out of the exposure range that can be followed may be output by voice from a speaker, or the target exposure EX target2 Information indicating that the exposure range is outside the range that can be tracked by switching from one of the use state and the non-use state to the other may be stored in storage 66 and / or a device connected to external I / F 50.

[0129] In step ST204, processor 64 determines whether or not a cancel instruction to cancel switching from one of the use state and the non-use state to the other has been given from outside (for example, a user). If a cancel instruction to cancel switching from one of the use state and the non-use state to the other has not been given from outside in step ST204, the determination is negative, and the exposure control process proceeds to step ST22 shown in Fig. 10A. If a cancel instruction to cancel switching from one of the use state and the non-use state to the other has been given from outside in step ST204, the determination is positive, and the exposure control process proceeds to step ST206.

[0130] In step ST206, the processor 64 selects the current exposure EX as the exposure for the next frame. current After setting the exposure for the next frame, the image capturing device 10 is made to capture an image. current Setting this means maintaining the exposure currently set for the image capture device 10. After the processing of step ST206 is executed, the exposure control processing ends.

[0131] As described above, in the third embodiment, the target exposure EX target2 is outside the exposure range that can be tracked by switching from one of the use state and non-use state to the other, the target exposure EX target2 The user is notified or informed that the target exposure EX is out of the exposure range that can be followed by switching from one of the use state and the non-use state to the other. target2 However, the user can be made aware that the exposure range is outside the range that can be followed by switching from one of the use state and the non-use state to the other.

[0132] In the third embodiment, the target exposure EX target2However, if the target exposure EX falls outside the exposure range that can be followed by switching from one of the use state and the non-use state to the other, control is performed to maintain the currently set exposure for the image capture device 10 on the condition that an instruction to stop switching from one of the use state and the non-use state to the other is given from outside. target2 However, when the exposure range falls outside the range that can be followed by switching from one of the use state and the non-use state to the other, it is possible to prevent the brightness of the frame 80 from becoming inappropriate against the user's will.

[0133] [Fourth embodiment] In the first embodiment, a plurality of split exposures EX are used for the exposure of a plurality of frames 80 obtained by capturing live view images. div Even if the brightness of the subject (i.e., the object) changes significantly while the exposures are being applied, the already calculated multiple split exposures EX div However, in the fourth embodiment, a plurality of divided exposures EX are used for a plurality of frames 80 obtained by performing live view image capturing. div An example will be described in which processing different from that in the first embodiment is executed when the amount of change in brightness of the imaging target increases or decreases significantly while the above-described steps are being applied sequentially.

[0134] In the fourth embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted. In the fourth embodiment, the differences from the first embodiment will be mainly described.

[0135] In the present fourth embodiment, an example of exposure control processing according to the present fourth embodiment will be described with reference to the flowcharts shown in Figures 11A to 11C. However, since the flowcharts shown in Figures 11A to 11C include multiple steps that overlap with the flowchart shown in Figure 7 described in the first embodiment, in the following, of the multiple steps included in the flowcharts shown in Figures 11A to 11C, the same steps as those in the flowchart shown in Figure 7 described in the first embodiment will be assigned the same step numbers, and descriptions thereof will be omitted.

[0136] The flowcharts shown in FIGS. 11A to 11C differ from the flowchart shown in FIG. 7 in that steps ST300 to ST314 are provided between step ST28 and step ST30.

[0137] 11A, the processor 64 acquires a frame 80 generated by capturing an image for a live view image. After the processing of step ST300 is performed, the exposure control processing proceeds to step ST302.

[0138] In step ST302, the processor 64 calculates the photometric value 90 based on the frame 80 acquired in step ST300. After the processing of step ST302 is executed, the exposure control processing proceeds to step ST304.

[0139] In step ST304, the processor 64 determines whether the change in brightness of the imaging target exceeds a reference change amount. The change in brightness of the imaging target refers to, for example, the change from the photometric value 90 calculated in step ST12 to the photometric value 90 calculated in step ST302. An example of the reference change amount is a value determined in advance by testing an actual device and / or computer simulation as the upper limit of the photometric change amount that does not cause visual discomfort to the user. Here, the reference change amount may be a value below the upper limit of the photometric change amount that does not cause visual discomfort to the user (for example, the average, median, or mode of the photometric change amount that does not cause visual discomfort to the user). The reference change amount may be a fixed value or a variable value that is changed according to instructions given by the user and / or various conditions (for example, the frame rate FR, the imaging mode, etc.).

[0140] In step ST304, if the amount of change in brightness of the imaging target does not exceed the reference change amount, the determination is negative, and the exposure control process proceeds to step ST30 shown in Fig. 11C. If the determination is positive in step ST30 shown in Fig. 11C, the exposure control process ends. If the determination is negative in step ST30 shown in Fig. 11C, the exposure control process proceeds to step ST32. After the process of step ST32 is executed, the exposure control process proceeds to step ST28 shown in Fig. 11A.

[0141] In step ST304, if the amount of change in brightness of the imaging target exceeds the reference amount of change, the determination is affirmative, and the exposure control process proceeds to step ST306 shown in FIG. 11B.

[0142] In step ST306, the processor 64 resets N to the initial value. After the processing of step ST306 is executed, the exposure control processing proceeds to step ST308.

[0143] In step ST308, the processor 64 calculates a new target exposure EX based on the latest photometric value 90. target2 By calculating the target exposure EXtarget2 After the process of step ST308 is executed, the exposure control process proceeds to step ST310.

[0144] In step ST310, processor 64 calculates the time from the present time until switching from one of the use state and the non-use state to the other is completed as a new switching time T. After the processing of step ST310 is executed, the exposure control processing proceeds to step ST312.

[0145] In step ST312, processor 64 updates the required number of frames A1 by calculating a new required number of frames A1 based on the new switching time T and frame rate FR. The updated required number of frames A1 is the number of frames corresponding to the remaining time from the current frame until switching from one of the use state and the non-use state to the other is completed (i.e., the number of frames obtained in the remaining time until switching from one of the use state and the non-use state to the other is completed). In the fourth embodiment, the updated required number of frames A1 is an example of the "second number of frames" and "third number of frames" according to the present disclosure. After the processing of step ST312 is executed, the exposure control processing proceeds to step ST314.

[0146] In step ST314, processor 64 calculates the new target exposure EX calculated in step ST308. target2 (i.e., updated target exposure EX target2 ) and the new number of required frames A1 calculated in step ST312, a plurality of split exposures EX div By recalculating multiple split exposures, div After the process of step ST314 is executed, the exposure control process proceeds to step ST28 shown in FIG.

[0147] As described above, in the imaging device 10 according to the fourth embodiment, a plurality of split exposures EX are generated for the exposure of a plurality of frames 80 obtained by capturing live view images. divIf the change in brightness of the subject exceeds the standard change amount while the exposure is being applied, the target exposure EX target2 is updated, and the updated target exposure EX target2 and the updated number of frames required A1, multiple split exposures EX div is updated. And after updating, multiple split exposure EX div are applied as the exposure of the corresponding frame 80. Therefore, a plurality of split exposure EVs are used for the exposure of the plurality of frames 80 obtained by capturing live view images. div Even if the amount of change in brightness of the object to be imaged exceeds the reference amount of change while the above are being applied in sequence, a sudden change in brightness between multiple frames 80 obtained by capturing images for live view images can be suppressed.

[0148] [Fifth embodiment] In the first embodiment, a plurality of divided exposures EX are taken for a plurality of frames 80 obtained by capturing live view images. div Target exposure EX target2 However, in the fifth embodiment, a plurality of split exposures EX are set for the exposure of a plurality of frames 80 obtained by capturing an image for a live view image. div 8. An example embodiment will be described in which the exposure of multiple frames 80 is changed while the exposure is applied sequentially.

[0149] In the fifth embodiment, the same components as those in the fourth embodiment are denoted by the same reference numerals, and the description thereof will be omitted. In the fifth embodiment, the differences from the fourth embodiment will be mainly described.

[0150] In the present fifth embodiment, an example of exposure control processing according to the present fifth embodiment will be described with reference to the flowchart shown in Fig. 12. However, since the flowchart shown in Fig. 12 includes multiple steps that overlap with the flowcharts shown in Fig. 11A to 11C described in the above fourth embodiment, in the following, of the multiple steps included in the flowchart shown in Fig. 12, the same steps as those in the flowcharts shown in Fig. 11A to 11C described in the above fourth embodiment will be assigned the same step numbers, and descriptions thereof will be omitted.

[0151] The flowchart shown in FIG. 12 differs from the flowcharts shown in FIGS. 11A to 11C in that it has step ST402 instead of step ST304.

[0152] In step ST402 shown in FIG. 12, processor 64 calculates the target exposure EX target2 11B。 In step ST402, if an exposure change instruction has not been given from the outside, the determination is negative, and the process proceeds to step ST30 shown in FIG. 11C. In step ST402, if an exposure change instruction has been given from the outside, the determination is positive, and the process proceeds to step ST306 shown in FIG. 11B, and the processes from step ST306 onwards shown in FIG. 11B are executed by the processor 64. In the fifth embodiment, the exposure change instruction is an example of a "change instruction" according to the present disclosure.

[0153] As described above, in the imaging device 10 according to the fifth embodiment, a plurality of split exposures EX are generated for the exposure of a plurality of frames 80 obtained by capturing live view images. div If an external exposure change command is given while the target exposure EX target2 is updated, and the updated target exposure EX target2 and the updated number of frames required A1, multiple split exposures EX div is updated. And after updating, multiple split exposure EX divare applied as the exposure of the corresponding frame 80. Therefore, a plurality of split exposure EVs are used for the exposure of the plurality of frames 80 obtained by capturing live view images. div Even if an exposure change instruction is given from outside while the exposure control is being applied in sequence, a sudden change in brightness between multiple frames 80 obtained by capturing images for live view images can be suppressed.

[0154] [Variations] In the above embodiments, the switching time T is exemplified, but the number of frames may be used as the switching time T. That is, the concept of the change time may include the number of frames.

[0155] In the above embodiments, monotonic changes have been exemplified, but monotonic changes refer to, for example, linear changes or exponential changes, etc. Furthermore, examples of monotonic changes include monotonic increases and decreases.

[0156] In each of the above embodiments, an example of exposure control processing when capturing images for live view images has been given, but the present disclosure is not limited to this, and the above-described exposure control processing can be applied when continuous image capturing is performed, such as when capturing images for recording moving images, when continuous image capturing is performed with a fixed image capturing interval, or when continuous image capturing is performed with a variable image capturing interval.

[0157] In the above embodiment, an example has been described in which the exposure control processing program PG is stored in the storage 66, but the present disclosure is not limited to this. For example, the exposure control processing program PG may be stored in a portable, computer-readable, non-transitory storage medium such as an SSD or a USB memory. The exposure control processing program PG stored in the non-transitory storage medium is installed in the system controller 12 of the imaging device 10. The processor 64 executes exposure control processing in accordance with the exposure control processing program PG.

[0158] Alternatively, the exposure control processing program PG may be stored in a storage device such as another computer or server device connected to the imaging device 10 via a network, and the exposure control processing program PG may be downloaded in response to a request from the imaging device 10 and installed in the system controller 12.

[0159] It is not necessary to store the entire exposure control processing program PG in a storage device such as another computer or server device connected to the imaging device 10, or in the storage 66; only a part of the exposure control processing program PG may be stored therein.

[0160] Furthermore, although the imaging device 10 shown in FIGS. 1 and 2 has a built-in system controller 12, the present disclosure is not limited to this. For example, the system controller 12 may be provided outside the imaging device 10.

[0161] In the above embodiment, the system controller 12 is exemplified, but the present disclosure is not limited to this, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the system controller 12. Furthermore, instead of the system controller 12, a combination of a hardware configuration and a software configuration may be used.

[0162] The hardware resources for executing the exposure control process described in the above embodiments can be various processors, as listed below. Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource for executing exposure control processes by executing software, i.e., a program. Examples of processors include dedicated electrical circuits, such as FPGAs, PLDs, or ASICs, which are processors with circuit configurations designed specifically for executing specific processes. Each processor has built-in or connected memory, and each processor uses the memory to execute the exposure control process.

[0163] The hardware resource that executes the exposure control process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the exposure control process may be a single processor.

[0164] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes exposure control processing. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute exposure control processing, on a single IC chip, as typified by SoCs. In this way, the exposure control processing is realized using one or more of the above-mentioned various processors as hardware resources.

[0165] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The above exposure control process is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the process.

[0166] The above-described description and illustrations are a detailed explanation of the parts related to the present disclosure and are merely an example of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or elements may be replaced with other parts from the above-described description and illustrations, as long as they do not deviate from the gist of the present disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the parts related to the present disclosure, the above-described description and illustrations omit explanations of common general technical knowledge that do not require particular explanation to enable the implementation of the present disclosure.

[0167] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[0168] The following additional notes are provided regarding the above-described embodiments.

[0169] (Appendix 1) a processor; The processor is When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; Control is performed to monotonically change the exposure of a plurality of frames obtained by capturing images by the imaging device at least within a switching time required for switching from one to the other, toward the target exposure. Control device.

[0170] (Appendix 2) A plurality of split exposures determined based on the first frame number, which is the number of frames corresponding to the switching time, and the target exposure are applied to the exposure of the plurality of frames. 10. The control device of claim 1.

[0171] (Appendix 3) The split exposure is determined based on the target exposure, the exposure currently set for the image capture device, the proportion of the range of the frame that the electronic neutral density filter affects, and the number of remaining frames corresponding to the time remaining until the switching is completed. 3. The control device according to claim 2.

[0172] (Appendix 4) The control device according to claim 2 or 3, wherein the split exposure is determined based on the target exposure, the exposure currently set for the imaging device, the proportion of the range of the frame that the electronic neutral density filter affects, and the number of remaining frames corresponding to the time remaining until the switching is completed.

[0173] (Appendix 5) the plurality of frames are obtained by capturing the images based on a predetermined frame rate; The control device according to any one of Supplementary Note 2 to Supplementary Note 4, wherein the first number of frames is determined based on the switching time and the default frame rate.

[0174] (Appendix 6) If a change in brightness of an object to be imaged exceeds a reference change amount while the plurality of split exposures are being applied in sequence to the exposure of the plurality of frames, The target exposure is updated. The control device according to any one of appendices 2 to 5, wherein the plurality of split exposures are updated based on a second number of frames, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure.

[0175] (Appendix 7) If a change instruction to change the target exposure is given from an external source while the split exposures are being applied in sequence to the exposures of the frames, The target exposure is updated. The control device according to any one of appendices 2 to 6, wherein the plurality of split exposures are updated based on a third number of frames, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure.

[0176] (Appendix 8) A control device according to any one of appendices 1 to 7, wherein, when the target exposure is outside an exposure range that can be tracked by the switching, a notification or alert is given that the target exposure is outside the exposure range.

[0177] (Appendix 9) The control device according to any one of Supplementary Note 1 to Supplementary Note 8, wherein, when the target exposure is outside an exposure range that can be tracked by the switching, the exposure currently set for the imaging device is maintained on the condition that an instruction to stop the switching is given from outside.

[0178] (Appendix 10) In the use state, the electronic neutral density filter is inserted into the optical path of the imaging device; 11. The control device according to any one of claims 1 to 10, wherein in the unused state, the electronic neutral density filter is removed from the optical path.

[0179] (Appendix 11) the imaging device includes a light-transmitting filter having an optical path length corresponding to an optical path length of the electronic neutral density filter; the electronic attenuation filter and the optical transmission filter are selectively inserted into and removed from the optical path; In the use state, the electronic neutral density filter is inserted into the optical path, and the optical transmission filter is removed from the optical path; 11. The control device according to claim 10, wherein in the unused state, the light-transmitting filter is inserted into the optical path and the electronic neutral density filter is removed from the optical path.

[0180] (Appendix 12) A control device according to any one of Supplementary Note 1 to Supplementary Note 11; an image sensor used for the image capture; Imaging device.

[0181] (Appendix 13) When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; and This control method includes performing control to monotonically change the exposure of multiple frames obtained by capturing images using the imaging device at least within the switching time required to switch from one to the other, toward the target exposure.

[0182] (Appendix 14) When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; and This is a program for causing a computer to execute processing that includes controlling the exposure of multiple frames obtained by capturing images using the imaging device within at least the switching time required to switch from one of the two to the other, to monotonically change the exposure toward the target exposure.

[0183] (Appendix 15) The ratio corresponds to the ratio of the area where the effective pixel area and the electronic neutral density filter overlap with respect to the effective pixel area of ​​the imaging device. 4. The control device according to claim 3.

[0184] (Appendix 16) The split exposure is calculated using formula (1) and formula (2). 5. The control device according to claim 3 or 4. (Split exposure)=(Coefficient)×{(Target exposure set for the image capture device)−(Current exposure set for the image capture device)}+(Current exposure set for the image capture device) (1) (Coefficient) = {1 - (Percentage of the range in which the electronic neutral density filter affects the frame} / (Number of frames obtained in the remaining time from the current frame until the switch from one of the active state and the inactive state to the other is completed) (2)

[0185] (Appendix 17) The use state is a state in which the electronic neutral density filter is used within the effective pixel area of ​​the imaging device. 12. The control device according to any one of claims 1 to 11. [Explanation of symbols]

[0186] 10. Imaging device 12 System Controller 16. Imaging device body 18 Interchangeable Lenses 18A Focus Ring 20 Image Sensor 22 Release button 24 Dial 26 Instruction keys 28 Display 30 Touch Panel 32 Touch Panel Display 36 Control device 37 First Actuator 38 Second Actuator 39 Third Actuator 40 Imaging lens 40A objective lens 40B variable magnification lens 40C aperture 40C1 opening 40C2 aperture blades 46 Image Memory 48 UI devices 50 External I / F 54 Photoelectric conversion element driver 55 ND filter driver 56 Motor Driver 58 Electronic ND Filter 60 Clear Glass 62 Shift mechanism 62A motor 64 processors 66 Storage 68 memory 70 Input / Output Interface 72 Photoelectric conversion element 72A Photosensitive surface 74 A / D converter 76 Reception Device 78 Hard key section 79 RAW images 80 frames 90 photometric values 92 Current transmittance 93 Target exposure calculation formula 94 Switching destination transparency 95 Target exposure calculation formula 96 split exposure calculation formula A1 Number of frames required EX current currently exposed EX div split exposure EX target1 ,EX target2 target exposure FR Frame Rate ND R ND area ratio N rf Remaining frames OA optical axis PG Program R ND ND area T change time α coefficient

Claims

1. a processor; The processor: When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; Control is performed to monotonically change the exposure of a plurality of frames obtained by capturing images by the imaging device at least within a switching time required for switching from one to the other, toward the target exposure. Control device.

2. A plurality of split exposures determined based on a first frame number, which is the number of frames corresponding to the switching time, and the target exposure are applied to the exposure of the plurality of frames. The control device according to claim 1 .

3. The plurality of split exposures vary monotonically in the order in which they are applied to the plurality of frame exposures. The control device according to claim 2 .

4. The split exposure is determined based on the target exposure, the exposure currently set for the image capture device, the proportion of the range of the frame that the electronic neutral density filter affects, and the number of remaining frames corresponding to the time remaining until the switching is completed. The control device according to claim 2 .

5. the plurality of frames are obtained by performing the imaging based on a default frame rate; The first number of frames is determined based on the switching time and the default frame rate. The control device according to claim 2 .

6. If a change in brightness of an object to be imaged exceeds a reference change amount while the plurality of split exposures are being applied in sequence to the exposure of the plurality of frames, the target exposure is updated; The divided exposures are updated based on a second number of frames, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure. The control device according to claim 2 .

7. When a change instruction to change the target exposure is given from the outside while the plurality of split exposures are being applied in sequence to the exposure of the plurality of frames, the target exposure is updated; The divided exposures are updated based on a third number of frames, which is the number of frames corresponding to the remaining time until the switching is completed, and the updated target exposure. The control device according to claim 2 .

8. When the target exposure is out of the exposure range that can be followed by the switching, a notification or an announcement is made that the target exposure is out of the exposure range. The control device according to claim 1 .

9. When the target exposure is out of the exposure range that can be followed by the switching, the exposure currently set for the imaging device is maintained on the condition that a stop instruction to stop the switching is given from outside. The control device according to claim 1 .

10. In the use state, the electronic neutral density filter is inserted into an optical path of the imaging device; In the unused state, the electronic neutral density filter is removed from the optical path. The control device according to claim 1 .

11. the imaging device includes a light-transmitting filter having an optical path length corresponding to an optical path length of the electronic neutral density filter; the electronic attenuation filter and the optical transmission filter are selectively inserted into and removed from the optical path; In the use state, the electronic neutral density filter is inserted into the optical path, and the optical transmission filter is removed from the optical path; In the unused state, the light-transmitting filter is inserted into the optical path, and the electronic neutral density filter is removed from the optical path. The control device according to claim 10.

12. The control device according to any one of claims 1 to 11; an image sensor used for the image capture; Imaging device.

13. When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; and and performing control to monotonically change the exposure of a plurality of frames obtained by capturing images by the imaging device within at least a switching time required for switching from one to the other, toward the target exposure. Control method.

14. When switching from one of a use state in which an electronic neutral density filter mounted on an imaging device is used and a non-use state in which the electronic neutral density filter is not used to the other, acquiring a target exposure of the imaging device after switching; and A program for causing a computer to execute a process including controlling the exposure of multiple frames obtained by capturing images using the imaging device within at least the switching time required to switch from one to the other, to monotonically change toward the target exposure.

Images