Camera device capable of performing luminous photography, control method thereof, and storage medium

Abstract

The present invention relates to an imaging device capable of performing luminous shooting, a control method thereof, and a storage medium. The imaging device can display a good live view image even during continuous luminous shooting. The imaging device includes an image sensor, a first imaging controller, and a second imaging controller, wherein the first imaging controller periodically obtains a display image using the image sensor, and the second imaging controller obtains a flash control image accompanied by pre-lighting of a first flash unit using the image sensor in addition to the first imaging controller. The second imaging controller performs pre-lighting of the first flash unit at a non-accumulation timing when the image sensor does not perform charge accumulation for periodically obtaining a display image by the first imaging controller.

Description

Technical Field

[0001] The present invention relates to an imaging device capable of performing light-emitting photography and a control method thereof. Background Art

[0002] Among the imaging devices, there is a known imaging device that is capable of performing so-called light emission photography, which captures images using an image sensor in the device body while controlling a light emitting member of a flash unit attached to the device body to emit light. Japanese Patent Laid-Open No. 2019-79024 (JP 2019-79024A, corresponding to U.S. Patent No. 10,602,051) discloses continuous photography (continuous photography). In such an imaging device, an image sensor can be used to periodically obtain a recorded image of light emission photography, and a display image can be periodically obtained as a live view image during photography.

[0003] By the way, when continuous light shooting is performed, the light from the light-emitting components of the flash unit may affect the displayed image, thereby causing the image quality to fluctuate. In particular, when the light-emitting components of the flash unit perform pre-lighting for flash control for each light shooting, the possibility that the pre-lighting light causes the image quality of the displayed image to fluctuate becomes higher. In view of this problem, Japanese Patent Laid-Open No. 2015-126386 (JP2015-126386A) discloses a technology for switching the driving mode of an image sensor when pre-lighting is performed in each shot in continuous light shooting. Then, in this disclosure, the cycle for obtaining the displayed image in the continuous light shooting is extended, and the pre-lighting of the light-emitting components of the flash unit is performed during the non-accumulation period in the long acquisition cycle. As a result, it becomes difficult for the pre-lighting light to cause the image quality of the displayed image to fluctuate.

[0004] However, when the cycle of obtaining a display image during shooting is extended by switching the drive mode of the image sensor, the update period of the live view image also becomes longer, which reduces the convenience of the live view image. It becomes difficult for the live view image in continuous light shooting to display the shooting state of the camera device in real time. In continuous light shooting, it becomes difficult to appropriately determine the shooting area, etc. based on the live view image in continuous light shooting.

[0005] In particular, when the light emitting components of the plurality of flash units emit light in each light shooting, at least one flash unit is to perform light pulse communication or wireless communication with the device body of the image pickup device. When the light emitting components of such flash units that communicate with the device body of the image pickup device perform pre-light emission, the acquisition cycle of the display image during shooting can be extended by taking the communication time into account. Summary of the invention

[0006] The present invention provides an image pickup apparatus capable of displaying a good live view image even during continuous light emission shooting.

[0007] Therefore, one aspect of the present invention provides an imaging device, comprising: an image sensor; a first imaging controller for periodically obtaining a display image using the image sensor; and a second imaging controller for obtaining a flash control image accompanied by pre-luminescence of a first flash unit using the image sensor in addition to the first imaging controller, wherein the second imaging controller performs pre-luminescence of the first flash unit when the image sensor does not perform non-cumulative timing for charge accumulation for periodically obtaining the display image by the first imaging controller.

[0008] According to the present invention, even during continuous light emission shooting by an image pickup apparatus, a good live view image is displayed.

[0009] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a block diagram schematically showing the structure of an image pickup apparatus according to an embodiment of the present invention.

[0011] Figure 2A and Figure 2B It is shown Figure 1 A timing diagram of an imaging operation for live view in an imaging device in FIG.

[0012] Figure 3 It is shown Figure 1 An explanatory diagram of a connection state between a device body and a flash unit in an image pickup device in FIG.

[0013] Figure 4 It is shown Figure 3 A timing diagram of the communication between the device body and the flash unit.

[0014] Figure 5 is an explanatory diagram showing a communication command sent from a device body to a flash unit.

[0015] Figure 6 It is shown in Figure 1 Flowchart of an imaging process performed in an imaging apparatus of the present invention when continuous flash photography accompanied by pre-light emission for flash control is performed.

[0016] Fig. 7A and Figure 7B It is shown Figure 6 The flowchart in the figure is a timing diagram of the sequence of the imaging process.

[0017] Figure 8 It is shown in Figure 1Flowchart of an imaging process executed in an imaging apparatus in a case where a plurality of flash units perform light pulse communication and conduct pre-emission for flash control for continuous flash photography.

[0018] Fig. 9 It is shown Figure 8 0 is a timing diagram of an imaging process in a period in which a plurality of flash units perform light pulse communication.

[0019] Fig.10 It is shown in Figure 1 A flowchart of an imaging process performed in an imaging apparatus in a case where a plurality of flash units perform wireless communication and an external flash unit performs pre-emission for flash control for continuous flash photography.

[0020] Fig.11A , Fig. 11B and Fig. 11C It is shown Fig.10 The flowchart in FIG. 1 is a timing chart of an image pickup process in a case where an external flash unit performs pre-emission for flash control for continuous flash photography.

[0021] Fig.12 It is shown in Figure 1 A flowchart of an imaging process performed in an imaging apparatus in the embodiment of the present invention when a plurality of flash units perform wireless communication and the plurality of flash units sequentially perform pre-emission for flash control for continuous flash photography.

[0022] Fig.13 It is shown Fig.12 The flowchart in FIG. 1 is a timing chart of an imaging process in a case where a plurality of flash units sequentially perform pre-emission for flash control for continuous flash photography. DETAILED DESCRIPTION

[0023] Hereinafter, some exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the structures described in the following embodiments are only examples, and the scope of the present invention is not limited to the structures described in the embodiments.

[0024] Figure 1 is a block diagram schematically showing an image pickup apparatus 1 according to an embodiment of the present invention. Figure 1 The image pickup apparatus 1 in the embodiment has an apparatus body 100, a lens unit 200 attached to the apparatus body 100, and a first flash unit 300 attached to the apparatus body 100. Figure 1 A second flash unit 400 is shown that can communicate with the first flash unit 300 through optical pulse communication or wireless communication.

[0025] The interchangeable lens unit 200 is attached to the device body 100. The lens unit 200 has a lens 201, a stop 202, a focus driver 203, a stop driver 204, a lens position detector 207, and a lens controller 205. The lens 201 includes a lens group such as a focus lens and a zoom lens, etc. The lens 201 receives light entering the device body 100 from a subject.

[0026] The focus driver 203 drives the focus lens to change its position. Thus, the lens 201 can focus on a subject far from the image pickup apparatus 1. The diaphragm 202 adjusts the amount of light passing therethrough according to the size of the opening. The diaphragm driver 204 drives the diaphragm 202 to control its opening.

[0027] The lens position detector 207 obtains the zoom position (focal length information) of the lens 201 and information about the distance to the focal plane based on the position information about the lens 201. The lens controller 205 communicates with the controller 105 of the device body 100 through the connectors 206 and 118 for the lens, and controls the various parts included in the lens unit 200. The lens controller 205 controls the position of the focus lens through the focus driver 203, adjusts the opening of the diaphragm 202 through the diaphragm driver 204, and adjusts the amount of light during shooting.

[0028] The device body 100 has an image sensor 103, a main mirror 101 arranged in an optical path toward the image sensor 103, and a shutter 102 as optical components. The image sensor 103 is, for example, a CMOS sensor or a CCD sensor. The main mirror 101 is arranged obliquely with respect to the optical path to split a portion of a light beam traveling from the lens unit 200 toward the image sensor 103 to a viewfinder (not shown).

[0029] Light from the subject split by the main mirror 101 is guided to the viewfinder through the focusing screen 109, the penta prism 110, and the eyepiece lens 111. The focusing screen 109 is arranged at the main imaging surface of the lens unit 200. A Fresnel lens (condenser lens) is provided in the incident surface of the focusing screen 109. An optical image of the subject (viewfinder image) is formed in the exit surface of the focusing screen 109.

[0030] The penta prism 110 reflects light entering the viewfinder optical path multiple times to convert the subject image formed in the exit surface of the focusing screen 109 into an upright erect image. The eyepiece lens 111 is configured so that when the user looks at the viewfinder, the diopter can be adjusted according to the user's eyesight. In addition, the main mirror 101 rotates according to the operating state of the imaging device 1. When the user observes the subject through the viewfinder, the main mirror 101 is arranged obliquely with respect to the optical path toward the image sensor 103. At the time of shooting, the main mirror 101 is retracted from the optical path toward the image sensor 103. Thereby, the light beam from the lens unit 200 is guided to the image sensor 103.

[0031] It should be noted that the image pickup apparatus 1 may adopt a so-called mirrorless structure without the main mirror 101 or a lens-integrated structure in which the lens unit 200 is not replaceable. Figure 1 The structures shown are different, but detailed description is omitted because these structures can be implemented by adopting well-known structures.

[0032] The shutter 102 is provided between the main mirror 101 and the image sensor 103. A light beam from the lens unit 200 enters the image sensor 103 during a period in which the shutter 102, which is normally closed, is opened.

[0033] The device body 100 has an image capture control system, which includes an analog signal processor 104, a timing generator 116, a shutter controller 115, a timer 131, an image display unit 119, a memory controller 120, an operation unit 122, and a controller 105 to which they are connected. In addition, a photometric sensor 112, an AF sensor 117, a flash connector 114, and a lens connector 118 are connected to the controller 105. The controller 105 is a microcomputer having, for example, a CPU, a ROM, and a RAM. The microcomputer reads and runs a program recorded in the ROM. Thus, the microcomputer implements the controller 105 that controls the operation of each part of the image capture device 1.

[0034] Specifically, the controller 105 of the image pickup apparatus 1 implements functions such as a photometric processor 113, a digital gain unit 106, an image processor 107, and a focus detection processor 123. The photometric sensor 112 has a plurality of photodiodes corresponding to a plurality of regions that divide the image pickup region. The photometric sensor 112 detects the brightness of the subject image formed on the exit surface of the focusing screen 109 using the photodiodes, and outputs it to the photometric processor 113 of the controller 105. The photometric processor 113 performs photometric processing based on the detection output of the photometric sensor 112 to satisfactorily capture the subject image.

[0035] The AF sensor 117 outputs the defocus amount to the focus detection processor 123 of the controller 105. The focus detection processor 123 determines the driving amount of the lens 201 to focus the lens 201 on the subject based on the defocus amount from the AF sensor 117, and drives the lens unit 200 through the connector 118. The controller 105 controls the timing generator 116 and the shutter controller 115.

[0036] The timing generator 116 outputs imaging timing to the image sensor 103. In addition to imaging timing for recording, imaging timing of the image sensor 103 includes imaging timing for obtaining a live view image, imaging timing for obtaining an image for flash control, etc. The shutter controller 115 drives the shutter 102 to open and close.

[0037] The image sensor 103 is driven according to the timing signal output from the timing generator 116, and accumulates the charge generated by receiving the light from the subject using the plurality of photoelectric conversion elements during the period in which the shutter 102 is open. Then, the image sensor 103 outputs an analog signal regarding the captured subject image given by the light amount distribution corresponding to the charge accumulated in the photoelectric conversion element.

[0038] The analog signal processor 104 samples and holds the analog signal output from the image sensor 103, adds an analog gain, and converts it into a digital signal by A / D conversion. The analog signal processor 104 outputs a digital signal about the captured subject image to the controller 105. In the controller 105, a digital gain unit 106 adds a digital gain to the digital signal.

[0039] The image processor 107 performs digital signal processing such as pixel interpolation processing and color conversion processing. The image processor 107 records the data of the captured subject image that has been subjected to the digital signal processing into the memory 121 through the memory controller 120. The image display unit 119 is an LCD monitor provided in the back of the device body 100 of the image pickup device 1. The image display unit 119 displays a live view image periodically captured by the image sensor 103.

[0040] The first flash unit 300 is detachably attached to the device body 100. The first flash unit 300 has a flash controller 301. A first light emitting member 302, a flash connector 303, a flash operation unit 304, a light receiving element 305, and a wireless communication unit 306 are connected to the flash controller 301. The first light emitting member 302 emits light under the control of the flash controller 301. The first light emitting member 302 illuminates a subject with flash light, and emits light pulses for light pulse communication with other flash units such as the second flash unit 400.

[0041] The second flash unit 400 is configured similarly to the first flash unit 300. The second flash unit 400 has a second light emitting member 401. When the first flash unit performs light pulse communication with other flash units, the light receiving element 305 receives light pulses from the other flash units.

[0042] The wireless communication unit 306 performs wireless communication with other flash units. The flash operation unit 304 is an input unit that receives an operation from a user. The flash operation unit 304 has various operation buttons, such as a setting change button for a light emission mode. The flash controller 301 controls the first light emitting member 302 to emit light based on the user's operation and a signal from the device body 100 through the flash connector 303. The flash controller 301 performs data communication with other flash units by using light pulse communication of the first light emitting member 302 and the light receiving element 305 or wireless communication using the wireless communication unit 306.

[0043] In the device body 100, a timer 131 measures time and time periods. The operation unit 122 has a touch panel, a switch, and a button operated by a user. When an image capturing operation is performed on the operation unit 122, the controller 105 controls the operation of each part of the image capturing device 1. For example, the controller 105 sets a periodic image capturing timing to the timing generator 116 and the shutter controller 115 to control the image sensor 103 so that a live view image is captured periodically.

[0044] The controller 105 sets a single imaging timing or a continuous imaging timing to the timing generator 116 and the shutter controller 115 to control the image sensor 103 so that flash photography (pre-emission) for flash control is performed. The controller 105 calculates the light amount of the main emission based on the result of the pre-emission, etc. For example, the controller 105 can capture an image using the image sensor 103 in a state where the first light emitting member 302 of the first flash unit 300 emits light.

[0045] The controller 105 sets a single imaging timing or continuous imaging timing to the timing generator 116 and the shutter controller 115 to control the image sensor 103 so that an image of a subject for recording is captured. The controller 105 records the captured subject image into the memory 121 .

[0046] Figure 2A and Figure 2B It is shown Figure 1 A timing diagram of an imaging operation for live view in an imaging device in FIG. Figure 2A1 is a timing diagram showing the imaging operation of the image sensor 103 in the case of periodically capturing a live view image and performing continuous non-light-emitting shooting for recording. Time flows from left to right. The image sensor 103 repeatedly captures the live view image at a cycle of 60fps after starting to perform the first shooting for recording. Thereafter, the image sensor 103 repeatedly captures the live view image at a cycle of 60fps after performing the second shooting for recording. Although the image sensor 103 can perform the imaging operation at a cycle of 120fps at maximum, the live view image is captured at a specific cycle of 60fps throughout the entire period.

[0047] exist Figure 2A , “ACCUM” shows an accumulation period of charge of the image sensor 103. Furthermore, “SI” shows a period for reading the charge accumulated in the image sensor 103 to generate a recorded image (still image), and “LV” shows a period for reading the charge accumulated in the image sensor 103 to generate a live view image.

[0048] Figure 2B 1 is a timing diagram showing the imaging operation of the image sensor 103 in the case of periodically capturing a live view image and performing continuous light shooting for recording. Hereinafter, light shooting is also referred to as flash shooting. Time flows from left to right. After the first flash shooting for recording is started, the image sensor 103 attempts to repeatedly capture a live view image at a cycle of 60 fps.

[0049] However, actually, after the first live view image is captured, the drive mode of the image sensor 103 is switched to continuous flash photography, and flash photography (pre-emission) for flash control corresponding to the flash photography (main emission) is performed. Figure 2B In the pre-light emission of the image sensor 103, charge accumulation in the non-light emission state (NE-ACCUM) and charge accumulation in the pre-light emission state (PE-ACCUM) are performed. In this case, the controller 105 that controls the image sensor 103 performs a photometric calculation process (NE-CALC) based on NE-ACCUM, a photometric calculation process (PE-CALC) based on PE-ACCUM, and a flash control calculation process (ETTL-CALC) after NE-ACCUM and PE-ACCUM for pre-light emission.

[0050] In addition, the controller 105 sets the light emission amount obtained by the calculation for flash control, etc. to the first flash unit 300 or the second flash unit 400 through EF communication. After that, the image sensor 103 captures an image using the main light emission without resuming the repeated capture of the live view image. Then, the image sensor 103 captures a live view image after the capture using the pre-light emission and the capture using the main light emission.

[0051] In this case, a live view image is captured at a cycle longer than 60 fps. In addition, a live view image is not captured during a period after the drive mode of the image sensor 103 is switched until the pre-light emission and the main light emission are finished. Since the live view image is not updated in real time at a short cycle of 60 fps, it is difficult for the user to easily check the current imaging area, etc. based on the live view image.

[0052] Furthermore, if a live view image should be captured during the period between the switching of the drive mode of the image sensor 103 and the end of the pre-light emission and the main light emission, the light of the pre-light emission may cause the image quality of the live view image to fluctuate. When the image quality of the live view image varies, it becomes difficult for the user to check the current photographing area, etc. using the live view image. In this way, the imaging apparatus 1 is used to improve the live view image in continuous flash photography. Figure 2A and Figure 2B The time periods shown in the processing of are examples, and the invention is not limited to these examples.

[0053] Figure 3 It is shown Figure 1 1 is an explanatory diagram of the connection state between the device body 100 and the first flash unit 300 in the camera device 1. The device body 100 and the first flash unit 300 of the camera device 1 are connected via the flash connector 114 and the flash connector 303. The flash connector 114 of the device body 100 has a Cin terminal, a Cout terminal, and a Cclk terminal. The flash connector 303 of the first flash unit 300 has a Sout terminal, a Sin terminal, and a Sclk terminal. The Cin terminal is connected to the Sout terminal. The Cout terminal is connected to the Sin terminal. The Cclk terminal is connected to the Sclk terminal.

[0054] The device body 100 and the first flash unit 300 communicate using a clock synchronization signal. The device body 100 outputs a data modulation signal from the Cout terminal, and the first flash unit 300 outputs a data modulation signal from the Sout terminal. The device body 100 samples the data modulation signal input to the Cin terminal in synchronization with the clock synchronization signal, and demodulates the output data from the first flash unit 300. The first flash unit 300 samples the data modulation signal input to the Sin terminal in synchronization with the clock synchronization signal, and demodulates the output data from the device body 100.

[0055] Figure 4 It is shown Figure 3 1 and 2. A timing diagram of communication between the device body 100 and the flash unit in FIG. Figure 4 The upper diagram in shows a signal waveform of a data modulated signal outputted from the Cout terminal by the device body 100. Figure 4The middle diagram in shows a signal waveform of a data modulation signal output from the flash unit and input to the Cin terminal. Figure 4 The figure below shows the waveform of the clock synchronization signal output from the Cclk terminal.

[0056] The device body 100 samples the signal input to the Cin terminal at the rising timing of the clock synchronization signal and obtains one byte of data. In this example, the first flash unit 300 outputs the data "32HEX" to the device body 100. The flash unit samples the signal output from the Cout terminal at the rising timing of the clock synchronization signal and obtains one byte of data. In addition, after obtaining the data, the device body 100 can stop outputting the clock synchronization signal to the Cclk terminal to enter a busy state. Thus, the device body 100 and the flash unit can perform processing based on the obtained data. When a predetermined process has been performed in the busy state where the Cclk terminal remains at a low level, the device body 100 can switch the Cclk terminal to a high level.

[0057] Figure 5 FIG. 1 is an explanatory diagram showing a communication command sent from the device body 100 to the flash unit. The device body 100 may Figure 5 , the plurality of communication commands shown in are sent to the first flash unit 300. The amount of data that the first flash unit 300 outputs to the device body 100 in response to the communication command is predetermined for each command. Next, when the device body 100 outputs the communication command 10H to the first flash unit 300, the first flash unit 300 recognizes it as a "light emission pattern information request" communication. The first flash unit 300 outputs the light emission pattern information to the device body 100 through the second byte of data communication.

[0058] In addition, when the device body 100 outputs the communication command 12H to the first flash unit 300, the first flash unit 300 recognizes it as a "lighting mode setting" communication for changing the light-emitting mode. In addition, the device body 100 outputs information about the desired light-emitting mode to the first flash unit 300 through the second byte of data communication. The first flash unit 300 sets and changes the light-emitting mode.

[0059] Figure 6 It is shown in Figure 1 Flowchart of an imaging process performed in the imaging apparatus 1 in the case of performing continuous flash photography accompanied by pre-emission for flash control. When performing continuous flash photography accompanied by pre-emission for flash control, the controller 105 of the imaging apparatus 1 may perform Figure 6 in control.

[0060] In step S101, the controller 105 determines whether continuous shooting accompanied by flash control (meaning continuous flash shooting accompanied by pre-light emission for flash control) is started. When continuous shooting accompanied by flash control is started, the user gives a start operation to the operation unit 122. When the start operation of continuous shooting accompanied by flash control is not given to the operation unit 122, the controller 105 repeats the process. When the start operation of continuous shooting accompanied by flash control is given to the operation unit 122, the controller 105 advances the process to step S102.

[0061] In step S102, when it is the imaging timing of the main light emission for recording, the controller 105 requests the first flash unit 300 for the main light emission and performs flash photography. The controller 105 controls the accumulation and reading of the image sensor 103. The image sensor 103 receives the light including the light emission component of the first flash unit 300 and accumulates the corresponding charge to generate a captured image for recording. The controller 105 stores the captured image read and obtained from the image sensor 103 in the memory 121 for recording.

[0062] In step S103, when it is the imaging timing of the live view image, the controller 105 captures the live view image during the continuous imaging accompanied by the flash control (inter-frame LV imaging). The controller 105 controls the accumulation and reading of the image sensor 103. The controller 105 outputs the captured image read and obtained from the image sensor 103 to the image display unit 119. The user can check the imaging area that can be captured by the imaging apparatus 1 in real time.

[0063] Then, the controller 105 can repeat the recording process of the flash photographed image and the display process of the live view image by repeating the loop process including steps S102 and S103. In continuous flash photography, the live view image can continue to be updated at a good cycle and frequency.

[0064] In step S104, the controller 105 determines whether the continuous shooting accompanied by flash control continues. When the continuous shooting accompanied by flash control ends, the user gives a termination operation to the operation unit 122. When the termination operation of the continuous shooting accompanied by flash control is not given to the operation unit 122, the controller 105 determines that the continuous shooting accompanied by flash control continues, and the processing proceeds to step S105. When the termination operation of the continuous shooting accompanied by flash control is given to the operation unit 122, the controller 105 ends the processing.

[0065] In step S105, the controller 105 determines whether the non-accumulation (blanking) period in the inter-frame live view shooting until the next live view shooting is equal to or greater than a predetermined value. In this case, the controller 105 can calculate the non-accumulation period by subtracting the accumulation period and the reading period from the frame rate in the live view shooting started in step S103. For example, when the accumulation period is 8.3 ms (milliseconds) and the reading period is 3.5 ms in the live view shooting of the slit rolling method with a frame rate of 60 fps (a cycle of 16.6 ms), the non-accumulation period becomes 4.8 ms (=16.6-(8.3+3.5)).

[0066] In addition, for example, a predetermined value for determining the blanking period may be set based on a pre-emission period for flash control required to perform pre-emission for flash control of the first flash unit 300. Then, when the non-accumulation (blanking) period is equal to or greater than the predetermined value, the controller 105 advances the process to step S107. When the non-accumulation (blanking) period is less than the predetermined value, the controller 105 advances the process to step S108.

[0067] In step S107, the controller 105 requests pre-emission for flash control to the first flash unit 300 to perform pre-emission during the non-accumulation (blanking) period. Thereafter, the controller 105 advances the process to step S110.

[0068] When the non-accumulation (blanking) period is less than a predetermined value, the controller 105 temporarily stops the display update of the inter-frame live view image in step S108 (step S103). The controller 105 may temporarily stop the display update of the inter-frame live view image until the next flash shooting using the main light is completed or until a period equal to a predetermined value for determining the blanking period has passed. After the temporary stop period has passed, the controller 105 resumes the display update of the inter-frame live view image in step S103.

[0069] In step S109, the controller 105 requests pre-emission for flash control from the first flash unit 300 to perform pre-emission during the temporary stop period in which the display update of the inter-frame live view image is temporarily stopped. In step S110, the controller 105 performs flash photography as pre-emission for flash control of the first flash unit 300. The controller 105 controls accumulation and reading of the image sensor 103. The image sensor 103 receives light including the emission component of the pre-emission and accumulates corresponding charges.

[0070] The controller 105 reads and obtains the captured image from the image sensor 103. Fig. 7AThe sequence of photographing in the case where the processing in step S107 is performed is shown in FIG. Figure 7B ] A sequence of photographing in the case where the processing in steps S108 and S109 is performed is shown in FIG.

[0071] In step S111, the controller 105 calculates the emission amount of the main emission of the first flash unit 300 based on the captured image at the time of pre-emission obtained in step S110. The controller 105 can calculate the emission amount of the main emission using the technology of the flash control calculation described in the above-mentioned JP2015-126386A. Thus, the controller 105 as a flash control calculation unit can calculate the emission amount of the main emission of the first flash unit 300 at the time of continuous flash photography based on the flash control image. After that, the controller 105 returns the process to step S102.

[0072] Fig. 7A and Figure 7B It is shown Figure 6 The flowchart in the figure is a timing diagram of the sequence of the imaging process. Fig. 7A Shown in execution Figure 6 The sequence of the image pickup process in the case of the process in step S107. Fig. 7A In the sequence of the image capture processing in , the image sensor 103 repeats flash photography accompanied by main light emission of the first flash unit 300 at a predetermined cycle. In addition, the image sensor 103 repeatedly captures live view images without omission at a cycle of 60 fps suitable for updating of the live view images.

[0073] Then, the image sensor 103 performs shooting (pre-emission accumulation) accompanied by pre-emission for flash control with respect to the first flash unit 300 during a non-accumulation (blanking) period between the imaging timings of two consecutive live view images. On the other hand, the controller 105 performs flash control calculation and processing for setting the calculated emission amount of main emission to the first flash unit 300 at the same timing at which the image sensor 103 captures the next live view image (imaging preparation).

[0074] Figure 7B Shown in execution Figure 6 The sequence of the image pickup process in the case of the processes in steps S108 and S109 in FIG. Figure 7B The case where the accumulation period for capturing live view images becomes longer is shown. In this case, if the capturing of live view images should be attempted at a cycle of 60 fps, the non-accumulation (blanking) period between the imaging timings of two consecutive live view images becomes smaller than a predetermined value. Figure 7BIn the sequence of the imaging process in step S108, the image sensor 103 repeats flash photography accompanied by main light emission of the first flash unit 300 at a predetermined cycle. In addition, the image sensor 103 attempts to capture a live view image at a cycle of 60 fps. However, in the process of step S108, the capturing of the live view image in the second shooting period is temporarily stopped. And the live view image at that point in time is missing.

[0075] Then, during the period in which the capturing of the live view image is stopped, the image sensor 103 performs capturing (pre-flash accumulation) accompanied by pre-flash for flash control with respect to the first flash unit 300. On the other hand, the controller 105 performs flash control calculation and processing for setting the calculated light emission amount of main flash to the first flash unit 300 at the same timing at which the image sensor 103 captures the next live view image (imaging preparation).

[0076] As described above, since the controller 105 performs pre-light emission for flash control during the period in which the live view image is not accumulated in the flash control continuous shooting, the live view image can be displayed with an update cycle equal to the update cycle of the non-light emission continuous shooting. In addition, when the accumulation period of the live view image becomes longer and the pre-light emission affects the live view image, the controller 105 stops the update of the live view image, performs pre-light emission for flash control, and can display the live view image with stable brightness.

[0077] Then, the controller 105 may control the first flash unit 300 to perform pre-light emission at a timing when charge accumulation for periodically obtaining a live view image is not performed. When the non-accumulation period between periodic charge accumulations for a live view image of the image sensor 103 is equal to or greater than the accumulation period of charge for a flash control image of the image sensor 103, the controller 105 controls the first flash unit 300 to perform pre-light emission at a timing in the non-accumulation period.

[0078] In addition, when the non-accumulation period between the periodic charge accumulation for the live view image of the image sensor 103 is less than the accumulation period of the charge for the flash control image of the image sensor 103, the controller 105 stops the periodic acquisition of the live view image in a thinning manner. Then, the controller 105 controls the first flash unit 300 to perform pre-emission at the non-accumulation timing generated by thinning. In this way, the controller 105 can perform continuous flash shooting while minimizing the period for stopping display updating.

[0079] In the present embodiment, in the imaging apparatus 1 capable of performing continuous flash photography by the image sensor 103 in a state where the first light emitting member 302 is controlled to emit light, the first imaging controller periodically obtains a live view image using the image sensor 103. Thus, the live view image used for determining the imaging area of ​​the imaging apparatus 1 can be periodically updated by using the periodically obtained live view image.

[0080] In the present embodiment, in particular, as a process of the second imaging controller in addition to the first imaging controller that obtains the live view image, the controller 105 obtains a flash control image for continuous flash photography accompanied by pre-emission of the first light emitting member 302 using the image sensor 103. The controller 105 gives priority to periodic acquisition of the live view image by the first imaging controller, and controls the first light emitting member 302 to perform pre-emission at a timing when the image sensor 103 does not perform charge accumulation for periodic acquisition of the live view image.

[0081] Specifically, when the non-accumulation period between periodic charge accumulations of the image sensor 103 for the live view image is equal to or greater than the charge accumulation period of the image sensor 103 for the flash control image, the controller 105 controls the first light emitting member 302 to perform pre-emission during the non-accumulation period.

[0082] On the other hand, when the non-accumulation period between periodic charge accumulations for live view images of the image sensor 103 is smaller than the accumulation period of charges for flash control images of the image sensor 103 , the controller 105 stops periodic acquisition of live view images in a thinning manner.

[0083] Then, the controller 105 controls the first flash unit 300 to perform pre-light emission at a non-cumulative timing generated by omitting the periodic acquisition of the live view image. Thus, the controller 105 can serve as a first camera controller that periodically updates the live view image and update the live view image at a specific period without being affected by the acquisition of the flash control image. In this embodiment, even when the flash control image is obtained, the update period of the live view image is almost not lengthened. And the acquisition of the flash control image can reduce the continuous loss of the live view image.

[0084] As a result, in this embodiment, the imaging device 1 can update the live view image in a short cycle suitable for live view to reduce omissions, which enables the user to appropriately determine the imaging area based on the live view image. In addition, even if the first light emitting member 302 performs pre-lighting, a live view image of a certain image quality that is not affected by the pre-lighting can be obtained.

[0085] Next, an example of performing continuous flash photography accompanied with light pulse communication among a plurality of flash units and pre-light emission for flash control will be described. Figure 8 It is shown in Figure 1 Flowchart of an image pickup process executed in the image pickup apparatus 1 in FIG. 1 , in which a plurality of flash units perform light pulse communication and pre-emission for flash control for continuous flash photography. Figure 1 The first flash unit 300 and the second flash unit 400 in FIG. 4 have light emitting members 302 and 401 and a light receiving member 305 to perform optical pulse communication, for example. Figure 1 Only the light receiving element 305 of the first flash unit 300 is shown, and the light receiving element of the second flash unit 400 is omitted.

[0086] When a plurality of flash units perform light pulse communication and perform continuous flash photography accompanied by pre-emission for flash control, the controller 105 of the imaging apparatus 1 may execute Figure 8 Steps S101 to S111 are the same as Figure 6 The steps in are the same as those in , and description of these steps is omitted. When the processing in step S104 is executed, the controller 105 advances the processing to step S201.

[0087] In step S201, the controller 105 determines whether to execute multi-lamp lighting in which main lighting of a plurality of flash units is performed by optical communication control. For example, when the light amount of the main lighting of only the first flash unit 300 is insufficient, the controller 105 determines to execute multi-lamp lighting in which the first flash unit 300 and the second flash unit 400 perform main lighting, and the processing proceeds to step S202. When it is determined not to execute multi-lamp lighting controlled by optical communication, the controller 105 Figure 6 The process advances to step S105 as in the process in order to execute shooting for recording accompanied by main emission of only the first flash unit 300.

[0088] In step S202, the controller 105 temporarily stops the display update of the inter-frame live view image performed in step S102 for the light pulse communication. The controller 105 temporarily stops the display update of the inter-frame live view image until the execution of the light pulse communication between the first flash unit 300 and the second flash unit 400 ends. When the inter-flashlight communication using the light pulse is performed, the light pulse may affect the image quality of the live view image. In this embodiment, since the display update of the inter-frame live view image is temporarily stopped, the light pulse does not affect the displayed live view image.

[0089] After the temporary stop period has elapsed, the controller 105 resumes display update of the inter-frame live view image in step S103. In step S203, the controller 105 performs light pulse communication between the first flash unit 300 and the second flash unit 400 while temporarily stopping display update of the inter-frame live view image.

[0090] In the optical pulse communication, the controller 105 controls the first light emitting member 302 to emit optical pulses at a predetermined cycle and with a predetermined light amount, so as to set the light emission timing and light emission amount for shooting to the second flash unit 400. Since the optical pulse communication is a known technology, its detailed description is omitted. Thus, the controller 105 as an optical pulse communication unit can perform optical pulse communication with the second flash unit 400 by controlling the first flash unit 300 to emit optical pulses, so as to perform flash light emission of multiple flash units in continuous flash shooting.

[0091] The controller 105 stops the periodic acquisition of live view images by the first imaging controller in a thinning shooting manner, and performs optical pulse communication at non-accumulation timing generated by thinning the periodic acquisition of live view images. Thereafter, the controller 105 advances the process to step S105.

[0092] When the preparatory processing of the multi-light emission from step S201 to step S203 is performed in this manner, the controller 105 performs flash photography while controlling the first flash unit 300 and the second flash unit 400 to perform pre-emission for flash control. In addition, the controller 105 calculates the main emission amount of the main emission of the first flash unit 300 and the second flash unit 400 in step S111 based on the captured image using the pre-emission obtained in step S110.

[0093] Fig. 9 It is shown Figure 8 0 is a timing diagram of an imaging process in a period in which a plurality of flash units perform light pulse communication. Fig. 9 Shown in execution Figure 8 The sequence of the imaging process in the case of the processes in steps S202 and S203.

[0094] exist Fig. 9In the sequence of the image capture processing in step S202, the image sensor 103 repeats the flash photography accompanied by the main light emission of the first flash unit 300 and the second flash unit 400 at a predetermined cycle. In addition, the image sensor 103 attempts to repeat the photography of the live view image at a cycle of 60fps suitable for the update of the live view image. However, the photography from the second live view image onwards is temporarily stopped by the processing in step S202, and the second live view image and the live view images thereafter are missing. Then, the controller 105 performs light pulse communication between the first flash unit 300 and the second flash unit 400 in the period in which the photography of the live view image is stopped.

[0095] In the present embodiment, the controller 105 as the light pulse communication unit can perform light pulse communication with the second flash unit 400 by controlling the first flash unit 300 to emit light pulses, so as to perform flash light emission of multiple flash units in continuous flash shooting. In addition, when performing light pulse communication, the controller 105 stops the periodic acquisition of the live view image using the first camera controller in a thinning manner. Then, the controller 105 performs light pulse communication at a non-accumulative timing generated by thinning the periodic acquisition of the live view image.

[0096] Therefore, in this embodiment, the imaging device 1 can update the live view image at a cycle suitable for live view while reducing the loss. In addition, since the live view image is not affected by the light pulse used for light pulse communication between the flash units, a certain stable image quality can be obtained. The user can appropriately determine the imaging area based on the live view image with stable image quality.

[0097] Next, an example of performing continuous flash photography accompanied with wireless communication between a plurality of flash units and pre-light emission for flash control will be described. Fig.10 It is shown in Figure 1 Flowchart of an image pickup process executed in the image pickup apparatus 1 in the embodiment of the present invention when a plurality of flash units perform wireless communication and an external flash unit performs pre-light emission for flash control for continuous flash photography. Figure 1 The first flash unit 300 and the second flash unit 400 in each of the embodiment have a wireless communication unit to perform wireless communication. Figure 1 Only the wireless communication unit 306 of the first flash unit 300 is shown, and the wireless communication unit of the second flash unit 400 is omitted.

[0098] When a plurality of flash units perform wireless communication and perform continuous flash photography accompanied by pre-emission for flash control, the controller 105 of the imaging apparatus 1 executes Fig.10 Steps S102 to S111 are the same as Figure 6 The steps in are the same as in , and their description is omitted.

[0099] In step S301, the controller 105 determines whether to start continuous shooting accompanied by flash control through wireless communication with multiple flash units. When starting continuous shooting accompanied by flash control through wireless communication with the flash units, the user gives a start operation to the operation unit 122. When a predetermined start operation is not given to the operation unit 122, the controller 105 repeats the process. When a predetermined start operation is given to the operation unit 122, the controller 105 advances the process to step S102. Thereafter, the controller 105 performs the process from step S102 to step S104. When it is determined in step S104 that a termination operation is not given to the operation unit 122, the controller 105 advances the process to step S302.

[0100] In step S302, the controller 105 determines whether, when controlling the first flash unit 300 and the second flash unit 400 to perform pre-light emission at the shortest light emission time, at least one of the pre-light emission will overlap with the charge accumulation for the live view image of the image sensor 103. Thus, the controller 105 as the second imaging controller can determine whether the pre-light emission at the shortest light emission time of at least one of the first light emitting member 302 and the second light emitting member 401 will overlap with the charge accumulation for the live view image of the image sensor 103.

[0101] When any pre-emission will not overlap with the charge accumulation for the live view image of the image sensor 103, the controller 105 advances the process to step S107. In this case, the controller 105 requests the first flash unit 300 for pre-emission for flash control in step S107. In addition, the controller 105 performs wireless communication between the first flash unit 300 and the second flash unit 400 to request the second flash unit 400 for pre-emission for flash control. Thereafter, the controller 105 advances the process to step S110, and performs flash photography using pre-emission of the first flash unit 300 and the second flash unit 400.

[0102] On the other hand, when it is determined in step S302 that at least one of the pre-light emission will overlap with the charge accumulation for the live view image of the image sensor 103, the controller 105 advances the process to step S105. In step S105, the controller 105 determines whether the non-accumulation (blanking) period in the inter-frame live view until the next live view image is captured is equal to or greater than a predetermined value. In this way, the controller 105 as the second imaging controller first determines whether the pre-light emission of the first flash unit 300 or the pre-light emission of the second flash unit 400 at the shortest light emission time will overlap with the charge accumulation for the live view image of the image sensor 103.

[0103] In addition, the controller 105 determines whether the non-accumulation period between periodic charge accumulation for the live view image of the image sensor 103 is equal to or greater than the accumulation period for the flash control image of the image sensor 103. Then, when the non-accumulation (blanking) period is less than a predetermined value, the controller 105 advances the process to step S108. In this case, the controller 105 temporarily stops the display update of the inter-frame live view image in step S108.

[0104] Furthermore, in step S109, the controller 105 requests pre-emission for flash control from the first flash unit 300. Furthermore, the controller 105 performs wireless communication between the first flash unit 300 and the second flash unit 400 to request pre-emission for flash control from the second flash unit 400. Thereafter, the controller 105 advances the process to step S110, and performs flash photography using pre-emission of the first flash unit 300 and the second flash unit 400.

[0105] On the other hand, when the non-accumulation (blanking) period is equal to or greater than the predetermined value, the controller 105 advances the process to step S304. In step S304, the controller 105 requests the first flash unit 300 for pre-emission for flash control. In addition, the controller 105 performs wireless communication between the first flash unit 300 and the second flash unit 400 to request the second flash unit 400 for pre-emission for flash control. At this time, the controller 105 performs offset setting on the second flash unit 400 to delay the emission timing. Thereafter, the controller 105 advances the process to step S110, and performs flash photography using pre-emission of the first flash unit 300 and the second flash unit 400.

[0106] Fig.11A , Fig. 11B and Fig. 11C It is shown Fig.10 The flowchart in FIG. 1 is a timing chart of an image pickup process in a case where an external flash unit performs pre-emission for flash control for continuous flash photography. Fig.11A The sequence of the image pickup process is shown in the case where the process in step S107 is performed because pre-light emission at the shortest light emission time will not overlap with charge accumulation for a live view image.

[0107] exist Fig.11A In the sequence of the image capture processing in , the image sensor 103 repeats flash photography accompanied by main light emission of the first flash unit 300 and the second flash unit 400 at a predetermined cycle. In addition, the image sensor 103 repeatedly captures live view images without loss at a cycle of 60 fps suitable for updating of the live view images.

[0108] Then, at the non-accumulation (blanking) timing at the shortest lighting time between the photographing timings of the first two consecutive live view images, the image sensor 103 performs photographing (accumulation) accompanied by pre-lighting of the first flash unit 300 and the second flash unit 400. In this way, when the pre-lighting of the first flash unit 300 and the pre-lighting of the second flash unit 400 at the shortest lighting time will not overlap with the charge accumulation for the live view image of the image sensor 103, the controller 105 performs wireless communication and performs pre-lighting of the first flash unit 300 and the second flash unit 400 at the shortest lighting time. It should be noted that the above-mentioned processing is also applied to the case where pre-lighting is performed only by the second flash unit 400.

[0109] Fig. 11B The sequence of the image pickup process in the case where the process in step S304 is executed is shown. That is, Fig. 11B The following case is shown: As the accumulation period for the live view image becomes longer than Fig.11A In the case of longer, the pre-emission at the shortest emission time will overlap with the charge accumulation for the live view image, and the non-accumulation period is equal to or greater than a predetermined value. Fig. 11B In the sequence of the image capture processing in , the image sensor 103 repeats flash photography accompanied by main light emission of the first flash unit 300 and the second flash unit 400 at a predetermined cycle. In addition, the image sensor 103 repeatedly captures live view images without omission at a cycle of 60fps suitable for updating of live view images. Then, the image sensor 103 delays the timing of photography (accumulation) accompanied by pre-light emission of the first flash unit 300 and the second flash unit 400 by a period offset (delayed) from the shortest light emission time. And the image sensor 103 performs photography accompanied by pre-light emission during the non-accumulation (blanking) period of the live view image.

[0110] In this way, when the pre-emission of the first flash unit 300 and the pre-emission of the second flash unit 400 at the shortest emission time will overlap with the charge accumulation for the live view image, and when the non-accumulation period is equal to or greater than the accumulation period of the charge for the flash control image of the image sensor 103, the controller 105 performs wireless communication and performs pre-emission at a timing delayed from the shortest emission time. The controller 105 controls at least the second flash unit 400 to perform pre-emission at a non-accumulation timing delayed from the shortest emission time. It should be noted that the above-mentioned processing is also applied to the case where the pre-emission is performed only by the second flash unit 400.

[0111] Fig. 11C The sequence of the image pickup process in the case where the processes in steps S108 and S109 are performed is shown. That is, Fig. 11C The following is shown: As the accumulation period for the live view image becomes longer than Fig. 11B In the case of longer, the pre-emission at the shortest emission time will overlap with the charge accumulation for the live view image, and the non-accumulation period is less than a predetermined value. Fig. 11C In the sequence of the imaging process in step S108, the image sensor 103 repeats the flash photography accompanied by the main emission of the first flash unit 300 at a predetermined cycle. In addition, the image sensor 103 attempts to repeat the photography of the live view image at a cycle of 60 fps suitable for the update of the live view image. However, the photography of the second live view image is temporarily stopped by the processing in step S108, and the second live view image is missing.

[0112] Then, during the stop of the shooting of the live view image, the image sensor 103 performs shooting (accumulation) accompanied by pre-light emission of the first flash unit 300 and the second flash unit 400. In this way, when the pre-light emission of the first flash unit 300 and the pre-light emission of the second flash unit 400 at the shortest lighting time will overlap with the charge accumulation for the live view image of the image sensor 103, and when the non-accumulation period is less than a predetermined value, the controller 105 performs wireless communication and performs pre-light emission at a timing delayed from the shortest lighting time.

[0113] When the non-accumulation period is less than the accumulation period of the charge for the flash control image of the image sensor 103, the controller 105 stops the periodic acquisition of the live view image using the first camera controller in a thinning manner. Then, at the non-accumulation timing generated by thinning the periodic acquisition of the live view image and delayed from the shortest emission time, the controller 105 performs at least pre-emission of the second flash unit 400. It should be noted that the above-mentioned processing is also applied to the case where only the second flash unit 400 performs pre-emission.

[0114] Next, an example of optimizing the cycle of live view images and performing continuous flash photography accompanied with wireless communication of a plurality of flash units and pre-light emission for flash control will be described. Fig.12 It is shown in Figure 1 Flowchart of an image pickup process executed in the image pickup apparatus 1 in FIG. 1 , in which a plurality of flash units perform wireless communication and the flash units sequentially perform pre-emission for flash control for continuous flash photography.

[0115] Figure 1 The first flash unit 300 and the second flash unit 400 in each of the embodiment have a wireless communication unit to perform wireless communication. Figure 1 , only the wireless communication unit 306 of the first flash unit 300 is shown and the wireless communication unit of the second flash unit 400 is omitted.

[0116] When a plurality of flash units perform wireless communication, and when continuous flash photography is performed while the flash units sequentially perform pre-emission for flash control, the controller 105 of the imaging apparatus 1 performs Fig.12 Steps S102 to S111 and steps S301 to S304 are the same as Fig.10 The controller 105 performs the processing in steps S301, S102 to S104. When it is determined in step S104 that no termination operation is given to the operation unit 122, the controller 105 advances the processing to step S401.

[0117] In step S401, the controller 105 determines whether the current frame rate of the live view image is equal to or less than the low frame rate of 30fps. In this way, the controller 105 as a period controller can determine the period in which the first camera controller periodically obtains the live view image using the image sensor 103. Then, when the current frame rate of the live view image is equal to or less than 30fps, the controller 105 advances the process to step S402. When the current frame rate of the live view image is greater than 30fps (for example, 60fps), the controller 105 skips the processes in steps S402 and S403, and advances the process to step S302.

[0118] In step S402, the controller 105 temporarily stops the display update of the live view image as in step S108. The controller 105 temporarily stops the display update of the live view image until the wireless communication between the first flash unit 300 and the second flash unit 400 and the pre-light emission of the first flash unit 300 and the pre-light emission of the second flash unit 400 have been performed. When the pre-light emission is performed, the pre-light emission light may affect the image quality of the live view image. In this embodiment, since the display update of the inter-frame live view image is temporarily stopped, the pre-light emission light does not affect the displayed live view image. After the temporary stop period has passed, the controller 105 resumes the display update of the inter-frame live view image in step S103.

[0119] In step S403, the controller 105 changes the frame rate as the update cycle of the live view image to 60fps. Thereafter, the controller 105 advances the processing to step S302. In step S302, when the controller 105 determines that any pre-emission will not overlap with the charge accumulation for the live view image of the image sensor 103 in the case where the first flash unit 300 and the second flash unit 400 perform pre-emission, the controller 105 performs the processing in steps S107, S110, and S404. In this case, in step S107, the controller 105 requests the non-emitting flash unit (i.e., the flash unit that has not performed pre-emission in the current cycle) of the first flash unit 300 and the second flash unit 400 for pre-emission for flash control at non-accumulation timing. In addition, the controller 105 performs flash photography accompanied by pre-emission in step S110, and advances the processing to step S404.

[0120] In step S404, the controller 105 determines whether the process of controlling the flash units to perform pre-lighting in sequence continues. When the pre-lighting of at least one flash unit is not completed, the controller 105 determines that the process of performing pre-lighting continues, and returns the process to step S107. When the pre-lighting of all flash units is completed, the controller 105 advances the process to step S111.

[0121] In the case where at least one of the pre-emissions will overlap with the charge accumulation for the live view image of the image sensor 103 when the first flash unit 300 and the second flash unit 400 are controlled to perform pre-emission at the shortest emission time ("Yes" in step S302), and the non-accumulation (blanking) period of the inter-frame live view until the next live view image is captured is equal to or greater than a predetermined value ("Yes" in step S105), the processing in step S405 is performed. In this case, in step S304, the controller 105 requests the non-emitting flash unit in the first flash unit 300 and the second flash unit 400 for pre-emission for flash control at non-accumulation timing. At this time, the controller 105 performs offset setting on the selected flash unit to delay the emission timing.

[0122] In step S405, the controller 105 performs flash photography accompanied by pre-emission of the selected flash unit. In step S404, the controller 105 determines whether the process of controlling the flash units to perform pre-emission in sequence continues. When the pre-emission of at least one flash unit is not completed, the controller 105 determines that the process of performing pre-emission continues, and returns the process to step S304. When the pre-emission of all flash units is completed, the controller 105 advances the process to step S111.

[0123] When the first flash unit 300 and the second flash unit 400 are controlled to perform pre-light emission with the shortest light emission time, at least one of the pre-light emission will overlap with the charge accumulation of the image sensor 103 for the live view image ("Yes" in step S302), and the non-accumulation (blanking) period of the inter-frame live view until the next live view image is captured is less than a predetermined value ("No" in step S105), the processing in step S407 is performed.

[0124] In this case, the controller 105 temporarily stops the display update of the live view image in step S108, and in step S109 requests pre-emission for flash control from the non-emitting flash unit of the first flash unit 300 and the second flash unit 400. Then, in step S407, the controller 105 performs flash photography accompanied by pre-emission of the selected flash unit.

[0125] In step S408, the controller 105 determines whether the process of controlling the flash units to perform pre-lighting in sequence continues. When the pre-lighting of at least one flash unit is not completed, the controller 105 determines that the process of performing pre-lighting continues and returns the process to step S108. When the pre-lighting of all flash units is completed, the controller 105 advances the process to step S111.

[0126] Fig.13 It is shown Fig.12 The flowchart in FIG. 1 is a timing chart of an imaging process in a case where a plurality of flash units sequentially perform pre-emission for flash control for continuous flash photography. Fig.13 Shown in execution Fig.12 The sequence of the imaging process in the case of the processes in steps S108 to S408.

[0127] exist Fig.13 In the sequence of the image capture processing in , the image sensor 103 repeats the flash photography accompanied by the main emission of the first flash unit 300 at a predetermined cycle. In addition, the image sensor 103 attempts to repeat the photography of the live view image at a cycle of 60fps suitable for the update of the live view image. On the other hand, because the frame rate becomes less than 30fps due to the long accumulation period for the live view image and the non-accumulation period is less than the accumulation period of the charge for the flash control image of the image sensor 103, the image sensor 103 is not captured by the processing in steps S402 and S108. Fig.13 As shown, the shooting from the second live view image onwards is temporarily stopped, and the second live view image and the live view images thereafter are missing. Then, during the period in which the shooting of the live view image is stopped, the image sensor 103 performs shooting (accumulation) accompanied by pre-emission of the first flash unit 300 and shooting (accumulation) accompanied by pre-emission of the second flash unit 400.

[0128] In this way, when the pre-light emission of the first flash unit 300 and the pre-light emission of the second flash unit 400 at the shortest light emission time will overlap with the charge accumulation for the live view image, and when the non-accumulation period is less than the accumulation period of the charge for the flash control image of the image sensor 103, the controller 105 stops the shooting of the live view image and delays the pre-light emission timing from the shortest light emission time by performing wireless communication. The controller 105 controls the first flash unit 300 and the second flash unit 400 to sequentially perform pre-light emission at the delayed timing relative to the shortest light emission time.

[0129] In addition, when the accumulation period for the live view image becomes longer and the frame rate becomes lower in the case of shooting in a dark place, the execution of pre-lighting is usually delayed. On the other hand, in the present embodiment, the frame rate of the live view image is forcibly increased in step S403. As a result, in this embodiment, the execution of pre-lighting does not become too late. Therefore, the processing of sequentially performing pre-lighting of the flash unit can be completed quickly. In this way, when the cycle of the first camera controller using the image sensor 103 to periodically obtain the live view image is longer than a predetermined cycle, the controller 105 as a cycle controller stops the periodic acquisition of the live view image using the first camera controller in an intermittent manner.

[0130] Then, the controller 105 may change the period at which the first camera controller periodically obtains the live view image using the image sensor 103 to a predetermined period. In addition, after the controller 105 changes the period at which the live view image is periodically obtained using the image sensor 103 to a predetermined period, the controller 105 may obtain a flash control image accompanied by pre-light emission of the first light emitting member 302 using the image sensor 103 for continuous flash photography.

[0131] Although the present invention has been described in detail based on suitable embodiments, the present invention is not limited to these specific embodiments, and various structures that do not depart from the scope of the present invention are also included in the present invention.

[0132] Other embodiments

[0133] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0134] Although the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

[0135] This application claims the benefit of Japanese Patent Application No. 2021-086107, filed May 21, 2021, which is hereby incorporated by reference herein in its entirety.

Claims

1. A camera device, comprising: Image sensor; A first camera controller, used for periodically obtaining a display image using the image sensor; as well as a second imaging controller configured to obtain a flash control image accompanied by pre-light emission of a first flash unit using the image sensor in addition to the first imaging controller; wherein the second imaging controller performs pre-light emission of the first flash unit when the image sensor does not perform non-accumulation timing for accumulating the charge obtained by the first imaging controller for the period of the display image, wherein, in a case where a non-accumulation period between periodic charge accumulations of the image sensor for the display image is not less than an accumulation period of charge of the image sensor for the flash control image, the second imaging controller performs pre-emission of the first flash unit at the non-accumulation timing, and In which, when the non-accumulation period between the periodic charge accumulation of the image sensor for the display image is shorter than the accumulation period of the charge of the image sensor for the flash control image, the second camera controller stops the periodic acquisition of the display image by the first camera controller in an intermittent manner, and performs pre-light emission of the first flash unit at the non-accumulation timing generated by intermittently eliminating the periodic acquisition of the display image.

2. The imaging device according to claim 1, further comprising a light pulse communication unit that communicates with a second flash unit using light pulses by controlling the first flash unit to emit light pulses, in, The optical pulse communication unit stops periodic acquisition of the display image by the first imaging controller in a thinning manner, and performs communication using optical pulses at non-accumulation timing generated by thinning out periodic acquisition of the display image.

3. The imaging device according to claim 1 , further comprising a wireless communication unit configured to wirelessly communicate with one of the first flash unit and a second flash unit, wherein the second flash unit is capable of wirelessly communicating with the first flash unit. in, the second imaging controller determines whether pre-light emission of at least the second flash unit of the first flash unit and the second flash unit at the shortest light emission time will overlap with charge accumulation of the image sensor for the display image, wherein, in a case where the pre-light emission of the shortest light emission time will not overlap with the charge accumulation, the second imaging controller performs wireless communication using the wireless communication unit and performs pre-light emission of at least the second flash unit out of the first flash unit and the second flash unit at the shortest light emission time, and In which, in a case where the pre-light emission of the shortest light emission time will overlap with the charge accumulation, the second camera controller uses the wireless communication unit to perform wireless communication, and performs pre-light emission of at least the second flash unit among the first flash unit and the second flash unit at a timing delayed from the shortest light emission time.

4. The imaging device according to claim 3, wherein: the second imaging controller determines whether a non-accumulation period between periodic charge accumulations for the display image of the image sensor is not less than an accumulation period of charge for the flash control image of the image sensor, in a case where pre-emission of at least the second flash unit of the first flash unit and the second flash unit at the shortest emission time will overlap with charge accumulation for the display image of the image sensor, wherein, in a case where the non-accumulation period is not less than an accumulation period of the charge of the image sensor for the flash control image, the second imaging controller performs pre-emission of at least the second flash unit out of the first flash unit and the second flash unit at a non-accumulation timing delayed from the shortest emission time, and Wherein, when the non-accumulation period is smaller than the accumulation period of the charge of the image sensor for flash control image, the second camera controller stops the periodic acquisition of the display image by the first camera controller in an intermittent elimination manner, and performs pre-illumination of at least the second flash unit among the first flash unit and the second flash unit at the non-accumulation timing generated by periodic acquisition of the display image at the timing delayed from the shortest emission time by intermittent elimination.

5. The imaging device according to claim 1, further comprising a cycle controller configured to obtain a cycle in which the first imaging controller periodically obtains the display image using the image sensor. in, In a case where the period at which the first camera controller uses the image sensor to periodically obtain the display image is longer than a predetermined period, the period controller stops the periodic acquisition of the display image by the first camera controller in an interval elimination manner, and changes the period at which the first camera controller uses the image sensor to periodically obtain the display image to the predetermined period.

6. The imaging device according to claim 5, wherein: After the cycle controller changes the cycle in which the first imaging controller periodically obtains the display image using the image sensor to the predetermined cycle, the second imaging controller obtains a flash control image accompanied by pre-emission of the first flash unit.

7. A method for controlling a camera device, wherein the camera device can use an image sensor to perform light-emitting photography when a first flash unit emits light, the method comprising the following steps: periodically acquiring a display image using the image sensor; obtaining a flash control image accompanied by pre-emission of the first flash unit using the image sensor at a non-accumulation timing in which the image sensor does not perform charge accumulation for periodic acquisition of the display image; performing pre-emission of the first flash unit at the non-accumulation timing when a non-accumulation period between periodic charge accumulations of the image sensor for the display image is not less than an accumulation period of charge of the image sensor for the flash control image; stopping the periodic acquisition of the display image in a thinning-out manner when a non-accumulation period between periodic charge accumulations of the image sensor for the display image is shorter than an accumulation period of charge of the image sensor for the flash control image; as well as In a case where the periodic acquisition of the display image is stopped, the pre-emission of the first flash unit is performed at a non-accumulation timing generated by thinning out the periodic acquisition of the display image.

8. The control method according to claim 7, further comprising the following steps: Stopping the periodic acquisition of the display image in a thinning-out manner; and Communication using light pulses is performed with the second flash unit by controlling the first flash unit to emit light pulses at a non-accumulation timing generated by thinning out a period of the display image.

9. The control method according to claim 7, further comprising the following steps: determining whether pre-light emission of at least the second flash unit of the first flash unit and the second flash unit at the shortest light emission time will overlap with charge accumulation of the image sensor for the display image, wherein the second flash unit is capable of wireless communication with the first flash unit; wireless communication is performed, and pre-emission of at least the second flash unit of the first flash unit and the second flash unit is performed at the shortest emission time, in a case where pre-emission of the shortest emission time will not overlap with the charge accumulation; as well as When the pre-emission of the shortest emission time will overlap with the charge accumulation, wireless communication is performed, and pre-emission of at least the second flash unit of the first and second flash units is performed at a timing delayed from the shortest emission time.

10. The control method according to claim 9, further comprising the following steps: In a case where pre-light emission of at least the second flash unit of the first flash unit and the second flash unit at the shortest light emission time will overlap with charge accumulation of the image sensor for the display image, determining whether a non-accumulation period between periodic charge accumulations of the image sensor for the display image is not less than an accumulation period of charge of the image sensor for the flash control image; in a case where the non-accumulation period is not less than an accumulation period of the charge of the image sensor for the flash control image, performing pre-emission of at least the second flash unit of the first flash unit and the second flash unit at a non-accumulation timing delayed from the shortest emission time; When the non-accumulation period is shorter than the accumulation period of the charge of the image sensor for the flash control image, the periodic acquisition of the display image is stopped in a thinning manner; as well as While stopping the periodic acquisition of the display image, pre-emission of at least the second flash unit among the first flash unit and the second flash unit is performed at a non-accumulative timing generated by thinning out the periodic acquisition of the display image at a timing delayed from the shortest emission time.

11. The control method according to claim 7, further comprising the following steps: determining a period of periodically obtaining the display image using the image sensor; When the period of periodically obtaining the display image using the image sensor is longer than a predetermined period, stopping the periodic acquisition of the display image in a thinning-out manner; as well as The cycle of periodically obtaining the display image using the image sensor is changed to the predetermined cycle.

12. The control method according to claim 11, further comprising the following steps: After changing the cycle of periodically obtaining the display image using the image sensor to the predetermined cycle, a flash control image accompanied by pre-light emission of the first flash unit is obtained. 13 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 7 .

Images