Camera device, camera method and storage medium

Abstract

The present invention provides a camera device, a camera method and a camera program capable of shortening shutter time lag. A digital camera (100) comprises: a system control unit (11) for performing a first synchronization control, wherein the first synchronization control is to output a vertical synchronization signal (VD1) at a first moment (moment (t1)) after receiving an instruction for continuous shooting, output the vertical synchronization signal (VD1) at a moment (t2) after a first time (T1) from moment (t1), and output the vertical synchronization signal (VD1) every second time (T2) longer than the first time (T1) after moment (t2); and a camera unit (50) for starting to read a signal from an imaging element (5) by a rolling shutter method at a moment when an input of a vertical synchronization signal after moment (t2) is received, and starting to expose the imaging element (5) by a rolling shutter method at a moment before an exposure time (EX) at that moment.

Description

Technical Field

[0001] The invention relates to a camera device, a camera method and a storage medium. Background Art

[0002] As imaging elements such as CCD (Charge Coupled Device) image sensors and CMOS (Complementary Metal Oxide Semiconductor) image sensors have higher resolution, the demand for electronic devices with imaging functions, such as digital cameras, digital video cameras, and electronic devices with cameras (such as smartphones), has increased dramatically.

[0003] As a driving method for CMOS type imaging elements mounted on electronic devices, rolling shutter driving is known. The rolling shutter driving is a method in which each photoelectric conversion element of a pixel row of the imaging element is reset to start exposure of the pixel row, and then, while changing the pixel row, pixel signals corresponding to the charges accumulated in each photoelectric conversion element of the pixel row are sequentially read to the signal line.

[0004] Patent Document 1 describes, as a method for driving a CCD image sensor, a method of reducing shutter lag by resetting the vertical synchronization operation to start exposure when a shooting instruction is received.

[0005] Patent Document 2 describes a method for driving a CMOS image sensor in which, when a still image shooting start trigger is input, a vertical synchronization signal is forcibly applied asynchronously without waiting for the next vertical synchronization signal, and a global reset (simultaneous reset of all pixels) is performed to start exposure.

[0006] Previous technical literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2005-260733

[0009] Patent Document 2: Japanese Patent Application Publication No. 2012-129817 Summary of the invention

[0010] Technical issues to be solved by the invention

[0011] One embodiment of the technology according to the present invention provides an imaging device, an imaging method, and an imaging program capable of reducing shutter time lag.

[0012] Means for solving technical problems

[0013] The camera device of the present invention comprises: a control unit, which performs a first synchronous control, wherein the first synchronous control is to output a first synchronization signal at a first moment after receiving an instruction for continuous shooting, output a second synchronization signal at a second moment after a first time has passed from the above-mentioned first moment, and output the above-mentioned second synchronization signal every time a second time longer than the above-mentioned first time has passed after the above-mentioned second moment; and a camera unit, which starts to read the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the above-mentioned second synchronization signal after the above-mentioned second moment, and starts to expose the above-mentioned imaging element by a rolling shutter method at a moment before the exposure time at this moment.

[0014] The camera method of the present invention comprises: a control step of performing a first synchronous control, wherein the first synchronous control is to output a first synchronization signal at a first moment after receiving an instruction for continuous shooting, output a second synchronization signal at a second moment after a first time has passed from the above-mentioned first moment, and output the above-mentioned second synchronization signal every time a second time longer than the above-mentioned first time has passed after the above-mentioned second moment; and a camera step of starting to read a signal from an imaging element by a rolling shutter method at a moment when the above-mentioned second synchronization signal is input after the above-mentioned second moment, and starting to expose the above-mentioned imaging element by a rolling shutter method at a moment before the exposure time at that moment.

[0015] The camera program of the present invention is used to enable a computer to execute the following steps: a control step, performing a first synchronous control, wherein the first synchronous control is to output a first synchronization signal at a first moment after receiving an instruction for continuous shooting, output a second synchronization signal at a second moment after a first time has passed from the above-mentioned first moment, and output the above-mentioned second synchronization signal every second time longer than the above-mentioned first time has passed after the above-mentioned second moment; and a camera step, at the moment of receiving the input of the above-mentioned second synchronization signal after the above-mentioned second moment, start reading the signal from the imaging element by a rolling shutter method, and at a moment before the exposure time at this moment, start exposing the above-mentioned imaging element by a rolling shutter method.

[0016] Effects of the Invention

[0017] According to the present invention, it is possible to provide an imaging device, an imaging method, and an imaging program capable of shortening shutter time lag. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 1 is a diagram showing a schematic configuration of a digital camera 100 as an electronic device including an embodiment of an imaging device according to the present invention.

[0019] Figure 2 Yes means Figure 1 The schematic top view of the imaging element 5 is shown.

[0020] Figure 3 It means in Figure 1 1 is a diagram showing an example of a timing chart when the system control unit 11 performs the first synchronization control in the continuous shooting mode of the digital camera 100 shown.

[0021] Figure 4 It means in Figure 1 1 is a diagram showing an example of a timing chart when the system control unit 11 performs the second synchronization control in the continuous shooting mode of the digital camera 100.

[0022] Figure 5 Yes means Figure 3 A timing chart of a modified example of the first synchronous control shown.

[0023] Figure 6 Yes means Figure 1 1 is a timing chart of operations in the continuous shooting mode and during the first synchronous control in the fourth modification of the digital camera 100 shown.

[0024] Figure 7 FIG. 2 is a diagram showing the appearance of a smartphone 200 as another embodiment of an electronic device including an embodiment of the imaging device of the present invention.

[0025] Figure 8 Yes means Figure 7 FIG. 2 is a block diagram of the structure of the smartphone 200 shown in FIG. DETAILED DESCRIPTION

[0026] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0027] Figure 1 1 is a diagram showing a schematic configuration of a digital camera 100 as an electronic device including an embodiment of an imaging device according to the present invention.

[0028] Figure 1 The digital camera 100 shown in the figure includes a lens device 40 and a main body 100A. The lens device 40 includes an imaging lens 1, an aperture 2, a lens control unit 4, a lens driving unit 8, and an aperture driving unit 9. The main body 100A includes an imaging unit 50, a system control unit 11, an operation unit 14, a display device 22, a memory 16 including a RAM (Random Access Memory) and a ROM (Read Only Memory), a memory control unit 15 that controls recording data in the memory 16 and reading data from the memory 16, a digital signal processing unit 17, and an external memory control unit 20 that controls recording data in a recording medium 21 and reading data from the recording medium 21. The imaging unit 50 and the system control unit 11 constitute an imaging device.

[0029] The lens device 40 can be attached to and detached from the main body 100A, or can be integrated with the main body 100A. The imaging lens 1 includes a focus lens or a zoom lens that can be moved along the optical axis. The lens control unit 4 of the lens device 40 is configured to communicate with the system control unit 11 of the main body 100A in a wired or wireless manner. The lens control unit 4 controls the focus lens included in the imaging lens 1 via the lens driving unit 8 to change the position of the principal point of the focus lens, or controls the zoom lens included in the imaging lens 1 via the lens driving unit 8 to change the position (focal length) of the zoom lens, or controls the aperture value of the aperture 2 via the aperture driving unit 9 in accordance with the instruction from the system control unit 11.

[0030] The imaging unit 50 includes a CMOS imaging element 5 that captures an image of a subject through an imaging optical system including an imaging lens 1 and an aperture 2 , and an imaging element driving unit 10 that drives the imaging element 5 .

[0031] The imaging element 5 has a camera surface in which a plurality of pixels are arranged in a two-dimensional shape, and converts the subject image formed on the camera surface by the imaging optical system into a pixel signal through the plurality of pixels and outputs it. Hereinafter, the set of pixel signals output from each pixel of the imaging element 5 is referred to as a camera image signal.

[0032] The system control unit 11 that performs overall control of the electrical control system of the digital camera 100 drives the imaging element 5 via the imaging element driving unit 10 , and outputs a subject image captured by the imaging optical system of the lens device 40 as a captured image signal.

[0033] The imaging element driving unit 10 generates a driving signal according to a command from the system control unit 11, and supplies the driving signal to the imaging element 5, thereby driving the imaging element 5. The hardware configuration of the imaging element driving unit 10 is a circuit composed of a combination of circuit elements such as semiconductor elements.

[0034] In the system control unit 11, instruction signals from the user are inputted through the operation unit 14. The operation unit 14 includes a touch panel and various buttons which are integrated with a display surface 22b described later.

[0035] The system control unit 11 performs overall control of the digital camera 100 , and its hardware structure is various processors that execute programs including an imaging program to perform processing. The programs that execute the system control unit 11 are stored in the ROM of the memory 16 .

[0036] Various processors include CPU (Central Processing Unit), a general-purpose processor that executes programs to perform various processes, FPGA (Field Programmable Gate Array), a processor whose circuit structure can be changed after manufacturing, such as Programmable Logic Device (PLD), or ASIC (Application Specific Integrated Circuit), a processor with a circuit structure specially designed to perform specific processing, such as a dedicated circuit, etc. More specifically, the structure of these various processors is a circuit composed of a combination of circuit elements such as semiconductor elements.

[0037] The system control unit 11 may be constituted by one of various processors, or may be constituted by a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs, or a combination of a CPU and an FPGA).

[0038] The display device 22 includes a display surface 22 b formed of an organic EL (electroluminescence) panel or a liquid crystal panel, and a display controller 22 a that controls the display on the display surface 22 b.

[0039] The memory control section 15 , the digital signal processing section 17 , the external memory control section 20 , and the display controller 22 a are connected to one another via a control bus 24 and a data bus 25 , and are controlled according to instructions from the system control section 11 .

[0040] Figure 2 Yes means Figure 1 The schematic top view of the imaging element 5 is shown.

[0041] The imaging element 5 includes: an imaging surface 60, in which a plurality of pixel rows 62 composed of a plurality of pixels 61 arranged in a row direction X are arranged in a column direction Y orthogonal to the row direction X; a driving circuit 63 that drives the pixels 61 arranged on the imaging surface 60; and a signal processing circuit 64 that processes pixel signals read from the respective pixels 61 in the pixel rows 62 arranged on the imaging surface 60 to the signal lines. The imaging surface 60 constitutes a light receiving surface.

[0042] Below, in Figure 2 In the diagram, the end portion of the imaging surface 60 on one end side in the column direction Y (the upper side in the figure) is referred to as an upper end, and the end portion of the imaging surface 60 on the other end side in the column direction Y (the lower side in the figure) is referred to as a lower end.

[0043] Figure 2The driving circuit 63 shown drives each pixel row 62 individually according to the signal from the imaging element driving unit 10, resets each pixel 61 included in the pixel row 62 (discharges the charge accumulated in the photoelectric conversion element), reads the pixel signal corresponding to the charge accumulated in the photoelectric conversion element of each pixel 61 to the signal line, etc.

[0044] Figure 2 The signal processing circuit 64 performs correlated double sampling processing on the pixel signals read from each pixel 61 of the pixel row 62 to the signal line, converts the correlated double sampling processed pixel signals into digital signals, and outputs them to the data bus 25. The signal processing circuit 64 is controlled by the imaging element driving section 10.

[0045] The digital signal processing unit 17 performs signal processing such as demosaic processing and gamma correction processing on the pixel signal output from the imaging element 5 to the data bus 25 to generate captured image data.

[0046] The digital camera 100 is equipped with a continuous shooting mode that continuously generates a plurality of captured image data in response to a single image capturing instruction and records the data in the recording medium 21 .

[0047] The system control unit 11 functions as a control unit by executing programs including an imaging program recorded in the ROM of the memory 16 .

[0048] In the continuous shooting mode, the system control unit 11 drives the imaging element 5 by the rolling shutter method through the imaging element driving unit 10 to shoot a subject. The system control unit 11 can also drive a mechanical shutter (not shown) to shoot a subject in the continuous shooting mode.

[0049] The driving of the rolling shutter method includes rolling reset driving and rolling reading driving. The rolling reset driving is a driving method that sequentially resets each pixel 61 of the pixel row 62 and starts the exposure process of each pixel 61 while changing the pixel row 62. The rolling reading driving is a driving method that sequentially reads signals from each pixel 61 of the exposed pixel row 62 and ends the exposure process of the pixel row 62 while changing the pixel row 62.

[0050] In the continuous shooting mode, the system control unit 11 selects and executes either the first synchronous control or the second synchronous control according to the imaging conditions such as the imaging sensitivity or the exposure value, or the exposure time determined by the setting from the user. Specifically, the system control unit 11 selects and executes the first synchronous control when the exposure time is less than the threshold value TH1, and selects and executes the second synchronous control when the exposure time exceeds the threshold value TH1.

[0051] In addition, regarding the exposure time of the imaging element 5, for example, in order to expand the dynamic range of the captured image data, it is sometimes possible to Figure 2 The imaging plane 60 shown has a distribution. For example, there is a case where the exposure time of the pixel rows 62 on the odd-numbered rows of the imaging plane 60 is different from the exposure time of the pixel rows 62 on the even-numbered rows of the imaging plane 60. In this case, the maximum value of the exposure time of the pixel rows 62 is set as the exposure time for selecting the first synchronous control and the second synchronous control.

[0052] Figure 3 It means in Figure 1 1 is a diagram showing an example of a timing chart when the system control unit 11 performs the first synchronization control in the continuous shooting mode of the digital camera 100. Figure 4 It means in Figure 1 1 is a diagram showing an example of a timing chart when the system control unit 11 performs the second synchronization control in the continuous shooting mode of the digital camera 100. Figure 3 and Figure 4 An example is shown in which four pieces of captured image data are continuously acquired and recorded in the continuous shooting mode.

[0053] exist Figure 3 and Figure 4 In the example, the horizontal axis represents time. Figure 3 and Figure 4 The upper stage shows a vertical synchronization signal VD1, which is generated and output by the system control section 11 and input to the imaging element driving section 10 through a single signal line.

[0054] exist Figure 3 and Figure 4 The lower level shows the driving timing of each pixel row 62 of the imaging element 5. Figure 3 and Figure 4 At the lower level, the vertical axis represents the position of pixel row 62 in the column direction Y. Figure 3 and Figure 4 The straight line RR shown below represents the timing at which each pixel 61 included in the pixel row 62 is reset (exposure starts) by the rolling reset drive. Figure 3 and Figure 4 The straight line RS shown below represents the timing at which the exposure of each pixel 61 included in the pixel row 62 ends by the rolling read drive. The period surrounded by the straight line RR and the straight line RS adjacent to the right thereof represents the exposure time EX of the imaging element 5 in the continuous shooting mode.

[0055] (First Synchronous Control)

[0056] like Figure 3 As shown, the system control unit 11 receives the continuous shooting instruction ( Figure 3 At the first moment after the camera instruction in the image pickup instruction (i.e., the moment t1), the vertical synchronization signal VD1 and control information (exposure start time of each pixel row 62, signal amplification gain, etc.) are output.

[0057] When the imaging element driving section 10 receives the input of the vertical synchronization signal VD1 and the control information, it reflects the control information to the driving circuit 63 and the signal processing circuit 64. When the reflection of the control information is completed, the imaging element driving section 10 starts the rolling reset drive (exposure of the imaging element 5) at time t2a after a predetermined time Tx has passed since the vertical synchronization signal VD1 at time t1 was received.

[0058] When the time t2 is the second time after the first time T1 has passed from the time t1, the system control unit 11 outputs the vertical synchronization signal VD1 and the exposure start time information of the second frame. The system control unit 11 determines the time after the exposure time EX has passed from the time t2a when the exposure of the imaging element 5 starts as the second time. That is, the system control unit 11 determines the time obtained by adding the exposure time EX to the prescribed time Tx as the first time T1.

[0059] In addition, the predetermined time Tx needs to be set to be longer than the processing time required from when the system control unit 11 outputs the control information until the control information is reflected on the imaging element 5. The greater the processing load of the imaging unit 50 or the system control unit 11, the longer the processing time becomes. Therefore, the system control unit 11 determines the lower limit value of the predetermined time Tx (the above-mentioned processing time) according to the processing load of the imaging unit 50 or the system control unit 11.

[0060] In this way, the first time T1 becomes a value controlled according to the processing load of the imaging unit 50 or the system control unit 11 and the exposure time EX.

[0061] The imaging element driving section 10 starts rolling reading driving (reading a signal from the imaging element 5 ) at the time of receiving the input of the vertical synchronization signal VD1 output at the time t2 after the exposure time EX has elapsed from the time t2a.

[0062] After the time t2, the system control unit 11 performs the following operation each time a second time T2 (longer than the first time T1) has passed. Figure 3 At the time t3, t4, t5 in the image processing unit, the vertical synchronization signal VD1 and the exposure start time information are output. The second time T2 is a value predetermined according to the number of continuous shots, settings, etc.

[0063] After the imaging element driving unit 10 starts the rolling read drive at time t2, if it becomes the moment (time t3a) according to the exposure time information input from the system control unit 11 at time t2, it starts the rolling reset drive, and receives the input of the vertical synchronization signal VD1 at time t3 after the exposure time EX from time t3a, then starts the rolling read drive.

[0064] After the imaging element driving unit 10 starts the rolling read drive at time t3, if it becomes the moment (time t4a) according to the exposure time information input from the system control unit 11 at time t3, it starts the rolling reset drive, and if it receives the input of the vertical synchronization signal VD1 at time t4 after the exposure time EX from time t4a, it starts the rolling read drive.

[0065] After the imaging element driving unit 10 starts the rolling read drive at time t4, if it becomes the moment (time t5a) according to the exposure time information input from the system control unit 11 at time t4, it starts the rolling reset drive, and if it receives the input of the vertical synchronization signal VD1 at time t5 after the exposure time EX from time t5a, it starts the rolling read drive.

[0066] exist Figure 3 In the embodiment, the vertical synchronization signal VD1 output at time t1 is used to instruct the imaging element driving unit 10 to prepare for exposure of the first frame of continuous shooting, and constitutes a first synchronization signal. Figure 3 In the embodiment, the vertical synchronization signal VD1 output after the time t1 is used to instruct the imaging element driving section 10 to read the signal obtained in each exposure of the continuous shooting, and constitutes the second synchronization signal.

[0067] Thus, in the first synchronization control, the interval (first time T1) between the vertical synchronization signal VD1 output first and the second vertical synchronization signal VD1 output after receiving the continuous shooting instruction is shorter than the interval (second time T2) between the vertical synchronization signals VD1 output after the second one.

[0068] (Second Synchronous Control)

[0069] like Figure 4 As shown, upon receiving the instruction for continuous shooting ( Figure 4 After the camera instruction in the image pickup section, the system control section 11 outputs the vertical synchronization signal VD1 and the control information at time t1. After time t1, the system control section 11 outputs the vertical synchronization signal VD1 and the control information at time t1. Figure 4 At times t2, t3, t4, t5), the vertical synchronization signal VD1 and exposure start time information are output.

[0070] When the imaging element driving unit 10 receives the vertical synchronization signal VD1 output at time t1 and the input of the control information, it reflects the control information to the driving circuit 63 and the signal processing circuit 64. When the reflection of the control information is completed, the imaging element driving unit 10 starts the rolling reset drive (exposure of the imaging element 5) at time t2a after a predetermined time Ty has passed from time t1. The predetermined time Ty is set to a value that subtracts the exposure time EX from the second time T2.

[0071] The imaging element driving section 10 starts rolling reading driving (reading a signal from the imaging element 5 ) at the time of receiving the input of the vertical synchronization signal VD1 output at the time t2 after the exposure time EX has elapsed from the time t2a.

[0072] When it is time (time t3a) after a predetermined time Ty has passed from time t2, the imaging element driving unit 10 starts rolling reset driving. When receiving input of the vertical synchronization signal VD1 at time t3 after an exposure time EX has passed from time t3a, the imaging element driving unit 10 starts rolling reading driving.

[0073] At a time (time t4a) after a predetermined time Ty has passed from time t3, the imaging element driving unit 10 starts rolling reset driving. At time t4 after an exposure time EX has passed from time t4a, upon receiving input of the vertical synchronization signal VD1, the imaging element driving unit 10 starts rolling reading driving.

[0074] When it is time (time t5a) after a predetermined time Ty has passed since time t4, the imaging element driving unit 10 starts rolling reset driving. When receiving input of the vertical synchronization signal VD1 at time t5 after an exposure time EX has passed since time t5a, the imaging element driving unit 10 starts rolling reading driving.

[0075] exist Figure 4 In the embodiment, the vertical synchronization signal VD1 output at time t1 is used to instruct the imaging element driving unit 10 to prepare for exposure of the first frame of continuous shooting, and constitutes a first synchronization signal. Figure 4 In the embodiment, the vertical synchronization signal VD1 output after the time t1 is used to instruct the imaging element driving section 10 to read the signal obtained in each exposure of the continuous shooting, and constitutes the second synchronization signal.

[0076] In this way, in the second synchronous control, when the instruction for continuous shooting is received, the vertical synchronization signal VD1 is output from the system control unit 11 at a constant interval (every second time period T2).

[0077] (Effects of the digital camera according to the embodiment)

[0078] According to the digital camera 100, in the continuous shooting mode, Figure 3 The first synchronous control and Figure 4 The second synchronous control is shown. Figure 3 In the first synchronous control shown in FIG. 1 , the time from when the image capture instruction is issued to when the exposure of the first frame starts (predetermined time Tx) can be reduced to a so-called shutter time lag ratio. Figure 4 The same time (predetermined time Ty) in the second synchronous control shown is shortened.

[0079] For example, in burst mode, when only Figure 4In the case of the second synchronous control shown, the shorter the exposure time EX, the greater the shutter lag. Therefore, when the exposure time EX is short (below the threshold), by performing the first synchronous control, it is possible to prevent the increase of the shutter lag that becomes significant when the exposure time EX is short.

[0080] (First Modification of Digital Camera of Embodiment)

[0081] In this modification, the system control unit 11 functions as a flicker detection unit that detects flicker (flicker of a light source such as a fluorescent lamp or a mercury lamp). The method of detecting flicker is not particularly limited.

[0082] When flicker is detected in the continuous shooting mode, the system control unit 11 executes the synchronization control according to the continuous shooting instruction without depending on the exposure time EX. Figure 4 The system control unit 11 controls the second time T2 in the second synchronous control to a time (for example, a natural multiple of the flicker cycle of the light source causing the flicker) that suppresses image quality degradation (generation of brightness unevenness between captured image data) caused by flicker.

[0083] In this way, when the system control unit 11 detects flicker and drives the imaging element 5 under the driving conditions that prevent image quality degradation caused by the flicker, even if the exposure time EX is less than the threshold value, Figure 4 According to this structure, the overlapping state of the exposure period and the light source blinking pattern of each frame of the continuous shooting can be made uniform. As a result, the brightness change in each camera image data obtained in the continuous shooting can be prevented.

[0084] (Second Modification of Digital Camera of Embodiment)

[0085] Figure 5 Yes means Figure 3 A timing chart of a modified example of the first synchronous control shown. Figure 5 The timing diagram shown is similar to Figure 3 The difference is that the system control unit 11 causes the imaging element driving unit 10 to perform global reset driving (straight line GR) during the period from time t1 after receiving the continuous shooting instruction to time t2a when the exposure of the first frame starts.

[0086] The global reset drive is a drive that simultaneously resets all pixels 61 to be exposed on the imaging surface 60 of the imaging element 5. Between time t1 and time t2a, the system control unit 11 instructs the imaging element driving unit 10 to perform the global reset drive, and the imaging element driving unit 10 that receives the instruction performs the global reset drive.

[0087] By performing global reset driving before starting exposure of the first frame, exposure of the first frame can be started in a state where residual charges in the pixels 61 generated in the live preview image displaying image shooting performed before time t1 are eliminated. As a result, the quality of the shot image data can be improved.

[0088] In addition, the residual charge of the pixel 61 tends to be generated easily when the temperature of the imaging element 5 is low. Therefore, the system control unit 11 monitors the temperature of the imaging element 5 when performing the first synchronous control, and performs global reset driving when the temperature is below the threshold, and does not perform global reset driving when the temperature exceeds the threshold. In this way, the power consumption during the first synchronous control can be reduced.

[0089] (Third Modification of Digital Camera of Embodiment)

[0090] In this variation, the system control unit 11 can operate in an external synchronization mode, which generates a vertical synchronization signal VD1 in synchronization with an external synchronization signal VD2 generated outside the system control unit 11 (for example, a vertical synchronization signal for display generated in the display controller 22a of the display device 22).

[0091] In the external synchronization mode, the system control unit 11 makes the second time T2 in the continuous shooting mode coincide with the cycle of the external synchronization signal VD2. Then, when operating in the external synchronization mode, the system control unit 11 selects and executes the second synchronization control as the synchronization control selected in the continuous shooting mode, regardless of the exposure time EX.

[0092] like Figure 4 As shown, the second synchronization control is a control for outputting the vertical synchronization signal VD1 at a certain interval every second time T2 after the camera instruction is issued. Therefore, in the third modified example, for example, the output timing of the vertical synchronization signal VD1 output for the second time after the camera instruction is issued is made consistent with the input timing of the external synchronization signal first input to the system control unit 11 after the camera instruction is issued, thereby minimizing the deviation between the output timings of the vertical synchronization signal VD1 and the external synchronization signal, so that the captured image can be displayed immediately. In addition, the output timing of the vertical synchronization signal VD1 and the output timing of the external synchronization signal VD2 may not be completely consistent. The system control unit can control to output the vertical synchronization signal VD2 after a certain time has passed since the external synchronization signal VD2 was output.

[0093] (Fourth Modification of Digital Camera According to Embodiment)

[0094] In this modification, the system control unit 11 may operate in the external synchronization mode. In the external synchronization mode, the system control unit 11 makes the second time T2 in the continuous shooting mode coincide with the cycle of the external synchronization signal VD2. Furthermore, the system control unit 11 determines the first time T1 for performing the first synchronization control based on the input timing of the external synchronization signal VD2 for the first time after receiving the continuous shooting instruction.

[0095] Figure 6 Yes means Figure 1 FIG. 1 is a timing chart of the operation in the continuous shooting mode and the first synchronous control in the fourth modified example of the digital camera 100 shown in FIG. Figure 6 The external synchronization signal VD2 is generated at a certain period (second time T2) and input to the system control unit 11.

[0096] exist Figure 6 The vertical synchronization signal VD1 and the driving timing of each pixel row 62 of the imaging element 5 are shown in FIG. Figure 3 Same. Figure 6 In the example, the length of the first time T1 is Figure 3 The example has been changed. Figure 6 In the example, after receiving the shooting instruction, the system control unit 11 outputs the first vertical synchronization signal VD1 at time t1. Then, if the system control unit 11 first receives the input of the external synchronization signal VD2 (time t2) after receiving the shooting instruction, it outputs the second vertical synchronization signal VD1 after receiving the shooting instruction. Figure 6 In the example of FIG. 1 , the time from when the vertical synchronization signal VD1 is first output upon receiving the imaging instruction to when the external synchronization signal VD2 is first input is set as the first time T1 .

[0097] Thus, in the fourth variation, the predetermined time Tx and Figure 3 , but the deviation between the vertical synchronization signal VD1 and the external synchronization signal VD2 for reading the signal can be minimized. Therefore, for example, the processed image of each camera image signal can be instantly displayed on the display surface 22b, so that the camera image can be quickly confirmed. In addition, although the prescribed time Tx is slightly longer, it is shorter than when the second synchronization control is performed, so the shutter lag can be shortened.

[0098] Next, the structure of a smartphone will be described as another embodiment of an electronic device including one embodiment of the imaging device of the present invention.

[0099] Figure 7 FIG. 2 is a diagram showing the appearance of a smartphone 200 as another embodiment of an electronic device including an embodiment of the imaging device of the present invention.

[0100] Figure 7 The illustrated smartphone 200 includes a flat housing 201 , and includes a display panel 202 as a display surface and a display input unit 204 in which an operation panel 203 as an input unit is integrated on one surface of the housing 201 .

[0101] The housing 201 includes a speaker 205, a microphone 206, an operation unit 207, and a camera unit 208. The structure of the housing 201 is not limited thereto, and for example, a display surface and an input unit may be independent, or a foldable structure or a structure having a sliding mechanism may be adopted.

[0102] Figure 8 Yes means Figure 7 FIG. 2 is a block diagram of the structure of the smartphone 200 shown in FIG.

[0103] like Figure 8 As shown, the main components of the smartphone include a wireless communication unit 210, a display input unit 204, a call unit 211, an operation unit 207, a camera unit 208, a recording unit 212, an external input and output unit 213, a GPS (Global Positioning System) receiving unit 214, a motion sensor unit 215, a power supply unit 216 and a main control unit 220.

[0104] Furthermore, as a main function of the smartphone 200 , a wireless communication function of performing mobile wireless communication via a base station device BS (not shown) and a mobile communication network NW (not shown) is provided.

[0105] The wireless communication unit 210 performs wireless communication with the base station device BS in the mobile communication network NW according to the instruction of the main control unit 220. The wireless communication is used to send and receive various file data such as voice data and image data, e-mail data, and receive network data and streaming data.

[0106] The display input unit 204 is a so-called touch panel, which displays images (still images and dynamic images) or character information, etc. under the control of the main control unit 220, thereby transmitting information to the user in a visual manner, and detects the user's operation on the displayed information, and has a display panel 202 and an operation panel 203.

[0107] The display panel 202 uses LCD (Liquid Crystal Display), OELD (Organic Electro-Luminescence Display), or the like as a display device.

[0108] The operation panel 203 is a device that places an image displayed on the display surface of the display panel 202 in a visually recognizable manner and detects one or more coordinates operated by a user's finger or stylus. When the device is operated by the user's finger or stylus, a detection signal generated by the operation is output to the main control unit 220. Then, the main control unit 220 detects the operation position (coordinates) on the display panel 202 based on the received detection signal.

[0109] like Figure 8 As shown, the display panel 202 and the operation panel 203 of the smartphone 200 illustrated as one embodiment of the photographing device of the present invention are integrated to form a display input unit 204 , and the operation panel 203 completely covers the display panel 202 .

[0110] In the case of adopting such a configuration, the operation panel 203 may have a function of detecting user operations in areas other than the display panel 202. In other words, the operation panel 203 may have a detection area for the overlapping portion with the display panel 202 (hereinafter referred to as the display area) and a detection area for the outer edge portion that does not overlap with the display panel 202 (hereinafter referred to as the non-display area).

[0111] In addition, the size of the display area can be completely consistent with the size of the display panel 202, but it is not necessary to make them consistent. In addition, the operation panel 203 can have two sensing areas, an outer edge portion and an inner portion. In addition, the width of the outer edge portion can be appropriately designed according to the size of the frame 201, etc.

[0112] Furthermore, as a position detection method adopted in the operation panel 203, a matrix switch method, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an electrostatic capacitance method, etc. can be cited, and any method can be adopted.

[0113] The call unit 211 includes a speaker 205 or a microphone 206 , which converts the user's voice input through the microphone 206 into voice data that can be processed by the main control unit 220 and outputs it to the main control unit 220 , or decodes the voice data received by the wireless communication unit 210 or the external input / output unit 213 and outputs it from the speaker 205 .

[0114] And, if Figure 7 As shown, for example, the speaker 205 can be mounted on the same surface as the surface on which the display input unit 204 is provided, and the microphone 206 can be mounted on the side surface of the housing 201 .

[0115] The operation unit 207 is a hardware key using a key switch, etc., and receives instructions from the user. Figure 7As shown, the operation unit 207 is a push-button switch mounted on the side of the housing 201 of the smartphone 200. When pressed by a finger or the like, the switch is turned on, and when the finger is released, the switch is turned off by a restoring force of a spring or the like.

[0116] The recording unit 212 records the control program and control data of the main control unit 220, application software, address data that associates the name or telephone number of the communication partner, data of sent and received emails, web data downloaded by browsing the web, downloaded content data, and temporarily records streaming data, etc. The recording unit 212 is composed of an internal recording unit 217 built into the smartphone and an external recording unit 218 having a removable external memory slot.

[0117] In addition, each internal recording unit 217 and external recording unit 218 constituting the recording unit 212 is implemented using storage media such as a flash memory type, a hard disk type, a micro multimedia card type, a card type memory (for example, MicroSD (registered trademark) memory, etc.), RAM (Random Access Memory), or ROM (Read Only Memory).

[0118] The external input / output unit 213 serves as an interface with all external devices connected to the smartphone 200, and is used to directly or indirectly connect to other external devices through communication (e.g., Universal Serial Bus (USB), IEEE1394, etc.) or a network (e.g., the Internet, wireless LAN, Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association: IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee (registered trademark), etc.).

[0119] Examples of external devices connected to the smartphone 200 include wired / wireless headphones, wired / wireless external chargers, wired / wireless data ports, memory cards or SIM (Subscriber Identity Module Card) / UIM (User Identity Module Card) cards connected via a card slot, external audio / video devices connected via audio / video I / O (input / output) terminals, wirelessly connected external audio / video devices, wired / wirelessly connected smartphones, wired / wirelessly connected personal computers, wired / wirelessly connected personal computers, headphones, etc.

[0120] The external input / output unit 213 can transfer data received from such an external device to each component in the smartphone 200 , or can transfer data in the smartphone 200 to an external device.

[0121] The GGPS receiving unit 214 receives GPS signals transmitted from GPS satellites ST1 to STn according to the instruction of the main control unit 220, performs positioning calculation processing based on the received plurality of GPS signals, and detects the position consisting of the latitude, longitude, and altitude of the smartphone 200. When the GPS receiving unit 214 can obtain position information from the wireless communication unit 210 or the external input / output unit 213 (e.g., wireless LAN), it can also detect the position using the position information.

[0122] The motion sensor unit 215 includes, for example, a three-axis acceleration sensor, and detects the physical motion of the smartphone 200 according to the instruction of the main control unit 220. By detecting the physical motion of the smartphone 200, the motion direction or acceleration of the smartphone 200 is detected. The detection result is output to the main control unit 220.

[0123] The power supply unit 216 supplies power stored in a battery (not shown) to each unit of the smartphone 200 in accordance with an instruction from the main control unit 220 .

[0124] The main control unit 220 includes a microprocessor, operates according to the control program and control data recorded in the recording unit 212, and performs overall control of each unit of the smartphone 200. In addition, the main control unit 220 includes a mobile communication control function and an application processing function for controlling each unit of the communication system in order to perform voice communication or data communication through the wireless communication unit 210.

[0125] The application processing function is realized by the main control unit 220 operating according to the application software recorded in the recording unit 212. Examples of the application processing function include an infrared communication function for controlling the external input / output unit 213 to perform data communication with an opposite device, an email function for sending and receiving emails, and a web browsing function for browsing web pages.

[0126] Furthermore, the main control unit 220 has an image processing function such as displaying an image on the display input unit 204 based on image data (still image or moving image data) such as received data or downloaded streaming data.

[0127] The image processing function is a function in which the main control unit 220 decodes the image data and performs image processing on the decoded result to display the image on the display input unit 204 .

[0128] Furthermore, the main control unit 220 performs display control on the display panel 202 and operation detection control for detecting a user operation performed via the operation unit 207 and the operation panel 203 .

[0129] By executing display control, the main control unit 220 displays an icon for starting application software or software keys such as a scroll bar, or displays a window for creating an e-mail.

[0130] The scroll bar refers to a software key for receiving an instruction to move an image display portion, such as a large image that cannot be completely accommodated in the display area of ​​the display panel 202 .

[0131] Furthermore, by executing operation detection control, the main control unit 220 detects user operations through the operation unit 207, receives operations on the above-mentioned icons and input of character strings to the input field of the above-mentioned window through the operation panel 203, or receives scrolling requests for displayed images through the scroll bar.

[0132] In addition, by executing operation detection control, the main control unit 220 has a touch panel control function, which determines whether the operation position of the operation panel 203 is the overlapping part (display area) overlapping with the display panel 202, or the outer edge part (non-display area) that does not overlap with the display panel 202, and controls the sensing area of ​​the operation panel 203 or the display position of the software key.

[0133] Furthermore, the main control unit 220 can also detect a gesture operation on the operation panel 203 and execute a preset function according to the detected gesture operation.

[0134] The gesture operation is not a simple touch operation as in the past, but refers to an operation of drawing a trajectory with a finger or the like, or specifying multiple positions at the same time, or combining these operations to draw a trajectory at at least one of the multiple positions.

[0135] The camera unit 208 includes Figure 1 The digital camera 100 shown includes components other than the external memory control unit 20 , the recording medium 21 , the display device 22 , and the operation unit 14 .

[0136] The captured image data in the RAW format or the JPEG format generated by the camera section 208 can be recorded in the recording section 212 instead of being recorded in the recording medium 21 , or can be output through the external input / output section 213 or the wireless communication section 210 .

[0137] exist Figure 7 In the illustrated smartphone 200 , the camera unit 208 is mounted on the same surface as the display input unit 204 . However, the mounting position of the camera unit 208 is not limited thereto, and the camera unit 208 may be mounted on the back side of the display input unit 204 .

[0138] Furthermore, the camera unit 208 can be used in various functions of the smartphone 200 . For example, an image acquired by the camera unit 208 can be displayed on the display panel 202 , or an image acquired by the camera unit 208 can be used as one of the operation inputs of the operation panel 203 .

[0139] Furthermore, when the GPS receiving unit 214 detects the position, the position can also be detected by referring to the image from the camera unit 208. Furthermore, the image from the camera unit 208 can be referred to to determine the optical axis direction of the camera unit 208 of the smartphone 200 or the current usage environment without using the 3-axis acceleration sensor or using the 3-axis acceleration sensor in combination. Of course, the image from the camera unit 208 can also be used in the application software.

[0140] In addition, the position information obtained by the GPS receiving unit 214, the voice information obtained by the microphone 206 (which can be converted into text information by the main control unit, etc. through voice-to-text conversion), the posture information obtained by the motion sensor unit 215, etc. can be added to the image data of the still image or animation and recorded in the recording unit 212, or output through the external input and output unit 213 or the wireless communication unit 210.

[0141] In the smartphone 200 having the above-described configuration, the shutter time lag can be shortened also in the continuous shooting mode.

[0142] As described above, the following matters are disclosed in this specification.

[0143] (1) An imaging device comprising:

[0144] a control unit that performs a first synchronization control, wherein after receiving an instruction for continuous shooting, the control unit outputs a first synchronization signal at a first moment, outputs a second synchronization signal at a second moment after a first time has passed from the first moment, and outputs the second synchronization signal every time a second time longer than the first time has passed after the second moment; and

[0145] The camera unit starts reading the signal from the imaging element by a rolling shutter method when receiving the input of the second synchronization signal after the second moment, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time at that moment.

[0146] (2) The imaging device according to (1), wherein:

[0147] The first synchronization signal and the second synchronization signal are transmitted through the same signal line.

[0148] (3) The imaging device according to (1) or (2), wherein:

[0149] The control unit selectively performs a second synchronization control and the first synchronization control. The second synchronization control is to output the first synchronization signal after receiving an instruction for continuous shooting, and to output the second synchronization signal every time the second time period elapses after the first synchronization signal is output.

[0150] When the second synchronization control is performed, the camera unit starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the second synchronization signal, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time at that moment.

[0151] (4) The imaging device according to (3), wherein:

[0152] The control unit selects one of the first synchronous control and the second synchronous control according to the exposure time.

[0153] (5) The imaging device according to (4), wherein:

[0154] The control unit performs the first synchronous control when the exposure time becomes equal to or less than a threshold value.

[0155] (6) The imaging device according to (4) or (5), wherein:

[0156] When the continuous shooting has a distribution of exposure times within the light receiving surface of the imaging element, the control unit sets a maximum value of the exposure times within the light receiving surface as the exposure time for selecting the first synchronous control and the second synchronous control.

[0157] (7) The imaging device according to any one of (3) to (6), comprising:

[0158] A flicker detection unit detects flicker,

[0159] When the flicker is detected, the control unit causes the imaging unit to drive the imaging element under a driving condition that prevents image quality degradation caused by the flicker, and performs the second synchronous control.

[0160] (8) The imaging device according to any one of (3) to (6), wherein:

[0161] The control unit performs the second synchronization control in a mode in which the second time is matched with a cycle of an external synchronization signal generated externally.

[0162] (9) The imaging device according to any one of (3) to (6), wherein:

[0163] The control unit determines the first time based on a time when the external synchronization signal is first input after the instruction is received, in a mode in which the second time is matched with a cycle of an external synchronization signal generated externally.

[0164] (10) The imaging device according to any one of (1) to (9), wherein:

[0165] When performing the first synchronous control, the control unit simultaneously resets all pixels of the imaging element during a period from the first time point to the start of first exposure of the imaging element.

[0166] (11) The imaging device according to any one of (1) to (9), wherein:

[0167] When the temperature of the imaging element is below a threshold value and the first synchronous control is performed, the control unit simultaneously resets all pixels of the imaging element during a period from the first time to the start of initial exposure of the imaging element.

[0168] (12) The imaging device according to any one of (1) to (11), wherein:

[0169] The control unit controls the first time according to the exposure time.

[0170] (13) The imaging device according to any one of (1) to (12), wherein:

[0171] The control unit controls a lower limit value of a time obtained by subtracting the exposure time from the first time.

[0172] (14) The imaging device according to (13), wherein:

[0173] The control unit controls the lower limit value according to a processing load.

[0174] (15) The imaging device according to (13), wherein:

[0175] The control unit controls the lower limit value according to a processing load of the imaging unit.

[0176] (16) A method for photographing, comprising:

[0177] a control step of performing a first synchronization control, wherein after receiving an instruction for continuous shooting, the first synchronization control is to output a first synchronization signal at a first moment, output a second synchronization signal at a second moment after a first time has passed from the first moment, and output the second synchronization signal every time a second time longer than the first time has passed after the second moment; and

[0178] The photographing step starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the above-mentioned second synchronization signal after the above-mentioned second moment, and starts exposing the above-mentioned imaging element by a rolling shutter method at a moment before the exposure time of this moment.

[0179] (17) The imaging method according to (16), wherein:

[0180] The first synchronization signal and the second synchronization signal are transmitted through the same signal line.

[0181] (18) The imaging method according to (16) or (17), wherein:

[0182] In the control step, the second synchronization control and the first synchronization control are selectively performed, wherein the second synchronization control is to output the first synchronization signal after receiving an instruction for continuous shooting, and to output the second synchronization signal every second time after the first synchronization signal is output.

[0183] In the above-mentioned video recording step, when the above-mentioned second synchronization control is performed, at the moment of receiving the input of the above-mentioned second synchronization signal, the signal from the above-mentioned imaging element is started to be read by a rolling shutter method, and at a moment before the exposure time at that moment, the exposure of the above-mentioned imaging element is started by a rolling shutter method.

[0184] (19) The imaging method according to (18), wherein:

[0185] In the control step, any one of the first synchronous control and the second synchronous control is selected according to the exposure time.

[0186] (20) The imaging method according to (19), wherein:

[0187] In the control step, when the exposure time becomes equal to or less than a threshold value, the first synchronous control is performed.

[0188] (21) The imaging method according to (19) or (20), wherein:

[0189] When the continuous shooting has a distribution of exposure time within the light receiving surface of the imaging element, in the control step, the maximum value of the exposure time within the light receiving surface is set as the exposure time for selecting the first synchronous control and the second synchronous control.

[0190] (22) The imaging method according to any one of (18) to (21), wherein:

[0191] comprising a flicker detection step of detecting flicker,

[0192] In the control step, when the flicker is detected, the imaging element is driven under a driving condition that prevents image quality degradation caused by the flicker, and the second synchronous control is performed.

[0193] (23) The imaging method according to any one of (18) to (21), wherein:

[0194] In the control step, the second synchronization control is performed in a mode in which the second time coincides with a cycle of an external synchronization signal generated outside a control unit that performs the control step.

[0195] (24) The imaging method according to any one of (18) to (21), wherein:

[0196] In the control step, in a mode in which the second time is matched with a cycle of an external synchronization signal generated outside a control unit that performs the control step, the first time is determined based on a time of input of the external synchronization signal first after the instruction is received.

[0197] (25) The imaging method according to any one of (16) to (24), wherein:

[0198] In the control step, when the first synchronous control is performed, all pixels of the imaging element are reset simultaneously during a period from the first time to the start of first exposure of the imaging element.

[0199] (26) The imaging method according to any one of (16) to (24), wherein:

[0200] In the above control step, when the temperature of the above imaging element is below a threshold value and when the above first synchronous control is performed, all pixels of the above imaging element are reset simultaneously during the period from the above first moment to the start of initial exposure of the above imaging element.

[0201] (27) The imaging method according to any one of (16) to (26), wherein:

[0202] In the control step, the first time is controlled according to the exposure time.

[0203] (28) The imaging method according to any one of (16) to (27), wherein:

[0204] In the control step, a lower limit value of a time obtained by subtracting the exposure time from the first time is controlled.

[0205] (29) The imaging method according to (28), wherein:

[0206] In the control step, the lower limit value is controlled according to a processing load of a control unit that performs the control step.

[0207] (30) The imaging method according to (28), wherein:

[0208] In the control step, the lower limit value is controlled according to a processing load of an imaging unit that performs the imaging step.

[0209] (31) A camera program for causing a computer to execute the following steps:

[0210] a control step of performing a first synchronization control, wherein after receiving an instruction for continuous shooting, the first synchronization control is to output a first synchronization signal at a first moment, output a second synchronization signal at a second moment after a first time has passed from the first moment, and output the second synchronization signal every time a second time longer than the first time has passed after the second moment; and

[0211] The photographing step starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the above-mentioned second synchronization signal after the above-mentioned second moment, and starts exposing the above-mentioned imaging element by a rolling shutter method at a moment before the exposure time of this moment.

[0212] In the above, various embodiments are described with reference to the accompanying drawings, but the present invention is certainly not limited to these examples. Obviously, those skilled in the art can think of various variations or modifications within the scope of the claims, and these examples certainly also belong to the technical scope of the present invention. Moreover, the various constituent elements in the above embodiments may also be arbitrarily combined without departing from the scope of the present invention.

[0213] In addition, the present application claims are based on Japanese patent application (Japanese Patent Application No. 2019-154882) filed on August 27, 2019, the contents of which are incorporated herein by reference.

[0214] Explanation of symbols

[0215] 100-digital camera, 100A-main body, 40-lens device, 1-camera lens, 2-aperture, 4-lens control unit, 8-lens driving unit, 9-aperture driving unit, 50-camera unit, 5-imaging element, 10-imaging element driving unit, 60-camera surface, 61-pixel, 62-pixel row, 63-driving circuit, 64-signal processing circuit, 11-system control unit, 14-operating unit, 15-memory control unit, 16-memory, 17-digital signal processing unit, 20-external memory control unit, 21-recording medium, 22-display device, 22a-display controller, 22b-display surface, 24-control bus, 25-data bus, RR, RS, GR-straight line, EX -Exposure time, Tx, Ty, Tz-specified time, T1-first time, T2-second time, VD1-vertical synchronization signal, VD2-external synchronization signal, 200-smartphone, 201-frame, 202-display panel, 203-operation panel, 204-display input unit, 205-speaker, 206-microphone, 207-operation unit, 208-camera unit, 210-wireless communication unit, 211-call unit, 212-recording unit, 213-external input and output unit, 214-GPS receiving unit, 215-motion sensor unit, 216-power supply unit, 217-internal recording unit, 218-external recording unit, 220-main control unit, ST1~STn-GPS satellites.

Claims

1. A camera device comprising: a control unit that performs a first synchronization control, wherein after receiving an instruction for continuous shooting, the first synchronization control outputs a first synchronization signal at a first moment, outputs a second synchronization signal at a second moment after a first time has passed from the first moment, and outputs the second synchronization signal every time a second time longer than the first time has passed after the second moment; and The camera unit starts reading the signal from the imaging element by a rolling shutter method when receiving the second synchronization signal input after the second moment, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time at this moment.

2. The imaging device according to claim 1, wherein: The first synchronization signal and the second synchronization signal are transmitted through the same signal line.

3. The imaging device according to claim 1 or 2, wherein: The control unit selectively performs a second synchronization control and the first synchronization control, wherein the second synchronization control outputs the first synchronization signal after receiving an instruction for continuous shooting, and outputs the second synchronization signal every time the second time elapses after the first synchronization signal is output, When the second synchronization control is performed, the camera unit starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the second synchronization signal, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time at that moment.

4. The imaging device according to claim 3, wherein: The control unit selects one of the first synchronous control and the second synchronous control according to the exposure time.

5. The imaging device according to claim 4, wherein: The control unit performs the first synchronous control when the exposure time becomes equal to or less than a threshold value.

6. The imaging device according to claim 4 or 5, wherein: When the continuous shooting has a distribution of exposure times within the light receiving surface of the imaging element, the control unit sets the maximum value of the exposure time within the light receiving surface as the exposure time for selecting the first synchronous control and the second synchronous control.

7. The imaging device according to claim 3, comprising: A flicker detection unit detects flicker, When the flicker is detected, the control section causes the imaging section to drive the imaging element under a driving condition that prevents image quality degradation caused by the flicker, and performs the second synchronous control.

8. The imaging device according to claim 3, wherein: The control unit performs the second synchronization control in a mode in which the second time is matched with a cycle of an external synchronization signal generated externally.

9. The imaging device according to claim 3, wherein: The control unit determines the first time based on a time when the continuous shooting instruction is received and a time when the external synchronization signal is first input after the continuous shooting instruction is received, in a mode in which the second time is matched with a cycle of an external synchronization signal generated externally.

10. The imaging device according to any one of claims 1, 2, 4, 5, 7, 8, and 9, wherein: When performing the first synchronous control, the control unit simultaneously resets all pixels of the imaging element during a period from the first time point to the start of first exposure of the imaging element.

11. The imaging device according to any one of claims 1, 2, 4, 5, 7, 8, and 9, wherein: When the temperature of the imaging element is equal to or lower than a threshold value and when the first synchronous control is performed, the control unit simultaneously resets all pixels of the imaging element during a period from the first time to the start of initial exposure of the imaging element.

12. The imaging device according to any one of claims 1, 2, 4, 5, 7, 8, and 9, wherein: The control unit controls the first time according to the exposure time.

13. The imaging device according to any one of claims 1, 2, 4, 5, 7, 8, and 9, wherein: The control unit controls a lower limit value of a time obtained by subtracting the exposure time from the first time.

14. The imaging device according to claim 13, wherein: The control unit controls the lower limit value according to a processing load.

15. The imaging device according to claim 13, wherein: The control unit controls the lower limit value according to a processing load of the imaging unit.

16. A camera method, comprising: A control step of performing a first synchronization control, wherein the first synchronization control outputs a first synchronization signal at a first moment after receiving an instruction for continuous shooting, outputs a second synchronization signal at a second moment after a first time has passed from the first moment, and outputs the second synchronization signal after the second moment every time a second time longer than the first time has passed; and The photographing step starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the second synchronization signal after the second moment, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time of the moment.

17. The imaging method according to claim 16, wherein: The first synchronization signal and the second synchronization signal are transmitted through the same signal line.

18. The imaging method according to claim 16 or 17, wherein: In the control step, a second synchronization control and the first synchronization control are selectively performed, wherein the second synchronization control outputs the first synchronization signal after receiving an instruction for continuous shooting, and outputs the second synchronization signal every second time after the first synchronization signal is output, In the video recording step, when the second synchronization control is performed, at the moment of receiving the input of the second synchronization signal, the signal from the imaging element is started to be read by a rolling shutter method, and at a moment before the exposure time at that moment, the exposure of the imaging element is started by a rolling shutter method.

19. The imaging method according to claim 18, wherein: In the control step, any one of the first synchronous control and the second synchronous control is selected according to the exposure time.

20. The imaging method according to claim 19, wherein: In the control step, when the exposure time becomes equal to or less than a threshold value, the first synchronous control is performed.

21. The imaging method according to claim 19 or 20, wherein: In a case where the continuous shooting has a distribution of exposure times within the light receiving surface of the imaging element, in the control step, the maximum value of the exposure time within the light receiving surface is set as the exposure time for selecting the first synchronous control and the second synchronous control.

22. The imaging method according to claim 18, wherein: comprising a flicker detection step of detecting flicker, In the control step, when the flicker is detected, the imaging element is driven under a driving condition that prevents image quality degradation caused by the flicker, and the second synchronization control is performed.

23. The imaging method according to claim 18, wherein: In the control step, the second synchronization control is performed in a mode in which the second time is matched with a cycle of an external synchronization signal generated outside a control unit that performs the control step.

24. The imaging method according to claim 18, wherein: In the control step, in a mode that makes the second time consistent with the period of an external synchronization signal generated outside the control unit that performs the control step, the first time is determined based on the time when the instruction for continuous shooting is received and the time when the external synchronization signal is first input after the instruction for continuous shooting is received.

25. The imaging method according to any one of claims 16, 17, 19, 20, 22, 23, and 24, wherein: In the control step, when the first synchronous control is performed, all pixels of the imaging element are reset simultaneously during a period from the first time to the start of first exposure of the imaging element.

26. The imaging method according to any one of claims 16, 17, 19, 20, 22, 23, and 24, wherein: In the control step, when the temperature of the imaging element is below a threshold value and when the first synchronous control is performed, all pixels of the imaging element are reset simultaneously during the period from the first moment to the start of initial exposure of the imaging element.

27. The imaging method according to any one of claims 16, 17, 19, 20, 22, 23, and 24, wherein: In the control step, the first time is controlled according to the exposure time.

28. The imaging method according to any one of claims 16, 17, 19, 20, 22, 23, and 24, wherein: In the control step, a lower limit value of a time obtained by subtracting the exposure time from the first time is controlled.

29. The imaging method according to claim 28, wherein: In the control step, the lower limit value is controlled according to a processing load of a control unit that performs the control step.

30. The imaging method according to claim 28, wherein: In the control step, the lower limit value is controlled according to a processing load of an imaging unit that performs the imaging step.

31. A storage medium storing a camera program, wherein the camera program is used to cause a computer to execute the following steps: a control step of performing a first synchronization control, wherein the first synchronization control outputs a first synchronization signal at a first moment after receiving an instruction for continuous shooting, outputs a second synchronization signal at a second moment after a first time has passed from the first moment, and outputs the second synchronization signal after the second moment every time a second time longer than the first time has passed; and The photographing step starts reading the signal from the imaging element by a rolling shutter method at the moment of receiving the input of the second synchronization signal after the second moment, and starts exposing the imaging element by a rolling shutter method at a moment before the exposure time of the moment.

Images