Imaging device and control method thereof

Abstract

To provide an imaging apparatus that maintains a constant update interval of a display in photographing a still image during capturing of moving images, and a method for controlling the same.SOLUTION: An imaging apparatus comprises: an image pickup device 107 that reads image data of LV images and image data of a still image from a pixel array, converts the image data of the still image read based on an instruction signal to start reading image data of a still image into image data with a third resolution, and can output the image data of the LV images and the image data with the third resolution; a DSP 108 that generates image data for display based on the pieces of image data output from the image pickup device; a RAM 109 that holds the image data for display; and a display 114 that displays the image data for display. A method controls a holding time during which the RAM holds an image for display to make equal the time from the start of a frame until when the display 114 starts display of the image data of the LV images and the time from the start of the frame until when the display starts display of the image data with the third resolution.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus and a control method thereof. [Background technology]

[0002] Conventionally, when taking a still image while taking a video in an imaging device, it was necessary to interrupt the video shooting and read out the image data of the "still image." Patent Document 1 discloses an imaging device that converts the image data of the "still image" into image data of the "video" and displays it. This proposed an imaging device that does not require interrupting video shooting even when taking a still image during video shooting. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-129321 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional technology disclosed in Patent Document 1 has a problem in that there is a time difference between the time from the start of a video frame to the start of displaying the video image data, and the time from the start of a still image frame to the start of displaying the image data obtained by converting the image data of the still image into a video size. When taking a still image while taking a video, the update interval of the display unit may not be kept constant. In this case, there is a problem in that the user feels that the screen is sluggish when the update interval of the display unit is extended.

[0005] An object of the present invention is to provide an imaging device that can keep the update interval of the display constant even when still images are captured during moving image capture, and a control method thereof. [Means for solving the problem]

[0006] In order to achieve the above object, an imaging device of the present invention is an imaging device having a live view function, comprising: a pixel array in which a plurality of photoelectric conversion elements are arranged in a matrix; 1st for video Image data and 2nd for still images a readout unit capable of reading out image data from the pixel array; Second an operation unit that issues an instruction signal indicating a start of reading of image data; 2nd for still images Image data, 3rd for video Convert to image data Change A conversion unit and the read out No. 1 Image data; Third an output unit capable of outputting image data; The first Image data or the third image data a generating unit that generates display image data based on the display image data, a storage unit that stores the display image data, and a display unit that displays the display image data, by The display image data of By controlling the hold time, the No. 1 The time from the start of a frame to the start of displaying the image data on the display unit. Third The present invention is characterized in that the time until the display of the image data by the display unit is started is made equal. Effect of the Invention

[0007] According to the present invention, it is possible to provide an imaging device capable of keeping the update interval of the display unit constant when capturing a still image during video capture. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a configuration diagram showing an example of the configuration of an imaging device according to each embodiment of the present invention. [Diagram 2] FIG. 2 is a configuration diagram showing an example of the configuration of an image sensor in each embodiment of the present invention. [Diagram 3] 4 is a flowchart showing an imaging operation in the first to third embodiments. [Figure 4] FIG. 11 is an explanatory diagram showing the timing of an imaging operation when the present invention is not implemented. [Diagram 5] FIG. 4 is an explanatory diagram showing the timing of an imaging operation in the first embodiment. [Figure 6] 13 is an explanatory diagram showing the timing of an imaging operation in the second embodiment. [Figure 7] FIG. 13 is an explanatory diagram showing the timing of an imaging operation in the third embodiment. [Figure 8] 13 is a flowchart showing an imaging operation according to a fourth embodiment. [Figure 9] FIG. 13 is an explanatory diagram showing the timing of an imaging operation according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments. First, a first embodiment of the present invention will be described.

[0010] <Imaging device> FIG. 1 is a diagram showing the configuration of an imaging device 1 according to a first embodiment. The imaging device 1 has an imaging optical system 104. The imaging optical system 104 includes a first lens 100, an aperture 101, a second lens 102, and a third lens 103. In FIG. 1, the first lens 100 is disposed at the tip of the imaging optical system 104. The aperture 101 adjusts the aperture diameter to adjust the amount of light during shooting. An aperture actuator 122 drives the aperture 101 to adjust the aperture diameter. The second lens 102 and the third lens 103 are driven by a focus actuator 120 to move forward and backward in the optical axis direction, thereby adjusting the focus of the imaging optical system 104.

[0011] A focal plane shutter 105 and an optical low-pass filter 106 are arranged on the rear side of the imaging optical system 104 in the optical axis direction. The focal plane shutter 105 has a function of adjusting the exposure time when capturing a still image. However, when an electronic shutter is used to adjust the exposure time in slot rolling readout, the exposure time is not adjusted. The optical low-pass filter 106 is used to reduce false colors and moire in the captured image.

[0012] An image sensor 107 is disposed behind the optical low-pass filter 106 in the optical axis direction. The image sensor 107 photoelectrically converts an optical image of a subject formed via the imaging optical system 104 into an electrical signal. The image sensor 107 also has an electronic shutter function and can acquire an image by slot rolling readout.

[0013] The CPU 110 includes a shutter drive circuit 118, a focus drive circuit 119, an aperture drive circuit 121, a DSP 108 (a generator), a RAM 109, a timing pulse generator 111, a display unit 114, a recording medium 115, an operation unit 116, and a ROM 1 1 7 is connected to the timing pulse generating circuit 111. The timing pulse generating circuit 111 is also connected to the image sensor 107 and the display unit 114. The DSP 108 receives image data and performs image processing. The image processing performed by the DSP 108 includes, for example, generating image data for display from image data of a still image. In addition to the image processing, the DSP 108 also calculates control information used to drive the focus lenses (second lens 102, third lens 103) based on information from the image sensor 107.

[0014] The RAM 109 has a function of image data storage means for storing image data processed by the DSP 108, and a function of a work memory when the CPU 110 described later operates. In this embodiment, these functions are realized using the RAM 109, but other types of memory can be used as long as the access speed is sufficiently fast and does not cause any operational problems. In this embodiment, the RAM 109 is disposed outside the DSP 108 and the CPU 110, but some or all of the functions may be built into the DSP 108 or the CPU 110. The ROM 117 records programs for the CPU 110 to control the operations of each unit.

[0015] The CPU 110 performs overall control of the operation of the imaging device 1. The CPU 110 executes a program recorded in the ROM 117 to control each unit of the imaging device 1. The CPU 110 can control reading from the imaging element 107 by performing various settings on the imaging element 107. The CPU 110 also communicates with a timing pulse generating circuit 111 and controls the generation timing of various timing pulses for controlling the operation of each module. The CPU 110 supplies an "imaging system vertical synchronization signal" to the imaging element 107 and a "display system vertical synchronization signal" to the display unit 114. The CPU 110 also has a function of controlling a focus driving circuit 119 to drive a focus actuator 120 and adjust the focus of the imaging optical system 104 using the calculation result output from the DSP 108.

[0016] The shutter driving circuit 118 drives and controls the focal plane shutter 105. The focus driving circuit 119 is a focal position changing means for changing the focal position of the imaging optical system 104, and controls a focus actuator 120 based on the output of the CPU 110. This drives the focus lenses (second lens 102, third lens 103) forward and backward in the optical axis direction to perform focus adjustment. The aperture driving circuit 121 controls an aperture actuator 122 to control the opening of the aperture 101.

[0017] The display unit 114 displays "still images", "moving images", "menus", etc., processed by the DSP 108. The imaging device 1 also has an LV function (live view function) that displays "moving images" processed by the DSP 108 on the display unit 114. By using the displayed moving image as a viewfinder, the user can perform framing to adjust the shooting range of still images and moving images. The display unit 114 may be a rear display or an electronic viewfinder (EVF), etc. Although FIG. 1 shows a configuration with only one display unit 114, both a rear display and an EVF may be provided. The recording medium 115 is a removable recording medium that records image data of "still images" and image data of "moving images". For example, it may be realized by a memory card, etc.

[0018] The operation unit 116 is an operator such as a button or a lever. The user operates the operation unit 116 to control the CPU 110 and perform shooting. The operation unit 116 includes a "still image shooting start button" and a "menu operation button". When the user half-presses the "still image shooting start button", shooting of a "moving image" for distance measurement is performed after a certain time has passed. When the user presses the "still image shooting start button", shooting of a "still image" is performed after a certain time has passed. Furthermore, by continuing to press the button even after shooting of a "still image" has started, continuous shooting of the "still images" is performed. Furthermore, by operating the "menu operation button", shooting conditions can be changed from the menu displayed on the display unit 114.

[0019] <Image sensor> Next, the configuration of the image sensor 107 will be described with reference to Fig. 2(a) and Fig. 2(b). As shown in Fig. 2(a), the photodiode 200 is an element that constitutes a unit pixel 206 under a microlens, and constitutes a photoelectric conversion section. The photoelectric conversion section transfer switch 201 is a switch controlled by a signal "φtx". By setting the value of the signal "φtx" to High (hereinafter "H"), the photoelectric charge accumulated in the photodiode 200 can be transferred to the floating diffusion section 202.

[0020] The reset switch 203 is a switch controlled by a signal "φres" to initialize the floating diffusion section 202. The pixel reset operation is performed by setting both "φtx" and "φres" to "H". This resets the photodiode 200 and the floating diffusion section 202. but Both become the power supply voltage (VDD), and the pixel is reset. The pixel amplifier transistor 204 is connected to a constant current source 209, which will be described later, via a select switch 205 and a vertical output line 208, which will be described later. When the value of the input signal "φsel" of the select switch 205 becomes "H", the pixel amplifier transistor 204 is connected to the constant current source 209 to form a pixel amplifier. The floating diffusion section 202 is connected to this pixel amplifier. Therefore, the charge transferred from the photodiode 200 to the floating diffusion section 202 is converted by the pixel amplifier into a voltage value according to the amount of charge, and is output to the vertical output line 208 as a pixel signal.

[0021] As shown in FIG. 2(b), the pixel array 207 has a plurality of unit pixels 206 arranged in a matrix. Specifically, "m" unit pixels 206 are arranged in the horizontal direction (row direction) and "n" unit pixels 206 are arranged in the vertical direction (column direction). Here, "m" and "n" are natural numbers. Thus, the pixel array 207 has a plurality of photoelectric conversion elements arranged in a matrix. The driving pulse generating circuit 210 generates pulses for performing reset operations and read operations of the unit pixels 206. The generated pulses are supplied to the pixel driving circuit 212. The vertical scanning circuit 211 selects a specific row to which the pulses generated by the driving pulse generating circuit 210 are supplied, and sets the selected row in the pixel driving circuit 212. The pixel driving circuit 212 supplies the pulses generated by the driving pulse generating circuit 210 to the row selected by the vertical scanning circuit 211. The pixel signals are output to the vertical output line 208 for each row in response to the pulses supplied from the pixel driving circuit 212.

[0022] The constant current source 209 constitutes a source follower circuit in combination with the pixel amplifier transistor 204. The AD conversion circuit 213 converts the analog value output to the vertical output line 208 into a digital value according to the output. Be The pixel signals are selected in order by the horizontal scanning circuit 214 and output to the subsequent stage. The pixel array 207, the vertical output lines 208, the constant current source 209, the drive pulse generating circuit 210, the vertical scanning circuit 211, the pixel drive circuit 212, the AD conversion circuit 213, and the horizontal scanning circuit 214 form a pixel scanning unit 215 (readout unit).

[0023] The resolution conversion circuit 220 (resolution conversion section) generates image data by converting the resolution of the "still image" image data to a "moving image size". The selector 221 selects either "input a" which directly inputs the output from the AD conversion circuit 213, or "input b" which is input via the resolution conversion circuit 220. The data A output section 222 (output section) is an interface which outputs the output of the selector 221 to the outside of the image sensor 107. The data A output section 222 outputs "moving image" image data and image data obtained by converting the resolution of the "still image" image data to a "moving image size" to the outside of the image sensor 107. The data B output section 223 outputs the output from the AD conversion circuit 213 to the outside of the image sensor 107. of 107 This is an interface for outputting to the outside, and outputs image data of a “still image” to the outside of the imaging element 107.

[0024] In this embodiment, the image sensor 107 has two output units in order to output image data of a "still image" to the outside. However, a memory may be built into the image sensor 107, and the image data of the "still image" may be stored in the memory, and the image data of the "still image" may be output at a timing that does not overlap with the output of the image data of the "moving image". With this configuration, the image sensor 107 can have only one output unit.

[0025] The image sensor 107 in this embodiment is capable of performing a plurality of readout methods by changing the driving of the pixel scanning unit 215. For example, in this embodiment, a method is adopted for reading out a "still image" in which the top row of pixels is read out, and then the next row is read out, and this is repeated until the bottom row is read out. Also, a method for reading out a "moving image" is adopted in which the top row of pixels is read out, and then the rows that are skipped by a few rows (for example, two rows) are read out until the bottom row is read out.

[0026] When the image data of the "moving image" is read out in this way, the vertical resolution of the image is reduced, but the reading can be performed at high speed and with low power consumption. Various other reading methods are possible. In this embodiment, circuits other than the pixel array 207 are also built into the image sensor 107, but the circuits other than the pixel array may be provided on a chip separate from the image sensor 107. The resolution of the image data of the live view moving image is lower than that of the image data of the "still image".

[0027] <When this embodiment is not applied> First, referring to Figs. 3 and 4, a process flow in which the update interval of the display unit 114 cannot be kept constant when still images are captured during video capture without applying this embodiment will be described. The process of the flowchart shown in Fig. 3 is executed by the CPU 110 executing a program. At time "T402" in Fig. 4, shooting is started in S300. The shooting may start, for example, immediately after power-on, but is not limited to this. At time "T410", in S320, it is determined whether or not the "still image shooting start button" has been pressed at a predetermined timing. Here, it is determined whether or not the "still image shooting start button" has been pressed at the start of each frame.

[0028] At the start of "frame 0" (when shooting starts at time "T402"), it is determined that the "still image shooting start button" has not been pressed, S320 becomes "NO", and the process proceeds to S340. Similarly, at time "T410", "moving image" is set in S340. CPU 110 sets the image sensor 107 to read out "moving image" image data, and sets DSP 108 to develop "moving image" image data. Furthermore, CPU 110 sets the timing pulse generation circuit 111 to an "imaging system vertical synchronization signal" and a "display system vertical synchronization signal", and sets display unit 114 to display "moving image" image data.

[0029] Furthermore, CPU 110 sets the timing to start reading out the "moving image" image data from RAM 109. To output the "moving image" image data from data A output unit 222, selector 221 of imaging element 107 is set to "input a." The timing to start reading out the "moving image" image data from RAM 109 is set to "tS (time "T412" to time "T414")" after the start of the frame.

[0030] At time "T412", an "imaging system vertical synchronization signal" is issued, and in S341, reading of the "moving image" image data begins. Also at time "T412", the "moving image" image data is developed in S343, and writing of the "moving image" image data to RAM 109 begins in S344. Also at time "T412", a specified time (time "tS" in FIG. 4) is waited in S345. At time "T414", a "display system vertical synchronization signal" is issued, and in S346, reading of the "moving image" image data from RAM 109 begins. Also at time "T414", updating of the display of display unit 114 based on the "moving image" image data begins in S347.

[0031] At time "T420", in S325, it is determined whether or not to continue shooting, and if shooting is to be continued (YES), the process proceeds to S320. On the other hand, if shooting is not to be continued (NO), the process proceeds to S301 and shooting ends. For example, when a menu is displayed on the display unit 114 or the power switch is turned off, it is determined that shooting will not be continued and shooting ends. In this embodiment, in S325, all determinations as to whether or not to continue shooting are made to continue shooting, and the process proceeds to S320.

[0032] At time "T420", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was not pressed at the start of frame 1, and S320 becomes "NO". Thereafter, at time "T424", in S347, updating of the display of the display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T420" to time "T424" is the same as the processing of S340 to S347 from time "T410" to time "T414". However, it is assumed that the "still image shooting start button" is pressed at time "T421" and the pressed state is continued thereafter. At time "T430", it is determined in S325 whether or not to continue shooting, and S325 becomes "YES", and the process proceeds to S320.

[0033] time" T At time "T430", in S320 it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 2 it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES" and the process proceeds to S321. Similarly, at time "T430", in S321 it is determined whether or not the next frame is the first frame to be shot after it is detected that the "still image shooting start button" has been pressed. As frame 3 is the first frame to be shot after it is detected that the "still image shooting start button" has been pressed, S321 becomes "YES" and the process proceeds to S360.

[0034] Similarly, at time "T430", in S360, a "still image" is set. The CPU 110 sets the image sensor 107 to read out the image data of the "still image", and sets the DSP 108 to develop the image data of the "still image". Furthermore, the CPU 110 sets the timing pulse generating circuit 111 to an "imaging system vertical synchronizing signal" and a "display system vertical synchronizing signal", and sets the display unit 114 to display the image data of the "still image".

[0035] Furthermore, CPU 110 sets the timing to start reading out the image data of the "still image" from RAM 109. Selector 221 of imaging element 107 is set to "input b" in order to output the resolution-converted image data of the "still image" from data A output unit 222. The timing to start reading out the image data of the "still image" from RAM 109 is set to "tL=tS+tD (time "T432" to time "T434")" from the start of the frame. "tD" is the latency required to convert the resolution of the "still image" to a moving image size.

[0036] At time "T432", the "imaging system vertical synchronization signal" is issued, and in S361, reading of the image data of the "still image" is started. At time "T433", the resolution of the image data of the "still image" is converted to a moving image size in S362. Next, in S363, the image data of the "still image" is developed, and in S364, writing of the image data of the "still image" to the RAM 109 is started. After that, in S365, waiting for a specified time "tL=tS+tD" is performed. At time "T434", the "display system vertical synchronization signal" is issued, and in S366, reading of the image data of the "still image" from the RAM 109 is started. Similarly, at time "T434", updating of the display of the display unit 114 based on the image data of the "still image" is started in S367. At time "T440", it is determined in S325 whether or not to continue shooting, and S325 becomes "YES", and the process proceeds to S320.

[0037] At time "T440", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. Since the "still image shooting start button" was pressed at the start of the frame of frame 3, S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T440", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 4 is the second frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S323. Similarly, at time "T440", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and since frame 4 is the first frame shot from the last still image shot, S323 becomes "NO", and the process proceeds to S340.

[0038] Thereafter, at time "T444", in S347, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T440" to time "T444" is the same as the processing of S340 to S347 from time "T410" to time "T414". At time "T450", it is determined whether or not to continue shooting in S325, and the result in S325 is "YES", and the process proceeds to S320.

[0039] At time "T450", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 4, it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T450", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 5 is the third frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S323. Similarly, at time "T450", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 5 is the second frame shot from the last still image shot, so S323 becomes "NO", and the process proceeds to S340.

[0040] Thereafter, at time "T454", in S347 updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T450" to time "T454" is the same as the processing of S340 to S347 from time "T410" to time "T414". At time "T460", in S325 it is determined whether or not to continue shooting, and S325 transitions to "YES", proceeding to S320.

[0041] At time "T460", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 5, it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T460", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 6 is the fourth frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S323. Similarly, at time "T460", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 6 is the third frame shot from the last still image shot, so S323 becomes "YES", and the process proceeds to S360.

[0042] Thereafter, at time "T464", in S367 updating of the display on display unit 114 based on the image data of the "still image" is started. The processing of S360 to S367 from time "T460" to time "T464" is the same as the processing of S360 to S367 from time "T430" to time "T434". At time "T470", it is determined whether or not to continue shooting in S325, and the result in S325 is "YES", and the process proceeds to S320. And the processing of S340 to S347 from time "T470" to time "T484" is the same as the processing of S340 to S347 from time "T440" to time "T454".

[0043] At this time, as shown in Figure 4, vertical If the interval between the "sync signals" is "tA", the "display system vertical The interval between the "sync signals" is "tA". vertical The interval of the "synchronization signal" is a mixture of "tA", "tB=tA+tD" and "tC=tA-tD", and the update interval of the display unit 114 cannot be kept constant.

[0044] The embodiment described below is characterized in that the timing of reading out image data of moving images from RAM 109 in "moving image shooting before still image shooting" and "moving image shooting while still image shooting" is changed and controlled in order to keep the update interval of display unit 114 constant.

[0045] First Embodiment FIG. 5 is an explanatory diagram showing the timing of the imaging operation in the first embodiment. With reference to FIG. 3 and FIG. 5, a process flow in the first embodiment for keeping the update interval of the display unit 114 constant when taking a still image during video shooting will be described. The process shown in FIG. 3 is realized by the CPU 110 executing a program.

[0046] At time "T502", shooting is started by S300. This shooting start may be, for example, immediately after power-on, but is not limited to this. At time "T510", in S320, it is determined whether or not the "still image shooting start button" is pressed at a predetermined timing. In this embodiment, it is determined whether or not the "still image shooting start button" is pressed at the start of each frame. At the start of frame 0 (when shooting starts at time "T502"), it is determined that the "still image shooting start button" has not been pressed, the result is "NO" in S320, and the process proceeds to S340. Similarly, at time "T510", "moving image" is set in S340. The CPU 110 sets the image sensor 107 to read out image data of the moving image, and sets the DSP 108 to develop the image data of the moving image.

[0047] Furthermore, the CPU 110 sets the timing pulse generating circuit 111 to an "imaging system vertical synchronizing signal" and a "display system vertical synchronizing signal", and sets the display unit 114 to display image data of the "moving image". The CPU 110 also sets the timing to start reading out the image data of the "moving image" for the RAM 109. In order to output the image data of the "moving image" from the data A output unit 222, the selector 221 of the image sensor 107 is set to "input a". The timing to start reading out the image data of the moving image from the RAM 109 is set to "tL=tS+tD (time "T512" to time "T514")" after the start of the frame. "tD" is the latency required to convert the resolution of the "still image" to the moving image size, and the amount is uniquely determined by the readout time of the "still image" and the image size before and after conversion. For this reason, it can be calculated even during moving image shooting before still image shooting.

[0048] At time "T512", an "imaging system vertical synchronization signal" is issued, and in S341, reading of the "moving image" image data is started. Also at time "T512", in S343, development of the "moving image" image data is performed, and in S344, writing of the "moving image" image data to RAM 109 is started. Also at time "T512", in S345, waiting is performed for a specified time "tL=tS+tD". At time "T514", a "display system vertical synchronization signal" is issued, and in S346, reading of the "moving image" image data from RAM 109 is started. Also at time "T514", updating of the display of display unit 114 based on the "moving image" image data is started in S347.

[0049] At time "T520", in S325, it is determined whether or not to continue shooting, and if shooting is to be continued (YES), the process proceeds to S320. On the other hand, if shooting is not to be continued (No), shooting ends in S301. For example, when a menu is displayed on display unit 114 or the power switch is turned off, it is determined that shooting will not be continued and shooting ends. In this embodiment, in S325, all determinations as to whether or not to continue shooting are to continue shooting, and the result in S325 is "YES" and the process proceeds to S320.

[0050] At time "T520", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. At the start of frame 1, it is determined that the "still image shooting start button" was not pressed, so the result in S320 is "NO" and the process proceeds to S340. Thereafter, at time "T524", updating of the display on display unit 114 based on the image data of the moving image in S347 is started. The processing of S340 to S347 from time "T520" to time "T524" is the same as the processing of S340 to S347 from time "T510" to time "T514". However, at time "T521", the "still image shooting start button" is pressed, and thereafter, the pressed state is continued. At time "T530", in S325, it is determined whether or not to continue shooting. The result in S325 is "YES", and the process proceeds to S320.

[0051] At time "T530", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 2, the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T530", in S321, it is determined whether or not the next frame is the first frame to be shot after the pressing of the "still image shooting start button" is detected. Since frame 3 is the first frame to be shot after the pressing of the "still image shooting start button" is detected, S321 becomes "YES", and the process proceeds to S360. Similarly, at time "T530", "still image" is set in S360. The CPU 110 sets the image sensor 107 to read out the image data of the "still image", and sets the DSP 108 to develop the image data of the still image.

[0052] Furthermore, the CPU 110 sets the "imaging system vertical synchronizing signal" and the "display system vertical synchronizing signal" for the timing pulse generating circuit 111, and sets the display unit 114 to display the image data of the "still image". The CPU 110 also sets the timing to start reading the image data of the "still image" for the RAM 109. In order to output the image data of the "still image" whose resolution has been converted from the data A output unit 222, the selector 221 of the imaging element 107 is set to "input b". The timing to start reading the image data of the still image from the RAM 109 is set to "tL=tS+tD (time "T532" to time "T534")" after the start of the frame. "tD" is the latency required for converting the resolution of the "still image" to a moving image size.

[0053] At time "T532", an "imaging system vertical synchronization signal" is issued, and in S361, reading of the "still image" image data is started. At time "T533", resolution conversion to a moving image size of the "still image" image data is performed in S362. Next, in S363, development of the "still image" image data is performed, and in S364, writing of the "still image" image data to RAM 109 is started. Also at time "T533", waiting is performed for a specified time "tL=tS+tD" in S365. At time "T534", a "display system vertical synchronization signal" is issued, and in S366, reading of the "still image" image data from RAM 109 is started. Also at time "T534", updating of the display of display unit 114 based on the "still image" image data is started in S367. At time "T540", in S325, it is determined whether or not to continue shooting. The result in S325 is "YES", and the process proceeds to S320.

[0054] At time "T540", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. Since the "still image shooting start button" has been pressed at the start of frame 3, S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T540", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 4 is the second frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S340. Similarly, at time "T540", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 4 is the first frame shot from the last still image shot, so S323 becomes "NO", and the process proceeds to S340.

[0055] Thereafter, at time "T544", in S347, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T540" to time "T542" is the same as the processing of S340 to S347 from time "T510" to time "T512". At time "T550", it is determined whether or not to continue shooting in S325, and the result in S325 is "YES", and the process proceeds to S320.

[0056] At time "T550", in S320, it is determined whether or not the "still image shooting start button" is pressed at the start of the frame. Since the "still image shooting start button" is pressed at the start of the frame of frame 4, the result is "YES" in S320, and the process proceeds to S321. Similarly, at time "T550", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 5 is the third frame shot after the pressing of the "still image shooting start button" is detected, the result is "NO" in S321, and the process proceeds to S323. Similarly, at time "T550", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 5 is the second frame shot from the last still image shot, so the result is "NO" in S323, and the process proceeds to S340.

[0057] Thereafter, at time "T554", in S347 updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T550" to time "T554" is the same as the processing of S340 to S347 from time "T510" to time "T514". At time "T560", in S325 it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320.

[0058] At time "T560", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. Since the "still image shooting start button" was pressed at the start of the frame of frame 5, the result is "YES" in S320, and the process proceeds to S321. Similarly, at time "T560", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 6 is the fourth frame shot after the pressing of the "still image shooting start button" is detected, the result is "NO" in S321, and the process proceeds to S323. Similarly, at time "T560", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 6 is the third frame shot from the last still image shot, so the result is "YES" in S323, and the process proceeds to S360.

[0059] Thereafter, at time "T564", in S367, updating of the display on display unit 114 based on image data of a still image is started. The processes of S360 to S367 from time "T560" to time "T564" are the same as the processes of S360 to S367 from time "T530" to time "T534". At time "T570", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320. And the processes of S340 to S347 from time "T570" to time "T584" are the same as the processes of S340 to S347 from time "T540" to time "T554".

[0060] According to this embodiment, as shown in FIG. vertical If the interval between the "sync signals" is "tA", the "display system vertical The interval between the "sync signals" is "tA", and the "display system" during still image shooting verticalThe interval between the "synchronization signal" is also "tA". As a result, the update interval of the display unit 114 can be kept constant. Note that, although this embodiment deals with the control of "video" and "still image" before and after pressing the "still image shooting start button", the scope of application is not limited to this. For example, the processing in this embodiment can be applied to the control of the "first video (LV image)" before the button is half-pressed and the "second video (still image)" during the half-press in the distance measurement operation when the "still image shooting start button" is half-pressed.

[0061] According to this embodiment, a configuration can be adopted in which an instruction to start reading out image data of a still image (image data of the second resolution) is given based on the start of still image shooting by the operation unit 116. Also, a configuration can be adopted in which an instruction to start reading out image data of a still image is given based on the start of a distance measurement operation by the operation unit 116.

[0062] <Second embodiment> In the first embodiment, the update interval of the display unit 114 before and during still image shooting is kept constant, making it difficult for the user to recognize that still image shooting has started. In the second embodiment, an example will be described in which an "alternative image" in which the brightness of the image data of the "still image" is reduced in the first frame of still image shooting is displayed on the display unit 114 to make it easier for the user to recognize that still image shooting has started.

[0063] The second embodiment has the same configuration as the first embodiment with respect to Fig. 1, Fig. 2(a) and Fig. 2(b). Whether or not to display an "alternative image" in the first frame of still image shooting may be determined by, for example, referring to a value set by the user from a menu. The operation when an "alternative image" is not displayed in the first frame of still image shooting is the same as in the first embodiment.

[0064] Fig. 6 is an explanatory diagram showing the timing of the imaging operation of the second embodiment. The flow of the process of this embodiment for displaying an "alternative image" in the first frame of still image shooting will be described with reference to Figs. 3 and 6. The process shown in Fig. 3 is realized by the CPU 110 executing a program.

[0065] At time "T602", shooting is started in S300. This shooting may start immediately after power-on, but is not limited to this. Here, the processing of S340 to S347 from time "T610" to time "T624" is the same as the processing of S340 to S347 from time "T510" to time "T524" in the first embodiment. At time "T630", in S325, it is determined whether or not shooting is to be continued, and the result of S325 is "YES", and the process proceeds to S32. At time "T630", in S320, it is determined whether or not the "still image shooting start button" has been pressed at a predetermined timing. In this embodiment, it is determined whether or not the "still image shooting start button" has been pressed at the start of each frame. Since the "still image shooting start button" has been pressed at the start of frame 2, the result of S320 is "YES", and the process proceeds to S321.

[0066] Similarly, at time "T630", in S321, it is determined whether the next frame is the first frame to be shot after detecting pressing of the "still image shooting start button". Since frame 3 is the first frame to be shot after detecting pressing of the "still image shooting start button", the result is "YES" in S321 and the process proceeds to S360. Similarly, at time "T630", in S360, "still image" is set. CPU 110 sets the image sensor 107 to read out image data of the "still image", and sets the DSP 108 to develop image data of the still image. Furthermore, CPU 110 sets the timing pulse generating circuit 111 to an "imaging system vertical synchronization signal" and a "display system vertical synchronization signal", and sets the display unit 114 to display image data of the "still image".

[0067] Furthermore, the CPU 110 sets the timing to start reading out the image data of the "still image" from the RAM 109. The selector 221 of the imaging element 107 is set to "input b" in order to output the image data of the "still image" whose resolution has been converted from the data A output unit 222. The timing to start reading out the image data of the "still image" from the RAM 109 is set to "tL=tS+tD (time "T632" to time "T634")" from the start of the frame. "tD" is the latency required to convert the resolution of the "still image" to a moving image size. Furthermore, for this frame only, when developing the image data of the "still image" whose resolution has been converted to a moving image size, for example, a process of reducing brightness is added, so that the substitute image data is developed as the image data of the "still image".

[0068] At time "T632", reading of the "still image" image data begins in S361 together with the issuance of an "imaging system vertical synchronization signal". At time "T633", resolution conversion of the "still image" image data to a video size is performed in S362. At time "T633", in developing the "still image" image data in S363, substitute image data is developed as the "still image" image data. At time "T633", writing of the "still image" image data to RAM 109 begins in S364, and then in S365, waiting is performed for a specified time "tL=tS+tD".

[0069] At time "T634", a "display system vertical synchronization signal" is issued, and at the same time, in S366, reading of the image data of the "still image" from RAM 109 is started. Similarly, at time "T634", updating of the display of display unit 114 based on the image data of the "still image" is started in S367. At time "T640", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320. Here, the processing of S340 to S347 from time "T640" to time "T654" is the same as the processing of S340 to S347 from time "T540" to time "T554" in the first embodiment.

[0070] At time "T660", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. Since the "still image shooting start button" was pressed at the start of the frame of frame 5, the result is "YES" in S320, and the process proceeds to S321. Similarly, at time "T660", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 6 is the fourth frame shot after the pressing of the "still image shooting start button" is detected, the result is "NO" in S321, and the process proceeds to S323. Similarly, at time "T660", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 6 is the third frame shot from the last still image shot, so the result is "YES" in S323, and the process proceeds to S360.

[0071] Thereafter, at time "T664", in S367, updating of the display on the display unit 114 based on the image data of the "still image" is started. The processing of S360 to S367 from time "T660" to time "T664" is the processing of S360 to S367 from time "T630" to time "T634" except for the processing of generating substitute image data from the image data of the "still image". At time "T670", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320. And the processing of S340 to S347 from time "T670" to time "T684" is the same as the processing of S340 to S347 from time "T570" to time "T584" in the first embodiment.

[0072] According to this embodiment, as shown in FIG. vertical If the interval between the "sync signals" is "tA", the "display system vertical The interval between the "sync signals" is "tA", and the "display system" during still image shooting verticalThe interval between the "synchronization signals" is also "tA". As a result, the update interval of the display unit 114 can be kept constant. Furthermore, by displaying an "alternative image" in the first frame of still image capture, it is possible to make it easier for the user to recognize that still image capture has started.

[0073] In the present embodiment, an example has been shown in which the first frame of still image shooting after pressing the "still image shooting start button" is replaced with an "alternative image", but another frame of still image shooting after pressing the "still image shooting end button" may be replaced with an "alternative image". Furthermore, a frame of video shooting after pressing the "still image shooting end button" may be replaced with an "alternative image". In addition, an example has been shown in which the brightness of image data is reduced as an "alternative image", but the image data in the frame may be replaced with a fixed pattern image such as a black image that is unrelated to the image data.

[0074] In this embodiment, the substitute image data can be displayed on the display unit 114 in a predetermined frame after the timing of an instruction from the operation unit 116. In addition to using image data in which the luminance of the image data in the predetermined frame has been changed as the substitute image data, it is also possible to use image data unrelated to the image data in the predetermined frame as the substitute image data.

[0075] <Third embodiment> In the first embodiment, when shooting a moving image before shooting a still image, there is a large delay in the time until image data is displayed on the display unit 114, which may cause inconvenience when tracking a fast-moving subject and starting still image shooting. In the third embodiment, an example will be described in which emphasis is placed on subject tracking in shooting a moving image before shooting a still image, and a constant display update interval is maintained while suppressing the delay in the time until image data is displayed on the display unit 114. Note that the third embodiment has the same configuration as the first embodiment with respect to Figs. 1, 2(a) and 2(b).

[0076] Whether or not to suppress the delay in time until image data is displayed on display unit 114 when shooting a moving image before shooting a still image may be determined by, for example, referring to a value set by the user from a menu. The operation in the case where a delay in time until image data is displayed on display unit 114 when shooting a moving image before shooting a still image is permitted is similar to that in the first embodiment.

[0077] Fig. 7 is an explanatory diagram showing the timing of the imaging operation in the third embodiment. A process flow for suppressing a delay in time until image data is displayed on the display unit 114 in moving image shooting before still image shooting will be described with reference to Figs. 3 and 7. The process shown in Fig. 3 is realized by CPU 110 executing a program.

[0078] At time "T702", shooting is started in S300. This shooting may start immediately after power-on, but is not limited to this. At time "T710", in S320, it is determined whether or not the "still image shooting start button" is pressed at a predetermined timing. In this embodiment, it is determined whether or not the "still image shooting start button" is pressed at the start of each frame. At the start of frame 0 (at the start of shooting at time "T702"), it is determined that the "still image shooting start button" was not pressed, so the result in S320 is "NO", and the process proceeds to S340. Similarly, at time "T710", "moving image" is set in S340. The CPU 110 sets the image sensor 107 to read out image data of the moving image, and sets the DSP 108 to develop the image data of the moving image.

[0079] Furthermore, the CPU 110 sets an "imaging system vertical synchronizing signal" and a "display system vertical synchronizing signal" for the timing pulse generating circuit 111, and sets the display unit 114 to display the image data of the "moving image". The CPU 110 also sets the timing to start reading out the image data of the "moving image" for the RAM 109. In order to output the image data of the "moving image" from the data A output unit 222, the selector 221 of the image sensor 107 is set to "input a". The timing to start reading out the image data of the moving image from the RAM 109 is set to "tS (time "T712" to time "T714")" after the start of the frame.

[0080] At time "T712", an "imaging system vertical synchronization signal" is issued, and in S341, reading of the "moving image" image data is started. Also at time "T712", in S343, development of the "moving image" image data is performed, and in S344, writing of the "moving image" image data to RAM 109 is started. After starting, in S345, waiting is performed for a specified time "tS". At time "T714", a "display system vertical synchronization signal" is issued, and in S346, reading of the "moving image" image data from RAM 109 is started. Also at time "T714", updating of the display of display unit 114 based on the "moving image" image data is started in S347. At time "T720", in S325, it is determined whether or not shooting should be continued, and if shooting is to be continued (Yes), the process proceeds to S320.

[0081] On the other hand, if shooting is not to be continued (No), shooting ends in S301. For example, when a menu is displayed on the display unit 114 or when the power switch is turned off, it is determined that shooting is not to be continued and shooting ends. In this embodiment, all determinations as to whether or not to continue shooting in S325 are to continue shooting, and S325 becomes "YES", and the process proceeds to S320.

[0082] At time "T720", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was not pressed at the start of frame 1, so the result in S320 is "NO" and the process proceeds to S340. Thereafter, at time "T724", in S347, updating of the display of display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T720" to time "T724" is the same as the processing of S340 to S347 from time "T710" to time "T714". However, it is assumed that the "still image shooting start button" is pressed at time "T721" and continues to be pressed until time "T761". At time "T730", in S325, it is determined whether or not to continue shooting. The result in S325 is "YES", and the process proceeds to S320.

[0083] At time "T730", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 2, it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T730", in S321, it is determined whether or not the next frame is the first frame to be shot after the pressing of the "still image shooting start button" is detected. Since frame 3 is the first frame to be shot after the pressing of the "still image shooting start button" is detected, S321 becomes "YES", and the process proceeds to S360. Similarly, at time "T730", the "still image" setting is performed in S360. The CPU 110 sets the image sensor 107 to read image data of the still image, and sets the DSP 108 to develop the image data of the still image.

[0084] Furthermore, the CPU 110 sets the "imaging system vertical synchronizing signal" and the "display system vertical synchronizing signal" for the timing pulse generating circuit 111, and sets the display unit 114 to display the image data of the "still image". The CPU 110 also sets the timing to start reading out the image data of the "still image" for the RAM 109. In order to output the image data of the still image with the resolution conversion from the data A output unit 222, the selector 221 of the imaging element 107 is set to "input b". The timing to start reading out the image data of the "still image" from the RAM 109 is set to "tL=tS+tD (time "T732" to time "T734")" after the start of the frame. "tD" is the latency required for the resolution conversion of the "still image" to the moving image size.

[0085] At time "T732", an "imaging system vertical synchronization signal" is issued, and in S361, reading of the image data of the "still image" is started. At time "T733", resolution conversion to a moving image size of the image data of the "still image" is performed in S362, and the image data of the "still image" is developed in S363. Furthermore, writing of the image data of the "still image" to the RAM 109 is started in S364, and then waiting for a specified time "tL=tS+tD" is performed in S365. At time "T734", reading of the image data of the "still image" from the RAM 109 is started in S366, and in the same manner, at time "T734", updating of the display of the display unit 114 based on the image data of the "still image" is started in S367. At time "T740", a determination is made in S325 as to whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320.

[0086] At time "T740", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 3, it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T740", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 4 is the second frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S323. Similarly, at time "T740", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 4 is the first frame shot from the last still image shot, so S323 becomes "NO", and the process proceeds to S340.

[0087] Thereafter, at time "T744", in S347, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T740" to time "T744" is the same as the processing of S340 to S347 from time "T710" to time "T714", except that the timing at which reading of the moving image data starts is changed to "tL=tS+tD" from the start of the frame. At time "T750", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320.

[0088] At time "T750", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 4, it is determined that the "still image shooting start button" has been pressed, so S320 becomes "YES", and the process proceeds to S321. Similarly, at time "T750", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 5 is the third frame shot after the pressing of the "still image shooting start button" is detected, S321 becomes "NO", and the process proceeds to S323. Similarly, at time "T750", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 5 is the second frame shot from the last still image shot, so S323 becomes "NO", and the process proceeds to S340.

[0089] Thereafter, at time "T754", in S347, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S340 to S347 from time "T750" to time "T754" is the same as the processing of S340 to S347 from time "T710" to time "T714", except that the timing at which reading of the moving image data starts is changed to "tL=tS+tD" from the start of the frame. At time "T760", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320.

[0090] At time "T760", in S320, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. At the start of frame 5, it is determined that the "still image shooting start button" has been pressed, and the result in S320 is "YES", and the process proceeds to S321. Similarly, at time "T760", in S321, it is determined whether or not the next frame is the first frame shot after the pressing of the "still image shooting start button" is detected. Since frame 6 is the fourth frame shot after the pressing of the "still image shooting start button" is detected, the result in S321 is "NO", and the process proceeds to S340. Similarly, at time "T760", in S323, it is determined whether or not the next frame is the Nth frame from the last still image shot. In this embodiment, N=3, and frame 6 is the third frame shot from the last still image shot, so the result in S323 is "YES", and the process proceeds to S360.

[0091] Thereafter, at time T764, in S347, updating of the display on display unit 114 based on the image data of the "still image" is started. The processing of S360 to S367 from time T760 to time T764 is the same as the processing of S360 to S367 from time T730 to time T734. However, at time T761, the pressing of the "still image shooting start button" is released, and thereafter, the released state continues. At time T770, in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320.

[0092] At time "T770", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. At the start of frame 6, it is determined that the "still image shooting start button" was not pressed, and the result of S320 is "NO", and the process proceeds to S320. Thereafter, at time "T774", updating of the display of display unit 114 based on the image data of the "moving image" at S347 is started. The processing of S340 to S347 from time "T770" to time "T774" is the same as the processing of S340 to S347 from time "T710" to time "T714". If the timing to start reading out the image data of the moving image from RAM 109 is set to "tL=tS+tD (time "T712" to time "T714")" after the start of the frame, the interval of the "display system vertical synchronization signal" of frame 6 is "tA". However, in this case, the timing for starting to read video image data from RAM 109 is set to "tS (time "T712" to time "T714")" from the start of the frame, so the interval of the "display system vertical synchronization signal" for frame 6 is "tC = tA - tD".

[0093] At time "T780", in S325, it is determined whether or not to continue shooting, and the result in S325 is "YES", and the process proceeds to S320. At time "T780", in S320, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was not pressed at the start of frame 7, and the result in S320 is "NO", and the process proceeds to S340. Thereafter, at time "T784", updating of the display of display unit 114 based on the image data of the "moving image" in S347 is started. The processing of S340 to S347 from time "T780" to time "T784" is the same as the processing of S340 to S347 from time "T710" to time "T714".

[0094] According to this embodiment, as shown in FIG. vertical If the interval between the "sync signals" is "tA", then the "display system sync signal" immediately before the start of still image shooting verticalThe interval between the synchronization signals is tB = tA + tD. Also, when the still image capture start button is released and video capture resumes, the display system vertical The interval between the synchronization signals is tC = tA - tD. However, other display systems vertical The interval between the "synchronization signals" is "tA", and the update interval of the display unit 114 can be kept constant, except immediately before still image shooting begins and when moving image is restored after the still image shooting start button is released. Furthermore, since the time delay until image data is displayed on the display unit 114 in moving image shooting before still image shooting is suppressed, there is also the advantage that the ability to track a fast-moving subject in moving image shooting before still image shooting is not impaired.

[0095] <Fourth embodiment> In the third embodiment, when shooting a video while shooting a still image, the time delay until image data is displayed on the display unit 114 becomes large, which may cause inconvenience when tracking a fast-moving subject while shooting a still image. In the fourth embodiment, an example will be described in which the display update interval is kept constant while emphasizing subject tracking in shooting a video before shooting a still image and shooting a video while shooting a still image, while suppressing the time delay until image data is displayed on the display unit 114. Note that the fourth embodiment has the same configuration as the first embodiment with respect to Figs. 1, 2(a) and 2(b).

[0096] Whether to suppress the time delay until image data is displayed on display unit 114 in movie shooting before still image shooting and movie shooting during still image shooting may be determined by, for example, referring to a value set by the user from a menu. The operation when allowing the time delay until image data is displayed on display unit 114 in movie shooting before still image shooting and movie shooting during still image shooting is the same as in the first embodiment. Also, the operation when allowing the time delay until image data is displayed on display unit 114 only in movie shooting during still image shooting is the same as in the third embodiment.

[0097] Fig. 8 is a flowchart showing the imaging operation of the fourth embodiment. Fig. 9 is an explanatory diagram showing the timing of the imaging operation of the fourth embodiment. With reference to Figs. 8 and 9, a process for suppressing a delay in time until image data is displayed on the display unit 114 in moving image shooting before still image shooting and moving image shooting during still image shooting will be described. The process shown in Fig. 8 is realized by CPU 110 executing a program.

[0098] At time "T902", shooting is started in S800. This shooting start may be, for example, immediately after power-on, but is not limited to this. At time "T910", in S820, it is determined whether or not the "still image shooting start button" is pressed at a predetermined timing. In this embodiment, it is determined whether or not the "still image shooting start button" is pressed at the start of each frame. At the start of frame 0 (at the start of shooting at time "T902"), it is determined that the "still image shooting start button" has not been pressed, so the result in S820 is "NO", and the process proceeds to S840. Similarly, at time "T910", "moving image" is set in S840. The CPU 110 sets the image sensor 107 to read out image data of the moving image, and sets the DSP 108 to develop the image data of the moving image.

[0099] Furthermore, the CPU 110 sets an "imaging system vertical synchronizing signal" and a "display system vertical synchronizing signal" for the timing pulse generating circuit 111, and sets the display unit 114 to display "moving image" image data. The CPU 110 also sets the timing to start reading out the moving image data for the RAM 109. In order to output the moving image data from the data A output unit 222, the selector 221 of the imaging element 107 is set to "input a". The timing to start reading out the moving image data from the RAM 109 is set to "tS (time "T912" to time "T914")" after the start of the frame.

[0100] At time "T912", an "imaging system vertical synchronization signal" is issued, and in S841, reading of the image data of the "moving image" is started. Also at time "T912", image data of the "moving image" is developed at S843, and writing of the image data of the "moving image" to the RAM 109 is started at S844. Also at time "T912", waiting for a specified time "tS" is performed at S845. At time "T914", a "display system vertical synchronization signal" is issued, and in S846, reading of the image data of the "moving image" from the RAM 109 is started. Also at time "T914", updating of the display of the display unit 114 based on the image data of the "moving image" is started at S847. At time "T920", a determination is made in S825 as to whether or not to continue shooting, and if shooting is to be continued (YES), the process proceeds to S820.

[0101] On the other hand, if shooting is not to be continued (NO), shooting is ended in S801. For example, when a menu is displayed on the display unit 114 or when the power switch is turned off, shooting is not to be continued and shooting is ended. In this embodiment, all determinations in S825 as to whether or not to continue shooting are made to continue shooting, and S825 is assumed to be "YES".

[0102] At time "T920", in S820, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was not pressed at the start of frame 1, so S820 becomes "NO" and the process proceeds to S840. Thereafter, at time "T924", in S847, updating of the display of display unit 114 based on the image data of the "moving image" is started. The processing of S840 to S847 from time "T920" to time "T924" is the same as the processing of S840 to S847 from time "T910" to time "T914". However, it is assumed that the "still image shooting start button" is pressed at time "T921" and continues to be pressed thereafter. At time "T930", in S825, it is determined whether or not to continue shooting. The result of S825 is "YES", and the process proceeds to S820.

[0103] At time "T930", in S820, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. It is determined that the "still image shooting start button" has been pressed at the start of frame 2, so S820 becomes "YES" and the process proceeds to S821. Similarly, at time "T930", in S821, it is determined whether or not the next frame is the first frame to be shot after detection of pressing the "still image shooting start button". Since frame 3 is the first frame to be shot after detection of pressing the "still image shooting start button", S821 becomes "YES" and the process proceeds to S840.

[0104] Thereafter, at time "T934", in S847, updating of the display of the display unit 114 based on the image data of the "moving image" is started. The processing of S840 to S847 from time "T930" to time "T934" is the processing of S840 to S847 from time "T910" to time "T914" in which the interval of the "imaging system vertical synchronization signal" of frame 3 is set to "tC = tA - tD". "tA" is the interval of the "imaging system vertical synchronization signal" of frame 1 and frame 2. "tD" is the latency required for resolution conversion of a still image to a moving image size, and the amount is uniquely determined by the read time of the still image and the image size before and after conversion. Therefore, it can be calculated even during shooting of a moving image before shooting a still image. At time "T940", in S825, it is determined whether or not to continue shooting, and S825 becomes "YES", and the process proceeds to S820.

[0105] At time "T940", in S820, it is determined whether or not the "still image shooting start button" has been pressed at the start of the frame. It is determined that the "still image shooting start button" has been pressed at the start of frame 3, so S820 becomes "YES" and the process proceeds to S821. Similarly, at time "T940", in S821, it is determined whether or not the next frame is the first frame to be shot after detection of pressing of the "still image shooting start button". Since frame 4 is the second frame to be shot after detection of pressing of the "still image shooting start button", S821 becomes "NO" and the process proceeds to S822. Similarly, at time "T940", in S822, it is determined whether or not the next frame is the second frame to be shot after detection of pressing of the "still image shooting start button". Frame 4 is the second frame captured after detecting the pressing of the "still image capture start button," so S822 becomes "YES" and the process proceeds to S860.

[0106] Similarly, at time "T940", in S860, a "still image" is set. The CPU 110 sets the image sensor 107 to read out image data of a still image, and sets the DSP 108 to develop the image data of a still image. Furthermore, the CPU 110 sets the timing pulse generating circuit 111 to an "imaging system vertical synchronizing signal" and a "display system vertical synchronizing signal", and sets the display unit 114 to display the image data of a still image. The CPU 110 also sets the timing to start reading out the image data of a still image for the RAM 109. In order to output the image data of a still image with the resolution converted from the data A output unit 222, the selector 221 of the image sensor 107 is set to "input b".

[0107] The timing to start reading image data of a still image from RAM 109 is "tL=tS+tD (time "T942" to time "T944")" from the start of the frame. "tD" is the latency required to convert the resolution of a "still image" to a video size. When video shooting is performed between still image shooting frames, the interval of the "imaging system vertical synchronization signal" is set to "tB=tA+tD". When video shooting is not performed between still image shooting frames, the interval of the "imaging system vertical synchronization signal" is set to "tA". In this embodiment, video shooting is performed between still image shooting frames.

[0108] At time "T942", an "imaging system vertical synchronization signal" is issued, and in S861, reading of the "still image" image data is started. At time "T943", resolution conversion to a moving image size of the "still image" image data is performed in S862, and the "still image" image data is developed in S863. Furthermore, at time "T943", writing of the "still image" image data to RAM 109 is started in S864, and then waiting for a specified time "tL=tS+tD" is performed in S865. At time "T944", a "display system vertical synchronization signal" is issued, and in S866, reading of the "still image" image data from RAM 109 is started. Similarly, at time "T944", updating of the display of display unit 114 based on the "still image" image data is started in S867. At time "T950", in S825, it is determined whether or not to continue shooting. The result of S825 is "YES", and the process proceeds to S820.

[0109] At time "T950", in S820, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was pressed at the start of frame 4, so S820 becomes "YES" and the process proceeds to S821. Similarly, at time "T950", in S821, it is determined whether or not the next frame is the first frame to be shot after detection of pressing the "still image shooting start button". Since frame 5 is the third frame to be shot after detection of pressing the "still image shooting start button", S821 becomes "NO" and the process proceeds to S822.

[0110] Similarly, at time "T950", in S822, it is determined whether the next frame is the second frame to be shot after detecting pressing of the "still image shooting start button". Since frame 5 is the third frame to be shot after detecting pressing of the "still image shooting start button", S822 becomes "NO" and the process proceeds to S823. Similarly, at time "T950", in S823, it is determined whether the next frame is the Nth frame since the last still image shooting. Since N=3 in this embodiment and frame 5 is the first frame to be shot since the last still image shooting, S823 becomes "NO" and the process proceeds to S840.

[0111] Thereafter, at time "T954", in S847, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S840 to S847 from time "T950" to time "T954" is the same as the processing of S840 to S847 from time "T910" to time "T914". At time "T960", in S825, it is determined whether or not to continue shooting, and S825 becomes "YES", and the process proceeds to S820.

[0112] At time "T960", in S820, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was pressed at the start of frame 5, so S820 becomes "YES" and the process proceeds to S821. Similarly, at time "T960", in S821, it is determined whether or not the next frame is the first frame to be shot after detection of pressing the "still image shooting start button". Frame 6 is the fourth frame to be shot after detection of pressing the "still image shooting start button", so S821 becomes "NO" and the process proceeds to S822.

[0113] Similarly, at time "T960", in S822, it is determined whether the next frame is the second frame shot after detecting pressing of the "still image shooting start button". Since frame 6 is the fourth frame shot after detecting pressing of the "still image shooting start button", S822 becomes "NO" and the process proceeds to S823. Similarly, at time "T960", in S823, it is determined whether the next frame is the Nth frame since the last still image shooting. In this embodiment, N=3, and frame 6 is the second frame shot since the last still image shooting, so S823 becomes "NO" and the process proceeds to S840.

[0114] Thereafter, at time "T964", in S847, updating of the display on display unit 114 based on the image data of the "moving image" is started. The processing of S840 to S847 from time "T960" to time "T964" is the processing of S840 to S847 from time "T910" to time "T914", where the interval of the "imaging system vertical synchronization signal" for frame 6 is set to "tC = tA - tD". At time "T970", in S825, it is determined whether or not to continue shooting, and S825 becomes "YES", and the process proceeds to S820.

[0115] At time "T970", in S820, it is determined whether or not the "still image shooting start button" was pressed at the start of the frame. It is determined that the "still image shooting start button" was pressed at the start of frame 6, so S820 becomes "YES" and the process proceeds to S821. Similarly, at time "T970", in S821, it is determined whether or not the next frame is the first frame to be shot after detection of pressing the "still image shooting start button". Frame 7 is the fifth frame to be shot after detection of pressing the "still image shooting start button", so S821 becomes "NO" and the process proceeds to S822.

[0116] Similarly, at time "T970", in S822, it is determined whether the next frame is the second frame shot after the pressing of the "still image shooting start button" is detected. Since frame 7 is the fifth frame shot after the pressing of the "still image shooting start button" is detected, S822 becomes "NO" and the process proceeds to S823. Similarly, at time "T970", in S823, it is determined whether the next frame is the Nth frame from the last still image shooting. Since N=3 in this embodiment and frame 7 is the third frame shot from the last still image shooting, S823 becomes "YES" and the process proceeds to S860. Thereafter, at time "T974", updating of the display of display unit 114 based on the image data of the "still image" is started in S867. The processing of S860 to S867 from time "T970" to time "T974" is the same as the processing of S860 to S867 from time "T940" to time "T942".

[0117] At time "T980", in S825, it is determined whether or not to continue shooting, and S825 becomes "YES", and the process proceeds to S820. Then, the processing of S840 to S847 from time "T980" to time "T984" is the same as the processing of S840 to S847 from time "T950" to time "T954".

[0118] According to this embodiment, as shown in FIG. 9, the “imaging system” during video shooting except immediately before still image shooting vertical If the interval between the "sync signals" is "tA", the "display system verticalThe interval between the "sync signals" is "tA", and the "display system" during still image shooting vertical The interval between the "synchronization signals" is also "tA". As a result, the update interval of the display unit 114 can be kept constant. Furthermore, it is possible to reduce the delay in time until image data is displayed on the display unit 114 when shooting a video before shooting a still image, as well as when shooting a video while shooting a still image. This has the effect of not impairing the ability to track a fast-moving subject when shooting a video before shooting a still image, as well as when shooting a video while shooting a still image.

[0119] <Summary> According to the above-described embodiments, the following configurations can be realized. The pixel scanning unit 215 (reading unit) can read out "LV image (live view moving image) image data" (first image data with a first resolution) and "still image data" (second image data with a second resolution) from the pixel array 207. Also, based on an instruction signal to start reading out the "still image data" given by the operation unit 116, reading out of the "still image" image data from the pixel array 207 is started. The read-out "still image data" is converted by the resolution conversion circuit 220 (resolution conversion unit) to obtain image data (image data with a third resolution). The data A output unit 222 (output unit) can output the "LV image data" and the "converted image data with a third resolution."

[0120] DSP 108 (generation unit) generates display image data based on image data output from data A output unit 222 (output unit). RAM 109 (storage unit) holds the generated display image data, and display unit 114 displays the display image data. Then, the retention time during which RAM 109 retains the display image data is controlled. This makes equal the time from the start of a frame to the start of display by display unit 114 of "image data of an LV image" and the time from the start of a frame to the start of display by display unit 114 of image data of a still image whose resolution has been converted by resolution conversion circuit 220. This causes a live view image to be displayed on display unit 114 at intervals of "fixed display system vertical synchronization signal".

[0121] In addition, the retention time during which the RAM 109 (retention unit) retains the display image data is controlled both before and after the timing at which an instruction signal is given to the operation unit 116. This provides a "first mode" in which the time from the start of a frame to the start of displaying the image data of an LV image by the display unit 114 is equal to the time from the start of a frame to the start of displaying the image data of a still image converted by the resolution conversion circuit 220 by the display unit 114.

[0122] Moreover, the retention time for which the RAM 109 (retention unit) retains the display image data is controlled only after the timing at which an instruction signal is given to the operation unit 116. This provides a "second mode" that equalizes the time from the start of a frame to the start of display by the display unit 114 of the image data of the LV image, and the time from the start of a frame to the start of display by the display unit 114 of the image data of a still image converted by the resolution conversion circuit 20. Furthermore, the operation unit 116 may be configured to include a mode selection unit that switches between the first mode and the second mode.

[0123] To summarize the above, before the "still image shooting start button" is pressed, CPU 110 makes the display delay time until a live view image is displayed on display unit 114 shorter than the display delay time until a still image is displayed on display unit 114. To achieve this, it controls the retention time of display image data in RAM 109. Then, after the "still image shooting start button" is pressed, it controls the retention time of display image data in RAM 109 so that the display delay time until a live view image is displayed on display unit 114 and the display delay time until a still image is displayed on display unit 114 are equal.

[0124] In the "first mode", even before the "still image shooting start button" is pressed, the display delay time until the live view image is displayed on the display unit 114 is equal to the display delay time until the still image is displayed on the display unit 114. To this end, the holding time of the display image data in the RAM 109 (holding unit) is controlled. In the "second mode", first, before the "still image shooting start button" is pressed, the display delay time until the live view image is displayed on the display unit 114 is shorter than the display delay time until the still image is displayed on the display unit 114. To this end, the holding time of the display image data in the RAM 109 is controlled. On the other hand, after the "still image shooting start button" is pressed, the display delay time until the live view image is displayed on the display unit 114 is equal to the display delay time until the still image is displayed on the display unit 114. To this end, the holding time of the display image data in the RAM 109 (holding unit) is controlled.

[0125] In addition, other aspects are as follows. The pixel scanning unit 215 (reading unit) can read out "LV image (live view moving image) image data" (first image data with a first resolution) and "still image data" (second image data with a second resolution) from the pixel array 207. Also, based on an instruction signal to start reading out the "still image data" given by the operation unit 116, reading out of the "still image" image data is started from the pixel array 207. The read-out "still image data" is converted by the resolution conversion circuit 220 (resolution conversion unit) to obtain image data (image data with a third resolution). The data A output unit 222 (output unit) can output the "LV image data" and the "converted image data with a third resolution."

[0126] DSP 108 (generation unit) generates display image data based on image data output from data A output unit 222 (output unit). RAM 109 (storage unit) stores the generated display image data, and display unit 114 displays the display image data. The update interval of the display image data displayed by display unit 114 is kept constant by changing and controlling the timing at which "still image data" (image data with a second resolution) is read out. In other words, when a still image is captured during video capture, the readout of "still image data" from pixel array 207 is start This causes the live view image to be displayed on the display unit 114 at regular intervals of the "display system vertical synchronization signal."

[0127] Also, a second operation unit may be provided which, when operated, provides a shooting start instruction signal indicating the start of still image shooting, and based on the shooting start instruction signal, reading of "still image data" (image data with the second resolution) from pixel array 207 may be started. Also, a third operation unit may be provided which, when operated, provides a distance measurement operation start instruction signal indicating the start of distance measurement operation, and based on the distance measurement operation start instruction signal, reading of "still image data" (image data with the second resolution) from pixel array 207 may be started. Note that the second and third operation units may be configured to be included in operation unit 116.

[0128] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0129] 1. Imaging device 107 Image sensor 215 Pixel Scanning Unit 220 Resolution conversion circuit 222 Data A output section 116 Operation section 108 DSP 109 RAM 114 Display section

Claims

1. An imaging device having a live view function, a pixel array in which a plurality of photoelectric conversion elements are arranged in a matrix; a readout unit capable of reading out first image data for moving images and second image data for still images from the pixel array; an operation unit which, when operated, gives an instruction signal indicating a start of reading of the second image data; a conversion unit that converts the second image data for a still image read out from the pixel array based on the instruction signal into third image data for a moving image; an output unit capable of outputting the first image data and the third image data that have been read out; a generation unit that generates display image data based on the first image data or the third image data output from the output unit; A storage unit for storing the display image data; a display unit that displays the display image data, An imaging device characterized in that the retention time of the display image data by the retention unit is controlled so that the time from the start of a frame to the start of displaying the first image data by the display unit is equal to the time from the start of a frame to the start of displaying the third image data by the display unit.

2. The imaging device according to claim 1, characterized in that it has a first mode in which the time from the start of a frame to the start of displaying the first image data by the display unit is equal to the time from the start of a frame to the start of displaying the third image data by the display unit by controlling the retention time that the retention unit retains the display image data both before and after the instruction signal is given by the operation unit.

3. The imaging device according to claim 2, characterized in having a second mode in which the holding unit controls the retention time for which the display image data is held only after the instruction signal is given by the operation unit, so that the time from the start of a frame to the start of displaying the first image data by the display unit is equal to the time from the start of a frame to the start of displaying the third image data by the display unit.

4. 4. The imaging apparatus according to claim 3, further comprising a mode selection unit that switches between the first mode and the second mode.

5. a second operation unit that, when operated, issues a shooting start instruction signal indicating the start of still image shooting; 5. The imaging apparatus according to claim 1, wherein the readout of the second image data from the pixel array is started based on the imaging start instruction signal.

6. a third operation unit which, when operated, gives a distance measurement start instruction signal indicating the start of a distance measurement operation; 5. The imaging apparatus according to claim 1, wherein reading of the second image data from the pixel array is started based on the distance measurement start instruction signal.

7. 7. The imaging device according to claim 1, wherein a resolution of the first image data is lower than a resolution of the second image data.

8. 8. The imaging device according to claim 1, wherein the first image data is image data of a live view video.

9. An imaging device having a live view function, a pixel array in which a plurality of photoelectric conversion elements are arranged in a matrix; a readout unit capable of reading out first image data for moving images and second image data for still images from the pixel array; an operation unit which, when operated, gives an instruction signal indicating a start of reading of the second image data; a conversion unit that converts the second image data for a still image read out from the pixel array based on the instruction signal into third image data for a moving image; an output unit capable of outputting the first image data and the third image data that have been read out; a generation unit that generates display image data based on the first image data or the third image data output from the output unit; A storage unit for storing the display image data; a display unit that displays the display image data, An imaging device characterized in that the update interval of the display image data displayed by the display unit is kept constant by controlling the timing at which the readout unit starts reading the second image data and the retention time of the display image data by the retention unit.

10. 10. The imaging apparatus according to claim 9, wherein the display unit displays substitute image data for a still image in a predetermined frame after the timing at which the instruction signal is given by the operation unit.

11. 11. The imaging device according to claim 10, wherein the alternative image data is image data obtained by changing a luminance of the image data in the predetermined frame.

12. 11. The image pickup apparatus according to claim 10, wherein the alternative image data is image data that is unrelated to the image data in the predetermined frame.

13. a second operation unit that, when operated, issues a shooting start instruction signal indicating the start of still image shooting; 13. The imaging apparatus according to claim 9, wherein the readout of the second image data from the pixel array is started based on the imaging start instruction signal.

14. a third operation unit which, when operated, gives a distance measurement start instruction signal indicating the start of a distance measurement operation; 13. The imaging apparatus according to claim 9, wherein reading out of the second image data from the pixel array is started based on the distance measurement operation start instruction signal.

15. 15. The imaging apparatus according to claim 9, wherein the resolution of the first image data is lower than the resolution of the second image data.

16. 16. The imaging apparatus according to claim 9, wherein the first image data is image data of a live view video.

17. A control method for an imaging device having a live view function, comprising: reading out first image data for moving images from a pixel array in which a plurality of photoelectric conversion elements are arranged in a matrix; reading out second image data for a still image from the pixel array; a step of giving an instruction signal indicating a start of reading of the second image data when an operation unit is operated; converting the second image data for still images read out based on the instruction signal into third image data for moving images; outputting the first image data that has been read; outputting the third image data; generating display image data based on the output first image data or the output third image data; storing the display image data in a storage unit; displaying the display image data on a display unit; a step of controlling a retention time of the display image data by the retention unit to make equal the time from the start of a frame to the start of display of the first image data by the display unit and the time from the start of a frame to the start of display of the third image data by the display unit.

18. A control method for an imaging device having a live view function, comprising: reading out first image data for moving images from a pixel array in which a plurality of photoelectric conversion elements are arranged in a matrix; reading out second image data for a still image from the pixel array; a step of giving an instruction signal indicating a start of reading of the second image data when an operation unit is operated; converting the second image data for a still image read out from the pixel array based on the instruction signal into third image data for a moving image; outputting the first image data; outputting the third image data; generating display image data based on the output first image data or the output third image data; storing the display image data in a storage unit; displaying the display image data on a display unit; and a step of keeping constant the update interval of the display image data displayed by the display unit by controlling the timing at which the second image data is started to be read by the reading step and the retention time of the display image data by the retention unit.

Images