Imaging apparatus, control method of the imaging apparatus, and program

Abstract

To enable a photographing of a moving image in which even general user can be connected as a continuous operation when photographing the moving image connected with the moving image to be photographed.SOLUTION: At the time of photographing of a moving image at the last half when two moving images are connected, a direction of a camera work that is similar to camera work information in associated with the moving image to be selected is provided as operation information in the case where there is no change in the size of a main subject of the moving image at the first half by the camera work such a dolly. In the case where a final scene of the moving image to be selected is a specified scene, a direction of the camera work with a relation that is inverse to the camera work information in associated with the moving image is provided as operation information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device that captures moving images, and a control method and program for the imaging device. [Background technology]

[0002] Video production is carried out by an editor who cuts and joins together multiple moving images taken by a cameraman using a video camera or other device to create the footage he or she intended. The moving images used in this video production are generally shot using camera manipulation techniques such as panning, tilting, zooming, following the subject from behind, and dollying, which moves parallel to the subject.

[0003] Professional video producers have the skills to shoot and edit videos by combining camera work from previous and next videos to create videos that are sharp and powerful. Even when scenes change between videos, such users can seamlessly combine the videos into a series of movements through camera work, making the video more appealing.

[0004] In addition, many techniques have been proposed for connecting moving images to create attractive images. Patent Document 1 discloses a technique for checking camera operation information, including camera work, in previous and subsequent moving images against scene rules for making the images more attractive, and adding transition effects to the connections between the moving images when the scene rules are violated. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2003-110995 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, when a video production user is an ordinary person, he / she does not originally have the shooting technique using camerawork with consideration for the connection of previous and next videos, so there may be few videos that conform to the scene rules for making attractive videos. In that case, even if the technology described in Patent Document 1 is used, it is only possible to hide the difficulty of seeing the seams of videos that do not conform to the scene rules with transition effects. In addition, it is difficult to produce a video in which the camerawork is connected as a series of actions even when the scene changes.

[0007] In consideration of the above-mentioned problems, the present invention has an object to enable even general users to shoot moving images that are connected as a series of actions when shooting moving images to be joined with previously shot moving images. [Means for solving the problem]

[0008] The imaging device of the present invention is an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, and is characterized in that it comprises a recognition means for recognizing camerawork information when capturing the first moving image, a storage means for storing the camerawork information recognized by the recognition means in association with the first moving image, and a presentation means for presenting operation information when capturing the second moving image based on the camerawork information associated with the first moving image. Effect of the Invention

[0009] According to the present invention, when capturing a video to be joined with previously captured videos, even an ordinary user can capture a video that is connected as a series of movements. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an example of the internal configuration of an imaging device according to a first embodiment. [Diagram 2] FIG. 13 is a diagram for explaining an example of photography using a dolly. [Diagram 3]FIG. 13 is a diagram for explaining an example of photography performed by push-in / push-out. [Figure 4] FIG. 13 is a diagram for explaining an example of photographing with tilt up / tilt down. [Diagram 5] FIG. 13 is a diagram showing an example of a screen for recording moving images captured by a dolly. [Figure 6] FIG. 13 is a diagram showing an example of a screen for selecting moving images to be joined and starting shooting of the moving image. [Figure 7] FIG. 13 is a diagram showing another example of the screen for selecting a video to be joined and starting video shooting. [Figure 8] 10 is a flowchart showing an example of a processing procedure for capturing a moving image. [Figure 9] 10 is a flowchart showing an example of a processing procedure for selecting a video to be joined and starting video shooting in the first embodiment. [Figure 10] 11 is a diagram illustrating an example of the external configuration of an imaging device according to a second embodiment. FIG. [Figure 11] FIG. 11 is a block diagram showing an example of the internal configuration of an imaging device according to a second embodiment. [Figure 12] FIG. 13 is a diagram for explaining a state in which a person is moving to the left side of the angle of view. [Figure 13] FIG. 13 is a diagram for explaining a state in which the background moves to the right with a person at the center. [Figure 14] FIG. 13 is a diagram for explaining a state in which a person is moving quickly to the left side of the angle of view. [Figure 15] FIG. 13 is a diagram for explaining a state in which a person cannot be tracked. [Figure 16] 13 is a flowchart showing an example of a drive control procedure when shooting a video to be connected to the latter half of a material video when a main subject is present in the material video in the second embodiment. [Figure 17] 10 is a flowchart showing an example of a detailed procedure of drive control according to a subject. [Figure 18]13 is a flowchart showing an example of a drive control procedure for shooting a video to be connected to the latter half of a material video when the main subject is not present in the material video in the second embodiment. [Figure 19] 10 is a flowchart showing an example of a detailed procedure of drive control according to a subject. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0012] (First embodiment) 1 is a block diagram showing an example of the internal configuration of an imaging device 100 according to this embodiment. The imaging device 100 has a control unit 101, a ROM 103, a RAM 104, an imaging unit 105, an image processing unit 106, a motion vector detection unit 107, a subject detection unit 108, a scene determination unit 109, a motion detection unit 110, an operation unit 111, a display unit 112, and a recording unit 113. These components are connected via a bus 102.

[0013] The control unit 101 is configured by, for example, a part of a CPU, and reads out a control program for each block included in the imaging device 100 from a ROM 103 described later, and deploys and executes the program in a RAM 104 described later. In this way, the control unit 101 controls the operation of each block included in the imaging device 100 via a bus 102.

[0014] The ROM 103 is an electrically erasable and recordable non-volatile memory, and stores parameters and the like necessary for the operation of each block in addition to the operation programs of each block of the imaging device 100. The RAM 104 is a rewritable volatile memory, and is used for expanding programs executed by the control unit 101 and the like, and for temporarily storing data generated by the operation of each block of the imaging device 100.

[0015] The imaging unit 105 captures an image of a subject using a configuration including a lens, an image sensor, an A / D converter, etc. (not shown), to obtain a moving image (video data) of the subject. The image processing unit 106 performs image processing such as predetermined pixel interpolation, resizing such as reduction or enlargement, and color conversion on the moving image obtained by the imaging unit 105.

[0016] The motion vector detection unit 107 refers to previous and next frame images in the moving image obtained by the imaging unit 105, and detects motion vectors of the main subject, background, etc. detected by the subject detection unit 108 described later. The motion vector detection unit 107 then associates the detected information with the moving image as motion vector information, and the control unit 101 records it in the recording unit 113 described later. The subject detection unit 108 detects subjects including the main subject from the moving image processed by the image processing unit 106. The subject detection unit 108 then associates the detected information with the moving image as subject information, and the control unit 101 records it in the recording unit 113 described later. The scene determination unit 109 performs scene determination for the moving image processed by the image processing unit 106. The scene determination unit 109 then associates the determined information with the moving image as scene information, and the control unit 101 records it in the recording unit 113 described later.

[0017] The motion detection unit 110 is, for example, a gyro sensor or an acceleration sensor, and detects the amount and direction of movement of the imaging device 100 when capturing an image. Information detected by the motion detection unit 110 is recorded by the control unit 101 as motion detection information in a recording unit 113 described later. The operation unit 111 is composed of a touch panel, buttons, a mouse, etc., and inputs instructions from a user to the imaging device 100. The display unit 112 is composed of an LCD, etc., and displays images stored in the RAM 104 and images recorded in the recording unit 113 described later, and displays an operation user interface for receiving instructions from the user.

[0018] The recording unit 113 is a recording medium such as a removable memory card. The recording unit 113 records the moving images processed by the image processing unit 106, the motion vector information recorded in association with the moving images, the subject information, the scene information, and the camera work information generated by the camera work determination unit 114 described below. The recording unit 113 also records the motion detection information generated by the motion detection unit 110.

[0019] The camerawork determination unit 114 recognizes camerawork from the motion vector information detected by the motion vector detection unit 107, the subject information detected by the subject detection unit 108, and the motion detection information of the imaging device 100 detected by the motion detection unit 110. Then, the camerawork determination unit 114 associates the recognized camerawork with the moving image as camerawork information, and records it in the recording unit 113 by the control unit 101.

[0020] The operation information determination unit 115 determines operation information to be proposed based on the motion vector information, the subject information, the scene information, and the camera work information. The method of determining the operation information will be described later in detail.

[0021] Hereinafter, with reference to Figs. 2 to 4, a description will be given of how to join two moving images captured using camerawork according to this embodiment.

[0022] First, the dolly camerawork will be described with reference to Fig. 2. In Fig. 2, frames 201 and 202 are two frames extracted from the first half of a video when splicing two videos, and frames 203 and 204 are two frames extracted from the second half of a video. Here, it is assumed that both the first half and second half of the video are shot from left to right with a dolly, and that the main subject is shot at the same position and with the same size in both videos.

[0023] Here, frame 202 is one frame before the previous and next videos are switched, and is shot so that an object such as a wall is between the main subject and the imaging device so that the main subject's moving direction is hidden by the object at the end of the first half of the video. Frame 203 is one frame after the previous and next videos are switched, and is shot so that an object such as a wall is between the main subject and the imaging device so that the main subject's moving path is hidden by the object at the beginning of the second half of the video. Frame 201 is the frame immediately before the first half of the video is hidden by the object, and frame 204 is the frame immediately after the second half of the video is hidden by the object. As a result, the camera work is connected as a series of actions depending on the direction in which the main subject moves, and the transition between the previous and next videos is seamless.

[0024] Next, the camera work of push-in and push-out will be described with reference to Fig. 3. Frames 301-304 are four frames extracted from the first half of a video when splicing two videos, and frames 305-308 are four frames extracted from the second half of a video. The first half of the video was shot with push-in, and frames 301, 302, 303, and 304 were shot so that the subject approached the main subject with each transition. On the other hand, the second half of the video was shot with push-out, and frames 305, 306, 307, and 308 were shot so that the subject moved away from the main subject with each transition.

[0025] Here, frame 304 is one frame before the video switches between the previous and next videos, and frame 305 is the video after the video switches between the previous and next videos. The previous and next videos are shot so that the main subject in frames 304 and 305 has the same size, and the speed at which the main subject approaches in the first half and the speed at which the main subject moves away in the second half are approximately the same, and by linking these videos together, the background switches between the first and second half. As a result, the camerawork is linked as a series of movements depending on the size of the main subject, and the link between the previous and next videos is seamless.

[0026] Next, the camera work of tilt-up and tilt-down will be described with reference to FIG. 4. Frames 401 to 405 are five frames extracted from the first half of the video, and frames 406 to 410 are five frames extracted from the second half of the video. The first half of the video is shot with tilt-up, and the sky is shot in a larger range with each transition from frame 401, 402, 403, 404, and 405, until finally, only the sky is shot in frame 405. On the other hand, the second half of the video is shot with tilt-down, and the second half of the video starts with only the sky shot, and is shot so that the sky is shot in a smaller range with each transition from frame 406, 407, 408, 409, and 410. As described above, the camera work is connected as a series of operations via the sky, and the connection between the previous and next videos is seamless.

[0027] Hereinafter, a user interface displayed on display unit 112 during shooting of the first half of a video when splicing two videos in this embodiment will be described with reference to Fig. 5. In Fig. 5, screens 501, 503, and 506 each represent a screen displayed on display unit 112 during or after shooting of the first half of a video when splicing two videos.

[0028] Screen 501 displays an image captured by imaging unit 105, with camera work information 502 displayed superimposed thereon during video capture. Camera work information 502 displayed on screen 501 may be generated by camera work determination unit 114, or may be configured as information selected by the user via operation unit 111. When video capture ends, screen 501 transitions to screen 503.

[0029] A screen 503 is displayed for allowing the user to select whether or not to associate and record the camera work information 502 and the video. The user selects button 504 if they wish to associate and record, and selects button 505 if they do not wish to associate and record.

[0030] A list of thumbnail images of the videos that have already been shot is displayed on screen 506. When the user selects button 504 on screen 503, a mark 508 identifying the target material video to be linked to the video to be shot is superimposed on thumbnail images 507 and 511 displayed on screen 506. On the other hand, when the user selects button 505 on screen 503, thumbnail images 509 and 510 are displayed, and the identifying mark 508 is not superimposed on the thumbnail images, which are not target material video to be linked to the video to be shot.

[0031] Next, a user interface displayed on the display unit 112 when capturing the latter part of a video when splicing two videos in this embodiment will be described with reference to Fig. 6 and Fig. 7. In Fig. 6, screens 601, 603, and 606 each show an example of a screen displayed on the display unit 112 before capturing the latter part of a video when splicing two videos.

[0032] Screen 601 displays a list of thumbnail images of videos captured by the imaging unit 105. The user selects from screen 601 a material video to be linked to a video to be captured. In the example of Fig. 6, video 602 associated with dolly camerawork information is selected. After the material video is selected, the screen transitions to screen 603.

[0033] A screen 603 is displayed to allow the user to select whether or not to confirm the selected video 602 as a material video to be spliced ​​into a video to be shot. If the user confirms the selection, he or she selects button 604, and if not, he or she selects button 605. If the material video is confirmed, the screen transitions to screen 606, which displays a live view image.

[0034] A live view image is displayed on screen 606, along with recommended camera work according to the video 602 selected on screen 601. In this case, a screen recommending dolly, which is the same camera work as the video 602 selected on screen 601, is displayed on screen 606. The recommended camera work is determined by operation information determination unit 115. A method for determining the recommended camera work will be described later.

[0035] In addition, in FIG. 7, screens 701, 703, and 706 each show another example of a screen displayed on display unit 112 before shooting the latter half of a moving image when splicing two moving images together.

[0036] Screen 701 displays a list of thumbnail images of videos captured by imaging unit 105. The user selects from screen 701 a material video to be linked to a video to be captured. In the example of Fig. 7, video 702 associated with tilt-up camerawork information is selected. After the material video is selected, the screen transitions to screen 703.

[0037] An image is displayed on screen 703 to allow the user to select whether or not to confirm the selected video 702 as a material video to be spliced ​​into a video to be shot. The user selects button 704 to confirm, or selects button 705 to not confirm. If the material video is confirmed, the screen transitions to screen 706, which displays a live view image.

[0038] A live view image is displayed on screen 706, along with recommended camera work according to the video 702 selected on screen 701. In this case, a screen recommending tilt down, which is camera work in a direction opposite to that of the video 702 selected on screen 701, is displayed on screen 706.

[0039] Next, a procedure for recording a material video image in this embodiment will be described. Fig. 8 is a flow chart showing an example of a processing procedure for shooting and recording a video image in this embodiment. The processing starts when the imaging device 100 transitions to a shooting mode. First, in S801, the control unit 101 waits until it receives a moving image shooting start operation from the user through the operation unit 111. Then, when the shooting start operation is received, the process proceeds to the next step S801.

[0040] In S802, the imaging unit 105 starts capturing a moving image, and with the start of capturing, the subject detection unit 108 detects a subject for each frame of the captured moving image and generates subject information. Then, in S803, the motion vector detection unit 107 detects a motion vector for each frame of the captured moving image and generates motion vector information.

[0041] Next, in S804, the scene determination unit 109 performs scene determination processing on each frame of the acquired video to generate scene information. Then, in S805, the camerawork determination unit 114 performs camerawork determination processing on the acquired video to generate camerawork information. The camerawork determination processing is performed based on the subject information generated in S802, the motion vector information generated in S803, and the motion detection information of the imaging device 100 detected by the motion detection unit 110.

[0042] Next, in S806, a process is performed to record each piece of information generated in S802 to S805 in association with a moving image. Specifically, the subject detection unit 108 associates the subject information generated in S802 with the moving image acquired by starting shooting in S801, and the motion vector detection unit 107 associates the motion vector information generated in S803 with the moving image acquired by starting shooting in S801. Furthermore, the scene determination unit 109 associates the scene information generated in S804 with the moving image acquired by starting shooting in S801, and the camera work determination unit 114 associates the camera work information generated in S805 with the moving image. Then, the control unit 101 records the moving image with which these pieces of information are associated in the recording unit 113. At this time, the control unit 101 also records the motion detection information of the imaging device 100 detected by the motion detection unit 110 in association with the moving image.

[0043] In S807, the control unit 101 waits until it receives an operation to end shooting of a moving image by the user through the operation unit 111, and ends the shooting process when the operation to end shooting is received.

[0044] Next, a method for determining a recommended camera work for shooting the latter video when splicing two videos in this embodiment will be described. Fig. 9 is a flowchart showing an example of a processing procedure for presenting a recommended camera work in this embodiment. In S901, the control unit 101 displays a material video selection screen, such as the screen 601 in Fig. 6 or the screen 701 in Fig. 7, on the display unit 112. Then, in S902, the control unit 101 waits until it receives a video selection operation by the user from the operation unit 111. Then, when the video selection operation is received, the process proceeds to S903.

[0045] In S903, the control unit 101 checks the video selected in S902 from the recording unit 113, and determines whether or not the video is associated with subject information. If the result of this determination is that the subject information is associated, the process proceeds to S904, and if not, the process proceeds to S905. Note that if the camera work is a dolly or a push-in or push-out, the subject information is associated, and in such cases the process proceeds to S904. Also, if the camera work is a normal pan or normal tilt, the subject information is not associated, and in such cases the process proceeds to S905.

[0046] In S904, control unit 101 determines whether there is a change in the size of the main subject of the selected video. In this process, if the size of the main subject changes only within a predetermined range, it is determined that the size of the main subject is constant within the predetermined range and has not changed. If the result of this determination is that there is a change in the size of the main subject, proceed to S906, and if not, proceed to S907. If the camera work is a dolly, there is no change in the size of the main subject, so in this case proceed to S907. On the other hand, if the camera work is a push-in or push-out, there is a change in the size of the subject, so in this case proceed to S906.

[0047] In S905, the control unit 101 determines whether or not the specific scene determined by the scene determination unit 109 is associated with the final scene of the video selected in S902. If the result of this determination is that a specific scene is associated, the process proceeds to S906, and if not, the process proceeds to S907. For example, if the camera work is tilt up and the specific scene is sky, the process proceeds to S906. On the other hand, if the camera work is panning, or the final scene of the video is not a specific scene, the process proceeds to S907.

[0048] In S906, the operation information determination unit 115 presents, as operation information, on the display unit 112, a camerawork direction that is inverse to the camerawork information associated with the video selected in S902, as shown in screen 706 in FIG.

[0049] On the other hand, in S907, the operation information determination unit 115 presents, as operation information, on the display unit 112, the same camerawork direction as the camerawork information associated with the video selected in S902, such as screen 606 in FIG.

[0050] As described above, according to this embodiment, when shooting the latter moving image for joining two moving images, the direction of the camera work is presented. This allows the user to shoot the moving images before and after the joining using camera work even if the user does not have specialized knowledge about video production, and makes it easier to create a video in which the camera work is connected as a series of actions even when the scene changes. Note that in this embodiment, dolly, push in / push out, and tilt up / tilt down are described as examples of camera work, but the target camera work is not limited to these. Therefore, the method of determining the recommended camera work is not limited to the procedure of FIG. 9.

[0051] In addition, in this embodiment, as shown in Figures 6 and 7, the camerawork direction is displayed when shooting the latter video for joining two videos, but the camerawork direction may also be presented by audio or the like.

[0052] Second Embodiment In this embodiment, an example is described in which the driving of an imaging device is controlled using subject information detected when a moving image is captured and subject information associated with a moving image selected by the photographer as a material moving image. Note that a description of the configuration and processing that overlap with the first embodiment is omitted.

[0053] Fig. 10 is a diagram showing an example of the external configuration of an imaging device 1000 according to this embodiment. In Fig. 10, a driving unit 1001 includes a motor, and is driven to rotate about each axis, with the horizontal direction as viewed from the imaging device 1000 being the x-axis, the depth as the y-axis, and the up and down as the z-axis. The driving unit 1001 also includes a zoom drive for the lens, and drives to enlarge and reduce the main subject to be photographed.

[0054] 11 is a block diagram showing an example of the internal configuration of an image pickup device 1000 according to this embodiment. The following describes configurations that are different from those in FIG. The drive control unit 1101 compares the motion vector detected by the motion vector detection unit 107 with motion vector information recorded in association with the material video recorded in the recording unit 113. The drive control unit 1101 also compares the subject information detected by the subject detection unit 108 with the subject information recorded in association with the material video recorded in the recording unit 113. The drive control unit 1101 also compares the movement of the imaging device 1000 detected by the motion detection unit 110 with the motion detection information of the imaging device 1000 recorded in association with the material video recorded in the recording unit 113. The drive control unit 1101 then controls the drive unit 1001 based on these comparison results.

[0055] 12 is a diagram for explaining the movement of a certain main subject. Frames 1201 to 1203 are an example showing three consecutive frames, and it is assumed that the main subject is moving toward the left side.

[0056] Fig. 13 is a diagram showing an example of three consecutive frames when the same main subject as in Fig. 12 is photographed by a user and recorded as a material moving image in recording unit 113. In the example of frames 1301 to 1303 in Fig. 13, the main subject is tracked and photographed so that the main subject, which moves to the left, is always located in the center of the angle of view.

[0057] Fig. 14 is a diagram for explaining the movement of the main subject, which is different from that in Fig. 12. Frames 1401 to 1403 are an example showing three consecutive frames, and the main subject is moving toward the left side in the figure, at a higher speed than in the example of Fig. 12.

[0058] FIG. 15 is a diagram showing an example of three consecutive frames of live view images captured while tracking the same main subject as in FIG. 14. In the example of frames 1501 to 1503 in FIG. 15, the user moves with the imaging device 1000 to capture a moving image, or attempts to track the main subject by pan driving, but the main subject cannot be tracked completely. Here, the frame rate when capturing the moving image shown in FIG. 15 is assumed to be the same as the frame rate when the recorded moving image shown in FIG. 13 was captured. In this embodiment, an example will be described in which the driving unit 1001 is controlled in a situation as shown in FIG. 15 to appropriately track and capture the main subject when capturing a moving image to be connected to a material moving image including the frames shown in FIG. 13.

[0059] In the following, in this embodiment, first, the control of driving of imaging device 1000 when a main subject is included in the subject information recorded in association with a video recorded in recording unit 113 will be described. Fig. 16 is a flowchart showing an example of a processing procedure for controlling the driving of imaging device 1000 when a main subject is included in a material video when shooting the latter half of a video for joining two videos. Note that the procedure for recording the material video is the same as in Fig. 8, and therefore a description thereof will be omitted. Hereinafter, when a material video is selected, processing starts.

[0060] First, in S1601, control unit 101 acquires information on the main subject, etc., by referring to subject information and motion vector information associated with the material video image recorded by recording unit 113. The information acquired at this time includes the presence or absence, type, position, size, and motion vector of the main subject, and the motion vector of the background.

[0061] Next, in S1602, the control unit 101 acquires information such as the main subject from the live view image acquired from the imaging unit 105. At this time, the motion vector detection unit 107 detects a motion vector in the live view image, and the subject detection unit 108 detects a subject. The information acquired in S1602 includes the presence or absence, type, position, size, and motion vector of the main subject, and the motion vector of the background.

[0062] Next, in S1603, control unit 101 sends information on the type of the main subject acquired in S1602 to drive control unit 1101. Furthermore, control unit 101 sends information on the type of the main subject of the material video recorded in recording unit 113 acquired in S1601 to drive control unit 1101. Then drive control unit 1101 determines whether or not the main subject at the time of shooting matches the main subject in the material video recorded in recording unit 113. If the result of this determination is that the main subjects match, proceed to S1604, and if they do not match, proceed to S1608.

[0063] In S1604, control unit 101 sends information on the position of the main subject acquired in S1602 to drive control unit 1101. Furthermore, control unit 101 sends information on the final position of the main subject of the material video recorded in recording unit 113 acquired in S1601 to drive control unit 1101. Drive control unit 1101 then determines whether or not the position of the main subject at the time of shooting matches the final position of the main subject in the material video recorded in recording unit 113. If the result of this determination is that the positions do not match, proceed to S1605, and if they match, proceed to S1606. Note that even if the positions of the main subject do not match completely, they are determined to match as long as they are within a predetermined range.

[0064] In S1605, the drive control unit 1101 drives the drive unit 1001 based on the difference in the position of the main subject. For example, the drive control unit 1101 performs pan driving when the position of the main subject differs in the horizontal direction with respect to the shooting angle of view. Furthermore, the drive control unit 1101 performs tilt driving when the position of the main subject differs in the vertical direction with respect to the shooting angle of view. Furthermore, the drive control unit 1101 performs pan driving and tilt driving when the position of the main subject differs in the diagonal direction with respect to the shooting angle of view. Note that, when the position of the main subject cannot be adjusted by pan driving and tilt driving, the control unit 101 may notify the user by displaying a message on the display unit 112 to the effect that the position could not be adjusted. This prompts the user to adjust the position of the main subject in the live view image by moving the main body of the imaging device 1000 by camerawork or the like.

[0065] In S1606, control unit 101 sends information about the size of the main subject acquired in S1602 to drive control unit 1101. Furthermore, control unit 101 sends information about the final size of the main subject of the material video recorded in recording unit 113 acquired in S1601 to drive control unit 1101. Drive control unit 1101 then determines whether or not the size of the main subject at the time of shooting matches the final size of the main subject in the material video recorded in recording unit 113. If the result of this determination is that the sizes of the main subject do not match, proceed to S1607, and if they match, proceed to S1608. Note that even if the sizes of the main subject do not match completely, they are determined to match as long as they are within a predetermined range.

[0066] In S1607, the drive control unit 1101 drives the drive unit 1001 based on the ratio of the size of the main subject. When the main subject to be shot is small, the drive control unit 1101 performs zoom-in drive to adjust the size of the main subject relative to the main subject of the material video recorded in the recording unit 113. When the main subject to be shot is large, the drive control unit 1101 performs zoom-out drive to adjust the size of the main subject relative to the main subject of the material video recorded in the recording unit 113. When the main subject to be shot cannot be adjusted to the size of the main subject by the zoom-in drive and zoom-out drive, the control unit 101 may notify the user by displaying a message on the display unit 112 to the effect that the size could not be adjusted. This prompts the user to adjust the size of the main subject in the live view image by moving the main body of the imaging device 1000 by camera work or the like. Instead of zooming in and out by the control of the drive control unit 1101 to control the drive unit 1001, the control unit 101 may control the image processing unit 106 to perform zoom-in and zoom-out processing by image processing.

[0067] In S1608, the control unit 101 waits until it receives a shooting start operation from the user through the operation unit 111. Note that the control unit 101 may acquire information associated with the material video recorded in the recording unit 113 as preparation for shooting before receiving the shooting start operation, and may further superimpose and display the information on the display unit 112 together with the main subject in the material video recorded in the recording unit 113. For example, when camera work information is associated with the material video, a message or the like encouraging camera work corresponding to the camera work information may be displayed as in the first embodiment. Furthermore, the control unit 101 may automatically start shooting a video in response to the match between the position and size of the main subject by the processing of S1607 and the like. When the shooting start operation is received, the process proceeds to S1609.

[0068] In S1609, the control unit 101 starts capturing a moving image by the imaging unit 105. Then, in S1610, the drive control unit 1101 controls the drive unit 1001. Details of the process of S1610 will be described later.

[0069] In S1611, the control unit 101 waits until it receives an operation to end shooting by the user via the operation unit 111. When the operation to end shooting is received, the process proceeds to S1612. Then, in S1612, the control unit 101 causes the imaging unit 105 to end shooting.

[0070] Next, the process of S1610 in Fig. 16 will be described with reference to the flowchart shown in Fig. 17. Fig. 17 is a flowchart showing an example of the detailed process procedure of S1610 in Fig. 16. First, in S1701, the control unit 101 acquires motion detection information of the imaging device 1000 associated with the material video recorded in the recording unit 113, and sends it to the drive control unit 1101. The drive control unit 1101 then controls the drive unit 1001 to reproduce the motion in the motion detection information associated with the material video, and performs pan driving, tilt driving, etc. Note that if the motion detection information indicates that the user shot the video while manually moving the imaging device 1000 using camera work such as a dolly, and pan driving, tilt driving, etc. are not performed, the process proceeds to the next step S1702 without controlling the drive unit 1001.

[0071] Next, in S1702, subject detection unit 108 acquires information on the presence or absence and type of main subject in the video being shot, and sends it to drive control unit 1101. Furthermore, control unit 101 acquires information on the type of main subject of the material video recorded in recording unit 113, and sends it to drive control unit 1101. Then, drive control unit 1101 determines whether or not the main subject included in the video being shot matches the main subject in the material video recorded in recording unit 113. If the result of this determination is that the main subjects match, proceed to S1703, and if the main subjects do not match or there is no main subject in the video being shot, proceed to S1704.

[0072] In S1703, control unit 101 acquires a motion vector of the main subject in the material video recorded in recording unit 113, and sends it to drive control unit 1101. Also, motion vector detection unit 107 acquires a motion vector of the main subject in the video being shot, and sends it to drive control unit 1101. At this time, motion vector detection unit 107 acquires a motion vector that can be compared with the frames of the material video.

[0073] In this embodiment, the motion vectors are compared for each frame, but the motion vectors to be compared may be the average vector of the entire material video and the motion vector of the main subject in the video being shot. Also, the motion vectors to be compared may be the motion vector of the main subject in the video being shot and the motion vector of the main subject in the material video up to the frame to be compared. Also, if there is no frame to be compared in the material video for the shooting time of the video, the average vector of the entire material video may be used.

[0074] Drive control unit 1101 compares the motion vector of the main subject in the material moving image recorded in recording unit 113 with the motion vector of the main subject in the moving image being shot. Then, based on the compared information, drive control unit 1101 controls the driving of drive unit 1001. At this time, the drive control performed by drive control unit 1101 is performed so that the relative movement of the main subject due to the actual movement of the main subject at the time of shooting and the movement of imaging device 1000 at the time of shooting after adjustment matches the movement of the main subject in the material moving image. For example, in the main subject in FIG. 13 and the main subject in FIG. 15, since the main subject in FIG. 15 moves faster than the main subject in FIG. 13, the pan drive is adjusted to the left so that the main subject in FIG. 15 continues to be located in the center of the angle of view as in FIG. 13.

[0075] When the position of the main subject cannot be adjusted by pan driving, control unit 101 may notify the user by displaying a message to that effect on display unit 112. This prompts the user to adjust the position of the main subject during shooting by moving the main body of imaging device 1000 using camerawork or the like.

[0076] On the other hand, in S1704, the control unit 101 acquires the motion vector of the main subject in the material video recorded in the recording unit 113, and sends it to the drive control unit 1101. The motion vector detection unit 107 also acquires the motion vector of the background in the video being shot, and sends it to the drive control unit 1101. At this time, the motion vector detection unit 107 acquires a motion vector that can be compared with the frames of the material video, such as the relationship between frame 1301 and frame 1501.

[0077] The motion vectors to be compared may be the average vector of the entire material video and the motion vector of the background in the video being shot. The motion vectors to be compared may be the motion vector of the background in the video being shot and the motion vector of the main subject in the material video up to the frame to be compared. If there is no frame to be compared in the material video for the shooting time of the video, the average vector of the entire material video may be used.

[0078] The drive control unit 1101 compares the motion vector of the main subject in the material video recorded in the recording unit 113 with the motion vector of the background in the video being shot. Then, based on the compared information, the drive control unit 1101 controls the drive of the drive unit 1001. At this time, the drive control performed by the drive control unit 1101 is performed so that the actual movement of the background during shooting and the relative movement of the background due to the movement of the imaging device 1000 during shooting after adjustment match the movement of the main subject in the material video. For example, in the main subject in FIG. 13 and the background in FIG. 15, the background in FIG. 15 moves to the right, while the main subject in FIG. 13 continues to be contained in the center of the angle of view. Therefore, the pan drive is adjusted toward the right so that the background in FIG. 15 continues to be contained in the center of the angle of view like the main subject in FIG. 13.

[0079] When the position of the background cannot be adjusted by pan driving, the control unit 101 may notify the user by displaying a message to that effect on the display unit 112. This prompts the user to adjust the position of the background during shooting by moving the main body of the imaging device 1000 by camerawork or the like.

[0080] As a result, when a main subject is present in the subject information recorded in association with the material video, it is possible to control the driving of the imaging device to easily match the selected material video with the camera work. If the main subject is not present in the video at the time of shooting or the main subject does not match, the driving of the imaging device is adjusted using the motion vector of the background instead.

[0081] Next, in this embodiment, the control of driving of the imaging device when there is no main subject associated with the material video will be described. Fig. 18 is a flowchart showing an example of a processing procedure for controlling the driving of the imaging device 1000 when shooting the latter video for joining two videos and there is no main subject in the material video. Hereinafter, when a material video is selected, the processing starts.

[0082] In S1801, the control unit 101 acquires a recorded material video from the recording unit 113, and acquires information on the motion vector of the background recorded in association with the material video. Then, in S1802, the control unit 101 acquires information on the main subject, etc. from a live view image acquired from the imaging unit 105. At this time, the motion vector detection unit 107 detects a motion vector in the live view image, and the subject detection unit 108 detects the main subject. The information acquired in S1802 includes the presence or absence, type, position, size, and motion vector of the main subject, and the motion vector of the background.

[0083] Next, in S1803, the control unit 101 waits until it receives a shooting start operation from the user through the operation unit 111. Note that the control unit 101 may acquire information associated with the material video recorded in the recording unit 113 as preparation for shooting before receiving the shooting start operation. For example, when camera work information is associated with the material video, a message prompting camera work corresponding to the camera work information may be displayed as in the first embodiment. Also, the control unit 101 may start shooting a video when the background motion vector acquired in S1801 matches the background motion vector acquired in S1802. When the shooting start operation is received, the process proceeds to S1804.

[0084] In S1804, the control unit 101 starts capturing a moving image by the imaging unit 105. Then, in S1805, the control unit 101 controls the drive unit 1001 by the drive control unit 1101. Details of the process in S1805 will be described later.

[0085] In S1806, the control unit 101 waits until it receives an operation to end shooting by the user via the operation unit 111. When the operation to end shooting is received, the process proceeds to S1807. Then, in S1807, the control unit 101 causes the imaging unit 105 to end shooting.

[0086] Next, the process of S1805 in Fig. 18 will be described with reference to the flowchart shown in Fig. 19. Fig. 19 is a flowchart showing an example of the detailed process procedure of S1805 in Fig. 18. First, in S1901, the control unit 101 acquires motion detection information of the camera of the imaging device 1000 associated with the material video recorded in the recording unit 113, and sends it to the drive control unit 1101. The drive control unit 1101 then controls the drive unit 1001 so as to reproduce the motion in the motion detection information associated with the material video. Note that if the motion detection information indicates that the user shot the video while manually moving the imaging device 1000 using camera work such as tilt-up, and pan driving, tilt driving, or the like is not performed, the process proceeds to the next step S1902 without controlling the drive unit 1001.

[0087] In S1902, the subject detection unit 108 acquires information on the presence or absence of a main subject in the moving image being shot, and determines the presence or absence of a main subject. If the result of this determination is that a main subject is present, the process proceeds to S1903, and if not, the process proceeds to S1904.

[0088] In S1903, the control unit 101 acquires a motion vector of the background in the material video recorded in the recording unit 113, and sends it to the drive control unit 1101. The motion vector detection unit 107 also acquires a motion vector of the main subject in the video being shot, and sends it to the drive control unit 1101. At this time, the motion vector detection unit 107 acquires a motion vector that can be compared with the frames of the material video.

[0089] In this embodiment, the motion vectors are compared for each frame, but the motion vectors to be compared may be the average vector of the entire material video and the motion vector of the main subject in the video being shot. The motion vectors to be compared may be the motion vector of the main subject being shot and the motion vector of the background in the material video up to the frame to be compared. If there is no frame to be compared in the material video for the shooting time of the video, the average vector of the entire material video may be used.

[0090] Drive control unit 1101 compares the motion vector of the background in the material video recorded in recording unit 113 with the motion vector of the main subject in the video being shot. Then, based on the compared information, drive control unit 1101 controls the driving of drive unit 1001. At this time, the drive control performed by drive control unit 1101 is performed so that the relative movement of the main subject due to the actual movement of the main subject at the time of shooting and the movement of imaging device 1000 at the time of shooting after adjustment matches the movement of the background in the material video. For example, in the background of FIG. 13 and the main subject of FIG. 15, the main subject of FIG. 15 moves to the left, while the background of FIG. 13 moves to the right of the angle of view. Therefore, a large pan drive adjustment is performed toward the left so that the main subject of FIG. 15 moves to the right of the angle of view like the background of FIG. 13.

[0091] When the position of the main subject cannot be adjusted by pan driving, control unit 101 may notify the user by displaying a message to that effect on display unit 112. This prompts the user to adjust the position of the main subject during shooting by moving the main body of imaging device 1000 using camerawork or the like.

[0092] On the other hand, in S1904, the control unit 101 acquires a motion vector of the background in the material video recorded in the recording unit 113, and sends it to the drive control unit 1101. The motion vector detection unit 107 also acquires a motion vector of the background in the video being shot, and sends it to the drive control unit 1101. At this time, the motion vector detection unit 107 acquires a motion vector of a frame that can be compared with the frame of the material video.

[0093] The motion vectors to be compared may be the average vector of the entire material video and the motion vector of the background in the video being shot. The motion vectors to be compared may be the motion vector of the background in the video being shot and the motion vector of the background in the material video up to the frame to be compared. If there is no frame to be compared in the material video for the shooting time of the video, the average vector of the entire material video may be used.

[0094] The drive control unit 1101 compares the motion vector of the background in the material video recorded in the recording unit 113 with the motion vector of the background in the video being shot. Then, based on the compared information, the drive control unit 1101 controls the drive of the drive unit 1001. At this time, the drive control performed by the drive control unit 1101 is performed so that the relative movement of the background due to the background at the time of shooting and the movement of the imaging device 1000 at the time of shooting after adjustment matches the movement of the background in the material video. For example, in the background of FIG. 13 and the background of FIG. 15, the background of FIG. 15 moves to the right of the angle of view, and the background of FIG. 13 also moves to the right of the angle of view. Therefore, the pan drive is adjusted so that the background of FIG. 15 matches the moving speed of the background of FIG. 13.

[0095] When the position of the background cannot be adjusted by pan driving, the control unit 101 may notify the user by displaying a message to that effect on the display unit 112. This prompts the user to adjust the position of the background during shooting by moving the main body of the imaging device 1000 by camerawork or the like.

[0096] As a result, even if the main subject is not present in the subject information recorded in association with the material video images, it is possible to control the driving of the imaging device to easily match the selected video images with the camerawork.

[0097] (Other embodiments) Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0098] The disclosure of this embodiment includes the following configuration, method, and program.

[0099] (Configuration 1) An imaging device that captures a first moving image and a second moving image to be connected to the first moving image, A recognition means for recognizing camera work information when shooting the first moving image; a storage means for storing the camera work information recognized by the recognition means in association with the first moving image; a presentation means for presenting operation information for shooting the second video image based on camera work information associated with the first video image; An imaging device comprising:

[0100] (Configuration 2) a motion detection unit for detecting a motion of the imaging device; 2. The imaging device according to configuration 1, wherein the recognition means recognizes the camerawork information based on the movement detected by the movement detection means. (Configuration 3) 3. The imaging device according to configuration 1 or 2, wherein the presentation means presents, as the operation information, the same movement as camera work information associated with the first moving image. (Configuration 4) 3. The imaging device according to claim 1, wherein the presenting means presents, as the operation information, a movement in a direction opposite to the camera work information associated with the first moving image.

[0101] (Configuration 5) a detection unit for detecting a main subject from the first moving image, The imaging device described in configuration 3, wherein the presentation means presents, when a size of a main subject detected by the detection means is constant within a predetermined range in the first moving image, the same movement as camera work information associated with the first moving image as the operation information. (Configuration 6) further comprising a subject detection means for detecting a main subject from the first moving image; The imaging device described in configuration 4, wherein the presentation means presents, when the size of the main subject detected by the subject detection means changes beyond a predetermined range in the first video, a movement in a direction opposite to the camera work information associated with the first video as the operation information. (Configuration 7) A determination means for determining a scene from the first moving image is further provided, The imaging device described in configuration 4, characterized in that when the determination means determines that a scene in the first video to be connected to the second video is a specific scene, the presentation means presents movement in a direction opposite to the camera work information associated with the first video as the operation information.

[0102] (Configuration 8) An imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a motion vector detection means for detecting a motion vector of a main subject or a background from the first video sequence and the second video sequence; a storage means for storing motion vector information in the first video image detected by the motion vector detection means in association with the first video image; a control means for controlling driving of a direction or a zoom of the imaging device when capturing the second moving image, based on motion vector information associated with the first moving image and motion vector information detected by the motion vector detection means in the second moving image; An imaging device comprising:

[0103] (Configuration 9) further comprising a subject detection means for detecting the presence or absence and the type of a main subject in the first video and the second video; The imaging device described in configuration 8, characterized in that when the subject detection means detects a main subject that matches the main subject of the first moving image when shooting the second moving image, the control means controls to drive the orientation or zoom of the imaging device when shooting the second moving image based on motion vector information of the main subject associated with the first moving image and motion vector information of the main subject detected by the motion vector detection means in the second moving image. (Configuration 10) further comprising a subject detection means for detecting the presence or absence and the type of a main subject in the first video and the second video; The imaging device described in configuration 8, characterized in that when the subject detection means does not detect a main subject matching the main subject of the first moving image when shooting the second moving image, the control means controls to drive the orientation or zoom of the imaging device when shooting the second moving image based on motion vector information of the main subject associated with the first moving image and motion vector information of the background detected by the motion vector detection means in the second moving image.

[0104] (Configuration 11) further comprising a subject detection means for detecting the presence or absence and the type of a main subject in the first video and the second video; The imaging device described in configuration 8, characterized in that when the subject detection means does not detect a main subject in the first moving image and a main subject is detected in the second moving image, the control means controls driving an orientation or zoom of the imaging device when capturing the second moving image based on motion vector information of a background associated with the first moving image and motion vector information of the main subject detected by the motion vector detection means in the second moving image. (Configuration 12) further comprising a subject detection means for detecting the presence or absence and the type of a main subject in the first video and the second video; The imaging device described in configuration 8, characterized in that when the subject detection means does not detect a main subject in the first moving image and the main subject is not detected in the second moving image, the control means controls to drive an orientation or zoom of the imaging device when capturing the second moving image based on background motion vector information associated with the first moving image and background motion vector information detected by the motion vector detection means in the second moving image.

[0105] (Configuration 13) The imaging device of any one of configurations 9 to 12, characterized in that when a main subject matching the main subject of the first moving image is detected when shooting the second moving image, the control means performs control so as to match the position and size of the main subject with those of the first moving image before shooting the second moving image. (Configuration 14) The imaging device described in configuration 13, further comprising a notification means for notifying a user when the position and size of the main subject cannot be made to match those of the first moving image before the control means captures the second moving image. (Configuration 15) a motion detection unit that detects a motion of the imaging device when the first moving image is captured; The imaging device described in any one of configurations 8 to 14, characterized in that the control means further controls the orientation or zoom of the imaging device when capturing the second moving image based on the motion detected by the motion detection means.

[0106] (Configuration 16) The imaging device described in any one of configurations 8 to 15, further comprising a notification means for notifying a user that, when the control means is unable to drive the orientation or zoom of the imaging device to adjust the position of the main subject or background while the second moving image is being captured, the device is notified of this fact. (Configuration 17) The imaging device described in configuration 13, characterized in that the control means controls to start capturing the second moving image in response to matching the position and size of the main subject with those of the first moving image before capturing the second moving image. (Configuration 18) The imaging device described in configuration 12 or 13, characterized in that the control means controls to start shooting the second moving image in response to matching of motion vectors of the first moving image and a background before shooting the second moving image.

[0107] (Method 1) 1. A method for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, comprising the steps of: a recognition step of recognizing camera work information when shooting the first moving image; a storage step of storing the camera work information recognized by the recognition step in a storage means in association with the first moving image; a presentation step of presenting operation information for shooting the second video image based on camera work information associated with the first video image; 13. A method for controlling an imaging apparatus comprising: (Method 2) 1. A method for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, comprising the steps of: a motion vector detection step of detecting a motion vector of a main subject or a background from the first video sequence and the second video sequence; a storing step of storing, in a storage means, motion vector information in the first video image detected in the motion vector detecting step in association with the first video image; a control step of controlling the direction or zoom of the imaging device when capturing the second moving image based on motion vector information associated with the first moving image and motion vector information detected in the second moving image by the motion vector detection step; 13. A method for controlling an imaging apparatus comprising:

[0108] (Program 1) A program for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a recognition step of recognizing camera work information when shooting the first moving image; a storage step of storing the camera work information recognized by the recognition step in a storage means in association with the first moving image; a presentation step of presenting operation information for shooting the second video image based on camera work information associated with the first video image; A program for causing a computer to execute the following. (Program 2) A program for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a motion vector detection step of detecting a motion vector of a main subject or a background from the first video sequence and the second video sequence; a storing step of storing, in a storage means, motion vector information in the first video image detected in the motion vector detecting step in association with the first video image; a control step of controlling the direction or zoom of the imaging device when capturing the second moving image based on motion vector information associated with the first moving image and motion vector information detected in the second moving image by the motion vector detection step; A program for causing a computer to execute the following. [Explanation of symbols]

[0109] 101 control unit, 103 ROM, 105 imaging unit, 114 camera work determination unit, 115 operation information determination unit

Claims

1. 1. An imaging device that captures a first moving image and a second moving image to be connected to the first moving image, A recognition means for recognizing camera work information when shooting the first moving image; a storage means for storing the camera work information recognized by the recognition means in association with the first moving image; a presentation means for presenting operation information for shooting the second video image based on camera work information associated with the first video image; An imaging device comprising:

2. a motion detection unit for detecting a motion of the imaging device; 2. The imaging apparatus according to claim 1, wherein the recognition means recognizes the camerawork information based on the movement detected by the movement detection means.

3. The imaging device according to claim 1 , wherein the presenting means presents, as the operation information, the same movement as camera work information associated with the first moving image.

4. The imaging device according to claim 1 , wherein the presenting means presents, as the operation information, a movement in a direction opposite to the camera work information associated with the first moving image.

5. a detection unit for detecting a main subject from the first moving image, The imaging device of claim 3, wherein the presentation means presents as the operation information the same movement as the camera work information associated with the first moving image when the size of the main subject detected by the detection means is constant within a predetermined range in the first moving image.

6. a subject detection unit for detecting a main subject from the first moving image, The imaging device of claim 4, wherein the presentation means presents, as the operation information, a movement in a direction opposite to the camera work information associated with the first moving image when the size of the main subject detected by the subject detection means changes beyond a predetermined range in the first moving image.

7. a determination unit for determining a scene from the first moving image, The imaging device described in claim 4, characterized in that when the determination means determines that a scene in the first video to be connected to the second video is a specific scene, the presentation means presents movement in a direction opposite to the camera work information associated with the first video as the operation information.

8. 1. An imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a motion vector detection means for detecting a motion vector of a main subject or a background from the first video image and the second video image; a storage means for storing motion vector information in the first video image detected by the motion vector detection means in association with the first video image; a control means for controlling driving of a direction or a zoom of the imaging device when capturing the second moving image, based on motion vector information associated with the first moving image and motion vector information detected by the motion vector detection means in the second moving image; An imaging device comprising:

9. a subject detection unit for detecting the presence or absence and the type of a main subject in the first video and the second video, The imaging device described in claim 8, characterized in that when the subject detection means detects a main subject that matches the main subject of the first moving image when shooting the second moving image, the control means controls the orientation or zoom of the imaging device when shooting the second moving image based on motion vector information of the main subject associated with the first moving image and motion vector information of the main subject detected by the motion vector detection means in the second moving image.

10. a subject detection unit for detecting the presence or absence and the type of a main subject in the first video and the second video, The imaging device described in claim 8, characterized in that when the subject detection means does not detect a main subject matching the main subject of the first moving image when shooting the second moving image, the control means controls the orientation or zoom of the imaging device when shooting the second moving image based on motion vector information of the main subject associated with the first moving image and motion vector information of the background detected by the motion vector detection means in the second moving image.

11. a subject detection unit for detecting the presence or absence and the type of a main subject in the first video and the second video, The imaging device described in claim 8, characterized in that when the subject detection means does not detect a main subject in the first moving image and a main subject is detected in the second moving image, the control means controls the orientation or zoom of the imaging device when capturing the second moving image based on motion vector information of a background associated with the first moving image and motion vector information of the main subject detected by the motion vector detection means in the second moving image.

12. a subject detection unit for detecting the presence or absence and the type of a main subject in the first video and the second video, The imaging device described in claim 8, characterized in that when the subject detection means does not detect a main subject in the first moving image and the main subject is not detected in the second moving image, the control means controls the orientation or zoom of the imaging device when capturing the second moving image based on background motion vector information associated with the first moving image and background motion vector information detected by the motion vector detection means in the second moving image.

13. The imaging device of claim 9, characterized in that when a main subject matching a main subject of the first moving image is detected when shooting the second moving image, the control means performs control so as to match the position and size of the main subject with those of the first moving image before shooting the second moving image.

14. The imaging device according to claim 13, further comprising a notification means for notifying a user when the position and size of the main subject cannot be made to match those of the first moving image before the control means captures the second moving image.

15. a motion detection unit that detects a motion of the imaging device when the first moving image is captured; 9. The imaging device according to claim 8, wherein the control means further controls driving a direction or a zoom of the imaging device when capturing the second moving image based on the motion detected by the motion detection means.

16. The imaging device according to any one of claims 9 to 12, further comprising an alarm means for notifying a user that, when the control means is unable to drive the orientation or zoom of the imaging device to adjust the position of the main subject or the background while the second moving image is being captured, the image capturing device is further provided with an alarm means for notifying the user that a position of the main subject or the background cannot be adjusted.

17. The imaging device according to claim 13, characterized in that the control means controls to start capturing the second moving image in response to matching the position and size of the main subject with those of the first moving image before capturing the second moving image.

18. The imaging device according to claim 12 or 13, characterized in that the control means controls to start capturing the second moving image in response to a motion vector of the first moving image and a motion vector of a background being matched before the second moving image is captured.

19. 1. A method for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, comprising the steps of: a recognition step of recognizing camera work information when shooting the first moving image; a storage step of storing the camera work information recognized by the recognition step in a storage means in association with the first moving image; a presentation step of presenting operation information for shooting the second video image based on camera work information associated with the first video image; 13. A method for controlling an imaging apparatus comprising:

20. 1. A method for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, comprising the steps of: a motion vector detection step of detecting a motion vector of a main subject or a background from the first video image and the second video image; a storing step of storing, in a storage means, motion vector information in the first moving image detected in the motion vector detecting step in association with the first moving image; a control step of controlling the direction or zoom of the imaging device when capturing the second moving image, based on motion vector information associated with the first moving image and motion vector information detected in the second moving image by the motion vector detection step; 13. A method for controlling an imaging apparatus comprising:

21. A program for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a recognition step of recognizing camera work information when shooting the first moving image; a storage step of storing the camera work information recognized by the recognition step in a storage means in association with the first moving image; a presentation step of presenting operation information for shooting the second video image based on camera work information associated with the first video image; A program for causing a computer to execute the following.

22. A program for controlling an imaging device that captures a first moving image and a second moving image to be connected to the first moving image, a motion vector detection step of detecting a motion vector of a main subject or a background from the first video image and the second video image; a storing step of storing, in a storage means, motion vector information in the first moving image detected in the motion vector detecting step in association with the first moving image; a control step of controlling the direction or zoom of the imaging device when capturing the second moving image, based on motion vector information associated with the first moving image and motion vector information detected in the second moving image by the motion vector detection step; A program for causing a computer to execute the following.

Images