Imaging device and video editing device

Abstract

The present invention provides an imaging device that facilitates the capture of images that are subject to trimming. [Solution] The imaging device comprises an imaging unit that captures an image of a subject and generates image data, a control unit that displays the captured image shown by the image data on a display unit and controls image capture, and an operation unit that inputs user operations to adjust a cropping frame that indicates the range to be cropped in the captured image. The control unit sets the position and size of a plurality of cropping frames, each having a different aspect ratio, according to the user operations input to the operation unit, and displays the plurality of cropping frames on the captured image on the display unit at the set position and size.

Description

Technical Field

[0004] , , , , , , , , , , ,

[0003] , , ,

[0005]

[0001] The present disclosure relates to an imaging device that captures an image to be trimmed and a video editing device.

Background Art

[0002] Patent Document 1 discloses a camera that allows a user to select a trimming frame to be recorded in association with captured image data from a plurality of trimming frames that define a trimming range. The camera of Patent Document 1 switches each selected trimming frame and superimposes it on a live view image. The position and size of each trimming frame are predefined based on the center of the field of view. In this camera, the position and size of the currently displayed trimming frame selected by the user can be changed. Thereby, it is intended that the user can determine the composition while checking the relationship with the subject after selecting the trimming frame.

Prior Art Documents

[0006] In another embodiment of this disclosure, the imaging device includes an imaging unit that captures an image of a subject and generates image data, a control unit that displays the captured image shown by the image data on a display unit and controls image capture, and an operation unit that inputs user operations to adjust a cropping frame indicating the range to be cropped in the captured image. The operation unit receives touch operations on the captured image displayed on the display unit. The control unit sets the position and size of one or more cropping frames in response to the user operations input to the operation unit, and displays one or more cropping frames on the captured image on the display unit at the set position and size. The control unit updates at least one of the position and size of one of the cropping frames in response to a touch operation on one of the cropping frames displayed on the display unit. The control unit sets the focus target for autofocus operation in image capture in response to a touch operation on an area on the captured image different from one or more cropping frames.

[0007] In one aspect of this disclosure, a video editing device comprises a communication unit that communicates with an imaging device that shoots video, and a control unit that receives video data from the imaging device via the communication unit, and displays the video shown in the received video data on a display unit. The received video data includes metadata that manages the position and size set for each of a plurality of trimming frames, each indicating a range to be cut out from the video shooting result. Based on the metadata, the control unit displays the plurality of trimming frames on the video on the display unit at the respective set positions and sizes. Based on the position and size set for each of the plurality of trimming frames, the control unit generates video data showing the video cut out from the received video data according to one or more trimming frames.

[0008] In another embodiment of the present disclosure, an imaging device for shooting video includes an imaging unit that captures a subject image at a predetermined frame period and generates image data, a control unit that displays the captured image shown by the image data on a display unit and controls video shooting by the imaging device, and an operation unit that receives user input for adjusting a trimming frame that indicates the range to be cropped in the captured image. During video shooting, the control unit displays a plurality of trimming frames superimposed on the captured image on the display unit, and changes one or more of the trimming frames displayed on the display unit in response to user input to the operation unit.

[0009] In another embodiment of the present disclosure, an imaging device for shooting video includes an imaging unit that captures a subject image at a predetermined frame period and generates image data, a control unit that displays the captured image shown by the image data on a display unit and controls video shooting by the imaging device, an operation unit that inputs user operations to adjust a trimming frame that indicates the range to be cropped in the captured image, and a tracking unit that tracks the subject shown by the subject image during video shooting. During video shooting, the control unit displays a plurality of trimming frames superimposed on the captured image on the display unit, and changes one or more of the trimming frames displayed on the display unit according to the position and size of the subject being tracked by the tracking unit in the captured image. [Effects of the Invention]

[0010] The imaging device and video editing device described herein make it easier to capture images of images that are to be trimmed. [Brief explanation of the drawing]

[0011] [Figure 1] A diagram showing the configuration of the video production system according to Embodiment 1 of this disclosure. [Figure 2] Diagram showing the configuration of digital cameras in a video production system. [Figure 3] Diagram showing the back of a digital camera [Figure 4] Diagram showing the PC configuration in a video production system. [Figure 5] A diagram illustrating the overview of the operation of the digital camera in Embodiment 1. [Figure 6] A diagram illustrating the cropping frame setting function in digital cameras. [Figure 7] A diagram illustrating the size / position adjustment screen in a digital camera. [Figure 8] A flowchart illustrating the operation of a digital camera in the shooting standby state. [Figure 9] A flowchart illustrating the resizing / positioning process in a digital camera. [Figure 10] Diagram to explain how to resize the cropping frame. [Figure 11] Diagram to explain the operation of changing the position of the trimming frame. [Figure 12] Flowchart illustrating the recording process in the digital camera of Embodiment 1 [Figure 13] Flowchart illustrating the video editing process on a PC in Embodiment 1 [Figure 14] A diagram illustrating the function of cropping frame masks in digital cameras. [Figure 15] A diagram illustrating the custom aspect ratio setting function in digital cameras. [Figure 16]Flowchart illustrating the recording process in the digital camera of Embodiment 2 [Figure 17] Flowchart illustrating the video playback process in the PC of Embodiment 2 [Figure 18] Diagram for explaining the interlocking of size changes in a plurality of trimming frames according to Modification 1 of Embodiment 2 [Figure 19] Diagram for explaining the interlocking of position changes in a plurality of trimming frames according to Modification 1 of Embodiment 2 [Figure 20] Diagram showing the configuration of the digital camera according to Modification 2 of Embodiment 2

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, detailed descriptions that are more than necessary may be omitted. For example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art. The inventor provides the accompanying drawings and the following description so that those skilled in the art can fully understand the present disclosure, and does not intend to limit the subject matter described in the claims thereby.

[0013] (Embodiment 1) In Embodiment 1 of the present disclosure, a video production system that performs video shooting and editing of the shot video will be described.

[0014] 1. Configuration The video production system 1 in Embodiment 1 of the present disclosure will be described with reference to FIG. 1.

[0015] The video production system 1 of the present embodiment includes, for example, as shown in FIG. 1, a digital camera 100 and a personal computer (PC) 5 for video editing. In this system 1, the digital camera 100 and the PC 5 are connected so as to be capable of data communication by, for example, wired communication or wireless communication.

[0016] This system 1 can be applied, for example, to a user shooting a single video with a digital camera 100 and editing that single video into multiple videos with different aspect ratios by trimming. This system 1 provides a function to upload the edited video to information distribution platforms such as various social media, using a PC 5 connected to a communication network such as the internet.

[0017] In this system 1, the digital camera 100 records video data, including various metadata such as the aspect ratio used in video recording, based on the results of video recording. The video data recorded by the digital camera 100 is transferred to the PC 5, for example, by data communication, and edited in the PC 5 according to the upload destination platform. The data from the digital camera 100 may also be input to the PC 5 via a portable recording medium such as a memory card. Furthermore, the digital camera 100 and the PC 5 may communicate data via an access point or a communication network such as the Internet.

[0018] 1-1. Digital Camera Configuration The configuration of the digital camera in this embodiment will be explained with reference to Figure 2.

[0019] Figure 2 shows the configuration of the digital camera 100 in this system 1. The digital camera 100 is an example of an imaging device in this embodiment. The digital camera 100 illustrated in Figure 1 includes an image sensor 115, an image processing engine 120, a display monitor 130, and a control unit 135. Furthermore, the digital camera 100 includes a buffer memory 125, a card slot 140, a flash memory 145, an operation unit 150, and a communication module 165.

[0020] Furthermore, the digital camera 100 includes, for example, an optical system 110 and a lens drive unit 112. The optical system 110 and the lens drive unit 112 may constitute a detachable interchangeable lens for the digital camera 100 body.

[0021] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization (OIS) lens, an aperture, a shutter, etc. The focus lens is a lens for changing the focus state of the subject image formed on the image sensor 115. The zoom lens is a lens for changing the magnification of the subject image formed by the optical system. The focus lens, etc., are each composed of one or more lenses.

[0022] The lens drive unit 112 drives the focus lens and other components in the optical system 110. The lens drive unit 112 includes a motor and moves the focus lens along the optical axis of the optical system 110 based on the control of the control unit 135. The configuration for driving the focus lens in the lens drive unit 112 can be implemented using a DC motor, stepping motor, servo motor, or ultrasonic motor, etc.

[0023] The image sensor 115 captures an image of a subject formed through the optical system 110 and generates imaging data. The imaging data constitutes image data representing the image captured by the image sensor 115. The image sensor 115 generates image data of a new frame at a predetermined frame rate (e.g., 30 frames / second). The timing of image data generation and the operation of the electronic shutter in the image sensor 115 are controlled by the control unit 135. The image sensor 115 can use various image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor.

[0024] The image sensor 115 performs actions such as capturing still images, moving images, or through images. Through images are mainly moving images and are displayed on the display monitor 130 for the user to determine the composition for capturing still and moving images for recording. The image sensor 115 is an example of the imaging unit in this embodiment. A through image is an example of an image captured in this embodiment.

[0025] The image processing engine 120 performs various processes on the imaging data output from the image sensor 115 to generate image data, and also performs various processes on the image data to generate an image for display on the display monitor 130. Examples of various processes include, but are not limited to, white balance correction, gamma correction, YC conversion, electronic zoom, compression, and decompression. The image processing engine 120 may be composed of hardwired electronic circuits, or it may be composed of a microcomputer or processor using a program.

[0026] The display monitor 130 is an example of a display unit that displays various information. For example, the display monitor 130 displays an image (through image) represented by image data captured by the image sensor 115 and processed by the image processing engine 120. The display monitor 130 also displays a menu screen or the like for the user to make various settings for the digital camera 100. The display monitor 130 can be made of, for example, a liquid crystal display device or an organic EL device.

[0027] The operation unit 150 is a general term for the user interface that receives operations (instructions) from the user. The operation unit 150 includes, for example, physical buttons, levers, dials, touch panels, switches, joysticks, etc. It also includes virtual buttons and icons displayed on the display monitor 130. Specific examples of the operation unit 150 will be described later.

[0028] The control unit 135 provides overall control over the operation of the digital camera 100. The control unit 135 includes a CPU, and the CPU executes a program (software) to realize a predetermined function. The control unit 135 may also include a processor consisting of dedicated electronic circuits designed to realize a predetermined function, instead of a CPU. In other words, the control unit 135 can be realized with various processors such as a CPU, MPU, GPU, DSU, FPGA, and ASIC. The control unit 135 may consist of one or more processors. Alternatively, the control unit 135 may be configured on a single semiconductor chip together with the image processing engine 120, etc.

[0029] The buffer memory 125 is a recording medium that functions as work memory for the image processing engine 120 and the control unit 135. The buffer memory 125 is implemented using DRAM (Dynamic Random Access Memory) or the like. The flash memory 145 is a non-volatile recording medium. Each memory 145 and 125 is an example of a storage unit in this embodiment.

[0030] The card slot 140 is a means for inserting a removable memory card 142. The card slot 140 can electrically and mechanically connect to the memory card 142. The memory card 142 is an external memory equipped with recording elements such as flash memory. The memory card 142 can store data such as image data generated by the image processing engine 120. The digital camera 100 may store image data in its internal memory. The internal memory may be the buffer memory 125 or flash memory 145, or it may be provided separately from each of the memories 125 and 145.

[0031] The communication module 165 is a module (circuit) that connects to an external device according to a predetermined communication standard in wired or wireless communication. The predetermined communication standard includes, for example, USB, HDMI®, IEEE 802.11, Wi-Fi®, Bluetooth®, etc. The digital camera 100 can communicate with other devices via the communication module 165.

[0032] 1-1-1. About the control panel A specific example of the control unit 150 will be explained using Figure 3. Figure 3 is a diagram showing the back of the digital camera 100.

[0033] Figure 3 shows examples of the operation unit 150, including a release button 151, a selection button 152, a confirmation button 153, a dial 154, a touch panel 155, and a function (Fn) button 156. When the operation unit 150 receives an operation from the user, it transmits various instruction signals to the control unit 135.

[0034] The release button 151 is a two-stage press button. When the release button 151 is half-pressed by the user, the control unit 135 performs autofocus control (AF control) and auto exposure control (AE control), etc. When the release button 151 is fully pressed by the user, the control unit 135 records the image data captured at the time of the press as a recorded image on the memory card 142 or the like. In the digital camera 100, the function of starting recording video data by shooting video and the function of ending said recording may be assigned to the release button 151. In the operation unit 150, recording of video data may be started and / or ended by a button other than the release button 151.

[0035] The selection buttons 152 are push-buttons located in the up, down, left, and right directions. By pressing any of the selection buttons 152 in the up, down, left, or right directions, the user can select various condition items displayed on the display monitor 130 or move the cursor.

[0036] The OK button 153 is a push-button. When the OK button 153 is pressed by the user while the digital camera 100 is in either the shooting mode or playback mode, the control unit 135 displays a menu screen on the display monitor 130. The menu screen is for setting various conditions for shooting / playback. When the OK button 153 is pressed while a setting item for the various conditions is selected, the control unit 135 confirms the setting of the selected item.

[0037] The dial 154 is rotatable. By rotating the dial 154, the user can change various settings on the digital camera 100 and switch operating modes.

[0038] The touch panel 155 is positioned superimposed on the display screen of the display monitor 130 and detects touch operations on the display screen by the user's finger. This allows the user to specify areas of the image displayed on the display monitor 130 and perform various operations such as selections on the menu screen. For example, the touch panel 155 allows the user to specify an area corresponding to the focus target, such as a subject to be focused on by AF control during image capture, by touching the image.

[0039] The Fn button 156 is a push-button. In the digital camera 100, the user can assign any function specified by the user via the menu screen to the Fn button 156, and then press the Fn button 156 to execute that function.

[0040] 1-2. PC Configuration The configuration of PC5 in this embodiment will be explained with reference to Figure 4.

[0041] Figure 4 is a diagram illustrating the configuration of PC5 in this system 1. PC5 is an example of a video editing device in this embodiment. The PC5 illustrated in Figure 4 comprises a control unit 50, a storage unit 51, a display unit 52, an operation unit 53, a device interface 54, and a network interface 55. Hereinafter, "interface" will be abbreviated as "I / F".

[0042] The control unit 50 is electrically connected to each part of the PC5 and controls the operation of each part. The control unit 50 includes a CPU, and the CPU executes a program (software) to realize a predetermined function. The control unit 50 may be realized solely by hardware circuits specifically designed to realize a predetermined function. In addition to a CPU, the control unit 50 can be composed of various circuits such as an MPU, GPU, DSP, FPGA, or ASIC. The control unit 50 may be equipped with internal memory as a temporary storage area for various data and programs.

[0043] The storage unit 51 is a recording medium that stores data and programs necessary to realize predetermined functions in the PC 5. The storage unit 51 is composed of, for example, a hard disk drive (HDD), a solid-state storage device (SSD), or a semiconductor memory (RAM). The storage unit 51 may function as a work area for the control unit 50, or it may be composed of a storage area in the internal memory of the control unit 50. The storage unit 51 stores, for example, a program that makes the PC 5 function as the video editing device of this disclosure. For example, this program is executed by the control unit 50, causing the control unit 50 to execute a video editing method including various processes in the PC 5. The storage unit 51 may also store NLE (Non-linear editing) software used for video editing in the PC 5.

[0044] The display unit 52 is composed of, for example, a liquid crystal display or an organic EL display. The display unit 52 displays video data received from the digital camera 100. The display unit 52 may also display various icons for operating the operation unit 53 and information input from the operation unit 53.

[0045] The operation unit 53 is a general term for the operating components that the user operates. The operation unit 53 includes, for example, a keyboard, mouse, touchpad, buttons and / or switches. The operation unit 53 may also constitute a touch panel together with the display unit 52. When the operation unit 53 receives an operation from the user, it transmits an operation signal corresponding to the user operation to the control unit 50.

[0046] The device interface 54 is a circuit for connecting an external device, such as a digital camera 100, to the PC 5. The device interface 54 performs communication compliant with the USB standard or Bluetooth standard, etc. In this embodiment, the device interface 54 receives various information from and transmits various information to an external device, for example, by communication compliant with the USB standard, according to the control of the control unit 50. The device interface 54 is an example of a communication unit in the PC 5 of this embodiment.

[0047] Network I / F55 is a circuit that performs communication compliant with communication standards such as IEEE 802.11 or Wi-Fi. PC5 can communicate with other devices directly or via an access point through Network I / F55. Network I / F55 may be connectable to a communication network. Network I / F55 may constitute the communication unit in PC5, either in place of or in addition to Device I / F54.

[0048] 2.Operation The operation of System 1, configured as described above, will be explained below.

[0049] In this system 1, when the user is shooting a video, the digital camera 100 checks the range that will be cropped from the resulting video after shooting and makes it possible to adjust that range. The overview of the operation of the digital camera 100 in this embodiment will be explained with reference to Figure 5.

[0050] When the digital camera 100 is in shooting mode, it displays a live view image in real time on the display monitor 130. In this embodiment, the digital camera 100 displays cropping frames 11 to 13, which are set, for example, by the settings menu, on the image on the live view screen. Each of the cropping frames 11 to 13 indicates the range to be extracted from the resulting video. Hereinafter, the longer side of the display monitor 130 screen will be referred to as the X direction (also called the horizontal direction), and the shorter side will be referred to as the Y direction (also called the vertical direction).

[0051] As illustrated in Figure 5, the display monitor 130 displays multiple cropping frames 11 to 13 on the same screen in different display modes (e.g., frame color or line type). Each cropping frame 11 to 13 is set to indicate the outer edge of the area to be cropped rectangularly from the image, for example, corresponding to the aspect ratio of width to height. In the digital camera 100 of this embodiment, by simultaneously displaying multiple cropping frames 11 to 13 on the live view screen, the user can shoot video while imagining the composition after cropping with each cropping frame 11 to 13.

[0052] For example, it is possible to shoot videos for various platforms at once, assuming that multiple videos will be generated from the shooting result, each extracted using trimming frames 11-13 set according to the various platforms to which the edited video will be uploaded.

[0053] The digital camera 100 of this embodiment accepts user operations to adjust the position and / or size of the trimming frames 11-13 displayed on the live view screen, for example, in the shooting standby state before performing a video recording operation. Through such adjustment operations, the trimming range of each trimming frame 11-13 can be adjusted by moving or resizing the trimming frames 11-13 on the live view screen according to the subject and other trimming frames. This makes it easier to shoot videos with the intention of trimming the resulting footage.

[0054] 2-1. Setting the cropping frame The digital camera 100 of this embodiment provides a function that allows the user to set trimming frames 11 to 13 in advance via a settings menu, for example, before recording a video. The outline of this setting function will be explained below with reference to Figures 6 and 7.

[0055] Figure 6 is a diagram illustrating the cropping frame setting function in the digital camera 100. Figure 6(A) shows an example of the display of the setting menu screen for setting various information related to cropping frames 11 to 13 in the digital camera 100. In this example, the display monitor 130 displays menu items such as "Frame 1," "Frame 2," and "Frame 3," which correspond to cropping frames 11, 12, and 13 respectively, as well as "Cropping Frame Mask" and "Cropping Frame Touch Operation."

[0056] The "Cropping Frame Mask" menu item allows you to set a masking function (described later) for the area outside of cropping frames 11-13 on the live view screen. "Cropping Frame Touch Operation" enables / disables touch operation on the frame lines of cropping frames 11-13 on the touch panel 155. For example, the digital camera 100 stores setting information showing the results of these various settings in a buffer memory 125 or the like.

[0057] In this example, the menu item "Frame 1" is set to "2.39:1," which indicates the aspect ratio of the corresponding trimming frame 11. The menu items "Frame 2" and "Frame 3" are set to "OFF," which disables the display of the corresponding trimming frames 12 and 13. In this embodiment, the menu items "Frame 1" to "Frame 3" are provided to allow setting attributes such as the aspect ratio for the corresponding trimming frames 11 to 13. Figure 6(B) illustrates the settings screen for trimming frame 11, which is accessed when the menu item "Frame 1" is selected in the settings menu screen of Figure 6(A).

[0058] In the settings screen shown in Figure 6(B), the display monitor 130 displays "Aspect Ratio," "Frame Color," and "Size / Position Settings" as menu items. When the menu item "Aspect Ratio" is selected by the operation unit 150, the display monitor 130 displays a selection list 4 containing multiple different aspect ratio options. The digital camera 100 sets the aspect ratio cropping frame 11 to the setting information according to the selection result from selection list 4. "OFF" in selection list 4 is an option to disable the display of the cropping frame 11.

[0059] The "Frame Color" menu item allows the user to set the color of the frame line as part of the display method of the trimming frame 11 on the live view screen. When the "Size / Position Setting" menu item is selected, the display monitor 130 transitions from the settings screen shown in Figure 6(B) to a size / position change screen, such as the one shown in Figure 7, for adjusting the size and / or position of the trimming frame 11 according to user operation. In this embodiment, the size and position are set for a trimming frame with a set aspect ratio.

[0060] Furthermore, in this embodiment, if "Trimming Frame Touch Operation" is ON in the settings menu screen shown in Figure 6(A), the digital camera 100 will also transition the display monitor 130 to the size / position change screen by touching any of the trimming frames 11 to 13 on the live view screen. Details of this transition to the size / position change screen will be described later.

[0061] Furthermore, in each of the screens illustrated in Figures 6(A) and (B), the display monitor 130 displays a return button 44 as a virtual button that accepts the user's back operation. The back operation is a user operation that returns from the current screen to the previous screen by touching the return button 44.

[0062] 2-1-1. Size / Position Settings In the digital camera 100, the details of the setting function on the size / position change screen, which allows setting the size and position of cropping frames 11 to 13, will be explained using Figure 7. Figure 7 is a diagram illustrating the size / position change screen in the digital camera 100.

[0063] Figure 7 shows an example of transitioning to the size / position change screen by selecting the "Size / Position Settings" menu item in the settings screen for the cropping frame 11 shown in Figure 6(B), or by touching the cropping frame 11 on the live view screen in Figure 5, as in the example in Figure 5. In this example, the cropping frame 11 is displayed in a different manner from the other cropping frames 12 and 13 as the target for size / position change.

[0064] In the size / position change screen of this example, the display monitor 130 displays a position display area 21 and a size display area 22, as well as virtual buttons: a reset button 24, a frame switching button 25, a return button 44, and an exit button 45. The display monitor 130 further displays a size operation area 26 and a position operation area 27 for the trimming frame 11. The size operation area 26 is the area for inputting size change operations on the change screen, and the position operation area 27 is the area for inputting position change operations. Size change operations and position change operations are user operations that change the size and position of the object to be changed, respectively, and are input by, for example, dragging on the touch panel 155.

[0065] The cropping frame 11 is displayed such that, for example, in its initial state, the center of the frame coincides with the center of the screen and the longer side of the frame is the same size as the longer side of the screen. The position display area 21 shows the amount of movement of the cropping frame 11 in the X and Y directions in pixels, with the initial position as the reference point (X=0, Y=0). The size display area 22 shows the magnification by which the size of the cropping frame 11 has been changed from its initial state, with the initial size being "100%". The reset button 24 accepts touch operation to return the size and position to their initial state.

[0066] The frame switching button 25 accepts touch operations to sequentially switch between the trimming frames selected from multiple trimming frames 11 to 13 as the target for size and position changes. For example, if the frame switching button 25 is operated while trimming frame 11 is the target for change, as shown in Figure 7, in the order corresponding to the menu items "Frame 1" to "Frame 3" on the settings menu screen shown in Figure 6(A), the target for change will be switched to trimming frame 12.

[0067] In this embodiment, when the digital camera 100 receives a return operation via the return button 44 on the size / position change screen, for example, it transitions the display monitor 130 to the live view screen without saving the size and position changes. On the other hand, when the digital camera 100 receives a touch operation of the exit button 45 via the touch panel 155, it confirms the changes on the size / position change screen, saves them in the buffer memory 125, etc., and then terminates the size / position setting function.

[0068] In the example above, the digital camera 100 displayed a size / position change screen for each cropping frame 11-13 by selecting a menu item or performing a touch operation on the live view screen. The digital camera 100 may, for example, assign a function similar to the selection of the menu item above to the Fn button 156, depending on user settings, and the screen transition may be performed by a user operation of pressing the Fn button 156. In this case, for example, each time the Fn button 156 is pressed, the target for change in the cropping frames 11-13 may be switched sequentially.

[0069] 2-2. Operation in shooting standby state The digital camera 100 of this embodiment performs operations that simultaneously perform size / position change processing in response to user operations on the size / position change screen described above and AF control processing in response to touch operations on the object to be focused, for example, in the shooting standby state before shooting video. The operation of this digital camera 100 will be explained with reference to Figure 8.

[0070] Figure 8 is a flowchart illustrating the operation of the digital camera 100 in the shooting standby state. The processes shown in Figure 8 are started, for example, when the digital camera 100 is set to shooting mode. Each process in Figure 8 is executed by the control unit 135 while the live view screen is displayed on the display monitor 130.

[0071] First, the control unit 135 displays all of the set trimming frames 11-13, etc., on the live view screen of the display monitor 130, as shown in Figure 5, based on the setting information from the setting function described above (S1). The setting function may be executed at any time in parallel with the processing in this flowchart.

[0072] The control unit 135 determines whether or not a touch operation has been input via the touch panel 155 on the live view screen (S2). If no touch operation has been input (NO in S2), the control unit 135 repeats the processing from step S1 onwards at a predetermined period, such as the frame period.

[0073] If a touch operation is input (YES in S2), the control unit 135 determines whether the touched area on the live view screen is on the border of one of the trimming frames 11 to 13 (S3). The control unit 135 determines whether such a touched area is on the border based, for example, on its position in the X and Y directions.

[0074] If the touch location is on the frame line (YES in S3), the control unit 135 determines, based on the setting information, whether the setting for trimming frame touch operation (see Figure 6(A)) is ON or OFF, that is, whether the touch operation is enabled or OFF (S4).

[0075] If the setting for touch operation of the trimming frame is ON (YES in S4), the control unit 135 transitions the display monitor 130 from the live view screen to the size / position change screen and performs the size / position change process (S5). The control unit 135 displays the size / position change screen with the trimming frame corresponding to the touched location among the trimming frames 11 to 13 displayed on the live view screen in step S1 as the target for modification. Details of the size / position change process will be described later.

[0076] On the other hand, if the touch location is not on the frame line of any of the trimming frames 11 to 13 (NO in S3), the control unit 135 determines, based on the setting information, whether or not the AF control setting corresponding to the touch operation of the object to be focused on is ON (S6). In this embodiment, the digital camera 100 allows the user to enable or disable such touch AF by setting it ON / OFF via the operation unit 150, for example, in the settings menu.

[0077] Furthermore, even if the touch point is on the frame line (YES in S3), if the setting for trimming frame touch operation is not ON (NO in S4), the control unit 135 makes the decision in step S6.

[0078] If the touch AF setting is ON (YES in S6), the control unit 135 performs AF control according to the touch location (S7). In this touch AF processing, for example, the lens drive unit 112 drives the focus lens of the optical system 110 with the subject that appears in the area corresponding to the touch location in the through image as the focus target.

[0079] After performing the size / position change process (S5) or the touch AF process (S7), the control unit 135 terminates the process in this flowchart. The control unit 135 also terminates the process in this flowchart if the touch AF setting is not ON (NO in S6). Subsequently, the control unit 135 repeats the process in this flowchart at a predetermined period, such as the frame rate.

[0080] Following the above process, all set trimming frames 11-13 are displayed on the live view screen (S1), and in response to a touch operation on any of the frame lines on the screen (S2-S4), the size / position change process can be executed (S5). This allows for efficient size / position change processing without having to go through settings menus, for example, from the live view screen, and enables intuitive specification of the target to be changed for the user.

[0081] Furthermore, in this embodiment, if the setting for touch operation on the cropping frame is ON (YES in S4), when a touch operation is input on the frame line (YES in S3), the size / position change process is executed regardless of the touch AF setting (S5). This allows the size / position change process to take precedence over the touch AF process for touch operations on the frame line. For example, if cropping frames 11 to 13 are set to surround the subject, it is expected that touch operations on the focus target will tend to be input within the frame. In this embodiment, by performing touch AF processing with touch operations other than on the frame line (NO in S3, S7), two processes corresponding to touch operations on the live view screen can be used in combination.

[0082] The above example describes a scenario where all trimming frames 11-13 in the settings information are displayed on the live view screen (S1). For example, if you transition to the size / position change screen by selecting a menu item from the settings screen for each trimming frame (see Figure 6(B)), only the trimming frame to be changed may be displayed on the live view screen.

[0083] 2-3. Resizing / Positioning Process The details of the size / position change process in step S5 of Figure 8 will be explained using Figures 9 to 11.

[0084] Figure 9 is a flowchart illustrating the size / position change process in the digital camera 100. The process in this flowchart begins when, for example, one of the cropping frames 11 to 13 is selected as the target for change by touching the frame line, and the size / position change screen is displayed on the display monitor 130. The following describes an example where cropping frame 11 is selected.

[0085] First, the control unit 135 determines whether or not a resizing operation for the object to be changed has been input to the operation unit 150 (S11). Figure 10 is a diagram illustrating the resizing operation of the trimming frame.

[0086] For example, as shown in Figure 10(A), the operation unit 150 receives a user operation as a resizing operation on the touch panel 155, in which the user drags the resizing area 26 on the display monitor 130 in the diagonal direction of the screen. Figure 10(B) shows an example in which the size of the trimming frame 11 is enlarged by dragging the resizing area 26 from the state shown in Figure 10(A). In this example, the size is enlarged by dragging in the direction away from the center of the trimming frame 11, and the size is reduced by dragging in the direction towards the center. The resizing operation may also be a user operation such as rotating the dial 154. For example, the size of the trimming frame 11 may be enlarged or reduced depending on the direction of rotation of the dial 154.

[0087] If a resize operation is input (YES in S11), the control unit 135 changes the size of the trimming frame 11 according to the input operation (S12). The control unit 135 updates the display of the trimming frame 11 and the size display field 22 on the size / position change screen of the display monitor 130 (see Figure 7) to the changed size. A predetermined lower limit (for example, "20%" in the initial state) may be set for the changeable size. If the size corresponding to the position change operation is less than the lower limit, the control unit 135 may change the size of the trimming frame 11 to the lower limit.

[0088] If no resizing operation is input (NO in S11), the control unit 135 determines whether or not a position change operation for the target to be changed has been input in the operation unit 150 (S13). Figure 11 is a diagram illustrating the position change operation of the trimming frame.

[0089] For example, as shown in Figure 11(A), the operation unit 150 receives a user operation to change the position on the touch panel 155, which is dragging the position operation area 27 on the display monitor 130. Figure 11(B) shows an example in which the trimming frame 11 is moved in the -X and -Y directions by dragging the position operation area 27 from the state shown in Figure 11(A). In this example, the position of the trimming frame 11 is changed so that the position to which the position operation area 27 was moved by the drag operation becomes the center of the trimming frame 11. The position change operation may be a user operation by pressing one of the selection buttons 152 in the up, down, left, or right direction, or it may be input using the joystick of the operation unit 150.

[0090] If a position change operation is input (YES in S13), the control unit 135 changes the position of the trimming frame 11 according to the input operation (S14). The control unit 135 updates the display of the trimming frame 11 and the position display field 21 on the size / position change screen of the display monitor 130, for example, to the changed position.

[0091] After changing the size of the trimming frame 11 (S12) or changing its position (S14), the control unit 135 determines whether or not a touch operation of the end button 45 has been input on the touch panel 155 (S15).

[0092] If the exit button 45 is touched (YES in S15), the control unit 135 updates the trimming frame information for the trimming frame 11 to be modified according to the changes made in steps S12 and S14 (S16). The trimming frame information refers to the information set for each of the trimming frames 11 to 13 from the setting information held in the buffer memory 125, etc., and includes the aspect ratio, size, and position of each.

[0093] If no touch operation is performed on the exit button 45 (NO in S15), the control unit 135 repeats the processing from step S11 onwards for, for example, the trimming frame 11 to be modified.

[0094] On the other hand, if, for example, no position change operation is input (NO in S13), the control unit 135 determines whether or not a touch operation of the frame switching button 25 has been input on the touch panel 155 (S17). If no touch operation of the frame switching button 25 has been input (NO in S17), the control unit 135 makes the determination in step S15 according to the touch operation of the exit button 45.

[0095] If a touch operation is input for the frame switching button 25 (YES in S17), the control unit 135 switches the target to be changed in the trimming frames 11 to 13 (S18). In this example, the control unit 135 switches the target to be changed from trimming frame 11 to trimming frame 12 and updates the display of the size / position change screen on the display monitor 130. After the switch, the control unit 135 repeats the processing from step S11 onwards for trimming frame 12.

[0096] In response to a touch operation of the exit button 45 (S15), the control unit 135 updates the trimming frame information (S16), terminates the processing of this flowchart, and returns to step S1 in Figure 8. As a result, the trimming frames 11-13 are displayed on the live view screen (S1) based on the setting information including the updated trimming frame information, and the user can visualize, for example, the relationship between the positions and sizes of the set trimming frames 11-13.

[0097] Through the above process, the size and / or position of the object to be modified, selected from the trimming frames 11 to 13, can be changed according to user operations on the size / position change screen illustrated in Figure 7.

[0098] In the above process, if the control unit 135 receives a touch operation of the return button 44 on the size / position change screen, it terminates the process of this flowchart without updating the trimming frame information (S16) and returns to step S1 in Figure 8. In this case, the changes to the size and position are not saved. If the reset button 24 is touched, the control unit 135 resets the size and position to their initial state and continues the process of this flowchart.

[0099] 2-4. Recording of trimming frame information The digital camera 100 of this embodiment records the trimming frame information of the trimming frames 11 to 13, which are adjusted before the video recording operation by the size / position change processing described above, in association with the resulting video. This recording process in the digital camera 100 will be explained with reference to Figure 12.

[0100] Figure 12 is a flowchart illustrating the recording process in the digital camera 100 of this embodiment. The process in this flowchart is initiated, for example, by fully pressing the shutter release button 151, along with the video recording operation, and each process is executed by the control unit 135 of the digital camera 100.

[0101] The control unit 135 determines whether the shooting operation has ended, for example, by whether or not the release button 151 is fully pressed while the video shooting operation is in progress (S21).

[0102] When the shooting operation is completed (YES in S21), the control unit 135 records the latest trimming frame information held in the buffer memory 125 in the metadata of the video data indicating the shooting result (S22). The metadata in the video data is header information that includes various information such as the settings at the time of shooting, and is associated with the shooting result to manage the position and size set for each trimming frame 11 to 13. This metadata may be recorded in a format such as an extended version of Exif (Exchangeable image file format).

[0103] The control unit 135 records the video data, including metadata, generated from the shooting results onto the memory card 142 (S23). After that, the control unit 135 terminates the processing of this flowchart.

[0104] According to the above process, when the video recording operation is completed, the trimming frame information of the trimming frames 11 to 13, whose size and / or position have been adjusted by the size / position change process in the recording standby state, is associated as metadata, and the video data can be recorded. For example, in the video production system 1 of this embodiment, the video data including such metadata is transferred from the digital camera 100 after video recording to the PC 5 via the communication module 165. The operation of the PC 5 in this system 1 will be described below.

[0105] 2-5. Video Editing Process The PC5 of this system 1 performs video editing processing, such as trimming videos captured by the digital camera 100. Figure 13 is a flowchart illustrating the video editing processing in the PC5 of this embodiment. The processing in this flowchart is started, for example, in response to a predetermined user operation that calls a video editing function in the PC5. Each process in Figure 13 is executed by the control unit 50 of the PC5.

[0106] First, the control unit 50 acquires video data recorded on the memory card 142 from the digital camera 100, which is connected, for example via the device interface 54 (S31). The video data is stored in the storage unit 51, etc. The control unit 50 may also acquire video data via a communication network using the network interface 55. In the digital camera 100, the video data generated as a result of video shooting may be transmitted to the PC 5 in addition to, or instead of, being recorded to the memory card 142.

[0107] Next, the control unit 50 displays all the trimming frames 11 to 13 recorded in the metadata on the display unit 52, based on the acquired video data, so as to be superimposed on the video shown by the video data (S32).

[0108] The control unit 50 determines whether a trimming frame has been selected based on whether a user operation has been input at the operation unit 53 to select one or more of the trimming frames 11 to 13 displayed on the display unit 52 (S33). If no trimming frame has been selected (NO in S33), the control unit 50 repeats the determination in step S33, for example, at a predetermined interval. If no such user operation is input before the video playback ends, the control unit 135 may terminate the processing of this flowchart without executing the subsequent processes.

[0109] If a trimming frame is selected (YES in S33), the control unit 50 generates trimmed video data showing the video extracted from the captured video according to the trimming frame, for example, based on the position and size of the trimming frame in the metadata (S34). If two or more trimming frames are selected, the control unit 50 generates trimmed video data for each trimming frame.

[0110] After generating the trimmed video data (S34), the control unit 50 terminates the processing of this flowchart.

[0111] Through the above processing, when playing back the video data acquired from the digital camera 100 on the PC 5, the trimming frames 11-13 that were displayed at the time of shooting the video data can be displayed. For example, even if the user does not remember the trimming frames 11-13 used at the time of shooting, the intended composition can be reproduced by displaying the trimming frames 11-13 during video playback, making video editing easier. Furthermore, in the video production system 1, even if the videographer and editor are different people, video editing can be made easier by displaying the trimming frames 11-13 using this metadata.

[0112] Furthermore, trimmed video data can be generated from the resulting video using the trimming frames 11-13 displayed during shooting, allowing for efficient video editing to create videos with the user's intended composition. Additionally, trimmed video data can be generated using one or more trimming frames selected by the user from the multiple trimming frames 11-13 displayed on the video, allowing the user to review the shooting results and trim using the desired trimming frame. For example, if two or more trimming frames are selected, videos extracted in multiple aspect ratios corresponding to each trimming frame can be obtained simultaneously.

[0113] In the example above, video editing processing was performed by PC5. In the video production system 1, the same video editing processing as above may be performed by the digital camera 100. In this case, the control unit 135 of the digital camera 100 may acquire the video data recorded on the memory card 142 and perform the same processing as in steps S32 to S34 by controlling the display monitor 130 and the operation unit 150.

[0114] 2-6. Details of setting functions in digital cameras The digital camera 100 of this embodiment provides various functions to make it easier for the user to adjust the cropping range, in addition to the cropping frame setting function 11 to 13 via the setting menu illustrated in Figure 6. Details of these setting functions will be explained using Figures 14 and 15.

[0115] Figure 14 is a diagram illustrating the function of the cropping frame mask in the digital camera 100. Figure 14(A) shows the settings screen that is accessed when the "Cropping Frame Mask" menu item is selected from the settings menu screen shown in Figure 6(A), for example. When the digital camera 100 is in shooting mode, for example, it provides a masking function that masks the area outside the cropping frames 11-13 on the live view screen displayed on the display monitor 130.

[0116] In the settings screen illustrated in Figure 14(A), the display monitor 130 shows a selection list 6 containing options for the opacity rate of the area to be masked by the masking function, and a return button 44. Among the options in selection list 6, "100%" indicates that the background of the masked area is not transparent. "OFF" is an option that disables the masking function, corresponding to an opacity rate of "0%".

[0117] Figure 14(B) shows an example of the display on the display monitor 130 in shooting mode when the masking function is enabled, in addition to the cropping frames 11-13 similar to the example in Figure 5. For example, as shown in Figure 14(B), the display monitor 130 masks areas on the screen that are not included in any of the areas enclosed by each cropping frame 11-13 according to the set occlusion rate. This masking function makes the area cropped by the cropping frames 11-13 easier for the user to see. For example, when the size and / or position of the cropping frames 11-13 are changed by a size / position change process (S12, S14), the masked area is also updated according to the change.

[0118] Figure 15 is a diagram illustrating the custom aspect ratio setting function in the digital camera 100. When the "Size / Position Setting" menu item is selected on the setting screen for the cropping frame 11 (Figure 6(B)), and then the "Custom" option is selected from the selection list 4, the digital camera 100 transitions the display monitor 130 to the setting screen shown in Figure 15.

[0119] In the example shown in Figure 15, the display monitor 130 displays aspect control areas 28a and 28b at the midpoints of the two sides of the trimming frame 11. For example, as shown in Figure 15(A), the control unit 135 changes the aspect ratio of the trimming frame 11 in the Y direction by a user operation of dragging the aspect control area 28a in the Y direction on the touch panel 155. Figure 15(B) shows an example in which the trimming frame 11 is enlarged in the Y direction from the state in Figure 15(A).

[0120] Furthermore, as shown in Figure 15(C), the control unit 135 changes the aspect ratio of the trimming frame 11 in the X direction by a user operation of dragging the aspect ratio manipulation area 28b in the X direction. Figure 15(D) shows an example in which the trimming frame 11 is enlarged in the X direction from the state in Figure 15(C).

[0121] With the custom aspect ratio setting function described above, users can set their desired aspect ratio for each cropping frame 11-13, rather than being limited to the options included in the pre-selected list 4, making it easier to perform cropping in accordance with the user's intentions.

[0122] 3. Summary As described above, in this embodiment, the digital camera 100, which is an example of an imaging device, comprises an image sensor 115, which is an example of an imaging unit that captures an image of a subject and generates image data, a control unit 135, and an operation unit 150. The control unit 135 controls image capture by displaying the captured image indicated by the image data on the display monitor 130. The operation unit 150 receives user input to adjust the cropping frames 11 to 13 that indicate the range to be cropped in the captured image (S2 to S5). In response to the user input to the operation unit 150, the control unit 135 sets the position and size of the multiple cropping frames 11 to 13, each having a different aspect ratio, and displays the multiple cropping frames on the captured image on the display monitor 130 at the set position and size (S1, S5).

[0123] With the digital camera 100 described above, multiple cropping frames 11-13, each having a different aspect ratio, are set according to user adjustments and simultaneously displayed on the captured image, such as the live view screen on the display monitor 130 (S1-S5, see Figure 7). In this way, the multiple cropping frames 11-13, set according to user operation, are visualized on the captured image at their respective positions and sizes. This makes it easier to capture images for cropping with multiple aspect ratios from a single shooting result. For example, the user can adjust the position and size relationship of the multiple cropping frames 11-13, making it easier to obtain images cropped with the desired composition according to the aspect ratio of each cropping frame 11-13. Furthermore, these cropped compositions can be visualized during shooting to support cropping from the image capture result.

[0124] In this embodiment, the operation unit 150 receives touch operations on the captured image displayed on the display monitor 130. The control unit 135 updates at least one of the position and size of one of the multiple trimming frames 11 to 13 displayed on the display monitor 130 in response to a touch operation on that trimming frame (S2 to S5, S11 to S14). This allows the user to adjust the position and / or size of the trimming frame selected by touch from the multiple trimming frames 11 to 13, making it easier to adjust the trimming frames 11 to 13 displayed on the live view screen or the like.

[0125] In this embodiment, the control unit 135 sets the focus target by AF control, which is an example of autofocus operation in image capture, in response to touch operations on areas different from each of the cropping frames 11 to 13 on the captured image (S3, S7). As a result, AF control in response to touch operations on the subject to be focused and size / position change processing in response to touch operations on each of the cropping frames 11 to 13 (S5) can be used in combination depending on the area touched on the captured image (see S2 to S4).

[0126] In this embodiment, the operation unit 150 receives user input to select the aspect ratio of each of the multiple trimming frames 11 to 13 from a selection list 4, which is an example of multiple options (see Figure 6(B)). The control unit 135 sets the position and size of the trimming frame for which the aspect ratio has been set according to the user input to the operation unit 150 (see S1, S5, Figures 6(A), (B)). As a result, the aspect ratio of each of the trimming frames 11 to 13 can be set by user input, and for example, the position and size can be set for each of the trimming frames 11 to 13 that have different aspect ratios.

[0127] In this embodiment, the control unit 135 records video data on a memory card 142, an example of a recording medium, as an example of image data showing the result of image capture (S23). The video data recorded on the memory card 142 includes metadata that manages the position and size set for each of the multiple trimming frames 11 to 13 (see S22). This allows each trimming frame 11 to 13, whose position and size were set at the time of capture, to be recorded in the metadata in relation to the capture result. With this metadata, for example, the trimming frames 11 to 13 at the time of capture can be reproduced on the captured image.

[0128] In this embodiment, the control unit 135 generates trimmed video data as an example of image data showing an image cut out from image data showing the result of image capture according to one or more trimming frames, based on the position and size set for each of the multiple trimming frames 11 to 13, similar to the processing in step S34 of the video editing process by the PC 5 (Figure 13). This makes it possible to generate a video cut out from the shooting result at the position and size set for each trimming frame 11 to 13, making it easier for the user to trim the image to the composition they intended at the time of shooting.

[0129] In the digital camera 100 of this embodiment, the operation unit 150 accepts touch operations on the captured image displayed on the display monitor 130. The control unit 135 sets the position and size of one or more example cropping frames 11 in response to user operations input to the operation unit 150 (S5, see Figure 6(B)), and displays the cropping frames 11 on the captured image on the display monitor 130 at the set position and size (S1, S5). In response to touch operations on the cropping frames 11 displayed on the display monitor 130, the control unit 135 updates at least one of the position and size of the cropping frames 11 (S2~S4, S11~S14), and sets the focus target by AF control in response to touch operations on an area of ​​the captured image different from the cropping frames 11 (S3, S6~S7). This makes it possible to use both touch operations on the cropping frames and touch operations for AF control on the image.

[0130] In this embodiment, PC5 is an example of a video editing device. PC5 comprises a device I / F 54, which is an example of a communication unit, and a control unit 50. The device I / F 54 communicates data with a digital camera 100 (an example of an imaging device that shoots video). The control unit 50 receives video data from the digital camera 100 via the device I / F 54 (S31), and displays the video indicated by the received video data on the display unit 52 (S32). The video data includes metadata that manages the position and size set for each of the multiple trimming frames 11 to 13, which each indicate the range to be cut out from the video (see S22). Based on the metadata, the control unit 50 displays the multiple trimming frames 11 to 13 on the video on the display unit 52 at their respective set positions and sizes (S32). The control unit 50 generates trimmed video data as an example of video data showing a video cut out from the received video data according to one or more trimming frames, based on the position and size set for each of the multiple trimming frames 11 to 13 (S33, S34).

[0131] According to the PC5 described above, based on the metadata of the received video data, the trimming frames 11 to 13 set by the user during video recording can be reproduced during video playback. Furthermore, video data can be generated by cutting out the video according to one or more trimming frames from the trimming frames 11 to 13 displayed on the video. As a result, after video recording is performed, the user can check the trimming frames 11 to 13 recorded along with the video result, and furthermore, trimming according to the trimming frames 11 to 13 set during recording can be performed efficiently. In this way, the PC5 of this embodiment can support trimming from the results of video recording. Also, for example, even without performing video editing on the digital camera 100, the PC5 can perform trimming according to the trimming frames 11 to 13 set during recording based on the metadata of the video data, making it easier to record videos with the digital camera 100.

[0132] (Embodiment 2) Embodiment 1 describes a video production system 1 in which the size and position of a trimming frame 11, etc., are set according to user operation before the video recording operation on the digital camera 100, and the set size and position are recorded in association with the resulting video. Embodiment 2 further describes a video production system 1 that can set and record the size and position of the trimming frame even while the video recording operation is being performed on the digital camera 100.

[0133] Hereinafter, descriptions of the configuration and operation similar to those of the video production system 1 according to Embodiment 1 will be omitted as appropriate, and the video production system 1 according to this embodiment will be described.

[0134] 1. Actions during video recording In the video production system 1 of this embodiment, the digital camera 100 displays trimming frames 11 to 13 on the live view screen during video recording, similar to the processing in the shooting standby state shown in Figure 8, and performs size / position change processing (S5) according to user operation. The digital camera 100 of this embodiment records trimming frame information in parallel with this shooting operation processing.

[0135] Figure 16 is a flowchart illustrating the recording process in the digital camera 100 of Embodiment 2. The process in this flowchart, for example, is started simultaneously with the shooting operation by fully pressing the release button 151, while the trimming frame information set at the time of the operation is held in the buffer memory 125, instead of the recording process in Embodiment 1 (Figure 12).

[0136] First, the control unit 135 determines whether any of the trimming frames 11 to 13 have been changed during the size / position change process (S41). The control unit 135 may also determine that a trimming frame has been changed (S41 YES) if, for example, a size change operation is input (YES in S11 in Figure 9) or a position change operation is input (YES in S13). The determination in step S41 is performed, for example, at the cycle in which image data for each frame is generated, corresponding to the frame rate.

[0137] If the trimming frame is changed (YES in S41), the control unit 135 records, for example, the updated trimming frame information corresponding to the change in the metadata of the latest frame image in the shooting result at the time of the change (S42). Such video frame metadata is recorded, for example, as header information that manages the position and size of the trimming frame at the frame level in the video data, and is associated with the frame image indicated by the image data of each frame.

[0138] If the trimming frame has not been changed (NO in S41), the control unit 135 records the trimming frame information, for example, that has been retained since the previous frame period, in the metadata for the latest frame image (S43). In this case, the same trimming frame information as the previous frame image is recorded in the metadata for the frame image.

[0139] After recording the trimming frame information in the metadata (S42, S43), the control unit 135 determines whether or not video recording has finished, for example, in step S21 in Figure 12 (S44). If video recording has not finished (NO in S44), the control unit 135 repeats the processing from step S41 onwards.

[0140] When video recording is finished (YES in S44), the control unit 135 generates video data including metadata for each frame image and records the generated video data to the memory card 142 (S45). After that, the control unit 135 terminates the processing of this flowchart.

[0141] Through the above processing, even if the size and / or position of the trimming frames 11-13 are changed during video recording, video data containing the trimming frame information as metadata associated with each frame image can be recorded. As a result, for example, if the size of the trimming frame is changed during video recording, the size of the subject in each frame image cut out at a certain size from the shooting result will change, resulting in a pseudo-zoom effect. Also, if the position of the trimming frame is changed during video recording, the position of the subject in each frame image cut out from the shooting result will change in accordance with that change, resulting in a pseudo-panning effect.

[0142] For example, when filming a stage performance from the audience, one possible use is to start filming with a relatively wide-angle lens to capture the entire stage, and then change the position and / or size of the cropping frame when a performer moves to the corner of the stage. In such applications, the digital camera 100 may be fixed on a tripod or the like while filming. Even when the user is filming with the digital camera 100 handheld, size / position changes can be input using, for example, the selection button 152 and dial 154, which can suppress camera shake during filming. The digital camera 100 may be equipped with an electronic viewfinder (EVF), and in such handheld filming, the same display as the display monitor 130 described above may be shown on the EVF. Furthermore, size / position changes can be input via touch operation while displaying the live view screen on an external electronic device such as a smartphone that can communicate data with the digital camera 100.

[0143] The above describes an example in which the digital camera 100 performs resizing / positioning processing while displaying multiple cropping frames 11 to 13. In this embodiment, the digital camera 100 may also perform resizing / positioning processing while displaying only one cropping frame.

[0144] 2. Actions after video recording In this system 1, the operation after the recording process described above will be explained below. In this system 1, for example, PC 5 plays back the video of the shooting result by the digital camera 100. In this embodiment, during this video playback process, PC 5 performs an operation that allows the user to adjust the trimming frame recorded for each frame image of the video.

[0145] Figure 17 is a flowchart illustrating the video playback process in PC5 of Embodiment 2. The processes in this flowchart are initiated, for example, in response to a predetermined user operation that causes a video to be played on PC5. Each process in Figure 17 is executed by the control unit 50 of PC5.

[0146] First, the control unit 50 acquires video data from the digital camera 100 via the device I / F 54, for example, in step S31 of Figure 13 (S51).

[0147] Next, the control unit 50 starts playing the video indicated by the video data on the display unit 52 based on the acquired video data (S52).

[0148] The control unit 50, for example, displays the trimming frames 11 to 13 from the metadata superimposed on the frame image in the video data on the display unit 52 (S53).

[0149] The control unit 50 determines whether each trimming frame has been changed from the trimming frame information recorded in the metadata, based on whether a user operation to change the size and / or position of any of the trimming frames 11 to 13 has been input, for example, in the operation unit 53 (S54). For example, such a user operation may be an operation to drag any of the frame lines or vertices of the trimming frames 11 to 13 displayed on the display unit 52 using a mouse or the like in the operation unit 53. Such a user operation may be input while the video playback is paused.

[0150] If the trimming frame is changed (YES in S54), the control unit 50 updates the metadata for the frame image in the video data in which the trimming frame has been changed, according to the changed size and position (S55).

[0151] On the other hand, if the trimming frame has not been changed (NO in S54), the control unit 50 does not update the metadata (S55) and proceeds to the next step S56.

[0152] The control unit 50 determines whether to terminate video playback based on, for example, whether or not it has read the video data up to the final frame image (S56). The control unit 50 may further determine in step S56 based on whether or not a user operation to terminate playback has been input to the operation unit 53. The determination in step S56 is performed, for example, at a cycle corresponding to the video's frame rate.

[0153] If the video playback is not terminated (NO in S56), the control unit 50 repeats the processing from step S53 onwards.

[0154] If the video playback is to be terminated (YES in S56), the control unit 50 terminates the video playback (S57) and ends the processing of this flowchart.

[0155] Through the above process, the trimming frames recorded in the metadata for each frame image of the video data are displayed during video playback, and the size and / or position of the trimming frames 11-13 in each frame image can be changed according to user operation. Furthermore, the results of these changes are reflected in the metadata for each frame image. As a result, in this system 1, after shooting a video, the user can check the trimming frames 11-13 that were displayed during shooting and adjust their respective sizes and positions. For example, the user can fine-tune the trimming frames 11-13 during video playback, making it easier to perform the intended trimming.

[0156] The above processing may be performed, for example, before the video editing processing described in Embodiment 1 (Figure 13). Alternatively, the same processing may be performed by the digital camera 100. In this case, the digital camera 100 may acquire video data from the memory card 142, start video playback, and then, for example, perform size / position change processing in response to touch operations on each trimming frame 11-13, similar to the operation in the shooting standby state.

[0157] 3. Variant The above describes an example in which the size and position of one trimming frame selected from multiple trimming frames 11 to 13 can be changed. In this system 1, the size and / or position of multiple trimming frames 11 to 13 may be changed collectively by user operation on a single trimming frame. A modified example 1 of Embodiment 2, which links the resizing and positioning of multiple trimming frames 11 to 13, will be described using Figures 18 and 19.

[0158] Figure 18 is a diagram illustrating the linked resizing of multiple cropping frames in this modified example. In this embodiment, the digital camera 100 displays multiple set cropping frames 11 to 13 on the display monitor 130, for example, during video recording, similar to step S1 in Figure 8. An example of the live view screen on the display monitor 130 is shown in Figure 18(A). Below, an example in which cropping frame 11 is selected by touching the frame line will be described.

[0159] The digital camera 100 accepts resizing and repositioning operations for the selected cropping frame 11, similar to steps S11 and S13 of the resizing / repositioning process (Figure 9). In this example, instead of steps S12 and S14 in Figure 9, when a resizing / repositioning operation for the cropping frame 11 is input, the digital camera 100 also changes the size and position of the other cropping frames 12 and 13 in conjunction with the cropping frame 11.

[0160] Figure 18(B) shows an example of the live view screen display when a resizing operation is input for the cropping frame 11, based on the example in Figure 18(A). In this example, the control unit 135 of the digital camera 100 changes the size of each of the cropping frames 11 to 13 so that the magnification for changing the size from the initial state matches in response to the resizing operation.

[0161] Figure 19 is a diagram illustrating the linked position changes in multiple trimming frames according to this modified example. Figure 19(A) shows an example in which trimming frames 11 to 13 are displayed on a different live view screen than that in Figure 18(A) on the display monitor 130. Figure 19(B) shows an example of the live view screen display when a position change operation is input for trimming frame 11, based on the example in Figure 19(A). In this example, the control unit 135 changes the position of each of the multiple trimming frames 11 to 13 so that the amount of movement in the X and Y directions from the reference point matches.

[0162] Furthermore, in the recording process of this example, the control unit 135 records the updated trimming frame information for all trimming frames 11 to 13 in the metadata, instead of step S42 in Figure 16.

[0163] According to the operation of the digital camera 100 described above, for example, by changing the size / position of one trimming frame 11, the size and position of multiple trimming frames 11 to 13 can be changed simultaneously. This means that, for example, when extracting videos with multiple aspect ratios for various platforms from a single video using trimming frames 11 to 13, the same zoom effect from resizing and panning effect from repositioning can be applied to each aspect ratio video at once.

[0164] The above description illustrates the operation of a digital camera 100 in which the size and / or position of multiple trimming frames 11 to 13 are changed in conjunction. Such operations may also be performed on the PC 5. For example, in the video playback process (Figure 17), if a user operation to change the size and / or position of any of the trimming frames 11 to 13 is input (YES in S54), the PC 5 may update the metadata for all trimming frames 11 to 13 instead of step S55.

[0165] 4. Summary As described above, in the digital camera 100 of this embodiment, the control unit 135 changes the position and size of one or more of the multiple trimming frames 11 to 13 displayed on the display monitor 130 in response to user operations input to the operation unit 150 while video recording is being performed in which the image sensor 115 captures the subject image at a predetermined frame period (see S1 to S5, S41 to S44). As a result, user adjustments to the position and size of the multiple trimming frames 11 to 13 displayed can be reflected in real time while video recording is being performed, making it easier to record videos that are being trimmed.

[0166] In this embodiment, the control unit 135 records video data showing the result of video recording onto a memory card 142, which is an example of a recording medium (S45). The video data recorded on the memory card 142 includes metadata that manages the position and size set for each of the multiple trimming frames 11 to 13 for each frame period (see S42, S43). As a result, the position and size set for each frame of the video can be recorded in the metadata, and for example, by trimming at the position and size that change in each frame based on the metadata, a video can be obtained with added video effects such as panning and zooming effects.

[0167] In this embodiment, during video recording, the control unit 135 changes one of the multiple trimming frames 11 to 13 in response to user input to the operation unit 150, and changes the other trimming frames to maintain the positional and size relationship with the said trimming frame (see Figures 18 and 19). This allows for the synchronized adjustment of position / size by user operation across the multiple trimming frames 11 to 13, making it easier to apply similar panning / zooming effects to the videos extracted by each trimming frame.

[0168] The PC5 of this embodiment further includes an operation unit 53 for inputting user operations to adjust the trimming frames 11 to 13. The metadata in this embodiment manages the position and size set for each of the multiple trimming frames 11 to 13 for each frame period in which a video is shot by a digital camera 100, as an example of an imaging device (see S42, S43). The control unit 50 of the PC5, while performing video playback to display the video on the display unit 52 (S52), changes one or more of the multiple trimming frames 11 to 13 displayed on the display unit 52 in response to user operations input to the operation unit 53 (S53, S54), and updates the position and size of the said one or more trimming frames in the metadata (S55). As a result, the PC5 can change the position and size of the trimming frames in real time in response to user operations during video playback, based on metadata that manages the position and size of each of the trimming frames 11 to 13 for each frame of the video data.

[0169] Furthermore, the digital camera 100 of this embodiment is an example of an imaging device for shooting video. The digital camera 100 includes an image sensor 115, an example of an imaging unit, which captures a subject image at a predetermined frame period and generates image data, a control unit 135, and an operation unit 150. The control unit 135 displays the captured image indicated by the image data on a display monitor 130, an example of a display unit, and controls video shooting by the digital camera 100. The operation unit 150 receives user input to adjust trimming frames 11 to 13 that indicate the range to be cropped in the captured image (S2 to S5). During video shooting, the control unit 135 displays multiple trimming frames 11 to 13 superimposed on the captured image on the display monitor 130, and changes the position and size of one or more of the multiple trimming frames 11 to 13 displayed on the display monitor 130 in accordance with the user operation input to the operation unit 150 (see S1 to S5, S41 to S44). In this way, during video recording, user-operated adjustments to the position and size of the multiple trimming frames 11-13 displayed can be reflected in real time.

[0170] (Other embodiments) As described above, Embodiments 1 and 2 have been explained as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited thereto and can be applied to embodiments that have been modified, substituted, added, or omitted as appropriate. Furthermore, it is possible to create new embodiments by combining the components described in Embodiments 1 and 2 above. Therefore, other embodiments will be illustrated below.

[0171] In the above embodiment 2, an example was described in which the size and / or position of the multiple trimming frames 11 to 13 displayed are changed in response to user operation during video recording with the digital camera 100. These changes in size and / or position of each trimming frame 11 to 13 are not limited to user operation; they may also be performed automatically, for example, depending on the subject being captured by the digital camera 100. A modification 2 of this embodiment 2 will be explained using Figure 20.

[0172] Figure 20 shows the configuration of the digital camera 100 according to this modified example. In addition to the same configuration as the example in Figure 2, the digital camera 100 of this modified example includes, for example, a subject tracking unit 122 that tracks a subject on the image during video recording, as a functional configuration of the image processing engine 120. The subject tracking unit 122 may be implemented by executing a predetermined program by the control unit 135, or it may be implemented as a dedicated hardware circuit. The subject tracking unit 122, similar to the known technology disclosed in, for example, Patent Document 2, recognizes a subject in the image and tracks the subject by determining the direction of movement of the subject between frame images. For example, the tracking result by the subject tracking unit 122 includes the position and size of the subject set as the tracking target recognized in each frame image.

[0173] In this modified example, the control unit 135 of the digital camera 100 displays a plurality of cropping frames 11 to 13, whose aspect ratios are set by user operation using the setting function, on the live view screen in the initial state during video recording, for example, in step S1 of Figure 8. Instead of a size / position change process (S5) performed by user operation, the control unit 135 changes the position and / or size of one or more cropping frames 11 to 13 according to the tracking result by the subject tracking unit 122. The changed position and size can be set for each cropping frame selected by user operation based on the subject tracking result, as in Patent Document 2, or they may be changed in conjunction with each other across multiple cropping frames, as in Modified Example 1 above.

[0174] As described above, the modified digital camera 100 further includes a subject tracking unit 122, which is an example of a tracking unit that tracks a subject shown in the subject image during video recording. During video recording, the control unit 135 displays multiple cropping frames 11 to 13 superimposed on the captured image on the display monitor 130, and changes one or more of the multiple cropping frames 11 to 13 displayed on the display monitor 130 according to the position and size of the subject being tracked by the subject tracking unit 122 in the captured image. As a result, during video recording, the position and size of the multiple cropping frames 11 to 13 displayed can be adjusted in real time according to the subject tracking result by the subject tracking unit 122.

[0175] In each of the embodiments described above, an example was explained in which a video edited by the PC5 from video data captured by the digital camera 100 is uploaded to various social media platforms. In this embodiment, for example, the video edited by the camera 100 may be uploaded.

[0176] In each of the embodiments described above, an example was explained in which video data and trimming frames 11-13, etc., are displayed on the display monitor 130 of the digital camera 100 and the display unit 52 of the PC 5. In this embodiment, an external display device may be connected to the digital camera 100, for example, via a communication module 165, and the control unit 135 may control the display device to perform various displays. Similarly, an external display device may be connected to the PC 5 via a device I / F 54, etc., and the control unit 50 may control the display device to perform various displays.

[0177] In the above embodiment 1, an example was described in which the PC 5 generates trimmed video data extracted from a single video captured by the digital camera 100 based on metadata of the video data (Figure 13). In this embodiment, the digital camera 100 may generate the trimmed video and record it on the memory card 142, for example, after the video shooting operation. Furthermore, if the digital camera 100 can accommodate multiple memory cards, each trimmed video data extracted by multiple trimming frames 11 to 13 may be recorded on a different memory card.

[0178] In the above embodiment 2, frame-level header information was described as metadata for recording trimming frame information for each frame image in the video data. In this embodiment, for example, the trimming frame information may be managed separately from the video data and associated with the frame image, and the header information of the entire video data may include information that identifies the trimming frames 11 to 13 in such external management information.

[0179] Furthermore, while a digital camera was described as an example of an imaging device in each of the embodiments described above, the invention is not limited to this. The imaging device of this disclosure may be any electronic device having an image capture function (for example, a video camera, smartphone, tablet terminal, etc.).

[0180] (Summary of characteristics) The various aspects of this disclosure are listed below.

[0181] A first aspect of the present disclosure is an imaging device comprising: an imaging unit that captures an image of a subject and generates image data; a control unit that displays the captured image shown by the image data on a display unit and controls image capture; and an operation unit that inputs user operations to adjust a cropping frame indicating the range to be cropped in the captured image. The control unit sets the position and size of a plurality of cropping frames, each having a different aspect ratio, in response to the user operations input to the operation unit, and displays the plurality of cropping frames on the captured image on the display unit at the set position and size.

[0182] According to the second embodiment, in the imaging apparatus of the first embodiment, the operation unit receives touch operations on the captured image displayed on the display unit, and the control unit updates at least one of the position and size of one of the trimming frames among a plurality of trimming frames displayed on the display unit in response to a touch operation on that trimming frame.

[0183] According to the third embodiment, in the imaging device of the second embodiment, the control unit sets the object to be focused by the autofocus operation during image capture in response to a touch operation on an area on the captured image that is different from each cropping frame.

[0184] According to the fourth embodiment, in the imaging apparatus according to any of the first to third embodiments, the operation unit receives a user operation to select the aspect ratio of each of the multiple cropping frames from multiple options, and the control unit sets the position and size of the cropping frame for which the aspect ratio has been set according to the user operation input to the operation unit.

[0185] According to the fifth embodiment, in the imaging device of any of the first to fourth embodiments, the control unit records image data indicating the result of image acquisition on a recording medium, and the image data recorded on the recording medium includes metadata that manages the position and size set for each of the plurality of trimming frames.

[0186] According to the sixth aspect, in the imaging device according to any of the first to fifth aspects, the control unit generates image data showing an image cropped from image data showing the result of image acquisition according to one or more cropping frames, based on the position and size set for each of the plurality of cropping frames.

[0187] According to the seventh aspect, in an imaging device according to any of the first to sixth aspects, the control unit changes the position and size of one or more trimming frames in a plurality of trimming frames displayed on the display unit in response to user operations input to the operation unit while the imaging unit is performing video recording in which it captures an image of a subject at a predetermined frame period.

[0188] According to the eighth aspect, in the imaging device of the seventh aspect, the control unit records video data indicating the result of video recording on a recording medium, and the video data recorded on the recording medium includes metadata that manages the position and size set for each of the plurality of trimming frames for each frame period.

[0189] According to the ninth aspect, in the imaging device of the seventh or eighth aspect, the control unit, while performing video recording, changes one of the multiple trimming frames in response to a user operation input to the control unit, and changes the other trimming frames in such a way as to maintain the positional and size relationship with the said trimming frame.

[0190] The tenth embodiment is an imaging device comprising: an imaging unit that captures an image of a subject and generates image data; a control unit that displays the captured image shown by the image data on a display unit and controls image capture; and an operation unit that inputs user operations to adjust a cropping frame indicating the range to be cropped in the captured image. The operation unit accepts touch operations on the image displayed on the display unit. The control unit sets the position and size of one or more cropping frames in response to the user operations input to the operation unit, and displays one or more cropping frames on the captured image on the display unit at the set position and size. The control unit updates at least one of the position and size of one of the cropping frames in response to a touch operation on one of the cropping frames displayed on the display unit. The control unit sets the focus target for autofocus operation in image capture in response to a touch operation on an area on the captured image different from one or more cropping frames.

[0191] The eleventh embodiment is a video editing apparatus comprising a communication unit that communicates data with an imaging device that shoots video, and a control unit that receives video data indicating the result of video shooting from the imaging device via the communication unit and displays the video indicated by the received video data on a display unit. The received video data includes metadata that manages the position and size set for each of a plurality of trimming frames that each indicate the range to be cut out from the video. Based on the metadata, the control unit displays the plurality of trimming frames on the video on the display unit at the respective set positions and sizes. Based on the position and size set for each of the plurality of trimming frames, the control unit generates video data indicating the video cut out from the received video data according to one or more trimming frames.

[0192] According to the twelfth aspect, the video editing apparatus of the eleventh aspect further includes an operation unit for inputting user operations to adjust trimming frames, and metadata manages the position and size set for each of the multiple trimming frames for each frame period in which the imaging device captures the video. During video playback, in which the video is displayed on the display unit, the control unit changes one or more of the multiple trimming frames displayed on the display unit in response to the user operations input to the operation unit, and updates the position and size of the said one or more trimming frames in the metadata.

[0193] The 13th embodiment is an imaging device for shooting video, comprising: an imaging unit that captures a subject image at a predetermined frame period and generates image data; a control unit that displays the captured image indicated by the image data on a display unit and controls video shooting by the imaging device; and an operation unit that inputs user operations to adjust a trimming frame indicating the range to be cropped in the captured image. During video shooting, the control unit displays a plurality of trimming frames superimposed on the captured image on the display unit, and changes one or more of the trimming frames displayed on the display unit in response to user operations input to the operation unit.

[0194] According to the 14th embodiment, in the 13th embodiment, the control unit, while recording video, changes one of the multiple trimming frames in response to a user operation input to the control unit, and changes the other trimming frames in such a way as to maintain the positional and size relationship with the said trimming frame.

[0195] The 15th embodiment is an imaging device for shooting video, comprising: an imaging unit that captures a subject image at a predetermined frame period and generates image data; a control unit that displays the captured image indicated by the image data on a display unit and controls video shooting by the imaging device; an operation unit that inputs user operations to adjust a trimming frame indicating the range to be cropped in the captured image; and a tracking unit that tracks the subject indicated by the subject image during video shooting. During video shooting, the control unit displays a plurality of trimming frames superimposed on the captured image on the display unit, and changes one or more of the trimming frames displayed on the display unit according to the position and size of the subject being tracked by the tracking unit in the captured image.

[0196] As described above, embodiments have been explained as examples of the technology in this disclosure. For this purpose, accompanying drawings and a detailed description have been provided.

[0197] Therefore, the components described in the attached drawings and detailed descriptions may include not only components essential for solving the problem, but also components that are not essential for solving the problem, provided that they illustrate the technology described above. For this reason, the mere presence of these non-essential components in the attached drawings and detailed descriptions should not be immediately assumed to mean that they are essential.

[0198] Furthermore, since the embodiments described above are for illustrative purposes of the technology described herein, various modifications, substitutions, additions, omissions, etc., can be made within the claims or their equivalents. [Industrial applicability]

[0199] This disclosure is applicable to various imaging devices for capturing images to be trimmed, and various video editing devices for trimming captured images. [Explanation of Symbols]

[0200] 100 Digital Cameras 115 Image Sensor 125 buffer memory 130 Display Monitor 135 Control Unit 145 Flash Memory 150 Operation section 50 Control Unit 51 Storage section 52 Display section 53 Operation section 54 Equipment I / F 55 Network Interface

Claims

1. An imaging unit that captures an image of the subject and generates image data, A control unit that displays the captured image shown in the aforementioned image data on a display unit and controls image capture, The captured image includes an operation unit for inputting user operations to adjust a trimming frame that indicates the range to be cropped, The control unit, In response to user input to the aforementioned control unit, the position and size of multiple cropping frames, each having a different aspect ratio, are set accordingly. The display unit displays the multiple cropping frames on the captured image at the set positions and sizes. Imaging device.

2. The operation unit receives touch operations on the captured image displayed on the display unit. The control unit updates at least one of the position and size of one of the trimming frames among the plurality of trimming frames displayed on the display unit in response to a touch operation on that trimming frame. The imaging apparatus according to claim 1.

3. The control unit sets the focus target for the autofocus operation during image capture in response to touch operations on areas of the captured image different from each of the cropping frames. The imaging apparatus according to claim 2.

4. The operation unit accepts user input to select the aspect ratio of each of the multiple trimming frames from multiple options. The control unit sets the position and size of the cropping frame, which has an aspect ratio set according to the user operation input to the operation unit. The imaging apparatus according to claim 1.

5. The control unit records image data showing the result of the image capture onto a recording medium. The image data recorded on the recording medium includes metadata that manages the position and size set for each of the plurality of trimming frames. The imaging apparatus according to claim 1.

6. The control unit generates image data showing images cropped from the image data showing the result of the image capture according to one or more trimming frames, based on the position and size set for each of the plurality of trimming frames. The imaging apparatus according to claim 1.

7. The control unit, During video recording, in which the imaging unit captures an image of the subject at a predetermined frame period, In response to user input to the control unit, the position and size of one or more trimming frames in the multiple trimming frames displayed on the display unit are changed. The imaging apparatus according to claim 1.

8. The control unit, The video data showing the results of the aforementioned video recording is recorded on a recording medium. The video data recorded on the recording medium includes metadata that manages the position and size set for each of the plurality of trimming frames for each frame period. The imaging apparatus according to claim 7.

9. During the execution of the video recording, the control unit changes one of the multiple trimming frames in response to a user operation input to the operation unit, and changes the other trimming frames in order to maintain the positional and size relationship with the said trimming frame. The imaging apparatus according to claim 7.

10. An imaging unit that captures an image of the subject and generates image data, A control unit that displays the captured image shown in the aforementioned image data on a display unit and controls image capture, The captured image includes an operation unit for inputting user operations to adjust a trimming frame that indicates the range to be cropped, The operation unit receives touch operations on the captured image displayed on the display unit. The control unit, In response to user input to the aforementioned control unit, the position and size of one or more trimming frames are set accordingly. The display unit displays the one or more trimming frames on the captured image at the set positions and sizes. In response to a touch operation on one of the one or more trimming frames displayed on the display unit, at least one of the position and size of the trimming frame is updated. In response to a touch operation on the captured image in an area different from the one or more cropping frames, the autofocus operation during image capture sets the focus target. Imaging device.

11. An imaging device for shooting video and a communication unit for data communication, The system includes a communication unit that receives video data from the imaging device indicating the results of video recording, and a control unit that displays the video indicated by the received video data on a display unit. The received video data includes metadata that manages the position and size set for each of the multiple trimming frames that indicate the range to be extracted from the video. The control unit, Based on the metadata, the display unit displays the multiple trimming frames on the video at their respective set positions and sizes. Based on the position and size set for each of the plurality of trimming frames, video data is generated showing the video extracted from the received video data according to one or more trimming frames. Video editing device.

12. The system further includes an operation unit for inputting user operations to adjust the trimming frame, The metadata manages the position and size set for each of the plurality of trimming frames for each frame period in which the video is captured by the imaging device. The control unit, while performing video playback to display the video on the display unit, responds to user operations input to the operation unit. The display unit changes one or more of the multiple trimming frames shown in the display unit, Update the position and size of the one or more trimming frames in the metadata. The video editing device according to claim 11.

13. An imaging device for shooting video, An imaging unit that captures an image of a subject at a predetermined frame period and generates image data, A control unit that displays the captured image shown in the image data on a display unit and controls video recording by the imaging device, The captured image includes an operation unit for inputting user operations to adjust a trimming frame that indicates the range to be cropped, The control unit, during the execution of the video recording, The display unit overlays and displays multiple cropping frames on the captured image. In response to user input to the operation unit, one or more trimming frames among the multiple trimming frames displayed on the display unit are changed. Imaging device.

14. During the execution of the video recording, the control unit changes one of the multiple trimming frames in response to a user operation input to the operation unit, and changes the other trimming frames in order to maintain the positional and size relationship with the said trimming frame. The imaging device according to claim 13.

15. An imaging device for shooting video, An imaging unit that captures an image of a subject at a predetermined frame period and generates image data, A control unit that displays the captured image shown in the image data on a display unit and controls video recording by the imaging device, The aforementioned captured image includes an operation unit for inputting user operations to adjust the cropping frame that indicates the area to be cropped, The aforementioned video recording includes a tracking unit that tracks the subject shown in the subject image, The control unit, during the execution of the video recording, The display unit overlays and displays multiple cropping frames on the captured image. Depending on the position and size of the subject being tracked by the tracking unit in the captured image, one or more of the multiple cropping frames displayed on the display unit are changed. Imaging device.

Images