How to create a video

Abstract

To provide a video creation method for appropriately executing adjustment of an exposure amount or the like and video display when changing an extracted region in a structure of extracting a part of an imaged video and displaying the video.SOLUTION: The video creation method according to the present invention includes: setting a plurality of regions with a second angle of view smaller than a first angle of view in an imaged region of a reference video with the first angle of view; selecting a selective region of a video to be recorded from a plurality of regions; selecting the selective region from the plurality of regions again and switching the selective region; recording a video before switching and a video after switching; displaying the video after switching after displaying the video before switching and displaying an insertion video in a period between a display period of the video before switching and a display period of the video after switching; and adjusting an exposure amount or the like after switching of the selective region, during the display period of the insertion video.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a video creation method for capturing video using a camera and creating a video file based on the video. [Background technology]

[0002] When capturing images of multiple subjects in a scene, the scene may be captured by a single camera, and the images of each subject may be extracted from the captured images and displayed. Examples of such techniques include those described in Patent Documents 1 to 3.

[0003] Patent Document 1 discloses a technique for generating a cutout image by cutting out a part of an original image captured by a single camera, controlling the cutout position, and outputting the cutout image so that the position of the subject changes.

[0004] Patent Document 2 discloses a technology that detects multiple objects based on high-resolution wide-angle images captured by a single camera, cuts out images of each detected object from the wide-angle image, and displays the images of the multiple objects in parallel on a monitor.

[0005] Patent Document 3 discloses a technology for specifying multiple arbitrary areas from an image captured by a single imaging device, and cutting out and outputting images corresponding to the specified multiple arbitrary areas. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 11-220653 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-194309 [Patent Document 3] Japanese Patent Application Laid-Open No. 2014-42357 Summary of the Invention [Problem to be solved by the invention]

[0007] When extracting and displaying a portion of an image, the image quality of the extracted image is determined by the exposure, white balance, lens focus, etc. When these conditions are set to appropriate values, the extracted image will have good image quality.

[0008] On the other hand, the appropriate conditions for the extracted image are determined by the position of the extracted area in the original image. Taking this into consideration, if the position of the extracted area is changed, it is necessary to re-adjust the exposure and other conditions according to the changed extracted area.

[0009] However, the extracted image in the middle of adjusting the exposure conditions is unstable and incomplete, so there is a risk that the image may not be appropriate. Therefore, if the exposure conditions and other conditions are adjusted immediately after changing the extraction area and the extracted image is displayed in the middle, the viewer (user) may feel uncomfortable.

[0010] One embodiment of the present invention has been made in consideration of the above circumstances, and aims to provide an image creation method that, in a configuration in which a portion of an image captured by a photographing device is extracted and displayed, allows for appropriate adjustment of conditions such as exposure amount and image display when the extraction area is changed. [Means for solving the problem]

[0011] In order to achieve the above-mentioned object, one embodiment of the image creation method is an image creation method that creates an image file based on an image captured by an image capture device equipped with a photographing lens and an image sensor, and is characterized by comprising: a setting process that sets multiple areas with a second angle of view smaller than the first angle of view within the shooting area of ​​a reference image with a first angle of view; a selection process that selects a selected area from the multiple areas in which the image to be recorded will be captured; a switching process that, after the selection process, reselects the selected area from the multiple areas and switches the selected area; a recording process that records a pre-switching image, which is an image of the selected area before the switching process, and a post-switching image, which is an image of the selected area after the switching process; a display process that displays the post-switching image after the pre-switching image, and displays the inserting image during the period between the display period of the pre-switching image and the display period of the post-switching image; and an adjustment process that adjusts at least one of the exposure of the selected area after the switching process, the white balance of the post-switching image, and the focus of the photographing lens after the switching process during the display period of the inserting image.

[0012] In the video creation method of one embodiment of the present invention, the insertion video may be a video based on the pre-switching video and the post-switching video, or may be a video that is not based on any of the base video, the pre-switching video, and the post-switching video.

[0013] In the video creation method according to one embodiment of the present invention, the recording step can combine the pre-switching video and the post-switching video to create a video file.

[0014] It is more preferable that the inserted video is excluded from the recording target in the recording step.

[0015] In addition, in the image creation method of one embodiment of the present invention, the exposure amount may be adjusted by adjusting the aperture value of the light incident on the photographing lens. In this case, when the aperture value or focus is adjusted in the adjustment process, the length of the display period of the inserted image may be changed depending on the time required to adjust the aperture value or focus in the adjustment process.

[0016] Furthermore, if the required time is equal to or longer than a predetermined time, it is more preferable to display an insert video including information relating to the required time in the display step.

[0017] In addition, in the image creation method of one embodiment of the present invention, the exposure amount may be adjusted by adjusting the aperture value of the light incident on the photographing lens. In this case, when the aperture value or focus is adjusted in the adjustment step, it is preferable that the aperture value or focus adjustment speed is faster during the display period of the inserted image than during periods other than the display period of the inserted image.

[0018] In the image creation method of one embodiment of the present invention, the focus adjustment mode may be selected from a manual focus mode in which the focus is manually adjusted based on a user's operation, and an autofocus mode in which the focus is automatically adjusted. Furthermore, when the manual focus mode is selected, the focus may be automatically adjusted in the adjustment process during the display period of the inserted image.

[0019] The method for automatically adjusting the focus may include a first method, which is contrast autofocus, and a second method selected from image plane phase difference autofocus, directional light autofocus, and depth-from-defocus autofocus. In the adjustment process during the display period of the inserted video, the focus may be adjusted using the second method.

[0020] Furthermore, in the above configuration, the exposure amount may be adjusted by adjusting the aperture value of the light incident on the photographing lens. The second method may be image plane phase difference autofocus, and in the adjustment process during the display period of the inserted video, the focus may be adjusted by the second method regardless of the aperture value.

[0021] In addition, in the image creation method according to one embodiment of the present invention, if the image capture device does not have a function for automatically adjusting the focus, the focus will be adjusted manually based on a user's operation. In this case, it is preferable that the display step displays an insert image including guide information for manually adjusting the focus.

[0022] In the video creation method of one embodiment of the present invention, the mode for adjusting the exposure amount may be selected from a manual adjustment mode in which the exposure amount is manually adjusted based on a user's operation, and an auto adjustment mode in which the exposure amount is automatically adjusted. Furthermore, when the manual adjustment mode is selected, the exposure amount may be automatically adjusted in an adjustment process during the display period of the insertion video.

[0023] Furthermore, according to one embodiment of the present invention, an image creation device can be realized that creates an image file based on an image captured by an imaging device equipped with a photographing lens and an image sensor, wherein the processor of the image creation device is configured to execute the following steps: a setting step of setting multiple areas with a second angle of view smaller than the first angle of view within the shooting area of ​​a reference image with a first angle of view; a selection step of selecting a selected area from the multiple areas in which the image to be recorded will be captured; a switching step of reselecting the selected area from the multiple areas after the selection step and switching the selected area; a recording step of recording a pre-switching image, which is the image of the selected area before the switching step, and a post-switching image, which is the image of the selected area after the switching step; a display step of displaying the post-switching image after the pre-switching image, and displaying the inserting image during the period between the display period of the pre-switching image and the display period of the post-switching image; and an adjustment step of adjusting at least one of the exposure of the selected area after the switching process, the white balance of the post-switching image, and the focus of the photographing lens after the switching process, during the display period of the inserting image. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a perspective view showing an example of the appearance of an imaging device according to a first embodiment of the present invention. [Figure 2] 1 is a rear view showing the rear side of an imaging device according to a first embodiment of the present invention. [Figure 3] 1 is a block diagram showing the configuration of an imaging device according to a first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing the correspondence between pixels of an imaging element and a shooting area of ​​a reference image. [Figure 5] FIG. 10 is a diagram showing a procedure for setting an area of ​​an image to be extracted from a reference image. [Figure 6] FIG. 10 is a diagram showing a state in which a plurality of areas of an image to be extracted from a reference image are set. [Figure 7] FIG. 10 is a diagram showing an image of a selected area displayed on a display screen. [Figure 8] 10A and 10B are explanatory diagrams illustrating the transition of a display image accompanying the execution of a switching process. [Figure 9] FIG. 2 is an explanatory diagram of a moving image file of recorded video. [Figure 10] FIG. 1 is an explanatory diagram of a video creation flow according to a first embodiment which is one embodiment of the present invention. [Figure 11] FIG. 10 is an explanatory diagram of a video creation flow according to a second embodiment of the present invention. [Figure 12] FIG. 10 is a diagram showing a first modified example of an inserted video. [Figure 13] FIG. 10 is an explanatory diagram of a video production flow according to a third embodiment which is one embodiment of the present invention. [Figure 14] FIG. 10 is an explanatory diagram of a video production flow according to a fourth embodiment which is one embodiment of the present invention. [Figure 15] FIG. 10 is a diagram showing a second modified example of an inserted video. [Figure 16] FIG. 10 is an explanatory diagram of a video production flow according to a fifth embodiment which is one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0025] Hereinafter, preferred embodiments (first to fifth embodiments) of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiment described below is merely an example given to facilitate understanding of one embodiment of the present invention, and does not limit the present invention. In other words, one embodiment of the present invention may be modified or improved from the embodiment described below without departing from the spirit of the invention. Furthermore, one embodiment of the present invention includes equivalents thereof.

[0026] <<First Embodiment>> A first embodiment of the present invention relates to a method of creating an image using a photographing device 10 shown in Figures 1 to 3. Figures 1 and 2 show the appearance of the photographing device 10, with Figure 1 being a perspective view of the photographing device 10 and Figure 2 being a view of the photographing device 10 as seen from the rear side. Figure 3 is a block diagram showing the configuration of the photographing device 10.

[0027] [Basic configuration of imaging device] The image capturing device 10 is, for example, a digital camera used for capturing video. In the following description, unless otherwise specified, "video" refers to live video (live view image), that is, video captured in real time.

[0028] 1 and 2 is a digital camera with an interchangeable lens, and includes a camera body 12 and a photographic lens 14. The photographic lens 14 is interchangeably attached to a mount 13 of the camera body 12. However, the present invention is not limited to this, and the camera body 10 may also be a digital camera with an integrated lens.

[0029] (photographic lens) As shown in FIG. 3, the photographing lens 14 includes an optical component unit 18, an aperture 20, an electronic neutral density filter 21, a focus driver 22, an aperture driver 23, and a voltage application unit 24. The optical component unit 18 has a plurality of lenses, including a focusing optical component 19 (focus lens). When the focusing optical component 19 moves in the direction of the optical axis L1, the focus of the photographing lens 14 changes.

[0030] There are two focus adjustment modes: manual focus mode and autofocus mode. In manual focus mode, the user manually turns a focus ring 16 provided on the lens barrel of the photographic lens 14, which moves a focusing optical component 19 along the optical axis L1. In autofocus mode, the control unit 46 described below drives the focus drive unit 22 to move the focus optical component 19 in the direction of the optical axis L1, and the focus is automatically adjusted to focus on the subject in the image.

[0031] The drive motor of the focus drive unit 22 is configured by an ultrasonic motor or the like, and is provided in the image taking device body 12 or the image taking lens 14 .

[0032] The optical component unit 18 includes a wide-angle lens, an ultra-wide-angle lens, a 360-degree lens, an anamorphic lens, or the like. This allows the image capture device 10 to capture video with a wide horizontal angle of view. Here, the maximum angle of view (hereinafter referred to as the first angle of view) when the image capture device 10 captures video is determined depending on the use of the optical component unit 18 and the image sensor 40 (described below), and the video captured at the first angle of view corresponds to the "reference video" in one embodiment of the present invention.

[0033] The imaging device 10 may include a plurality of optical component units 18 each having a different angle of view.

[0034] The diaphragm 20 is an optical component that is disposed in the optical path of the photographing lens 14, has a variable aperture shape, and adjusts the aperture amount (specifically, the aperture value or F-number) for light incident on the photographing lens 14. The diaphragm 20 has an aperture shape that can be changed, for example, by mechanically driving a member that changes the size of the aperture. However, the diaphragm is not limited to this, and may be a diaphragm (physical diaphragm) whose aperture shape can be changed by driving a liquid crystal or an electrochromic element.

[0035] The opening shape of the diaphragm 20, that is, the aperture amount, is adjusted by a diaphragm driver .

[0036] The electronic neutral density filter 21 is an ND (Neutral Density) filter that is placed in the optical path of the photographing lens 14 and can electronically change the degree of dimming. The electronic neutral density filter 21 is made, for example, by mixing a light-absorbing dimming material into liquid crystal, and controls the degree of dimming (specifically, light transmittance) by changing the tilt of the liquid crystal molecules.

[0037] The electronic neutral density filter 21 is not limited to a liquid crystal type electronic ND filter, but may be a precipitation type electronic ND filter that utilizes an oxidation-reduction reaction of a reactive substance (for example, silver chloride). As the electronic neutral density filter 21, for example, the electronic ND filters described in Japanese Patent Application Laid-Open No. 2013-88596 or Japanese Patent Application Laid-Open No. 2019-68402 can be used.

[0038] The degree of dimming of the electronic attenuation filter 21 is adjusted by changing the magnitude of the voltage (applied voltage) that the voltage application unit 24 applies to the electronic attenuation filter 21.

[0039] (imaging device body) 1 and 2, the photographing device body 12 includes an operation unit that is operated by the user. For example, a release button 26 is disposed on the top surface of the photographing device body 12. For example, when the user fully presses the release button 26, recording of an image captured by the photographing device 10 or an image based on the captured image begins. An example of an image based on the captured image is an image of a selected area, which will be described later. The user's release instruction (i.e., a recording instruction) may be input to the control unit 46 via a touch operation detection function of the display 28.

[0040] A display 28 constituting a display screen is disposed on the rear surface of the photographing device main body 12, and a plurality of buttons 30, 32, and 34 are disposed around the display 28.

[0041] The display 28 is configured by, for example, an LCD (Liquid Crystal Display), an organic EL (Organic Electroluminescence) display, an LED (Light Emitting Diode) display, electronic paper, etc. Images captured by the image capturing device 10 or images based on the captured images are displayed on the display screen of the display 28. Furthermore, the display screen of the display 28 also displays a selection menu relating to the shooting conditions, notification information for the user including warnings, and playback images of previously acquired images. Furthermore, an insert video Pi is displayed on the display screen of the display 28. The insert video Pi is displayed for a fixed period of time at a predetermined timing during the period in which the video is being recorded. The insert video Pi will be explained again later.

[0042] The display 28 has a function for detecting touch operations of the user's fingers. A transparent touch panel 36 is overlaid on the display 28 or incorporated inside the display 28. The touch panel 36 detects the contact position and displacement of the user's finger or stylus pen, and outputs a signal based on the detection result to a predetermined output destination. For example, suppose that a user touches the touch panel 36 with two fingers that are close to each other and then widens the space between the fingers (a so-called pinch-out operation). In this case, the touch panel 36 detects the positions of each of the two fingers at the start and end of the operation and outputs a signal according to the detection result.

[0043] As shown in FIG. 3, the housing of the photographing device main body 12 contains a shutter 38, an image sensor 40, an analog signal processing circuit 44, a control unit 46, an internal memory 50, a card slot 52, and a buffer 56.

[0044] The imaging element 40 is an image sensor and is configured by a solid-state imaging element such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor Image Sensor). The imaging element 40 has a plurality of pixels 42 arranged in a grid as shown in Fig. 4. Fig. 4 shows the correspondence between the pixels 42 of the imaging element 40 and the shooting area of ​​the reference image.

[0045] Each pixel 42 has an on-chip microlens, a color filter, and a photodiode (photoelectric conversion element).

[0046] 4, each pixel 42 corresponds to one of the unit areas A0 that make up the image capturing area A1 of the image. The image capturing area A1 is the capturing area when the image capturing device 10 captures the reference image, and its angle of view corresponds to the first angle of view. The unit area A0 is the smallest unit of the image capturing area A1, and corresponds to the pixels 42 that are arranged vertically and horizontally on the image sensor 40. In other words, the reference image captured in the shooting area A1 is composed of unit images whose number is the same as the number of unit areas A0 (i.e., the number of pixels 42). In this specification, the number of unit images in the reference image is referred to as the "number of pixels" for convenience.

[0047] The image sensor 40 receives light from a subject that has passed through the photographic lens 14, converts the received light image into an electrical signal (image signal), and outputs the electrical signal. The image sensor 40 is also configured to be capable of performing an exposure operation using a so-called electronic shutter. In the following explanation, unless otherwise specified, "exposure" means exposure by the electronic shutter at the image sensor 40 while the shutter 38 is kept open. Furthermore, "exposure time" means the time corresponding to the shutter speed of the electronic shutter, or more precisely, the charge accumulation time.

[0048] 3, the analog signal processing circuit 44 reads out, for each pixel, an electrical signal (image signal) for one frame output from the image sensor 40. The analog signal processing circuit 44 amplifies the read-out image signal using an AGC (Auto Gain Controller) and performs signal processing such as correlated double sampling on the amplified signal. The processed signal is sent to a video processing unit 48 in the control unit 46.

[0049] The control unit 46 controls each unit of the image capturing device 10 and executes various processes related to the creation of video files. The control unit 46 includes a controller 47 and a video processing unit 48 as shown in FIG.

[0050] The control unit 46 is composed of, for example, one or more processors, and is composed of, for example, a CPU (Central Processing Unit) and a control program. However, the present invention is not limited to this, and the processor may be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), an MPU (Micro-Processing Unit), or other ICs (Integrated Circuits), or may be composed of a combination of these. Furthermore, the above processor may be configured such that the functions of the entire control unit 46 including the controller 47 and the video processing unit 48 are implemented in a single IC (Integrated Circuit) chip, as typified by an SoC (System on Chip). The hardware configuration of each of the processors described above may be realized by an electric circuit that combines circuit elements such as semiconductor elements.

[0051] The controller 47 comprehensively controls the image capturing device 10 in accordance with a user's operation or a predetermined control pattern. For example, the controller 47 controls the image capturing element 40 and the analog signal processing circuit 44 so as to capture video (moving images) at a predetermined frame rate.

[0052] The controller 47 also determines the shooting conditions according to the shooting environment, and controls the various driving units, the image sensor 40, the analog signal processing circuit 44, and the video processing unit 48 so that the shooting conditions are the determined conditions. The shooting conditions include the exposure amount, white balance, and focus of the shooting lens 14 when shooting an image. Furthermore, the controller 47 controls the video processing unit 48 so that the captured video or the video based on the captured video is recorded on a recording medium.

[0053] The video processing unit 48 converts the signal sent from the analog signal processing circuit 44 into digital image data, and then performs various processes on the digital image data, such as gamma correction, white balance correction, and defect correction. The video processing unit 48 also compresses the processed digital image data in a compression format that complies with a predetermined standard.

[0054] Then, during video capture, video processing unit 48 generates compressed digital image data at a specific frame rate and acquires video (strictly speaking, frame images) from that data. The video (frame images) acquired at this time correspond to video captured at the first angle of view, i.e., reference video.

[0055] Furthermore, under the control of the controller 47, the image processing unit 48 performs various processes (for example, extraction processes described below) on the acquired image, and outputs the processed image to the display 28 frame by frame at a specific frame rate. Furthermore, the video processing unit 48 records the processed video on a recording medium and creates a video file of the video. In this way, the video processing unit 48 has a function for creating a video file, and the image capturing device 10 having the video processing unit 48 is used as a video creating device.

[0056] In the following, unless otherwise specified, the operations and processes of the controller 47 and the video processing unit 48 will be described as the operations and processes of the control unit 46. The processes by the control unit 46 will be described in detail later.

[0057] The internal memory 50 built into the photographing device main body 12 and the memory card 54 that can be attached to and detached from the photographing device main body 12 via the card slot 52 are recording media, and images are recorded on the recording media by the control unit 46. The internal memory 50 and the memory card 54 are configured with flash memory, ferroelectric memory, or the like. Note that the internal memory 50 and the memory card 54 may be located outside the photographing device main body 12, in which case the control unit 46 may record images on the external recording media via a wired or wireless connection.

[0058] The buffer 56 functions as a work memory for the control unit 46, and is configured by, for example, a DRAM (Dynamic Random Access Memory), a ferroelectric memory, or the like.

[0059] [Processing by the control unit] The processing by the control unit 46 includes display processing, extraction processing, selection processing, switching processing, recording processing, exposure amount adjustment processing, focus adjustment processing, and white balance adjustment processing. Each of the above processes will be explained below individually.

[0060] (Display processing) The display process is a process of displaying various images on the display screen of the display 28. For example, when the control unit 46 starts the display process after the image capturing device 10 is started, at that point in time, a reference image captured by the image capturing device 10 at the first angle of view, that is, an image captured in the image capturing area A1 shown in FIG. Furthermore, when the extraction process is executed, the control unit 46 displays an image of the selected area, which will be described later, on the display screen. Furthermore, when the selected area is switched (i.e., when the switching step, which will be described later, is performed), the control unit 46 displays an insertion image Pi, which will be described later, on the display screen, and then displays the image of the selected area after the switching step.

[0061] The above-described execution operation of the display process by the control unit 46 corresponds to the display step. In the present embodiment, the image displayed on the display 28 by the display process is a live image (live view image) captured in real time at that time.

[0062] (Extraction process) The extraction process is a process of extracting a portion of the base video. The extracted video is also called a cropped video, and is the recording target in the recording process. During the extraction process, the user performs an operation to set the area to be extracted in the shooting area of ​​the reference video. This setting operation will be specifically described with reference to Fig. 5. Fig. 5 shows the procedure for setting the area of ​​the video to be extracted from the reference video.

[0063] As shown in Fig. 5, the user performs a setting operation with a reference video (denoted by symbol P1 in Fig. 5) displayed on the display screen of display 28. Specifically, when the user operates a predetermined button while the reference video P1 is displayed, a rectangular area setting frame FR is displayed superimposed on the reference video P1, as shown in Fig. 5. The area A2 surrounded by this area setting frame FR is the area of ​​the video extracted from the reference video P1. The angle of view of the extracted video is smaller than the angle of view of the reference video P1, i.e., the first angle of view, and will be referred to as the second angle of view hereinafter.

[0064] The region setting frame FR is displayed with its position, size, and aspect ratio variable. For example, the user can change the display position of the region setting frame FR by touching one side of the region setting frame FR with a finger on the touch panel 36 and dragging the finger. The user can also change the size and aspect ratio of the region setting frame FR by touching the region setting frame FR with two fingers on the touch panel 36 and widening or narrowing the space between the fingers. By changing the position, size, and aspect ratio of the region setting frame FR in this way, the position, size, and aspect ratio of the region of the image extracted from the reference image P1 can be changed.

[0065] The above operations correspond to the setting operations by the user. Furthermore, by repeating the above series of operations multiple times, it is possible to set multiple areas A2 of the image to be extracted within the shooting area A1 of one reference image P1, as shown in Figure 6. Figure 6 shows how multiple areas A2 of the image to be extracted from the reference P1 have been set.

[0066] When a plurality of areas A2 are set, the sizes (second angles of view) of the areas A2 may be the same among the areas A2, or may be different among the areas A2. Furthermore, the shape of each region A2 is not limited to a rectangle (rectangle), but may be a square, parallelogram, trapezoid, rhombus, circle, ellipse, triangle, polygon with pentagons or more, or an indeterminate shape. The number of areas A2 to be set is not particularly limited, but in this embodiment, it is assumed to be two or more as shown in FIG.

[0067] When the user repeats the setting operation multiple times, the control unit 46 accepts each setting operation and sets the number of areas A2 corresponding to the number of setting operations in the shooting area A1 of the reference video P1. Such an operation of the control unit 46 corresponds to the setting step.

[0068] When the reference image P1 is a high-quality image (for example, an image having 10 million or more pixels), the image at the second angle of view extracted from the reference image P1 is an image with sufficiently high quality.

[0069] The number of pixels in the reference image P1 is not particularly limited, but the lower limit is preferably 10 million or more, and more preferably 60 million or more. The upper limit is preferably 1 billion or less, and more preferably 500 million or less. If the number of pixels exceeds the above lower limit, the visibility of the image of the second angle of view extracted from the reference image P1 is ensured. If the number of pixels is below the above upper limit, the data volume of the reference image P1 is reduced, and processing by the control unit 46 is accelerated.

[0070] (Selection and switching processes) The selection process is a process of selecting a selection area in which an image to be recorded appears from among a plurality of areas A2 set in the shooting area A1 of the reference image P1. The switching process is a process in which, after the selection process, a selected area is reselected from among the multiple areas A2 and the selected area is switched. In this embodiment, the number of regions that are selected in the selection process and the switching process is one, but this is not limitative, and two or more regions may be selected.

[0071] To explain the procedures of the selection process and the switching process, the user sets multiple areas A2 by performing the setting operation described above, and then selects one of the areas A2 as the selected area. The user then inputs the selected area A2 using the operation buttons 30, 32, 34 or the touch panel 36, and the control unit 46 accepts this input operation. The control unit 46 determines the selected area from the multiple areas A2 based on the user's input operation. Such an operation by the control unit 46 corresponds to the selection step.

[0072] Furthermore, after the selection step, if the user reselects the selected area to another area A2 and performs an input operation again, the control unit 46 accepts the re-input operation and switches the previously selected area to another area A2 based on the re-input operation. Such an operation by the control unit 46 corresponds to the switching step. The input operation (re-input operation) performed by the user when reselecting the selected area is not particularly limited. For example, the re-input operation may be an operation of tapping the area A2 to be selected on the display 28, or an operation of pressing down either the up / down button or the left / right button of the first operation button 30, which is a cross key.

[0073] As described above, in this embodiment, a selected area is selected from among multiple areas A2 in the selection step, and an image of the selected area is recorded as a video file. Furthermore, when the selection step is performed, an image of the selected area is displayed on the display screen of display 28 in conjunction with the selection step, as shown in Figure 7. Figure 7 shows the image of the selected area displayed on the display screen.

[0074] Furthermore, by performing a switching process after the selection process, the selected area can be switched to change the image to be recorded from an image of one subject to an image of another subject. This allows individual images (more specifically, close-up images of each subject) of multiple subjects in the same scene (same location) to be simultaneously captured by a single image capture device 10 without using multiple devices. Furthermore, the area A2 showing the video to be recorded can be switched in chronological order in response to a user operation, and video files showing the video before and after the switch can be easily obtained.

[0075] Furthermore, in conjunction with the implementation of the switching process, the image displayed on the display screen of display 28 switches from the image of the selection area before the switching process to the image of the selection area after the switching process. In other words, when control unit 46 implements the switching process during the display process, the image of the selection area before the switching process is displayed, and then the image of the selection area after the switching process is displayed. This allows the user to confirm the switching of the selection area on the display screen. In the following description, the image of the selected area after the switching process will be referred to as a post-switching image Pa, and the image of the selected area before the switching process will be referred to as a pre-switching image Pb.

[0076] Furthermore, when the switching process is performed during the display process, the control unit 46 displays the insertion video Pi in the period between the display period of the pre-switching video Pb and the display period of the post-switching video Pa in the display process, as shown in Fig. 8. Fig. 8 is an explanatory diagram of the transition of the displayed video accompanying the performance of the switching process.

[0077] The inserting image Pi is, for example, an image that is not based on any of the reference image, the pre-switching image Pb, and the post-switching image Pa. For example, it may be an image filled with a single color (e.g., black or gray) as shown in Fig. 8. Furthermore, a previously prepared image (e.g., a landscape image or a portrait image provided as a sample image) can also be used as the inserting image Pi.

[0078] The inserting video Pi is not limited to the above video, and may be, for example, a video based on at least one of the post-switching video Pa and the pre-switching video Pb. For example, a video that gradually transitions (cross-fades) from the pre-switching video Pb to the post-switching video Pa may be created, and this video may be displayed as the inserting video Pi. The inserting video Pi may also be a still image related to the pre-switching video Pb.

[0079] (Recording Processing) The recording process is a process in which the control unit 46 records the video of the selected area on a recording medium and creates a video file (more specifically, a moving image file) related to the video. In the recording process, the operation of the control unit 46 to record the video of the selected area corresponds to the recording step.

[0080] Furthermore, when the control unit 46 has performed the switching step, it records the pre-switching video Pb and the post-switching video Pa in the recording step to create a video file. More specifically, in the recording step, the control unit 46 combines the video image of the pre-switching video Pb with the video image of the post-switching video Pa to create a video file. This results in a video file of video in which the subject changes as the selected area is switched, as shown in FIG. 9. FIG. 9 is an explanatory diagram of the video file of the video to be recorded.

[0081] As can be seen from Fig. 9, when the image recorded in the recording process is the image of the selected area and the switching process is performed, the pre-switching image Pb and the post-switching image Pa are recorded. On the other hand, the inserting image Pi is not an image to be recorded and used later, and is therefore excluded from the recording target in the recording process. This allows the image file (moving image file) to be created appropriately so that only images showing the subject as shown in Fig. 9 are recorded.

[0082] (Exposure adjustment processing) The exposure amount adjustment process is a process for adjusting the exposure amount of a selected region, and is executed by utilizing the AE (Automatic Exposure) function of the control unit 46. The operation of the control unit 46 in the exposure amount adjustment process corresponds to an example of an adjustment step of one embodiment of the present invention.

[0083] The exposure amount is determined by a number of parameters, including the exposure time (i.e., the shutter speed of the electronic shutter), the sensitivity (ISO sensitivity) of the pixels 42 of the image sensor 40, and the aperture size (F-number) of light incident on the photographic lens 14. The exposure amount is adjusted by determining the values ​​of each parameter and controlling the aperture driver 23, the image sensor 40, the video processor 48, etc. so that each parameter reaches the determined value. Here, the adjustment of the aperture 20 by the aperture driver 23 is performed using a known automatic light control (ALC) function. Furthermore, the adjustment of the shutter speed of the electronic shutter in the image sensor 40 is performed using a known electronic light control (ELC) function.

[0084] Furthermore, if the photographing lens 14 is equipped with an electronic neutral density filter 21, the above-mentioned multiple parameters include the degree of dimming of the electronic neutral density filter 21. In this case, the value of the degree of dimming of the electronic neutral density filter 21 is determined, and the voltage application unit 24 is controlled so that the degree of dimming becomes the determined value, thereby adjusting the exposure amount.

[0085] The appropriate value of the exposure amount (appropriate exposure amount) of the selected area varies depending on which area is the selected area among the multiple areas A2 set in the shooting area A1 of the reference image P1.

[0086] More specifically, when the reference image P1 is shot, the exposure amount at each location in the shooting area A1 including the multiple areas A2 varies depending on the subject and the environment at each location. That is, the appropriate exposure amount for each area A2 in the shooting area A1 may vary depending on the position of that area A2, and is therefore determined for each area A2.

[0087] The appropriate exposure amount for each region A2 is determined by a known procedure. For example, the brightness of R (Red), G (Green), and B (Blue) (i.e., RGB pixel values) for a certain region A2 is integrated from image signals output from pixels 42 corresponding to a unit region A0 constituting the region A2 in the image sensor 40. Here, the pixel 42 corresponding to the unit region A0 is the pixel 42 located at the same position as the unit region A0 in the positional relationship shown in FIG. 4. For example, the unit region A0 in the region A2 enclosed by a bold frame in FIG. 4 corresponds to the pixel 42 located within the range enclosed by the bold frame in the same figure. The appropriate exposure amount for the region A2 is then determined from the integrated value of the RGB pixel values ​​calculated for the region A2 (more specifically, the average value within the region A2).

[0088] The exposure amount of the selected region is adjusted based on the appropriate exposure amount determined in the above manner. Specifically, the control unit 46 determines the exposure time (shutter speed), aperture value (F-number), and sensitivity (ISO sensitivity) of the pixel 42 based on the appropriate exposure amount of the predetermined region. Regarding the sensitivity (ISO sensitivity), a gain (amplification ratio) is determined for the output signal from the pixel 42 corresponding to the selected region. Here, the gain may be, for example, an analog gain for an analog signal in the analog signal processing circuit 44 or the like, or a digital gain for a signal (data) after digital conversion in the image processing unit 48 or the like.

[0089] After the exposure time, aperture value, and sensitivity are determined, the control unit 46 controls the aperture driving unit 23, the image sensor 40, the image processing unit 48, etc. so that these parameters become the determined values. As a result, the exposure amount when capturing the reference image including the image of the selected area is adjusted to the target exposure amount.

[0090] While the video is being recorded, the exposure adjustment process is repeated periodically (for example, for each frame) using the above procedure. Each time the exposure adjustment process is performed, a target exposure is set, and the exposure time, aperture value, and sensitivity are determined according to the target exposure. Specifically, during video capture, the integrated value of RGB pixel values ​​within a selected area in the Nth frame image (N is a natural number) is calculated. Then, the appropriate exposure amount is calculated based on the calculated integrated value, and a target exposure amount is set from the calculated appropriate exposure amount. Then, the exposure time, aperture value, and sensitivity for capturing the next frame image (i.e., the N+1th frame image) are determined according to the set target exposure amount.

[0091] Furthermore, by performing the exposure adjustment process for each frame, the exposure conditions (exposure time, aperture value, and sensitivity) change over time, and accordingly the exposure of the selected region is adjusted over time. Here, "adjusting over time" means that an adjustment amount is determined for each frame for the parameters to be adjusted, and each parameter is increased or decreased by that adjustment amount for each frame.

[0092] In this embodiment, the exposure adjustment mode includes an auto adjustment mode in which the exposure is automatically adjusted as described above, as well as a manual adjustment mode in which the user manually adjusts the exposure. In the manual adjustment mode, the user operates the various operation buttons 30, 32, 34 or the touch panel 36 to input setting values ​​for the above parameters (exposure time, aperture value, sensitivity, etc.). The control unit 46 then controls the aperture driver 23, the image sensor 40, the image processor 48, etc. so that each parameter becomes the setting value input by the user.

[0093] (Focus adjustment process) The focus adjustment process is a process in which, in autofocus mode, the control unit 46 controls the focus driver 22 to automatically adjust the focus of the photographic lens 14. The operation of the control unit 46 in the focus adjustment process corresponds to an example of an adjustment step of one embodiment of the present invention.

[0094] For focus adjustment in the autofocus mode, known autofocus techniques can be used, such as contrast autofocus, image plane phase difference autofocus, directional light autofocus, and depth-from-defocus (DFD) autofocus. Directional light autofocus is a method of adjusting the focus by shining light toward the subject and measuring the distance to the subject by receiving the reflected light. Examples of directional light autofocus include laser autofocus and autofocus using ToF (Time of Flight) technology. Furthermore, as a DFD-type autofocus, for example, the technology described in Japanese Patent Application Laid-Open No. 2014-98898 or Japanese Patent Application Laid-Open No. 2015-200907 can be used.

[0095] The autofocus may be any one of the above methods, or a combination of multiple methods. In the latter case, contrast autofocus is the first method, and one of image plane phase difference autofocus, directional light autofocus, and DFD autofocus is the second method. Both the first and second methods may be used depending on the situation during focus adjustment (e.g., the type or brightness of the light source).

[0096] In this embodiment, the first and second methods are used together, and the second method is image plane phase difference autofocus. Here, image plane phase difference autofocus has the fastest focus adjustment speed among the above-mentioned methods, although adjustment accuracy decreases when the aperture value (F-number) increases.

[0097] (White balance adjustment processing) The white balance adjustment process is a process in which the control unit 46 automatically adjusts the white balance of the image of the selected area. The white balance adjustment process is performed using a known AWB (Auto White Balance) function, for example, the technology described in Japanese Patent Application Laid-Open No. 2009-33410. The operation of the control unit 46 in the white balance adjustment process corresponds to an example of an adjustment step of one embodiment of the present invention.

[0098] [About the adjustment process] When the control unit 46 performs the selection process or the switching process, it also performs an adjustment process in conjunction with the selection process or the switching process. In the adjustment process, at least one of the exposure amount of the selected area, the focus of the photographing lens 14, and the white balance of the image of the selected area is adjusted. In particular, in the adjustment process after the switching process is performed, at least one of the exposure amount of the selected area after the switching process, the white balance of the image Pa after the switching process, and the focus of the photographing lens 14 after the switching process is adjusted. At this time, the exposure amount of the selected area, etc. is adjusted during the display period of the insertion image Pi.

[0099] As described above, in the first embodiment, the inserting image Pi is displayed, and the display period of the inserting image Pi is used to adjust the exposure amount and the like of the selected area. This eliminates the need to display the image of the selected area (i.e., the post-switching image Pa) while the exposure amount and the like are being adjusted. This makes it possible to avoid a situation in which the user feels uncomfortable by displaying an image in an incomplete adjustment state. Note that the adjustment process does not have to be completed during the display period of the inserting image Pi, and in that case, it may also be performed during the display period of the post-switching image. Even in this embodiment, the post-switching image Pa can be displayed when the exposure adjustment has progressed to a certain extent, thereby mitigating the sense of discomfort felt by the user.

[0100] In the following, a case where the exposure, focus, and white balance are adjusted in the adjustment process will be described as an example. However, the present invention is not limited to this, and any of the exposure, focus, and white balance may be adjusted. In such a case, the user may be allowed to freely select which of the three items to automatically adjust (optimize) by the control unit 46 in the adjustment process. In this case, for items not selected by the user, adjustment (optimization) may be performed on the entire shooting area of ​​the reference image (i.e., the first angle of view) regardless of which area A2 is selected.

[0101] [Video creation flow according to the first embodiment] The flow of video creation according to the first embodiment will be described with reference to Fig. 10. Fig. 10 is an explanatory diagram of the video creation flow according to the first embodiment. In the following description, the period for capturing one reference video (frame image) will be referred to as "one frame" for convenience.

[0102] In the video creation flow, the user first starts up the photographing device 10. After the device is started up, the control unit 46 performs initial settings for various conditions, including photographing conditions and exposure conditions (S001). In this step S001, each of a plurality of parameters that determine the amount of exposure, such as exposure time (shutter speed), aperture value (F-number), and sensitivity (ISO sensitivity), is preset to an initial value. Similarly, in step S001, the focus (in focus) and white balance of the photographing lens 14 are preset according to the photographing environment, etc., as photographing conditions for photographing a video.

[0103] Thereafter, the image capturing device 10 starts capturing video at the first angle of view (i.e., capturing the reference video). In conjunction with this, the control unit 46 performs a display step, and the reference video, which is a live video, is displayed on the display screen of the display 28 (S002).

[0104] The user performs the setting operation described above multiple times, and the control unit 46 accepts each setting operation and performs the setting step (S003). In this step S003, the control unit 46 sets multiple areas A2 in the shooting area A1 of the reference image in accordance with the setting operation performed by the user through the reference image displayed on the display screen.

[0105] Furthermore, when the user selects a selection area from among the multiple areas A2 and inputs the selection result via the touch panel 36 or the like, the control unit 46 performs a selection step (S004). In this step S004, the control unit 46 selects a selection area from among the multiple areas A2 in response to the user's input operation.

[0106] After selecting the selected area, the control unit 46 adjusts the exposure, focus, and white balance for the selected area (S005).

[0107] Thereafter, when the user performs an operation such as pressing the release button 26 to start recording the video, the processes from step S006 onwards are carried out. First, in step S006, the control unit 46 acquires one frame of reference video (i.e., frame image). In the next step S007, the control unit 46 determines whether a predetermined time has passed since the previous switching of the selected area at the current time (current frame). Here, if the switching process has not been performed before, such as in the first frame, the determination in step S007 is "Yes (predetermined time has passed)."

[0108] If step S007 returns "Yes (a predetermined time has elapsed)," then in step S008, the control unit 46 performs a display step to display the image of the selected area on the display screen of the display 28. In addition, in step S009, the control unit 46 performs a recording step to record the image of the selected area on a recording medium and start creating a video file that is the image file. The image of the selected area that is displayed and recorded at this time has had its exposure, focus, and white balance adjusted in step S005 or in step S011, which will be described later.

[0109] Furthermore, if the user selects a selection area once and then reselects it and performs an input operation again (S012), the control unit 46 performs a switching step (S013). In step S013, the control unit 46 reselects and switches the selection area from among the multiple areas A2 in response to the user's input operation. Thereafter, the process returns to step S006, and step S006 and subsequent steps are repeated.

[0110] When the switching step is performed, the control unit 46 performs a display step to display the inserting video Pi on the display screen until a predetermined time has elapsed from the time of the switching step (i.e., when the determination in S007 is "No") (S010). The control unit 46 also performs an adjustment step using the display period of the inserting video Pi (S011). In this adjustment step, the exposure amount of the selected area after the switching step, the white balance of the post-switching video Pa, and the focus of the photographing lens 14 after the switching step are adjusted. Note that in the first embodiment, the control unit 46 suspends video recording during the display period of the inserting video Pi. However, this is not limited thereto, and the control unit 46 may continue recording video during the display period of the inserting video Pi, that is, may create a video file including the inserting video Pi.

[0111] In the first embodiment, the length (time) of the display period of the inserting video Pi is determined in advance based on the time required for adjusting the exposure amount, etc. in step S011. Here, the time required for the adjustment may vary depending on the adjustment content, adjustment method, etc. For example, when image plane phase difference autofocus is used to adjust the focus, the time required for the adjustment is shorter than when contrast autofocus is used. In consideration of the above, it is preferable to determine the length of the display period of the inserting video Pi depending on the adjustment content, adjustment method, etc.

[0112] Furthermore, as mentioned above, the inserting image Pi may be a single black or gray image, or may be a cross-fade image that transitions from the pre-switching image Pb to the post-switching image Pa. When displaying a cross-fade image, the image transition speed may be determined based on the time required for adjusting the exposure amount, etc. in step S011. Here, the image transition speed is a value that represents the rate at which the proportion of the area occupied by the post-switching image Pa in the cross-fade image increases per unit time (increase speed).

[0113] Then, after a predetermined time (i.e., the display period of the inserting image Pi) has elapsed since the previous switching step was performed, the display of the inserting image Pi ends, and the post-switching image Pa is displayed (S008). The post-switching image Pa displayed at this time is an image in a state where adjustments of the exposure amount, etc. have been completed for the post-switching selected area. Note that the control unit 46 may display the post-switching image Pa if adjustments of the exposure amount, etc. have been roughly completed for the post-switching selected area.

[0114] Furthermore, when a predetermined time (i.e., the display period of the inserting video Pi) has elapsed since the previous switching process, the recording process that had been suspended until then is resumed (S009). In the resumed recording process, the post-switching video Pa is recorded on the recording medium. At this time, the post-switching video Pa and the pre-switching video Pb are combined to create a moving image file. Also, as described above, the inserting video Pi is excluded from the recording target. In the moving image file created in this way, the pre-switching video Pb is immediately switched to the post-switching video Pa, as shown in FIG. 9.

[0115] The control unit 46 repeats the above-described series of steps S006 to S013 until the user issues an end instruction by performing a predetermined operation (S014), and the video creation flow ends when an end instruction is received from the user.

[0116] As described above, in this embodiment, when the exposure amount and the like are adjusted in conjunction with switching of the selected area, the inserting image Pi is displayed as a dummy image after switching of the selected area. That is, in this embodiment, the inserting image Pi is displayed in the period between the display period of the pre-switching image Pb and the display period of the post-switching image Pa (strictly speaking, the post-switching image Pa with the exposure amount and the like adjusted). This prevents the post-switching image Pa from being displayed while the adjustment of the exposure amount and the like is still in progress, and makes it possible to prevent the post-switching image Pa at this stage from being seen by the user.

[0117] <<Second embodiment>> In the first embodiment, after the switching step is performed, the inserting video Pi is displayed for a predetermined period of time. On the other hand, the display time of the inserting video Pi may not be determined in advance for a predetermined display time, but may be determined based on the time required for the adjustment process performed after the switching process. For example, the inserting video Pi may continue to be displayed until the adjustment process performed after the switching process is completed. This form is referred to as the second embodiment, and the second embodiment will be described below with reference to FIG. 11. FIG. 11 is an explanatory diagram of the flow of the video creation flow according to the second embodiment. In the following, the second embodiment will be mainly described with respect to the differences from the first embodiment.

[0118] As can be seen from a comparison between FIGS. 10 and 11, the steps in the video production flow according to the second embodiment are generally common to the steps in the video production flow according to the first embodiment. Specifically, step S027 in the video production flow according to the second embodiment is different from step S007 in the video production flow according to the first embodiment. Except for this difference, the content and order of execution of each step (S021 to S026, S028 to S34) other than step S027 in the video production flow according to the second embodiment are the same as those in the video production flow according to the first embodiment.

[0119] In step S007 of the video production flow according to the first embodiment, it is determined whether a predetermined period of time has passed since the previous adjustment process was performed. In contrast, in step S027 of the video production flow according to the second embodiment, it is determined whether the adjustment process performed in conjunction with the switching process has been completed.

[0120] Specifically, when the aperture amount is adjusted so that the exposure amount becomes the target exposure amount in the adjustment process, step S027 determines whether or not driving of the aperture driver 23 for adjusting the aperture amount has been completed. Explaining in more detail, when the aperture amount adjustment is completed, the aperture driver 23 outputs a signal in conjunction with this. When the control unit 46 receives the output signal from the aperture driver 23, it determines that the aperture amount adjustment has been completed at that point.

[0121] Furthermore, when the focus is adjusted to focus on a subject appearing in the image of the selected region in the adjustment process, step S027 determines whether driving of focus driver 22 for focus adjustment has been completed. More specifically, when focus adjustment is completed, focus driver 22 outputs a signal in conjunction with the completion of focus adjustment. When control unit 46 receives an output signal from focus driver 22, it determines that focus adjustment has been completed at that point.

[0122] Then, during the period in which it is determined in step S027 that the adjustment is not yet complete, the control unit 46 continues to display the inserting video Pi in the display process. That is, as long as the aperture driving unit 23 continues to be driven to adjust the aperture amount, or the focus driving unit 22 continues to be driven to adjust the focus, the inserting video Pi is displayed.

[0123] As described above, in the second embodiment, an adjustment process is performed in conjunction with the switching process, and in this adjustment process, the display time of the inserting image Pi is determined based on the adjustment time for the exposure amount, etc. For example, the inserting image Pi is displayed until the adjustment of the exposure amount, etc. is completed. In other words, in the second embodiment, the length of the display period of the inserting image Pi changes depending on the time required to adjust the aperture or focus in the adjustment process. This makes it possible to reliably prevent the user from seeing the post-switching image Pa until the adjustment of the exposure amount, etc. is roughly completed. As a result, it is possible to effectively reduce the sense of discomfort that the user may feel when the post-switching image Pa is displayed while it is being adjusted.

[0124] Furthermore, in the second embodiment, if the time required for adjustment is equal to or longer than a predetermined time, the control unit 46 may display, in the display step, an inserting video Pi as shown in Fig. 12. Fig. 12 shows a first modified example of the inserting video Pi. 12 includes information about the time required for the adjustment. Here, the information about the time required for the adjustment corresponds to, for example, the time remaining until the adjustment is completed, or a message urging the user to wait until the adjustment is completed. As described above, by displaying the inserted image Pi including information about the time required for adjustment, it is possible to inform the user that, for example, it will take time to adjust the aperture or focus.

[0125] <<Third Embodiment>> As described in the above embodiment, when the switching process is performed to switch the selected area, the adjustment process is performed accordingly to adjust the exposure, white balance, and focus. When adjusting the exposure, etc., it is common to adjust the exposure gradually over time to prevent sudden changes. However, when the switching process is performed, it is necessary to complete the adjustments promptly in order to ensure the image quality of the image Pa after switching.

[0126] Considering the above points, it is preferable to adjust the exposure amount and the like at a speed faster than normal immediately after the switching step is performed. This embodiment is referred to as the third embodiment, which will be described below with reference to Fig. 13. Fig. 13 is an explanatory diagram of the video creation flow according to the third embodiment.

[0127] 13, steps S041 to S045 of the video creation flow according to the third embodiment are common to steps S001 to S005 of the video creation flow according to the first embodiment. That is, in the video creation flow according to the third embodiment, first, various conditions are initially set, a reference video is displayed as video shooting begins, a plurality of areas A2 are set, and a selection area is selected from among them (S041 to S044).

[0128] Once the selected area is selected, the exposure, focus, and white balance are adjusted for the selected area (S045). In this step S045, the aperture driver 23 is controlled to change the aperture amount in order to adjust the exposure. Also, the focus driver 22 is controlled to move the focusing optical component 19 in order to adjust the focus. At this time, the exposure and focus are adjusted at normal adjustment speeds. In other words, the aperture driver 23 and the focus driver 22 are driven at normal drive speeds.

[0129] Thereafter, the processes from step S046 onwards are carried out in response to the user pressing the release button 26. More specifically, one frame of the reference image is acquired (S046), and the image of the selected region is displayed (S048).

[0130] Furthermore, if the selected area is reselected, a switching step is performed to switch the selected area (S054, 055). Then, if the switching step is performed, the inserting image Pi is displayed (S052), and the exposure amount and the like are adjusted during the display period of the inserting image Pi (S053). In this step S053, as in step S045, the aperture amount is changed by the aperture driver 23 to adjust the exposure amount, and the focus driver 22 moves the focusing optical component 19 to adjust the focus.

[0131] In the third embodiment, the adjustment speed during the display period of the inserted video Pi is set to a speed faster than the normal adjustment speed (in other words, during periods other than the display period of the inserted video Pi) (S056). Here, the adjustment speed refers to the adjustment speed when adjusting the aperture amount or focus, in other words, the drive speed of the aperture drive unit 23 or the focus drive unit 22. The adjustment speed during the display period of the inserted image Pi may be determined arbitrarily as long as it is faster than the normal adjustment speed, but it is preferably at least 1.5 times faster than the normal adjustment speed, and more preferably at least 2 times faster.

[0132] As described above, in the third embodiment, the adjustment process performed during the display period of the inserting image Pi adjusts the aperture amount or focus at a speed faster than normal. In other words, while the inserting image Pi is displayed, the aperture drive unit 23 or the focus drive unit 22 is driven at a speed faster than normal. This allows the exposure amount or focus of the post-switching image Pa to be quickly optimized and reach the target value early. Furthermore, even if the exposure amount or focus is changed rapidly, the inserting image Pi is displayed during the adjustment, so the effects of a sudden change in exposure amount or focus (for example, discomfort felt by the user) are reduced.

[0133] Furthermore, in the third embodiment, similarly to the second embodiment, it is determined whether the aperture adjustment and focus adjustment after the switching process are completed (S047), and the inserting video Pi is displayed until these adjustments are completed. However, this is not limited to this, and in the third embodiment, the inserting video Pi may be displayed for a predetermined period of time. In the third embodiment, the adjustment speed during the display period of the inserting video Pi is faster than the normal adjustment speed, so the display period of the inserting video Pi can be made shorter.

[0134] After the aperture and focus adjustments are completed, it is determined whether the adjustment speed has returned to the normal speed (S050). If the adjustment speed has not returned to the normal speed, the adjustment speed is set to the normal speed (S051), and then the process proceeds to step S054. On the other hand, if the adjustment speed has returned to the normal speed, the process proceeds directly to step S054.

[0135] The above series of steps (i.e., steps S046 to S056) are repeated for each frame until the user issues an instruction to end (S057), at which point the video production flow according to the third embodiment ends.

[0136] <<Fourth Embodiment>> There are two modes for adjusting the focus of the photographing lens 14: manual focus mode and autofocus mode. In photographing device 10 where these two modes can be selected, the focus is adjusted in the selected mode. When photographing a video with a fixed subject, it is sufficient to manually adjust the focus once to focus on the subject, and manual focus mode is usually selected.

[0137] On the other hand, when switching the selected area in a configuration in which an image of a portion of the image (i.e., an image of a selected area) is extracted from the captured image, it is necessary to adjust the focus on the switched selected area. In this case, even if manual focus mode is selected, it is preferable to automatically adjust the focus on the switched selected area while the inserting image Pi is being displayed. This is because the user cannot check the image of the switched selected area (i.e., the switched image Pa) while the inserting image Pi is being displayed. The above embodiment is defined as the fourth embodiment, which will be described below with reference to Fig. 14. Fig. 14 is an explanatory diagram of a video creation flow according to the fourth embodiment.

[0138] 14, steps S061 to S065 of the video production flow according to the fourth embodiment are common to steps S001 to S005 of the video production flow according to the first embodiment. That is, in the video production flow according to the fourth embodiment, first, various conditions are initialized (S061). Here, in step S061, the focus adjustment mode is set to manual focus mode.

[0139] Thereafter, as video shooting begins, a reference video is displayed, multiple areas A2 are set, a selection area is selected from among them, and the exposure, focus, and white balance are adjusted for the selection area (S062 to S065). In step S065, the exposure and white balance are automatically adjusted by the control unit 46. The user manually adjusts the focus by operating the focus ring 16, for example.

[0140] Thereafter, the processes from step S066 onwards are carried out in response to, for example, the user pressing the release button 26. More specifically, one frame of the reference image is acquired (S066), and the image of the selected region is displayed (S068).

[0141] Furthermore, when the selected area is reselected, a switching step is performed to switch the selected area (S074, 075). When the switching step is performed, the inserting image Pi is displayed (S072), and an adjustment step is performed during the display period of the inserting image Pi to adjust the exposure amount, etc. (S073). In this step S073, the exposure amount and white balance are automatically adjusted, and the focus is also automatically adjusted.

[0142] More specifically, when the switching step is performed and the selected area is switched, the focus adjustment mode, which was previously manual focus mode, is set to autofocus mode (S076). As a result, in the adjustment step during the display period of the inserted video Pi, the focus is automatically adjusted in autofocus mode. In other words, in the fourth embodiment, even if manual focus mode is normally selected, the focus is automatically adjusted immediately after the selected area is switched. As a result, the user does not need to adjust the focus every time the selected area is switched, improving convenience (ease of use) for the user.

[0143] Furthermore, in the adjustment process carried out during the display period of the inserted video Pi, the focus is adjusted by the second method described above, and more precisely, the focus is adjusted by employing image plane phase difference autofocus.

[0144] In particular, in the fourth embodiment, during the display period of the inserted video Pi, focus is adjusted by the second method, image plane phase detection autofocus, regardless of the value of the aperture amount. When the aperture amount becomes sufficiently large (i.e., when the aperture size becomes sufficiently small), the adjustment accuracy of image plane phase detection autofocus decreases. For this reason, it is common to use contrast autofocus when the aperture amount becomes larger than the appropriate value. The appropriate value is the aperture amount beyond which it is considered better in terms of adjustment accuracy to use contrast autofocus rather than image plane phase detection autofocus, and is expressed in F-numbers from F9 to F13.

[0145] On the other hand, when image plane phase detection autofocus is used, the focus adjustment speed is faster. Taking this into consideration, in the fourth embodiment, in the adjustment process performed during the display period of the inserted image Pi, image plane phase detection autofocus is used to prioritize the focus adjustment speed, even if the aperture value becomes larger than the aforementioned appropriate value. This allows the focus to be adjusted quickly after switching the selected area, and the post-switching image Pa to be quickly brought into focus.

[0146] In the fourth embodiment, it is determined whether the focus adjustment after the switching step is complete (S067), and the inserting image Pi is displayed until the adjustment is complete. However, this is not limited to this, and in the fourth embodiment, the control unit 46 may display the inserting image Pi for a predetermined period of time. In the fourth embodiment, the control unit 46 may display the post-switching image Pa when the focus adjustment is almost complete.

[0147] After the focus adjustment is completed, it is determined whether the focus adjustment mode has returned to the manual focus mode (S070). If the focus adjustment mode is the autofocus mode, it is set to the manual focus mode (S071), and then the process proceeds to step S074. On the other hand, if the adjustment speed has returned to the normal adjustment speed, the process proceeds directly to step S074.

[0148] The above series of steps (i.e., steps S066 to S076) are repeated until the user issues an instruction to end the process (S077). Then, at the point in time when the user issues an instruction to end the process, the video production flow according to the fourth embodiment ends.

[0149] As described above, in the fourth embodiment, even when the manual focus mode is selected, the focus is automatically adjusted immediately after the selected area is switched, but this is not limited to this. For example, the control unit 46 may have, as a focus adjustment mode, a full manual mode in which the focus is manually adjusted throughout the entire period during shooting, including the adjustment process immediately after the selected area is switched.

[0150] Furthermore, the above-described content is not limited to focus adjustment, but can also be applied to exposure adjustment. That is, as modes for adjusting the exposure, a manual adjustment mode in which the exposure is manually adjusted based on a user's operation, and an auto adjustment mode in which the exposure is automatically adjusted can be selected. When the manual adjustment mode is selected under such a configuration, it is preferable to automatically adjust the exposure in the adjustment process immediately after switching the selected area (i.e., the adjustment process during the display period of the inserted video Pi). As a result, the user does not need to adjust the exposure every time the selected area is switched, improving convenience for the user.

[0151] <<Fifth Embodiment>> In the five embodiments described above, the video is a moving image, that is, a collection of multiple frame images captured continuously at a constant frame rate. However, the video to be recorded is not limited to a moving image, and may be a still image.

[0152] For example, the control unit 46 displays the reference video as a through image on the display 28, and sets a plurality of partial areas A2 in the shooting area of ​​the reference video, as shown in Fig. 6. Then, when the user selects one of the plurality of set areas A2 as a selected area, the control unit 46 extracts and displays the video of the selected area on the display 28, as shown in Fig. 7. When the user inputs a recording instruction while the video of the extracted selected area is being displayed, the control unit 46 records a still image file of the video of the selected area on a recording medium. Then, when the selected area is switched, the inserting image Pi is displayed thereafter, and the exposure amount and the like can be adjusted for the selected area after the switch using the display period of the inserting image Pi.

[0153] The above embodiment is defined as the fifth embodiment, which will be described below with reference to Fig. 16. Fig. 16 is an explanatory diagram of the flow of video production according to the fifth embodiment. The video creation flow according to the fifth embodiment differs from the video creation flow according to the first embodiment in steps S089 and S090, which are related to recording the video of the selected area, as can be seen by comparing Figures 10 and 16. More specifically, in the first embodiment, after the video of the selected area is displayed (S008), the video of the selected area is recorded and a moving image file is created (S009). In contrast to this, in the fifth embodiment, after displaying the image of the selected area (S088), the control unit 46 determines whether or not the user has instructed to record the image of the selected area (S089). If the control unit 46 determines in step S089 that there has been no instruction to record, the process proceeds to step S093, in which it is determined whether or not the selected area has been reselected. On the other hand, if it is determined in step S089 that a recording instruction has been issued, the control unit 46 records the image of the selected area as a still image file on the recording medium (S090). After the image of the selected area has been recorded on the recording medium, the process proceeds to step S093, in which it is determined whether the selected area has been re-selected.

[0154] When the video to be recorded is a still image, the shutter speed that defines the exposure time may be the shutter speed of an electronic shutter, or may be the shutter speed of the mechanical component shutter 38 (focal plane shutter).

[0155] <<Other embodiments>> The embodiment described above is a specific example given to clearly explain the video creation method of one embodiment of the present invention, and is merely an example, and other embodiments are also possible. For example, in the above-described embodiment, the image capturing device 10 is provided with the electronic neutral density filter 21, but the image capturing device may not have the electronic neutral density filter 21.

[0156] Furthermore, in the above-described embodiment, the photographing device 10 has an autofocus function, but this is not limiting and a photographing device without an autofocus function may also be used. That is, the focus driver 22 may not be provided, and the focus may be adjusted only by operating the focus ring 16 (i.e., only manually). In this case, in the display process after switching the selected area, it is preferable to display an inserting image Pi as shown in FIG. 15. FIG. 15 shows a second modified example of the inserting image Pi. 15 includes guide information for manually adjusting the focus. Here, the guide information corresponds to a message or the like indicating the direction in which to turn the focus ring 16 to achieve focus. As described above, by displaying the inserted image Pi including guide information for focus adjustment, even an imaging device without an autofocus function can manually and appropriately adjust the focus according to the guide information.

[0157] In the above embodiment, the image capture device 10 acts as a video creation device to create a video file, but this is not limiting. For example, other devices connected to the image capture device via a wired or wireless connection, such as a camera controller or an external recorder, may be used as the video creation device. These devices may then create a video file of the video captured by the image capture device.

[0158] Furthermore, in the above-described embodiment, the photographing device is a digital camera, but it may also be a video camera, a mobile phone with an imaging optical system, a smartphone, a tablet terminal, or other portable terminal. The imaging lens may be a lens unit that is externally attached to the imaging optical system of the mobile terminal described above. [Explanation of symbols]

[0159] 10 Imaging equipment 12 Imaging device body 13 Mount 14. Photographic lenses 16 Focus ring 18 Optical Component Unit 19 Focusing optics 20 apertures 21 Electronic neutral density filter 22 Focus drive unit 23 Aperture drive unit 24 Voltage application section 26 Release button 28 Display 30 First operation button 32 Second operation button 34 Third operation button 36 Touch Panel 38 Shutter 40 Image sensor 42 pixels 44 Analog signal processing circuit 46 Control Unit 47 Controller 48 Video Processing Unit 50 internal memory 52 card slots 54 Memory Card 56 buffers A0 unit area A1 Shooting Area A2 area L1 optical axis Video after switching Image before Pb switching Pi insertion video FR area setting frame

Claims

1. 1. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process for adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other; a creating step in which the processor creates a video file by combining the pre-switching video and the post-switching video, In the creating step, the inserted video is excluded from the recording target.

2. The video creation method according to claim 1 , wherein the insertion video is a video based on the pre-switching video and the post-switching video, or a video that is not based on any of the base video, the pre-switching video, and the post-switching video.

3. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, an aperture value of the photographing lens of the photographing device is adjusted after the switching step, thereby adjusting the exposure amount of the selected area after the switching step; An image creation method in which, when the aperture value or the focus of the photographing lens is adjusted in the processing execution process, the length of the display period of the inserted image changes depending on the time required to adjust the aperture value or the focus in the processing execution process.

4. 4. The video creating method according to claim 3, wherein, if the required time is equal to or greater than a predetermined time, the display step displays the insert video including information about the required time.

5. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, an aperture value of the photographing lens of the photographing device is adjusted after the switching step, thereby adjusting the exposure amount of the selected area after the switching step; An image creation method, wherein when the aperture value or the focus of the photographing lens is adjusted in the processing execution step, the adjustment speed of the aperture value or the focus is faster during the display period of the inserted image than during periods other than the display period of the inserted image.

6. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, a mode for adjusting the focus of the photographic lens of the photographing device is selected from a manual focus mode in which the focus is manually adjusted based on a user's operation, and an autofocus mode in which the focus is automatically adjusted; When the manual focus mode is selected, the focus is automatically adjusted in the processing execution step during the display period of the inserted video.

7. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, The method for automatically adjusting the focus of a photographing lens provided in a photographing device includes a first method which is a contrast autofocus, and a second method which is selected from image plane phase difference autofocus, directional light autofocus, and depth-from-defocus autofocus, In the processing execution step during the display period of the insertion video, the focus is adjusted using the second method.

8. an aperture value of the photographing lens after the switching step is adjusted to adjust the exposure amount of the selected area after the switching step; the second method is the image plane phase difference autofocus; 8. The video creating method according to claim 7, wherein in the process execution step during a display period of the inserting video, the focus is adjusted by the second method regardless of the value of the aperture amount.

9. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, If the photographing device does not have a function for automatically adjusting the focus of the photographing lens, the focus is adjusted manually based on the user's operation; In the displaying step, the inserting image including guide information for manually adjusting the focus is displayed.

10. A video creation method for creating a video file, comprising: a setting step in which a processor sets one or more areas having a second angle of view different from the first angle of view within a shooting area of ​​a reference image having a first angle of view; a selection step in which the processor determines a selected area, the area including an object to be recorded; a switching step in which the processor switches the selected region; a display step in which the processor displays an inserting image during a period between a display period of a pre-switching image, which is an image of the selected area before the switching step is performed, and a display period of a post-switching image, which is an image of the selected area after the switching step is performed; a processing execution step in which the processor executes, during a display period of the insertion video, a process of adjusting conditions for acquiring an image of the selected area corresponding to the other of the pre-switching video and the post-switching video in order to change the displayed image from one of the pre-switching video and the post-switching video to the other, a mode for adjusting the exposure amount of the selected region after the switching step is selected from a manual adjustment mode in which the exposure amount is manually adjusted based on a user operation, and an auto adjustment mode in which the exposure amount is automatically adjusted; When the manual adjustment mode is selected, the exposure amount is automatically adjusted in the processing execution step during the display period of the insertion image.

11. The video creation method according to claim 1 , wherein the switching step switches the selected area by reselecting the selected area after the selection step is performed.

Images