Presentation method and video processing method

Abstract

To provide a display method and a video recording method for a user to perceive a position of an extraction range moving within an angle of view.SOLUTION: A display method of the present invention includes: an acquisition step of acquiring reference video that is a motion picture; an extraction step of extracting extraction video set to be smaller than an angle of view of the reference video within the angle of view from the reference video; a movement step of moving an extraction range of the extraction video over time; a first display step of displaying the extraction video on a display device; and a second display step of displaying support video based on a positional relationship between the angle of view and the extraction range on the display device, the second display step being executed during execution of the first display step.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a display method for displaying video and a video processing method for recording video.

Background Art

[0002] Among imaging devices for capturing video, there are those that extract (crop) a part of the video within the angle of view of the captured video and display the extracted video, such as the imaging devices described in Patent Documents 1 and 2. The imaging devices described in Patent Documents 1 and 2 have a function of changing the position of the extraction area within the angle of view at a predetermined speed. By using this function, for example, it is possible to track a subject in the video or slide the angle of the recorded video in a certain direction without manually moving the imaging device during shooting.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] When displaying the video within the extraction range while moving the extraction range, it is required to be able to confirm the position of the extraction range within the angle of view so that the user can grasp which range within the angle of view is being extracted. However, in the video display method using the imaging devices described in Patent Documents 1 and 2, although the video within the extraction range moving within the angle of view is displayed, it is difficult to grasp the position of the extraction range only from the displayed video.

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to solve the problems of the above prior art and to provide a display method for allowing a user to grasp the position of an extraction range that moves within an angle of view, and a video recording method employing the display method.

Means for Solving the Problems

[0006] In order to achieve the above object, the display method of the present invention includes an acquisition step of acquiring a reference video, an extraction step of extracting an extraction video set smaller than the angle of view within the angle of view of the reference video from the reference video, a movement step of moving the extraction range of the extraction video over time, a first display step of displaying the extraction video on a display device, and a second display step of displaying a support video based on the positional relationship between the angle of view and the extraction range on the display device, and is characterized in that the second display step is executed during the execution of the first display step. According to the display method of the present invention described above, during the display of the extraction video, by displaying a support video based on the positional relationship between the angle of view and the extraction range, the user can grasp the position of the extraction range that moves within the angle of view.

[0007] Further, in the display method of the present invention, the support video may include the extraction video, and in the second display step, a support video in which the position of the extraction video in the support video is specified may be displayed.

[0008] Further, the display method of the present invention may further include a third display step of displaying information regarding at least one of the reference video and the extraction video on the display device. In this case, it is more preferable that the third display step is executed during the execution of both the first display step and the second display step.

[0009] Further, in the display method of the present invention, in the first display step, the extraction video may be displayed in a state where the display size of the extraction video can be changed, and in the second display step, the support video may be displayed in a state where the aspect ratio of the support video and the display size of the support video can be changed. In this case, in the first display step, the extracted video may be displayed in a state where the display size of the extracted video can be changed while maintaining the aspect ratio of the extracted video constant. In the second display step, the support video may be displayed in a state where the display size of the support video is changed according to the display size of the extracted video.

[0010] Alternatively, in the above display method, in the second display step, when the display size of the extracted video is changed, a support video showing a part of the video in the reference video may be displayed in a state where the display size of the support video is changed while maintaining the aspect ratio of the support video constant.

[0011] Further, in the display method of the present invention, the second display step is executed according to the display method selected by the user among the first display method and the second display method. When the first display method is selected, in the second display step, the support video is displayed in a state where the aspect ratio and the display size of the support video can be changed. When the second display method is selected, in the second display step, a support video showing a part of the video in the reference video may be displayed in a state where the display size of the support video is changed while maintaining the aspect ratio of the support video constant.

[0012] Further, the acquisition step may be a shooting step of shooting a reference video at an angle of view. In this case, in the shooting step, the reference video is shot at the angle of view using an anamorphic lens, and in the first display step, the extracted video may be displayed by stretching the size in the horizontal direction of the angle of view using the anamorphic lens.

[0013] Further, in the display method of the present invention, the movement step is executed during the execution of the shooting step. In the movement step, at least one of the position, size, movement speed, and movement direction of the extraction range may be changed based on an instruction from the user received during the execution of the movement step.

[0014] Further, in the display method of the present invention, in the movement step, the extraction range may be moved within the angle of view so that the subject of the tracking target set by the user enters the extraction range.

[0015] Further, the display device may include a first display device and a second display device. In this case, the first display device may display the extracted video on the first display device, and the second display device may display the support video on the second display device.

[0016] Further, the display method of the present invention may include a third display step of displaying character information regarding at least one of the reference video and the extracted video on the second display device. In this case, the third display step is executed while both the first display step and the second display step are being executed. When the first display device is vertically and horizontally inverted during the first display step, in the second display step, the vertically and horizontally inverted support video may be displayed on the second display device, and in the third display step, the character information with the display orientation maintained may be displayed on the second display device.

[0017] Further, the display method of the present invention may include a determination step of determining whether or not the distance between the edge of the viewing angle and the edge of the extraction range is less than a threshold value during the execution of the movement step, and a warning step of warning the user when the distance is less than the threshold value.

[0018] Further, according to the present invention, it is possible to provide a video recording method that employs the above-described display method and includes a recording step of recording the extracted video on a recording medium.

[0019] Further, the present invention provides an apparatus for video display having a processor, wherein the processor executes an acquisition step of acquiring a reference video, an extraction step of extracting an extracted video, which is set to be smaller than the viewing angle within the viewing angle of the reference video, from the reference video, a movement step of moving the extraction range of the extracted video over time, a first display step of displaying the extracted video on a display device, and a second display step of displaying a support video based on the positional relationship between the viewing angle and the extraction range on the display device, and is configured to execute the second display step during the execution of the first display step.

Advantages of the Invention

[0020] According to the display method and the video recording method of the present invention, it is possible to allow the user to grasp the position of the extraction range moving within the viewing angle.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0022] Hereinafter, preferred embodiments of the present invention (first to fourth embodiments) will be described in detail with reference to the accompanying drawings. However, the embodiments described below are merely examples given to facilitate the understanding of the present invention and do not limit the present invention. That is, the present invention can be changed or improved from the embodiments described below without departing from the gist thereof. Also, equivalents of the present invention are included therein.

[0023] <<First Embodiment>> The first embodiment of the present invention relates to a display method using the photographing device 10 shown in FIGS. 1 and 2. That is, the display method according to the first embodiment of the present invention is realized by the photographing device 10.

[0024] [Basic Configuration of Photographing Device] The basic configuration of the photographing device 10 will be described with reference to FIGS. 1 to 3.

[0025] The photographing device 10 is a portable digital camera, has the appearance shown in FIGS. 1 and 2, and photographs still images and moving images. Further, the photographing device 10 has a function of displaying the photographed image (video) and recording the video. In this specification, among the functions of the photographing device 10, the function of photographing a video, which is a moving image, in real time will be mainly described.

[0026] The photographing device 10 is composed of a photographing device main body 12 and a housing 14. The photographing device main body 12 is the part of the photographing device 10 excluding the housing 14. The housing 14 has substantially the same structure as the housing of a general digital camera, and inside it, a photographing unit 20 shown in FIG. 3, and a control unit including a controller 30 and a video processing unit 32 are accommodated.

[0027] The imaging unit 20 is a device for capturing an image. As shown in FIG. 3, it includes a lens unit 110, a lens driving unit 120, a diaphragm unit 130, a shutter 140, an imaging sensor 150, and an A / D (Analog / Digital) converter 160.

[0028] The lens unit 110 has a zoom lens 112 and a focus lens 114. In the first embodiment, the zoom lens 112 is equipped with an anamorphic lens. Therefore, in the first embodiment, it is possible to capture an image with a wide horizontal angle of view (for example, an aspect ratio of 2.35:1). However, it is not limited to an anamorphic lens, and imaging lenses such as a wide-angle lens, an ultra-wide-angle lens, and a 360-degree lens may be used. Also, the lens unit 110 may be configured to be replaceable with other lens units. Further, the imaging unit 20 may include a plurality of lens units 110 having different angles of view from each other. Here, the angle of view when the imaging unit 20 captures an image is determined according to the specifications of the lens unit 110 and the imaging sensor 150, etc. The image captured at that angle of view corresponds to the "reference image" of the present invention. The aspect ratio of the reference image is a value corresponding to the above angle of view, and when an anamorphic lens is used, it is, for example, 2.35:1.

[0029] The lens driving unit 120 is composed of a driving motor (not shown) and a driving mechanism (not shown), and moves the lens of the lens unit 110 along the optical axis. The diaphragm unit 130 adjusts the size of the aperture according to the user's setting or automatically, and adjusts the amount of light passing through the aperture. The shutter 140 blocks the transmitted light to the imaging sensor 150.

[0030] The imaging sensor 150 is composed of, for example, a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor Image Sensor), etc. It receives light from a subject via the lens unit 110, forms an image, and generates image data. Specifically, the imaging sensor 150 converts the optical signal received through a color filter into an electrical signal by a light receiving element, amplifies the electrical signal by an AGC (Auto Gain Controller), and generates analog image data from the amplified signal.

[0031] The A / D converter 160 converts the analog image data generated by the imaging sensor 150 into digital image data. This digital image data corresponds to the data of the frame images that constitute the reference video which is a moving image. Note that the number of pixel data (i.e., the number of pixels) constituting the digital image data is not particularly limited. However, in the first embodiment, the number of pixels is 10 million or more, and preferably, the lower limit of the number of pixels is 60 million or more. Also, the preferable upper limit of the number of pixels in the first embodiment is 1 billion or less, and more preferably 500 million or less. If the number of pixels exceeds the lower limit, the visibility of the extracted video extracted from the reference video can be ensured. Also, if the number of pixels is less than the upper limit, the pixel information amount of the reference video can be made smaller, so the processing by the control unit (specifically, the video processing unit 32) can be speeded up.

[0032] The controller 30 controls each part of the imaging device main body 12 according to the user's operation or automatically. For example, it can control the imaging unit 20 to cause the imaging unit 20 to capture (acquire) a reference image. Further, the controller 30 can control the video processing unit 32 so that a video (specifically, an extraction video described later) is recorded on a recording medium. Also, the controller 30 can control the lens drive unit 120 to focus the lens unit 110 on a subject in the image based on the contrast or the like of the whole or a part of the image indicated by the digital image data generated by the imaging unit 20. Further, the controller 30 can control the aperture unit 130 based on the luminance of the whole or a part of the image indicated by the digital image data generated by the imaging unit 20, and automatically adjust the exposure amount at the time of shooting. Also, the controller 30 can control the lens drive unit 120 to perform zoom (optical zoom) according to the user's operation or automatically according to the distance between the subject and the imaging device 10.

[0033] Under the control of the controller 30, the video processing unit 32 performs processes such as gamma correction, white balance correction, and defect correction on the digital image data generated by the imaging unit 20, and further compresses it in a compression format conforming to a predetermined standard. Then, the video processing unit 32 acquires a reference image from the compressed digital image data sequentially generated during shooting, and executes various processes on the acquired reference image. As an example of the process on the reference image, the video processing unit 32 can extract an extraction video (so-called crop image) smaller than the angle of view from the reference image within the angle of view of the imaging unit 20. Also, the video processing unit 32 can change the size of the range of the extraction video (hereinafter referred to as the extraction range) in order to perform zoom (electronic zoom) on the image of the subject in the extraction video. Here, the size of the extraction range is the number of pixels of the extraction video (strictly speaking, the number of pixels in the vertical and horizontal directions of the extraction video).

[0034] Note that the control unit including the controller 30 and the video processing unit 32 is composed of one or more microcontrollers or processors. Specifically, the control unit is composed of, for example, a CPU (Central Processing Unit) and a control program for causing the CPU to execute various processes. However, it is not limited thereto, and the above processor may be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), an MPU (Micro-Processing Unit), or other IC (Integrated Circuit), or may be composed by combining these. Further, the above processor may configure the function of the entire control unit including the controller 30 and the video processing unit 32 with one IC (Integrated Circuit) chip as represented by an SoC (System on Chip), etc. Furthermore, the hardware configuration of each of the above processors may be realized by an electric circuit (Circuitry) combining circuit elements such as semiconductor elements.

[0035] Further, inside the housing 14, a built-in memory 230 built in the imaging device main body 12, a memory card 240 detachable from the imaging device main body 12 via a card slot 260, and a buffer 250 are accommodated. The built-in memory 230 and the memory card 240 are recording media on which the aforementioned extracted video is recorded, and are composed of a flash memory, a ferroelectric memory, or the like. The buffer 250 functions as a work memory for the controller 30 and the video processing unit 32, and is composed of, for example, a DRAM (Dynamic Random Access Memory) or a ferroelectric memory, etc. Further, various setting contents, shooting conditions, etc. are stored in the buffer 250. Note that the recording medium does not have to be provided inside the imaging device main body 12, and it may be an external recording medium connected to the imaging device main body 12 via the Internet. Further, the recording medium may be connected to the imaging device main body 12 via a cable such as a USB (Universal Serial Bus) cable or an HDMI (High-Definition Multimedia Interface) (registered trademark), or in a wireless format.

[0036] As shown in FIG. 2, a display device 40 is attached to the back surface of the housing 14. The display device 40 is composed of an LCD (Liquid Crystal Display), an organic EL (Organic Electroluminescence Display) display, an LED (Light Emitting Diode) display, an electronic paper, or the like. Various images including the above-described extracted images are displayed on the display device 40, and an operation screen for setting shooting conditions and the like and mode selection is also displayed. In the first embodiment, the aspect ratio of the screen of the display device 40 is different from the aspect ratio of the angle of view, for example, 4:3 or 16:9, and the value corresponding to the horizontal width / vertical width of the screen of the display device 40 is smaller than that of the angle of view.

[0037] The housing 14 is provided with an operation unit 50, and the user performs various operations related to shooting through the operation unit 50. The operation unit 50 includes, for example, a release button 310, a zoom lever 320, a front operation dial 330, a rear operation dial 340, a cross button 350, and a touch wheel 360 disposed on the housing 14 as shown in FIGS. 1 and 2. When these devices are operated by the user, they transmit various control signals toward the controller 30. For example, when the zoom lever 320 is operated, a control signal for changing the zoom magnification according to the operation is transmitted toward the controller 30, and the controller 30 controls the lens driving unit 120 to move the zoom lens 112 according to the control signal.

[0038] In the first embodiment, the display device 40 is a touch panel display and is also used as the operation unit 50. When the user touches the screen of the display device 40, a control signal corresponding to the touch position is transmitted toward the controller 30. For example, an extraction mode selection screen (see FIG. 6) described later is displayed on the display device 40, and the user selects one of a plurality of modes and touches a corresponding one of the plurality of mode selection buttons drawn on the screen. As a result, a control signal for setting the selected mode is transmitted toward the controller 30. Note that the user can instruct the control unit to perform zoom processing or shutter processing (imaging processing) by touching the screen of the display device 40.

[0039] [Example of the screen of the display device during imaging] Next, an example of the screen displayed on the display device 40 during imaging in the first embodiment will be described with reference to FIG. 4.

[0040] In the first embodiment, during imaging, the screen of the display device 40 is divided into three regions, and as shown in FIG. 4, the extracted video P1 is displayed in the first region, the assist video P2 is displayed in the second region, and the information IF such as the set content is displayed in the third region, all at the same time. Hereinafter, each of the extracted video P1, the assist video P2, and the information IF such as the set content will be described in detail.

[0041] (Extracted video) As shown in FIG. 5, the extracted video P1 is a video set to be smaller than the viewing angle A0 at the viewing angle A0 of the reference video P0 and is extracted (cut out) from the reference video P0. In the first embodiment, since the reference video P0 is a high-definition video composed of 10 million or more (preferably 60 million or more) pixels, the extracted video P1 extracted therefrom is also a sufficiently high-definition video. Note that in the first embodiment, the outer edge of the extracted video P1 has a rectangular shape, but the outer edge shape of the extracted video P1 is not particularly limited and may be square, parallelogram, trapezoid, rhombus, circular or elliptical, triangular or polygonal with five or more sides, or irregular.

[0042] The extraction video P1 is extracted from the reference video P0 by the video processing unit 32 as needed during shooting and is displayed in the first area on the screen of the display device 40 by the video processing unit 32. At this time, the extraction video P1 is displayed in a state where its display size can be changed so as to fit within the first area while maintaining its aspect ratio constant. When shooting using an anamorphic lens, the extraction video P1 is displayed with the size in the horizontal direction of the angle of view A0 when using the anamorphic lens extended. This is because the image size is temporarily compressed in the horizontal direction of the angle of view A0 at the time of imaging by the imaging sensor 150, and the display size is returned to the original size when displaying the extraction video P1.

[0043] In the screen example shown in FIG. 4, the extraction video P1 is displayed in the area located at the bottom most on the screen of the display device 40. However, it is not limited to this. For example, the extraction video P1 may be displayed in the area located at the top most or the central area on the screen of the display device 40.

[0044] Also, during shooting, the range of the extraction video P1 in the angle of view A0, that is, the extraction range A1, can be moved over time within the angle of view A0. Here, "moving over time" means moving the extraction range A1 relative to the angle of view A0 so that the position of the extraction range A1 changes gradually, and it may include cases where the movement stops (interrupts) midway.

[0045] The movement of the extraction range A1 over time is realized by the video processing unit 32. Specifically, when the user selects one mode through the extraction mode selection screen shown in FIG. 6, the video processing unit 32 moves the extraction range A1 within the angle of view A0 along the movement path corresponding to the selected mode.

[0046] More specifically, in the first embodiment, two types of extraction modes are prepared. One mode is a mode in which the extraction range A1 is moved so as to track the subject to be tracked (hereinafter referred to as the tracking mode). The other mode is a mode in which the extraction range A1 is moved in a certain direction (hereinafter referred to as the panning mode).

[0047] When the tracking mode is selected, the video processing unit 32 moves the extraction range A1 so as to track the subject to be tracked. The procedure will be described. When the tracking mode is selected, the user designates by touching the image of the subject in the extraction video P1 on the screen or the like. The video processing unit 32 sets the subject designated by the user as the tracking target. Thereafter, the video processing unit 32 moves the extraction range A1 so that the subject to be tracked is within the extraction range A1 as shown in FIG. 7.

[0048] As described above, when the tracking mode is selected, as long as the subject to be tracked exists within the angle of view A0, the extraction video P1 showing the subject to be tracked can be constantly displayed on the display device 40. In addition, it is not necessary for the user to move the imaging device 10 himself / herself to track the subject, so there is no manual change of the angle of view, and it is possible to avoid video disturbance (such as video blur) caused by manual change of the angle of view. Such an effect is particularly effective when shooting at the angle of view when using an anamorphic lens.

[0049] Note that the algorithm for searching for the subject to be tracked within the angle of view A0 is not particularly limited. For example, the image of the subject set as the tracking target is stored in the buffer 250 as a template image, and a known template matching technique is applied to compare the template image with the reference video P0. Then, as a result of the comparison, the video of the part that matches the template image may be specified as the video of the subject to be tracked.

[0050] When the panning mode is selected, the video processing unit 32 slides the extraction range A1 in a certain direction (for example, the horizontal direction of the angle of view A0), that is, pans it. To explain the procedure, when the panning mode is selected, the user sets the start position, moving direction, moving speed, etc. of the extraction range A1 on a setting screen (not shown). Thereafter, as shown in FIG. 8, the video processing unit 32 automatically pans the extraction range A1 from the set start position in the set direction at the set speed.

[0051] As described above, when the panning mode is selected, a video that continuously changes the shooting angle in a certain direction, so to speak, a panoramic video, can be displayed on the display device 40. In addition, it is not necessary for the user to move the imaging device 10 himself / herself to change the angle, and therefore there is no manual change of the angle of view, and image disturbance (image blur, etc.) caused by manual change of the angle of view can also be avoided. Such an effect is particularly effective when shooting at the angle of view when using an anamorphic lens.

[0052] Incidentally, regarding the setting items related to the extraction range A1, such as size, aspect ratio, area ratio, and moving speed during movement, usually, the initially set content is adopted, but the user can arbitrarily set it on a setting screen (not shown). The aspect ratio of the extraction range A1 is the aspect ratio of the extracted video P1, and strictly speaking, it is the ratio of the number of pixels in the vertical and horizontal directions respectively. The area ratio of the extraction range A1 is the ratio of the area of the extraction range A1 to the angle of view A0. The moving speed of the extraction range A1 is the number of pixels passed by the moving extraction range A1 per unit time when the angle of view A0 is divided in pixel units.

[0053] In the first embodiment, during the movement of the extraction range A1, an instruction from the user is received through the operation unit 50, and based on this instruction, the size, movement speed, movement direction, and position during movement of the extraction range A1 can be changed. For example, the size can be changed by operating the front operation dial 330, and the movement speed can be changed by operating the rear operation dial 340. Also, the movement direction can be changed by operating the cross button 350, and the position during movement can be changed by the touch panel of the display device 40. In this case, the user can change various setting contents related to the extraction range A1 in real time and intuitively according to the situation during the movement of the extraction range A1. Note that the devices operated when changing the setting contents of the extraction range A1 are not limited to the above-described correspondence relationship. For example, the size of the extraction range A1 may be changed based on the operation of the touch wheel 360.

[0054] (Support video) The support video P2 is a video based on the positional relationship between the shooting angle A0 and the extraction range A1 during shooting, and is displayed for the user to grasp the position of the extraction range A1 within the shooting angle A0 during shooting. The support video P2 is displayed on the display device 40 by the video processing unit 32. Specifically, during shooting, the video processing unit 32 recognizes the position, size, etc. of the extraction range A1, and generates the support video P2 based on this information and displays it on the display device 40.

[0055] Also, the support video P2 is a video including the extraction video P1 as shown in FIG. 9, and in the first embodiment, it is constituted by the entire reference video P0 (strictly speaking, the reference video P0 with the display size reduced while maintaining the aspect ratio).

[0056] Also, the support video P2 is a video in which the position of the extraction video P1 in the support video P2 is specified. Specifically, as shown in FIG. 9, it is a video in which the extraction video P1 is surrounded by a frame. Regarding the manner of specifying the position of the extracted video P1 in the support video P2, it may be a manner other than surrounding it with a frame. For example, it may be a manner of changing only the display color of the extracted video P1 in the support video P2 to a highlight color, or a manner of displaying an instruction mark such as a cursor near the extracted video P1 in the support video P2. Also, in the support video P2, the display color of the area other than the extracted video P1 may be made semi-transparent or gray, etc. to emphasize the extracted video P1.

[0057] Also, when the extraction range A1 moves during shooting, the position of the extracted video P1 in the support video P2 also changes in conjunction with it. Further, when the size, aspect ratio, and position of the extraction range A1 are changed during movement, the size, aspect ratio, and position of the extracted video P1 in the support video P2 also change according to the set content after the change.

[0058] The support video P2 described so far is generated as needed by the video processing unit 32 based on the positional relationship between the shooting angle A0 and the extraction range A1 during shooting, and is displayed by the video processing unit 32 in the second area on the screen of the display device 40. At this time, the support video P2 is displayed in a state where the display size can be changed so as to fit into the second area while maintaining its aspect ratio constant.

[0059] Here, when a general lens is used, the support video P2 has the same aspect ratio as the reference video P0 (that is, the shooting angle A0). On the other hand, when shooting with an anamorphic lens, the reference video P0 is stretched in the horizontal direction of the shooting angle A0 to form a horizontally long video with an aspect ratio of 2.35:1, and the reference video P0 is displayed on the display device 40 as the support video P2. Note that the aspect ratio of the display screen on the display device 40 is often different from the aspect ratio of the support video P2 (for example, 4:3 or 16:9). Therefore, when the support video P2 is displayed on the display device 40, there is often a space (margin) at the locations adjacent to the support video P2 in the vertical direction of the display screen. By using this space, the extracted video P1 and the support video P2 can be simultaneously and neatly displayed on the display device 40. In the first embodiment, as shown in FIG. 4, the support video P2 is displayed directly above the extracted video P1. However, the present invention is not limited to this, and the support video P2 may be displayed below the extracted video P1.

[0060] (Information such as setting content) The information IF of the setting content etc. is information regarding at least one of the reference video P0 and the extracted video P1. In the first embodiment, it is character information regarding each of the reference video P0 and the extracted video P1. The information IF of the setting content etc. is displayed on the display device 40 by the cooperation of the controller 30 and the video processing unit 32. Specifically, the controller 30 reads the setting content, shooting conditions, etc. from the buffer 250, and the video processing unit 32 displays the information IF of the setting content etc. on the display device 40 based on the information read by the controller 30.

[0061] As shown in FIG. 10, the information IF of the setting content etc. includes the setting content for each of the reference video P0 and the extracted video P1 (the content belonging to the category marked as "at the time of setting" in FIG. 10) and the information during shooting (the information belonging to the category marked as "at the time of shooting" in FIG. 10).

[0062] The information displayed as the information IF of the setting content etc. is not particularly limited. As an example, the aspect ratio and the number of pixels of the extracted video P1, the position and the area ratio of the extraction range A1, the moving distance of the moving extraction range A1, the distance from the edge of the extraction range A1 to the edge of the angle of view A0, the estimated time until the moving extraction range A1 reaches the edge of the angle of view A0, the setting operation method of the extraction range A1, the shooting time, various shooting conditions (for example, exposure conditions, f-value of the lens, ISO sensitivity, and white balance, etc.), the number of pixels of the extraction area (4K, or Full HD [High Definition], etc.), and the frame rate during moving image shooting, etc. can be mentioned.

[0063] The position of the extraction range A1 is the representative position of the extraction range A1 (for example, the center position or the positions of the four vertices, etc.), and is represented as coordinates when the reference position (for example, the position of the upper left vertex of the viewing angle A0) set at the viewing angle A0 is taken as the origin. The moving distance of the moving extraction range A1 is obtained in pixel units as the total moving distance of the extraction range A1 from the start point of movement, and is represented as a relative value (ratio) based on the length of the viewing angle A0 in the moving direction, for example. The estimated time until the moving extraction range A1 reaches the edge of the viewing angle A0 is the time required for the extraction range A1 to move to the edge of the viewing angle A0, and is obtained from the distance from the edge of the extraction range A1 to the edge of the viewing angle A0 and the moving speed of the extraction range A1. The setting operation method of the extraction range A1 is information indicating which device among the operation units 50 is to be operated when setting "a certain content" regarding the extraction range A1.

[0064] Also, when the extraction range A1 moves during shooting, information IF such as the set content displayed in an interlocked manner (specifically, the position of the extraction range A1, etc.) changes. Further, when the size, aspect ratio, etc. of the extraction range A1 are changed during movement, the information IF such as the set content is updated according to the set content after the change.

[0065] The information IF such as the set content is displayed on the display device 40 together with the extracted video P1 and the support video P2 by the video processing unit 32 during shooting. In the first embodiment, as shown in FIG. 4, the information IF such as the set content is displayed at a position horizontally aligned with each of the extracted video P1 and the support video P2 (for example, the position adjacent on the right). However, it is not limited to this. For example, the information IF such as the set content may be displayed at an upper position or a lower position of the extracted video P1, or at an upper position or a lower position of the support video P2. Also, a plurality of areas where the information IF such as the set content is displayed may be provided on the screen of the display device 40, and information regarding the reference video P0 may be displayed in one of the areas, and information regarding the extracted video P1 may be displayed in another area.

[0066] [Regarding the display method] Next, a display method using the imaging device 10 described above will be described with reference to FIGS. 11 and 12. FIGS. 11 and 12 show the flow of the display process by the imaging device 10. In the display flow shown in FIGS. 11 and 12, the display method of the present invention is adopted. In other words, each step shown in FIGS. 11 and 12 corresponds to a component of the display method of the present invention. Further, in the above display flow, the display method of the present invention is adopted, and the recording step described later is executed. That is, in the above display flow, the video recording method of the present invention is adopted.

[0067] At the start of the display flow, the user activates the imaging device 10. After the device is activated, the controller 30 executes a setting step (S001). In the setting step, the extraction range A1 is set within the angle of view A0 based on a preset initial value or the content instructed by the user.

[0068] Thereafter, the controller 30 controls the imaging unit 20 to start executing the imaging step (S002). The imaging step corresponds to an acquisition step of acquiring a reference video P0 that is a moving image. In the first embodiment, it is a step of imaging the reference video P0 at the angle of view A0 when using an anamorphic lens.

[0069] When the imaging step is executed, the video processing unit 32 executes an extraction step under the control of the controller 30 (S003). In the extraction step, the video processing unit 32 extracts the video of the extraction range A1 set in the setting step, that is, the extraction video P1, from the reference video P0.

[0070] The video processing unit 32 executes a first display step of displaying the extraction video P1 on the display device 40 and a second display step of displaying the above-described support video P2 on the display device 40 along with the extraction of the extraction video P1 (S004). Here, the second display step is executed during the execution of the first display step. Thereby, during imaging, the extraction video P1 and the support video P2 are simultaneously displayed on the display device 40.

[0071] When capturing the reference video P0 using an anamorphic lens in the shooting process, in the first display process, the extracted video P1 is displayed with the size in the horizontal direction of the angle of view A0 when using the anamorphic lens expanded. Also, in the first embodiment, in the first display process, the extracted video P1 is displayed in a state where the display size of the extracted video P1 can be changed while maintaining the aspect ratio of the extracted video P1 constant.

[0072] Also, in the second display process, the support video P2 in which the position of the extracted video P1 in the support video P2 is specified, specifically, the support video P2 in which the portion of the extracted video P1 is framed as shown in FIG. 9, is displayed. When the display size of the extracted video P1 is changed, in the second display process, the support video P2 is displayed in a state where the display size of the support video P2 is changed in accordance with the change in the display size of the extracted video P1. At this time, it is preferable to display the support video P2 in a state where the display size is changed while keeping the aspect ratio of the support video P2 constant.

[0073] Furthermore, in the first embodiment, during the execution of both the first display process and the second display process, a third display process of displaying information IF such as setting contents on the display device 40 is further executed. As a result, during shooting, the extracted video P1, the support video P2, and the information IF such as setting contents are simultaneously displayed on the display device 40.

[0074] When the user presses the release button 310 after the extraction of the extracted video P1 is started, the execution of the recording process is started on this occasion (S005). In the recording process, the extracted video P1 is recorded by the video processing unit 32 in the built-in memory 230 or the memory card 240 as the recording medium. In the first embodiment, the video to be recorded is limited to only the extracted video P1, and other videos, that is, the reference video P0 and the support video P2, are discarded without being recorded. Thereby, the usage amount of the recording capacity can be made smaller. However, it is not limited to this, and one or both of the reference video P0 and the support video P2 may be recorded together with the extracted video P1.

[0075] Also, during the execution of the shooting process, when the user gives an instruction to move the extraction range A1 within the viewing angle A0 (S006), the video processing unit 32 executes the movement process (S007). In the movement process, the extraction range A1 moves along the movement path corresponding to the mode selected by the user among the aforementioned tracking mode and panning mode within the viewing angle A0. More specifically, when the tracking mode is selected, the extraction range A1 is moved within the viewing angle A0 so that the subject to be tracked set by the user enters the extraction range A1. On the other hand, in the movement process when the panning mode is selected, the extraction range A1 slides (pans) based on the start position, movement direction, and movement speed set by the user.

[0076] When the movement process is executed, the video processing unit 32 executes the first display process, the second display process, and the third display process according to the movement of the extraction range A1 (S008). Specifically, in the first display process, the extraction video P1 while the extraction range A1 is moving is displayed. And in the second display process, the support video P2 is displayed so that the position of the extraction video P1 in the support video P2 changes, and in the third display process, the information IF such as the setting content is updated and displayed according to the movement of the extraction range A1. Note that in step S008, similar to step S005, the second display process is executed during the execution of the first display process, and the third display process is executed during the execution of both the first display process and the second display process.

[0077] Also, when the movement process is executed, the video processing unit 32 executes a recording process to record the extraction video P1 while the extraction range A1 is moving due to the movement process (S009).

[0078] On the other hand, when there is no instruction from the user regarding the movement of the extraction range A1, until the user gives an instruction to end shooting (S010), the execution of the above-described first to third display processes and the recording process is repeated, and when the instruction to end shooting is given, the display flow ends. At this point, shooting ends and the recording of the extraction video P1 ends. Note that the operation by which the user instructs the end of shooting is not particularly limited, but for example, an operation of pressing the release button 310 again may be used as an instruction to end shooting.

[0079] Returning to the processing flow of the case where the movement process has been executed, when the user gives an instruction to change at least one of the position, size, movement speed, and movement direction of the extraction range A1 (hereinafter referred to as "the position, etc. of the extraction range A1") during the execution of the movement process (S011), the controller 30 re-executes the setting process (S012). In the re-executed setting process, based on the instruction from the user received during the execution of the movement process, the position, etc. of the extraction range A1 are reset.

[0080] Thereafter, it returns to step S007, and each of the movement process, the first to third display processes, and the recording process is repeatedly executed. In the movement process after the position, etc. of the extraction range A1 have been reset, at least one of the position, etc. of the extraction range A1 is changed based on the instruction from the user received during the execution of the movement process, and then the extraction range A1 is moved.

[0081] Also, in the subsequent first to third display processes (that is, step S008), the extraction video P1, the support video P2, and the information IF such as the setting content based on the extraction range A1 whose position, etc. have been changed are displayed on the display device 40. Specifically, in the first display process, the extraction video P1 after the position, etc. of the extraction range A1 have been changed is displayed. In the second display process, the support video P2 in which the position of the extraction video P1 in the support video P2 has become the changed position is displayed. In the third display process, the information IF such as the setting content is updated and displayed according to the change in the position, etc. of the extraction range A1.

[0082] Also, in the case where the movement process is executed, the video processing unit 32 appropriately executes a determination process (S013). The determination process is executed during the execution of the movement process. In the determination process, it is determined whether the distance between the end of the viewing angle A0 and the end of the extraction range A1 (strictly speaking, the end on the side approaching the end of the viewing angle A0) is less than the threshold value.

[0083] When it is determined in the determination step that the above distance is less than the threshold value (S014), the video processing unit 32 executes a warning step (S015) to give a warning to the user. Thereby, the user can be informed that the extraction range A1 is approaching the vicinity of the edge of the angle of view, and the user can be prompted to perform an operation for changing the angle of view, an operation for instructing the end of shooting, or the like. Note that the warning method in the warning step is not particularly limited, and examples thereof include displaying a warning message on the display device 40, or changing the outer edge frame of the extracted video P1 to a predetermined color (specifically, red or the like).

[0084] In the case where the movement step is executed, until the user gives an instruction to end shooting (S016), the above-described series of steps S007 to S015 are repeated, and the display flow ends when the instruction to end shooting is given. At this point, shooting ends and recording of the extracted video P1 ends.

[0085] As described above, in the video display method according to the first embodiment, the extracted video P1 smaller than the angle of view A0 is extracted from the reference video P0, and the extraction range A1 can be moved within the angle of view A0. Further, during the movement of the extraction range A1, the user can confirm the extracted video P1 by displaying the extracted video P1 on the display device 40. At this time, it is preferable that the position of the extraction range A1 within the angle of view A0 can be grasped. Therefore, in the first embodiment, the support video P2 as an interface representing the position of the extraction range A1 within the angle of view A0 is displayed on the display device 40 together with the extracted video P1. Thereby, even if the extraction range A1 moves within the angle of view A0, the user can grasp the position of the extraction range A1 at each point in time during the movement. Such an effect is particularly effective when the extraction range A1 moves randomly according to the movement of the subject so that the tracking mode is selected and a predetermined subject is tracked.

[0086] Also, in the first embodiment, when a change instruction is received from the user during the execution of the movement process, at least one of the position, size, movement speed, and movement direction of the extraction range A1 is changed based on the instruction. In such a case, the effect that the user can grasp the position of the extraction range A1 is more prominently exhibited.

[0087] Also, in the first embodiment, the support video P2 includes the extraction video P1, and the support video P2 is displayed on the display device 40 in a state where the position of the extraction video P1 in the support video P2 is specified (for example, a state where the extraction video P1 is framed). Thereby, the user can more easily grasp the position of the extraction range A1.

[0088] Also, in the first embodiment, information IF such as setting contents regarding at least one of the reference video P0 and the extraction video P1 is displayed on the display device 40 simultaneously with the extraction video P1 and the support video P2. Thereby, the user can confirm various information indicated by the information IF such as setting contents, and can know more detailed information about the position of the extraction range A1 specified from the support video P2.

[0089] <<Second Embodiment>> In the first embodiment, the support video P2 is constituted by the entire reference video P0, and in the second display step, the support video P2 is displayed on the display device 40 in a state where the display size of the support video P2 can be changed. However, a form of displaying support videos different from the support video P2 according to the first embodiment, for example, support videos P21 and P22 shown in FIGS. 13 and 14, is also conceivable. This form is taken as the second embodiment and will be described below with reference to FIGS. 13 to 15. Here, FIGS. 13 and 14 show screen examples of the display device 40 in the second embodiment and correspond to FIG. 4.

[0090] Note that hereinafter, among the second embodiment, matters different from the first embodiment will be mainly described, and among the elements illustrated in FIGS. 13 and 14, those common to the first embodiment will be given the same reference numerals as in the first embodiment.

[0091] In the second embodiment, the user selects one of two display methods, and the support video is displayed on the display device 40 in the selected display method. That is, the second display step in the second embodiment is executed according to the display method selected by the user among the first display method and the second display method. Regarding the display method, a selection screen shown in FIG. 15 may be displayed on the display device 40, and the user may select a display method by touching one of the display methods on the screen.

[0092] When the first display method is selected, in the second display step, the support video P21 composed of the entire reference video P0 is displayed on the display device 40. The aspect ratio and display size of this support video P21 can be changed.

[0093] In other words, in the second display step when the first display method is selected, the support video P21 can be displayed in a state where the aspect ratio and display size of the support video P21 can be changed. For example, as shown in FIG. 13, the support video P21 whose display size is reduced by being crushed in the vertical direction can be displayed. In this way, when the first display method is selected, the degree of freedom in displaying the support video P21 is higher compared to the first embodiment. That is, in the second display step when the first display method is adopted, along with the change in the display size of the extracted video P1, the support video P21 can be displayed in a state where the aspect ratio and display size of the support video P21 are changed. For example, when the area for displaying the extracted video P1 on the display screen of the display device 40 is expanded, in order to display the support video P21 in the remaining space, the aspect ratio and display size of the support video P21 can be freely changed according to that space.

[0094] In the second display step when the second display mode is selected, a support video P22 composed of a part of the reference video P0 is displayed on the display device 40. This support video P22 is displayed in a state where its display size can be changed while maintaining its aspect ratio constant. That is, in the second display step when the second display mode is selected, along with the change in the display size of the extracted video P1, the above support video P22 can be displayed with its display size changed while maintaining its aspect ratio constant.

[0095] Furthermore, when the second display mode is selected, the user can freely specify the range of the support video P22 in the reference video P0 (specifically, the range displayed as the support video P22) by operating the operation unit 50 or the like, and can freely change the specified range. That is, in the second display step when the second display mode is selected, the support video P22 can be displayed while moving the range of the support video P22 in the reference video P0. Regarding the method of specifying the range of the support video P22 in the reference video P0, various methods such as button operation or touch panel operation can be mentioned. In the second embodiment, a method using an auxiliary video Ps described later is utilized.

[0096] As described above, when the second display mode is selected, as shown in FIG. 14, the video in the range specified by the user in the reference video P0 is used as the support video P22, and the display size of the support video P22 can be changed while maintaining the aspect ratio of the support video P22. For example, in the reference video P0, only the range necessary for displaying as the support video P22 is specified, and then the display size of the support video P22 is adjusted as appropriate. By doing so, the display space of the support video P22 on the display device 40 can be made smaller.

[0097] Also, when the second display mode is selected, as shown in FIG. 14, a range indication video P3, which is a video indicating the range of the support video P22 in the reference video P0, is displayed on the display device 40 together with the extracted video P1 and the support video P22. The range indication video P3 is composed of a reduced reference video P0 and an auxiliary video Ps that is displayed superimposed on the reference video P0. The auxiliary video Ps indicates the portion corresponding to the support video P22 in the reference video P0. By visually recognizing the auxiliary video Ps, the range of the support video P22 in the reference video P0 can be grasped.

[0098] In addition, the auxiliary video Ps can be moved by the user performing a touch-and-drag operation on the screen or the like. By moving the auxiliary video Ps, the range of the support video P22 in the reference video P0 can be changed.

[0099] When the second display format is selected, in addition to the first to third display steps described above, a step of displaying the above-described range indication video P3 (hereinafter referred to as the fourth display step) is executed during the execution of all of the first to third display steps. That is, in the second display format, all of the extracted video P1, the support video P22, the information IF such as the set content, and the range indication video P3 are simultaneously displayed on the display device 40. As described above, when the second display mode is selected, the user can freely determine the range of the support video P22 by operating the auxiliary video Ps. Also, by checking the support video P22 and the range indication video P3, the position of the extraction range A1 within the viewing angle A0 can be grasped.

[0100] Note that when the second display mode is selected, the display of the range indication video P3 (that is, the execution of the fourth display step) is not necessarily required, and only the support video P22 may be displayed by omitting the display of the range indication video P3.

[0101] <<Third Embodiment>> In the first embodiment, information IF such as the extracted video P1, the support video P2, and the setting content is all displayed on the display device 40 of the same imaging device 10. However, a form in which the extracted video P1 and the support video P2 are displayed on different display devices is also conceivable. This form is taken as the third embodiment and will be described below with reference to FIGS. 16 to 18.

[0102] In the following, mainly the matters different from the first embodiment in the third embodiment will be described, and among the elements illustrated in FIG. 16, those common to the first embodiment will be given the same reference numerals as in the first embodiment.

[0103] The third embodiment relates to a display method using the imaging system S shown in FIG. 16. That is, the display method according to the third embodiment of the present invention is realized by the imaging system S. The imaging system S is composed of an imaging device 10X and an external monitor. The basic configuration of the imaging device main body 12X according to the third embodiment is generally common to the basic configuration of the imaging device main body 12 according to the first embodiment as shown in FIG. 16.

[0104] On the other hand, the imaging device main body 12X according to the third embodiment includes a first display device 410 constituted by a touch panel display or the like, and is connected to a second display device 420 which is an external monitor. The second display device 420 is composed of a display device such as a liquid crystal monitor, a recorder with a monitor, or an information processing terminal with a monitor such as a laptop personal computer, a smartphone, or a tablet terminal. Note that the imaging device 10X according to the third embodiment and the second display device 420 are connected by a wired or wireless method.

[0105] In the third embodiment, the display device 400 for displaying the video includes the first display device 410 and the second display device 420 which are separate devices from each other. Further, in the third embodiment, the video processing unit 32 of the imaging device transmits video signals to the respective display devices. As a result, as shown in FIG. 17, the first display device 410 displays the extracted video P1, and the second display device 420 displays the support video P2.

[0106] Then, in the third embodiment, during the execution of the step of displaying the extracted video P1 on the first display device 410 (i.e., the first display step), the step of displaying the support video P2 on the second display device 420 (i.e., the second display step) is executed. As a result, also in the third embodiment, it becomes possible to make the user more easily understand the position of the extraction range A1 within the viewing angle A0. The second display device 420 may display a video corresponding to the display format selected by the user among the two types of support videos P21 and P22 described in the second embodiment.

[0107] Also, as shown in FIG. 17, information IF such as setting contents is displayed on the second display device 420 together with the support video P2. Thus, in the third embodiment, the step of displaying the information IF such as setting contents on the second display device 420 (i.e., the third display step) is provided, and the third display step is executed during the execution of both the first display step and the second display step. Note that a part of the information IF such as setting contents, for example, shooting conditions (e.g., exposure conditions, f-value of the lens, ISO sensitivity, and white balance, etc.) may be displayed on the first display device 410 as shown in FIG. 17.

[0108] Also, as shown in FIG. 16, an orientation detector 60 is mounted on the imaging device main body 12X according to the third embodiment. The orientation detector 60 is configured by, for example, an acceleration sensor or the like, and detects the movement when the orientation of the imaging device 10X changes, for example, when the imaging device 10X is vertically or horizontally inverted.

[0109] In the third embodiment, while the first display process is being executed, that is, while the extracted video P1 is being displayed on the first display device 410, if the user rotates the imaging device 10X 90 degrees, the first display device 410 rotates 90 degrees, and as shown in FIG. 18, the display orientation of the extracted video P1 rotates 90 degrees. When the orientation detector 60 detects this movement, the controller 30 controls the video processing unit 32 according to the detection result. The video processing unit 32 generates a supported video P2 that has been rotated 90 degrees from the state before the orientation detector 60 detects the 90-degree rotation of the imaging device 10X. Then, the video processing unit 32 transmits the video signal to the second display device 420. As a result, in the second display process, as shown in FIG. 18, the supported video P2 that has been rotated 90 degrees is displayed on the second display device 420. By changing the display orientation of the supported video P2 in conjunction with the change in the display orientation of the extracted video P1, even when the first display device 410 rotates 90 degrees, the correspondence between the extracted video P1 and the supported video P2 becomes easier for the user to understand.

[0110] On the other hand, information IF such as setting contents is displayed on the second display device 420. Regarding the information IF such as setting contents, as shown in FIG. 18, the display orientation does not change even after the orientation detector 60 detects the 90-degree rotation of the imaging device 10X. That is, in the third display process, the information IF such as setting contents is displayed on the second display device 420 while maintaining the display orientation before and after the 90-degree rotation of the first display device 410. Thus, even when the display orientation of the extracted video P1 rotates 90 degrees, since the information IF such as setting contents, which is character information, is displayed in the normal orientation, it becomes easier for the user to confirm the information IF such as setting contents.

[0111] <<Fourth Embodiment>> In the first to third embodiments described above, the video is assumed to be a moving image. Here, a moving image means a collection of a plurality of images (frame images) continuously captured at a certain frame rate. In the first to third embodiments, the extracted video recorded on the recording medium is assumed to be a moving image. However, the extracted video recorded on the recording medium may be a still image.

[0112] For example, the control unit including the controller 30 and the video processing unit 32 uses the still image acquired in the acquisition step (specifically, the shooting step) as the reference video P0. As shown in FIGS. 4 and 5, the control unit displays the still image, which is the reference video P0, on the display device 40 as the support video P2. Further, the control unit sets an extraction range A1 corresponding to the subject within the reference video P0, and displays the extraction video P1 reflected in the extraction range A1 on the display device 40. When the recording process is instructed by the user and the recording step is executed, the control unit may execute the recording of a still image instead of shooting a moving image, and record the extraction video P1, which is a still image, on a recording medium such as the memory card 240.

[0113] <<Other Embodiments>> So far, specific embodiments (First to Fourth Embodiments) of the display method of the present invention have been described with examples. However, the above-described embodiments are merely examples, and other embodiments are also conceivable. To give an example, in the above-described embodiment, during the display of the extraction video P1 and the support video P2 (in other words, during the execution of both the first display step and the second display step), it was decided to execute the third display step of displaying the information IF such as the setting content. However, it is not limited to this, and the third display step may not be executed and the display of the information IF such as the setting content may be omitted.

[0114] Also, in the above-described embodiment, as the video acquisition step, a shooting step of shooting a reference video using a shooting device was executed, and an extraction video smaller than the angle of view of the shooting device was extracted from the shot reference video. However, it is not limited to this, and the video acquisition step may be, for example, a step of acquiring a video for video editing as a reference video from the outside. Specifically, the reference video may be acquired by downloading a video file of the reference video from an external data distribution device (server). Alternatively, the reference video may be acquired by reading out the video to be edited from a recording medium on which the video file is recorded.

[0115] In the above-described embodiment, a digital camera is given as an example of the imaging device. However, the present invention is not limited thereto, and for example, a mobile terminal such as a mobile phone, a smartphone, and a tablet PC with an imaging optical system may be used. Further, the aforementioned anamorphic lens may be a lens unit externally attached to the imaging optical system of the aforementioned mobile terminal.

Explanation of Signs

[0116] 10, 10X Imaging Device 12, 12X Imaging Device Main Body 14 Housing 20 Imaging Unit 30 Controller 32 Video Processing Unit 40 Display Device 50 Operation Unit 60 Orientation Detector 110 Lens Unit 112 Zoom Lens 114 Focus Lens 120 Lens Driving Unit 130 Diaphragm Unit 140 Shutter 150 Imaging Sensor 160 A / D Converter 230 Built-in Memory 240 Memory Card 250 Buffer 260 Card Slot 310 Release Button 320 Zoom Lever 330 Front Operation Dial 340 Rear Operation Dial 350 Cross Button 360 Touch Wheel 400 Display Device 410 First Display Device 420 Second Display Device A0 Angle of View A1 Extraction Range Information such as IF Setting Contents P0 Reference Video P1 Extracted Video P2, P21, P22 Support Image P3 Range Indication Image Ps Auxiliary Image S Imaging System

Claims

1. An acquisition step of acquiring a reference image; an extraction step of extracting, from the reference image, an extraction image having an extraction range that is set to be smaller than an angle of view of the reference image; a first display step of displaying the extracted image on a display device; a second display step of displaying, on the display device, an assistance image based on a positional relationship between the angle of view and the extraction range; The second display step is executed during the execution of the first display step, The display device includes a first display device and a second display device, The first display device displays the extracted image on the first display device, The second display device displays the support image on the second display device; a third display step of displaying text information relating to at least one of the reference image and the extracted image on the second display device, the third display step is executed while both the first display step and the second display step are being executed, A display method characterized in that, when the first display device on which the extracted image is displayed in the first display step is rotated, the support image displayed in the second display step is rotated and displayed on the second display device, and the text information displayed in the third display step is displayed on the second display device while maintaining its display orientation.

2. The display method according to claim 1 , further comprising a moving step of moving the extraction range over time.

3. The support image includes the extracted image, The display method according to claim 1 or 2, wherein the second display step displays the support video with the position of the extracted video identified in the support video.

4. a third display step of displaying information on at least one of the reference image and the extracted image on the display device, The display method according to claim 1 , wherein the third display step is executed while both the first display step and the second display step are being executed.

5. In the first display step, the extracted image is displayed in a state in which a display size of the extracted image is changeable; The display method according to claim 1 , wherein in the second display step, the support video is displayed in a state in which an aspect ratio and a display size of the support video are changeable.

6. In the first display step, the extracted image is displayed in a state in which a display size of the extracted image is changeable while maintaining a constant aspect ratio of the extracted image; The display method according to claim 5 , wherein in the second display step, the support video is displayed with a display size of the support video changed in accordance with a change in the display size of the extracted video.

7. The display method described in claim 5, wherein in the second display step, in response to a change in the display size of the extracted image, the support image showing a portion of the reference image is displayed with the display size of the support image changed while maintaining a constant aspect ratio of the support image.

8. the second display step is executed according to a display method selected by a user from the first display method and the second display method, When the first display method is selected, the second display step displays the support video in a state in which an aspect ratio and a display size of the support video are changeable; A display method according to any one of claims 1 to 7, wherein, when the second display method is selected, the second display process displays the support image showing a portion of the reference image in a state in which the display size of the support image can be changed while maintaining a constant aspect ratio of the support image.

9. The display method according to claim 2 , wherein the acquiring step is a photographing step of photographing the reference image at the angle of view.

10. In the photographing step, the reference image is photographed at the angle of view using an anamorphic lens; The display method according to claim 9 , wherein in the first display step, the extracted image is displayed by expanding a size in a horizontal direction of the angle of view using the anamorphic lens.

11. The moving step is performed during the imaging step, The display method according to claim 9 or 10, wherein in the moving step, at least one of a position, a size, a moving speed, and a moving direction of the extraction range is changed based on an instruction from a user that is accepted during execution of the moving step.

12. The display method according to claim 2 , 9 , 10 , or 11 , wherein the moving step moves the extraction range within the angle of view so that the subject to be tracked set by a user falls within the extraction range.

13. a determination step of determining whether or not a distance between an end of the angle of view and an end of the extraction range is less than a threshold value during the movement step; The display method according to claim 2 , further comprising: a warning step of issuing a warning to a user when the distance is less than the threshold value.

14. The display method according to any one of claims 1 to 13, A video processing method comprising a recording step of recording the extracted video on a recording medium.

Images