Representation method

Abstract

To improve convenience for users in a display method for videos capable of segmenting a part of an imaged video and switching the segmented video.SOLUTION: A display method for displaying a video which is imaged by an imaging device includes: a setting step of setting a plurality of preset regions in a reference region which is an imaging region of a reference video; a selection step of selecting a recording region, which is a region of a recording video to be recorded, from among the plurality of preset regions; a switching step of selecting again a recording region from among the plurality of preset regions and switching the recording region after implementing the selection step; a display step of displaying a plurality of preset videos which are videos of the plurality of preset regions; and a control step of executing control processing relating to a change of the reference region after at least the reference region is determined. In a case where the imaging device comprises an optical apparatus for zoom, the control processing includes, as processing for suppressing the change of the reference region, processing for limiting an optical zoom function of the imaging device by stopping moving the optical apparatus during implementation of a recording step.SELECTED DRAWING: Figure 18

Description

[Technical field]

[0001] One embodiment of the present invention relates to a method for displaying an image. [Background technology]

[0002] A technology for extracting and storing an image of one of multiple subjects in a video captured by a single camera has already been developed. One example of such a technology is described in Patent Document 1. In the technology described in Patent Document 1, multiple different image areas are set within the shooting range of the shooting device, and an image of one of the areas is recorded. In addition, in the technology described in Patent Document 1, the area of ​​the image to be recorded can be changed (switched) among the multiple areas. This makes it possible to obtain zoomed-in images of each of multiple subjects in the shot image, for example, while keeping the shooting device fixed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-92467 A Summary of the Invention [Problem to be solved by the invention]

[0004] One embodiment of the present invention has been made in consideration of the above-mentioned circumstances, and aims to improve convenience for users in a method of displaying video that cuts out a portion of a captured video and allows the cut-out video to be switched. [Means for solving the problem]

[0005] In order to achieve the above object, one embodiment of the present invention is a display method for displaying an image captured by an imaging device, comprising: a setting step for setting a plurality of set areas within a reference area, which is the shooting area of ​​a reference image; a selection step for selecting a recording area, which is the area of ​​the recorded image to be recorded, from the plurality of set areas; a switching step for reselecting the recording area from the plurality of set areas after the selection step is performed, thereby switching the recording area; and a display step for displaying the recorded image, the reference image, and an indicator indicating the position of each of the plurality of set areas within the reference image.

[0006] The marker may include a boundary of the set area, and in the displaying step, an image within the boundary of the reference image may be highlighted.

[0007] Also, at the start of the setting process, the markers may be displayed in a state where the respective setting areas do not overlap each other.

[0008] In the display step, a mark indicating the position of the recording area in the reference image and a mark indicating the position of the waiting area, which is a set area other than the recording area, may be displayed in different modes.

[0009] In addition, in the display step, a marker indicating the position of a moving area, which is a set area that moves to follow a moving subject, may be displayed in a manner different from that of a marker indicating the position of a set area other than the moving area.

[0010] In addition, in the display step, the recorded image and the reference image may be displayed on different displays.

[0011] The display process may also include a first display process of displaying the recorded video, the reference video, and the marker, and a second display process of displaying the recorded video but not displaying the reference video and the marker, and one of the first and second display processes may be executed as specified by the user.

[0012] In the second display step, the recording image and the standby image, which is an image of a set area other than the recording area, may be displayed on different displays.

[0013] In addition, the number of markers displayed in the display step may be variable, and the identification information of each marker may be displayed in the display step. In this case, when the number of markers displayed is changed, it is preferable that the identification information set for each marker is maintained before and after the change in the number of markers displayed.

[0014] Moreover, one embodiment of the present invention is a display method for displaying an image captured by a shooting device, comprising a setting step of setting a plurality of set areas within a reference area, which is the shooting area of ​​the reference image; a selection step of selecting a recording area, which is the area of ​​the recorded image to be recorded, from the plurality of set areas; a switching step of reselecting the recording area from the plurality of set areas and switching the recording area after the selection step is performed; a determination step of determining a priority for the plurality of waiting areas when a set area other than the recording area is set as a waiting area; and a display step of displaying a plurality of waiting videos, which are images of the plurality of waiting areas; and when the number of the plurality of waiting areas set within the reference area reaches a set value related to the number of waiting videos to be displayed, the display step displays a waiting video of a waiting area selected from the plurality of waiting areas based on the priority, or displays the plurality of waiting videos in a size according to the priority.

[0015] In addition, in the determination step, a subject in a plurality of waiting videos may be detected, and the priority of each of the plurality of waiting areas may be determined according to information relating to the detected subject.

[0016] In addition, in the determination step, a history of a waiting area being selected as a recording area in the past may be identified, and the priority of each of the multiple waiting areas may be determined based on information relating to the identified history.

[0017] Moreover, one embodiment of the present invention is a display method for displaying an image captured by an imaging device, the display method including a setting step for setting a plurality of setting areas within a reference area, which is the imaging area of ​​a reference image; a selection step for selecting a recording area, which is the area of ​​the recorded image to be recorded, from the plurality of setting areas; a switching step for reselecting the recording area from the plurality of setting areas after the selection step is performed, thereby switching the recording area; a display step for displaying a plurality of setting images, which are images of the plurality of setting areas; and a control step for executing a control process for changing the reference area at least after the reference area is determined.

[0018] The control process may include at least one of a process for suppressing a change of the reference area, a process for encouraging a change of the reference area, and a process for notifying suggested information regarding a change of the reference area. Furthermore, in the case where the photographing device includes an optical device for zooming, the control step may include executing a control process related to zooming by the optical device.

[0019] Alternatively, the reference area may be determined when a user's instruction to start recording is accepted, and the control process may be a process related to changing the reference area after the instruction to start recording is accepted.

[0020] Moreover, one embodiment of the present invention is a display method for displaying an image captured by an imaging device, comprising a setting step of setting a plurality of setting areas within a reference area which is the imaging area of ​​a reference image, a selection step of selecting a recording area which is the area of ​​the recorded image to be recorded from the plurality of setting areas, a switching step of reselecting the recording area from the plurality of setting areas after the selection step is performed and switching the recording area, and a display step of displaying the setting image which is an image of the setting area, wherein at least one of the number of setting images displayed in the display step and the display size of the setting image is determined according to at least one of the items of the resolution and aspect ratio of the recorded image.

[0021] The number of setting videos displayed in the display step may be determined according to at least one item adjusted according to the recording format of the recorded video. [Brief description of the drawings]

[0022] [Figure 1] 1 is a perspective view showing an example of the appearance of an imaging device according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a rear view showing the rear side of the imaging device according to the embodiment of the present invention. [Diagram 3] 1 is a block diagram showing a configuration of an imaging device according to an embodiment of the present invention; [Figure 4] FIG. 2 is an explanatory diagram of electronic image stabilization. [Diagram 5] FIG. 13 is a diagram showing the relationship between a reference region and a set region. [Figure 6] FIG. 2 is a diagram showing the relationship between a reference video and a recorded video. [Figure 7] 13A and 13B are diagrams showing recorded video before and after switching, out of a moving image showing recorded video. [Figure 8] FIG. 13 is a diagram showing a reference image when a new subject enters the shooting area. [Figure 9] FIG. 13 is a diagram showing how a moving region follows a moving subject. [Figure 10] FIG. 13 is a diagram showing a video display flow. [Figure 11] FIG. 11 is a diagram showing the transition of UI screens in a setting process. [Figure 12] 13A and 13B are diagrams showing how a setting region is set when a previously used pattern is selected. [Figure 13] FIG. 13 is a diagram showing a selection screen for a preset pattern. [Figure 14] 13A and 13B are diagrams illustrating user operations related to the position of a setting area. [Figure 15] 13 is a diagram showing a setting area that is set based on an AF position specifying pattern. FIG. [Figure 16] FIG. 2 is a diagram showing characteristic points in a reference video. [Figure 17]FIG. 13 is a diagram showing a state in which a set region is set in a characteristic location. [Figure 18] FIG. 11 is a diagram showing an example of a display screen when a display step is performed. [Figure 19] FIG. 11 is a diagram showing an example of a display screen when a second display step is performed. [Figure 20] FIG. 13 is a diagram showing a modified example of the display screen when the second display step is performed. [Figure 21] FIG. 11 is a diagram showing an example of a screen when the number of waiting areas reaches the maximum number of displayable waiting videos (part 1). [Figure 22] 13 is a diagram showing the flow of a display process when the number of waiting areas reaches the maximum number of displayable waiting videos. [Figure 23] FIG. 2 is a diagram showing an example of a screen when the number of waiting areas reaches the maximum number of displayable waiting videos (part 2). [Figure 24] 13A and 13B are diagrams showing modified screen images when the number of standby areas reaches the maximum number of standby videos that can be displayed; [Diagram 25] FIG. 13 is a diagram showing a process flow during a recording step. [Figure 26] FIG. 13 is a diagram showing an example of a screen before a change process is performed. [Figure 27] 13 is a diagram showing an example of a screen when the number of displayed setting images is increased by a change process. FIG. [Figure 28] 13 is a diagram showing an example of a screen when a moving region overlaps with another setting region; FIG. [Figure 29] 13 is a diagram showing an example of a screen when an overlapping movement area and another set area are integrated into one set area. FIG. [Diagram 30] 13 is a diagram showing an example of a screen when the display of a setting image of a certain setting area is stopped. FIG. [Diagram 31] FIG. 13 is a diagram showing an example of a screen on which suggested information prompting a user to change the reference region is displayed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] A preferred embodiment of the present invention (hereinafter, referred to as the present embodiment) will be described in detail with reference to the accompanying drawings. This embodiment relates to a method for displaying an image using the image capturing device 10 shown in Figures 1 to 3. However, the embodiment described below is merely an example given to facilitate understanding of the present invention, and does not limit the present invention. In other words, the present invention may be modified or improved from the embodiment described below without departing from the spirit of the present invention. Furthermore, the present invention includes equivalents thereof.

[0024] [Basic configuration of imaging device] The image capturing device 10 is, for example, a digital camera that captures images. Here, unless otherwise specified, "video" refers to live video (live view image), that is, video captured in real time. In addition, the video in this embodiment is mainly a moving image. That is, the imaging device 10 captures the moving image at a predetermined frame rate.

[0025] The photographing device 10 is, for example, a lens-interchangeable model, and includes a photographing device body 12 and a photographing lens 14 as shown in Figures 1 and 2. The photographing lens 14 is replaceably attached to a mount 13 of the photographing device body 12. However, the present invention is not limited to this, and the photographing device 10 may be a model with an integrated lens.

[0026] (Photographic lens) As shown in FIG. 3, the photographing lens 14 includes an optical unit 17, an aperture 20, a zoom driver 21, a focus driver 22, and an aperture driver 23. The optical unit 17 includes an optical device 18 for zooming (e.g., a zoom lens). By moving the optical device 18 in the direction of the optical axis L1, the shooting area of ​​the photographing device 10 is enlarged or reduced, changing the zoom. In other words, the photographing device 10 has an optical zoom function using the optical device 18. The image capturing device 10 of this embodiment has an optical zoom function as well as an electronic zoom (digital zoom) function that enlarges a subject in an image by electronic processing.

[0027] The optical unit 17 also includes an optical device 19 for focusing (for example, a focus lens). By moving the optical device 19 in the direction of the optical axis L1, the focal position of the photographing lens 14 changes and the focus is adjusted. The photographing device 10 of this embodiment has an autofocus (AF) function. That is, when a user performs a predetermined operation (for example, an instruction to start recording video) during video shooting, the focus driving unit 22 operates to move the optical device 19. As a result, the focus position is automatically adjusted so as to focus on a predetermined part of the video.

[0028] Furthermore, the optical unit 17 includes a wide-angle lens, an ultra-wide-angle lens, a 360-degree lens, an anamorphic lens, or the like. As a result, the image capturing device 10 can capture an image with a wide angle of view in the lateral direction (width direction) of the image capturing device 10. The angle of view of the image capturing device 10 changes with the execution of optical zoom, etc. Furthermore, the maximum angle of view (full angle of view) of the image capturing device 10 is determined according to the design specifications of the optical unit 17 and the image sensor 40 described below, etc. Incidentally, the optical unit 17 provided in the photographing device 10 is not limited to one, and a plurality of optical units 17 each having a different angle of view may be provided.

[0029] The diaphragm 20 has a variable aperture shape, which is adjusted by a diaphragm driver 23. Adjustment of the aperture shape changes the amount of aperture for light incident on the photographing lens 14, thereby adjusting the amount of exposure.

[0030] (imaging device body) 1 and 2, the photographing device body 12 has an operation section including an operation button 30. In addition, a release button 26, which is one of the operation sections, is disposed on the top surface of the photographing device body 12. When the release button 26 is pressed, recording of the image photographed by the photographing device 10 or an image cut out from the image (strictly speaking, recorded image, which will be described later) starts.

[0031] Here, the shooting area of ​​the photographing device 10, i.e., the range included in the angle of view of the photographing device 10, is determined at the time when a recording start instruction from a user is accepted. The shooting area also changes depending on, for example, whether electronic image stabilization is on or off. When electronic image stabilization is off at the time when a recording start instruction is accepted, the shooting area is generally a full-size (full angle of view) shooting area. The user's operation to instruct the start of video recording is not limited to pressing the release button 26, but may be an operation of touching a predetermined position on the rear display 28, which will be described later.

[0032] Hereinafter, the image captured by the image capture device 10 with the angle of view at that time will be referred to as the "reference image." Also, the capture area of ​​the reference image will be referred to as the "reference area."

[0033] 2 (hereinafter, also referred to as rear display 28) is provided on the rear surface of the imaging device body 12. The rear display 28 is configured, for example, with an LCD (Liquid Crystal Display), an organic EL (Organic Electroluminescence) display, an LED (Light Emitting Diode) display, electronic paper, or the like.

[0034] The display 28 on the rear surface displays the reference image, a recorded image (described later), etc. In this manner, the imaging device 10 having a display has an image display function and is therefore used as an image display device. Furthermore, the display 28 on the back side can display information other than images, such as advice or suggested information regarding photography (see FIG. 18).

[0035] As shown in Figs. 2 and 3, the image capturing device body 12 of this embodiment is provided with an electronic viewfinder (represented as EVF in Fig. 3) 29 as a sub-display. The same image can be displayed on the rear display 28 and the electronic viewfinder 29, or different images can be displayed on each. Incidentally, the image capturing device does not have to be provided with the electronic viewfinder 29. Also, an image may be displayed on the electronic viewfinder 29, but not on the rear display 28.

[0036] Further, a touch panel 36 that detects user operations is provided inside the rear display 28 or on the exposed surface of the display 28. For example, when a user touches a predetermined position on the rear display 28, the touch panel 36 detects the touch position and outputs the detection result to a control unit 46 described later.

[0037] As shown in FIG. 3, the photographing device body 12 further includes a shutter 38, an image sensor 40, an analog signal processing circuit 44, a control unit 46, an internal memory 50, a card slot 52, and a buffer memory 56.

[0038] The imaging element 40 is an image sensor that receives light that has passed through the photographing lens 14, converts the received image into an electrical signal (video signal), and outputs the electrical signal. As the imaging element 40, a solid-state imaging element such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor Image Sensor) can be used.

[0039] The control unit 46 controls each part of the image capturing device 10 and executes various processes related to image capturing, display, recording, etc. The control unit 46 includes a controller 47 and an image processing unit 48 as shown in FIG.

[0040] The control unit 46 has one or more processors, and the control unit 46 is configured by cooperation between the processor and a control program. The processor may be configured, for example, by a central processing unit (CPU), a field programmable gate array (FPGA), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a graphics processing unit (GPU), or other integrated circuits (ICs). Alternatively, the processor may be configured by a combination of these. Furthermore, the processor may be such that the functions of the entire control unit 46 including the controller 47 and the image processing unit 48 are implemented in a single IC (Integrated Circuit) chip, as typified by a SoC (System on Chip) or the like. The hardware configuration of each of the processors described above may be realized by an electric circuit that combines circuit elements such as semiconductor elements.

[0041] The controller 47 controls each part of the photographing device 10 based on a user operation or in accordance with a predetermined control program. For example, the controller 47 controls the image sensor 40 and the analog signal processing circuit 44 so as to photograph an image at a predetermined frame rate.

[0042] The controller 47 controls the driving units 21-23, the image sensor 40, the analog signal processing circuit 44, etc. so that the photographing conditions are the desired conditions. The photographing conditions include focus, exposure, white balance, etc. That is, the controller 47 realizes the autofocus (AF) function, autoexposure (AE) function, and autowhite balance (AWB) function, which are the automatic adjustment functions of the photographing device 10.

[0043] Furthermore, when the controller 47 receives a recording start instruction from the user, it controls the video processing unit 48 to start recording the video.

[0044] The video processing unit 48 converts the analog video signal sent from the analog signal processing circuit 44 into digital video data, and performs gamma correction, white balance correction, etc. on the digital video data. The processed digital video data is compressed in a compression format that complies with a predetermined standard.

[0045] During shooting, the image processor 48 generates compressed digital image data at a predetermined frame rate and acquires images (strictly speaking, frame images) from the data. The images acquired at this time correspond to the reference images shot in the reference area.

[0046] Moreover, the image processor 48 cuts out the recording image from the reference image under the control of the controller 47. The recording image is an image with a smaller angle of view than that of the reference image, and is an image of a partial area of ​​the reference area. The recording image is generated at the same frame rate as the reference image, and is displayed on the rear display 28 or electronic viewfinder 29, for example.

[0047] The recorded video is then recorded on a recording medium. As a result, a video file of the recorded video is created. At this time, the resolution (number of pixels) and aspect ratio of the recorded video are determined according to the recording format (moving video format) of the recorded video. The recording format is not particularly limited and can be freely determined.

[0048] Furthermore, while electronic image stabilization is enabled (ON), image processor 48 extracts an extracted image that is slightly smaller in size than the pre-correction image from the pre-correction image captured at the full angle of view, as shown in Fig. 4. Then, if the extracted image is displaced due to vibration or the like, image processor 48 executes electronic image stabilization to shift the position of the extracted area in the pre-correction image (for example, from the position indicated by the solid line to the position indicated by the dashed line in Fig. 4). It should be noted that while the electronic image stabilization is on, the extracted image becomes the reference image.

[0049] Hereinafter, unless otherwise specified, the respective operations and processes of the controller 47 and the video processing unit 48 will be described as the operation and processing of the control unit 46.

[0050] An internal memory 50 built into the image capturing device main body 12 and a memory card 54 that is removable from a card slot 52 are recording media, in which, for example, video images are recorded. The internal memory 50 and the memory card 54 may be provided in a device (external) separate from the imaging device body 12. In this case, the control unit 46 may record the recorded video on the external recording medium by wire or wirelessly. The buffer memory 56 functions as a work memory for the control unit 46 .

[0051] [Regarding recording and switching of recorded video] The image capturing device 10 records a record image cut out from a base image on a recording medium. The image capturing device 10 can also switch record images by changing the cut-out area in the base image. This function will be described with reference to FIG. 5. For ease of explanation, the subject in the video is not shown in FIG.

[0052] When the photographing device 10 starts photographing, a reference image is displayed on a display (for example, the rear display 28). At this time, the image with the full angle of view usually becomes the reference image, and the area surrounded by the outermost edge in Fig. 5 becomes the reference area As. Also, while electronic image stabilization is on, an extracted image extracted from the image with the full angle of view becomes the reference image, and the area surrounded by the dashed frame in Fig. 5 becomes the reference area At.

[0053] When the user performs a predetermined operation before or during the start of shooting, the control unit 46 sets a setting area Ar within the reference areas As and At. The setting area Ar is a part of the reference areas As and At, and for example, a subject in the reference image is reflected within the setting area Ar (see FIG. 6).

[0054] The position and size of the set area Ar can be adjusted automatically or based on a user operation. By performing a predetermined operation on the screen, the user can change the position and size of the set area Ar in which the subject is captured, for example, according to the position and size of the subject in the reference video.

[0055] In this embodiment, the aspect ratio of the set area Ar is determined to a value according to the recording format (movie format) of the recorded video. Therefore, when changing the size of the set area Ar, the size is changed while the aspect ratio of the set area Ar remains constant. However, the aspect ratio of the set area Ar may be determined independently of the recording format of the recorded video, in which case the size of the set area Ar may be changed while changing the aspect ratio.

[0056] When the set area Ar is set, as shown in FIG. 5, a marker f is displayed in the reference image currently being displayed on the display. A marker f indicates the position of the set area Ar in the reference image and includes the boundary of the set area Ar. The boundary of the set area Ar is set in order to distinguish (distinguish) the set area Ar from its surroundings.

[0057] Examples of the marker f including a boundary include a frame surrounding the set area Ar and a graphic object such as a pointer indicating a representative position of the set area Ar. Differences in brightness, chromaticity, and shading between the set area Ar and its surroundings also fall under the marker f. Anything that can distinguish the set area Ar from its surroundings can be included in the category of the marker f. In the following, a sign f consisting of a colored rectangular frame will be taken as an example for explanation.

[0058] A plurality of set areas Ar can be set in the reference image as shown in Fig. 5. In this case, a marker f is displayed for each set area Ar. Also, identification information (the number displayed in the upper right corner of the marker f in Fig. 5) is displayed for each marker f. The identification information is information that is individually assigned to each marker f in accordance with a predetermined assignment rule by the control unit 46. By displaying the identification information together with the marker f, the user can distinguish between the markers f. The identification information is not particularly limited and may be a number, a letter, or a symbol, or may be a display color of the sign f that is differentiated for each sign f. When a number is used as the identification information, it is preferable that the number be a consecutive number.

[0059] When the setting of the set area Ar is completed, the user selects a recording area Ap, which is an area for recording video, from among the multiple set areas Ar that have been set. The control unit 46 selects a recording area Ap from among the multiple set areas Ar in accordance with the user's selection operation. This determines the set area Ar in which the video within the area is recorded, i.e., the recording area Ap.

[0060] When the recording area Ap is determined, the control unit 46 displays the markers f indicating the position of the recording area Ap and the markers f indicating the positions of the other setting areas Ar, among the markers f for each setting area Ar displayed in the reference image, in different modes. For example, the display mode of the markers f may be the color, brightness, density (degree of shading), shape, thickness and type of the border, and the presence or absence of blinking display. In the case shown in FIG. 5, the display color and thickness of the marker f indicating the position of the recording area Ap is different from those of the other markers f.

[0061] When the user issues a recording start instruction after the recording area Ap has been determined, recording of the image in the recording area Ap (hereinafter referred to as the recorded image) begins. At that point, the reference area (that is, the orientation and angle of view of the image capturing device 10) is determined. Note that the reference area is determined means that the reference area is determined once at the time when the recording start instruction is received. Even after the reference area is determined, the user can freely change the reference area. Incidentally, when the user changes the reference area, it is preferable to change the position of the set area according to the position of the subject, as described later.

[0062] By recording a part of the reference video as a recorded video as described above, it is possible to record, for example, a zoomed video of a part of interest in the reference video. Although the recorded image has a smaller angle of view than the reference image, if the reference image has high image quality (for example, if the number of pixels is 10 million or more), the recorded image will be of sufficiently high image quality. The number of pixels of the reference image is not particularly limited, but the lower limit is preferably 10 million or more, and more preferably 60 million or more. The upper limit of the number of pixels is preferably 1 billion or less, and more preferably 500 million or less. If the number of pixels is greater than the above lower limit, the visibility of the recorded image is ensured. If the number of pixels is less than the above upper limit, the amount of data of the reference image is reduced, and the processing speed by the control unit 46 is increased.

[0063] In addition, in this embodiment, after one set area Ar is selected as the recording area Ap from among the multiple set areas Ar, the recording area Ap can be switched to another set area Ar during video recording. As a result, the video of the recording area Ap before the switch and the video of the recording area Ap after the switch can be recorded, respectively. This will be described in detail with reference to FIG. 6.

[0064] Assume that the photographing device 10 photographs multiple subjects (people) in a certain scene (location) and sets a set area Ar for each subject as shown in Fig. 6. In this case, one set area Ar selected by the user from the multiple set areas Ar becomes the recording area Ap. In the case shown in Fig. 6, four set areas Ar are set, and the set area Ar surrounded by the marker f with the identification information "1" is the recording area Ap.

[0065] When the user issues a command to start recording under the above circumstances, the video of the set area Ar, which is the recording area Ap at that time, is recorded. Then, when the user instructs to change the recording area Ap to another set area Ar (for example, a set area Ar surrounded by a sign f with identification information "2") during video recording, the recording area Ap is reselected and the recorded video is switched. In this manner, in this embodiment, the recorded video can be switched by reselecting the recording area Ap during video recording, which makes it possible to capture zoomed video of each of a plurality of subjects without the need to install individual cameras for each of the subjects.

[0066] Furthermore, when the recorded video is switched, the control unit 46 records the recorded video before the switch and the recorded video after the switch, and combines these videos into one moving image. This allows a moving image file (video file) to be obtained in which the subject in the video changes as the recorded video is switched, as shown in Fig. 7. However, the present invention is not limited to this, and the recorded video before the switching and the recorded video after the switching may be recorded as separate file data without being combined. Also, the reference video and the waiting area described below may be recorded as separate file data.

[0067] In this embodiment, as shown in Figs. 5 and 6, a marker f indicating the position in the reference video is displayed for each of the multiple setting areas Ar including the recording area Ap. This allows the user to grasp the position of each setting area Ar during shooting. In other words, the display method of this embodiment improves convenience (ease of use) from the viewpoint of making it easier to grasp the position of the setting area Ar. This effect is particularly effective in a configuration in which the recording area Ap can be switched among the multiple setting areas Ar. In other words, by displaying the marker f for each setting area Ar, it is possible to easily grasp where in the reference video the recording video after switching is located.

[0068] To add a bit more about the set areas Ar, the number of set areas Ar (set number) can be changed automatically in response to a change in the number of subjects in the reference video, for example, or based on a user operation. For example, as shown in Fig. 8, when a new subject enters the reference video, a new set area Ar can be added to the position of the subject. Conversely, when a subject in the reference video moves outside the reference video, the set area Ar that was the video area of ​​the subject can be automatically deleted.

[0069] Furthermore, when a subject moves within a certain set area Ar (for example, a set area Ar surrounded by a sign f with identification information "5" in FIG. 8), the set area Ar can be displaced to follow the movement of the subject. This makes it possible to track a subject moving in the reference image. Here, tracking of the subject can be achieved by a known subject detection technology using image analysis. Furthermore, when the set area Ar for tracking a moving subject is the recording area Ap, it is possible to record an image of the moving subject.

[0070] Hereinafter, the set area Ar that tracks a moving subject will be referred to as a moving area Am. Note that the moving area Am is not limited to an area that moves to track a moving subject, but may be an area that moves in a predetermined direction at a constant speed or at an irregular speed.

[0071] [Video display flow] The process flow (hereinafter, image display flow) executed by the control unit 46 of the image capturing device 10 will be described with reference to FIG.

[0072] When the user turns on the power supply of the photographing device 10, the video display flow starts. When the video display flow starts, the user performs initial adjustments of the photographing device 10. In the initial adjustments, for example, the user adjusts the resolution (number of pixels) and aspect ratio of the recorded video by specifying a recording method, etc. Such adjustments are performed, for example, when the photographing device 10 is started for the first time, and thereafter, the adjustments are retained. The above adjustments may be performed by the device manufacturer before shipping the photographing device 10. In addition, the user can readjust the resolution, aspect ratio, and the like after starting up the photographing device 10 in order to review the resolution, aspect ratio, and the like that have been adjusted once.

[0073] In the video display flow, first, the control unit 46 starts the shooting process (S001). This shooting process is a process of shooting a reference video in the reference area at that time. With the start of shooting, it is preferable that the real-time reference video is displayed as a live view video on the rear display 28 or the like. The shooting process continues until the user instructs the end of shooting or the power of the imaging device 10 is turned off.

[0074] Thereafter, the control unit 46 executes a setting process (S002). The setting process is a process for automatically setting a plurality of set areas Ar in the shooting area of ​​the reference video. In the setting process, the initial position and initial size of each set area Ar are set, and it is possible to change the position and size of each set area Ar automatically based on a user operation or according to a predetermined rule.

[0075] After the setting step is completed, the control unit 46 executes a selection step (S003). The selection step is a step of selecting a recording area Ap from among the multiple set areas Ar set in the setting step, based on a selection operation by the user. When performing the selection process, the control unit 46 may display an image of each of the multiple setting areas Ar (hereinafter, referred to as a "setting image") on the display. In this case, the user can check the setting image for each of the multiple setting areas Ar.

[0076] Thereafter, when the user issues a recording start instruction (S004), the control unit 46 starts the recording process (S005). The recording process is a process of recording a record video, which is the video of the selected recording area Ap, onto a recording medium. The record video is recorded according to a predetermined recording format (moving image format). As described above, the reference area is determined at the time of receiving a recording start instruction which is a trigger for starting the recording process.

[0077] During the recording step, the control unit 46 also performs a display step (S006). The display step is a step of displaying a plurality of setting images including the recording image, a reference image at that time, and a marker f in the reference image on the display. The user can see these images, confirm the position of each setting area Ar in the reference image, and know which setting area Ar is the recording area Ap.

[0078] During the recording step, the control unit 46 also performs a control step (S007). The control step is a step of executing a control process related to a change of the reference area determined at the time of receiving the recording start instruction. In this embodiment, the control process includes a process for suppressing the change of the reference area, and is, for example, a control process related to zoom (optical zoom) by the optical device 19.

[0079] Furthermore, when the user instructs reselection of the recording area Ap during the recording process (S008), the control unit 46 performs a switching process (S009). The switching process is a process of switching the recording area Ap by reselecting the recording area Ap from among the multiple set areas Ar in accordance with the reselection instruction from the user after the selection process is performed. When the switching process is performed, the video of the recording area after the switch (recorded video) is recorded in the subsequent recording process.

[0080] Then, the series of steps from the recording step (ie, S005 to S009) are repeatedly performed until the user issues an instruction to end the video recording (S010). On the other hand, when an instruction to end the video recording is issued, the recording step ends at that point. Thereafter, when an instruction to end shooting is given or the power of the photographing device 10 is turned off (S011), the image display flow ends at that point.

[0081] [About the setup process] The setting process in the video display flow will be described. In this embodiment, when the setting process is executed, a first UI (User Interface) screen 101 shown in Fig. 11 is displayed on the back display 28. The user selects either "recording pattern" or "automatic setting pattern" as the setting pattern of the setting area Ar, and presses one of buttons Bt1 and Bt2 on the UI screen 101 that indicates the selected pattern.

[0082] In the setting step when a recording pattern is selected, the control unit 46 reads out position information of the set area Ar stored in advance in the image capturing device 10. Then, the set area Ar is automatically set at the position indicated by the read out position information. At this time, it is more preferable to highlight the image within the sign f in the reference image in order to make the sign f easier to see for the user. For example, the brightness of the image other than the image within the sign f (i.e., within the boundary of the set area Ar) in the reference image may be reduced or grayed out (see FIG. 18).

[0083] In this embodiment, when a recording pattern is selected, the second UI screen 102 is displayed on the rear display 28 as shown in Fig. 11. The user selects one of a plurality of recording patterns prepared in advance, and presses one of buttons Bt3, Bt4, and Bt5 on the second UI screen 102 that indicates the selected pattern. As the recording pattern, for example, a "last-used pattern," a "preset pattern," and a "user-input pattern" can be selected.

[0084] On the other hand, in the setting step when the automatic setting pattern is selected, the control unit 46 automatically sets the setting area Ar at a predetermined position in the reference image based on the reference image being shot. In this embodiment, when an automatic setting pattern is selected, the third UI screen 103 is displayed as shown in FIG. 11. The user selects one of a plurality of automatic setting patterns prepared in advance, and presses one of the buttons Bt6, Bt7, and Bt8 on the third UI screen 103 that indicates the selected pattern. As the automatic setting pattern, for example, a "scene recognition pattern," a "subject detection pattern," and an "AF position identification pattern" can be selected. In addition, in the case of an automatic setting pattern, it is preferable to display the markers f in a state where the respective setting areas Ar do not overlap each other at the start of the setting process. This makes it easier to distinguish the plurality of markers f, and makes it easier to set the setting area Ar in the setting process.

[0085] The plurality of recording patterns and the plurality of automatic setting patterns will be described below.

[0086] (Last used pattern) When the previously used pattern is selected, the control unit 46 reads out position information of the setting area Ar set in the setting step of the previous (immediately preceding) video display flow. This position information indicates the positions of each of the multiple setting areas Ar set in the setting step of the previous video display flow, and is stored, for example, in the internal memory 50 of the photographing device 10. It is preferable that the stored position information be retained even after the power of the photographing device 10 is turned off.

[0087] In addition to the position information of the setting area Ar, size information of the setting area Ar may be stored together. In this case, when the previously used pattern is selected, the position information and size information may be read together.

[0088] Then, the control unit 46 automatically sets the setting area Ar to the position indicated by the read position information, that is, the same position as the set position in the previous video display flow, as shown in Fig. 12. Such a previously used pattern is effective when shooting an image with the same composition as the previous video display flow (for example, when shooting an image at the same angle in the same place).

[0089] In the above embodiment, the read position information indicates the position of the setting area Ar set in the previous (immediately preceding) video display flow, but is not limited to this. For example, the position information of the setting area Ar set in several past setting steps may be stored. In that case, the current setting area Ar may be set to the position of the setting area Ar set in the setting step specified by the user among the stored position information.

[0090] (Preset patterns) When a preset pattern is selected, the control unit 46 reads out position information of the setting area Ar that is arranged in a predetermined standard arrangement pattern. The standard arrangement pattern is preregistered in the photographing device 10, or is newly registered when updating the program after purchase, etc.

[0091] When the position information related to a standard arrangement pattern (preset pattern) is read out, a fourth UI screen 104 shown in FIG. 13 is displayed on the rear display 28. A plurality of types of patterns (patterns A to D in FIG. 13) are displayed selectably on the fourth UI screen 104, and the user selects one of the types of preset patterns. The control unit 46 automatically sets the setting area Ar at a position according to the preset pattern selected by the user. Such a preset pattern is effective when an image is shot with a determined composition (for example, when an image is shot at a specific location) and there is a pattern corresponding to the composition. The number of types of preset patterns, and the number and arrangement positions of the setting areas Ar in each preset pattern are not particularly limited and may be determined arbitrarily.

[0092] (user input pattern) When a user input pattern is selected, the control unit 46 reads out position information of the setting area Ar determined based on the user's operation. The user's operation here is an input operation for registering the position of the setting area Ar, and is performed in a stage prior to the setting process (for example, the stage of initial registration related to the pattern). The above input operation is performed, for example, through an input screen 105 for pattern registration shown in FIG. 14. The user touches and drags the inner area of ​​the marker fx for area setting displayed on the input screen 105. As a result, the display position of the marker fx after dragging is registered as the position of the setting area Ar.

[0093] The control unit 46 automatically sets the setting area Ar at the position indicated by the read position information, i.e., the setting position determined based on the user's input operation. Such a user input pattern is effective when preparing a pattern based on the user's input in a situation where the above-mentioned preset patterns cannot be used.

[0094] When the position of the setting area Ar is registered, the size of the setting area Ar may also be registered. That is, information indicating the position and size of the setting area Ar determined based on the user's input operation may be stored. In this case, each of the multiple setting areas Ar is set at the position and size registered as the user input pattern.

[0095] (Scene Recognition Pattern) In the setting process when a scene recognition pattern is selected, the control unit 46 recognizes the shooting scene of the reference video based on the reference video. The shooting scene of the reference video is, for example, a landscape, an event, a type of subject, a scene (e.g., whether it is a daytime view or a night view), and a situation (e.g., weather, etc.) to be shot as the reference video.

[0096] A known scene recognition technique can be used to recognize the shooting scene based on the reference video. For example, a technique for determining whether the brightness or color of a predetermined area of ​​the video is within a preset range can be used. Machine learning can also be performed using a ground truth label indicating the shooting scene of the video and the video data as a learning dataset, and the shooting scene of the reference video can be recognized by a scene recognition model obtained as a result of the learning.

[0097] (Subject detection pattern) In the setting process when the subject detection pattern is selected, the control unit 46 detects a subject in the reference image and automatically sets the setting area Ar at the position of the detected subject. The subject in the reference image is a subject other than a landscape in the reference image that can be detected by the control unit 46, and includes, for example, a person, an animal, a vehicle, and the like. When detecting an object, a known template matching technique may be applied. For example, an image of the object may be stored in advance as a template image, and the template image may be matched with each part of a reference video to detect an image similar to the template image as the object. Alternatively, a model that recognizes objects in a video may be constructed by machine learning, and the object in the reference video may be detected using the model. As an algorithm for the object recognition model, known algorithms such as YOLO (You Only Look Once) or R-CNN (Region with Convolution Neural Network) may be used.

[0098] In the subject detection pattern, the control unit 46 can set a set area Ar for each detected subject, as shown in Fig. 6. At this time, the entire corresponding subject may be contained within each set area Ar, or a part of the corresponding subject (for example, the upper body including the face) may be contained within each set area Ar.

[0099] According to the subject detection pattern as described above, it is possible to automatically set the setting area Ar for the subject in the reference video without the user having to do anything. In this embodiment, the video of the recording area Ap selected from the multiple setting areas Ar is recorded, so the subject detection pattern is effective when recording the video of the subject in the reference video.

[0100] (AF position determination pattern) In the setting step when the AF position identification pattern is selected, the control unit 46 identifies a position in the reference image where the feature for determining the focus of the image capturing device 10 satisfies a criterion, and automatically sets the setting area Ar at the identified position. The feature for determining the focus is, for example, a feature for determining the in-focus position in the reference image. As a specific example, when the autofocus is a phase difference AF (Auto Focus) method, the phase difference corresponds to the above feature. Also, when the autofocus is a contrast AF method, the contrast between a plurality of pixels corresponds to the above feature. The AF method may be an AF method using directional light, or an AF method using DFD (Depth from defocus).

[0101] Moreover, the position that satisfies the criterion is a position where the above-mentioned characteristics (for example, phase difference or contrast, etc.) become characteristics when in focus. To put it simply, the control unit 46 specifies a position in the reference image that is in focus by the AF function as a position that satisfies the criterion. Then, as shown in FIG. 15, a setting area Ar is automatically set for the specified position (the in-focus position, which is the hatched position in FIG. 15). At this time, it is preferable that the size of the setting area Ar is also automatically set according to, for example, the area of ​​the in-focus portion in the reference image.

[0102] In general, the portion of the image that is in focus using the AF function is often the subject of recording. In light of this, by setting the setting area Ar at the in-focus position, the in-focus image can be easily recorded, improving convenience for the user.

[0103] In the AF position identification pattern, when the control unit 46 sets a setting area Ar at a focused position, the control unit 46 automatically sets another setting area Ar accordingly. For example, as shown in Fig. 15, another setting area Ar is set at a symmetrical position (for example, a point-symmetrical position as viewed from the center of the reference image) of the focused position. In this way, when the AF position identification pattern is selected, a plurality of setting areas Ar can be automatically set within the reference area. However, the position at which the other setting area Ar is set is not limited to the above position.

[0104] Furthermore, when the entire reference image is in focus in the AF position identification pattern, the entire reference area may be set as one set area Ar. Furthermore, if a subject is not detected in the reference video and an appropriate setting position for the set area Ar cannot be found within the reference video, the set area Ar may be set near the center of the reference video.

[0105] In this embodiment, the focal position in the reference image is taken as an example of a shooting condition, and the set area Ar is set at a position in the reference image where the characteristics for determining the focal position satisfy the criteria (i.e., the focused position). Here, the shooting condition may be other than the focal position, and may be, for example, exposure and white balance. Note that the shooting condition here excludes the shutter speed and ISO sensitivity.

[0106] Taking the exposure amount, which is one of the shooting conditions, as an example, a setting area Ar can be set at a position in the reference image where a feature for determining the exposure amount (e.g., pixel value or brightness) satisfies a standard. For example, it is preferable to set the setting area Ar at a position in the reference image where the exposure amount is adjusted to an appropriate value by an AE (Automatic Exposure) function. Alternatively, the setting area Ar may be set at each of a position where the exposure amount is relatively low and a position where the exposure amount is relatively high in the reference image.

[0107] Taking white balance, which is one of the shooting conditions, as an example, a setting area Ar can be set at a position in the reference image where a feature (e.g., chromaticity) for determining white balance satisfies a standard. For example, the setting area Ar may be set at a position in the reference image where the white balance is adjusted to an appropriate value by an AWB (Auto White Balance) function. As a specific example, when there are areas in the reference image where light is irradiated from each of a plurality of light sources such as lighting and the sun, a setting area Ar may be set for each irradiation area for each light source.

[0108] The user selects an arbitrary pattern from among the multiple arrangement patterns described above. As a result, in the setting process, the setting area Ar is set to reflect the user's will or preference. In addition, in the setting process, the setting area Ar is automatically set, so the user does not need to take any effort (setting work). In other words, the display method of this embodiment improves convenience (ease of use) in terms of saving the user's effort and setting the setting area Ar in the reference area to reflect the user's will, etc. The arrangement pattern may be an arrangement pattern that combines multiple arrangement patterns shown in FIG. 11. For example, a scene recognition pattern and an AF position identification pattern may be simultaneously adopted to set multiple setting areas Ar.

[0109] It should be noted that the above-mentioned patterns are merely examples, and arrangement patterns other than the above-mentioned patterns may be added, and conversely, some of the above-mentioned patterns may be omitted.

[0110] Furthermore, in the setting process of this embodiment, regardless of the type of selected pattern, if a characteristic location, which will be described later, exists in the reference video, a candidate Ac for the setting area is automatically set at the position of the characteristic location in the reference area. Then, when the user performs a predetermined operation on the set candidate Ac, a setting area Ar is set at the position of the set candidate Ac. The procedure for setting the candidates Ac in the setting step will be described below.

[0111] (About setting candidates) In the setting step, the control unit 46 judges whether or not a characteristic part exists in the reference image based on the characteristics (e.g., pixel value) of each pixel in the reference image. A characteristic part is a part where a visual change occurs in the reference image (excluding those detected as subjects), such as a part where there is movement in the background image and a part where color, brightness, etc. change. Specific examples include a part with a waterfall-like flow, a part where a light is turned on or blinks like an illumination, and a part where the displayed characters and images change like an electronic bulletin board. In the reference video shown in FIG. 16, for example, the illumination appearing in the upper left part of the figure corresponds to a characteristic portion.

[0112] When a characteristic portion is present in the reference video, the control unit 46 executes a first setting step. The first setting step is a step of automatically setting a candidate Ac for the setting region at the position of the characteristic portion in the reference video.

[0113] When the first setting step is performed, in the display step performed thereafter, a mark (hereinafter, referred to as a candidate mark K) indicating the position of the candidate Ac in the reference video is displayed as shown in FIG. 16. The candidate mark K is displayed in a manner different from the mark f indicating the position of the setting area Ar. For example, the candidate mark K in FIG. 16 is a substantially L-shaped graphic object indicating a square of a rectangular area surrounding a characteristic location. The type and shape of the candidate mark K are not particularly limited, and may be, for example, a pointer in the shape of an arrow or a finger, or a graphic object consisting of a symbol such as a circle or a star. Alternatively, the candidate mark K may be the difference in shading (difference in brightness) between the candidate Ac in the reference video and its surroundings.

[0114] When the user performs an operation such as tapping on the candidate marker K during the display step, this triggers the execution of a second setting step. The second setting step is a step in which the control unit 46 sets a setting area Ar at the setting position of the candidate Ac where the user performed an operation (e.g., a tap operation) on the candidate Ac. By performing the second setting step, a new setting area Ar is set in the area of ​​the image of the characteristic location, as shown in FIG.

[0115] As described above, in this embodiment, the candidate Ac of the setting area can be automatically set for a characteristic part in the reference video where a visual change occurs even though the characteristic part is not recognized as a subject. In addition, the candidate marker K indicating the position of the set candidate Ac is displayed in the reference video, so that the user can easily confirm the candidate Ac. Furthermore, the setting area Ar is set at the position of the candidate Ac by the user performing a predetermined operation on the candidate Ac. This makes it possible to set the setting area Ar for a characteristic part in which the user is interested in the reference video. Furthermore, by selecting the setting area Ar set in this way as a recording area, it becomes possible to record the video of the characteristic part.

[0116] [About the display process] The display process in the video display flow will be described in detail below. When the set area Ar is set in the setting process, the control unit 46 starts the display process. After that, the control unit 46 continues the display process until the recording process ends (strictly speaking, until the shooting ends).

[0117] The display step is a step of displaying on a display the recorded image, the reference image, and a marker f indicating the position of each of the plurality of set areas Ar in the reference image. In the display step, the marker f is displayed for each set area Ar in the reference image, as shown in Fig. 18. This allows the user to accurately grasp the position of each set area Ar in the reference image.

[0118] In the display step, as shown in FIG. 18, it is possible to display images (hereinafter, referred to as standby images) of the respective set areas Ar other than the recording area Ap among the plurality of set areas Ar. Furthermore, in the display step when the aforementioned characteristic location exists in the reference video, a candidate marker K indicating the position of the characteristic location is displayed together with the marker f in the reference video.

[0119] To explain an example of the display process, the recorded video, the reference video, and the standby video can be simultaneously displayed on the screen of the rear display 28 (hereinafter, referred to as the display screen). For example, as shown in Fig. 18, the display screen is divided into a main screen G1, a sub-screen G2, and an information display screen G3. In this case, the standby video can be displayed on the sub-screen G2.

[0120] The main screen G1 occupies a relatively wide area of ​​the display screen (for example, more than half of the display screen) and displays the reference video. The aspect ratio of the main screen G1 is preferably set to the same value as the aspect ratio of the reference video. The sub-screens G2 are smaller than the main screen G1 and are arranged in a row along the vertical or horizontal direction of the display screen. Each sub-screen G2 displays a recorded video or one standby video. It is preferable that the aspect ratio of each sub-screen G2 is set to the same value as the aspect ratio of each of the recorded video and the standby video. The information display screen G3 is a screen for displaying text information other than video, and for example, as shown in FIG. 18, displays advice regarding video recording.

[0121] The layout of the display screen (e.g., the size and position of each of the main screen G1 and the sub-screen G2) is not limited to the form shown in FIG. 18, and can be freely designed according to the specifications of the device or the preferences of the user.

[0122] Furthermore, on the main screen G1, together with the reference image, a marker f is displayed for each of the multiple setting areas Ar set in the setting process. The number of markers f displayed on the main screen G1 in the display process (display number) is variable, and the maximum number of markers f that can be displayed (upper display limit number) can be displayed simultaneously. Furthermore, in order to make the sign f easily visible to the user, it is more preferable to highlight the image within the sign f in the reference image. For example, as shown in Fig. 18, the brightness of the image other than the image within the sign f (i.e., within the boundary of the set area Ar) in the reference image may be reduced or grayed out.

[0123] In the display step, the marker f indicating the position of the recording area Ap and the marker f indicating the position of the other setting area Ar (hereinafter also referred to as a waiting area) are displayed in different modes. At this time, it is preferable that the marker f indicating the position of the recording area Ap is highlighted, for example, by making the border color a relatively conspicuous color such as red or fluorescent color, making the border thicker, or flashing. Also, the image in the recording area Ap (i.e., the recorded image) itself may be highlighted.

[0124] Furthermore, when a moving subject is present in the reference image, the moving area Am set for the subject moves to follow the subject. In the display process, the marker f indicating the position of the moving area Am is displayed in a manner different from the marker f indicating the position of the set area Ar other than the moving area Am, as shown in Fig. 9. This makes it easy to distinguish between the moving area Am and the other set areas Ar, and to easily find the position of the moving area Am in the reference image.

[0125] When the subject in the moving area Am moves in the depth direction (i.e., toward or away from the image capture device 10), the size of the subject in the reference image changes. Accordingly, the ratio of the size of the subject to the size of the moving area Am (hereinafter referred to as the subject ratio) changes. In this case, the control unit 46 uses an electronic zoom function to change the size of the moving area Am according to the change in the subject ratio, and adjusts it so that the subject ratio remains constant.

[0126] In addition, as the subject moves, the moving area Am may move to the vicinity of the edge of the reference area (i.e., the outer edge of the angle of view) or may go beyond the reference area. In such a case, it is preferable that the control unit 46 notifies the user of the above situation by displaying a warning message on the information display screen G3 or outputting a warning sound.

[0127] Furthermore, when the reference image (i.e., the extracted image extracted from the image of the full angle of view) changes due to electronic image stabilization, the relative position of each set area Ar with respect to the reference area changes (see FIG. 4). In this case, the control unit 46 calculates the amount of deviation of the reference image due to electronic image stabilization, and adjusts the position of each set area Ar based on the calculated amount of deviation. This allows the position of each set area Ar with respect to the reference area to be maintained before and after the implementation of electronic image stabilization. It is preferable that the function of adjusting the position of the setting area Ar in association with electronic image stabilization be freely switched on and off in response to a user operation.

[0128] Furthermore, in the display process, as shown in FIG. 18, the identification information of each marker f is displayed for each marker f. The identification information of each marker f is fixed during the display process, and is maintained unchanged before and after the display process even if the number of displayed markers f changes during the display process. For example, in FIG. 18, when the display of marker f with the identification number "3" is stopped, the identification numbers of the other markers f (i.e., "1", "2", "4") do not change. By fixing the identification number of each marker f during the display process in this way, it is possible to easily grasp where each setting area Ar is located, even if the number of displayed markers f changes, for example.

[0129] A plurality of setting images including a recording image and a standby image are displayed on the plurality of sub-screens G2. More specifically, a corresponding setting image is displayed on each of the plurality of sub-screens G2. Here, if the aspect ratio of each sub-screen G2 is the same as the aspect ratio of the corresponding setting image, the setting image can be displayed so as to fit well on the screen.

[0130] In addition, it is preferable that the recorded video among the multiple setting videos displayed is highlighted. For example, it is preferable that the color of the screen frame, the thickness or type of the frame line, or the presence or absence of lighting is different between the sub-screen G2 on which the recorded video is displayed and the sub-screen G2 on which the other setting videos are displayed. This allows a user viewing multiple setting videos on the display to easily distinguish which video is the recorded video.

[0131] Also, as shown in FIG. 18, on the sub-screen G2 (the second sub-screen from the top in FIG. 18) that displays the image of the moving area Am, it is preferable to display information indicating that the image is of the moving area Am (for example, text information such as "moving").

[0132] In this embodiment, a plurality of implementation modes of the display step are prepared, and the image display method in the display step changes for each mode. That is, the display step is carried out according to the mode designated by the user. For example, when the user specifies the first mode, a first display step is performed as the display step. In the first display step, as shown in Fig. 18, the reference video and the marker f for each set area Ar are displayed on the main screen G1, and the recorded video and the standby video are displayed on the sub-screen G2. On the other hand, when the user specifies the second mode, a second display step is performed as the display step. In the second display step, as shown in Fig. 19, the recorded video and the standby video are displayed, and the reference video and the marker f for each set area Ar are not displayed.

[0133] In the first display step, the recorded image, the standby image, the reference image, and the marker f for each setting area Ar do not necessarily have to be displayed on the same display (for example, the rear display 28). That is, as shown in Fig. 20, the image displayed on the main screen G1 and the image displayed on the sub-screen G2 may be displayed on different displays. As a specific example, the image displayed on the main screen G1 may be displayed on the rear display 28, and the image displayed on the sub-screen G2 may be displayed on the electronic viewfinder 29 or an external monitor (not shown) connected to the image capturing device 10.

[0134] Thus, in this embodiment, the display process includes a first display process and a second display process, and one of these two display processes designated by the user is executed. This allows the display image to be switched according to the user's needs. For example, if the user wishes to check the reference image and the sign f, the first display process may be executed to display the reference image and the sign f. On the other hand, if the user wishes to check only the recorded image and the standby image (i.e., the setting image), the second display process may be executed to display only the recorded image and the standby image.

[0135] In addition, it is preferable that the implementation mode of the display process, i.e., which of the first and second display processes is to be implemented, can be freely switched in response to a switching operation by the user during the implementation of the display process. For example, it is preferable that the user can switch which display process is to be adopted through the touch panel 36 or the operation button 30 shown in FIG.

[0136] In the second display step, the recorded video and other setting videos may be displayed on the same display. For example, as shown in Fig. 19, the recorded video may be displayed on a main screen G1 of the display screen, and the standby video may be displayed on a sub-screen G2. Alternatively, in the second display step, the recorded image and the other setting image may be displayed on different displays. For example, as shown in Fig. 20, the recorded image may be displayed on a rear display 28, and the other setting image may be displayed on an electronic viewfinder 29 or an external monitor (not shown) connected to the image capturing device 10.

[0137] On the information display screen G3, for example, suggested information described below is displayed. The information display screen G3 can also display advice for the user on photography, warning messages, etc. For example, if adjustments to the exposure amount or ISO sensitivity, etc., are required during the recording process, a message to that effect may be displayed. Furthermore, the information display screen G3 can display information other than the above, such as the currently used shooting mode, current values ​​of shooting conditions such as resolution and ISO sensitivity, and on / off of various functions such as electronic zoom.

[0138] (Regarding display of video settings based on priority) In the display process, the number of sub-screens G2 is determined according to at least one of the resolution and aspect ratio of the recorded video (hereinafter, simply referred to as "at least one item"). In other words, the number of setting videos displayed on the sub-screens G2 is determined according to at least one of the items. Similarly, the size of each sub-screen G2 is also determined according to at least one of the items. That is, the display size of the setting video is determined according to at least one of the items.

[0139] Here, at least one of the items is adjusted according to the recording format (movie format) of the recorded video. Therefore, the number of display (strictly speaking, the maximum number of display) and the display size of the setting video in the display process are the number and size according to the recording format of the recorded video.

[0140] In this embodiment, the number of setting images to be displayed and the display size are determined according to at least one of the items, so that each of the setting images including the recorded image can be displayed well. For example, each setting image can be displayed at an appropriate resolution so as to fit well on the sub-screen G2.

[0141] In this embodiment, the aspect ratio of the recorded image is determined according to the recording format of the recorded image, but the aspect ratio of the recorded image may be set arbitrarily regardless of the recording format. In this case, the number and size of the sub-screens G2 are changed according to the aspect ratio after the adjustment, along with the adjustment of the aspect ratio of the recorded image.

[0142] In the present embodiment, both the number and size of the setting images displayed in the display step (i.e., the number and size of the sub-screens G2) are determined according to at least one of the items. However, this is not limited to this, and either the number or the size of the setting images may be determined according to at least one of the items.

[0143] The number of setting images to be displayed in the display step does not have to be determined in accordance with at least one of the items. For example, the number of setting images to be displayed may be set or changed by the user.

[0144] In this embodiment, the number of setting images to be displayed in the display step is determined according to the resolution and aspect ratio of the recorded image, as described above. Here, in the case of the first display step, one of the setting images to be displayed is a recorded image, and the rest are standby images. Therefore, the setting value for the number of standby images to be displayed, i.e., the maximum number to be displayed, is determined according to the resolution and aspect ratio of the recorded image, and is specifically one less than the number of sub-screens G2. In the case shown in FIG. 21, the maximum number of standby videos that can be displayed is three.

[0145] On the other hand, the number of set areas Ar in the reference area changes according to the subjects in the reference image, and accordingly, the number of set areas Ar other than the recording area Ap, that is, the number of waiting areas changes. In the case shown in FIG. 21, the number of waiting areas is six.

[0146] When the number of the multiple waiting areas reaches (or, strictly speaking, exceeds) the maximum display number of waiting videos, the control unit 46 performs a display step according to the flow shown in Fig. 22. To explain the flow of the display step shown in Fig. 22, the control unit 46 performs a determination step when the number of the multiple waiting areas reaches the maximum display number of waiting videos (S021).

[0147] In the determination step, the control unit 46 determines a priority for each of the multiple standby areas. To explain the procedure, the control unit 46 first detects a subject in each of the multiple standby images (S101). Next, the control unit 46 acquires information about the subject in the detected standby image (S102). At this time, the control unit 46 may acquire performance information as a recording area, which will be described later, instead of information about the subject in the standby image.

[0148] The information about the subject includes, for example, the time or number of times the subject appears in the reference image during the shooting period, and the size (display size) of the subject in the reference image. These pieces of information can be obtained by the control unit 46 analyzing and measuring or counting the reference image during the shooting period. Furthermore, if the subject is a person, the face of the person may be recognized by a technique such as pattern matching, the importance of the person whose face has been recognized may be identified, and the identification result may be used as information about the subject. The importance of the person may be determined, for example, by determining the attributes of the person whose face has been recognized (e.g., family, relatives, acquaintances, or strangers), and the like, and obtained from the determination result. Furthermore, if there are multiple detected subjects, the priority may be determined according to the category of the subject (e.g., person, animal, object, or landscape, etc.). Furthermore, the priority may be determined by giving priority to subjects that are detected earlier. Of course, other information about the subject may be considered in addition to the above. It is desirable for the user to be able to freely select what information to use as information about the subject in the determination step.

[0149] Thereafter, in a determination step, the control unit 46 determines the priority of each of the multiple waiting areas according to the information on the detected subject (S103).

[0150] After the determination step is performed, the control unit 46 selects N waiting areas from among the multiple waiting areas based on the priority (S022). Here, the number N of waiting areas to be selected is the maximum number of waiting videos to be displayed, and is a number determined according to the number of sub-screens G2 (for example, a number that is one less than the number of sub-screens G2). In step S022, the control unit 46 selects N waiting areas in descending order of priority.

[0151] Then, the control unit 46 displays the images (standby images) of the selected N standby areas on the sub-screen G2 (S023). Here, when the sub-screens G2 are arranged vertically on the display screen as shown in Fig. 21, it is preferable to display the standby images of standby areas with higher priorities on the upper sub-screens G2.

[0152] As described above, in this embodiment, when the number of standby areas reaches (exceeds) the maximum number of standby videos to be displayed, N standby videos selected according to priority are displayed. This makes it possible to appropriately display standby videos with high priority while complying with the constraints on screen display.

[0153] The method of determining the priority is not limited to the method of determining the priority based on information about the subject in the waiting video. For example, the priority may be determined according to the performance information as a recording area. To explain in more detail, for each of the multiple waiting areas, the number of times it has been selected as a recording area from the start of shooting to the current time, the time it has been a recording area, or the elapsed time since it was last selected as a recording area, etc. are specified. This information corresponds to information about the performance of being selected as a recording area in the past. Then, the priority of each of the multiple waiting areas may be determined based on the information on the results. For example, if the information on the results is the number of times or the time that the area has been selected as a recording area, the higher the number of times or the time, the higher the priority may be assigned.

[0154] In addition, in the flow of the display process shown in Fig. 22, N waiting areas are selected based on the priority and only the images of the selected waiting areas are displayed, but this is not limited to this. For example, the top N waiting areas and lower waiting areas may be selected in order of priority. In this case, the waiting images of the top N waiting areas may be displayed first, and the waiting images of the lower waiting areas may be displayed by scrolling or switching the display screen as shown in Fig. 23.

[0155] Also, each of the multiple standby videos may be displayed in a size according to the priority. For example, as shown in Fig. 24, the standby video of the standby area with high priority may be displayed on a sub-screen G2 of normal size, and the standby video of the standby area with low priority may be displayed on a sub-screen G2x of reduced size. In this way, each of the multiple standby videos can be displayed, and the standby area with high priority can be displayed in a more easily viewable manner.

[0156] [About the control process] The control process in the video display flow will be described. The control process is a process for executing a control process for suppressing changes to the reference area, and is performed at least after the reference area is determined. In other words, the control process is a process for suppressing changes to the reference area after a user's instruction to start recording is accepted.

[0157] In the control process, the control unit 46 locks the zoom driver 21 to stop the movement of the zoom optical device 18. This limits the optical zoom function during the recording process, fixes the reference area, and maintains the angle of view at that time. By executing the above control process, it is possible to prevent the relative position of each set area Ar with respect to the reference area from changing during the recording process, thereby making it possible to avoid a situation in which each set area Ar deviates from the reference area and each set image such as a recording image is not captured appropriately.

[0158] The control process performed to suppress the change of the reference area is not limited to the above process, and may be, for example, a process for notifying suggested information regarding the change of the reference area. As a specific example, a message prohibiting optical zoom may be displayed on the information display screen G3, or may be played by audio or the like. In addition, as shown in Fig. 18, a message prohibiting the operation of moving the image capture device 10 (for example, panning operation), or a message recommending fixing the image capture device 10 using a platform such as a tripod may be displayed.

[0159] The control step may be performed before the reference area is determined (i.e., before the recording start instruction is received), or may be performed during the setting step, in which case it is possible to prevent the reference area from changing while multiple setting areas Ar are set in the reference area.

[0160] [About the change process] When a predetermined condition is satisfied during the recording step, the control unit 46 executes a change step. The change step is a step of executing a change process related to a change in the number of images (i.e., setting images) displayed in the setting area Ar. By executing the change process, the number of setting images displayed can be dynamically increased or decreased during the recording step. Hereinafter, the flow of processing during the recording step will be described with reference to the flow shown in Fig. 25. Incidentally, in Figs. 26 to 31 referred to in the following description, the grayed-out display of images other than the image within the sign f is omitted for convenience of illustration.

[0161] During the recording step, the control unit 46 monitors the reference video and determines whether the number of subjects in the reference video has increased (S031). If the number of subjects in the reference video has increased, the control unit 46 executes the change step (S032). In the change step, a change process is executed to increase the number of displayed setting videos.

[0162] In the change process in step S032, a setting area Ar is added in response to an increase in the number of subjects in the reference video, and the setting video of the added setting area Ar is newly displayed on the display. As a result, the number of setting videos displayed increases. For example, as shown in Figs. 26 and 27, if the number of subjects in the reference video increases from three to four, the number of setting videos displayed (i.e., the number of videos displayed on the sub-screen G2) increases from three to four.

[0163] In addition, if a setting area Ar is added in accordance with an increase in the number of subjects in the reference image, the number of markers f in the reference image displayed on the main screen G1 increases accordingly by the amount of the added setting area Ar (see Figure 27).

[0164] In the above embodiment, the setting area Ar is set at the position of a new subject in the reference image, but the present invention is not limited to this. For example, a candidate Ac for the setting area may be set instead of the setting area Ar. In this case, a sign indicating the position of the candidate Ac (more specifically, the above-mentioned candidate sign K) is displayed in the reference image. Then, when the user performs an operation such as tapping on the candidate sign K, this triggers the addition of the setting area Ar to the position of the candidate Ac. As a result, a setting image of the added setting area Ar is newly displayed, and the number of displayed setting images increases.

[0165] Also, instead of setting the setting area Ar or its candidate Ac at the position of the new subject in the reference video, suggested information regarding the addition of the setting area Ar (i.e., changing the number of setting videos to be displayed) may be output. For example, a message proposing to increase the number of setting videos to be displayed by adding the setting area Ar to the position of the new subject may be displayed on the information display screen G3 or played by audio or the like. In this way, a process of outputting suggested information regarding a change in the number of setting videos to be displayed may be executed as a change process.

[0166] In the flow shown in Fig. 25, the control unit 46 monitors the reference video during the recording process and determines whether the moving area Am in the reference area overlaps with another set area Ar (S033). Then, when the moving area Am overlaps with another set area Ar as shown in Fig. 28, or is about to overlap, the control unit 46 outputs a warning message or warning sound (S034). This is because, in a situation where the moving area Am overlaps with another set area Ar, a subject in one area may be behind a subject in the other area and not be captured.

[0167] By outputting a warning message or the like, the user can be notified of a situation in which the moving area Am overlaps or is about to overlap with another set area Ar. The user who receives the warning can take appropriate measures (e.g., resetting the set area Ar, etc.). As one measure, when the user makes a change request through a screen operation or the like (S035), the control unit 46 carries out a change step (S036). In this change step, a change process is executed to reduce the number of displaying set images.

[0168] In the change process in step S036, the overlapping moving area Am and other set areas Ar are updated to one set area Ar, and the set image of the updated set area Ar is displayed on the display. For example, the image of the moving area Am and the image of the other set area Ar displayed separately as in Fig. 28 are integrated into one image including the subjects of each of these two images as in Fig. 29. As a result, the number of set areas Ar is reduced by one, and the number of displayed set images is also reduced by one.

[0169] It is preferable that the size and position of the updated set area Ar are set so that the subjects of the two images are contained therein. The identification information of the marker f indicating the updated set area Ar may take over the identification information of the marker f indicating either one of the two areas before the update (i.e., the moving area Am and the other set area Ar). Alternatively, a new identification number may be assigned to the updated set area Ar.

[0170] 25, the control unit 46 periodically determines whether each of the multiple setting areas Ar satisfies a stop condition during the recording process (S037). The stop condition is a criterion for determining whether to stop displaying the image (setting image) of the setting area Ar, and may be, for example, the following conditions (1) to (3). Cancellation condition (1): At least a part of the set area Ar is outside the reference area due to optical zoom or the like. Cancellation condition (2): There is no change in the setting image in the setting area Ar for a certain period of time or more, or there is no subject in the setting image. Cancellation condition (3): The set area Ar has not been selected as a recording area for a certain period of time or longer. The stop conditions are not limited to the above conditions (1) to (3), and may include conditions other than the above.

[0171] Then, if there is a setting area Ar that satisfies any of the above-mentioned cancellation conditions (1) to (3), the control unit 46 executes a change step (S038). In this change step, a change process is executed to reduce the number of displaying setting videos.

[0172] In the change process in step S038, the display of the setting video of the setting area Ar that satisfies the cancellation condition is cancelled. For example, in FIG. 26, when the setting area Ar in which the identification information of the marker f is "2" satisfies the cancellation condition, the display of the setting video of that setting area Ar is cancelled (disappears from the sub-screen G2) as shown in FIG. 30. As a result, the number of displayed setting videos is reduced by one. It should be noted that, with respect to the setting area Ar where the display of the setting video has been stopped (hereinafter referred to as the stopped area), as shown in FIG. 30, the display of the indicator f indicating the position of the stopped area is also stopped on the main screen G1.

[0173] Incidentally, instead of immediately ceasing the display of the setting video in the setting area Ar that satisfies the cancellation condition, suggestion information regarding ceasing the display of the setting video (in other words, changing the number of displaying setting videos) may be output. For example, a message recommending ceasing the display of the setting video in the setting area Ar that satisfies the cancellation condition may be displayed on the information display screen G3 or may be played by audio or the like. During that time, a different video (a video different from the setting video) may be displayed on the sub-screen G2 instead of the setting video in the setting area Ar that satisfies the cancellation condition.

[0174] When the display of the setting image of the stopped image is stopped, the stopped area is stored in the internal memory 50 or the like in the image capture device 10 while the recording process is being performed. The stopped area may be stored until the end of image capture, or until the power of the image capture device 10 is turned off.

[0175] Furthermore, when the display of the setting image of the interruption area is interrupted, an operation icon such as a back button Bt9 is displayed on the main screen G1 as shown in Fig. 30. The user can issue an instruction to redisplay the setting image of the interruption area by, for example, tapping the back button Bt9. When the user issues an instruction to redisplay (S039), the control unit 46 executes a change process (S040). In this change process, a change process is executed to redisplay the setting image of the interruption area that is stored based on the user's instruction to redisplay.

[0176] By the change process in step S040, the video of the suspension area is displayed again on the sub-screen G2, and the number of displayed setting videos returns to the number before the display of the setting video in the suspension area was stopped. The setting image of the interrupted area that can be redisplayed is not limited to the image of the immediately previous interrupted area (the setting area where the display of the setting image was most recently interrupted). For example, the images of the interrupted areas from the past few times during the current shooting period may be redisplayed. In this case, the shooting device 10 stores the interrupted areas from the past few times, and the user designates which setting image of the interrupted area is to be redisplayed and instructs the redisplay of the image.

[0177] In the flow shown in Fig. 25, the control unit 46 monitors the reference video during the recording step, and judges whether the number of subjects in the reference area exceeds the upper limit of the number of set areas Ar (S041). If the number of subjects exceeds the upper limit of the number of set areas Ar, the control unit 46 executes the change step (S042). In this change step, a change process for reducing the number of displayed set videos is executed. In the change process in step S042, a message is displayed on the information display screen G3 or played by audio or the like, notifying the user that the number of subjects has exceeded the upper limit of the number of set areas Ar and recommending that the number of set videos be reduced. The user uses this as an opportunity to review the settings of the set areas Ar and delete unnecessary set areas Ar, such as the set areas Ar that have not been selected as recording areas for the longest period of time. As a result, the number of set videos to be displayed is reduced by the number of set areas Ar deleted by the user.

[0178] The series of steps S031 to S042 described above are repeatedly performed during the recording process, and end when the recording process ends (S043). As described above, in this embodiment, the change process is performed in response to a change in the reference image (e.g., the addition of a subject) or the establishment of a cancellation condition, and the number of displayed setting images is appropriately changed. This allows the user to easily check the number of setting images according to the current situation, and to omit checking images such as the setting area Ar that are unlikely to become a recording area. As a result, convenience for the user is improved.

[0179] <<Other embodiments>> The embodiment described above is a specific example given to easily explain the display method of the present invention, and is merely one example, and other embodiments are also possible. In the above-described embodiment, the photographing device 10 displays various images as a display device, but the present invention is not limited to this. For example, the display device may be configured by the photographing device 10, a camera controller connected to the photographing device 10 by wire or wirelessly, and an external display of an external type. In this case, the camera controller functions as the control unit 46, causes the photographing device 10 to photograph a reference image and displays various images on the external display. The camera controller may also set the setting area Ar, select and reselect (switch) the recording area, and record the recorded image.

[0180] In the above embodiment, a control process for suppressing a change in the reference area is executed in the control step in the video display flow. However, the present invention is not limited to this, and a process for encouraging a change in the reference area may be executed as a control process related to the change in the reference area. In this case, the reference area can be adjusted according to a change in the reference image (for example, a movement of a subject in the reference image, etc.).

[0181] To explain in more detail, for example, suppose that the recorded image is zoomed up by electronic zoom in the recording process. In that case, if the zoom magnification exceeds a predetermined value, the resolution of the recorded image may become equal to or lower than a certain value, making it difficult to obtain the desired image quality. In that case, as shown in FIG. 31, information that prompts the user to change the reference area may be displayed on the information display screen G3 by performing optical zoom instead of electronic zoom. Alternatively, the control unit 46 may operate the zoom drive unit to forcibly perform optical zoom to automatically change the reference area so that the resolution becomes equal to or higher than a predetermined value. When the reference area changes due to optical zoom, the relative position of each set area Ar with respect to the reference area changes. In this case, it is preferable that the control unit 46 calculates the amount of change in the reference area and adjusts the position and size of each set area Ar based on the calculated amount of change. This allows the relative position of each set area Ar with respect to the reference area to be maintained before and after zooming.

[0182] During the recording process, the moving area Am may follow the movement of the subject and reach the edge of the reference area, or at least a part of the moving area may extend beyond the reference area. In such a case, information may be displayed on the information display screen G3 to prompt the user to move the image capturing device 10 (i.e., change the reference image) so that the moving area Am after the movement fits within the reference area. Here, if the user changes the reference area by moving the photographing device 10 during the recording process, a known detection sensor such as a gyro sensor provided in the photographing device 10 may detect the movement (e.g., the amount of displacement) of the photographing device 10. Then, it is preferable that the control unit 46 adjusts the position and size of each set area Ar based on the detected movement of the photographing device 10. This allows the relative position of each set area Ar with respect to the reference area to be adjusted according to the changed reference area. At this time, a set area Ar that has moved outside the reference area due to the change of the reference area may be automatically deleted.

[0183] In the above embodiment, the recorded video is a video, that is, a collection of a plurality of frame images captured continuously at a constant frame rate. However, the recorded video is not limited to a video, and may be a still image. For example, the control unit 46 displays a reference video as a live view image on the main screen G1, and sets multiple setting areas Ar within the reference area. The user selects a recording area Ap from the multiple setting areas Ar, and the control unit 46 displays the multiple setting images including the recording video on the sub-screen G2. Then, when the user issues a recording instruction by operating the release button 26, the control unit 46 may record the recording video as a still image on the recording medium.

[0184] In the above embodiment, when a subject is detected in the reference video, the setting area Ar is automatically set at the position of the detected subject. However, the present invention is not limited to the case where the setting area Ar is immediately set at the position of the detected subject, and a candidate Ac for the setting area may be set at the position of the detected subject first. In this case, a candidate marker K is displayed at the position of the candidate Ac, and when the user performs a predetermined operation on the candidate marker K, the setting area Ar is set at the position of the candidate Ac.

[0185] In the above embodiment, the display of the setting image of the setting area Ar that satisfies the stop condition is stopped, but the setting image is stored in the photographing device 10 during the recording process. However, this is not limited to the above, and the setting area Ar that satisfies the stop condition may be deleted and the image of that area may not be stored. In this case, it is preferable to display suggested information regarding the deletion of the setting area Ar on the information display screen G3 at a stage before deleting the setting area Ar that satisfies the stop condition. Then, it is preferable to separately display a screen (not shown) for selecting whether or not to delete the setting area Ar, and delete the setting area Ar that satisfies the stop condition after confirming the user's intention regarding whether or not to delete it.

[0186] In the above-described embodiment, the photographing device is a digital camera, but it may be a video camera, a mobile phone with an imaging optical system, a smartphone, a mobile terminal such as a tablet terminal, etc. The imaging lens may be a lens unit that is externally attached to the imaging optical system of the mobile terminal. [Explanation of symbols]

[0187] 10. Imaging Device 12. Imaging device body 13. Mount 14. Shooting Lenses 17 Optical unit 18,19 Optical equipment 20 apertures 21 Zoom drive unit 22 Focus drive unit 23 Aperture drive unit 26 Release button 28 Display 29 Electronic Viewfinder 30 Operation Buttons 36 Touch Panel 38 Shutter 40 Image sensor 42 pixels 44 Analog signal processing circuit 46 Control Unit 47 Controller 48 Video Processing Section 50 Internal Memory 52 Card Slots 54 Memory Card 56 Buffer Memory 61 Camera Controller 62 External Display 101 First UI screen 102 Second UI Screen 103 Third UI Screen 104 4th UI screen 105 Input Screen AC candidate Am moving area Ap Recording Area Ar setting area As, At Shooting area Bt1~Bt8 buttons Bt9 Return button f,fx sign G1 Main Screen G2, G2x sub screen G3 information display screen K candidate indicator L1 optical axis T Table Data

Claims

1. A display method for displaying an image captured by a photographing device equipped with an optical device for zooming, comprising: A setting step of setting a plurality of setting regions within a reference region which is a shooting region of a reference video; a selection step of selecting a recording area, which is an area of ​​a recording image to be recorded, from the plurality of set areas; a switching step of reselecting the recording area from among the plurality of set areas and switching the recording area after the selection step is performed; a recording step of recording the recorded video onto a recording medium; a display step of displaying a plurality of setting images which are images of the plurality of setting areas; and a control step of executing a control process for changing the reference area after at least the reference area is determined, The display method, wherein the control process includes a process of stopping movement of the optical device and maintaining a state in which an optical zoom function of the photographing device is limited while the recording step is being performed.

2. When a user's instruction to start recording is received, the reference area is determined; 2. The display method according to claim 1, wherein the control process is a process related to a change of the reference area after the recording start instruction is received.

Images