Electronic apparatus, electronic apparatus control method, program, and storage medium

Abstract

To make it easy to grasp a region for which an imaging result is checked in advance.SOLUTION: An electronic apparatus comprises: acquisition means for acquiring a pickup image; and display control means which performs control to geometrically convert a partial region of the pickup image as a display range and display a geometrically converted display image, and is capable of changing the display range. The display control means performs control to further display an item which makes it possible to identify the displayed region in the pickup image.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium. [Background technology]

[0002] In recent years, content (VR content) using a technology called VR (Virtual Reality) has become widespread. Technologies for capturing photos and videos to be used in VR content are disclosed in Patent Documents 1 and 2. Patent Document 1 discloses a technology that can capture a 360-degree image at once. Patent Document 2 discloses a technology that can simultaneously capture two images that can be viewed stereoscopically (two images with parallax between them). VR content is mainly viewed using a display device such as a non-transparent HMD (Head Mounted Display). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-211641 A [Patent Document 2] JP 2022-183656 A Summary of the Invention [Problem to be solved by the invention]

[0004] The images used in VR content are wide-range images, such as circular fisheye images. When such VR content is displayed on an HMD, the display device cuts out a part of the image as the viewer's field of view, and displays it after going through a transformation such as perspective projection transformation. In general, the viewer can change the range of the field of view as desired.

[0005] Therefore, when capturing an image to be used in VR content, it is necessary to check in advance the entire range of the viewer's field of view to see whether the appearance of the exposure, focus, etc. is as the user intended. When checking by reproducing the same field of view as the viewer, the display device only displays a part of the whole at a time, so there is a possibility that something will be missed.

[0006] An object of the present invention is to make it possible to easily grasp an area where a pre-check of an imaging result has been performed. [Means for solving the problem]

[0007] The electronic device of the present invention has an acquisition means for acquiring an captured image, and a display control means for performing a geometric transformation on a partial area of ​​the captured image as a display range, controlling the display range to display the geometrically transformed display image, and is characterized in that the display control means controls the displayed area of ​​the captured image to further display identifiable items. Effect of the Invention

[0008] According to the present invention, it is possible to easily grasp the area where the imaging result has been checked in advance. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an imaging device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing a captured image according to the first embodiment. [Diagram 3] 5A and 5B are diagrams showing an assist image and a composite image according to the first embodiment. [Figure 4] FIG. 1 is a diagram for explaining conversion from a circular fisheye image to a hemispherical image. [Diagram 5] FIG. 1 is a diagram for explaining perspective projection transformation. [Figure 6] 4 is a flowchart of a VR display process etc. according to the first embodiment. [Figure 7] FIG. 13 is a diagram showing a modified example of a captured image. [Figure 8] FIG. 13 is a diagram showing a modified example of a composite image. [Figure 9] FIG. 11 is a block diagram showing an imaging device according to a second embodiment. [Figure 10] 10 is a flowchart showing an LV display process according to the second embodiment. [Figure 11] FIG. 11 is a block diagram showing an imaging device according to a third embodiment. [Figure 12] 13 is a flowchart showing an initialization process according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings, but the present invention is not limited to the embodiment described below.

[0011] (Embodiment 1) A description will be given of embodiment 1 of the present invention. Fig. 1 is a block diagram showing an imaging device as an example of an electronic device according to embodiment 1. The imaging device in Fig. 1 has a lens unit 101, an imaging element unit 102, an imaging processing unit 103, a recording unit 104, an image processing unit 105, an assist image generating unit 106, an image synthesis unit 107, an operation unit 108, a display control unit 109, a display unit 110, and a lens information communication unit 111.

[0012] The lens unit 101 has an optical system that forms a subject image (an optical image representing a subject) on the imaging surface of the image sensor unit 102, and has a zoom function, a focus adjustment function, and an aperture adjustment function. The lens unit 101 may or may not be detachable from the imaging device.

[0013] The imaging element unit 102 has an imaging element in which a large number of photoelectric conversion elements are arranged, and converts the subject image formed by the lens unit 101 into an image signal. The imaging element is, for example, a complementary metal oxide semiconductor (CMOS) image sensor or a charged coupled device (CCD) image sensor. The imaging element unit 102 has an A / D converter, and converts the image signal (analog signal) obtained by the imaging element into image data, which is digital data. Then, the imaging element unit 102 outputs the obtained image data (captured image data).

[0014] The image capturing processing unit 103 performs image processing on the captured image data from the image sensor unit 102, such as correcting scratches caused by the image sensor unit 102, and also performs image processing for recording and display.

[0015] The recording unit 104 records the image data processed by the imaging processing unit 103 in a storage medium (not shown). The storage medium is, for example, a recording medium such as an SD card. The storage medium may be built into the imaging device, or may be detachable from the imaging device.

[0016] The image processing unit 105 performs image processing (geometric transformation) to reduce distortion of the image data processed by the image capture processing unit 103. For example, when a fisheye lens is used in the lens unit 101, perspective projection transformation is performed on a part of the captured circular fisheye image as image processing. As a result, an image for display is generated.

[0017] The perspective projection transformation according to the first embodiment will be described with reference to Figs. 2(A), 2(B), 4(A), and 4(B). Fig. 2(A) is a diagram showing a circular fisheye image captured by the imaging device according to the first embodiment. As shown in Fig. 2(A), the circular fisheye image processed by the imaging processing unit 103 is a distorted circular image. In order to reduce this distortion, perspective projection transformation is performed.

[0018] During the perspective projection transformation, the image processing unit 105 transforms the circular fisheye image acquired from the image capturing processing unit 103 into a hemispherical image. For example, a three-dimensional computer graphics library such as Open GL ES (Open Graphics Library for Embedded Systems) may be used for such processing. Specifically, each pixel of the acquired circular fisheye image is associated with the coordinate system of FIG. 4(A) that is configured by a vertical angle θ with the zenith direction of the captured image as an axis, and a horizontal angle φ around the axis of the zenith direction. At this time, it is assumed that the circular fisheye image is an image having a range of 180° in the vertical direction (up and down direction) and 180° in the horizontal direction (left and right direction), and that the range of the vertical angle θ and the horizontal angle φ are each between -90° and 90°.

[0019] The correspondence between each pixel of the circular fisheye image and the coordinates (θ, φ) is determined by the combination and arrangement of the lens unit 101 and the image sensor unit 102. This allows the image processing unit 105 to associate each pixel of the circular fisheye image with each point on the spherical surface shown in Fig. 4(B). If the center of the sphere shown in Fig. 4(B) is the origin O, the three-dimensional coordinates on the spherical surface are (X, Y, Z), and the radius of the sphere is r, the correspondence between the coordinates (θ, φ) associated with each pixel of the circular fisheye image and the coordinates (X, Y, Z) on the spherical surface can be expressed by the following formulas 1 to 3. X=rcos(θ)sin(φ) (Formula 1) Y = rsin(θ) (equation 2) Z=rcos(θ)cos(φ) (Formula 3)

[0020] By converting the coordinates of each pixel in the circular fisheye image into coordinates on a sphere based on the correspondence relationships shown in Equations 1 to 3, a hemispherical image (hemispherical image data) can be generated.

[0021] When generating a spherical image, circular fisheye images 180° in front of and 180° behind the photographer are acquired, and then semi-spherical images of each are generated using the method described above. A 360° spherical image can be generated by stitching these together.

[0022] As described above, since the omnidirectional image and the hemispherical image are spherically distorted images, they need to be further transformed when viewed by a user on an HMD or the like. By performing perspective projection transformation on a partial region of the image, an image with reduced distortion can be displayed. For example, by performing perspective projection transformation on a partial region 201 (region surrounded by a dashed line) of the omnidirectional image 200 shown in FIG. 2(A), an image 202 (image with reduced distortion) shown in FIG. 2(B) can be displayed.

[0023] FIG. 5 is a diagram showing the relationship between an area for which perspective projection conversion of a hemispherical image is performed and a virtual camera in a three-dimensional virtual space assumed in the perspective projection conversion. In the perspective projection conversion of a hemispherical image, a virtual camera 501 corresponding to the position of a user viewing the hemispherical image is assumed. In the hemispherical image, an area of ​​width w×height h in the optical axis direction (θ, φ) of the virtual camera is determined as an area 502 for which perspective projection conversion is performed. In the first embodiment, the width w of the area 502 corresponds to the horizontal resolution of the display unit 110, and the height h of the area 502 corresponds to the vertical resolution of the display unit 110. Hereinafter, extracting and displaying a part of an image is referred to as VR display. Shooting for VR display is referred to as VR shooting.

[0024] The assist image generating unit 106 stores displayed area information indicating an area in the circular fisheye image that has been VR-displayed. Furthermore, the assist image generating unit 106 generates an assist image (circular fisheye icon) that is an item that imitates the circular fisheye image. Then, the assist image generating unit 106 fills in an area in the generated assist image that corresponds to the area that has been VR-displayed (corresponding to area 201 in FIG. 2(A)), as in assist image 300 in FIG. 3(A). This allows the user to easily grasp the area that has been confirmed in the VR display. Note that a reduced image of the circular fisheye image may be used as the assist image that imitates the circular fisheye image.

[0025] The image synthesis unit 107 superimposes (composites) a plurality of images and outputs the superimposed image. In the first embodiment, the image synthesis unit 107 superimposes the assist image generated by the assist image generation unit 106 on the image output by the image processing unit 105, and outputs a composite image as shown in FIG. 3(B).

[0026] The operation unit 108 is composed of operation members such as a cross key, a touch panel, and a shutter button. Through the operation unit 108, the user can input various parameters (imaging parameters) of the imaging device, select a display method for the circular fisheye image, and select ON / OFF of a function for checking an area that has already been VR displayed (displayed area checking function). Examples of the imaging parameters include ISO sensitivity and shutter speed. In the first embodiment, the display method can be selected from a circular fisheye display that displays a circular fisheye image as is, and a VR display that displays an image obtained by performing perspective projection conversion on the circular fisheye image.

[0027] The display control unit 109 controls the image processing unit 105, the assist image generating unit 106, and the image combining unit 107 so that an image is displayed on the display unit 110 according to a display method specified (set) using the operation unit .

[0028] The display unit 110 has a display panel (for example, an organic EL panel or a liquid crystal panel) and is controlled by the display control unit 109. For example, the display unit 110 is used as an EVF that displays a live view (LV) image. Note that the display unit 110 may be an external device connected to the imaging device by wire or wirelessly.

[0029] The lens information communication unit 111 acquires lens information of the lens unit 101 and transmits the lens information to the display control unit 109 .

[0030] FIG. 6A is a flowchart showing an example of LV display processing of the imaging apparatus according to the first embodiment.

[0031] In S601, the display control unit 109 acquires lens information from the lens unit 101 attached to the imaging device via the lens information communication unit 111. Then, the display control unit 109 determines whether or not the lens unit 101 is a lens unit for VR imaging. If the lens unit 101 is a lens unit for VR imaging, the process proceeds to S602, and if not (if the lens unit 101 is a normal lens unit), the process proceeds to S607. The lens unit for VR imaging is a lens unit that enables imaging over a wide range, for example, a lens unit including a fisheye lens.

[0032] In S602, the display control unit 109 determines whether the displayed area confirmation function is ON (enabled). If the displayed area confirmation function is ON, the process proceeds to S603, and if not (if the displayed area confirmation function is OFF (disabled)), the process proceeds to S605.

[0033] In S603, the display control unit 109 performs assisted VR display processing. The details of the assisted VR display processing will be described later with reference to FIG.

[0034] In S604, the display control unit 109 determines whether or not the user has performed an operation to end the LV display process using the operation unit 108. The end operation is, for example, a user operation to instruct the execution of playback display of a captured image, a user operation to instruct the execution of menu display, etc. If the end operation has been performed, the LV display process is ended, and if not, the process proceeds to S601.

[0035] In S605, the display control unit 109 determines whether or not VR display is enabled. If VR display is enabled, the process proceeds to S606, and if not (if circular fisheye display is enabled), the process proceeds to S608.

[0036] In S606, the display control unit 109 performs unassisted VR display processing. Details of the unassisted VR display processing will be described later with reference to FIG.

[0037] In S607, the display control unit 109 displays on the display unit 110 the image captured using the normal lens unit as is.

[0038] In S608, the display control unit 109 displays, on the display unit 110, the circular fisheye image captured using the lens unit for VR shooting as is.

[0039] The process of S603 (assisted VR display process) will be described in detail with reference to FIG. 6(B).

[0040] In S611, the display control unit 109 controls the image processing unit 105 to perform perspective projection conversion on the range (display range) in which VR display is performed. As a result, a perspective projection image viewed by the user is generated. Note that the user can change the display range by using an operation member such as a cross key or a touch panel included in the operation unit 108. When a touch panel is used, the display range may be changed by a flick operation, or the display range may be changed to a range including a position corresponding to the tapped position by the user tapping a desired position in the assist image. In addition, when an external device such as an HMD is connected to the imaging device and used as the display unit 110, the display range may be changed by changing the attitude of the external device. The display range may be changed at any timing.

[0041] In S612, the display control unit 109 stores displayed area information indicating the range (the range currently displayed) for which perspective projection conversion was performed in S611 in the assist image generation unit 106. Note that if the assist image generation unit 106 has already stored displayed area information, the display control unit 109 adds information on the range currently displayed to the displayed area information stored in the assist image generation unit 106.

[0042] In S613, the display control unit 109 controls the assist image generating unit 106 to generate an assist image that reflects the displayed area information stored in the assist image generating unit 106. For example, the assist image 300 in Fig. 3(A) is generated. In addition, when the displayed area checking function is switched from OFF to ON, the assist image generating unit 106 may generate an assist image that indicates the area that was VR-displayed while the displayed area checking function was OFF.

[0043] In S614, the display control unit 109 controls the image synthesis unit 107 to synthesize (superimpose) the assist image generated in S613 on the perspective projection image generated in S611. As a result, for example, a synthetic image 301 in FIG. 3B is generated.

[0044] In S615, the display control unit 109 displays on the display unit 110 the composite image generated in S614.

[0045] The process of S606 (unassisted VR display process) will be described in detail with reference to FIG. 6(C).

[0046] 6C are similar to S611 and S612 in FIG 6B, and therefore description thereof will be omitted. In S623, the display control unit 109 displays the generated perspective projection image on the display unit 110 as is.

[0047] As described above, according to the first embodiment, the assist image in which the already-displayed area can be identified is The images are then synthesized and displayed in VR. This makes it easy to see the areas where the imaging results have been confirmed using the imaging parameters that have been set.

[0048] In addition, when performing VR shooting to obtain an image that allows stereoscopic viewing using the parallax of both eyes, as shown in FIG. 7, the imaging device captures an image including an area 701 of a circular fisheye image for the left eye and an area 702 of a circular fisheye image for the right eye. An example of a standard for such an image is VR180. In addition, when performing VR display, perspective projection conversion is performed on both the circular fisheye image for the right eye and the circular fisheye image for the left eye, and displayed area information is stored separately for each of the circular fisheye image for the right eye and the circular fisheye image for the left eye. Furthermore, an assist image in which an area corresponding to the displayed area information is filled is superimposed (combined) on the captured image to generate and display a composite image. For example, a composite image 801 shown in FIG. 8(A) is generated and displayed. In FIG. 8(A), VR display for the left eye and VR display for the right eye are performed simultaneously. In addition, in FIG. 8(A), OSD (On Screen Display) display is performed in which character information 802, 803 is superimposed on the composite image 801 and displayed. Text information 802 indicates that a circular fisheye image for the left eye is being displayed in VR, and text information 803 indicates that a circular fisheye image for the right eye is being displayed in VR.

[0049] In addition, when the imaging device cannot simultaneously perform both the VR display of the circular fisheye image for the left eye and the VR display of the circular fisheye image for the right eye, the VR display of one of the circular fisheye image for the left eye and the circular fisheye image for the right eye is performed. In this case, the user can switch the VR display to be performed between the VR display of the circular fisheye image for the right eye and the VR display of the circular fisheye image for the left eye. Also, as in the composite image 804 shown in FIG. 8B, the area corresponding to the displayed area information is filled only for the assist image corresponding to the circular fisheye image for which the VR display is being performed. Furthermore, as in the composite image 804 in FIG. 8B, the OSD display of the character information 805 may be performed. The character information 805 indicates whether the VR display is performed for the right eye or the left eye.

[0050] Such an operation is applicable to a captured image including a plurality of image areas captured through three or more optical systems. At least a part of the plurality of image areas is displayed as a display range. Then, an item indicating which part of the plurality of image areas is being displayed as the display range and an item enabling identification of a displayed area in the image area corresponding to the display range are displayed.

[0051] In addition, in the first embodiment, the assist image is displayed in the upper left of the VR display as in Fig. 3(B), but the display position of the assist image may be moved as in Fig. 3(C) by a flick operation on the touch panel, an operation on the cross key, etc. In this way, when the assist image overlaps with a position that the user wants to check in the VR display, the user can move the assist image and check the desired position in the composite image.

[0052] (Embodiment 2) A description will now be given of a second embodiment of the present invention. Note that in the following, descriptions of the same points as in the first embodiment (for example, the same configurations and processes as in the first embodiment) will be omitted as appropriate.

[0053] FIG. 9 is a block diagram showing an imaging device according to the second embodiment. The configuration of the imaging device according to the second embodiment (FIG. 9) is substantially the same as the configuration of the imaging device according to the first embodiment (FIG. 1). However, the imaging device according to the second embodiment further includes a display time measurement unit 900. The display time measurement unit 900 measures the time during which the same display range is continuously displayed. In addition, the imaging device according to the second embodiment includes an automatic confirmation mode, as an operation mode of the displayed area confirmation function, in which the display range is automatically changed according to the passage of a predetermined time. The user can use the operation unit 108 to specify ON / OFF of the automatic confirmation mode at any timing.

[0054] FIG. 10 is a flowchart showing an example of LV display processing of the imaging apparatus according to the second embodiment.

[0055] In S1001, the display control unit 109 determines whether the automatic confirmation mode is ON (enabled). If the automatic confirmation mode is ON, the process proceeds to S1002, and if not (if the automatic confirmation mode is OFF (disabled)), the process proceeds to S603.

[0056] In S1002, the display control unit 109 sets an initial position of the display range in the automatic confirmation mode. The display range of the initial position may be the center of the circular fisheye image, may be an end of the circular fisheye image, or may be an area arbitrarily specified by the user. The display range of the initial position may be an area not displayed in VR (an undisplayed (unconfirmed) area in which no information is included in the displayed area information).

[0057] In S1003, the display control unit 109 controls the display time measurement unit 900 to start measuring the time from the start of VR display of the current display range (display time of the current display range). Note that the LV display is updated sequentially even during measurement of the display time.

[0058] In S1004, the display control unit 109 determines whether or not an operation to end the automatic confirmation mode has been performed. If an operation to end the automatic confirmation mode has been performed, the process proceeds to S604, and if not, the process proceeds to S1005.

[0059] In S1005, the display control unit 109 judges whether the display time that started to be measured in S1003 is equal to or longer than the threshold time t. If the display time is equal to or longer than the threshold time t, the process proceeds to S1006, and if not, the process proceeds to S1004. Note that the threshold time t is not particularly limited, and for example, For example, it may be a fixed value determined in advance, or a value specified by the user (a value that can be changed by the user).

[0060] In S1006, the display control unit 109 controls the display time measurement unit 900 to end measurement of the display time of the current display range.

[0061] In S1007, the display control unit 109 determines whether or not the entire area of ​​the captured circular fisheye image has been displayed based on the displayed area information stored in the assist image generation unit 106. If the entire area has been displayed, the process proceeds to S604; otherwise, the process proceeds to S1008.

[0062] In S1008, the display control unit 109 changes the display range to an undisplayed area based on the displayed area information stored in the assist image generating unit 106.

[0063] As described above, according to the second embodiment, the display range is automatically changed so as to scan the entire captured image. This makes it possible to prevent omissions when pre-checking the imaging results based on the set imaging parameters.

[0064] (Embodiment 3) A third embodiment of the present invention will be described. In the following, the same points as those in the first and second embodiments (for example, the same configurations and processes as those in the first and second embodiments) will not be described as necessary. In the third embodiment, an assist image is initialized when a predetermined condition is satisfied.

[0065] 11 is a block diagram showing an imaging device according to embodiment 3. The configuration of the imaging device according to embodiment 3 (FIG. 11) is substantially the same as that of embodiment 1 (FIG. 1). The imaging device further includes an initialization determination unit 1100. The initialization determination unit 1100 determines whether or not a predetermined operation (initialization-required operation) that requires initialization of the displayed area information has been performed, and transmits the determination result to the display control unit 109. The display control unit 109 initializes the displayed area information in response to the initialization operation.

[0066] 12 is a flowchart showing an example of initialization processing of displayed area information in the imaging device according to embodiment 3. This initialization processing is executed in parallel with the LV display processing shown in FIG.

[0067] In S1201, the display control unit 109 detects a user operation performed on the imaging device using the operation unit .

[0068] In S1202, the display control unit 109 controls the initialization determination unit 1100 to determine whether or not the user operation detected in S1201 is a predetermined operation (initialization-required operation) that requires initialization of the displayed area information. If an initialization-required operation has been performed, the process proceeds to S1203; otherwise, the process proceeds to S1201.

[0069] The operation requiring initialization is, for example, an operation in which the user specifies initialization of the displayed area information, or an operation for changing the imaging parameters. The operation for changing the imaging parameters is an operation that affects the imaging result, such as an operation for changing the ISO sensitivity, the aperture value, the white balance setting, the focus setting, the lens zoom setting, etc. In addition, it is also determined that the operation requiring initialization has been performed when the imaging parameters are changed by, for example, pressing the shutter button halfway.

[0070] Also, if the orientation (imaging direction) or location (imaging position) of the imaging device changes, it is determined that an initialization-requiring operation has been performed. In order to determine whether the orientation or location of the imaging device has changed, the imaging device may include at least one of an acceleration sensor and a gyro sensor. Also, the initialization determination unit 1100 may calculate a difference between images (frames) captured at different times, and determine that the orientation or location of the imaging device has changed when the difference becomes equal to or greater than a threshold. The initialization determination unit 1100 may perform the determination by combining a plurality of methods. There is no particular limitation on the method of detecting an initialization-requiring operation.

[0071] In S1203, the display control unit 109 initializes (eg, deletes) the displayed area information stored in the assist image generating unit .

[0072] As described above, according to the third embodiment, the displayed region information is initialized when the imaging parameters are changed, etc. This makes it possible to prevent overlooking of a region that requires reconfirmation of the imaging result due to a change in the imaging parameters, etc.

[0073] The above-described embodiment (including the modified examples) is merely an example, and the present invention also includes configurations obtained by appropriately modifying or changing the configurations of the above-described embodiment within the scope of the gist of the present invention. The present invention also includes configurations obtained by appropriately combining the configurations of the above-described embodiment.

[0074] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0075] The disclosure of the present embodiment includes the following configuration, method, program, and medium. (Configuration 1) An acquisition means for acquiring a captured image; a display control means for performing a geometric transformation on a partial area of ​​the captured image as a display range, and for controlling to display a geometrically transformed display image, and capable of changing the display range; having The display control means controls the already-displayed area in the captured image to further display an identifiable item. 1. An electronic device comprising: (Configuration 2) The item includes a reduced image obtained by reducing the captured image, and an area in the reduced image that corresponds to the area that has been displayed is an identifiable item. 2. The electronic device according to configuration 1. (Configuration 3) The display control means initializes the items when a predetermined condition is satisfied. 3. The electronic device according to configuration 1 or 2. (Configuration 4) The predetermined condition is that the imaging position of the captured image is changed. 4. The electronic device according to configuration 3. (Configuration 5) The predetermined condition is that the imaging direction of the captured image is changed. 4. The electronic device according to configuration 3. (Configuration 6) The predetermined condition is that the imaging parameters are changed. 4. The electronic device according to configuration 3. (Configuration 7) The imaging parameters include at least one of ISO sensitivity, aperture value, shutter speed, white balance setting, focus setting, and zoom setting. 7. The electronic device according to configuration 6. (Configuration 8) the captured image includes a plurality of image regions captured via a plurality of optical systems, The display control means controls so that at least a part of any one of the plurality of image regions is displayed as a display range. 8. The electronic device according to any one of configurations 1 to 7. (Configuration 9) The display control means controls to further display a second item indicating which part of the plurality of image areas is being displayed as the display range. 9. The electronic device according to configuration 8. (Configuration 10) Each of the plurality of image regions is a region of a circular fisheye image. 10. The electronic device according to configuration 8 or 9. (Configuration 11) The geometric transformation is a perspective projection transformation. 11. The electronic device according to any one of configurations 1 to 10. (Configuration 12) The captured image is a spherical image or a semi-spherical image. 12. The electronic device according to any one of configurations 1 to 11. (Configuration 13) The display control means automatically changes the display range. 13. The electronic device according to any one of configurations 1 to 12. (Configuration 14) An acquisition step of acquiring a captured image; a display control step of performing geometric transformation on a partial area of ​​the captured image as a display range and controlling to display a geometrically transformed display image, and capable of changing the display range; having In the display control step, the area already displayed in the captured image is controlled so as to further display an identifiable item. 23. A method for controlling an electronic device comprising: (program) A program for causing a computer to function as each of the means of the electronic device according to any one of configurations 1 to 13. (medium) A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of configurations 1 to 13. [Explanation of symbols]

[0076] 102: Image sensor unit 109: Display control unit

Claims

1. An acquisition means for acquiring a captured image; a display control means for performing a geometric transformation on a partial area of ​​the captured image as a display range, and for controlling to display a geometrically transformed display image, and capable of changing the display range; having The display control means controls the already-displayed area in the captured image to further display an identifiable item.

1. An electronic device comprising:

2. The item includes a reduced image obtained by reducing the captured image, and an area in the reduced image that corresponds to the area that has been displayed is an identifiable item.

2. The electronic device according to claim 1 .

3. The display control means initializes the items when a predetermined condition is satisfied.

2. The electronic device according to claim 1 .

4. The predetermined condition is that the imaging position of the captured image is changed.

4. The electronic device according to claim 3.

5. The predetermined condition is that the imaging direction of the captured image is changed.

4. The electronic device according to claim 3.

6. The predetermined condition is that the imaging parameters are changed.

4. The electronic device according to claim 3.

7. The imaging parameters include at least one of ISO sensitivity, aperture value, shutter speed, white balance setting, focus setting, and zoom setting.

7. The electronic device according to claim 6.

8. the captured image includes a plurality of image regions captured via a plurality of optical systems, The display control means controls so that at least a part of any one of the plurality of image regions is displayed as a display range.

2. The electronic device according to claim 1 .

9. The display control means controls to further display a second item indicating which part of the plurality of image areas is being displayed as the display range.

9. The electronic device according to claim 8.

10. Each of the plurality of image regions is a region of a circular fisheye image.

9. The electronic device according to claim 8.

11. The geometric transformation is a perspective projection transformation.

2. The electronic device according to claim 1 .

12. The captured image is a spherical image or a semi-spherical image.

2. The electronic device according to claim 1 .

13. The display control means automatically changes the display range.

2. The electronic device according to claim 1 .

14. An acquisition step of acquiring a captured image; a display control step of performing geometric transformation on a partial area of ​​the captured image as a display range and controlling to display a geometrically transformed display image, and capable of changing the display range; having In the display control step, the area already displayed in the captured image is controlled so as to further display an identifiable item.

23. A method for controlling an electronic device comprising:

15. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 13.

16. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 13.

Images