Electronic apparatus, method for controlling electronic apparatus, program, and storage medium

Abstract

To allow a user to easily (instantly) grasp the range (direction) of a video displayed on a display immediately after change of a photographing mode, and in turn allow the user to easily photograph a desired range.SOLUTION: An electronic apparatus of the present invention has: setting means that sets any one of a plurality of modes including a first mode and a second mode different from the first mode in the size of an imaging range; and display control means that controls to display, on a display, an image picked up by using at least any one of a plurality of lenses different in optical axis direction from each other. When a mode to be set is switched from one of the first mode and the second mode to the other, the display control means controls to display, on the display, an image of an imaging range corresponding to a lens, of the plurality of lenses, which satisfies a predetermined condition.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium, and more particularly to a control method for displaying an image having a wide image range. [Background technology]

[0002] In recent years, imaging devices capable of capturing images of a range wider than the human viewing angle, such as omnidirectional images and omnidirectional images, using mirrors or multiple lenses, have become widespread. A method is known in which a part of such a wide-range image is displayed on a display, and the range (display range) of the image displayed on the display is changed following the change in the attitude of the device, thereby providing a highly immersive and realistic display (VR view). There are also imaging devices that can switch between a mode in which one lens is used to capture only one side (in a certain direction) and a mode in which multiple lenses are used to capture both sides (in all directions), and can display images corresponding to the set capture mode on the display. An image captured using an optical system including a spherical mirror or a hyperbolic mirror is an annular image, and a rectangular image is obtained by performing a panoramic development of the annular image. An image captured using an optical system including a fisheye lens is a circular image, and a rectangular image is obtained by performing a panoramic development of the circular image.

[0003] Patent Document 1 discloses a technique for generating a panoramic image centered on a preset direction (north, south, east, west). Patent Document 2 discloses a technique for obtaining a live view image by performing panoramic development in a direction according to the orientation of a variable angle monitor. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2011-040898 A [Patent Document 2] JP 2016-019251 A Summary of the Invention [Problem to be solved by the invention]

[0005] By using the technology disclosed in Patent Document 1, a user can easily grasp the direction (north, south, east, or west) in which a subject appears in a panoramic image. By using the technology disclosed in Patent Document 2, a user can easily grasp the relationship between a live view image and a subject appearing in the live view image.

[0006] However, the techniques disclosed in Patent Documents 1 and 2 do not take into consideration switching the shooting mode between a mode in which one lens is used to shoot only one side (in a certain direction) and a mode in which multiple lenses are used to shoot both sides (in all directions). Therefore, the user cannot easily (instantly) grasp the range (direction) of the image displayed on the display immediately after switching the shooting mode, and cannot easily shoot the desired range.

[0007] The present invention aims to enable a user to easily (instantly) grasp the range (direction) of an image displayed on a display immediately after switching shooting modes, and thus to enable the user to easily shoot a desired range. [Means for solving the problem]

[0008] The electronic device of the present invention includes a setting means for setting one of a plurality of modes including a first mode and a second mode having a different imaging range from the first mode, and a display unit for displaying an image captured using at least one of a plurality of lenses having optical axis directions different from each other. and a display control means for controlling the display unit to display, when a mode to be set is switched from one of the first mode and the second mode to the other, the display control means controls the display unit to display, on the display unit, an image of an imaging range corresponding to a lens among the plurality of lenses that satisfies a predetermined condition. Effect of the Invention

[0009] According to the present invention, the user can easily (instantly) grasp the range (direction) of the image displayed on the display immediately after switching the shooting mode, and thus the user can easily capture the desired range. [Brief description of the drawings]

[0010] [Figure 1] 1 is an external view and a block diagram of a digital camera. [Diagram 2] 1 is an external view and a block diagram of a display control device. [Diagram 3] 13 is a flowchart of a remote live view process. [Figure 4] FIG. 2 is a schematic diagram of a display screen. [Diagram 5] 13 is a flowchart of a main lens determination process. [Figure 6] FIG. 2 is a schematic diagram showing the operation of the digital camera. [Figure 7] 2A to 2C are schematic diagrams showing attachment and detachment of various modules to and from a digital camera. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1(a) is a front perspective view (exterior view) of a digital camera 100 (imaging device). Fig. 1(b) is a rear perspective view (exterior view) of the digital camera 100. The digital camera 100 is an omnidirectional camera (panoramic camera).

[0012] Barrier 102a is a protective window for a front camera unit whose shooting range is in front of digital camera 100. The front camera unit is, for example, a wide-angle camera unit whose shooting range is a wide range of 180 degrees or more up, down, left, and right on the front side of digital camera 100. Barrier 102b is a protective window for a rear camera unit whose shooting range is a rear side of digital camera 100. The rear camera unit is, for example, a wide-angle camera unit whose shooting range is a wide range of 180 degrees or more up, down, left, and right on the rear side of digital camera 100.

[0013] The display unit 28 displays various information. The shutter button 61 is an operation unit (operation member) for issuing a shooting instruction. The mode change switch 60 is an operation unit for switching between various modes. The connection I / F 25 is a connector for connecting a connection cable to the digital camera 100, and external devices such as a smartphone, a personal computer, and a television are connected to the digital camera 100 using the connection cable. The operation unit 70 is various switches, buttons, dials, touch sensors, etc. that accept various operations from the user. The power switch 72 is a push button for switching the power on / off.

[0014] The light-emitting unit 21 is a light-emitting member such as a light-emitting diode (LED), and notifies the user of various states of the digital camera 100 by light-emitting patterns and colors. The fixing unit 40 is, for example, a tripod screw hole, and is used to fix and install the digital camera 100 on a fixing device such as a tripod.

[0015] FIG. 1C is a block diagram showing an example of the configuration of the digital camera 100.

[0016] The barrier 102a covers the imaging system (photographing lens 103a, shutter 101a, imaging section 22a, etc.) of the front camera section to prevent the imaging system from becoming dirty or damaged. The photographing lens 103a is a lens group including a zoom lens and a focus lens, and is a wide-angle lens. The shutter 101a has an aperture function that adjusts the amount of subject light incident on the imaging section 22a. The imaging section 22a is an imaging element (imaging sensor) composed of a CCD or CMOS element that converts an optical image into an electrical signal. The A / D converter 23a converts an analog signal output from the imaging section 22a into a digital signal. The barrier 102a may be omitted and the outer surface of the photographing lens 103a may be exposed to prevent dirt and damage to other imaging systems (shutter 101a and imaging section 22a).

[0017] The barrier 102b covers the imaging system (taking lens 103b, shutter 101b, imaging section 22b, etc.) of the rear camera section to prevent the imaging system from becoming dirty or damaged. The taking lens 103b is a lens group including a zoom lens and a focus lens, and is a wide-angle lens. The shutter 101b is a shutter with an aperture function that adjusts the amount of subject light incident on the imaging section 22b. The imaging section 22b is an imaging element composed of a CCD or CMOS element that converts an optical image into an electrical signal. The A / D converter 23b converts an analog signal output from the imaging section 22b into a digital signal. Note that the barrier 102b may not be provided and the outer surface of the taking lens 103b may be exposed, and the taking lens 103b may prevent other imaging systems (shutter 101b and imaging section 22b) from becoming dirty or damaged.

[0018] The imaging units 22a and 22b capture VR (Virtual Reality) images. The VR image is an image that can be displayed in VR (displayed in the display mode "VR view"). The VR image includes an omnidirectional image (spherical image) captured by an omnidirectional camera (spherical camera) and a panoramic image having a wider image range (effective image range) than the display range that can be displayed at one time on the display unit. The VR image includes not only still images but also videos and live view images (images acquired from the camera almost in real time). The VR image has an image range (effective image range) of up to 360 degrees in the up and down directions (vertical angle, angle from the zenith, elevation angle, depression angle, altitude angle, pitch angle) and 360 degrees in the left and right directions (horizontal angle, azimuth angle, yaw angle).

[0019] In addition, VR images also include images that have a wider angle of view (field of view) than the angle of view that can be captured by a normal camera, or a wider image range (effective image range) than the display range that can be displayed at one time on a display unit, even if the angle of view is less than 360 degrees up and down and less than 360 degrees left and right. For example, an image captured by a spherical camera capable of capturing an object with a field of view (field of view) of 360 degrees in the left and right directions (horizontal angle, azimuth angle) and a vertical angle of 210 degrees centered on the zenith is a type of VR image. In addition, an image captured by a camera capable of capturing an object with a field of view (field of view) of 180 degrees in the left and right directions (horizontal angle, azimuth angle) and a vertical angle of 180 degrees centered on the horizontal direction is a type of VR image. In other words, an image that has a field of view of 160 degrees (±80 degrees) or more in the up and down and left and right directions and has a wider image range than the range that a human can see at one time is a type of VR image.

[0020] When this VR image is displayed in VR (displayed in "VR view" display mode), seamless omnidirectional images can be viewed in the left-right direction (horizontal rotation direction) by changing the position of the display device (the display device displaying the VR image) in the left-right rotation direction. In the up-down direction (vertical rotation direction), seamless omnidirectional images can be viewed within a range of ±105 degrees from directly above (the zenith), but the range beyond 105 degrees from directly above becomes a blank area with no images. A VR image can also be described as "an image whose image range is at least a part of a virtual space (VR space)."

[0021] VR display (VR view) is a display method (display mode) that allows you to change the display range of a VR image, displaying images with a field of view that corresponds to the posture of the display device. When viewing while wearing a head-mounted display (HMD), the display device, the image is displayed with a field of view that corresponds to the direction of the user's face. For example, if the VR image is displayed with the left eye at a certain point, Assume that an image with a viewing angle (angle of view) centered on 0 degrees to the right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) is displayed. From this state, if the orientation of the display device is flipped over (for example, if the display surface is changed from facing south to facing north), the display range of the same VR image is changed to an image with a viewing angle centered on 180 degrees left and right (opposite direction, e.g., south) and 90 degrees up and down (horizontal). In the case where a user is viewing an HMD, if the user turns his or her face from north to south (i.e., turns around), the image displayed on the HMD also changes from a north image to a south image. Such VR display can provide the user with a sense (a sense of immersion) as if they were visually in the VR image (VR space). A smartphone attached to VR goggles (head-mounted adapter) can be considered a type of HMD.

[0022] The display method of the VR image is not limited to the above. The display range may be moved (scrolled) in response to user operation on the touch panel or directional buttons, instead of posture changes. During VR display (display mode "VR view"), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch moves on the touch panel, dragging operations on the mouse, pressing directional buttons, etc.

[0023] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on data from the A / D converter 23a and the A / D converter 23b, or data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-emission) processing to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the arithmetic results obtained. The image processing unit 24 also performs basic image processing on two images (two fisheye images; two wide-angle images) obtained from the A / D converter 23a and the A / D converter 23b, and performs stitching processing to combine the two images that have been subjected to the basic image processing, thereby generating a single VR image. In addition, the image processing unit 24 performs image cropping, enlargement, distortion correction, etc. to display the VR image in VR during VR display in live view or during playback, and performs rendering to draw the processing results in the VRAM of the memory 32.

[0024] In the stitching image processing, the image processing unit 24 uses one of two images as a reference image and the other as a comparison image, calculates the amount of deviation between the reference image and the comparison image for each area by pattern matching processing, and detects a stitching position for stitching the two images based on the amount of deviation for each area. The image processing unit 24 corrects the distortion of each image by geometric transformation in consideration of the detected stitching position and the lens characteristics of each optical system, and converts each image into an image in a celestial sphere format (a celestial sphere image format). Then, the image processing unit 24 generates one celestial sphere image (VR image) by synthesizing (blending) two celestial sphere format images. The generated celestial sphere image is, for example, an image using equirectangular projection, and the position of each pixel of the celestial sphere image can be associated with the coordinates of the surface of a sphere (VR space).

[0025] The output data from the A / D converters 23a, 23b is written to the memory 32 via the image processing unit 24 and the memory control unit 15, or via the memory control unit 15 without via the image processing unit 24. The memory 32 stores image data obtained by the imaging units 22a, 22b and converted into digital data by the A / D converters 23a, 23b, and image data to be output to an external display from the connection I / F 25. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0026] The memory 32 also serves as a memory for displaying images (video memory). The stored data for image display can be output from the connection I / F 25 to an external display. The VR images captured by the imaging units 22a and 22b, generated by the image processing unit 24, and stored in the memory 32 are sequentially transferred to the external display and displayed. In this way, a function as an electronic viewfinder can be realized, and live view display (LV display) can be performed. Hereinafter, an image displayed in live view display is referred to as a live view image (LV image). In addition, the live view display (remote LV display) can also be performed by transferring the VR images stored in the memory 32 to a wirelessly connected external device (such as a smartphone) via the communication unit 54 and displaying them on the external device side.

[0027] The non-volatile memory 56 is a memory serving as an electrically erasable and recordable recording medium, such as an EEPROM. Constants and programs for the operation of the system control unit 50 are recorded in the non-volatile memory 56. The programs referred to here are computer programs for executing various processes.

[0028] The system control unit 50 is a control unit having at least one processor or circuit, and controls the entire digital camera 100. The system control unit 50 realizes each process by executing the programs recorded in the non-volatile memory 56 described above. The system memory 52 is, for example, a RAM, and constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, and the like are deployed in the system memory 52. ​​The system control unit 50 also performs display control by controlling the memory 32, the image processing unit 24, the memory control unit 15, and the like. The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0029] The mode changeover switch 60 , the shutter button 61 , the operation unit 70 , and the power switch 72 are used to input various operational instructions to the system control unit 50 .

[0030] The mode changeover switch 60 changes the operation mode of the system control unit 50 to one of a still image recording mode, a video shooting mode, a playback mode, a communication connection mode, etc. Modes included in the still image recording mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode. In addition, there are various scene modes and a custom mode that are shooting settings according to shooting scenes. The user can directly switch to one of these modes using the mode changeover switch 60. Alternatively, the user may use the mode changeover switch 60 to once switch to a list screen of shooting modes, and then selectively switch to one of the multiple modes displayed on the display unit 28 using other operating members. Similarly, the video shooting mode may also include multiple modes.

[0031] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is turned on when the shutter button 61 is pressed halfway (instruction to prepare for shooting) during operation, and generates a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 50 starts preparation operations for shooting, such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing. The second shutter switch 64 is turned on when the shutter button 61 is pressed fully (instruction to shoot) and generates a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of operations for shooting processing, from reading out signals from the imaging units 22a and 22b to writing image data to the recording medium 90.

[0032] The shutter button 61 is not limited to an operating member that can be operated in two stages, full depression and half depression, but may be an operating member that can be pressed only in one stage. In response to the pressing of the switch, the shooting preparation operation and the shooting process are performed consecutively. This is the same operation as when a shutter button that can be pressed halfway or all the way is pressed all the way (when the first shutter switch signal SW1 and the second shutter switch signal SW2 are generated almost simultaneously).

[0033] The operation unit 70 functions as various function buttons, with appropriate functions assigned for each situation by selecting and operating various function icons and options displayed on the display unit 28. Examples of the function buttons include an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. For example, when the menu button is pressed, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings by operating the operation unit 70 while looking at the menu screen displayed on the display unit 28.

[0034] The power switch 72 is a push button for switching the power on and off. The power control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching the blocks to be energized, and detects whether a battery is attached, the type of battery, the remaining battery level, etc. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage for the necessary period to each unit including the recording medium 90. The power supply unit 30 is composed of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, etc.

[0035] The recording medium I / F 18 is an interface with a recording medium 90 such as a memory card or a hard disk. The recording medium 90 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, an optical disk, a magnetic disk, etc. The recording medium 90 may be an exchangeable recording medium that is detachable from the digital camera 100, or may be a recording medium built into the digital camera 100.

[0036] The communication unit 54 transmits and receives video signals, audio signals, and the like to and from an external device connected wirelessly or via a wired cable. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can transmit images (including LV images) captured by the imaging units 22a and 22b and images recorded on the recording medium 90, and can receive images and various other information from external devices.

[0037] The attitude detection unit 55 detects the attitude of the digital camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging units 22a and 22b is an image captured by holding the digital camera 100 horizontally or vertically. In addition, it is possible to determine how much the digital camera 100 is tilted in three axial directions (rotation directions) of the yaw direction, pitch direction, and roll direction when the image captured by the imaging units 22a and 22b is captured. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 55 to the image file of the VR image captured by the imaging units 22a and 22b, or rotate the image (adjust the orientation of the image to correct the tilt (zenith correction)) and record it. The attitude detection unit 55 can use one sensor or a combination of multiple sensors from among an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, and an altitude sensor. The acceleration sensor, gyro sensor, direction sensor, and the like that configure the attitude detection unit 55 can also be used to detect the movement of the digital camera 100 (panning, tilting, lifting, whether or not it is stationary, etc.).

[0038] The microphone 20 is a microphone that collects sounds around the digital camera 100 to be recorded as sounds for VR images (VR video), which are videos. The connection I / F 25 is a connection plug to which an HDMI (registered trademark) cable, a USB cable, or the like is connected to connect to an external device to transmit and receive video.

[0039] FIG. 2(a) is an external view of a display control device 200, which is a type of electronic device to which the present invention is applied. The display control device 200 is, for example, a display device such as a smartphone. The display 205 is a display unit that displays images and various information. The display 205 is integrally configured with a touch panel 206a, and is configured to detect a touch operation on the display surface of the display 205. The display control device 200 is capable of VR display of a VR image (VR content) on the display 205. The operation unit 206b is a power button that accepts an operation to switch the power of the display control device 200 on and off. The operation unit 206c and the operation unit 206d are volume buttons that increase and decrease the volume of the sound output from the speaker 212b and the earphones and external speakers connected to the audio output terminal 212a. The operation unit 206e is a home button for displaying a home screen on the display 205. The audio output terminal 212a is an earphone jack, and is a terminal that outputs an audio signal to the earphones, the external speakers, and the like. The speaker 212b is a built-in speaker that outputs audio.

[0040] 2(b) is a block diagram showing an example of the configuration of the display control device 200. A CPU 201, a memory 202, a non-volatile memory 203, an image processing unit 204, a display 205, an operation unit 206, a recording medium I / F 207, an external I / F 209, and a communication I / F 210 are connected to an internal bus 250. In addition, an audio output unit 212 and a posture detection unit 213 are also connected to the internal bus 250. The units connected to the internal bus 250 are configured to be able to exchange data with each other via the internal bus 250.

[0041] The CPU 201 is a control unit that controls the entire display control device 200, and is composed of at least one processor or circuit. The memory 202 is composed of, for example, a RAM (such as a volatile memory using semiconductor elements). The CPU 201 controls each unit of the display control device 200, for example, using the memory 202 as a work memory in accordance with a program stored in the nonvolatile memory 203. The nonvolatile memory 203 stores image data, audio data, other data, various programs for the operation of the CPU 201, and the like. The nonvolatile memory 203 is composed of, for example, a flash memory, a ROM, and the like.

[0042] The image processing unit 204 performs various image processing on images stored in the non-volatile memory 203 or the recording medium 208, video signals acquired via the external I / F 209, images acquired via the communication I / F 210, etc., based on the control of the CPU 201. The image processing performed by the image processing unit 204 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, color conversion processing, etc. In addition, various image processing such as panoramic development, mapping processing, conversion of omnidirectional images or VR images that are wide-range images having wide-range images even if they are not omnidirectional. The image processing unit 204 may be configured with a dedicated circuit block for performing specific image processing. Depending on the type of image processing, it is also possible for the CPU 201 to perform image processing according to a program without using the image processing unit 204.

[0043] The display 205 displays images, GUI screens constituting a GUI (Graphical User Interface), and the like under the control of the CPU 201. The CPU 201 generates a display control signal according to a program, and controls each unit of the display control device 200 to generate a video signal for display on the display 205 and output it to the display 205. The display 205 displays an image based on the generated and output video signal. Note that the configuration of the display control device 200 itself is limited to an interface for outputting a video signal for display on the display 205, and the display 205 may be configured as an external monitor (such as a television or HMD).

[0044] The operation unit 206 is an input device for receiving user operations, including a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, etc. In this embodiment, the operation unit 206 includes a touch panel 206a and operation units 206b, 206c, 206d, and 206e.

[0045] A recording medium 208 such as a memory card, CD, or DVD can be detachably attached to the recording medium I / F 207. The recording medium I / F 207 reads data from the attached recording medium 208 and writes data to the recording medium 208 under the control of the CPU 201. The recording medium 208 is a storage unit that stores data such as images to be displayed on the display 205. The external I / F 209 is an interface that connects to an external device via a wired cable (such as a USB cable) or wirelessly and inputs and outputs (data communication) video signals and audio signals. The communication I / F 210 is an interface that communicates (wirelessly) with an external device, the Internet 211, etc. and transmits and receives (data communication) various data such as files and commands. The communication I / F 210 can communicate with the communication unit 54 of the digital camera 100 shown in FIG. 1. The display control device 200 can receive an image (video) captured by the digital camera 100 and display it on the display 205 of the display control device 200.

[0046] The audio output unit 212 outputs the sound of video or music data played back by the display control device 200, operation sounds, ringtones, various notification sounds, etc. The audio output unit 212 includes an audio output terminal 212a for connecting earphones or the like, and a speaker 212b, but the audio output unit 212 may output audio data to an external speaker via wireless communication or the like.

[0047] The attitude detection unit 213 detects the attitude (tilt) of the display control device 200 with respect to the direction of gravity and the attitude of the display control device 200 with respect to each axis of the yaw direction, pitch direction, and roll direction, and notifies the CPU 201 of the attitude information. Based on the attitude detected by the attitude detection unit 213, it is possible to determine whether the display control device 200 is held horizontally, held vertically, facing up, facing down, or in an oblique attitude. It is also possible to determine the presence or absence and magnitude of the tilt of the display control device 200 in a rotation direction such as the yaw direction, pitch direction, or roll direction, and whether the display control device 200 has rotated in the rotation direction. One or a combination of multiple sensors from among an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, and an altitude sensor can be used as the attitude detection unit 213.

[0048] As described above, the operation unit 206 includes the touch panel 206a. The touch panel 206a is configured to be planar and overlaid on the display 205, and is an input device that outputs coordinate information according to the touched position. The CPU 201 can detect the following operations or states on the touch panel 206a. A finger or pen that has not been touching the touch panel 206a touches the touch panel 206a again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which a finger or a pen touches the touch panel 206a (hereinafter referred to as Touch-On) A finger or a pen is moved while touching the touch panel 206a (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 206a is removed from the touch panel 206a, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 206a (hereinafter referred to as Touch-Off)

[0049] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. If touch-move is detected, touch-on is also detected at the same time. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. When it is detected that all fingers or pens that were touching have touched up, touch-off is detected.

[0050] These operation states and the position coordinates of the touch panel 206a touched by a finger or pen are notified to the CPU 201 via an internal bus, and the CPU 201 determines what kind of operation (touch operation) has been performed on the touch panel 206a based on the notified information. Regarding touch-move, the moving direction of the finger or pen moving on the touch panel 206a can also be determined for each vertical and horizontal component on the touch panel 206a based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed.

[0051] An operation of touching the touch panel 206a with a finger, moving it quickly for a certain distance, and then releasing it is called a flick. In other words, a flick is an operation of quickly tracing the touch panel 206a with a finger as if flicking it. When a touch-move of a certain distance or more at a certain speed or more is detected and a touch-up is detected immediately after that, it can be determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation).

[0052] Furthermore, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer together is called pinch in, and a touch operation in which the touch positions are moved away from each other is called pinch out. Pinch out and pinch in are collectively called pinch operation (or simply pinch). The touch panel 206a may be of any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. There are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or a pen to the touch panel, and either type may be used.

[0053] FIG. 2(c) is an external view of VR goggles (head mount adapter) 230 to which the display control device 200 can be attached. The display control device 200 can also be used as a head mount display by attaching it to the VR goggles 230. The insertion port 231 is an insertion port for inserting the display control device 200. The entire display control device 200 can be inserted into the VR goggles 230 with the display surface of the display 205 facing the headband 232 side (i.e., the user side) for fixing the VR goggles 230 to the user's head. In a state where the user wears the VR goggles 230 to which the display control device 200 is attached on the head, the user can view the display 205 without holding the display control device 200 with his / her hands. In this case, when the user moves the head or the entire body, the posture of the display control device 200 also changes. The posture detection unit 213 detects the posture change of the display control device 200 at this time, and the CPU 201 performs processing for VR display based on this posture change. In this case, the detection of the orientation of the display control device 200 by the orientation detection unit 213 is equivalent to detecting the orientation of the user's head (the direction in which the user's line of sight is facing). Note that the display control device 200 itself may be an HMD that can reach the head without VR goggles.

[0054] Fig. 3 is a flowchart showing an example of remote live view processing of the display control device 200. This processing is realized by the CPU 201 expanding a program stored in the non-volatile memory 203 into the memory 202 and executing it. When the power of the display control device 200 is turned on and a display mode for performing remote live view display of an image (video) captured by the digital camera 100 is set in the display control device 200, the processing in Fig. 3 starts.

[0055] In this embodiment, the digital camera 100 can set one of a plurality of shooting modes including a first shooting mode and a second shooting mode having a different shooting range (imaging range) from the first shooting mode. The shooting mode of the digital camera 100 can be set directly from the digital camera 100 or remotely from the display control device 200. In this embodiment, the imaging range of the second shooting mode is wider than that of the first shooting mode. The first shooting mode is a shooting mode in which an image (normal image) having a field angle (viewing angle) of less than 180 degrees is captured by one of the shooting lens 103a and the shooting lens 103b. The second shooting mode is a shooting mode in which an image (omnidirectional image, celestial sphere image, VR image) having a field angle (viewing angle) of 360 degrees is captured by both the shooting lens 103a and the shooting lens 103b.

[0056] Although the digital camera 100 has two photographing lenses 103a and 103b, the number of photographing lenses that the digital camera 100 has is not particularly limited. Although one photographing lens is used in the first photographing mode and all photographing lenses are used in the second photographing mode, the number of photographing lenses used in each photographing mode is not particularly limited. The angle of view (viewing angle) in each photographing mode is also not particularly limited. The digital camera 100 may have three or more photographing lenses with different optical axis directions, two or more photographing lenses may be used in the first photographing mode, and some of the photographing lenses may be used in the second photographing mode. For example, the digital camera 100 may have five photographing lenses, two photographing lenses may be used in the first photographing mode, and four photographing lenses may be used in the second photographing mode. The optical axis direction is a direction parallel to the optical axis of the photographing lens that moves away from the digital camera 100. The use of a photographing lens means that the subject light that enters through the photographing lens is input to the imaging unit 22. A plurality of photographing lenses having optical axis directions different from each other may be interpreted as a plurality of optical systems for capturing images of a subject in different directions.

[0057] In the first shooting mode, a first image may be generated by capturing an image of a subject in a first imaging range in a first direction. In the second shooting mode, a second image may be generated by capturing an image of a subject in a second imaging range including the first direction. The first image may be an image obtained using any one of a plurality of optical systems (a plurality of photographing lenses). The second image may be an image obtained using two or more of the plurality of optical systems. The two or more optical systems used in the second shooting mode may include the optical system used in the first shooting mode.

[0058] In S301, the CPU 201 judges whether or not a change in the shooting direction (image capture direction, display direction) has been instructed by the user. The operation (change operation) instructing a change in the shooting direction is neither an operation to move the digital camera 100 nor an operation to change the orientation of the digital camera 100. In both the first shooting mode and the second shooting mode, the operation to change the shooting direction is an operation on the operation unit 206 (for example, a touch operation on the touch panel 206a, or an operation on another physical button). In the first shooting mode, the operation to change the shooting direction is an operation to switch the shooting lens to be used between the shooting lens 103a and the shooting lens 103b. In the second shooting mode, the operation to change the shooting direction is an operation to change the range (display range) of the captured image displayed on the display 205. If it is determined that a change in the shooting direction has been instructed, the process proceeds to S302, and if not, the process proceeds to S307.

[0059] In S302, the CPU 201 determines a photographing lens that satisfies a predetermined condition based on the current shooting direction (image capture direction, display direction) as the primary lens (primary lens determination process). Details of the primary lens determination process will be described later with reference to FIG. 5. In this embodiment, one of the photographing lens 103a and the photographing lens 103b is determined as the primary lens. Then, based on the primary lens, the imaging range (display range) to be displayed on the display 205 after switching the shooting mode is determined. Note that two or more photographing lenses may be determined as the primary lens.

[0060] In S303, the CPU 201 stores lens information about the main lens determined in S302 in a storage unit (e.g., the memory 202). The lens information indicates at least one of the main lens and the shooting direction (imaging direction, display direction) at the time of determining the main lens. For example, the lens information includes at least one of identification information indicating the main lens and directional information indicating the shooting direction.

[0061] In S304, the CPU 201 acquires an image (image data of a live view image) to be displayed on the display 205. In the first shooting mode, a normal image captured by one of the shooting lenses 103a and 103b is acquired. In the second shooting mode, a VR image generated from an image captured by the shooting lens 103a and an image captured by the shooting lens 103b is acquired.

[0062] In S305, CPU 201 displays the image (live view image) acquired in S304 on display 205. The user performs the task of capturing the subject within the display range while looking at display 205. CPU 201 may further display various items such as an item indicating the current shooting direction, an item (icon) indicating the current shooting mode, an item (icon) accepting user operations, and an item (icon) indicating other camera setting values. These items are displayed, for example, superimposed on the image acquired in S304. The items displayed may differ depending on the shooting mode.

[0063] 4(a) and 4(b) show an example of a screen displayed on the display 205. The shape of the screen is not limited to a circle, and may be, for example, a rectangle. A screen 400 in FIG. 4(a) is a screen in the first shooting mode. In the screen 400, black bands are displayed above and below the live view image. In addition, in the screen 400, items 401 and 402 that accept user operations are displayed. The item 401 indicates that the current shooting mode is the first shooting mode, and when the item 401 is touched, the shooting mode to be set is switched from the first shooting mode to the second shooting mode. When the item 402 is touched, the shooting lens to be used is switched between the shooting lens 103a and the shooting lens 103b. A screen 410 in FIG. 4(b) is a screen in the second shooting mode. In the screen 410, black bands are not displayed above and below the live view image. In the screen 410, items 411 and 412 that accept user operations are displayed. Item 411 indicates that the current shooting mode is the second shooting mode, and when item 411 is touched, the shooting mode to be set is switched from the second shooting mode to the first shooting mode. When item 412 is touched, the shooting direction (image capture direction, display direction) is changed to the initial direction. The initial direction is, for example, the optical axis direction of the shooting lens 103b.

[0064] In both the first and second shooting modes, at least a part of the live view image is displayed on the screen. In the first shooting mode, the display range of the live view image (the range displayed on the display 205) cannot be changed, whereas in the second shooting mode, the display range of the live view image can be changed.

[0065] In S306, the CPU 201 determines whether or not the user has instructed the end of the live view display. If it is determined that the user has instructed the end of the live view display, the CPU 201 ends the remote live view process in FIG. 3, and if not, the process proceeds to S301.

[0066] In S307, the CPU 201 determines whether or not a change in the shooting mode has been instructed by the user. If it is determined that a change in the shooting mode has been instructed, the process proceeds to S308, and if not, the process proceeds to S304.

[0067] In S308, the CPU 201 acquires the lens information stored in the storage unit.

[0068] In S309, the CPU 201 changes (switches) the shooting mode. For example, the CPU 201 switches the shooting mode to be set from one of the first shooting mode and the second shooting mode to the other. At that time, the CPU 201 may notify the user that the shooting mode has been changed. The notification method is not particularly limited, and for example, various information can be notified to the user by turning on a light source or displaying an item.

[0069] In S304 following S309, the CPU 201 identifies the main lens based on the lens information acquired in S308, and displays an image of the imaging range corresponding to the main lens (range imaged using the main lens) on the display 205. In this embodiment, the CPU 201 uses the latest lens information (lens information immediately before switching of the shooting mode) to display 205 an image of the imaging range corresponding to the main lens related to the lens information.

[0070] Although the processes of S302 and S303 are performed immediately after an instruction to change the shooting direction is given, the timing of the processes of S302 and S303 is not limited to this. For example, the processes of S302 and S303 may be performed immediately after an instruction to change the shooting mode is given (between S307 and S308).

[0071] FIG. 5 is a flowchart showing an example of the main lens determination process (S302 in FIG. 3) of the display control device 200.

[0072] In S501, the CPU 201 determines whether the current shooting mode is the first shooting mode or the second shooting mode. If it is determined that the current shooting mode is the first shooting mode, the process proceeds to S502, and if it is determined that the current shooting mode is the second shooting mode, the process proceeds to S503.

[0073] In S502, the CPU 201 determines the photographing lens in use as the primary lens.

[0074] In S503, the CPU 201 acquires information regarding the current shooting direction (imaging direction, display direction).

[0075] In S504, the CPU 201 determines whether or not there is a photographing lens that corresponds to the photographing range (imaging range) including the current photographing direction. The photographing range here is assumed to be the photographing range in the first photographing mode (angle of view (viewing angle) less than 180 degrees). If it is determined that there is a photographing lens that corresponds to the photographing range including the current photographing direction, the process proceeds to S505, and if not, the process proceeds to S506.

[0076] In S505, the CPU 201 determines, as the main lens, the photographing lens that corresponds to the photographing range (the photographing range in the first photographing mode) that includes the current photographing direction.

[0077] In S506, the CPU 201 determines the photographing lens corresponding to the photographing range (the photographing range in the first photographing mode) closest to the current photographing direction as the main lens.

[0078] The main lens determined by the main lens determination process of Fig. 5 is the photographing lens corresponding to the imaging range displayed on the display 205. The main lens determined by the main lens determination process of Fig. 5 is also the photographing lens whose optical axis direction is closest to the current imaging direction (imaging direction, display direction corresponding to the center of the imaging range displayed on the display 205). This main lens may be interpreted as the photographing lens corresponding to the imaging range displayed most widely on the display 205, or as the photographing lens corresponding to the imaging range with the largest display area on the display 205.

[0079] FIG. 6(a) is a schematic diagram showing the state of the digital camera 100 as viewed from directly above. The shooting range 601 is the range photographed (imaged) using both the photographing lens 103a and the photographing lens 103b in the second shooting mode, and corresponds to a 360-degree angle of view (viewing angle). The shooting range 602 (shaded portion) is the range photographed (imaged) using the photographing lens 103b in the first shooting mode, and corresponds to a 360-degree angle of view (viewing angle). The direction 603 is the shooting direction indicating the center of the shooting range 602, and is also the optical axis direction of the photographing lens 103b. When the photographing lens 103b is selected in the first shooting mode, an image of the shooting range 602 centered on the direction 603 is captured and displayed on the display 205. When the current shooting mode is the second shooting mode and the current shooting direction is the direction 604, the direction 604 is included in the shooting range 602 in the first shooting mode, so the photographing lens 103b is determined as the main lens (S505 in FIG. 5).

[0080] FIG. 6B is also a schematic diagram showing the state of the digital camera 100 as seen from directly above. The shooting range 601, shooting range 602, and direction 603 are as described above. The shooting range 612 (shaded portion) is the range photographed (imaged) using the photographing lens 103a in the first photographing mode, and corresponds to an angle of view (viewing angle) of less than 180 degrees. The direction 613 is the imaging direction indicating the center of the shooting range 612, and is also the optical axis direction of the photographing lens 103a. When the photographing lens 103a is selected in the first photographing mode, an image of the shooting range 612 centered on the direction 613 is captured and displayed on the display 205. Consider a case where the current photographing mode is the second photographing mode and the current photographing direction is direction 614. The direction 614 is not included in the shooting range 602 or the shooting range 612 in the first photographing mode. The angle 605 between the direction 614 and the direction 603 is smaller than the angle 615 between the direction 614 and the direction 613. Therefore, among the multiple shooting ranges in the first shooting mode, the shooting range 602 is detected as the shooting range closest to the current shooting direction, and the shooting lens 103b is determined as the main lens (S506 in FIG. 5). Note that, although an example in which the angle between the shooting direction and the optical axis direction is used as the distance between the shooting direction and the shooting range has been described, this is not limiting. For example, the minimum angle between the shooting direction and the shooting direction corresponding to the edge of the shooting range may be used as the distance between the shooting direction and the shooting range.

[0081] As described above, according to this embodiment, when the shooting mode is switched, an image of an imaging range corresponding to a photographing lens that satisfies a predetermined condition (a photographing lens corresponding to an imaging range displayed immediately before switching of the shooting mode) is displayed. For example, assume that the shooting mode to be set is switched from the second shooting mode to the first shooting mode in a state in which the imaging range corresponding to the photographing lens 103b is displayed on the display 205. In this case, assume that the imaging range corresponding to the photographing lens 103b (for example, an imaging range centered on the direction 603 in FIG. 6(b)) is displayed on the display 205 in the first shooting mode. In the first shooting mode, assume that the imaging range displayed on the display 205 is switched from the imaging range corresponding to the photographing lens 103b to the imaging range corresponding to the photographing lens 103a, and then the shooting mode to be set is switched from the first shooting mode to the second shooting mode. In this case, the imaging range corresponding to the photographing lens 103a (for example, an imaging range centered on the direction 613 in FIG. 6(b)) is displayed on the display 205 in the second shooting mode. This allows the user to easily (instantly) grasp the range (direction) of the image (video) displayed immediately after switching the shooting mode, thereby enabling the user to easily capture the desired range.

[0082] In a first shooting mode, a first image is generated by capturing an image of a subject in a first imaging range in a first direction. According to this embodiment, when the mode to be set is switched from the first shooting mode to the second shooting mode, a second image is generated by capturing an image of a subject in a second imaging range including the first direction, and the imaging range in the first direction of the second image is displayed. Also, when the mode to be set is switched from the second shooting mode to the first shooting mode, When the imaging range is switched to the imaging range displayed in the second image, a third image is generated by capturing an image of a subject in a second direction corresponding to the displayed imaging range of the second image, and at least a portion of the third image is displayed.

[0083] The various controls described above as being performed by CPU 201 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0084] In addition, although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0085] In the above-mentioned embodiment, the present invention is applied to a display control device, but the present invention is not limited to this example and can be applied to any electronic device that can be controlled to display a live view image. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, electronic book readers, video players, etc. In addition, the present invention can be applied to digital cameras, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, medical devices, etc.

[0086] For example, the remote live view processing of Fig. 3 may be executed as live view processing in the digital camera 100. The CPU 201 of the display control device 200 may perform processing similar to the remote live view processing of Fig. 3 to display a live view image on the display unit 28 of the digital camera 100. The system control unit 50 of the digital camera 100 may perform processing similar to the remote live view processing of Fig. 3 to display a live view image on the display 205 of the display control device 200.

[0087] When the shooting mode to be set is switched from the first shooting mode to the second shooting mode, the shooting direction (the shooting direction corresponding to the center of the displayed imaging range, the display direction) does not change. On the other hand, when the shooting mode to be set is switched from the second shooting mode to the first shooting mode, the shooting direction may change significantly. For example, as in the direction 614 in FIG. 6(b), when the shooting direction in the second shooting mode is not included in any of the multiple shooting ranges in the first shooting mode, the shooting direction changes significantly when the shooting mode to be set is switched from the second shooting mode to the first shooting mode. Even when the shooting direction in the second shooting mode corresponds to the end of the shooting range in the first shooting mode, the shooting direction changes significantly when the shooting mode to be set is switched from the second shooting mode to the first shooting mode. When the shooting direction changes significantly, the user may lose sight of the subject or may not be able to easily (instantly) grasp the shooting direction. Therefore, the user cannot easily (instantly) adjust the shooting direction after switching the shooting mode.

[0088] Therefore, in such a case (for example, when the angle between the shooting direction and the optical axis direction closest to the shooting direction (angle 615 in FIG. 6(b)) is greater than a threshold value), CPU 201 may notify the user that switching the shooting mode will significantly change the shooting direction.

[0089] Assume that the user issues an instruction to switch the set shooting mode from the second shooting mode to the first shooting mode when the angle (angle 615 in FIG. 6(b)) between the shooting direction and the direction of the optical axis closest to the shooting direction is greater than a threshold value. In this case, the CPU 201 may automatically move the shooting direction closer to the direction of the optical axis closest to the shooting direction at a constant speed or acceleration while remaining in the second shooting mode. In the example of FIG. 6(b), the angle 615 in FIG. 6(b) is set to 0 while remaining in the second shooting mode. 4 (shooting direction) is automatically brought closer to direction 603 (optical axis direction of shooting lens 103b) at a constant speed or acceleration. To indicate that the second shooting mode is maintained, the outer periphery of shooting range 601 is drawn with a thick line in FIG. 6(b). Then, when the shooting direction (direction 614) coincides with the optical axis direction (direction 603), CPU 201 switches the shooting mode to be set from the second shooting mode to the first shooting mode. FIG. 6(c) shows the state after the shooting mode has been switched. By gradually changing the shooting direction, the user can easily (instantly) grasp the change in the shooting direction, and can easily (instantly) adjust the shooting direction after switching the shooting mode.

[0090] As shown in FIGS. 7(a) to 7(d), lens modules 704, 706 (lens units) having one or more photographing lenses may be detachably attached to a digital camera body 701. A display module 702 that displays a live view image may be detachably attached to the digital camera body 701. Similarly, a display 205 may be detachably attached to the display control device 200. FIGS. 7(a) to 7(d) are side views of a digital camera. As described above, the display control device 200 may perform the same process as the remote live view process in FIG. 3, but here it is assumed that the digital camera body 701 performs the same process as the remote live view process in FIG. 3.

[0091] In FIG. 7(a), a lens module 704 and a display module 702 are attached to a digital camera body 701. The lens module 704 has only a photographing lens 705 corresponding to the photographing lens 103b as a photographing lens. When the lens module 704 is attached, the digital camera body 701 sets a first photographing mode. While the lens module 704 is attached, only the first photographing mode can be selected. Then, the digital camera body 701 displays an image captured using the photographing lens 705 on the display section 703 of the display module 702, and stores lens information related to the photographing lens 705 (main lens) in a storage section.

[0092] 7(b) shows a state in which the lens module 704 is removed from the digital camera body 701. Image capture using the photographing lens 705 may be stopped when the lens module 704 is removed, or may be continued after the lens module 704 is removed. After the lens module 704 is removed, an image captured using the photographing lens 705 may be transmitted from the lens module 704 to the digital camera body 701 or the display module 702 by wireless communication, and the image may be displayed on the display unit 703.

[0093] In FIG. 7(c), a lens module 706 and a display module 702 are attached to a digital camera body 701. The lens module 706 has a photographing lens 707 corresponding to the photographing lens 103a and a photographing lens 708 corresponding to the photographing lens 103b. When the lens module 706 is attached, the digital camera body 701 sets the first photographing mode or the second photographing mode. While the lens module 706 is attached, the first photographing mode and the second photographing mode can be selected. When the lens module 706 is attached, the digital camera body 701 sets the first photographing mode or the second photographing mode. Then, the digital camera body 701 determines the photographing lens corresponding to the imaging range displayed on the display unit 703 as the main lens, and stores lens information related to the main lens in the storage unit.

[0094] When the lens module 706 is attached, if the lens information is stored in the storage unit, the digital camera body 701 identifies the main lens based on the lens information, and displays an image of the imaging range corresponding to the main lens on the display unit 703. When the lens module 704 is removed from the digital camera body 701, the digital camera body 70 3. Assume that a lens module 706 is attached to the digital camera body 701. In that case, the digital camera body 701 selects the photographing lens 708 corresponding to the photographing lens 705 (photographing lens 103b) as the main lens based on the lens information related to the photographing lens 705. Then, the digital camera body 701 displays an image captured using the photographing lens 708 on the display unit 703. While the lens module 706 is attached, the digital camera body 701 performs processing similar to the remote live view processing of FIG. 3. Therefore, when the shooting mode is switched, the main lens is identified based on the lens information stored in the storage unit, and an image of the imaging range corresponding to the main lens is displayed on the display unit 703.

[0095] 7(d) shows a state in which the display module 702 has been removed from the digital camera body 701. Here, it is assumed that when the display module 702 is removed from the digital camera body 701, communication with the display module 702 stops, and images are no longer displayed on the display unit 703. In such a case, the determination (identification) and storage of the main lens may not be performed.

[0096] The digital camera body 701 may display a live view image on another display device capable of communicating with the digital camera body 701, instead of the display module 702. In this case, the display module 702 may or may not be attached to the digital camera body 701. The other display device is, for example, a smartphone. A live view image may be displayed on the smartphone (display unit of the smartphone), and the shooting direction and shooting mode may be changed according to a touch operation on the smartphone. A shooting lens corresponding to an imaging range displayed on the smartphone may be determined as a main lens, and lens information on the main lens may be stored in a storage unit of the digital camera body 701. An image synchronized with an image displayed on the smartphone (for example, an image similar to an image displayed on the smartphone) may be displayed on the display unit 703 of the display module 702, or the display unit 703 may be set to be hidden. An instruction by a touch operation may be acceptable by both the display unit 703 and the smartphone, or may not be acceptable by the display unit 703 and may be acceptable only by the smartphone.

[0097] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0098] The disclosure of the present embodiment includes the following configuration, method, program, and medium. (Configuration 1) A setting means for setting one of a plurality of modes including a first mode and a second mode having a different imaging range from the first mode; a display control means for controlling the display unit to display an image captured using at least one of a plurality of lenses having optical axis directions different from each other; having When a set mode is switched from one of the first mode and the second mode to the other, the display control means controls the display unit to display an image of an imaging range corresponding to a lens that satisfies a predetermined condition among the plurality of lenses. 1. An electronic device comprising: (Configuration 2) The first mode is a mode for capturing an image having an angle of view of less than 180 degrees. 2. The electronic device according to configuration 1. (Configuration 3) The first mode is a mode in which an image is captured using any one of the plurality of lenses. 3. The electronic device according to configuration 2. (Configuration 4) In the first mode, the range of the captured image to be displayed on the display unit cannot be changed. 4. The electronic device according to configuration 2 or 3. (Configuration 5) The second mode is a mode for capturing an image having a 360-degree angle of view. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 6) The second mode is a mode in which an image is captured using the plurality of lenses. 6. The electronic device according to configuration 5. (Configuration 7) In the second mode, the range of the captured image to be displayed on the display unit can be changed. 7. The electronic device according to configuration 5 or 6. (Configuration 8) a control unit for controlling the recording, in a storage unit, of lens information relating to a lens corresponding to the imaging range displayed on the display unit, among the plurality of lenses; and When the setting mode is switched from one of the first mode and the second mode to the other, the display control means identifies a lens that satisfies the predetermined condition based on the lens information stored in the storage unit. 8. The electronic device according to any one of configurations 1 to 7. (Configuration 9) The lens information indicates at least one of a lens corresponding to the imaging range displayed on the display unit and an imaging direction corresponding to the imaging range. 9. The electronic device according to configuration 8. (Configuration 10) The lens that satisfies the predetermined condition is the lens that corresponds to the imaging range displayed on the display unit immediately before the mode to be set is changed. 10. The electronic device according to any one of configurations 1 to 9. (Configuration 11) The lens that satisfies the predetermined condition is the lens that corresponds to the widest imaging range displayed on the display unit immediately before the mode to be set is changed. 10. The electronic device according to any one of configurations 1 to 9. (Configuration 12) The lens that satisfies the predetermined condition is a lens whose optical axis direction is closest to the imaging direction corresponding to the imaging range displayed on the display unit immediately before the mode to be set is switched. 10. The electronic device according to any one of configurations 1 to 9. (Configuration 13) a lens unit having one or more lenses is detachably attached to the electronic device; The setting means sets a mode corresponding to a lens unit when the lens unit is attached to the electronic device. 13. The electronic device according to any one of configurations 1 to 12. (Configuration 14) the display unit is detachable from the electronic device, In the case where the display unit is mounted on the electronic device, when the set mode is switched from one of the first mode and the second mode to the other, the display control means A lens that satisfies the predetermined condition is identified, and an image of an imaging range corresponding to the identified lens is displayed on the display unit. When the display unit is not attached to the electronic device, the display control means does not identify a lens that satisfies the predetermined condition. 14. The electronic device according to any one of configurations 1 to 13. (Configuration 15) the display unit is provided in an external device capable of communicating with the electronic device, The setting means sets one of the plurality of modes in response to a user operation on the external device. 15. The electronic device according to any one of configurations 1 to 14. (Configuration 16) the plurality of lenses includes a first lens and a second lens; the display control means is capable of switching, in response to a user operation, an imaging range to be displayed on the display unit between an imaging range corresponding to the first lens and an imaging range corresponding to the second lens; The display control means When the mode to be set is switched from one of the first mode and the second mode to the other mode in a state in which an imaging range corresponding to the first lens is displayed on the display unit, control is performed so that the imaging range corresponding to the first lens is displayed on the display unit in the other mode; In the other mode, the imaging range to be displayed on the display unit is switched from the imaging range corresponding to the first lens to the imaging range corresponding to the second lens, and then, when the mode to be set is switched from the other of the first mode and the second mode to one of the first mode and the second mode, the imaging range corresponding to the second lens is controlled to be displayed on the display unit in the one mode. 16. The electronic device according to any one of configurations 1 to 15. (Configuration 17) A setting means for setting one of a plurality of modes including a first mode and a second mode having a wider imaging range than the first mode; a generation means for generating a first image by capturing an image of a subject in a first imaging range in a first direction in the first mode, and for generating a second image by capturing an image of a subject in a second imaging range including the first direction in the second mode; a display control means for controlling, in the first mode, a display unit to display at least a part of the first image, and for controlling, in the second mode, a display unit to display at least a part of the second image; having The display control means controls, when the setting mode is switched from the first mode to the second mode, to display an imaging range in the first direction of the second image on the display unit, and controls, when the setting mode is switched from the second mode to the first mode, to display, on the display unit, at least a part of a third image generated by imaging a subject in a second direction corresponding to the imaging range displayed on the display unit of the second image. 1. An electronic device comprising: (Configuration 18) The imaging device further includes a plurality of optical systems for capturing images of subjects in different directions, The generation means generates the first image by capturing an image of a subject in the first imaging range in the first direction using any one of the plurality of optical systems in the first mode, and generates the second image by capturing an image of a subject in the second imaging range using two or more of the plurality of optical systems in the second mode. 18. The electronic device according to claim 17, (Configuration 19) The two or more optical systems used in the second mode include an optical system used in the first mode. 20. The electronic device according to claim 18, (Method 1) Setting one of a plurality of modes including a first mode and a second mode having a different imaging range from that of the first mode; a step of controlling the display unit to display an image captured using at least one of a plurality of lenses having optical axis directions different from each other; having When a set mode is switched from one of the first mode and the second mode to the other, control is performed so that an image of an imaging range corresponding to a lens that satisfies a predetermined condition among the plurality of lenses is displayed on the display unit. 23. A method for controlling an electronic device comprising: (Method 2) Setting one of a plurality of modes including a first mode and a second mode having a wider imaging range than the first mode; generating a first image by capturing an image of a subject in a first imaging range in a first direction in the first mode, and generating a second image by capturing an image of a subject in a second imaging range including the first direction in the second mode; controlling, in the first mode, to display at least a portion of the first image on a display unit, and controlling, in the second mode, to display at least a portion of the second image on the display unit; having When the setting mode is switched from the first mode to the second mode, an imaging range in the first direction of the second image is controlled to be displayed on the display unit, and when the setting mode is switched from the second mode to the first mode, at least a part of a third image generated by imaging a subject in a second direction corresponding to the imaging range displayed on the display unit of the second image is controlled to be displayed on the display unit. 23. A method for controlling an electronic device comprising: (program) 20. A program for causing a computer to function as each of the means of the electronic device according to any one of configurations 1 to 19. (medium) A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of configurations 1 to 19. [Explanation of symbols]

[0099] 100: Digital camera 50: System control unit 200: Display control device 201: CPU

Claims

1. a setting means for setting one of a plurality of modes including a first mode and a second mode having a different imaging range from the first mode; a display control means for controlling the display unit to display an image captured using at least one of a plurality of lenses having optical axis directions different from each other; and when the mode to be set is switched from one of the first mode and the second mode to the other, the display control means controls the display unit to display an image of an imaging range corresponding to a lens among the plurality of lenses that satisfies a predetermined condition, The lens that satisfies the predetermined condition is the lens that corresponds to the widest imaging range displayed on the display unit immediately before the mode to be set is switched. An electronic device characterized by:

2. The first mode is a mode for capturing an image having a field of view of less than 180 degrees.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. The first mode is a mode in which an image is captured using any one of the plurality of lenses.

3. The electronic device according to claim 2.

4. In the first mode, the range of the captured image to be displayed on the display unit cannot be changed.

3. The electronic device according to claim 2.

5. The second mode is a mode for capturing an image having a 360-degree angle of view.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

6. The second mode is a mode in which an image is captured using the plurality of lenses.

6. The electronic device according to claim 5,

7. In the second mode, the range of the captured image to be displayed on the display unit can be changed.

6. The electronic device according to claim 5.

8. a control means for controlling the recording, in a storage unit, of lens information relating to a lens corresponding to the imaging range displayed on the display unit, among the plurality of lenses; and When the setting mode is switched from one of the first mode and the second mode to the other, the display control means identifies a lens that satisfies the predetermined condition based on the lens information stored in the storage unit.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

9. The lens information indicates at least one of a lens corresponding to the imaging range displayed on the display unit and an imaging direction corresponding to the imaging range.

9. The electronic device according to claim 8.

10. a lens unit having one or more lenses is detachably attached to the electronic device; The setting means sets a mode corresponding to a lens unit when the lens unit is attached to the electronic device.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

11. the display unit is detachable from the electronic device, When the display unit is attached to the electronic device, when the set mode is switched from one of the first mode and the second mode to the other, the display control means identifies a lens that satisfies the predetermined condition and controls the display unit to display an image of an imaging range corresponding to the lens, If the display unit is not attached to the electronic device, the display control means does not identify a lens that satisfies the predetermined condition.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

12. the display unit is provided in an external device that can communicate with the electronic device, The setting means sets one of the plurality of modes in response to a user operation on the external device.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

13. the plurality of lenses includes a first lens and a second lens; the display control means is capable of switching, in response to a user operation, an imaging range to be displayed on the display unit between an imaging range corresponding to the first lens and an imaging range corresponding to the second lens; The display control means When the mode to be set is switched from one of the first mode and the second mode to the other mode while the imaging range corresponding to the first lens is being displayed on the display unit, control is performed so that the imaging range corresponding to the first lens is displayed on the display unit in the other mode; In the other mode, the imaging range to be displayed on the display unit is switched from the imaging range corresponding to the first lens to the imaging range corresponding to the second lens, and then, when the mode to be set is switched from the other of the first mode and the second mode to one of the first mode and the second mode, the imaging range corresponding to the second lens is controlled to be displayed on the display unit in the one mode.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

14. setting one of a plurality of modes including a first mode and a second mode having a different imaging range from the first mode; a step of controlling the display unit to display an image captured using at least one of a plurality of lenses having optical axis directions different from each other; and when the set mode is switched from one of the first mode and the second mode to the other, the display unit is controlled to display an image of an imaging range corresponding to a lens among the plurality of lenses that satisfies a predetermined condition, The lens that satisfies the predetermined condition is the lens that corresponds to the widest imaging range displayed on the display unit immediately before the mode to be set is switched. A method for controlling an electronic device.

15. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 13.

16. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 13.

Images