Electronic equipment, control methods and programs for electronic equipment

Abstract

To allow users to easily view a wide area of ​​an image without any image processing. [Solution] An electronic device acquires an image having multiple image regions, including a first image region and a second image region, captured through multiple optical systems. It controls the display range, which is a part of the image, to be displayed after applying geometric transformation processing. The position of the display range is changed within one of the multiple image regions in response to user operation. When a user operation is performed to move the display range from a first position, where the entire display range is included in the first image region, to a second position, where the entire display range is not included in the first image region, if the portion of the second image region corresponding to the portion of the first image region included in the display range of the second position is included in the display range of the third position of the second image region, and the entire display range of the third position is included in the second image region, the display range is changed from the first position to the third position.

Description

Technical Field

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program.

Background Art

[0002] A technique is known in which an image having two image regions is acquired using two optical systems facing the same direction, and the two image regions are displayed. By using a wide-angle lens such as a fisheye lens as each optical system, an image region representing a wide range of 180 degrees or more (hemisphere, 90 degrees in all directions from the image center) can be obtained as each image region. Further, VR (Virtual Reality) content created based on an image captured by an imaging device such as a stereo camera having such an optical system has become widespread.

[0003] An image having two image regions is acquired, a display range is set in a part of the image, and the image regions are confirmed while moving the display range. Here, in the acquired image, there are regions that do not appear in the left image region in the right image region, and there are regions that do not appear in the right image region in the left image region. Therefore, in order to confirm the entire region shown in the right image region and the region shown in the left image region, the user has to move the display range significantly and cannot easily confirm it.

[0004] Patent Document 1 discloses a technique in which when there is a pixel value corresponding to a missing region of the other image region in one image region, the pixel value corresponding to the missing region included in the one image region is set in the missing region of the other image region.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

[0006] Using the technology disclosed in Patent Document 1, if the portion of the right image region that is not visible in the left image region is added to the left image region, then by simply checking the right image region, the entire area of ​​both the right and left image regions can be easily confirmed. However, this requires image processing.

[0007] The present invention aims to enable users to easily view a wide area of ​​an image without performing any image processing. [Means for solving the problem]

[0008] The electronic device of the present invention includes acquisition means for acquiring an image having a plurality of image regions including a first image region and a second image region captured through a plurality of optical systems, and control means for controlling a display range, which is a part of the image, to be displayed by applying geometric transformation processing, and changing the position of the display range within any of the plurality of image regions in response to user operation, wherein when a user operation is performed to move from a first position in which the entire display range is included in the first image region to a second position in which the entire display range is not included in the first image region, if the portion of the second image region corresponding to the portion of the first image region included in the display range at the second position is included in the display range at the third position of the second image region, and the entire display range at the third position is included in the second image region, then the control means moves the display range from the display range at the first position to the display range at the third position It is characterized by changing the range. [Effects of the Invention]

[0009] According to the present invention, users can easily view a wide area of ​​an image without having to process the image. [Brief explanation of the drawing]

[0010] [Figure 1]This is a schematic diagram showing the overall system configuration. [Figure 2] This is an external view of the camera. [Figure 3] This is a block diagram of the camera. [Figure 4] This is a schematic diagram showing the configuration of the lens unit. [Figure 5] This is a schematic diagram showing an image captured by an imaging device. [Figure 6] This is a flowchart showing the display process in Embodiment 1. [Figure 7] This is a schematic diagram illustrating the metadata in Embodiment 1. [Figure 8] This is a schematic diagram illustrating the screen display in Embodiment 1. [Figure 9] This is a flowchart showing the display process in Embodiment 2. [Figure 10] This is a schematic diagram of the switching screen in Embodiment 2. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described in detail below with reference to the drawings. Figures 1A and 1B are schematic diagrams showing an example of the overall configuration of the system according to this embodiment. The system according to this embodiment includes a digital camera (camera) 100 and a personal computer (PC) 500. A lens unit 300 is attached (connected) to the camera 100. Details of the lens unit 300 will be described later, but by attaching the lens unit 300, the camera 100 becomes able to capture two images (still images or moving images) with a predetermined parallax at the same time.

[0012] The PC500 is an information processing device that handles images captured by imaging devices such as the camera 100. Figure 1A shows a configuration in which the camera 100 and the PC500 are connected to each other via wireless or wired connections, enabling communication. Figure 1B shows a configuration in which images captured by the camera 100 are input to the PC500 in a file-based manner via an external storage device.

[0013] The external storage device may or may not be connected to both the camera 100 and the PC 500. For example, the external storage device may be connected to the camera 100 to store the image files captured by the camera 100 in the external storage device. Then, the external storage device may be removed from the camera 100 and connected to the PC 500, and the PC 500 may import the files stored in the external storage device.

[0014] Figures 2A and 2B are external views showing an example of the appearance of the camera 100. Figure 2A is a perspective view of the camera 100 seen from the front side, and Figure 2B is a perspective view of the camera 100 seen from the back side.

[0015] On the upper surface of the camera 100, there are a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub - electronic dial 105, a video button 106, and an external viewfinder display section 107. The shutter button 101 is an operating member for giving an instruction for shooting preparation or a shooting instruction. The power switch 102 is an operating member for switching on and off the power of the camera 100. The mode switch 103 is an operating member for switching various modes. The main electronic dial 104 is a rotary operating member for changing setting values such as shutter speed and aperture. The sub - electronic dial 105 is a rotary operating member for moving a selection frame (cursor) or scrolling images. The video button 106 is an operating member for giving an instruction to start or stop video shooting (recording). The external viewfinder display section 107 displays various setting values such as shutter speed and aperture.

[0016] The camera 100 has a display unit 108, a touch panel 109, directional keys 110, a SET button 111, an AE lock button 112, a zoom button 113, a playback button 114, and a menu button 115 on its back. It also has an eyepiece 116, an eyepiece detection unit 118, a touch bar 119, and a display mode switching button 125. The display unit 108 displays images and various information. The touch panel 109 is an operating member that detects touch operations on the display surface (touch operation surface) of the display unit 108. The directional keys 110 is an operating unit consisting of keys that can be pressed up, down, left, and right (4-way keys). Processing can be performed according to the position where the directional keys 110 are pressed. The SET button 111 is an operating member that is mainly pressed when confirming a selection item. The AE lock button 112 is an operating member that is pressed when fixing the exposure state in the shooting standby state. The zoom button 113 is an operating element for switching the zoom mode on and off in the live view display (LV display) of the shooting mode. When the zoom mode is on, the live view image (LV image) can be enlarged or reduced by operating the main electronic dial 104. The zoom button 113 is also used in playback mode to enlarge the playback image or increase the magnification ratio. The playback button 114 is an operating element for switching between shooting mode and playback mode. By pressing the playback button 114 in shooting mode, the camera switches to playback mode, and the latest image recorded on the recording medium 227 (described later) can be displayed on the display unit 108.

[0017] When the metadata generation / analysis unit 232 records image data on the recording medium 227, it generates various metadata such as Exif (Exchangeable image file format) standard attached to the image data based on the information at the time of shooting. Also, when the metadata generation / analysis unit 232 reads the image data recorded on the recording medium 227, it analyzes the metadata attached to the image data. Examples of the metadata include, for example, shooting setting information, image data information regarding the image data, feature information of the subject included in the image data, etc. Also, when the image data is a VR image, information regarding each of the right image area and the left image area and information such as the shooting range, etc. are included. Also, when recording moving image data, the metadata generation / analysis unit 232 can generate and attach metadata for each frame.

[0018] The menu button 115 is an operation member that is pressed to display a menu screen on which various settings are possible on the display unit 108. The user can intuitively perform various settings using the menu screen displayed on the display unit 108, the direction keys 110, and the SET button 111. The eyepiece part 116 is a part where the user looks into the eyepiece finder (peeping type finder) 117. The user can visually recognize the video displayed on the EVF 217 (Electronic View Finder), which will be described later, inside the camera 100 through the eyepiece part 116. The eyepiece detection unit 118 is a sensor that detects whether or not the user is looking into the eyepiece part 116 (eyepiece finder 117).

[0019] The touch bar 119 is a line-shaped touch operation component (line touch sensor) capable of accepting touch operations. The touch bar 119 is positioned so that it can be touched with the right thumb when the grip portion 120 is held with the right hand (with the little finger, ring finger, and middle finger) so that the shutter button 101 can be pressed with the right index finger. In other words, the touch bar 119 can be operated when the user is looking through the eyepiece 116 with their eyepiece in the eyepiece viewfinder 117, and is ready to press the shutter button 101 at any time (shooting posture). The touch bar 119 can accept tap operations (touching and releasing without moving the touch position within a predetermined period), left and right sliding operations (touching and then moving the touch position while maintaining contact). The touch bar 119 is a different operation component from the touch panel 109 and does not have a display function. Bar 119 functions, for example, as a multifunction bar (M-Fn bar) to which various functions can be assigned.

[0020] The display mode switching button 125 is an operating component for switching the display mode. When the display mode switching button 125 is pressed, the display mode is switched, and the live view image displayed on the display unit 108, or the OSD image (e.g., histogram or level indicator) superimposed on the live view image, etc., is switched. The user operates the display mode switching button 125 to switch the display mode so that the display necessary for their shooting is shown.

[0021] The camera 100 also includes a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, and a communication terminal 124. The grip section 120 is a holding section shaped to be easily gripped by the user with their right hand when holding the camera 100. With the camera 100 held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand, the shutter button 101 and the main electronic dial 104 are positioned to be operated by the index finger of the right hand. Similarly, in the same position, the sub electronic dial 105 and the touch bar 119 are positioned to be operated by the thumb of the right hand. The thumb rest section 121 (thumb waiting position) is a grip section located on the back of the camera 100, in a place where the thumb of the right hand holding the grip section 120 can be easily rested when no operating members are being operated. The thumb rest section 121 is made of a rubber material or the like to enhance the holding force (grip feel). The terminal cover 122 protects connectors such as connection cables that connect the camera 100 to external equipment (external devices). The cover 123 protects the recording medium 227 and the slot for storing the recording medium 227, which will be described later, by closing the slot. The communication terminal 124 is a terminal for communicating with a lens unit (such as the lens unit 200 or lens unit 300, which will be described later) that can be attached to or detached from the camera 100.

[0022] Figure 3 is a block diagram showing an example of the configuration of camera 100. Components identical to those in Figure 2 are denoted by the same reference numerals, and their descriptions are omitted where appropriate. In Figure 3, a lens unit 200 is attached to camera 100.

[0023] First, let's describe the lens unit 200. The lens unit 200 is a type of interchangeable lens unit (interchangeable lens) that can be attached to and removed from the camera 100. The lens unit 200 is a single-lens reflex lens unit (single-lens reflex) and is an example of a typical lens unit. The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like.

[0024] The aperture 201 is configured to have an adjustable aperture diameter. The lens 202 is composed of multiple lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, etc., based on instructions from the system control unit 50, which will be described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203 and focuses by changing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication takes place via the communication terminal 206 of the lens unit 200 and the communication terminal 124 of the camera 100. The communication terminal 206 is a terminal for the lens unit 200 to communicate with the camera 100. Furthermore, the types of lens units 200 and 300 attached to the camera 100 are identified via communication terminals 124 and 206.

[0025] Next, the camera 100 will be described. The camera 100 consists of a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, and a D It includes an A / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0026] The shutter 210 is a focal-plane shutter that can freely control the exposure time of the imaging unit 211 based on instructions from the system control unit 50. The imaging unit 211 is an image sensor composed of a CCD or CMOS element that converts an optical image into an electrical signal. The imaging unit 211 may have an image plane phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts the analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (such as pixel interpolation, resizing, and color conversion) on the data from the A / D converter 212 or the data from the memory control unit 213. The image processing unit 214 also performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. This processing enables TTL (through-the-lens) AF processing, AE (automatic exposure) processing, EF (flash pre-flash) processing, etc. Furthermore, the image processing unit 214 performs predetermined calculations using the captured image data, and the system control unit 50 performs TTL-type AWB (auto white balance) processing based on the obtained calculation results. In addition, the image processing unit 214 can obtain an image in which the subject is represented at equidistant by performing perspective projection transformation processing on the fisheye image captured using a fisheye lens.

[0027] Image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, as well as image data for display on the display unit 108 and EVF 217. The memory 215 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 215 also serves as a memory for image display (video memory).

[0028] The D / A converter 216 converts the display image data stored in the memory 215 into an analog signal and supplies it to the display unit 108 and EVF 217. Therefore, the display image data written to the memory 215 is displayed on the display unit 108 and EVF 217 via the D / A converter 216. The display unit 108 and EVF 217 perform display according to the analog signal from the D / A converter 216. The display unit 108 and EVF 217 are displays such as LCDs and OLEDs. The digital signal, which has been A / D converted by the A / D converter 212 and stored in the memory 215, is converted into an analog signal by the D / A converter 216 and sequentially transferred to the display unit 108 and EVF 217 for display, thereby performing live view display.

[0029] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 implements each process of the flowchart described later by executing a program recorded in the non-volatile memory 219. The system control unit 50 also performs display control by controlling the memory 215, D / A converter 216, display unit 108, EVF 217, etc.

[0030] The camera 100 also includes a system memory 218, a non-volatile memory 219, a system timer 220, a communication unit 221, a posture detection unit 222, and an eyepiece detection unit 118.

[0031] For example, RAM is used as the system memory 218. The system memory 218 stores constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 219, etc. The non-volatile memory 219 is an electrically erasable and recordable memory. For example, an EEPROM is used as the non-volatile memory 219. Constants for the operation of the system control unit 50, programs, etc. are stored in the non-volatile memory 219. The program here is a program for executing the flowchart described later. The system timer 220 is a timing unit that measures the time used for various controls and the time of the built-in clock. The communication unit 221 transmits and receives video signals and audio signals to and from external devices connected by wireless or wired cables. The communication unit 221 can also connect to wireless LAN (Local Area Network) and the internet. In addition, the communication unit 221 can communicate with external devices using Bluetooth® and Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211 and images recorded on the recording medium 227, and can receive images and other various information from external devices. The attitude detection unit 222 detects the attitude of the camera 100 with respect to the direction of gravity. The attitude detection unit 222 is, for example, an attitude detection sensor such as an inertial measurement unit (IMU). Based on the attitude detected by the attitude detection unit 222, it is possible to determine whether the image captured by the imaging unit 211 was taken with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image captured by the imaging unit 211, or rotate the image according to the detected attitude. For example, an acceleration sensor or a gyroscope sensor can be used for the attitude detection unit 222. It is also possible to use the attitude detection unit 222 to detect the movement of the camera 100 (pan, tilt, lift, whether it is stationary or not, etc.).

[0032] The eyepiece detection unit 118 can detect the approach of any object to the eyepiece unit 116 (eyepiece finder 117). For example, an infrared proximity sensor can be used for the eyepiece detection unit 118. When an object approaches, infrared light emitted from the light emitter of the eyepiece detection unit 118 is reflected by the object and received by the light receiver of the infrared proximity sensor. The distance from the eyepiece unit 116 to the object can be determined by the amount of infrared light received. In this way, the eyepiece detection unit 118 performs eyepiece detection to detect the proximity distance of an object to the eyepiece unit 116. The eyepiece detection unit 118 is an eyepiece detection sensor that detects the approach (eye-catching) and departure (eye-moving) of an eye (object) to the eyepiece unit 116. When an object is detected approaching the eyepiece unit 116 within a predetermined distance from a non-eyepiece state (non-approach state), it is detected that the eye has been caught in the eye. On the other hand, if the object that was detected as approaching moves beyond a predetermined distance from the eyepiece state (close-up state), it is detected that the eye has been removed. The threshold for detecting eyepiece contact and the threshold for detecting eye removal may be different, for example, by providing hysteresis. After eyepiece contact is detected, the eyepiece state is maintained until eye removal is detected. After eye removal is detected, the non-eyepiece state is maintained until eyepiece contact is detected again. The system control unit 50 switches the display (display state) / non-display (non-display state) of the display unit 108 and EVF 217 according to the state detected by the eyepiece detection unit 118. Specifically, at least in the shooting standby state and when the display destination switching setting is set to automatic switching, when the eyepiece is not in use, the display destination is set to the display unit 108 and the display is turned on, and the EVF 217 is hidden. When eyepiece contact is made, the display destination is set to the EVF 217 and the display is turned on, and the display unit 108 is hidden. Furthermore, the eyepiece detection unit 118 is not limited to an infrared proximity sensor; other sensors capable of detecting a state that can be considered as eyepiece use may be used in the eyepiece detection unit 118.

[0033] The camera 100 also includes an external viewfinder display unit 107, an external viewfinder display drive circuit 223, a power control unit 224, a power supply unit 225, a recording medium interface 226, and an operation unit 228. The external viewfinder display unit 107 is driven by the external viewfinder display drive circuit 223 and displays various settings of the camera 100, such as shutter speed and aperture. The power control unit 224 consists of a battery detection circuit, a DC-DC converter, and a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, and the remaining battery level. Furthermore, the power control unit 224 controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 227, for the required period of time. The power supply unit 225 includes primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries and Li batteries, and an AC adapter. The recording medium I / F 226 is an interface to a recording medium 227 such as a memory card or hard disk. The recording medium 227 is a memory card or the like for recording captured images, and is composed of semiconductor memory or a magnetic disk. The recording medium 227 may be detachable from the camera 100 or may be built into the camera 100.

[0034] The operation unit 228 is an input unit (reception unit) that receives user operations (user input) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, power switch 102, mode switch 103, touch panel 109, and other operation units 229. Other operation units 229 include the main electronic dial 104, sub electronic dial 105, video button 106, directional keys 110, SET button 111, and AE lock button 112. It also includes the zoom button 113, playback button 114, menu button 115, touch bar 119, and display mode switching button 125.

[0035] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. The first shutter switch 230 turns on during the operation of the shutter button 101, so-called half-press (shooting preparation instruction), and outputs a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 50 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 231 turns on when the operation of the shutter button 101 is completed, so-called full-press (shooting instruction), and outputs a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of shooting processes, from reading the signal from the imaging unit 211 to generating an image file containing the captured image and writing it to the recording medium 227.

[0036] The mode switch 103 switches the operating mode of the system control unit 50 to one of the following: still image shooting mode, video shooting mode, or playback mode. The modes included in still image shooting mode are auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide shooting settings for different shooting scenes. The user can directly switch to any of the above shooting modes using the mode switch 103. Alternatively, the user can switch to the shooting mode list screen using the mode switch 103, and then selectively switch to any of the displayed modes using the operation unit 228. Similarly, the video shooting mode may also include multiple modes.

[0037] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operating surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as an integrated unit. For example, the touch panel 109 is mounted on the upper layer of the display surface of the display unit 108 so that its light transmittance does not interfere with the display of the display unit 108. By associating the input coordinates on the touch panel 109 with the display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured that makes it appear as if the user can directly operate the screen displayed on the display unit 108. The touch panel 109 can use any of the following methods: resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, or optical sensor. Depending on the method, a touch may be detected when there is contact with the touch panel 109, or when a finger or pen approaches the touch panel 109; either method is acceptable.

[0038] The system control unit 50 can detect the following operations or states on the touch panel 109. - A finger or pen that was not previously touching the touch panel 109 now touches the touch panel 109, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the touch panel 109 is being touched with a finger or pen (hereinafter referred to as Touch-On). • The touch panel 109 is being moved while a finger or pen is touching it (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 109 is lifted (released), meaning the touch action ends (hereinafter referred to as "Touch-Up"). • The state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0039] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected if a touch-move is detected. A touch-move is not detected if the touch position has not moved, even if a touch-on has been detected. A touch-off occurs after all fingers or pens that were touching the screen have been detected as having touched up.

[0040] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 109, are notified to the system control unit 50 via the internal bus. Based on the notified information, the system control unit 50 determines what kind of operation (touch operation) was performed on the touch panel 109. For touch moves, the direction of movement of the finger or pen moving on the touch panel 109 can also be determined for each vertical and horizontal component on the touch panel 109 based on the change in position coordinates. If a touch move of a predetermined distance or more is detected, it is determined that a slide operation was performed. An operation in which a finger is touched on the touch panel 109 and then quickly moved a certain distance and released is called a flick. In other words, a flick is an operation in which the finger is quickly traced across the touch panel 109 as if flicking it. If a touch move of a predetermined distance or more at a predetermined speed or faster is detected, and a touch-up is then detected, it is determined that a flick was performed (it can be determined that a flick followed a slide operation). Furthermore, touching multiple points (for example, two points) simultaneously (multitouch) to bring them closer together is called pinch-in, and touching them further apart is called pinch-out. Pinch-out and pinch-in are collectively referred to as pinch operations (or simply pinch).

[0041] Figure 4 is a schematic diagram showing an example of the configuration of the lens unit 300. Figure 4 shows the lens unit 300 attached to the camera 100. Note that, among the components of the camera 100 shown in Figure 4, components identical to those described in Figure 3 are given the same reference numerals as in Figure 3, and their descriptions are omitted as appropriate. Hereafter, components related to the right eye will have an R appended to the end of their reference numeral, components related to the left eye will have an L appended to the end of their reference numeral, and components related to both the right and left eyes will not have either an R or L appended to the end.

[0042] The lens unit 300 is a type of interchangeable lens unit that can be attached to and removed from the camera 100. The lens unit 300 is a twin-lens unit capable of capturing parallax right and left images. In this embodiment, the lens unit 300 has two optical systems, and each of the two optical systems can capture a wide field of view of approximately 180 degrees. Specifically, each of the two optical systems of the lens unit 300 can capture a 180-degree field of view in the left-right direction (horizontal angle, azimuth angle, yaw angle). It can image subjects within a 180-degree field of view (angle of view) in the vertical direction (vertical angle, elevation angle, pitch angle). In other words, each of the two optical systems can image the area of ​​the front hemisphere.

[0043] The lens unit 300 includes a right-eye optical system 301R having multiple lenses and a reflective mirror, a left-eye optical system 301L having multiple lenses and a reflective mirror, and a lens system control circuit 303. The right-eye optical system 301R has a lens 302R positioned on the subject side, and the left-eye optical system 301L has a lens 302L positioned on the subject side. Lenses 302R and 302L face the same direction, and their optical axes are approximately parallel.

[0044] The lens unit 300 is a two-lens unit (two-lens, VR180 lens) for obtaining VR180 images, which are one of the VR (Virtual Reality) image formats that enable binocular stereoscopic viewing. In this embodiment, the lens unit 300 has a fisheye lens capable of capturing a range of approximately 180 degrees in each of the right eye optical system 301R and the left eye optical system 301L. The range that can be captured by each of the right eye optical system 301R and the left eye optical system 301L may be narrower than 180 degrees, around 160 degrees. The lens unit 300 can image the right image formed via the right eye optical system 301R and the left image formed via the left eye optical system 301L onto one or two image sensors of a camera to which the lens unit 300 is mounted. In camera 100, the right image and the left image are imaged onto a single image sensor, and a single image (binacular image) is generated in which the right image region (the region of the right image) and the left image region (the region of the left image) are arranged side by side.

[0045] The lens unit 300 is attached to the camera 100 via the lens mount portion 304 and the camera mount portion 305 of the camera 100. In this way, the system control unit 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 124 of the camera 100 and the communication terminal 306 of the lens unit 300. However, the lens unit attached to the camera 100 is not limited to one having two optical systems like the lens unit 300. For example, by attaching a lens unit having more than two optical systems to the camera 100, the imaging unit 211 may capture an image having multiple image regions captured through multiple optical systems, each of which is captured.

[0046] In this embodiment, the right image formed via the right-eye optical system 301R and the left image formed via the left-eye optical system 301L are simultaneously (as a set) imaged on the imaging unit 211 of the camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single image sensor. The imaging unit 211 converts the imaged subject (optical signal) into an analog electrical signal. By using the lens unit 300 in this way, two images with parallax can be simultaneously (as a set) acquired from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. By separating the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a three-dimensional VR image with a range of approximately 180 degrees. In other words, the user can view a VR180 image in 3D.

[0047] The display methods for showing images captured using the lens unit 300 on the display unit 108 or EVF 217 include a method for displaying the captured image as is, and a method for displaying the captured image after applying geometric transformation processing. The method for displaying the captured image after applying geometric transformation processing includes a method for displaying the image after applying perspective projection transformation processing to a circular fisheye image (perspective projection method). In the perspective projection method in this embodiment, perspective projection transformation processing is applied to a display range, which is a part of the image captured using the lens unit 300, and the display range after perspective projection transformation processing is displayed. Because the subject can be displayed at equidistant by performing perspective projection transformation processing, the subject in the peripheral part of the fisheye image can be displayed without distortion.

[0048] Here, we will explain VR images. A VR image is an image that can be displayed in VR, as described later. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera), and panoramic images with a wider image range (effective image range) than the display range that can be displayed at once on the display unit 108. Furthermore, VR images are not limited to still images, but also include videos and live images (images acquired from the camera in near real-time). VR images have an image range (effective image range) of up to 360 degrees horizontally and 360 degrees vertically. In addition, VR images also include images with a wider field of view than that that can be captured by a normal camera, or an image range that is wider than the display range that can be displayed at once on the display unit 108, even if the field of view is less than 360 degrees horizontally or vertically. The image captured by the camera 100 using the lens unit 300 described above is a type of VR image.

[0049] VR display is a display method (display mode) for displaying a portion of a VR image, specifically a display area. In VR display, the position of the display area can be changed. One type of VR display is "single-eye VR display (single-eye VR view)," which displays a single image by performing a transformation (distortion correction) that maps the VR image onto a virtual sphere. Another type of VR display is "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side-by-side in the left and right regions by transforming them and mapping them onto virtual spheres. For example, by using a display device such as an HMD (head-mounted display) and performing a "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax between them, it is possible to view these VR images in 3D. By performing a two-eye VR display in this way, the user can visually experience the sensation (immersion) of being inside the VR image (in the VR space).

[0050] Single-lens VR display is used, for example, when displaying a VR image on the display unit 108 of the camera 100 or on the PC 500. In single-lens VR display, a display range is extracted from one of the multiple image regions included in the VR image, and a geometric transformation process (perspective projection transformation process in this embodiment) is applied to this display range for display. The position and size of the display range can be changed according to user operation. Methods for changing the position of the display range include moving (scrolling) the display range in response to touch moves on the touch panel 109, drag operations with a mouse, or pressing the directional keys 110. Note that the VR image captured using the lens unit 300 is an image (180-degree image) that captures a range of approximately 180 degrees in front of the camera 100. Therefore, there is no image of a range of approximately 180 degrees behind the camera 100. In this embodiment, if the display range includes an area where no image exists (non-image area, blank area, invalid image area) due to changes in the position of the display range, the area where no image exists will be displayed as black or a predetermined pattern.

[0051] Figures 5A to 5D are schematic diagrams showing examples of VR images captured using camera 100 and lens unit 300. Figure 5A shows one image 500a consisting of two circular fisheye image regions side by side. Image 500a has an image region 501R captured via the right eye optical system 301R and an image region 501L captured via the left eye optical system 301L. Image 500a has a non-image region 502 (blank region) surrounding the image regions 501R and 501L. A part of image region 501R is set as the display range 503. Figure 5B is an image obtained by perspective projection transformation of the display range 503 in Figure 5A, and is an image that represents the subject at equidistant distance.

[0052] Other VR images are shown in Figures 5C and 5D. Image 500c in Figure 5C and image 500d in Figure 5D, like Figure 5A, have an image region 504R captured via the right eye optical system 301R and an image region 504L captured via the left eye optical system 301L. Image region 504R is a region where part of image region 501R in Figure 5A is missing, and image region 504L is the same as the image region in Figure 5A. This is a region where part of 501L is missing. In cases like those shown in Figures 5C and 5D, there are regions that are visible in image region 504R but not in image region 504L, and regions that are visible in image region 504L but not in image region 504R. In such cases, simply setting the display range for one image region (fisheye image region) will not include the region that is only visible in the other image region in the display range, and it will not be possible to confirm that region. Furthermore, even in the case of Figure 5A, the above problem occurs if there is parallax between image region 501R and image region 501L.

[0053] <Embodiment 1> Embodiment 1 will be described using Figures 6, 7, and 8A to 8G. In Embodiment 1, the VR display of the image region captured via the right eye optical system 301R and the VR display of the image region captured via the left eye optical system 301L are automatically switched. Figure 6 is a flowchart of the display process in Embodiment 1. In Embodiment 1, the image region to be captured will be described as a fisheye image region. The display process in Figure 6 is realized by the system control unit 50 loading the program recorded in the non-volatile memory 219 into the system memory 218 and executing it. The system control unit 50 starts the display process in Figure 6 in response to the user pressing the play button 114.

[0054] In S601, the system control unit 50 selects a display image (VR image to be displayed) in response to a user operation (image selection operation) to select a display image. The user selects the display image using the directional keys 110 and the SET button 111, etc.

[0055] In S602, the system control unit 50 reads the VR image selected in S601 from the recording medium 227. The metadata generation and analysis unit 232 analyzes the metadata attached to the VR image based on the instructions from the system control unit 50.

[0056] Here, the metadata in Embodiment 1 will be described. Figure 7 is a diagram illustrating the metadata in Embodiment 1. In Figure 7, the rectangular image 700 is a VR image captured by the camera 100. The metadata includes, for example, the overall width W of the image 700, the radius R of the image circle corresponding to the fisheye region, and the width L corresponding to the sensor width of the imaging unit 211. The radius R may be interpreted as the radius of the virtual sphere described above. As a result, the system control unit 50 understands the right image region 700R and the left image region 700L included in the image 700. The system control unit 50 uses the left edge of the image 700 as the origin coordinate in the left-right direction and the right edge as the positive x-axis direction to obtain the coordinates and lengths of each position. In Figure 7, x0 represents the x-coordinate of the left edge of the display range 701, and x1 represents the x-coordinate of the right edge of the display range 701. The system control unit 50 obtains the coordinate r1 of the left edge of the right image region 700R using the following equation 1. Furthermore, the system control unit 50 obtains the coordinates r2 of the right edge of the left image region 700L using the following equation 2. The system control unit 50 stores the obtained coordinates r1 and r2 in the system memory 218. r1=(WL) / 2 (Formula 1) r2=W-(WL) / 2 (Formula 2)

[0057] In S603, the system control unit 50 determines the image area to be displayed in response to a user operation (area selection operation) in which the user selects either the right image area or the left image area as the image area to be displayed. The selection of the right or left image area is made using the directional keys 110 and the SET button 111, etc.

[0058] In S604, the system control unit 50 sets the position and size of the display range within the image area selected in S603 or S608, in response to user operation. Assume the user has set the display range to include only the image area selected in S603 or S608.

[0059] In S605, the system control unit 50 instructs the image processing unit 214 to perform perspective projection transformation processing on the display range set in S604. The system control unit 50 then displays the display range after perspective projection transformation processing on the display unit 108. Figure 8A shows the VR image 800 selected in S601. The VR image 800 has a right image area 800R and a left image area 800L. The display range 801 is the display range set in S604. As shown in Figure 8A, assume that the display range 801 is set to position 801a. The system control unit 50 determines that at position 801a in Figure 8A, the display range 801 includes only the right image area 800R. Figure 8B shows the image after perspective projection transformation processing has been applied to the display range 801 in Figure 8A. The display object 802 indicates the image area selected in S603. "R" indicates the right image region 800R, and "L" indicates the left image region 800L. In Figure 8B, the display object 802, "R" indicating the right image region 800R, is superimposed.

[0060] In S606, the system control unit 50 determines whether the operation unit 228 has received a user operation (change operation) to change the position or size of the display range. The position or size of the display range is changed using the directional keys 110 and the SET button 111, etc. If the system control unit 50 determines in S606 that the position or size of the display range has been changed, it proceeds to S607. If the system control unit 50 determines in S606 that the position or size of the display range has not been changed, it proceeds to S609.

[0061] In S607, the system control unit 50 determines whether or not the display range includes a non-image area. If the system control unit 50 determines that it includes a non-image area, it proceeds to S608; if it determines that it does not include a non-image area, it proceeds to S604.

[0062] Here, we will explain how the system control unit 50 determines whether or not the display range includes a non-image area. The system control unit 50 obtains the amount of movement of the display range after changing the position or size of the display range. For example, when moving the display range using the directional keys 110, a reference movement amount, which is the amount of movement of the display range for one press of the directional key 110 (press for a predetermined time), is predetermined. The amount of movement of the display range (total movement amount) is calculated by multiplying the reference movement amount by the number of times (press duration) the directional key 110 is pressed. The system control unit 50 obtains (calculates) the x-coordinates x0 and x-1 of the left and right edges of the display range after changing the position or size of the display range by adding the obtained (calculated) amount of movement of the display range to the x-coordinate x0 of the left edge of the display range and the x-coordinate x1 of the right edge of the display range. Then, when the right image area is displayed, if the x-coordinate x0 of the left edge of the display range is smaller than coordinate r1, it is determined that the display range includes a non-image area. Furthermore, while the left image region is being displayed, if the x-coordinate x1 at the right edge of the display range is greater than the coordinate r2, it is determined that the display range includes a non-image region. In this way, the system control unit 50 determines in S607 whether or not a non-image region is included.

[0063] In S608, the system control unit 50 switches the image area to be displayed on the display unit 108. The system control unit 50 also provides a predetermined notification when changing the image area (position of the display range 801). In Embodiment 1, the notification is provided by displaying a predetermined image on the display unit 108 for a predetermined time. Figure 8C shows an example of a screen displayed on the display unit 108 as a predetermined image. After the processing in S608 is completed, the system control unit 50 proceeds to S604. However, the predetermined notification is not limited to displaying a predetermined image; for example, it may be a notification by voice or other means.

[0064] Figure 8D shows the state after the user has changed the position of the display range 801 from position 801a in Figure 8A. Here, the user has moved the display range 801 to position 801b. Furthermore, Figure 8E shows an image obtained by applying perspective projection transformation processing to the display range 801 of Figure 8D. When Figure 8E is displayed, if a user operation is performed to move the display range 801 to the left (position 803), the system control unit 50 determines that only a part of the display range 801 (804) includes the right image area 800R. If the position of the display range 801 is set to position 801c of the left image area 800L corresponding to position 803, and the entire display range 801 includes the left image area 800L, the system control unit 50 switches the image area to be displayed to the left image area 800L. In other words, if the part of the left image area 800L corresponding to the part of the right image area 800R included in the display range of position 803 is included in the display range of position 801c of the left image area 800L, and the entire display range of position 801c is included in the left image area 800L, the system control unit 50 switches the image area to be displayed to the left image area 800L. The system control unit 50 then sets the display range 801 to position 801c within the left image area 800L corresponding to position 803. Figure 8F shows position 801c of the display range 801 after the image area has been switched. Figure 8G shows an image obtained by applying perspective projection transformation processing to the display range 801 of Figure 8F. The display unit 108 displays the image of Figure 8E, then the screen of Figure 8C, and then the image of Figure 8G. Alternatively, the display range may be switched to position 801c in the left image area 800L after first displaying the image corresponding to position 803, or it may be switched to the display range of position 801c in the left image area 800L without first displaying the image corresponding to position 803.

[0065] In S609, the system control unit 50 determines whether a user operation (termination operation) has been performed to terminate the display process. The user instructs the system control unit 50 to terminate the display process using the directional keys 110 and the SET button 111, etc. If the system control unit 50 determines in S609 that the display should be terminated, it terminates the display process shown in Figure 6. If the system control unit 50 determines in S609 that the display process should not be terminated, it proceeds to S606.

[0066] As described above, Embodiment 1 allows users to easily view a wide area of ​​the image without processing the image. Suppose a user performs an operation to move the display range from position P1, where the entire display range includes image area A1, to position P2, where setting the display range only partially includes image area A1. In this case, if setting the display range to position P3 within image area A2 corresponding to position P2 would result in the entire display range including image area A2, then the display range will be automatically set to position P3. In this way, users can easily view a wide area of ​​the image.

[0067] Consider the case where the user manually moves the display range from position P1 to position P2. In this case, not only is it time-consuming, but unnecessary areas are also displayed. According to Embodiment 1, the position of the display range jumps (transitions instantaneously) from position P1 to position P3, so the user can seamlessly check a wide area.

[0068] Furthermore, VR images are not limited to still images; they may also be videos. Videos may be recorded or live-streamed. In addition, the display processing in Embodiment 1 may be performed on an electronic device other than the camera, such as a PC or tablet with playback capabilities.

[0069] <Embodiment 2> Embodiment 2 will be described below with reference to Figures 9 and 10. In Embodiment 2, it is predetermined whether or not to automatically switch between the VR display of the area imaged via the right-eye optical system and the VR display of the area imaged via the left-eye optical system. Figure 9 is a flowchart of the display process in Embodiment 2. The display process in Figure 9 is realized by the system control unit 50 loading the program recorded in the non-volatile memory 219 into the system memory 218 and executing it. The system control unit 50 starts the display process in Figure 9 in response to the user pressing the play button 114.

[0070] In S901, the system control unit 50 sets whether or not to automatically switch image areas (enable / disable automatic image area switching). The system control unit 50 displays a switching screen on the display unit 108, for example, as shown in Figure 10. The system control unit 50 sets one of several modes, which include at least a mode in which automatic switching is enabled and a mode in which automatic switching is disabled, in response to user operations such as the direction keys 110 and the SET button 111. The enable / disable status of automatic switching may be changed during the display process shown in Figure 9.

[0071] The processing from S902 to S907 is the same as the processing from S601 to S606 in Embodiment 1. If the system control unit 50 determines in S907 that the position or size of the display range has been changed, it proceeds to S908. If it determines in S907 that the position or size of the display range has not been changed, it proceeds to S911.

[0072] In S908, the system control unit 50 determines whether automatic switching is enabled or disabled. If the system control unit 50 determines that automatic switching is enabled, it proceeds to S909; otherwise, it proceeds to S905.

[0073] The processing from S909 to S911 is the same as the processing from S607 to S609 in Embodiment 1. In Embodiment 2, however, in order to enable a more seamless switching of image regions, it is not necessary to provide a predetermined notification in S910.

[0074] As described above, according to Embodiment 2, whether or not to automatically switch the image area is selected according to user operation. This allows the user to check the boundary between the image area and the non-image area according to their preference. For example, suppose that while Figure 8E is displayed, the user performs an operation to move the display range 801 to the left (position 803). In this case, if the mode to automatically switch the image area is set, the system control unit 50 sets the position of the display range 801 to position 801c of the left image area 800L corresponding to position 803, similar to Embodiment 1. If the mode to not automatically switch the image area is set, the system control unit 50 sets the position of the display range 801 to position 803. In other words, the display range 804 of position 803 is set.

[0075] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0076] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0077] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and each embodiment can be appropriately combined. It is also possible to combine them.

[0078] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0079] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) An acquisition means for acquiring an image having multiple image regions, including a first image region and a second image region, each captured through multiple optical systems, Control means that controls the display range, which is a part of the aforementioned image, to be displayed after applying geometric transformation processing, and changes the position of the display range within one of the image regions of a plurality of image regions in response to user operation. It has, If a user operation is performed to move from a first position where the entire display range is included in the first image area to a second position where the entire display range is not included in the first image area, and if the portion of the second image area corresponding to the portion of the first image area included in the display range at the second position is included in the display range at the third position of the second image area, and the entire display range at the third position is included in the second image area, then the control means changes the display range from the first position to the third position. An electronic device characterized by the following features. (Configuration 2) The aforementioned image region is a fisheye image region. The electronic device according to configuration 1, characterized by the features described above. (Composition 3) The aforementioned geometric transformation process is a perspective projection transformation process. The electronic device according to configuration 1 or 2, characterized by the above. (Composition 4) The control means controls the display range to make a predetermined notification when changing the position from the second position to the third position. An electronic device according to any one of configurations 1 to 3, characterized by the features described herein. (Composition 5) The control means controls the display range to make a predetermined notification when changing the position from the first position to the third position. An electronic device according to any one of configurations 1 to 3, characterized by the features described herein. (Composition 6) The control means controls the system to provide the predetermined notification by displaying a predetermined image. The electronic device according to configuration 4 or 5, characterized by the features described herein. (Composition 7) The plurality of optical systems include a first optical system for imaging the first image region and a second optical system for imaging the second image region. The first optical system has a predetermined parallax relative to the second optical system. An electronic device according to any one of configurations 1 to 6, characterized by the features described herein. (Composition 8) A plurality of modes including a first mode in which the display range is set to the second position when a user operation is performed to move the position of the display range from the first position to the second position, and a second mode in which the display range is set to the third position when the user operation is performed. It further has a setting means for setting one of the modes. An electronic device according to any one of configurations 1 to 7, characterized by the above. (method) An acquisition step of acquiring an image having multiple image regions, including a first image region and a second image region, each captured through multiple optical systems, A control step which controls the display range, which is a part of the aforementioned image, to be displayed after applying a geometric transformation process, and changes the position of the display range within one of the image regions of a plurality of image regions in response to user operation. It has, If a user operation is performed to move from a first position where the entire display range is included in the first image area to a second position where the entire display range is not included in the first image area, and if the portion of the second image area corresponding to the portion of the first image area included in the display range at the second position is included in the display range at the third position of the second image area, and the entire display range at the third position is included in the second image area, then in the control step, the display range is changed from the display range at the first position to the display range at the third position. A method for controlling electronic equipment characterized by the following features. (program) A program for causing a computer to function as one of the electronic devices described in any of configurations 1 to 8. [Explanation of symbols]

[0080] 50: System control unit 211: Imaging unit

Claims

1. An acquisition means for acquiring an image having multiple image regions, including a first image region and a second image region, each captured through multiple optical systems, Control means that controls the display range, which is a part of the aforementioned image, to be displayed after applying geometric transformation processing, and changes the position of the display range within one of the image regions of a plurality of image regions in response to user operation. It has, If a user operation is performed to move from a first position where the entire display range is included in the first image area to a second position where the entire display range is not included in the first image area, and if the portion of the second image area corresponding to the portion of the first image area included in the display range at the second position is included in the display range at the third position of the second image area, and the entire display range at the third position is included in the second image area, then the control means changes the display range from the first position to the third position. An electronic device characterized by the following features.

2. The aforementioned image region is a fisheye image region. The electronic device according to feature 1.

3. The aforementioned geometric transformation process is a perspective projection transformation process. The electronic device according to feature 1.

4. The control means controls the display range to make a predetermined notification when changing the position from the second position to the third position. The electronic device according to feature 1.

5. The control means controls the display range to make a predetermined notification when changing the position from the first position to the third position. The electronic device according to feature 1.

6. The control means controls the system to provide the predetermined notification by displaying a predetermined image. The electronic device according to feature 4.

7. The plurality of optical systems include a first optical system for imaging the first image region and a second optical system for imaging the second image region. The first optical system has a predetermined parallax with respect to the second optical system. The electronic device according to feature 1.

8. The system further includes setting means for setting one of a plurality of modes, including a first mode in which the display range is set to the second position when a user operation is performed to move the position of the display range from the first position to the second position, and a second mode in which the display range is set to the third position when the user operation is performed. The electronic device according to feature 1.

9. An acquisition step of acquiring an image having multiple image regions, including a first image region and a second image region, each captured through multiple optical systems, A control step which controls the display range, which is a part of the aforementioned image, to be displayed after applying a geometric transformation process, and changes the position of the display range within one of the image regions of a plurality of image regions in response to user operation. It has, If a user operation is performed to move from a first position where the entire display range is included in the first image area to a second position where the entire display range is not included in the first image area, and if the portion of the second image area corresponding to the portion of the first image area included in the display range at the second position is included in the display range at the third position of the second image area, and the entire display range at the third position is included in the second image area, then in the control step, the display range is changed from the display range at the first position to the display range at the third position. A method for controlling electronic equipment characterized by the following features.

10. A program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 8.

Images