Electronic device, method for controlling electronic device, and storage medium

Abstract

The present invention provides a technique capable of suitably switching execution / non-execution of geometric conversion processing (for example, perspective projection conversion processing) with a small number of user operations.SOLUTION: An electronic apparatus according to an embodiment of the present invention includes an image acquisition unit configured to acquire an image, an information acquisition unit configured to acquire information on a display magnification when a partial region of the image is displayed in an enlarged manner, and a conversion unit configured to, in a case where the image acquired by the image acquisition unit is a distorted image of a subject, not perform geometric conversion processing on the partial region of the image when the display magnification is smaller than a threshold value, and perform the geometric conversion processing on the partial region of the image when the display magnification is larger than the threshold value.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium. [Background technology]

[0002] A technology is known that uses two optical systems facing the same direction to acquire an image having two image areas with parallax and then displays the two image areas in a stereoscopic manner. If a circular fisheye lens is used as each optical system, it is possible to obtain an image area that displays a wide range of more than 180 degrees up, down, left, and right (a hemisphere, 90 degrees in all directions from the center of the image). In recent years, virtual reality (VR) content created based on images captured by imaging devices such as twin-lens cameras equipped with such optical systems has become widespread.

[0003] Cameras and smartphones are commonly used to check images captured using imaging devices such as twin-lens cameras, both during and after capture. The image display formats on cameras and smartphones include circular fisheye and perspective projection. The circular fisheye format displays the entire captured circular fisheye image on the display, while the perspective projection format crops a portion of the circular fisheye image and displays it on the display after performing perspective projection conversion processing.

[0004] In the circular fisheye format, the entire circular fisheye image is displayed, allowing a wide range to be viewed from above, but the closer to the edge of the circular fisheye image, the greater the distortion of the subject.In addition, in the perspective projection format, the subject is displayed at a regular distance, so there is no distortion of the subject, but because only a portion of the circular fisheye image is displayed, it is not possible to view a wide range from above.

[0005] Patent Document 1 discloses a technique for switching the display format based on a user operation. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-12881 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, with the technology disclosed in Patent Document 1, when frequently switching between bird's-eye view and detailed view, it is necessary to frequently perform an operation to switch the display format (an operation to switch between performing / not performing geometric transformation processing such as perspective projection transformation processing).

[0008] An object of the present invention is to provide a technique that enables suitable switching between execution and non-execution of geometric transformation processing (for example, perspective projection transformation processing) with minimal user operations. [Means for solving the problem]

[0009] The electronic device of the present invention is characterized by having an image acquisition means for acquiring an image, an information acquisition means for acquiring information on the display magnification when a portion of the image is enlarged and displayed, and a conversion means for, when the image acquired by the image acquisition means is a distorted image of a subject, not performing a geometric transformation process on the portion of the image if the display magnification is smaller than a threshold value, and performing the geometric transformation process on the portion of the image if the display magnification is greater than the threshold value. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a technique that can suitably switch between execution and non-execution of geometric transformation processing (for example, perspective projection transformation processing) with a small number of user operations. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic diagram showing the overall configuration of a system according to a first embodiment. [Figure 2]FIG. 1 is an external view of a camera according to a first embodiment. [Figure 3] FIG. 1 is a block diagram showing the configuration of a camera according to a first embodiment. [Figure 4] FIG. 2 is a schematic diagram illustrating the configuration of a lens unit according to the first embodiment. [Figure 5] 10 is a flowchart showing a playback mode process in the first embodiment. [Figure 6] 10 is a flowchart showing a display format determination process in the first embodiment. [Figure 7] 10 is a flowchart showing an enlarged display process in the first embodiment. [Figure 8] 1 is an image according to the first embodiment. [Figure 9] FIG. 3 is a schematic diagram showing a display magnification setting screen in the first embodiment. [Figure 10] 3 is a schematic diagram showing an enlarged area and an enlarged display screen in the first embodiment. FIG. [Figure 11] 10 is a flowchart showing a display format determination process in the second embodiment. [Figure 12] 10 is a schematic diagram showing an enlarged area and an enlarged display screen in the second embodiment. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0012] (Embodiment 1) Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

[0013] 1(a) and 1(b) are schematic diagrams showing an example of the overall configuration of a system according to embodiment 1. The system according to embodiment 1 includes a digital camera (camera) 100, which is an example of an electronic device, and a personal computer (PC) 102. A lens unit 103 is attached (connected) to the camera 100.

[0014] Although details of lens unit 103 will be described later, by attaching lens unit 103, camera 100 can simultaneously capture two images (still images or video) having a predetermined parallax. PC 102 is an information processing device that handles images captured by an imaging device such as camera 100.

[0015] Fig. 1(a) shows a state in which a camera 100 and a PC 102 are connected to each other so that they can communicate with each other via a wireless or wired connection, etc. Fig. 1(b) shows a configuration in which images captured by the camera 100 and the like are input to the PC 102 on a file basis via an external storage device.

[0016] The external storage device may or may not be connected to both the camera 100 and the PC 102. For example, an external storage device may be connected to the camera 100, and files of images captured by the camera 100 may be stored in the external storage device. The external storage device may then be removed from the camera 100 and connected to the PC 102, and the files stored in the external storage device may be imported by the PC 102.

[0017] 2(a) and 2(b) are external views showing an example of the appearance of the camera 100. Fig. 2(a) is a perspective view of the camera 100 seen from the front side, and Fig. 2(b) is a perspective view of the camera 100 seen from the back side.

[0018] The camera 100 has, on its top surface, a shutter button 201, a power switch 202, a mode selector switch 203, a main electronic dial 204, a sub electronic dial 205, a video button 206, and an outside-finder display 207. The shutter button 201 is an operating member for issuing a shooting preparation instruction or a shooting instruction. The power switch 202 is used to turn on and off the power of the camera 100. The mode selector switch 203 is an operating member for switching between on and off various modes. The main electronic dial 204 is a rotary operating member for changing setting values ​​such as shutter speed and aperture. The sub electronic dial 205 is a rotary operating member for moving the selection frame (cursor) and advancing images. The video button 206 is an operating member for issuing commands to start and stop video shooting (recording). The outside viewfinder display unit 207 displays various setting values ​​such as shutter speed and aperture.

[0019] The camera 100 has a display unit 208, a touch panel 209, directional keys 210, a SET button 211, an AE lock button 212, a magnify button 213, a playback button 214, and a menu button 215 on its rear surface. It also has an eyepiece 216, an eyepiece detection unit 218, a touch bar 219, and a display mode switching button 225. The display unit 208 displays images and various information. The touch panel 209 is an operation member that detects touch operations on the display surface (touch operation surface) of the display unit 208. The directional keys 210 are an operation member that includes keys that can be pressed up, down, left, and right (four-way keys). The directional keys 210 can perform processing according to the position where the directional keys 210 are pressed. The SET button 211 is an operation member that is mainly pressed to confirm a selection item. The AE lock button 212 is an operation member that is pressed to fix the exposure state in a shooting standby state. The enlargement button 213 is an operating member for switching the enlargement mode on and off in the live view display (LV display) in the shooting mode. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 204. The enlargement button 213 is also used to enlarge the playback image or increase the magnification in the playback mode. The playback button 214 is an operating member for switching between the shooting mode and the playback mode. Pressing the playback button 214 in the shooting mode switches to the playback mode, and the latest image recorded on the recording medium 227 (described later) can be displayed on the display unit 208.

[0020] The menu button 215 is an operation member that is pressed to display a menu screen on the display unit 208 that allows various settings to be made. The user can intuitively make various settings using the menu screen displayed on the display unit 208, the direction keys 210, and the SET button 211. The eyepiece unit 216 is a portion that is used to place the eyepiece 216 and look into the eyepiece finder (peek-in type finder) 117. The user can view an image displayed on an EVF 217 (Electronic View Finder) (described later) inside the camera 100 through the eyepiece 216. The eyepiece detection unit 218 is a sensor that detects whether the user has placed the eyepiece 216 (eyepiece finder 217) close to the eyepiece 216.

[0021] The touch bar 219 is a line-shaped touch operation member (line touch sensor) capable of receiving a touch operation. The touch bar 219 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip unit 220 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 201 can be pressed with the index finger of the right hand. That is, the touch bar 219 can be operated while the user places their eye on the eyepiece finder 217, looks through the eyepiece unit 216, and is in a position (shooting posture) where the user is ready to press the shutter button 201 at any time. The touch bar 219 can receive tap operations (operations in which the user touches and then releases the touched position without moving it within a predetermined period of time), slide operations to the left or right (operations in which the user touches and then moves the touched position while still touching), and the like. The touch bar 219 is an operation member different from the touch panel 209, and does not have a display function. The touch bar 219 functions as, for example, a multi-function bar (M-Fn bar) to which various functions can be assigned.

[0022] The display mode switching button 225 is an operation member for switching the display mode. When the display mode switching button 225 is pressed, the display mode is switched, and the live view image displayed on the display unit 208 and the OSD image (for example, history) superimposed on the live view image are displayed. The user operates the display mode switching button 225 to switch the display mode so that the display required for the user's photography is displayed.

[0023] The camera 100 also includes a grip section 220, a thumb rest section 221, a terminal cover 222, a lid 223, a communication terminal 224, and the like. The grip section 220 is a holding section formed in a shape that allows the user to easily hold the camera 100 with their right hand when holding the camera 100. The shutter button 201 and main electronic dial 204 are positioned so that they can be operated with the index finger of the right hand when the camera 100 is held by gripping the grip section 220 with the little finger, ring finger, and middle finger of the right hand. Similarly, the sub electronic dial 205 and touch bar 219 are positioned so that they can be operated with the thumb of the right hand. The thumb rest section 221 (thumb standby position) is a grip section provided on the back side of the camera 100, in a position where it is easy to place the thumb of the right hand that is holding the grip section 220 when none of the operation members are being operated. The thumb rest section 221 is made of a rubber member or the like to enhance holding strength (grip feeling). Terminal cover 222 protects connectors such as a connection cable that connects camera 100 to an external device. Lid 223 protects recording medium 327 and the slot by closing the slot for storing recording medium 327, which will be described later. Communication terminal 224 is a terminal for communicating with a lens unit (such as lens unit 300 or lens unit 103, which will be described later) that is detachable from camera 100.

[0024] Figure 3 is a block diagram showing an example of the configuration of camera 100. Note that the same components as those in Figure 2 are given the same reference numerals, and descriptions of those components will be omitted as appropriate. In Figure 3, a lens unit 300 is attached to camera 100.

[0025] First, the lens unit 300 will be described. The lens unit 300 is a type of interchangeable lens unit (interchangeable lens) that can be attached to and detached from the camera 100. The lens unit 300 is a single lens unit (single lens) and is an example of a normal lens unit. The lens unit 300 has an aperture 301, a lens 302, an aperture drive circuit 303, an AF (autofocus) drive circuit 304, a lens system control circuit 305, a communication terminal 306, and the like.

[0026] The aperture 301 is configured to have an adjustable aperture diameter. The lens 302 is composed of multiple lenses. The aperture drive circuit 303 adjusts the amount of light by controlling the aperture diameter of the aperture 301. The AF drive circuit 304 drives the lens 302 to adjust the focus. The lens system control circuit 305 controls the aperture drive circuit 303, the AF drive circuit 304, and the like based on instructions from the system control unit 30, which will be described later. The lens system control circuit 305 controls the aperture 301 via the aperture drive circuit 303, and adjusts the focus by changing the position of the lens 302 via the AF drive circuit 304. The lens system control circuit 305 can communicate with the camera 100. Specifically, communication is performed via a communication terminal 306 of the lens unit 300 and a communication terminal 224 of the camera 100. The communication terminal 306 is a terminal through which the lens unit 300 communicates with the camera 100. Furthermore, the system control unit 30 identifies the types of the lens unit 300 and the lens unit 103 attached to the camera 100 via the communication terminal 224 and the communication terminal 306 .

[0027] Next, a description will be given of the camera 100. The camera 100 has a shutter 310, an imaging unit 311, an A / D converter 312, a memory control unit 313, an image processing unit 314, a memory 315, a D / A converter 316, a metadata generation and analysis unit 332, an EVF 317, a display unit 208, and a system control unit 30.

[0028] The shutter 310 is a focal plane shutter that can freely control the exposure time of the imaging unit 311 based on instructions from the system control unit 30. The imaging unit 311 is an imaging element (image sensor) that can acquire an image and is configured with a CCD or CMOS element that converts an optical image into an electrical signal. The image capturing unit 311 may have an image plane phase difference sensor that outputs defocus amount information to the system control unit 30. The A / D converter 312 converts the analog signal output from the image capturing unit 311 into a digital signal. The image processing unit 314 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on the data from the A / D converter 312 or the data from the memory control unit 313. The image processing unit 314 also performs predetermined arithmetic processing using the captured image data, and the system control unit 30 performs exposure control and distance measurement control based on the obtained arithmetic results. This processing results in TTL (through-the-lens) AF processing, AE (auto exposure) processing, EF (flash pre-flash) processing, etc. Furthermore, the image processing unit 314 performs predetermined arithmetic processing using the captured image data, and the system control unit 30 performs TTL AWB (auto white balance) processing based on the obtained arithmetic results.

[0029] Image data from the A / D converter 312 is written to memory 315 via image processing unit 314 and memory control unit 313. Alternatively, image data from the A / D converter 312 is written to memory 315 via memory control unit 313 without going through image processing unit 314. Memory 315 stores image data obtained by the imaging unit 311 and converted into digital data by the A / D converter 312, as well as image data to be displayed on the display unit 208 and EVF 317. Memory 315 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. Memory 315 also serves as a memory for displaying images (video memory).

[0030] The D / A converter 316 converts the display image data stored in the memory 315 into an analog signal and supplies it to the display unit 208 or the EVF 217. Therefore, the display image data written to the memory 315 is displayed on the display unit 208 or the EVF 317 via the D / A converter 316. The display unit 208 or the EVF 317 performs display in accordance with the analog signal from the D / A converter 316. The display unit 208 or the EVF 317 is, for example, an LCD or organic EL display. A digital signal that has been A / D converted by the A / D converter 312 and stored in the memory 315 is converted into an analog signal by the D / A converter 316 and then sequentially transferred to and displayed on the display unit 208 or the EVF 317, thereby performing live view display.

[0031] The system control unit 30 is a control unit comprising at least one processor and / or at least one circuit. That is, the system control unit 30 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 30 controls the entire camera 100. The system control unit 50 executes programs recorded in the nonvolatile memory 319 to realize each process in the flowcharts described below. The system control unit 30 also performs display control by controlling the memory 315, D / A converter 316, display unit 208, EVF 317, etc.

[0032] The camera 100 also includes a system memory 318 , a nonvolatile memory 319 , a system timer 320 , a communication unit 321 , and an attitude detection unit 322 .

[0033] A RAM, for example, is used as the system memory 318. Constants and variables for the operation of the system control unit 30, programs read from the nonvolatile memory 319, and the like are loaded into the system memory 318. The nonvolatile memory 319 is an electrically erasable and recordable memory. An EEPROM, for example, is used as the nonvolatile memory 319. Constants and programs for the operation of the system control unit 30 are recorded in the nonvolatile memory 319. The programs here refer to programs for executing the flowcharts described below. The system timer 320 is a timing unit that measures the time used for various controls and the time of a built-in clock. The communication unit 321 transmits and receives video signals and audio signals to and from external devices connected wirelessly or via a wired cable. The communication unit 321 is used to communicate via a wireless LAN (Local Area Network). The camera 100 can be connected to the Internet using a Bluetooth (registered trademark) or a wired LAN. The communication unit 321 can communicate with external devices using Bluetooth (registered trademark), Bluetooth Low Energy, or the like. This allows the communication unit 321 to transmit images (including live images) captured by the imaging unit 311 and images recorded on the recording medium 327, and to receive images and various other information from external devices. The orientation detection unit 322 detects the orientation of the camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 322, it is possible to determine whether an image captured by the imaging unit 311 was captured with the camera 100 held horizontally or vertically. The system control unit 30 can add orientation information corresponding to the orientation detected by the orientation detection unit 322 to the image file of the image captured by the imaging unit 311, or rotate the image according to the detected orientation. The orientation detection unit 322 can be, for example, an acceleration sensor or a gyro sensor. The orientation detection unit 322 can also be used to detect the movement of the camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

[0034] The eyepiece detection unit 218 can detect the approach of an object to the eyepiece unit 216 (eyepiece finder 217). For example, an infrared proximity sensor can be used as the eyepiece detection unit 218. When an object approaches, infrared light is emitted from a light-emitting unit of the eyepiece detection unit 218, reflected by the object, and received by a light-receiving unit of the infrared proximity sensor. The distance from the eyepiece unit 216 to the object can be determined based on the amount of received infrared light. In this way, the eyepiece detection unit 218 performs eyepiece detection, which detects the proximity of an object to the eyepiece unit 216. The eyepiece detection unit 218 is an eyepiece detection sensor that detects the approach (eye-approach) and departure (eye-away) of an eye (object) from the eyepiece unit 216. When an object is detected approaching within a predetermined distance from the eyepiece unit 216 from a non-eyepiece state (non-approach state), it detects that the eye has been placed in proximity. On the other hand, when an object whose proximity has been detected moves away from the eye-closed state (approaching state) by a distance greater than a predetermined distance, it is detected that the eye has been moved away. The threshold for detecting eye-closedness and the threshold for detecting eye-away may be different, for example, by providing hysteresis. Furthermore, after eye-closedness is detected, the eye-closed state is maintained until eye-away is detected. After eye-away is detected, the non-eye-closed state is maintained until eye-closedness is detected. The system control unit 30 switches the display unit 208 and the EVF 317 between display (display state) and non-display (non-display state) depending on the state detected by the eye-closedness detection unit 218. Specifically, when at least in a shooting standby state and the display destination switching setting is automatic switching, the display unit 208 is set as the display destination and the display is turned on, and the EVF 317 is hidden, when the eye is not placed near the object. Furthermore, when the eye is placed near the object, the display unit 208 is set as the display destination and the display is turned on, and the EVF 317 is hidden. The eye proximity detector 218 is not limited to an infrared proximity sensor, and other sensors may be used as the eye proximity detector 218 as long as they can detect a state that can be considered as eye proximity.

[0035] The camera 100 also includes an outside-viewfinder display unit 207, an outside-viewfinder display drive circuit 323, a power supply control unit 324, a power supply unit 325, a recording medium I / F 326, an operation unit 328, and the like.

[0036] The viewfinder outside display unit 207 is driven by the viewfinder outside display drive circuit 323, and displays various settings of the camera 100 such as shutter speed and aperture.

[0037] The power supply control unit 324 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, etc. The power supply control unit 324 detects whether a battery is installed, the type of battery, and the remaining battery capacity. The power supply control unit 324 controls the DC-DC converter based on the power supply or battery detection results and instructions from the system control unit 30, and supplies the required voltage to each unit, including the recording medium 327, for the required period of time.

[0038] The power supply unit 325 is a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery or a Li-ion battery, or an AC adapter.

[0039] The recording medium I / F 326 is an interface for connecting the internal bus of the camera 100 and a recording medium 327 .

[0040] The recording medium 327 is a memory card or the like for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like. The recording medium 327 may be detachable from the camera 100 or may be built into the camera 100 .

[0041] When recording image data on the recording medium 327, the metadata generation and analysis unit 332 generates Exif (Exchangeable Image Format) data to be attached to the image data based on the information at the time of shooting. Generate various metadata such as file format standards. When image data recorded on the recording medium 327 is read, the analysis unit 332 analyzes the metadata attached to the image data. Examples of metadata include setting information at the time of shooting, image data information related to the image data, and feature information of the subject included in the image data. When recording moving image data, the metadata generation and analysis unit 332 can also generate and attach metadata for each frame.

[0042] The operation unit 328 is an input unit that accepts operations from the user (user operations) and is used to input various instructions to the system control unit 30. The operation unit 328 includes the shutter button 201, the power switch 202, the mode switching switch 203, the touch panel 209, and other operation units 329. The other operation units 329 include the main electronic dial 204, the sub electronic dial 205, the video button 206, the direction keys 210, the SET button 211, the AE lock button 212, and the like. The other operation units 329 further include the enlargement button 213, the playback button 214, the menu button 215, the touch bar 219, the display mode switching button 225, and the like.

[0043] The shutter button 201 has a first shutter switch 330 and a second shutter switch 331. The first shutter switch 330 is turned on when the shutter button 201 is pressed halfway (a shooting preparation instruction) and outputs a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 30 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 331 is turned on when the shutter button 201 is pressed fully (a shooting instruction) and outputs a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 30 starts a series of shooting processing operations, from reading out a signal from the imaging unit 311 to generating an image file containing the captured image and writing it to the recording medium 327.

[0044] The mode selector switch 203 switches the operation mode of the system control unit 30 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for different capture scenes. The user can directly switch to one of the above-mentioned capture modes using the mode selector switch 203. Alternatively, the user can first switch to a list screen of capture modes using the mode selector switch 203, and then selectively switch to one of the displayed modes using the operation unit 228. Similarly, the video capture mode may also include multiple modes.

[0045] The touch panel 109 is a device for inputting various inputs to the display surface of the display unit 108 (the operation surface of the touch panel 109). It is a touch sensor that detects a type of touch operation.

[0046] The touch panel 109 and the display unit 108 can be configured as an integrated unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that its light transmittance does not interfere with the display of the display unit 108. Then, by associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured that makes it appear as if the user is directly operating the screen displayed on the display unit 108. The touch panel 109 can use any of a variety of methods, such as a resistive film method, a capacitive method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, or an optical sensor method. Depending on the method, there are methods that detect a touch by contact with the touch panel 109, and methods that detect a touch by the approach of a finger or a pen to the touch panel 109, but either method may be used.

[0047] The system control unit 30 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 touches the touch panel 109 again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched with a finger or a pen (hereinafter referred to as Touch-On). The touch panel 109 is moved while being touched by a finger or a pen (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 109 is released from the touch panel 109, that is, the end of the touch (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 109 (hereinafter referred to as Touch-Off).

[0048] When a touch down is detected, a touch on is also detected at the same time. After a touch down, a touch on is usually continued to be detected unless a touch up is detected. If a touch move is detected, a touch on is also detected at the same time. Even if a touch on is detected, a touch move is not detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, a touch off occurs.

[0049] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 109, are notified to the system control unit 30 via the internal bus. The system control unit 30 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. Regarding touch-move, the movement direction of the finger or pen moving on the touch panel 109 can also be determined for each vertical and horizontal component on the touch panel 109 based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 109 as if flicking. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is then detected, it is determined that a flick has been performed (it can be determined that a flick occurred following a slide operation). Furthermore, when multiple points (for example, two points) are touched together (multi-touch), the touch operation of bringing the touched positions closer together is called pinch in, and when the touch operation of moving the touched positions farther apart is called pinch out. Pinch out and pinch in are collectively called pinch operations (or simply pinch).

[0050] Fig. 4 is a schematic diagram showing an example of the configuration of lens unit 103. Fig. 4 shows a state in which lens unit 103 is attached to camera 100. Note that, of the camera 100 shown in Fig. 4, the same components as those explained in Figs. 1 to 3 are given the same reference numerals as in Figs. 1 to 3, and explanations of those components will be omitted as appropriate. Components relating to the right eye have an R suffix added to the reference numeral, components relating to the left eye have an L suffix added to the reference numeral, and components relating to both the right and left eyes have neither an R nor an L suffix added to the reference numeral.

[0051] Lens unit 103 is a type of interchangeable lens unit that can be attached to and detached from camera 100. Lens unit 103 is a twin lens unit that can capture right and left images with parallax. Lens unit 103 has two optical systems, each of which can capture images over a wide viewing angle range of approximately 180 degrees. Specifically, each of the two optical systems of lens unit 103 can capture images of a subject over a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle). In other words, each of the two optical systems can capture images over the range of the forward hemisphere.

[0052] Lens unit 103 has optical system 401R having a plurality of lenses and reflecting mirrors, optical system 401L having a plurality of lenses and reflecting mirrors, and lens system control circuit 403. Optical system 401R has lens 402R arranged on the subject side, and optical system 401L has lens 402L arranged on the subject side. Lenses 402R and 402L face in the same direction, and their optical axes are approximately parallel.

[0053] The lens unit 300 is a VR (Virtual Reality) device that allows two-eye stereoscopic vision. The lens unit 103 is a twin lens (VR180 lens) for obtaining a VR180 image, which is one of the image formats for VR (Virtual Reality) cameras. In the first embodiment, the lens unit 300 has a fisheye lens capable of capturing a range of approximately 180 degrees in each of the optical systems 401R and 401L. The range that can be captured by the lenses of the optical systems 401R and 401L may be approximately 160 degrees, which is narrower than the 180-degree range. The lens unit 103 can form a right image formed via the optical system 401R and a left image formed via the optical system 401L on one or two image sensors of the camera to which the lens unit 103 is attached. In the camera 100, the right image and the left image are formed on one image sensor (image sensor), and a single image (twin image) is generated in which the right image area (area of ​​the right image) and the left image area (area of ​​the left image) are arranged side by side.

[0054] The lens unit 103 is attached to the camera 100 via the lens mount 404 and the camera mount 405 of the camera 100. In this way, the system control unit 30 of the camera 100 and the lens system control circuit 403 of the lens unit 103 are electrically connected via the communication terminal 125 of the camera 100 and the communication terminal 306 of the lens unit 103.

[0055] In FIG. 4, a right image formed via the optical system 401R and a left image formed via the optical system 401L are formed side by side on the imaging unit 311 of the camera 100. That is, two optical images (subject images) are formed in two areas of a single imaging element (imaging sensor) by the optical systems 401R and 401L. The imaging unit 311 converts the formed optical images (optical signals) into analog electrical signals. By using the lens unit 103 in this manner, two image areas with parallax can be simultaneously acquired (as a set) from two locations (optical systems), the optical systems 401R and 401L. By dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a range of approximately 180 degrees. That is, the user can view a VR180 image in stereo.

[0056] Here, a VR image is an image that can be displayed in VR, as described later. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than the display range that can be displayed at one time on a display unit. VR images are not limited to still images, but also include videos and live images (images acquired from a camera in almost real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and 360 degrees vertically. VR images also include images with a wider angle of view than the angle of view that can be captured by a normal camera, or an image range that can be displayed at one time on a display unit, even if the field of view is less than 360 degrees horizontally or vertically. An image captured by camera 100 using lens unit 103 is a type of VR image. VR images can be displayed in VR by, for example, setting the display mode of a display device (a display device that can display VR images) to "VR view." By displaying a VR image with a 360-degree angle of view and changing the orientation of the display device left and right (horizontal rotation direction), the user can view seamless, omnidirectional images left and right.

[0057] VR display (VR view) is a display method (display mode) that displays a VR image with a field of view that corresponds to the orientation of the display device. VR display includes "single-eye VR display," which displays a single image by mapping the VR image onto a virtual sphere (distortion correction). Another type of VR display includes "two-eye VR view," which displays a VR image for the left eye and a VR image for the right eye side by side by mapping them onto a virtual sphere. "Two-eye VR display" uses a VR image for the left eye and a VR image for the right eye that have parallax between them, enabling stereoscopic viewing of the VR images. Regardless of the VR display, when a user wears a display device such as an HMD, the image displayed corresponds to the user's facial orientation. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point in time. The area displayed at this time is called the magic window. If the orientation of the display device is flipped from this state (for example, the display surface is changed from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered at 180 degrees left and right (the opposite direction, for example, south) and 90 degrees up and down. In other words, when the user is wearing the HMD and turns their face from north to south (i.e., turns around), the image displayed on the HMD also changes from a north image to a south image. Note that the VR image captured using lens unit 103 is an image (180-degree image) capturing a range of approximately 180 degrees in front, and no image exists in a range of approximately 180 degrees behind. If such an image is VR displayed and the orientation of the display device is changed to the side where no image exists, a blank area is displayed.

[0058] By displaying VR images in this way, the user can visually experience a sense of immersion as if they were inside the VR image (in the VR space). Note that the method of displaying VR images is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (in the "VR view" display mode), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0059] As mentioned above, the magic window is the part of the field of view of a VR image that is displayed when the user looks in a specific direction (for example, the front direction). By displaying this magic window during shooting, the user can understand the field of view that will be displayed during playback. Furthermore, when playing back on a browser or head-mounted display (HMD), the range that the viewer will see first can be visually confirmed during shooting, so the user can easily determine the desired composition and the most suitable view. This allows you to capture subjects you want to show off more effectively.

[0060] Furthermore, by displaying the right image area and the left image area side by side, the user can understand the difference between the right image area and the left image area, and whether or not the image capture of the right image area and the left image area is being performed without any problems. Furthermore, by displaying the magic window of the right image area and the magic window of the left image area, the user can understand the difference between the image seen by the right eye and the image seen by the left eye in the VR display. Note that the position of the magic window is not particularly limited, and the magic window (the portion displayed when the user looks in a specified direction) may be changeable. Also, it is not necessarily required that the magic window be displayed at all times.

[0061] Furthermore, the method for determining the magic window is not particularly limited. For example, a rectangular area showing a part of the image after perspective projection transformation processing is predetermined as the area (angle of view) that is first displayed in VR display. Then, by applying processing such as an inverse transformation of the perspective projection transformation or an inverse transformation of the equirectangular transformation to this rectangular area, the area of ​​the magic window that is superimposed on the live view image before the perspective projection transformation processing is determined.

[0062] Here, a case where a VR image is displayed and confirmed on an image playback device (display) or the like will be described. When enlarging and displaying an image on a display, a method is known in which a partial area of ​​the entire image is displayed as the display range, and the display range is moved by operating an operating member or a touch panel. For example, when an operating member is pressed, the display range is moved by a predetermined movement amount, and the display range can be changed arbitrarily.

[0063] When enlarging the display, you determine the center of enlargement at a low display magnification, and then gradually increase the display magnification while checking the display. This allows you to check specific areas in detail. If you want to see a range different from the currently enlarged range, you can first lower the display magnification, move the enlarged area in a bird's-eye view, and then increase the display magnification again.

[0064] VR images can be displayed on a display in several ways, including displaying the captured image as is and displaying the captured image after geometric transformation. Displaying the captured image as is includes a circular fisheye image (circular fisheye format). Displaying the captured image after geometric transformation includes a perspective projection format, which displays the circular fisheye image after perspective projection transformation. A circular fisheye image is an image in which the subject is distorted, while a perspective projection format results in an image with less distortion than a circular fisheye image. To enlarge a VR image, the display magnification is set at a low magnification, as with a normal image, and the enlarged area (a portion of the VR image) is then gradually increased. However, the circular fisheye format, which allows a wide-area bird's-eye view of the image, is not suitable for viewing the image in detail because the subject's distortion increases toward the edge of the circular fisheye image. On the other hand, the perspective projection format displays a cropped portion of the circular fisheye image, making it unsuitable for viewing a wide area from a bird's-eye view.

[0065] Fig. 5 is a flowchart illustrating a sequence of playback mode processing. The playback mode processing of Fig. 5 is realized by system control unit 30 loading a program recorded in non-volatile memory 319 into system memory 318 and executing it. The playback mode processing of Fig. 5 is started, for example, in response to a user pressing playback button 214. The playback mode processing of Fig. 5 ends when a user operation is performed to switch from playback mode to another mode, or when a user operation is performed to power off camera 100.

[0066] In S501, the system control unit 30 reads out an image stored in the recording medium 327 and displays it on the display unit 208. An example of an image displayed on the display unit 208 is shown in FIG. An image 800 like this is displayed. In the first embodiment, an image captured by the camera 100 with the lens unit 103 (twin lens) attached is a single image in which the subject is distorted and two circular fisheye image areas are arranged side by side, as shown in image 800.

[0067] In S502, the system control unit 30 determines whether or not the enlarge button 213 has been pressed. The system control unit 30 waits for the enlarge button 213 to be pressed, and if it determines that the enlarge button 213 has been pressed, the process proceeds to S503.

[0068] In S503, the system control unit 30 acquires information about the display magnification. The system control unit 30 can display a display magnification setting screen as shown in FIG. 9 on the display unit 208. The user can set (specify) the display magnification using the setting screen. In S503, the system control unit 30 acquires information about the display magnification specified by the user. Note that the method for acquiring the display magnification information is not limited to this; for example, the system control unit 30 may automatically determine the display magnification based on the size of the image read out in S501.

[0069] In S504, the system control unit 30 determines whether the image read in S501 was captured using a twin lens. If the system control unit 30 determines that the image read in S501 was captured using a twin lens, the process proceeds to S507; otherwise, the process proceeds to S505.

[0070] In S505, the system control unit 30 determines the enlargement area based on the user's operation (instruction).

[0071] In S506, the system control unit 30 generates an enlarged image.

[0072] In S507, the system control unit 30 performs a display format determination process, which determines whether to perform enlarged display in a circular fisheye format or a perspective projection format, depending on the display magnification determined in S503.

[0073] The display format determination process of S507 will now be described with reference to Fig. 6. Fig. 6 is a flowchart illustrating a series of sequences relating to the display format determination process.

[0074] In S601, the system control unit 30 determines whether the display magnification determined in S503 is equal to or greater than a threshold value. If the system control unit 30 determines that the display magnification is equal to or greater than the threshold value, the process proceeds to S602; otherwise, the process proceeds to S603.

[0075] In S602, the system control unit 30 determines to enlarge and display the image read out in S501 (image captured using twin lenses) on the display unit 208 in perspective projection format.

[0076] In S603, the system control unit 30 determines to enlarge and display the image read out in S501 (image captured using a double lens) on the display unit 208 in a circular fisheye format.

[0077] The threshold value of the display magnification described here may be a value arbitrarily set by the user, or may be a value predetermined by the manufacturer or the like. The threshold value may, for example, be set to the size of the magic window described above. In this case, the maximum size of the display range (enlarged area) when enlarging the image in perspective projection format substantially matches the size of the magic window. The user can also set the threshold value so that perspective projection conversion processing is always performed when enlarging the image. The user can also set the threshold value so that the enlarged image is always displayed in circular fisheye format.

[0078] Returning to the description of Figure 5, in S508, the system control unit 30 determines whether to perform enlarged display in perspective projection format, depending on the processing result of S507. If the system control unit 30 determines that enlarged display in perspective projection format will be performed, the process proceeds to S511; otherwise, the process proceeds to S509.

[0079] In S509, the system control unit 30 determines the enlarged area of ​​the circular fisheye image based on the user's operation (instruction).

[0080] In S510, the system control unit 30 generates an enlarged image from the circular fisheye image.

[0081] In S511, the system control unit 30 determines the enlarged area of ​​the circular fisheye image based on the user's operation (instruction).

[0082] In S512, the system control unit 30 performs perspective projection transformation processing on one of the two circular fisheye image areas based on the enlargement area determined in S511.

[0083] In S513, the system control unit 30 generates an enlarged image from the image that has undergone the perspective projection transformation process generated in S512.

[0084] In S514, the system control unit 30 causes the display unit 208 to display the enlarged image generated in S506, S510, or S513.

[0085] In S515, the system control unit 30 performs enlarged display processing, the details of which will be described later with reference to FIG.

[0086] The enlarged display will be described with reference to Figs. 10(a) to 10(d). The enlarged area 1001 shown in Figs. 10(a) to 10(d) shows the enlarged area of ​​the image 800, and Figs. 10(e) to 10(h) show the image displayed on the display unit 208 during enlarged display. The magic window 1002 is an example of a magic window for the image 800. The enlarged area 1001 becomes smaller from the image shown in Fig. 10(a) to the image shown in Fig. 10(d). The smaller the enlarged area 1001, the larger the display magnification. In Fig. 10(c), the size of the enlarged area 1001 and the size of the magic window 1002 are approximately the same.

[0087] In the case of the enlarged area 1001 shown in Fig. 10(a), the image shown in Fig. 10(e) is displayed on the display unit 208 during enlargement. In the case of the enlarged area 1001 shown in Fig. 10(b), the image shown in Fig. 10(f) is displayed on the display unit 208 during enlargement. In the case of the enlarged area 1001 shown in Fig. 10(c), the image shown in Fig. 10(e) is displayed on the display unit 208 during enlargement. In the case of the enlarged area 1001 shown in Fig. 10(d), the image shown in Fig. 10(e) is displayed on the display unit 208 during enlargement. In Figs. 10(e) and 10(f), enlargement is performed in a circular fisheye format, and in Figs. 10(g) and 10(h), enlargement is performed in a perspective projection format.

[0088] In S514, images such as those shown in FIGS. 10(e) to 10(h) are displayed on the display unit 208.

[0089] FIG. 7 is a flowchart illustrating a sequence relating to the enlarged display process.

[0090] In S701, the system control unit 30 determines whether a user operation (change operation) to change the display magnification has been performed. The system control unit 30 waits for the change operation to be performed, and if it determines that the change operation has been performed, the process proceeds to S702.

[0091] In S702, the system control unit 30 acquires information about the display magnification after the change operation performed in S701.

[0092] In steps S703 to S710, the system control unit 30 performs the same processes as those in steps S507 to S514 in FIG.

[0093] In S711, the system control unit 30 determines whether a user operation to end the enlarged display (enlargement end operation) has been performed. If the system control unit 30 determines that an enlargement end operation has been performed, it ends the enlargement display process of FIG. 7, and if not, the process proceeds to S701.

[0094] For example, if the display magnification is increased from the state shown in Figure 10(e), the image will change to the state shown in Figure 10(f), while remaining in the circular fisheye format. If the display magnification is increased further, the display method will switch to the perspective projection method, resulting in the states shown in Figures 10(g) and 10(h).

[0095] In conventional technology, when switching between a bird's-eye view and a detailed view, an operation to enlarge the display and an operation to switch between performing and not performing geometric transformation processing are required. In the system according to the first embodiment, when an image captured by the camera 100 is enlarged and displayed, it is possible to automatically switch between the circular fisheye format and the perspective projection format depending on the display magnification. This reduces the number of operations to switch between performing and not performing geometric transformation processing when switching between a bird's-eye view and a detailed view.

[0096] (Embodiment 2) A second embodiment of the present invention will be described below with reference to Fig. 11 and Fig. 12. In the second embodiment, a display format determination process according to the display magnification and the position of the enlarged area when the system control unit 30 performs enlarged display processing will be described. Fig. 11 is a flowchart illustrating the display format determination process according to the display magnification and the position of the enlarged area.

[0097] In S1101, the system control unit 30 determines whether the display magnification is equal to or greater than a threshold value. If the system control unit 30 determines that the display magnification is equal to or greater than the threshold value, the process proceeds to S1102; otherwise, the process proceeds to S1104.

[0098] In S1102, the system control unit 30 determines whether the proportion of the imaging area included in the enlarged area (the value of the imaging area) is equal to or greater than a threshold. If the system control unit 30 determines that the value of the imaging area is equal to or greater than the threshold, the process proceeds to S1103; otherwise, the process proceeds to S1104.

[0099] In S1103 and S1104, the system control unit 30 performs the same processes as in S602 and S603 in FIG.

[0100] The enlarged display in the second embodiment will be described with reference to Figures 12(a) to 12(c). The enlarged area 1001 shown in Figures 12(a) to 12(c) shows the enlarged area of ​​the image 800, and Figures 12(d) to 12(f) show the image displayed on the display unit 208 during enlarged display. The image 800 includes an imaging area (circular fisheye image area) 1201 and a non-imaging area 1202.

[0101] In the case of the enlarged area 1001 shown in Fig. 12(a), the image shown in Fig. 12(d) is displayed on the display unit 208 during enlargement. In the image shown in Fig. 12(a), the display magnification is less than the threshold. In this case, the system control unit 30 performs enlargement display in the circular fisheye format.

[0102] In the case of the enlarged area 1001 shown in Fig. 12(b), the image shown in Fig. 12(e) is displayed on the display unit 208 during enlargement. In the image shown in Fig. 12(b), the display magnification is equal to or greater than the threshold, but the value of the imaging area is less than the threshold. In this case, the system control unit 30 performs enlargement and display in a circular fisheye format.

[0103] In the case of the enlarged area 1001 shown in FIG. 12(c), the image shown in FIG. 12(f) is displayed on the display unit 208 during enlarged display. In the image shown in FIG. 12(c), the value of the imaging area is equal to or greater than the threshold value, and the value of the imaging area is equal to or greater than the threshold value. In this case, the system control unit 30 performs enlarged display in perspective projection format. The user can move the enlarged area 1001 using, for example, the direction keys 210.

[0104] Although the position of the enlargement area is considered by using the value of the imaging area, the method for considering the position of the enlargement area is not limited to this. For example, it may be determined whether the enlargement area includes the center of the image. As shown in Figures 12(a) and 12(b), if the enlargement area 1001 includes the center of the image 800, the enlarged image may be displayed in a circular fisheye format as shown in Figures 12(d) and 12(e). On the other hand, if the enlargement area 1001 does not include the center of the image 800 as shown in Figure 12(c), the enlarged image may be displayed in a perspective projection format as shown in Figure 12(f).

[0105] As described above, the system according to the second embodiment can suppress the enlarged display in perspective projection format even if the display magnification is equal to or greater than a threshold value, depending on the position of the enlarged display area. This makes it easier to check the details of, for example, the area around the edge of a circular fisheye image.

[0106] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0107] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0108] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0109] (Other embodiments) The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0110] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) image acquisition means for acquiring an image; an information acquisition means for acquiring information on a display magnification when a partial area of ​​the image is enlarged and displayed; a conversion means for not performing a geometric transformation process on the partial region of the image if the display magnification is smaller than a threshold value when the image acquired by the image acquisition means is a distorted image of a subject, and for performing the geometric transformation process on the partial region of the image if the display magnification is larger than the threshold value; An electronic device comprising: (Configuration 2) The geometric transformation process is a perspective projection transformation process. 2. The electronic device according to configuration 1. (Configuration 3) The distorted image of the subject is an image in which two circular fisheye image regions are arranged side by side. 3. The electronic device according to configuration 1 or 2. (Configuration 4) The threshold is a value specified by the user. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 5) The larger the display magnification, the smaller the partial area of ​​the image. The threshold value is a display magnification at which the size of the partial area of ​​the image substantially matches the size of the area displayed at one time on the display device in a display mode that changes the area displayed on the display device depending on the attitude of the display device. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 6) If the image is an undistorted image of a subject, the conversion means does not perform the geometric conversion process regardless of the display magnification. 2. The electronic device according to configuration 1. (Configuration 7) the distorted image of the subject includes an imaging area that is an imaged area and a non-imaging area that is not an imaged area, When the image acquired by the image acquisition means is a distorted image of a subject, if the size of a portion of the non-image capture area included in the partial area of ​​the image is larger than a second threshold, the conversion means does not perform the geometric conversion process even if the display magnification is larger than the threshold. 7. The electronic device according to any one of configurations 1 to 6. (method) A method for controlling an electronic device, comprising: an image acquisition step of acquiring an image; an information acquisition step of acquiring information on a display magnification when a partial area of ​​the image is enlarged and displayed; a transformation step of not performing geometric transformation processing on the partial region of the image if the display magnification is smaller than a threshold value when the image acquired by the image acquisition step is a distorted image of a subject, and performing the geometric transformation processing on the partial region of the image if the display magnification is larger than the threshold value; A control method comprising: (program) A program for causing a computer to execute each step of the control method according to configuration 8. (medium) A computer-readable storage medium storing a program for causing a computer to execute each step of the control method according to configuration 9. [Explanation of symbols]

[0111] 100: Digital camera (camera) 30: System control unit 211: Imaging unit

Claims

1. image acquisition means for acquiring an image; an information acquisition means for acquiring information on a display magnification when a partial area of ​​the image is enlarged and displayed; a conversion means for not performing a geometric transformation process on the partial region of the image if the display magnification is smaller than a threshold value when the image acquired by the image acquisition means is a distorted image of a subject, and for performing the geometric transformation process on the partial region of the image if the display magnification is larger than the threshold value; An electronic device comprising:

2. The geometric transformation process is a perspective projection transformation process.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. The distorted image of the subject is an image in which two circular fisheye image regions are arranged side by side.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

4. The threshold is a value specified by the user.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

5. The larger the display magnification, the smaller the partial area of ​​the image. The threshold value is a display magnification at which the size of the partial area of ​​the image substantially matches the size of the area displayed at one time on the display device in a display mode in which the area displayed on the display device is changed depending on the attitude of the display device.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

6. If the image is an undistorted image of a subject, the conversion means does not perform the geometric conversion process regardless of the display magnification.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

7. the distorted image of the subject includes an imaging area that is an imaged area and a non-imaging area that is not an imaged area, When the image acquired by the image acquisition means is a distorted image of a subject, if the size of a portion of the non-image capture area included in the partial area of ​​the image is larger than a second threshold, the conversion means does not perform the geometric conversion process even if the display magnification is larger than the threshold.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

8. A method for controlling an electronic device, comprising: an image acquisition step of acquiring an image; an information acquisition step of acquiring information on a display magnification when a partial area of ​​the image is enlarged and displayed; a transformation step of not performing geometric transformation processing on the partial region of the image if the display magnification is smaller than a threshold value when the image acquired by the image acquisition step is a distorted image of a subject, and performing the geometric transformation processing on the partial region of the image if the display magnification is larger than the threshold value; A control method comprising:

9. A program for causing a computer to execute each step of the control method according to claim 8.

10. A computer-readable storage medium storing a program for causing a computer to execute each step of the control method according to claim 9.

Images