Imaging apparatus, method for controlling the same, and program

Abstract

To provide an imaging apparatus that can move an AF frame to a desired position in a screen even when it uses a lens unit with different characteristics.SOLUTION: An imaging apparatus according to an embodiment is capable of mounting a lens unit thereon, and has: acquisition means that acquires the characteristics of the lens unit mounted on the imaging apparatus; operation means that receives a moving operation; and control means that, according to the moving operation to the operation means, controls a position of an AF frame showing an area for detecting a defocus amount for an imaging signal displayed on display means. The control means performs control, on the basis of the characteristics of the lens unit mounted on the imaging apparatus, so as to make an amount of movement of the position of the AF frame different in a case of a lens unit with first characteristics having an imaging optical system having one optical axis and a case of a lens unit with second characteristics having a plurality of imaging optical systems different in optical axis, for the same operation amount of the moving operation to the operation means.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an imaging apparatus, a control method thereof, and a program. [Background technology]

[0002] Conventionally, as an interchangeable lens (lens unit) that can be attached to an interchangeable lens camera, a lens unit having two optical systems facing in the same direction so that VR (Virtual Reality) images can be acquired has been known (Patent Document 1). By using such a lens unit, it is possible to acquire two images with parallax that can easily create a VR image with a single shot.

[0003] Furthermore, whether a lens unit has one optical system or multiple optical systems, there are those that use central projection optical systems, which allow for similarity between the subject and the image, and those that can capture a wide range of more than 180 degrees up, down, left, and right (a hemisphere, 90 degrees in all directions from the center of the image). The latter are collectively called fisheye lenses. As such, a variety of lens units can be used in interchangeable lens cameras. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-189536 Summary of the Invention [Problem to be solved by the invention]

[0005] Some cameras with autofocus functions are known to have a function for moving an autofocus (AF) frame in response to user operation in order to focus on a desired subject. The AF frame is a frame that indicates an area for detecting the amount of defocus for a displayed image signal. The displayed image signal varies depending on the attached lens unit, which can affect the operability of the AF frame. Conventional technologies have not considered a technique for appropriately controlling the AF frame when lens units with different characteristics can be attached.

[0006] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to realize a technology that makes it possible to move the AF frame to a desired position within the image plane even when lens units with different characteristics are used. [Means for solving the problem]

[0007] In order to solve this problem, for example, an imaging device of the present invention has the following configuration: That is, an imaging device to which a lens unit can be attached, comprising: an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; and a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in accordance with a movement operation on the operation means, wherein the control means controls, based on the characteristics of the attached lens unit, such that, for the same amount of movement operation on the operation means, the amount of movement of the position of the AF frame differs between a lens unit with a first characteristic having an imaging optical system with one optical axis and a lens unit with a second characteristic having multiple imaging optical systems with different optical axes. [Effects of the Invention]

[0008] According to the present invention, even when lens units with different characteristics are used, it is possible to move the AF frame to a desired position within the image plane. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the external configuration of a camera as an example of an imaging device according to a first embodiment; [Figure 2] FIG. 1 is a diagram showing an example of the internal configuration of a camera equipped with a single lens unit as an example of a lens unit according to a first embodiment. [Figure 3] FIG. 1 is a schematic diagram showing an example of the configuration of a twin lens unit as an example of a lens unit according to a first embodiment; [Figure 4] FIG. 1 is a schematic diagram showing an example of a pixel arrangement of an image sensor in an image capturing unit according to the first embodiment; [Figure 5] FIG. 1 is a diagram showing an example of a live view image displayed on a camera equipped with a twin-lens unit according to the first embodiment. [Figure 6] 1 is a flowchart showing the AF frame movement control process according to the first embodiment. [Figure 7] Flowchart showing AF frame movement control processing in the second embodiment [Figure 8] Flowchart showing AF frame movement control processing in the third embodiment [Figure 9] Flowchart showing AF frame movement control processing in the fourth embodiment [Figure 10] Flowchart showing AF frame movement control processing in embodiment 5 [Figure 11] Flowchart showing AF frame movement control processing in the sixth embodiment DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (Embodiment 1) <Camera external configuration> 1 shows an example of the external configuration of a digital camera (hereinafter, simply referred to as a camera) 100 as an example of an imaging device according to this embodiment. Note that, in the following description, a digital camera will be used as an example of an imaging device, but the movement control process according to this embodiment, which will be described later, can also be applied to other electronic devices. These devices may include, for example, smartphones, game consoles, tablet terminals, personal computers, medical equipment, and surveillance cameras.

[0012] FIG. 1(a) is a perspective view of the camera 100 as seen from the front, and FIG. 1(b) is a perspective view of the camera 100 as seen from the back.

[0013] The camera 100 has, on its top surface, a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub electronic dial 105, a video button 106, and an extra-viewfinder display 107. The shutter button 101 is an operation unit used to prepare for shooting or to give instructions to shoot. The power switch 102 is an operation unit used to switch the power of the camera 100 on and off. The mode switch 103 is an operation unit used to switch between various modes. The main electronic dial 104 is a rotary operation unit used to change settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operation unit used to move the selection frame (cursor), advance images, etc. The video button 106 is an operation unit used to give instructions to start and stop video shooting (recording). The extra-viewfinder display 107 displays various settings such as shutter speed and aperture.

[0014] The camera 100 also has, on its rear surface, a display unit 108, a touch panel 109, directional keys 110, a SET button 111, an AE lock button 112, an AF frame selection / magnification button 113, a playback button 114, a menu button 115, an eyepiece unit 116, an eyepiece detection unit 118, and a touch bar 119. The display unit 108 displays images and various information. The touch panel 109 is an operation unit that detects touch operations on the display surface (touch operation surface) of the display unit 108. The directional keys 110 are an operation unit consisting of keys (four-way keys) that can be pressed up, down, left, and right. Operations can be performed according to the position of the directional keys 110 pressed. For example, the directional keys 110 accept movement operations in accordance with key presses to move the position of the AF frame. The SET button 111 is an operation unit that is mainly pressed to confirm a selection item. The AE lock button 112 is an operation unit that is pressed to fix the exposure state in a shooting standby state. The AF frame selection / enlargement button 113 is a shared operation unit used for a selection operation that enables movement of the AF frame in the live view display (LV display) in the shooting mode, and for switching the enlargement mode on and off. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 104. The AF frame selection / enlargement button 113 is also used to enlarge the playback image or increase the magnification ratio in the playback mode. The playback button 114 is an operation unit used to switch between the shooting mode and the playback mode. In the shooting mode, pressing the playback button 114 switches to the playback mode, and the most recent image recorded on the recording medium 229 (described later) can be displayed on the display unit 108.

[0015] The menu button 115 is an operation unit that is pressed when a menu screen that allows various settings to be displayed on the display unit 108. The user can intuitively make various settings using the menu screen displayed on the display unit 108, the direction keys 110, and the SET button 111. The eyepiece unit 116 is a part for placing an eye on the eyepiece finder 117 (a peer-type finder). The user can view an image displayed on an internal EVF 217 (Electronic View Finder) that will be described later through the eyepiece unit 116. The eyepiece detection unit 118 is a sensor that detects whether the user has placed their eye on the eyepiece unit 116.

[0016] The touch bar 119 is a line-shaped touch operation unit (line touch sensor) capable of receiving touch operations. The touch bar 119 is positioned so that it can be touched by the thumb of the right hand when the grip unit 120 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 101 can be pressed with the index finger of the right hand. That is, the touch bar 119 can be operated while the eyepiece unit 116 is placed near the eyepiece 116, the viewfinder 117 is viewed, and the camera is in a position (shooting posture) in which the shutter button 101 can be pressed at any time. The touch bar 119 can receive tap operations (operations in which the user touches the touch bar and then releases the touch bar without moving it within a predetermined period of time), slide operations to the left or right (operations in which the user touches the touch bar and then moves the touch position while keeping the touch), and the like. The touch bar 119 is an operation unit different from the touch panel 109 and does not have a display function. The touch bar 119 receives movement operations in accordance with the movement of the touch position to move the position of the AF frame. The touch bar 119 of this embodiment is a multi-function bar, and functions as, for example, an M-Fn bar.

[0017] The camera 100 also includes a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, a communication terminal 124, and the like. The grip section 120 is a holding section shaped to be easily gripped with the user's right hand when holding the camera 100. The shutter button 101 and main electronic dial 104 are positioned so that they can be operated with the index finger of the right hand when the user holds the camera 100 by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. Similarly, the sub electronic dial 105 and touch bar 119 are positioned so that they can be operated with the thumb of the right hand. The thumb rest section 121 (thumb standby position) is a grip section provided on the rear side of the camera 100, in a position where it is easy to place the thumb of the right hand holding the grip section 120 when none of the operation sections are being operated. The thumb rest section 121 is made of a rubber member or the like to enhance holding strength (grip feeling). The terminal cover 122 protects connectors such as connection cables that connect the camera 100 to external devices. The lid 123 protects the recording medium 229 and the slot by closing the slot for storing the recording medium 229, which will be described later. The communication terminal 124 is a terminal for communicating with the detachable lens unit 200, which will be described later, of the camera 100.

[0018] <Internal structure of the camera> Fig. 2 shows an example of the internal configuration of the camera 100. Note that the same components as those in Fig. 1 are given the same reference numerals and descriptions thereof will be omitted where appropriate. A lens unit 200 is attached to the camera 100.

[0019] First, we will explain lens unit 200. Lens unit 200 is a type of interchangeable lens that can be attached to and detached from camera 100. Lens unit 200 shown as an example in Fig. 2 is a single lens having an imaging optical system with one optical axis, and is an example of a normal lens.

[0020] The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an autofocus (AF) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like.

[0021] The aperture 201 is configured to have an adjustable aperture diameter. The lens 202 is composed of multiple lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, etc. based on instructions from a system control unit 218 (described later). The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203, and adjusts the focus by displacing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication is performed via a communication terminal 206 of the lens unit 200 and a communication terminal 124 of the camera 100. The communication terminal 206 is a terminal through which the lens unit 200 communicates with the camera 100.

[0022] Next, a description will be given of the camera 100. The camera 100 has a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 218.

[0023] The shutter 210 is a focal plane shutter that can freely control the exposure time of the imaging unit 211 based on instructions from the system control unit 218. The imaging unit 211 is an imaging element (image sensor) composed of a CCD, CMOS, or other element that converts an optical image into an electrical signal. The imaging unit 211 may also have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 218. The A / D converter 212 converts the analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on data from the A / D converter 212 or data from the memory control unit 213. The image processing unit 214 also performs predetermined arithmetic processing using captured image data, and the system control unit 218 performs exposure control and distance measurement control based on the obtained arithmetic results. This processing allows for TTL (through-the-lens) AF processing, AE (auto-exposure) processing, EF (pre-flash) processing, etc. Furthermore, the image processing unit 214 performs predetermined calculation processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the obtained calculation results.

[0024] The image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, the image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, as well as image data to be displayed on the display unit 108 and the EVF 217. The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also serves as a memory for displaying images (video memory).

[0025] The D / A converter 216 converts image display data stored in the memory 215 into an analog signal and supplies it to the display unit 108 or the EVF 217. Therefore, the display image data written to the memory 215 is displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 performs display in accordance with the analog signal from the D / A converter 216. The display unit 108 or the EVF 217 is, for example, an LCD or organic EL display. A digital signal that has been A / D converted by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216 and then sequentially transferred to and displayed on the display unit 108 or the EVF 217, thereby performing live view display.

[0026] The system control unit 218 is a control unit including at least one processor and / or at least one circuit. That is, the system control unit 218 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 218 controls the entire camera 100. The system control unit 218 executes a program recorded in the nonvolatile memory 220 to, for example, realize the movement control process of the AF frame (described later). The system control unit 218 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, the EVF 217, etc.

[0027] The camera 100 also includes a system memory 219 , a nonvolatile memory 220 , a system timer 221 , a communication unit 222 , an attitude detection unit 223 , and an eye proximity detection unit 118 .

[0028] The system memory 219 may be, for example, a RAM. Constants and variables for the operation of the system control unit 218, programs read from the nonvolatile memory 220, and the like are loaded into the system memory 219. The nonvolatile memory 220 is an electrically erasable and recordable memory, and may be, for example, an EEPROM. Constants and programs for the operation of the system control unit 218 are stored in the nonvolatile memory 220. The programs include instructions for executing the AF frame movement control process described below. The system timer 221 is a timing unit that measures the time used for various controls and the time of a built-in clock. The communication unit 222 transmits and receives video signals and audio signals to and from external devices connected wirelessly or via a wired cable. The communication unit 222 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 222 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 222 can transmit images (including live images) captured by the imaging unit 211 and images recorded on the recording medium 229, and can receive image data and other various information from external devices. The orientation detection unit 223 detects the orientation of the camera 100 relative to the direction of gravity. Based on the orientation detected by the orientation detection unit 223, it is possible to determine whether an image captured by the imaging unit 211 was captured with the camera 100 held horizontally or vertically. The system control unit 218 can add orientation information corresponding to the orientation detected by the orientation detection unit 223 to the image file of the image captured by the imaging unit 211, or rotate and record the image. The orientation detection unit 223 can use, for example, an acceleration sensor or a gyro sensor. The orientation detection unit 223 can also be used to detect movement of the camera 100 (panning, tilting, lifting, whether the camera is stationary, etc.). The sound generation unit 224 can emit sound in response to a signal from the system control unit 218. For example, it can produce sound effects when operating the camera, sounds to notify you when the AF is in focus, and sounds for recorded videos.

[0029] The eyepiece detection unit 118 can detect the approach of an object to the eyepiece 116 of the eyepiece finder 117, which incorporates the EVF 217. The eyepiece detection unit 118 can be, for example, an infrared proximity sensor. When an object approaches, infrared light is emitted from a light-emitting unit of the eyepiece detection unit 118, reflected by the object, and received by a light-receiving unit of the infrared proximity sensor. The amount of received infrared light can be used to determine the distance from the eyepiece 116 to the object. In this way, the eyepiece detection unit 118 performs eyepiece detection, which detects the proximity of the object to the eyepiece 116. The eyepiece detection unit 118 is an eyepiece detection sensor that detects the approach (approach) and departure (away from) of an eye (object) from the eyepiece 116 of the eyepiece finder 117. When an object is detected approaching within a predetermined distance from the eyepiece 116 from a non-eyepiece state (not approaching state), it is detected that the eye has been placed in proximity. On the other hand, when an object whose proximity has been detected moves away from the eye-closed state (approaching state) by a distance greater than a predetermined distance, it is detected that the eye has been moved away. The threshold for detecting eye-closedness and the threshold for detecting eye-away may be different, for example, by providing hysteresis. Furthermore, after eye-closedness is detected, the eye-closed state is maintained until eye-away is detected. After eye-away is detected, the non-eye-closed state is maintained until eye-closedness is detected. The system control unit 218 switches the display unit 108 and the EVF 217 between display (display state) and non-display (non-display state) depending on the state detected by the eye-closedness detection unit 118. Specifically, when at least in a shooting standby state and the display destination switching setting is automatic switching, the display unit 108 is set as the display destination and the display is turned on, and the EVF 217 is hidden, when the eye is not placed in the eye-closed state. Furthermore, when the eye is placed in the eye-closed state, the EVF 217 is set as the display destination and the display is turned on, and the display unit 108 is hidden. The eye proximity detector 118 is not limited to an infrared proximity sensor, and any other sensor may be used as long as it can detect a state that can be considered as eye proximity.

[0030] The camera 100 also has an outside-viewfinder display unit 107, an outside-viewfinder display drive circuit 225, a power supply control unit 226, a power supply unit 227, a recording medium I / F 228, an operation unit 230, and the like.

[0031] The viewfinder display unit 107 displays various settings of the camera 100, such as shutter speed and aperture, via an viewfinder display drive circuit 225. The power supply control unit 226 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, and other components, and detects whether a battery is installed, the battery type, and the remaining battery charge. The power supply control unit 226 also controls the DC-DC converter based on the detection results and instructions from the system control unit 218 to supply the required voltage for the required period to various components, including the recording medium 229. The power supply unit 227 may be a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, or an AC adapter. The recording medium I / F 228 is an interface with a recording medium 229, such as a memory card or a hard disk. The recording medium 229 is a memory card or the like for recording captured images, and may be composed of a semiconductor memory, a magnetic disk, or the like. The recording medium 229 may be removable or built-in.

[0032] The operation unit 230 is an input unit that accepts operations from the user (user operations) and is used to input various instructions to the system control unit 218. The operation unit 230 includes the shutter button 101, the power switch 102, the mode selector switch 103, the touch panel 109, and other operation members 231. The other operation members 231 include the main electronic dial 104, the sub electronic dial 105, the video button 106, the direction keys 110, the SET button 111, the AE lock button 112, the AF frame selection / enlargement button 113, the playback button 114, the menu button 115, the touch bar 119, and the like.

[0033] The shutter button 101 has a first shutter switch 232 and a second shutter switch 233. The first shutter switch 232 is turned on when the shutter button 101 is pressed halfway (a shooting preparation instruction) during operation, and generates a first shutter switch signal SW1. The system control unit 218 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing in response to the first shutter switch signal SW1. The second shutter switch 233 is turned on when the shutter button 101 is pressed fully (a shooting instruction) and generates a second shutter switch signal SW2. The system control unit 218 starts a series of shooting processing in response to the second shutter switch signal SW2, from reading out a signal from the imaging unit 211 to generating an image file including a captured image and writing it to the recording medium 229.

[0034] The mode selector switch 103 switches the operation mode of the system control unit 218 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for different capture scenes. The user can directly switch to one of the above-mentioned capture modes using the mode selector switch 103. Alternatively, the user can first switch to a list screen of capture modes using the mode selector switch 103, and then selectively switch to one of the displayed modes using the operation unit 230. Similarly, the video capture mode may also include multiple modes.

[0035] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as an integrated unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that its light transmittance does not interfere with the display of the display unit 108. By associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (graphical user interface) can be configured that makes it appear as if the user is directly operating the screen displayed on the display unit 108. The touch panel 109 can be any of a variety of types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, or an optical sensor type. Depending on the type, there are types that detect a touch by contact with the touch panel 109, and types that detect a touch by the approach of a finger or a pen to the touch panel 109, but either type may be used.

[0036] The system control unit 218 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 touches the touch panel 109 again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched with a finger or a pen (hereinafter referred to as Touch-On). The touch panel 109 is moved while being touched by a finger or a pen (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 109 is released from the touch panel 109, that is, the end of the touch (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 109 (hereinafter referred to as Touch-Off).

[0037] When a touch down is detected, a touch on is also detected at the same time. After a touch down, a touch on is usually continued to be detected unless a touch up is detected. If a touch move is detected, a touch on is also detected at the same time. Even if a touch on is detected, a touch move is not detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, a touch off occurs.

[0038] These operation states and the position coordinates of the finger or pen touching the touch panel 109 are notified to the system control unit 218 via the internal bus. The system control unit 218 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. Regarding touch-move, the movement direction of the finger or pen moving on the touch panel 109 can also be determined for each vertical and horizontal component on the touch panel 109 based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109, moved quickly for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 109 as if flicking it. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is then detected, it is determined that a flick has been performed (it can be determined that a flick occurred following a slide operation). Furthermore, when multiple points (for example, two points) are touched together (multi-touch), the touch operation of bringing the touched positions closer together is called pinch in, and when the touch operation of moving the touched positions farther apart is called pinch out. Pinch out and pinch in are collectively called pinch operations (or simply pinch).

[0039] <Lens unit configuration> Fig. 3 shows a schematic example of the configuration of lens unit 300. Fig. 3 shows a state in which lens unit 300 is attached to camera 100. Note that, among the camera 100 shown in Fig. 3, the same components as those described in Fig. 2 are given the same reference numerals, and descriptions thereof will be omitted as appropriate.

[0040] Lens unit 300 is a type of interchangeable lens that can be attached to and detached from camera 100. Lens unit 300 is a twin lens that can capture images with parallax between left and right images. Lens unit 300 has two optical systems, each with a wide viewing angle of approximately 180 degrees, and can capture images of the range of the forward hemisphere. Specifically, the two optical systems of lens unit 300 can each capture an object with a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle).

[0041] The lens unit 300 includes a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. The right-eye optical system 301R and the left-eye optical system 301L have lenses 302R and 302L located on the subject side, respectively, facing the same direction, and their optical axes are approximately parallel. The inter-optical axis distance 307 is the distance between the optical axes of the left-eye optical system 301L and the right-eye optical system 301R. The lens unit 200 of this embodiment is a VR180 lens for capturing images for VR180, a VR image format capable of two-eye stereoscopic viewing. The VR180 lens includes lenses that enable the right-eye optical system 301R and the left-eye optical system 301L to capture an approximately 180-degree range. The VR180 lens may be a lens capable of capturing a wide viewing angle range of approximately 160 degrees, which is narrower than the 180-degree range, as long as the right-eye optical system 301R and the left-eye optical system 301L can acquire images capable of displaying two-eye VR images as VR180. The VR180 lens can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L, which has parallax from the right image, on one or two image sensors of the attached camera. Like the lens unit 200, the lens unit 300 includes an aperture drive circuit and an AF drive circuit. Although not shown, the lens unit 300 includes two AF drive circuits: an AF drive circuit that drives the lens of the right image formed via the right-eye optical system 301R to focus, and an AF drive circuit that drives the lens of the left image formed via the left-eye optical system 301L to focus. The AF drive circuit can also simultaneously drive the lenses of the right image formed via the right-eye optical system 301R and the left image formed via the left-eye optical system 301L to achieve focusing.

[0042] Furthermore, the lens unit 300 is attached to the camera 100 via the lens mount section 304 and the camera mount section 305 of the camera 100. When the lens unit 300 is attached to the camera 100, the system control section 218 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 124 of the camera 100 and the communication terminal 306 of the lens unit 300.

[0043] In this embodiment, a right image formed via the right-eye optical system 301R and a left image formed via the left-eye optical system 301L, which has parallax from the right image, are imaged side by side on the imaging unit 211 of the camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single imaging element. The imaging unit 211 converts the imaged subject image (optical signal) into an analog electrical signal. In this way, by using the lens unit 300, two images with parallax can be simultaneously acquired (as a set) from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. Furthermore, by dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a range of approximately 180 degrees, known as VR180.

[0044] Here, a VR image is an image that can be displayed in VR, as described below. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than the display range that can be displayed at one time on a display unit. VR images are not limited to still images, but also include videos and live images (images acquired from a camera in almost real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and vertically. VR images also include images with a wider angle of view than the angle of view that can be captured by a normal camera, or an image range that can be displayed at one time on a display unit, even if the field of view is less than 360 degrees horizontally or vertically. Images captured by camera 100 using lens unit 300 described above are a type of VR image. VR images can be displayed in VR by, for example, setting the display mode of a display device (a display device that can display VR images) to "VR view." By displaying a VR image with a 360-degree angle of view and changing the orientation of the display device left and right (horizontal rotation direction), the user can view seamless, omnidirectional images left and right.

[0045] Here, VR display (VR view) refers to a display method (display mode) that displays a VR image with a field of view that corresponds to the orientation of the display device, allowing for a change in display range. VR display includes "single-eye VR display (single-eye VR view)," which displays a single image by mapping a VR image onto a virtual sphere (deformation that corrects distortion). VR display also includes "binocular VR display (binocular VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side by mapping them onto a virtual sphere. Stereoscopic viewing is possible by performing "binocular VR display" using a VR image for the left eye and a VR image for the right eye that have parallax. Regardless of the VR display, for example, when a user wears a display device such as an HMD (head-mounted display), the image displayed corresponds to the orientation of the user's face. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point in time. If the orientation of the display device is flipped from this state (for example, by changing the display surface from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered at 180 degrees left and right (the opposite direction, for example, south) and 90 degrees up and down. In other words, when the user wears the HMD and turns their face from north to south (i.e., turns backward), the image displayed on the HMD also changes from a north image to a south image. Note that the VR image captured using the lens unit 300 of this embodiment is a VR180 image captured in a range of approximately 180 degrees forward, and no image exists in a range of approximately 180 degrees behind. If such a VR180 image is VR displayed and the orientation of the display device is changed to the side where no image exists, a blank area is displayed.

[0046] By displaying VR images in this way, the user visually feels as if they are inside the VR image (in the VR space). Note that the method of displaying VR images is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (display mode "VR view"), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0047] <Configuration of the image sensor in the imaging unit> Fig. 4 shows an outline of the pixel arrangement of the image sensor in the image sensor 211 in this embodiment. Fig. 4 shows the pixel arrangement of the two-dimensional CMOS sensor used as the image sensor in the image sensor 211 in this embodiment, in a range of 4 columns x 4 rows of image sensing pixels (a range of 8 columns x 4 rows as the focus detection pixel arrangement).

[0048] In this embodiment, the pixel group 400 is composed of pixels arranged in 2 columns and 2 rows, and is covered with color filters in a Bayer array. In the pixel group 400, a pixel 400R having a spectral sensitivity of R (red) is arranged in the upper left position, pixels 400G having a spectral sensitivity of G (green) are arranged in the upper right and lower left positions, and a pixel 400B having a spectral sensitivity of B (blue) is arranged in the lower right position. Furthermore, the image sensor in the image capturing unit 211 of this embodiment performs focus detection using an image capture plane phase difference method, so each pixel has multiple photodiodes (photoelectric conversion units) for one microlens 401. In this embodiment, each pixel is composed of two photodiodes 402 and 403 arranged in a 2 column x 1 row.

[0049] The imaging element in the imaging unit 211 is capable of acquiring imaging signals and focusing signals by arranging a large number of pixel groups 400, each consisting of 2 columns x 2 rows of pixels (4 columns x 2 rows of photodiodes) as shown in Figure 4, on the imaging surface.

[0050] In each pixel having such a configuration, a light beam is separated by a microlens 401 and images are formed on the photodiodes 402 and 403. A signal (signal A+B) obtained by adding together signals from the two photodiodes 402 and 403 is used as an imaging signal, and two signals (image signals A and B) read out from each of the photodiodes 402 and 403 are used as focusing signals. Note that the imaging signal and the focusing signal may be read out separately, but in consideration of the processing load, the following may also be used. That is, the imaging signal (signal A+B) and a focusing signal (e.g., signal A) from one of the photodiodes 402 and 403 may be read out, and the other focusing signal (e.g., signal B) may be obtained by taking the difference.

[0051] In this embodiment, each pixel is configured to have two photodiodes 402, 403 for one microlens 401, but the number of photodiodes is not limited to two and may be more. Also, a plurality of pixels may be provided with different positions of the opening of the light receiving portion relative to the microlens 401. In other words, any configuration may be used as long as it results in the acquisition of two signals for phase difference detection, such as image A signal and image B signal, which enable phase difference detection.

[0052] Also, while FIG. 4 shows a configuration in which all pixels have multiple photodiodes, this is not limited to this, and focus detection pixels as shown in FIG. 4 may be provided discretely within the normal pixels that make up the image sensor in the image capturing unit 211.

[0053] <Live View image display example> FIG. 5 shows a display example of a display unit 108 on which a live view image in the camera 100 when the binocular lens unit is attached is displayed. The image of the left image formed through the left optical system 301L of the lens unit 300 is displayed as a left image 500L in the live view image 500, and the image of the right image formed through the right optical system 301R is displayed as a right image 500R. The image 501L of the left lens and the image 501R of the right lens are UI displays for preventing the user from misrecognition because the live view image 500 is displayed in a left-right reversed manner. The left image AF area 502L which is an AF frame is a display frame indicating a position where AF is to be performed, and is displayed on the left image 500L. The user can move the position of the left image AF area 502L by a moving operation following the pressing of the direction key 110 or a moving operation following the movement of the touch position on the touch bar 119. When receiving the moving operation, the system control unit 218 performs an AF frame moving control process described later, and controls the position of the left image AF area 502L according to the moving operation.

[0054] <Example of obtaining lens information> When the lens unit 200 is attached to the camera 100, the camera 100 can obtain information of the lens unit 200 via the communication terminal 206 of the lens unit and the communication terminal 124 of the camera 100. The camera 100 obtains information indicating the characteristics of the attached lens unit via the communication terminal 124 and the communication terminal 206. The information regarding the characteristics of the lens unit can include information indicating at least any one of the configuration of the lens unit, the projection method of the lens, and the type of the lens. The information indicating the configuration of the lens unit includes, for example, information on whether it is a single-lens or a binocular lens. Also, the information indicating the projection method of the lens includes, for example, information on whether the lens is a central projection or an equidistant projection. Further, the information indicating the type of the attached lens includes, for example, information on whether the lens is a fish-eye lens or not. The system control unit 218 controls the amount of movement of the position of the AF frame according to the characteristics of the attached lens unit in the AF frame moving control process described later.

[0055] Next, the AF frame movement control process according to this embodiment will be described. The AF frame movement control process is a process for easily and accurately moving the AF frame to a desired position within the screen in a situation where lens units with various characteristics can be attached to the camera 100. When lens units with different characteristics can be attached, if the AF frame is moved uniformly in response to an operation to move the AF frame (without considering the characteristics of the lens units), it may not be possible to move the AF frame to a desired position within the screen. For example, in a single-lens display in which a single lens with one optical system is attached, and a twin-lens VR display in which a twin lens with two optical systems is attached, moving the AF frame by the same amount within the screen will result in rough movement relative to the subject. In other words, in a twin-lens VR display, the user may not be able to accurately position the AF frame at a desired position within the screen. For this reason, the AF frame movement control process controls the amount of movement of the AF frame to vary based on the characteristics of the lens unit, for example, depending on whether the attached lens unit is a single lens or a twin lens.

[0056] 6, an example will be described in which the AF frame movement control process controls the amount of movement of the AF frame to vary depending on whether the attached lens unit is a single lens or a twin lens. Note that a series of operations in the AF frame movement control process according to this embodiment is realized by the system control unit 218 executing a program recorded in the nonvolatile memory 220. This series of operations is started when the AF frame selection / magnification button 113 is operated, making it possible to move the AF frame in the LV display of the shooting mode, and the direction key 110 is operated.

[0057] In S601, the system control unit 218 determines whether the attached lens unit has a single lens configuration (single lens configuration). The system control unit 218 can acquire information indicating the characteristics of the lens unit via the communication terminal 124 of the camera 100 and determine the lens unit configuration using the information. If the attached lens unit has a single lens configuration, the system control unit 218 proceeds to S602; otherwise, the system control unit 218 proceeds to S603. Note that in S601, the system control unit 218 may also determine whether the attached lens unit has a multi-lens configuration including twin lenses. In this case, if the attached lens unit has a multi-lens configuration, the system control unit 218 may proceed to S603; otherwise, the system control unit 218 may proceed to S602.

[0058] In S602, because the attached lens unit has a single lens configuration, the system control unit 218 sets a predetermined movement amount as the movement amount of the AF frame for a single lens. For example, the system control unit 218 sets a movement amount of 1 / 3 the size of the AF frame as the movement amount of the AF frame for a single lens.

[0059] In S603, because the attached lens unit is not configured as a single lens (for example, a twin lens), the system control unit 218 sets a predetermined movement amount as the movement amount of the AF frame for a twin lens (or multiple lens). The system control unit 218 sets, for example, a movement amount of 1 / 6 the size of the AF frame, which is half the movement amount of the AF frame for a single lens, as the movement amount of the AF frame for a twin lens. In other words, the system control unit 218 sets the movement amount of the AF frame for a twin lens to half the movement amount of the AF frame for a single lens for the same amount of movement operation of the directional key 110. In S604, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the movement amount of the AF frame set in S602 or S603. The system control unit 218 then ends the series of operations.

[0060] In this way, based on the characteristics of the attached lens unit, the system control unit 218 makes the movement amount of the AF frame position different between the case of a single-lens reflex camera and the case of a binocular lens for the same operation amount of the movement operation to the direction keys 110. For example, the system control unit 218 is configured such that for the same operation amount of the movement operation to the direction keys 110, the movement amount of the AF frame in the case of a binocular lens is half of the movement amount of the AF frame in the case of a single-lens reflex camera. Therefore, the user can place the AF frame at a desired position within the screen with the same operating feeling as that of a single-lens reflex camera even in the binocular VR display with the binocular lens attached.

[0061] (Embodiment 2) Next, Embodiment 2 will be described. In Embodiment 2, it is different from Embodiment 1 in that the movement of the position of the AF frame is controlled according to the movement operation to the touch bar 119. Therefore, although the operation of the movement control process of the AF frame is different from that of the above-described embodiment, the configurations of the above-described camera and lens unit are substantially the same as those of Embodiment 1. For this reason, the same reference numerals are given to the same or substantially the same configurations and processes, and the description thereof is omitted.

[0062] Referring to FIG. 7, the AF frame movement control process according to Embodiment 2 will be described. The series of operations of the AF frame movement control process according to the present embodiment is realized by the system control unit 218 executing a program recorded in the non-volatile memory 220. Further, this series of operations is started when the AF frame selection / enlargement button 113 is operated and the AF frame can be moved in the LV display in the shooting mode.

[0063] In S701, the system control unit 218 acquires a movement operation (e.g., the amount of sliding operation to the left or right) on the touch bar 119 by the user. In S702, the system control unit 218 determines whether the attached lens unit has a single lens configuration (single-lens configuration). The system control unit 218 can acquire information indicating the characteristics of the lens unit via the communication terminal 124 of the camera 100 and determine the lens unit configuration using the information. If the attached lens unit has a single lens configuration, the system control unit 218 proceeds to S703; otherwise, the system control unit 218 proceeds to S704. Note that in S702, the system control unit 218 may also determine whether the attached lens unit has a multi-lens configuration including twin lenses. In this case, if the attached lens unit has a multi-lens configuration, the process may proceed to S704; otherwise, the process may proceed to S703.

[0064] In S703, because the attached lens unit is configured as a single lens, the system control unit 218 calculates the left / right sliding operation amount acquired in S701 as the movement amount of the AF frame in the case of a single lens. In S704, the system control unit 218 calculates the movement amount of the AF frame in the case of a twin lens (or multiple lens) from the sliding operation amount acquired in S701. For example, the system control unit 218 sets half the movement amount of the AF frame in the case of a single lens as the movement amount of the AF frame in the case of a twin lens. In S705, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the movement amount of the AF frame set in S703 or S704. The system control unit 218 then ends the series of operations.

[0065] In this way, based on the characteristics of the attached lens unit, the system control unit 218 makes the movement amount of the AF frame different between the case of a single-lens reflex lens and the case of a binocular lens for the same operation amount of the movement operation on the touch bar. For example, the system control unit 218 is configured such that for the same operation amount of the movement operation on the touch bar, the movement amount of the AF frame in the case of a binocular lens is half of the movement amount of the AF frame in the case of a single-lens reflex lens. Therefore, even in the binocular VR display with a binocular lens attached, the user can place the AF frame at a desired position within the screen with the same operating feeling as in the case of a single-lens reflex lens.

[0066] (Embodiment 3) Next, Embodiment 3 will be described. Among single-lens reflex lenses and binocular lenses, there are lenses in which the optical system is a central projection and an image in which the subject and the image are similar is displayed, and lenses such as fisheye lenses in which the optical system is an equidistant projection and an image in which the incident angle and the image height are proportional is displayed.

[0067] Since the image height of the equidistant projection lens is higher than that of the central projection lens and the displayed image is stretched, when the AF frame is moved by the same amount as the screen displayed in the equidistant projection, the AF frame moves finely with respect to the subject. That is, when using a lens unit in which the projection method of the lens is an equidistant projection, there is a problem that an extra operation is required when the user moves the AF frame to a desired position within the screen as compared with the case where the projection method is a central projection.

[0068] In Embodiment 3, the point of controlling the movement of the position of the AF frame when lenses with different projection methods are attached is different from that of the above-described embodiment. Therefore, although the operation of the movement control process of the AF frame is different from that of the above-described embodiment, the configurations of the above-described camera and lens unit are substantially the same as those of Embodiment 1. For this reason, the same reference numerals are assigned to the same or substantially the same configurations and processes, and the description thereof is omitted.

[0069] AF frame movement control processing according to the third embodiment will be described with reference to Fig. 8. Note that a series of operations in the AF frame movement control processing according to the present embodiment is realized by the system control unit 218 executing a program recorded in the nonvolatile memory 220. Also, this series of operations is started when the AF frame selection / enlargement button 113 is operated, making it possible to move the AF frame in the LV display of the shooting mode, and the direction key 110 is operated.

[0070] In S801, the system control unit 218 determines whether the projection method of the lens of the attached lens unit is central projection. The system control unit 218 acquires information indicating the characteristics of the lens unit via the communication terminal 124 of the camera 100, and can determine the projection method of the lens of the lens unit using that information. If the projection method of the lens is central projection, the system control unit 218 proceeds to S802; otherwise, the system control unit 218 proceeds to S803.

[0071] In S802, because the projection method of the lens of the attached lens unit is central projection, the system control unit 218 sets a predetermined movement amount as the movement amount of the AF frame in the case of central projection. For example, the system control unit 218 sets a movement amount of, for example, 1 / 3 the size of the AF frame as the movement amount of the AF frame in the case of central projection. This movement amount of the AF frame may be the same as in the case of a single lens configuration.

[0072] In S803, the system control unit 218 sets the amount of movement of the AF frame for equidistant projection because the projection method of the lens of the attached lens unit is not central projection (for example, equidistant projection). The system control unit 218 sets the amount of movement of the AF frame for equidistant projection to, for example, 2 / 3 the size of the AF frame, which is twice the amount of movement of the AF frame for central projection.

[0073] In S804, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the movement amount of the AF frame set in S802 or S803. Then, the system control unit 218 ends a series of operations.

[0074] In this way, based on the characteristics of the mounted lens unit, the system control unit 218 makes the movement amount of the AF frame position different between the case of central projection and the case of equidistant projection for the same operation amount of the movement operation to the direction keys 110. For example, the system control unit 218 is configured such that for the same operation amount of the movement operation to the direction keys 110, the movement amount of the AF frame in the case of equidistant projection is twice the movement amount of the AF frame in the case of central projection. Therefore, the user can place the AF frame at a desired position within the screen with a similar operation feeling whether the lens mounted is a lens with central projection or a lens with equidistant projection.

[0075] (Embodiment 4) Next, Embodiment 4 will be described. Embodiment 4 relates to the movement of the AF frame when lenses with different projection methods are mounted, and is different from Embodiment 3 in that the movement of the position of the AF frame is controlled according to the movement operation to the touch bar 119. Therefore, although the operation of the AF frame movement control process is different from that of the above-described embodiments, the configurations of the above-described camera and lens unit are substantially the same as those of Embodiment 1. For this reason, the same reference numerals are assigned to the same or substantially the same configurations and processes, and the description thereof is omitted.

[0076] Referring to FIG. 9, the AF frame movement control process according to Embodiment 4 will be described. Note that a series of operations of the AF frame movement control process according to the present embodiment are realized by the system control unit 218 executing a program recorded in the non-volatile memory 220. Also, this series of operations starts when the AF frame selection / enlargement button 113 is operated and the AF frame can be moved in the LV display in the shooting mode.

[0077] In S901, the system control unit 218 acquires a movement operation (e.g., a sliding operation amount to the left or right) on the touch bar 119 by the user. In S902, the system control unit 218 determines whether the projection method of the lens of the attached lens unit is central projection. The system control unit 218 can acquire information indicating the characteristics of the lens unit via the communication terminal 124 of the camera 100 and determine the projection method of the lens of the lens unit using the information. If the projection method of the lens is central projection, the system control unit 218 proceeds to S903; otherwise, the system control unit 218 proceeds to S904. Note that the system control unit 218 may determine whether the projection method of the lens is equidistant projection, and proceed to S904 if the projection method of the lens is equidistant projection, or proceed to S903 if not.

[0078] In S903, since the projection method of the lens of the attached lens unit is central projection, the system control unit 218 sets the left / right sliding operation amount acquired in S901 as the movement amount of the AF frame in the case of central projection.

[0079] In S904, because the projection method of the lens of the attached lens unit is not central projection (for example, equidistant projection), the system control unit 218 calculates the movement amount of the AF frame from the left and right slide movement amount acquired in S901. The system control unit 218 sets the movement amount of the AF frame when the projection method of the lens of the attached lens unit is equidistant projection to, for example, twice the movement amount of the AF frame in the case of central projection. In S905, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the movement amount of the AF frame set in S903 or S904. The system control unit 218 then ends the series of operations.

[0080] In this way, the system control unit 218, based on the characteristics of the attached lens unit, changes the amount of movement of the AF frame position between central projection and equidistant projection for the same amount of movement operation on the touch bar 119. For example, the system control unit 218 makes the amount of movement of the AF frame in equidistant projection twice the amount of movement of the AF frame in central projection for the same amount of movement operation on the touch bar 119. This allows the user to position the AF frame at a desired position on the screen with the same feel of operation, whether the user is using a lens with a central projection projection method or a lens with an equidistant projection projection method.

[0081] The movement control process according to the third and fourth embodiments may be performed when the attached lens unit is a single lens or a twin lens. That is, the lens unit for central projection and the lens unit for equidistant projection may each have a configuration including multiple imaging optical systems with different optical axes (i.e., a twin lens configuration).

[0082] Furthermore, when the projection method of the lens of the attached lens unit is equidistant projection, the system control unit 218 may increase the movement amount of the AF frame according to the image height (the angle of view on the imaging signal displayed on the display unit). In this way, the movement amount of the AF frame can be changed according to the image height. On the other hand, when the projection method of the lens of the attached lens unit is central projection, the system control unit 218 may not change the movement amount of the AF frame according to the image height (the angle of view on the imaging signal displayed on the display unit).

[0083] (Embodiment 5) Next, Embodiment 5 will be described. Among single-lens and twin-lens cameras, there are those that use a fisheye lens for the lens and those that use a normal lens that is not a fisheye lens. When using a fisheye lens, since the displayed image is stretched as the image height increases, there are the same problems as in the case of using the lens unit that performs equidistant projection described in Embodiments 3 and 4 above. That is, when the user moves the AF frame to a desired position within the screen, there is a problem that an extra operation is required.

[0084] In Embodiment 5, the control of the movement of the position of the AF frame when using lenses of different types such as whether or not it is a fisheye lens is different from that in the above-described embodiments. Therefore, although the operation of the movement control process of the AF frame is different from that in the above-described embodiments, the configurations of the camera and the lens unit described above are substantially the same as those in Embodiment 1. For this reason, the same reference numerals are assigned to the same or substantially the same configurations and processes, and the description thereof is omitted.

[0085] Referring to FIG. 10, the movement control process of the AF frame according to Embodiment 5 will be described. A series of operations of the movement control process of the AF frame according to the present embodiment are realized by the system control unit 218 executing a program recorded in the non-volatile memory 220. Further, this series of operations is started when the AF frame selection / enlargement button 113 is operated to enable the movement operation of the AF frame in the LV display in the shooting mode and the direction key 110 is operated.

[0086] In S1001, the system control unit 218 determines whether the type of the lens of the lens unit attached is a fisheye lens. The system control unit 218 can acquire information indicating the characteristics of the lens of the lens unit via the communication terminal 124 of the camera 100, and determine the type of the lens of the lens unit using the information. When the type of the lens is a fisheye lens, the system control unit 218 proceeds to S1003, and otherwise proceeds to S1002.

[0087] In S1002, the system control unit 218 sets the amount of movement of the AF frame when the lens type of the attached lens unit is not a fisheye lens (this may be the amount of movement for central projection), because the lens type of the attached lens unit is not a fisheye lens. For example, the system control unit 218 sets the amount of movement of the AF frame when the lens type is not a fisheye lens to, for example, 1 / 3 the size of the AF frame. This amount of movement of the AF frame may be the same as in the case of a single lens configuration.

[0088] In S1003, because the type of lens in the attached lens unit is a fisheye lens, the system control unit 218 sets the amount of movement of the AF frame when the lens is a fisheye lens (this may be the amount of movement for equidistant projection). As the amount of movement of the AF frame when the type of lens is a fisheye lens, the system control unit 218 sets, for example, an amount of movement that is two-thirds the size of the AF frame, which is twice the amount of movement of the AF frame when the lens is not a fisheye lens (when the lens is a central projection). In S1004, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the amount of movement of the AF frame set in S1002 and S1003. The system control unit 218 then ends the series of operations.

[0089] In this way, based on the characteristics of the attached lens unit, the system control unit 218 changes the amount of movement of the AF frame position depending on whether the lens type is a fisheye lens or not, for the same amount of movement of the directional key 110. For example, the system control unit 218 sets the amount of movement of the AF frame when the lens is a fisheye lens to be twice the amount of movement of the AF frame when the lens is not a fisheye lens, for the same amount of movement of the directional key 110. This allows the user to position the AF frame at a desired position on the screen with the same feel, whether using a fisheye lens or a normal lens that is not a fisheye lens.

[0090] (Embodiment 6) In Embodiment 6, it relates to the movement of the position of the AF frame when using lenses of different types such as whether it is a fisheye lens. The difference from Embodiment 5 is that the movement of the position of the AF frame is controlled according to the movement operation on the touch bar 119. Therefore, although the operation of the AF frame movement control process is different from that of the above-described embodiment, the configurations of the camera and the lens unit described above are substantially the same as those in Embodiment 1. For this reason, the same reference numerals are assigned to the same or substantially the same configurations and processes, and the description thereof is omitted.

[0091] Referring to FIG. 11, the AF frame movement control process according to Embodiment 6 will be described. The series of operations of the AF frame movement control process according to the present embodiment is realized by the system control unit 218 executing a program recorded in the non-volatile memory 220. Further, this series of operations is started when the AF frame selection / enlargement button 113 is operated and the AF frame can be moved in the LV display in the shooting mode.

[0092] In S1101, the system control unit 218 acquires the user's movement operation on the touch bar 119 (for example, the amount of slide operation left and right). In S1102, the system control unit 218 determines whether the type of the lens of the attached lens unit is a fisheye lens. The system control unit 218 can acquire information indicating the characteristics of the lens unit via the communication terminal 124 of the camera 100, and determine the type of the lens of the lens unit using this information. When the type of the lens is a fisheye lens, the system control unit 218 proceeds to S1104, and otherwise proceeds to S1103.

[0093] In S1103, since the type of the lens of the attached lens unit is not a fisheye lens, the system control unit 218 sets the amount of slide operation left and right acquired in S1101 as the amount of movement of the AF frame when it is not a fisheye lens. The amount of movement of the AF frame may be the amount of movement for central projection.

[0094] In S1104, because the lens type of the attached lens unit is a fisheye lens, the system control unit 218 calculates the movement amount of the AF frame from the left and right sliding movement amount acquired in S1101. The system control unit 218 sets the movement amount of the AF frame when the lens type of the attached lens unit is a fisheye lens to, for example, double the movement amount of the AF frame when the lens type is not a fisheye lens (this may be the movement amount in the case of equidistant projection). In S1105, the system control unit 218 moves the AF frame displayed on the display unit 108 according to the movement amount of the AF frame set in S1103 or S1104. The system control unit 218 then ends the series of operations.

[0095] In this way, based on the characteristics of the attached lens unit, the system control unit 218 changes the amount of movement of the AF frame position depending on whether the lens type is a fisheye lens or not, for the same amount of movement of the touch bar 119. For example, the system control unit 218 makes the amount of movement of the AF frame when the lens is a fisheye lens twice the amount of movement of the AF frame when the lens is not a fisheye lens, for the same amount of movement of the touch bar 119. This allows the user to position the AF frame at a desired position on the screen with the same feel, whether using a fisheye lens or a normal lens that is not a fisheye lens.

[0096] The movement control process according to the fifth and sixth embodiments may be performed when the attached lens unit is a single lens or a twin lens. That is, the lens unit when it is a fisheye lens and the lens unit when it is not a fisheye lens may each have a configuration including multiple imaging optical systems with different optical axes (i.e., a twin lens configuration).

[0097] Furthermore, if the type of lens in the attached lens unit is a fisheye lens, the system control unit 218 may increase the amount of movement of the AF frame according to the image height (the angle of view on the imaging signal displayed on the display unit). In this way, the amount of movement of the AF frame can be changed according to the image height. On the other hand, if the type of lens in the attached lens unit is not a fisheye lens (i.e., a central projection lens), the system control unit 218 may not change the amount of movement of the AF frame according to the image height (the angle of view on the imaging signal displayed on the display unit).

[0098] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0099] (Disclosure of the present specification) The disclosure of this specification includes the following imaging device, its control method, and program. (Item 1) An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation on the operation means; an imaging device characterized in that the control means controls, based on the characteristics of the attached lens unit, so that, for the same amount of movement operation on the operation means, the amount of movement of the position of the AF frame differs between a lens unit with a first characteristic having an imaging optical system with one optical axis and a lens unit with a second characteristic having multiple imaging optical systems with different optical axes. (Item 2) The imaging device described in item 1 is characterized in that the control means controls the amount of movement of the position of the AF frame to be smaller in the case of a lens unit with the second characteristics than in the case of a lens unit with the first characteristics for the same amount of movement operation on the operation means, based on the characteristics of the attached lens unit. (Item 3) The imaging device described in item 2 is characterized in that the control means controls the movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement in the case of a lens unit with the second characteristics is half the amount of movement in the case of a lens unit with the first characteristics. (Item 4) An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation on the operation means; an imaging device characterized in that the control means controls, based on the characteristics of the attached lens unit, so that, for the same amount of movement operation on the operation means, the amount of movement of the position of the AF frame differs between a lens unit with a first characteristic in which the lens projection method is equidistant projection and a lens unit with a second characteristic in which the lens projection method is central projection. (Item 5) 5. The imaging device according to item 4, wherein the first characteristic lens unit and the second characteristic lens unit each have a plurality of imaging optical systems with different optical axes. (Item 6) 6. The imaging device according to item 4 or 5, wherein the control means controls the movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement when the projection method of the attached lens unit is equidistant projection is larger than the amount of movement when the projection method of the attached lens unit is central projection. (Item 7) 6. The imaging device according to item 4 or 5, characterized in that the control means controls the movement of the position of the AF frame so that, when the projection method of the lens of the attached lens unit is equidistant projection, the amount of movement is increased in accordance with the angle of view on the imaging signal displayed on the display means, and, when the projection method of the lens of the attached lens unit is central projection, the amount of movement is not changed in accordance with the angle of view on the imaging signal displayed on the display means. (Item 8) An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation on the operation means; The control means controls the position of the AF frame so that, based on the characteristics of the attached lens unit, the amount of movement of the position of the AF frame differs for the same amount of movement operation on the operation means between a lens unit with a first characteristic, which is a fisheye lens, and a lens unit with a second characteristic, which is not a fisheye lens. (Item 9) 9. The imaging device according to item 8, wherein the first characteristic lens unit and the second characteristic lens unit each have a plurality of imaging optical systems with different optical axes. (Item 10) Item 10. The imaging device described in item 8 or 9, characterized in that the control means controls the movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement when the lens type of the attached lens unit is a fisheye lens is larger than the amount of movement when the lens type of the attached lens unit is not a fisheye lens. (Item 11) 10. The imaging device according to item 8 or 9, characterized in that the control means controls the movement of the position of the AF frame so that, when the type of lens in the attached lens unit is a fisheye lens, the amount of movement is increased in accordance with the angle of view on the imaging signal displayed on the display means, and, when the type of lens in the attached lens unit is not a fisheye lens, the amount of movement is not changed in accordance with the angle of view on the imaging signal displayed on the display means. (Item 12) 12. The imaging device according to any one of items 1 to 11, wherein the operation unit accepts the movement operation according to the movement of the touch operation. (Item 13) 12. The imaging device according to any one of items 1 to 11, wherein the operation unit accepts the movement operation in accordance with pressing a key. (Item 14) 14. The imaging device according to any one of items 1 to 13, further comprising a determination means for determining whether the attached lens unit is a lens unit with the first characteristic or a lens unit with the second characteristic based on information acquired through communication with the attached lens unit. (Item 15) A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, a control method for an imaging device, characterized in that the control step controls, based on the characteristics of the attached lens unit, so that, for the same amount of movement operation on the operation means, the amount of movement of the position of the AF frame differs between a lens unit with a first characteristic having an imaging optical system with one optical axis and a lens unit with a second characteristic having multiple imaging optical systems with different optical axes. (Item 16) A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, a control method for an imaging device, characterized in that the control step controls the amount of movement of the position of the AF frame to be different for a lens unit with a first characteristic in which the lens projection method is equidistant projection, and a lens unit with a second characteristic in which the lens projection method is central projection, for the same amount of movement operation on the operation means, based on the characteristics of the attached lens unit. (Item 17) A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, a control method for an imaging device, characterized in that the control step controls the amount of movement of the position of the AF frame to be different for a lens unit with a first characteristic, in which the lens type is a fisheye lens, and a lens unit with a second characteristic, in which the lens type is not a fisheye lens, for the same amount of movement operation on the operating means, based on the characteristics of the attached lens unit. (Item 18) A program for causing a computer to function as each of the means of the imaging device described in any one of items 1 to 14.

[0100] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0101] 100: camera, 108: display unit, 110: directional keys, 119: touch bar, 124: communication terminal, 200: lens unit, 211: imaging unit, 502L: AF frame, 218: system control unit

Claims

1. An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation of the operation means; The control means controls the position of the AF frame so that, based on the characteristics of the attached lens unit, the amount of movement of the AF frame differs for the same amount of movement operation on the operating means between a lens unit with a first characteristic having an imaging optical system with one optical axis and a lens unit with a second characteristic having multiple imaging optical systems with different optical axes.

2. 2. The imaging device according to claim 1, wherein the control means controls the amount of movement of the position of the AF frame to be smaller in the case of a lens unit having the second characteristics than in the case of a lens unit having the first characteristics for the same amount of movement operation on the operation means, based on the characteristics of the attached lens unit.

3. 3. The imaging device according to claim 2, wherein the control means controls movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement in the case of a lens unit with the second characteristics is half the amount of movement in the case of a lens unit with the first characteristics.

4. An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation of the operation means; The control means controls the position of the AF frame so that, based on the characteristics of the attached lens unit, the amount of movement of the AF frame differs for the same amount of movement operation on the operation means between a lens unit with a first characteristic in which the lens projection method is equidistant projection and a lens unit with a second characteristic in which the lens projection method is central projection.

5. 5. The imaging device according to claim 4, wherein the first characteristic lens unit and the second characteristic lens unit each have a plurality of imaging optical systems with different optical axes.

6. 5. The imaging device according to claim 4, wherein the control means controls movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement when the projection method of the attached lens unit is equidistant projection is larger than the amount of movement when the projection method of the attached lens unit is central projection.

7. 5. The imaging device according to claim 4, wherein the control means controls the movement of the position of the AF frame so that, when the projection method of the lens of the attached lens unit is equidistant projection, the amount of movement is increased in accordance with the angle of view on the imaging signal displayed on the display means, and, when the projection method of the lens of the attached lens unit is central projection, the amount of movement is not changed in accordance with the angle of view on the imaging signal displayed on the display means.

8. An imaging device to which a lens unit can be attached, an acquisition means for acquiring characteristics of the attached lens unit; an operation means for accepting a movement operation; a control means for controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on the display means in response to a movement operation of the operation means; The control means controls the position of the AF frame so that, based on the characteristics of the attached lens unit, the amount of movement of the AF frame is different for the same amount of movement operation on the operating means in the case of a lens unit with a first characteristic in which the lens type is a fisheye lens and in the case of a lens unit with a second characteristic in which the lens type is not a fisheye lens.

9. 9. The imaging device according to claim 8, wherein the first characteristic lens unit and the second characteristic lens unit each have a plurality of imaging optical systems with different optical axes.

10. 9. The imaging device according to claim 8, wherein the control means controls the movement of the position of the AF frame so that, for the same amount of movement operation on the operation means, the amount of movement when the lens type of the attached lens unit is a fisheye lens is larger than the amount of movement when the lens type of the attached lens unit is not a fisheye lens.

11. 9. The imaging device according to claim 8, wherein the control means controls the movement of the position of the AF frame so that, when the type of lens of the attached lens unit is a fisheye lens, the amount of movement is increased in accordance with the angle of view on the imaging signal displayed on the display means, and, when the type of lens of the attached lens unit is not a fisheye lens, the amount of movement is not changed in accordance with the angle of view on the imaging signal displayed on the display means.

12. The imaging device according to claim 1 , wherein the operation unit accepts the movement operation in accordance with the movement of a touch operation.

13. 2. The imaging device according to claim 1, wherein the operation means accepts the movement operation in accordance with pressing a key.

14. 2. The imaging device according to claim 1, further comprising a determination unit that determines whether the attached lens unit is a lens unit with the first characteristic or a lens unit with the second characteristic based on information obtained through communication with the attached lens unit.

15. A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, A control method for an imaging device, characterized in that the control step controls the amount of movement of the position of the AF frame to be different for a lens unit with a first characteristic having an imaging optical system with one optical axis and a lens unit with a second characteristic having multiple imaging optical systems with different optical axes, for the same amount of movement operation on the operating means, based on the characteristics of the attached lens unit.

16. A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, A control method for an imaging device, characterized in that the control step controls the amount of movement of the position of the AF frame to be different for the same amount of movement operation on the operating means, based on the characteristics of the attached lens unit, in the case of a lens unit with a first characteristic in which the lens projection method is equidistant projection, and in the case of a lens unit with a second characteristic in which the lens projection method is central projection.

17. A control method for an imaging device to which a lens unit can be attached, comprising: an acquisition step in which acquisition means acquires characteristics of the attached lens unit; an operation step in which the operation means receives a movement operation; a control step of controlling the position of an AF frame indicating an area for detecting a defocus amount for an imaging signal displayed on a display means in response to a movement operation on the operation means, In the control step, the control method for an imaging device is characterized in that, based on the characteristics of the attached lens unit, the amount of movement of the position of the AF frame is controlled to be different for the same amount of movement operation on the operating means in the case of a lens unit with a first characteristic in which the lens type is a fisheye lens and in the case of a lens unit with a second characteristic in which the lens type is not a fisheye lens, for the same amount of movement operation on the operating means.

18. A program for causing a computer to function as each of the means of the imaging device according to any one of claims 1 to 14.

Images