Control device, imaging device, lens device, control method, and program

Abstract

To provide a control device that can improve convenience during tilt imaging. [Solution] A control device (9, 15) used in a camera system (1) having an imaging device (3) equipped with an image sensor (1106) and a lens device (2) equipped with an optical system including at least one optical member for tilting a focal plane (501) with respect to the imaging plane of the image sensor, wherein the control device has an acquisition unit that acquires first position information (1501) and second position information (1502) based on user instructions, and a determination unit that determines third position information (1503) not instructed by the user and constructs a focal plane from the first position information, second position information and third position information.

Description

Technical Field

[0001] The present invention relates to a control device, an imaging device, a lens device, a control method, and a program.

Background Art

[0002] Conventionally, an optical system having a tilt effect of tilting a focus plane so as to focus on an object plane tilted with respect to the optical axis of an imaging optical system is known.

[0003] Patent Document 1 discloses a method for calculating tilt angles in the vertical and horizontal directions. Patent Document 2 discloses a tilt drive method using the in-focus degrees of two regions.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the calculation method disclosed in Patent Document 1, tilt angles in directions other than the vertical and horizontal directions cannot be calculated. Therefore, for example, when driving in an oblique direction or the like, it may not be possible to set an appropriate focus plane. In the tilt drive method disclosed in Patent Document 2, since information other than the in-focus degrees of two regions is not disclosed, it may not be possible to set a desired focus plane when the two regions are close to each other.

[0006] Therefore, an object of the present invention is to provide a control device capable of improving convenience during tilt photography.

Means for Solving the Problems

[0007] A control device as one aspect of the present invention is a control device used in an imaging system having an image sensor, an optical system capable of tilting the focal plane with respect to the imaging plane of the image sensor, and an instruction unit that receives instructions from a user, the control device comprising: an acquisition unit that acquires first position information and second position information based on a position instructed by the user in the instruction unit; and a determination unit that determines a position different from the position instructed by the user in the instruction unit and acquires third position information based on that position, the determination unit determining the focal plane based on the first position information, the second position information and the third position information.

[0008] Other objects and features of the present invention are described in the following embodiments. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a control device that can improve the convenience of tilt imaging. [Brief explanation of the drawing]

[0010] [Figure 1] This is a cross-sectional view of the camera system in each embodiment. [Figure 2] This is a flowchart showing the control method of the lens CPU in each embodiment. [Figure 3] This is a block diagram of the camera system in each embodiment. [Figure 4] This is an explanatory diagram of the principle of Scheinproof in each embodiment. [Figure 5] This is an explanatory diagram of the subject surface in the space relative to the image sensor in each embodiment. [Figure 6] This is an explanatory diagram of tilt imaging in the first embodiment. [Figure 7] This is a flowchart showing tilt imaging in the first embodiment. [Figure 8] This is an explanatory diagram of tilt imaging in the second embodiment. [Figure 9]This is an explanatory diagram of tilt imaging in the third embodiment. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described in detail below with reference to the drawings. In each figure, the same reference numerals are used for the same components, and redundant descriptions are omitted.

[0012] (First Embodiment) First, the camera system (imaging system) 1 in the first embodiment of the present invention will be described with reference to Figures 1(a), (b) to 3. Figure 1(a) is a cross-sectional view of the camera system 1, and Figure 1(b) is a block diagram of the lens CPU 9. Figure 2 is a flowchart of the control method for the lens CPU 9. Figure 3 is a block diagram of the camera system 1.

[0013] As shown in Figures 1(a) and 3, the camera system 1 includes a lens device 2 and a camera body (imaging device) 3. The lens device 2 and the camera body 3 are connected via a mount 5 provided on the lens device 2 and a mount (not shown) provided on the camera body 3, and can communicate with each other via a lens communication unit 17 provided on the lens device 2 and a camera communication unit 18 provided on the camera body 3. The lens communication unit 17 and the camera communication unit 18 each include contacts 1009 and 1010 for supplying power from the camera body 3 to the lens device 2. In this embodiment, the vertical direction (direction of gravity) in Figure 1 is defined as the Y-axis direction, the direction parallel to the optical axis O of the optical system included in the lens device 2 is defined as the Z-axis direction, and the direction perpendicular to the Y-axis direction and the Z-axis direction is defined as the X-axis direction.

[0014] The camera body 3 includes an imaging device 1106, a display unit 1108, a camera CPU 15, and a viewfinder 16. By controlling a shutter (not shown) with the camera CPU 15, an image formed through the lens device 2 can be exposed to the imaging device 1106 for an arbitrary period of time to perform shooting. The display unit 1108 displays a captured image and a setting screen for changing various settings of the camera system 1. In the present embodiment, the display unit 1108 is provided on the back surface of the camera body 3 and has a touch panel function. The user can check the captured image and perform line-of-sight input by looking into the viewfinder 16.

[0015] The lens device 2 includes an optical system, a zoom operation ring 6, a guide cylinder 7, a cam cylinder 8, a lens CPU 9, and an aperture mechanism 11. The optical system (imaging optical system) includes a first lens group 21, a second lens group 22, a third lens group 23, a fourth lens group 24, a fifth lens group 25, a sixth lens group 26, a seventh lens group 27, an eighth lens group 28, a ninth lens group 29, and a tenth lens group 30. In the present embodiment, by moving at least one lens group (optical member) included in the optical system, at least one of a tilt effect of tilting the focus plane with respect to the imaging surface of the imaging device 1106 and a shift effect of moving the shooting range can be obtained.

[0016] Each lens group is held by a lens barrel having a cam follower. The cam follower engages with a straight groove provided in the guide cylinder 7 parallel to the optical axis O and a groove provided in the cam cylinder 8 having an inclination with respect to the optical axis O. When the zoom operation ring 6 rotates, the cam cylinder 8 rotates, and the positional relationship of each lens in the Z-axis direction changes. As a result, the focal length of the lens device 2 changes. The focal length of the lens device 2 can be detected by a zoom position detection unit (not shown) that detects the rotation amount of the zoom operation ring 6. The lens CPU 9 controls the aperture mechanism 11 to change the aperture diameter of the optical system. In the present embodiment, each lens group may be either a single lens or a plurality of lenses.

[0017] The second lens group 22 is a focus group (focus member) that performs focusing by moving in the Z-axis direction. The lens CPU 9 controls the second lens group 22 via the vibration actuator 31 using a detection signal from a detection unit that detects the amount of movement of the second lens group 22.

[0018] The lens device 2 has a tilt member that tilts the focus plane with respect to the imaging surface of the imaging device 1106. In the present embodiment, the tilt member is the sixth lens group (first optical member) 26 and the eighth lens group (second optical member) 28 that are movable in a direction orthogonal to the optical axis O. In the present embodiment, by moving the sixth lens group 26 and the eighth lens group 28 in a direction orthogonal to the optical axis O, a tilt effect and a shift effect can be obtained. Specifically, when both the sixth lens group 26 and the eighth lens group 28 have a positive refractive power or a negative refractive power, a tilt effect is generated by moving the sixth lens group 26 and the eighth lens group 28 in opposite directions. Conversely, a shift effect is generated by moving the sixth lens group 26 and the eighth lens group 28 in the same direction. On the other hand, when the sixth lens group 26 and the eighth lens group 28 have refractive powers with opposite signs of positive and negative, a tilt effect is generated by moving the sixth lens group 26 and the eighth lens group 28 in the same direction. Conversely, a shift effect is generated by moving the sixth lens group 26 and the eighth lens group 28 in opposite directions.

[0019] The lens CPU 9 controls the sixth lens group 26 via a drive unit using a signal from a detection unit (not shown) that detects the amount of movement of the sixth lens group 26. The lens CPU 9 also controls the eighth lens group 28 via a drive unit using a signal from a detection unit (not shown) that detects the amount of movement of the eighth lens group 28. The drive unit that moves the sixth lens group 26 and the eighth lens group 28 is, for example, a stepping motor or a voice coil motor (VCM). Note that it is also possible to obtain a tilt effect by tilting (rotating) the lens.

[0020] As shown in Figure 1(b), the lens CPU (control device) 9 comprises an acquisition unit 9a and a control unit 9b, and controls the operation of each component of the lens device 2. The acquisition unit 9a acquires information about the designated subject. The control unit 9b acquires information about the position of the subject in order to construct the subject plane (focus plane) based on the information about the designated subject. In this embodiment, the lens CPU 9 is mounted within the lens device 2, but it may be configured as a separate control device from the lens device 2. Furthermore, the camera CPU 15 may be configured to have at least some of the functions of the acquisition unit 9a and the control unit 9b.

[0021] The lens CPU 9 performs control as shown in Figure 2. First, in step S1, the acquisition unit 9a acquires information about the specified subject. Subsequently, in step S2, the control unit 9b acquires information about the position of the subject in order to construct a subject plane based on the information about the specified subject.

[0022] As shown in Figure 3, the camera CPU (control unit) 15 is composed of a microcomputer and controls the operation of each part within the camera body 3. When the lens device 2 is attached to the camera body 3, the camera CPU 15 communicates with the lens CPU 9 via the lens communication unit 17 and the camera communication unit 18. The information (signals) that the camera CPU 15 transmits to the lens CPU 9 includes information on the amount of movement of the second lens group 22 and focus shift information. It also includes attitude information of the camera body 3 based on signals from the camera attitude detection unit 1110, such as an acceleration sensor. Furthermore, it includes subject distance information of the subject based on signals from the TS instruction unit 1109, which indicates the desired subject that the user wants to focus on, and shooting range information that indicates the desired shooting range (field of view).

[0023] The information (signals) transmitted by the lens CPU 9 to the camera CPU 15 includes, for example, optical information such as the imaging magnification of the lens, and lens function information such as zoom and image stabilization mounted on the lens device 2. It may also include attitude information of the lens device 2 based on signals from the lens attitude detection unit 1008, such as a gyro sensor or an accelerometer.

[0024] The power switch 1101 is a user-operable switch used to start the camera CPU 15 and to begin supplying power to various actuators and sensors within the camera system 1. The release switch 1102 is a user-operable switch and comprises a first-stroke switch SW1 and a second-stroke switch SW2. The signal from the release switch 1102 is input to the camera CPU 15. The camera CPU 15 enters a shooting preparation state in response to the ON signal input from the first-stroke switch SW1. In the shooting preparation state, the photometering unit 1103 measures the brightness of the subject and the focus detection unit 1104 detects the focus.

[0025] The camera CPU 15 calculates the aperture value of the aperture mechanism 11 and the exposure amount (shutter time in seconds) of the image sensor 1106 based on the photometering results from the photometering unit 1103. The camera CPU 15 also determines the amount of movement (including the drive direction) of the second lens group 22 based on the focus information (defocus amount and defocus direction) of the optical system detected by the focus detection unit 1104. Information regarding the amount of movement of the second lens group 22 is transmitted to the lens CPU 9.

[0026] In this embodiment, as described above, tilt and shift effects can be obtained by moving the sixth lens group 26 and the eighth lens group 28 in a direction perpendicular to the optical axis O. The camera CPU 15 calculates the tilt drive amount to focus on the desired subject indicated by the TS indicator unit 1109. In this embodiment, the TS indicator unit 1109 is included in the display unit 1108 which has a touch panel function. The camera CPU 15 also calculates the shift drive amount to change from the current shooting range to the shooting range indicated by the TS indicator unit 1109. The camera CPU 15 transmits information about the acquired drive amount to the lens CPU 9. The sixth lens group 26 and the eighth lens group 28 are controlled based on the information about the drive amount described above.

[0027] The number of subjects indicated by the TS indicator unit 1109 may be multiple. Even if subjects at different distances are indicated, it is possible to focus as long as they are positioned on the tilted subject plane due to the tilt effect. Furthermore, the TS indicator unit 1109 may be provided on the lens device 2 instead of the camera body 3. In addition, the function of the TS indicator unit 1109 may be assigned to an operation unit already provided in the camera system 1.

[0028] When the camera CPU 15 is set to a predetermined shooting mode, it starts controlling the eccentric drive of the image-stabilizing lens (not shown), i.e., the image stabilization operation. If the lens device 2 does not have an image stabilization function, the image stabilization operation will not be performed. The camera CPU 15 also sends an aperture drive command to the lens CPU 9 in response to the ON signal input from the second stroke switch SW2, setting the aperture mechanism 11 to a previously acquired aperture value. The camera CPU 15 also sends an exposure start command to the exposure unit 1105, causing the mirror (not shown) to retract and the shutter (not shown) to open. If the camera body 3 is a mirrorless camera, the mirror retraction operation will not be performed. Furthermore, the camera CPU 15 causes the image sensor 1106 to perform photoelectric conversion of the subject image, i.e., the exposure operation.

[0029] The imaging signal from the image sensor 1106 is digitally converted by the signal processing unit in the camera CPU 15, and further corrected before being output as an image signal. The image signal (data) is stored in the image recording unit 1107, such as a semiconductor memory like flash memory, a magnetic disk, or an optical disk.

[0030] The display unit 1108 can display images captured by the image sensor 1106 during shooting. The display unit 1108 can also display images recorded in the image recording unit 1107.

[0031] Next, the internal control flow of the lens device 2 will be described. The focus operation rotation detection unit 1002 detects the rotation of the focus operation ring 19. The aperture operation rotation detection unit 1011 detects the rotation of the aperture operation ring 20. The zoom operation rotation detection unit 1003 detects the rotation of the zoom operation ring 6. The subject memory unit 1012 stores the spatial position of the subject instructed by the TS instruction unit 1109 within the shooting range (position information in space with respect to the image sensor 1106). Here, the spatial position refers to the distance to the subject and coordinate information of the spatial coordinate system with respect to the image sensor 1106.

[0032] The TS operation detection unit 1001 includes a manual operation unit for obtaining tilt and shift effects, and a sensor for detecting the amount of operation of the manual operation unit. The IS drive unit 1004 includes a drive actuator for the vibration-damping lens that performs vibration damping operation, and a drive circuit for the drive actuator. Note that if the lens device 2 does not have a vibration damping function, the above configuration is not necessary. The focus drive unit 1006 includes a second lens group 22 and a vibration actuator 31 that moves the second lens group 22 in the Z-axis direction according to the amount of movement information. The amount of movement information may be determined based on a signal from the camera CPU 15, or it may be determined based on a signal output by operating the focus operation ring 19.

[0033] The electromagnetic aperture drive unit 1005 changes the aperture mechanism 11 to an open state corresponding to the instructed aperture value in response to instructions from the lens CPU 9, which has received an aperture drive command from the camera CPU 15, or in response to user instructions via the aperture operation ring 20. The TS drive unit 1007 moves the sixth lens group 26 and the eighth lens group 28 in response to instructions from the lens CPU 9 based on subject distance, position information, and shooting range information from the camera CPU 15. The lens CPU 9 controls the TS drive unit 1007 and the focus drive unit 1006 to operate optimally in order to obtain the desired focus. Furthermore, the lens device 2 has optical characteristics that allow the focus to change even if the subject distance does not change due to the shifting operation of the sixth lens group 26 and the eighth lens group 28, and the TS drive unit 1007 and the focus drive unit 1006 are controlled to operate optimally in accordance with these optical characteristics.

[0034] Furthermore, a gyro sensor is provided inside the lens device 2, electrically connected to the lens CPU 9. The gyro sensor detects the angular velocity of the vertical (pitch direction) and horizontal (yaw direction) oscillations of the camera system 1, and outputs the detected values ​​as angular velocity signals to the lens CPU 9. The lens CPU 9 electrically or mechanically integrates the angular velocity signals in the pitch and yaw directions from the gyro sensor to calculate the amount of displacement in each direction, namely the pitch oscillation and yaw oscillation (collectively referred to as the angular oscillation).

[0035] The lens CPU 9 controls the IS drive unit 1004 based on the combined displacement of the angular and parallel runout amounts described above to move the image-stabilizing lens (not shown) and perform angular runout correction and parallel runout correction. Note that if the lens device 2 does not have an image stabilization function, the above configuration is unnecessary. The lens CPU 9 also controls the focus drive unit 1006 based on the focus runout amount to move the second lens group 22 in the Z-axis direction and perform focus runout correction.

[0036] In the lens device 2, the lens CPU 9 controls the TS drive unit 1007 based on the amount of shake and displacement of the lens device 2 calculated based on the output from the gyro sensor. For example, if camera shake occurs when shooting handheld with the camera body 3, the subject plane will shift relative to the subject. However, since the subject's position is stored in the subject memory unit 1012 of the camera body 3, the TS drive unit 1007 can be controlled to correct the shake and keep the subject plane aligned with the subject. The signal from the acceleration sensor mounted on the camera body 3 may be used to control the TS drive unit 1007. Note that the lens device 2 may also be equipped with an acceleration sensor in addition to the gyro sensor.

[0037] Next, the Scheinproof principle will be explained with reference to Figures 4(a) to 4(c). Figure 4(a) shows the range of focus when the optical axis of the optical system 1201 is not tilted with respect to the image sensor 1200. Figure 4(b) shows the range of focus when the optical axis of the optical system 1201 is tilted with respect to the image sensor 1200. The Scheinproof principle states that, as shown in Figure 4(b), when the image sensor 1200 and the principal surface 1203 of the optical system intersect at intersection 1204, the subject surface 1202 that is in focus also passes through intersection 1204. Therefore, when the optical axis of the optical system 1201 is tilted with respect to the image sensor 1200, the range of focus on the subject is determined by the Scheinproof principle. If the subject to be photographed has depth, by tilting the subject surface 1202 to follow that depth, it is possible to focus on the subject from the foreground to the background. On the other hand, by tilting the main surface 1203 of the optical system 1201 in the opposite direction to the inclination of the subject with depth, it is also possible to intersect the subject surface 1202 with respect to the depth direction of the subject at an angle close to a right angle. In this case, the range of focus can be made extremely narrow, so it is possible to obtain a diorama-like image.

[0038] In this embodiment, as shown in Figure 4(c), the tilt θobj of the subject plane 1202 is generated without tilting the imaging plane 1200 by the amount of image tilt θimg by utilizing the image drift caused by the eccentricity of the optical system 1201. However, if the tilt θobj of the subject plane 1202 is generated using only the optical system 1201, the amount of eccentricity of the optical system 1201 increases, resulting in a larger composition shift. Therefore, it is preferable to eccentricize a lens that is designed to minimize aberration fluctuations during eccentricity. In this embodiment, in order to change the tilt effect, the sixth lens group 26, which generates the tilt of the subject plane, and the eighth lens group 28, which minimizes aberration fluctuations during eccentricity, are made to operate eccentrically.

[0039] Next, with reference to Figure 5, the subject plane (focus plane 500) in space relative to the image sensor 1106 will be described. Figure 5 is an explanatory diagram of the focus plane 500 in space relative to the image sensor 1106. The camera system 1 can acquire positional information of the first subject 1301 and the second subject 1302 in the Z-axis direction by, for example, a focus detection system (not shown) using infrared light or a focus detection function mounted on the image sensor 1106. The camera system 1 can also acquire positional information in the X-axis direction and the Y-axis direction based on the imaging positions of the first subject 1301 and the second subject 1302 on the imaging plane of the image sensor 1106.

[0040] In this embodiment, the user can indicate a subject by touching the display unit 1108 and obtain information regarding the position of the indicated subject. For example, if the user specifies a first point 1401 on the display unit 1108, the camera body 3 obtains first coordinates (first position information) 1501, which are information regarding the position of the first subject 1301. The obtained information is stored in the subject storage unit 1012. The memory (not shown) of the lens device 2 stores table data showing the relationship between the amount and direction of movement of the sixth lens group 26 and the eighth lens group 28 and the amount of tilt of the focal plane 500 relative to the optical axis O. The camera CPU 15 and the lens CPU 9 perform calculations using the position information and table data stored in the subject storage unit 1012, and control the sixth lens group 26 and the eighth lens group 28 based on the calculation results to construct the focal plane 500. Alternatively, instead of using table data, the relationship between the amount of lens movement and the amount of tilt of the focal plane 500 may be calculated using a predetermined formula, and the sixth lens group 26 and the eighth lens group 28 may be controlled using the calculation results. Alternatively, the focal plane 500 may be constructed by gradually moving the sixth lens group 26 and the eighth lens group 28 and determining the focus level of each subject.

[0041] Next, with reference to Figures 6(a) to 6(e), we will explain the shooting method using the tilt effect in this embodiment. Figures 6(a) to 6(e) are explanatory diagrams illustrating the sequence of tilt shooting assuming portrait photography.

[0042] First, as shown in Figure 6(a), the user designates the first point 1401 on the camera body 3 so that the first subject 1301 is in focus. Figure 6(a) shows the state where the first subject 1301 is in focus and the second subject 1302 is out of focus. At this time, the camera body 3 acquires the first coordinate (first position information) 1501 based on the position information and focal length information of the first point 1401 and the first subject 1301 in the Z-axis direction, and stores it in the subject storage unit 1012. At the same time, as shown in Figure 6(b), the camera body 3 acquires the first subject range 1404 of the first subject 1301. Note that the method for acquiring the subject range (size, area of ​​the subject) is publicly known, so a detailed explanation is omitted.

[0043] Next, as shown in Figure 6(c), the camera body 3 estimates the third point 1403 from the first subject range 1404. The camera body 3 then calculates the third coordinate (third position information) 1503 based on the Z-axis position information of the first subject 1301 and the position and focal length information of the third point 1403, and stores it in the subject storage unit 1012. The third point 1403 is preferably selected within the first subject range 1404 such that it is the maximum distance from the first point 1401, but it is acceptable for it to be specified at a position far from the first point 1401 (a position different from the first point 1401). For example, in the case of photographing a person standing upright, if the face is specified as the first point, it is preferable for the feet to be specified as the third point.

[0044] Next, as shown in Figure 6(d), the user specifies the second point 1402 on the camera body 3 so that the second subject 1302 is in focus. Figure 6(d) shows the state where the second subject 1302 is in focus and the first subject 1301 is out of focus. At this time, the camera body 3 acquires the second coordinate (second position information) 1502 based on the Z-axis position information and focal length information of the second point 1402 and the second subject 1302, and stores it in the subject storage unit 1012.

[0045] Next, the camera CPU 15 performs the calculations necessary to construct the focal plane 501 using the first coordinate 1501 and second coordinate 1502 specified by the user, the third coordinate 1503 estimated by the camera body 3, and the table data. Based on the results, the sixth lens group 26, the eighth lens group 28, and the second lens group 22 are controlled to construct the focal plane 501. Once the focal plane 501 is constructed, tilt shooting becomes possible with the first subject 1301 and the second subject 1302 in focus.

[0046] The user only needs to specify two points to focus on, and tilt shooting is possible without the user having to specify a third point, thus improving the convenience of tilt shooting.

[0047] Furthermore, when constructing the focal plane 501, if it is difficult to do so solely by moving the second lens group 22, the sixth lens group 26, and the eighth lens group 28, the camera body 3 can change the range of focus by driving the aperture mechanism 11. This allows the range of focus to be enlarged or reduced, making it easier to obtain the desired image.

[0048] In this embodiment, a method for constructing the focal plane (subject plane) 501 was described after obtaining three points: a first coordinate 1501 specified by the user, a second coordinate 1502, and a third coordinate 1503 estimated by the camera body 3. However, as shown in Figures 6(c) and (e), a vector 1405 passing through the first coordinate 1501 and the third coordinate 1503 may be calculated, and the focal plane 501 may be constructed by rotating the subject plane around the axis of vector 1405 so that the focus is on the second coordinate 1502.

[0049] In this embodiment, the third point 1403 is estimated from the first subject range 1404 of the first subject 1301 and the third coordinate 1503 is obtained. However, the subject range of the second subject 1302 may be detected, the third point 1403 may be estimated from that range, and the third coordinate 1503 may be obtained.

[0050] Next, with reference to Figure 7, the tilt shooting (control method) in this embodiment will be described in detail. Figure 7 is a flowchart of tilt shooting. Although each step in Figure 7 is described as being performed by the camera CPU 15 (functioning as an acquisition unit and a decision unit), it is not limited to this. Each step in Figure 7 may be performed by either the camera CPU 15 or the lens CPU 9, or the camera CPU 15 and the lens CPU 9 may share the execution of each step. That is, each step in Figure 7 is performed by at least one of the camera CPU 15 or the lens CPU 9, or based on instructions from at least one of the camera CPU 15 or the lens CPU 9. Furthermore, a control device physically separated from the camera CPU 15 or the lens CPU 9 may be configured to perform at least some of the steps.

[0051] First, in step S101, the user specifies the first point. Next, in step S102, the camera CPU 15 uses a focus detection system (distance measuring unit), not shown, to acquire the Z-axis position information (distance information) of the subject located at the first point specified by the user. Next, in step S103, the camera CPU 15 acquires the X-axis and Y-axis position information based on the imaging position of the subject on the imaging surface of the image sensor 1106. Then, the camera CPU 15 acquires (calculates) a 3D coordinate, the first coordinate (first position information), based on the X-axis and Y-axis position information and the Z-axis position information acquired in step S102, and stores it in the subject storage unit 1012.

[0052] Next, in step S104, the camera CPU 15 detects the range (size, area) and type of the subject located at the first point specified by the user in step S101, based on the subject information detected from the image data output from the image sensor 1106. Next, in step S105, the camera CPU 15 determines whether the third point can be estimated from the range and type of the subject detected in step S104. If the camera CPU 15 determines that the third point can be estimated, the process proceeds to step S106. On the other hand, if the camera CPU 15 determines that the third point cannot be estimated, the process proceeds to step S107. In step S106, the camera CPU 15 calculates the third coordinate based on the third point estimated in step S105 and the position information acquired in step S102, and stores it in the subject storage unit 1012.

[0053] In step S107, the user specifies a second point. Then, in step S108, the camera CPU 15 uses a focus detection system (not shown) to acquire the Z-axis position information (distance information) of the subject located at the second point specified by the user. Next, in step S109, the camera CPU 15 acquires the X-axis and Y-axis position information from the imaging position of the subject on the imaging surface of the image sensor 1106. Then, based on the X-axis and Y-axis position information and the Z-axis position information acquired in step S108, the camera CPU 15 acquires (calculates) a second coordinate (second position information), which is a three-dimensional coordinate, and stores it in the subject storage unit 1012.

[0054] Next, in step S110, the camera CPU 15 determines whether the third coordinate has been stored. If it is determined that the third coordinate has been stored, the process proceeds to step S114. In step S114, the camera CPU 15 calculates the tilt drive direction and drive amount and determines the drive direction and drive amount for the sixth lens group 26, the eighth lens group 28, and the second lens group 22. Next, in step S115, the camera CPU 15 determines whether tilt drive is possible based on whether the drive direction and drive amount determined in step S114 exceed the movable range of the sixth lens group 26 and the eighth lens group 28. If it is determined that tilt drive is possible, the process proceeds to step S117, where the camera CPU 15 drives the sixth lens group 26, the eighth lens group 28, and the second lens group 22 to construct the focal plane 501. Next, in step S118, the camera CPU 15 performs a shooting operation, saves the captured image to the image recording unit 1107, and terminates this flow.

[0055] On the other hand, if it is determined in step S110 that the third coordinate is not stored, the process proceeds to step S111. In step S111, the camera CPU 15 detects the range and type of subject located at the second point specified by the user in step S107, based on the subject information detected from the image data output from the image sensor 1106. Subsequently, in step S112, the camera CPU 15 determines whether the third point can be estimated based on the range and type of subject detected in step S111. If it is determined that the third point can be estimated, the process proceeds to step S113. In step S113, the camera CPU 15 calculates the third coordinate (third position information), which is a three-dimensional coordinate, based on the third point estimated in step S112 and the position information acquired in step S109, and stores it in the subject storage unit 1012. After that, the process proceeds to step S114. On the other hand, if it is determined in step S112 that the third point cannot be estimated, the process proceeds to step S116. In step S116, the camera CPU 15 displays a warning to the user that it is not possible to construct the subject plane. Then, the process returns to step S101, and the user specifies the first point again.

[0056] If, in step S115, it is determined that the drive direction and drive amount determined in step S114 exceed the movable range of the sixth lens group 26 and the eighth lens group 28, the process proceeds to step S116. In step S116, the camera CPU 15 displays a warning to the user that the subject plane cannot be constructed. After that, the process returns to step S101, and the user specifies the first point again.

[0057] (Second Embodiment) Next, a second embodiment of the present invention will be described with reference to Figures 8(a) to 8(d). In this embodiment, components common to the first embodiment will be denoted by the same reference numerals as in the first embodiment and will not be described.

[0058] Figures 8(a) to 8(d) are explanatory diagrams illustrating the sequence of tilt shooting assuming product photography in this embodiment. First, as shown in Figure 8(a), the user designates the first point 2401 on the camera body 3 so that the first subject 2301 is in focus. Figure 8(a) shows the state where the first subject 2301 is in focus and the second subject 2302 is out of focus. At this time, the camera body 3 acquires the first coordinate (first position information) 2501 based on the position information and focal length information of the first point 2401 and the first subject 2301 in the Z-axis direction, and stores it in the subject storage unit 1012. At this time, the camera body 3 also acquires the first subject range 2411 of the first subject 1301 and determines the type of subject. Note that the method for acquiring the subject range and the method for determining the type are publicly known, so a detailed explanation of them is omitted.

[0059] Next, as shown in Figure 8(b), the user specifies the second point 2402 on the camera body 3 so that the second subject 2302 is in focus. Figure 8(b) shows the state where the second subject 2302 is in focus and the first subject 2301 is out of focus. At this time, the camera body 3 acquires the second coordinate (second position information) 2502 based on the position information and focal length information of the second point 2402 and the second subject 2302 in the Z axis direction and stores it in the subject storage unit 1012. At this time, the camera body 3 also acquires the second subject range 2412 of the second subject 2302 and determines the type of subject. The camera CPU 15 determines the shooting scene based on the types of the first subject 2301 and the second subject 2302. In this embodiment, it is determined to be a shooting scene of a product.

[0060] Next, as shown in Figure 8(c), the camera CPU 15 calculates a vector 2405 that passes through the first coordinate 2501 and the second coordinate 2502. If the shooting scene is determined to be a still-life shot, the camera CPU 15 changes the plane of focus based on the axis of vector 2405 in order to set the third point 2403 so that the range of focus (the range in focus) of the shooting range is widened (preferably maximized). Specifically, in Figure 8(c), the plane of focus 500 is changed so that the third subject 2303 is also in focus. As a result, as shown in Figure 8(d), a plane of focus 501 is constructed in which the first subject 2301, the second subject 2302, and the third subject 2303 are in focus.

[0061] In this way, the user only needs to specify two points to focus on, and tilt shooting becomes possible without the user having to specify a third point, thus improving the convenience of tilt shooting.

[0062] In this embodiment, when it is determined that the subject is being photographed as an object, the focus range is set to be maximized. However, the focal plane 501 may be constructed so that the first subject range 2411 and the second subject range 2412 are in focus. In this embodiment, a vector 2405 is calculated and the focal plane is changed based on the axis of the vector 2405. However, a third point 2403 may be set in advance by searching for a third subject 2303, a third coordinate may be calculated based on that information, and a focal plane passing through the three coordinates may be set.

[0063] In this embodiment, a vector 2405 is calculated, and the focal plane 500 is changed around the axis of vector 2405 to set the range in focus of the shooting range to the maximum, but it is not limited to this. The camera body 3 can take multiple shots when changing the focal plane 500. As for the method of setting the focal plane, it is sufficient to change it within the driveable range of the sixth lens group 26 and the eighth lens group 28, and it is preferable to drive them to a position where the drive amount of the sixth lens group 26 and the eighth lens group 28 is at least the minimum or maximum, and take multiple shots.

[0064] This allows for the acquisition of multiple photographs in which the first subject 2301 and the second subject 2302 are in focus at specified points. As a result, the user can later select photographs that are in focus within the desired range, further improving the convenience of tilt-shift photography.

[0065] (Third embodiment) Next, a third embodiment of the present invention will be described with reference to Figures 9(a) and 9(b). In this embodiment, components common to the first embodiment will be denoted by the same reference numerals as in the first embodiment and will not be described.

[0066] Figures 9(a) and 9(b) are explanatory diagrams illustrating the sequence of tilt shooting assuming miniature shooting (diorama shooting) in this embodiment. First, the user sets the shooting mode of the camera body 3 to miniature shooting mode. In Figure 9(a), the user specifies the first point 3401 on the camera body 3 so that the subject 3301 is in focus. At this time, the camera body 3 acquires the first coordinate (first position information) 3501 based on the position information and focal length information of the first point 3401 and the subject 3301 in the Z-axis direction, and stores it in the subject storage unit 1012.

[0067] Next, the user specifies a second point 3402 as a point different from the first point 3401 of the subject 3301. The camera body 3 acquires a second coordinate (second position information) 3502 based on the second point 3402 and the Z-axis position information and focal length information of the subject 3301, and stores it in the subject storage unit 1012. After that, it detects the edges 3404 and 3405 of the subject 3301. The method for detecting the edges of the subject is publicly known, so its explanation is omitted. The camera CPU 15 estimates a third point 3403 from the detected edges 3404 and 3405 so that it will perform inverse tilt photography (miniature photography), and acquires (calculates) a third coordinate (third position information) 3503 while referring to the information of the first coordinate 3501 and the second coordinate 3502.

[0068] Subsequently, as shown in Figure 9(b), the camera CPU 15 drives the second lens group 22, the sixth lens group 26, and the eighth lens group 28 to create a focal plane so that only the first coordinate 3501, the second coordinate 3502, and the third coordinate 3503 are in focus. Specifically, only subject 3301 is in focus, while the other subjects 3302, 3303, and 3304 are out of focus, making it possible to take miniature-style photographs.

[0069] In this way, the user only needs to specify two points to focus on, and tilt shooting becomes possible without the user having to specify a third point, thus improving the convenience of tilt shooting.

[0070] In this embodiment, one subject 3301 is selected, but the user may select multiple subjects. Also, in this embodiment, the focus is set to be only within the range of subject 3301, but it is not limited to this, as long as the third coordinate is set to achieve reverse tilt shooting. Also, in this embodiment, a point specified by the user is described, but it is not limited to this, and a surface with a certain range may be indicated. For example, it may be indicated within the range of the zone AF metering frame, as long as the coordinates can be calculated.

[0071] As described above, the control device (camera CPU 15 or lens CPU 9) of each embodiment has an acquisition unit (functioning as an acquisition unit 9a) and a determination unit (functioning as a control unit 9b). The acquisition unit acquires first position information (first coordinates) and second position information (second coordinates) based on user instructions. The determination unit determines the focal plane 501 based on the first and second position information and third position information (third coordinates) not specified by the user. According to each embodiment, the user can construct a desired subject plane by simply specifying two points. This makes it possible to take the desired shot and shorten the working time, thereby improving the convenience of tilt shooting.

[0072] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0073] According to each embodiment, it is possible to provide a control device, imaging device, lens device, control method, and program that can improve the convenience of tilt imaging.

[0074] Each embodiment of the disclosure includes the following configuration and method.

[0075] (Composition 1) A control device used in a camera system having an imaging device equipped with an image sensor and a lens device equipped with an optical system including at least one optical element for tilting the focal plane with respect to the imaging surface of the image sensor, An acquisition unit that acquires first location information and second location information based on user instructions, A control device characterized by having a determination unit that determines a third position information not specified by the user and constructs the focal plane from the first position information, the second position information and the third position information. (Configuration 2) The control device according to configuration 1, characterized in that the determination unit determines the third position information based on image data output from the image sensor. (Composition 3) The control device according to configuration 2, characterized in that the determination unit determines the third position information based on subject information detected from the image data. (Composition 4) The control device according to configuration 3, characterized in that the subject information is at least one of the type of subject, the range of the subject, or information regarding the edges of the subject. (Composition 5) The control device according to configuration 4, characterized in that the determination unit determines the third position information based on the range of the subject corresponding to the first position information or the second position information, such that the focus range of the subject is widened. (Composition 6) The control device according to configuration 1, characterized in that the determination unit determines the third position information based on the shooting scene. (Composition 7) The control device according to configuration 6, characterized in that the shooting scene is determined based on image data output from the image sensor. (Composition 8) The control device according to configuration 7, characterized in that the shooting scene is determined based on subject information detected from the image data. (Composition 9) The control device according to configuration 6, characterized in that the shooting scene is determined based on a mode set by the user. (Composition 10) The control device according to any one of configurations 1 to 9, characterized in that the determination unit determines the third position information based on at least one of the following: focal length, focus position, or aperture value. (Composition 11) The control device according to any one of configurations 1 to 10, characterized in that the determination unit determines the third position information while changing the aperture value. (Composition 12) The aforementioned determination unit, Based on the first position information and the second position information, the axis of rotation is determined. The control device according to configuration 1, characterized in that the focal plane is rotated around the rotation axis by changing the third position information. (Composition 13) The control device according to any one of configurations 1 to 12, further comprising a drive unit for driving at least one of a tilt member that inclins the focal plane with respect to the imaging plane of the image sensor, or a focus member that performs focus adjustment. (Composition 14) The control device according to configuration 12, characterized in that the determination unit rotates the focal plane so as to include a focal plane in which the amount of movement of the tilt member that inclins the focal plane with respect to the imaging surface of the image sensor is minimum or maximum. (Composition 15) The control device according to configuration 13, wherein the drive unit drives the tilt member to a predetermined position when the determination unit cannot determine the third position information. (Composition 16) The control device according to configuration 13, characterized in that the drive unit changes the focal plane within the movable range of the tilt member when the determination unit cannot determine the third position information. (Composition 17) The control device according to configuration 13, characterized in that the determination unit issues a warning to the user if it cannot determine the third position information or if it exceeds the movable range of the tilt member. (Composition 18) The control device according to any one of configurations 1 to 17, characterized in that the first position information, the second position information, and the third position information are three-dimensional position information. (Composition 19) Image sensor and An imaging apparatus characterized by having a control device according to any one of configurations 1 to 18. (Composition 20) The image sensor further includes a tilt member that tilts the focal plane relative to the imaging plane of the image sensor, The tilt member includes a first optical member and a second optical member that are movable in a direction perpendicular to the optical axis, Both the first optical member and the second optical member have either a positive or negative refractive power. The imaging apparatus according to configuration 19, characterized in that a tilt effect is generated when the first optical member and the second optical member move in opposite directions, and a shift effect is generated when the first optical member and the second optical member move in the same direction. (Composition 21) The image sensor further includes a tilt member that tilts the focal plane relative to the imaging plane of the image sensor, The tilt member includes a first optical member and a second optical member that are movable in a direction perpendicular to the optical axis, The first optical member and the second optical member have refractive powers of positive and negative signs, The imaging apparatus according to configuration 19, characterized in that a tilt effect is generated when the first optical member and the second optical member move in the same direction, and a shift effect is generated when the first optical member and the second optical member move in opposite directions. (Composition 22) Optical system and A lens device characterized by having a control device according to any one of configurations 1 to 18. (Method 1) The steps include acquiring first location information and second location information based on user instructions, A control method characterized by comprising the step of determining a focal plane based on the first position information, the second position information, and a third position information not specified by the user. (Composition 23) A program characterized by causing a computer to execute the control method described in Method 1.

[0076] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist. [Explanation of Symbols]

[0077] 1 Camera System 2 Lens device 3. Camera body (imaging device) 9. Lens CPU (Control Unit) 15. Camera CPU (Control Unit) 1106 Image sensor 1501 1st coordinate (1st location information) 1502 2nd coordinates (2nd location information) 1503 3rd coordinate (3rd location information) 501 Focal plane

Claims

1. A control device used in an imaging system having an image sensor, an optical system capable of tilting the focal plane with respect to the imaging plane of the image sensor, and an instruction unit that receives instructions from a user, The instruction unit includes an acquisition unit that acquires first position information and second position information based on the position indicated by the user, The instruction unit determines a position different from the position indicated by the user, and the determination unit acquires third position information based on that position. The control device is characterized in that the determination unit determines the focal plane based on the first position information, the second position information, and the third position information.

2. The control device according to claim 1, characterized in that the determination unit acquires the third position information based on the output from the image sensor.

3. The control device according to claim 2, characterized in that the determination unit acquires the third position information based on the subject information based on the output.

4. The control device according to claim 3, characterized in that the subject information is at least one of the type of subject, the range of the subject, or information regarding the edges of the subject.

5. The control device according to claim 1, characterized in that the determination unit acquires the third position information based on the position determined within the range of the subject corresponding to the first position information or the second position information.

6. The control device according to claim 1, characterized in that the determination unit acquires the third position information based on the shooting scene.

7. The control device according to claim 6, characterized in that the shooting scene is determined based on the output from the image sensor.

8. The control device according to claim 7, characterized in that the shooting scene is determined based on subject information based on the output.

9. The control device according to claim 6, characterized in that the aforementioned shooting scene is determined based on a mode set by the user.

10. The control device according to claim 1, characterized in that the determination unit acquires the third position information based on information relating to at least one of the focal length, focus position, and aperture value of the optical system.

11. The control device according to claim 1, characterized in that the determination unit acquires the third position information while changing the aperture value of the optical system.

12. The aforementioned determination unit, Based on the first position information and the second position information, the axis of rotation is determined. The control device according to claim 1, characterized in that the focal plane is rotated around the rotation axis by changing the third position information.

13. The control device according to claim 12, characterized in that the determination unit rotates the focal plane such that it includes a position in which the amount of movement of the optical element in the optical system is minimum or maximum when the focal plane is tilted.

14. The control device according to claim 1, further comprising a control unit that controls the movement of optical elements in the optical system when the focal plane is tilted.

15. The control device according to claim 1, characterized in that the determination unit issues a warning to the user when it is unable to acquire the third position information, or when the amount of movement of the optical element in the optical system when tilting the focal plane exceeds the range of motion.

16. The control device according to claim 1, characterized in that the position indicated by the user in the instruction unit is a two-dimensional position, and the first position information and the second position information are three-dimensional position information.

17. The control device according to claim 1, characterized in that the position in the instruction unit that is different from the position instructed by the user is a two-dimensional position, and the third position information is three-dimensional position information.

18. An imaging device comprising a control device according to any one of claims 1 to 17 and the image sensor.

19. An optical apparatus characterized by having a control device according to any one of claims 1 to 17 and the optical system.

20. The optical device according to claim 19, characterized in that the optical system includes a first optical member and a second optical member that can be switched to move in opposite directions or in the same direction depending on whether a tilt effect that inclins the focal plane or a shift effect that moves the shooting range is performed.

21. A control method for an imaging system having an image sensor, an optical system capable of tilting the focal plane with respect to the imaging plane of the image sensor, and an instruction unit that receives instructions from a user, The steps include: acquiring first position information and second position information based on the position indicated by the user in the instruction unit; The steps include: determining a position different from the position indicated by the user in the instruction unit, and acquiring third position information based on that position; A control method characterized by comprising the step of determining the focal plane based on the first position information, the second position information, and the third position information.

22. A program characterized by causing a computer to execute the control method described in claim 21.

Images