Control apparatus, lens apparatus, image pickup apparatus, camera system, control method, and storage medium

Abstract

To provide a control device for obtaining a more natural image while suppressing image point movement accompanying the movement of a focus lens group.SOLUTION: The control apparatus is used for a camera system including a lens apparatus including an image pickup optical system including a focus lens unit, and an image pickup apparatus including an image pickup element configured to acquire an image from an optical image formed by the image pickup optical system, and includes an acquirer configured to acquire a plurality of pieces of distortion information used when distortion correction processing by the image pickup optical system is performed on the image, and a corrector configured to perform the correction processing using first distortion information used when distortion correction processing of an optical image of an out-of-focus object is performed among the plurality of pieces of distortion information.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a control device, a lens device, an imaging device, a camera system, a control method, and a program. [Background technology]

[0002] In an imaging optical system, when the focus lens group is moved to adjust the distance to a subject to be focused, fluctuations in the angle of view (focus breathing) may occur depending on the position of the focus lens group. Patent Document 1 discloses a configuration that performs breathing correction to convert the size of an image based on the imaging magnification at each position of the focus lens group.

[0003] Furthermore, when the focus lens group is moved, distortion occurring in the imaging optical system fluctuates. Patent Document 2 discloses a configuration in which breathing correction is performed in consideration of distortion correction that electronically corrects distortion (Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-142965 [Patent Document 2] Japanese Patent Application Publication No. 2019-208168 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, we will explain the "distortion variation during focusing," a problem that the present invention aims to solve. FIG. 9 shows an input image 91 obtained by capturing a distant subject 92 and a close-up subject 93, and the distortion aberration of each optical image (94, 95). The thick frame 96 indicates the enlarged area after breathing correction. Typically, the distance between the various subjects captured in a single frame of a captured video and the imaging device is not constant, and in-focus and out-of-focus subjects exist within the same frame. The correction values ​​for the distortion aberration of the optical images of the focused and out-of-focus subjects are different. For example, if the correction value for the distortion aberration of the optical image of the out-of-focus subject is used to correct the distortion aberration of the optical image of the focused subject, as in the configuration of Patent Document 2, some distortion remains uncorrected.

[0006] In particular, when the difference in distortion is large, moving the focus lens group to adjust the subject distance will cause the amount of distortion remaining to fluctuate, resulting in focus distortion fluctuations, which cause the amount of distortion on the screen to fluctuate during video shooting. Figure 10 is a schematic diagram of focus distortion fluctuations. Figures 10(A) and 10(B) show distortion when focusing on a close-up subject and a distant subject, respectively. Focus distortion fluctuations are difficult to correct using breathing correction alone, and lead to a decrease in video quality.

[0007] An object of the present invention is to provide a control device for obtaining a more natural image while suppressing image point movement that accompanies movement of a focus lens group. [Means for solving the problem]

[0008] A control device according to one aspect of the present invention is a control device used in a camera system that includes a lens device having an imaging optical system including a focus lens group, and an imaging device having an image sensor that acquires an image from an optical image formed by the imaging optical system, and is characterized by having: an acquisition means for acquiring a plurality of pieces of distortion aberration information used when performing a correction process for distortion aberration caused by the imaging optical system on an image; and a correction means for performing a correction process using first distortion aberration information from the plurality of pieces of distortion aberration information used when performing a correction process for distortion aberration of an optical image of an out-of-focus subject. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a control device for obtaining a more natural image while suppressing the movement of the image point that accompanies the movement of the focus lens group. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram of a camera system according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram illustrating an example of distortion aberration information. [Figure 3] FIG. 10 is a diagram illustrating an example of magnification ratio information. [Figure 4] FIG. 10 is a schematic diagram of correction of distortion fluctuation during focusing. [Figure 5] 10A and 10B are diagrams illustrating an example of a result of performing correction of distortion fluctuation during focusing. [Figure 6] 1 is a flowchart showing a correction process according to the first embodiment. [Figure 7] 10 is a flowchart showing a correction process according to a second embodiment. [Figure 8] 10 is a flowchart showing a correction process according to a third embodiment. [Figure 9] 1A and 1B are schematic diagrams of a photographed scene, an input image, and distortion aberration (conventional example). [Figure 10] FIG. 10 is a schematic diagram of distortion fluctuation during focusing (conventional example). DETAILED DESCRIPTION OF THE INVENTION

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same components, and redundant explanations will be omitted.

[0012] 1 is a schematic diagram of a camera system according to an embodiment of the present invention. The camera system includes a lens device 100 and a camera (imaging device) 200. Examples of camera systems include digital video cameras, digital still cameras, broadcast cameras, and surveillance cameras. The lens device 100 may be configured to be detachable from the camera 200, or may be configured integrally with the camera 200.

[0013] The lens device 100 includes an imaging optical system 11, a focus position detection unit 13, a distortion correction information storage unit 14, and a breathing correction information storage unit 15. The imaging optical system 11 includes a focus lens group 12. As the focus lens group 12 moves, the in-focus object distance changes within a driving range from close to infinity. A plurality of focus lens groups 12 may be provided, for example, as in a floating focus. The focus position detection unit 13 detects the in-focus position of the focus lens group 12. The distortion correction information storage unit 14 stores a plurality of pieces of distortion information that differ for each image height and are used when the imaging optical system 11 performs distortion correction (distortion correction) on an input image obtained by imaging. In this embodiment, the plurality of pieces of distortion information include distortion information (first distortion information) used when performing distortion correction on an optical image of an out-of-focus object formed by the imaging optical system 11 according to the position of the focus lens group 12. The distortion information is transmitted to camera 200. Breathing correction information storage means 15 stores magnification ratio information for enlarging the input image. The magnification ratio information is transmitted to camera 200. This makes it possible to correct distortion and focus breathing of various lenses, including those with different types and manufacturing errors.

[0014] It is preferable that the magnification ratio information corresponds to the distortion aberration information. Specifically, it is preferable that the magnification ratio information and the distortion aberration information are set so that a corrected image is obtained by performing corresponding distortion aberration correction and enlargement processing together. Using appropriate magnification ratio information according to the distortion aberration information is preferable because it suppresses breathing correction residues.

[0015] It is also preferable to have two or more types of distortion information for each position of the focus lens group 12. This is preferable because it allows the user to select distortion correction values ​​for shooting conditions in which distortion fluctuations during focusing are more noticeable than for shooting conditions in which they are not. For example, it is possible to switch between different types of distortion information when shooting video, in which distortion fluctuations during focusing are more noticeable, and when shooting still images, in which distortion fluctuations during focusing are less noticeable than for shooting video. Furthermore, when the distance to the subject being shot is uniform, turning off the distortion fluctuation correction during focusing (described later) allows for the application of distortion correction that is optimal for the subject distance at which focus is achieved.

[0016] The camera 200 includes an image sensor 21 and a control unit (control device) 22. The image sensor 21 converts an optical image formed by the imaging optical system 11 into a digital signal. The control unit 22 includes an acquisition unit 23 and a correction unit 24. The acquisition unit 23 acquires multiple pieces of distortion aberration information from the distortion aberration correction information storage unit 14 and acquires magnification information from the breathing correction information storage unit 15. The correction unit 24 performs distortion aberration correction on an input image formed by the image sensor 21 using selected distortion aberration information from the multiple pieces of distortion aberration information. In this embodiment, the correction unit 24 performs distortion aberration correction using distortion aberration information used when performing distortion aberration correction on an optical image of an out-of-focus subject, depending on the position of the focus lens group 12. Note that the zoom position and aperture state are optional. This allows for minimal uncorrected distortion when the subject surface for which focus distortion variation correction (described later) is desired is not in focus. The correction unit 24 also performs breathing correction using magnification information. The correcting means 24 may be configured as being divided into a means for correcting distortion and a means for correcting breathing.

[0017] In this embodiment, the control unit 22 is provided in the camera 200, but it may be provided in the lens device 100, or may be configured as a control device separate from the camera system.

[0018] Furthermore, it is preferable that correction means 24 determine the shape of distortion from the input image, and if the distortion of the input image is pincushion-shaped, change the magnification information in accordance with the magnification required to correct the pincushion-shaped distortion, thereby making it possible to appropriately correct distortion even in the case of pincushion-shaped distortion.

[0019] Furthermore, when correcting distortion using distortion information of an optical image of an out-of-focus subject, it is preferable that the position of the focus lens group 12 is not a position within the movable range that focuses on the closest subject. As will be described later, with lens specifications that are prone to distortion fluctuations during focusing, distant subjects often occupy a large proportion of the entire screen. For this reason, it is preferable to perform distortion correction that is tailored to objects other than the closest subject plane across the entire focus range. Note that the position that focuses on the closest subject does not only include the position that strictly focuses on the closest subject, but also a position close to the position that focuses on the closest subject (a position that essentially focuses on the closest subject).

[0020] Furthermore, it is preferable that the distortion information includes distortion information (second distortion information) used when performing distortion correction processing on the optical image of the focused subject. When the user selects a distortion correction value, it is preferable to perform distortion correction using information for correcting distortion related to the focused subject, as this most effectively reduces uncorrected distortion.

[0021] The control unit 22 may also include a distance map information calculation means and a subject area information calculation means. The distance map information calculation means uses defocus information acquired from the camera 200 to acquire distance map information to the subject for each of multiple areas of the input image. The method for acquiring the distance map information can be replaced with any known method (e.g., a TOF method). The subject area information calculation means acquires ratio information (subject area information) regarding the ratio of the subject's area to the total area of ​​the input image based on the distance map information. The correction means 24 may perform distortion correction processing on the input image using distortion information corresponding to the subject area information calculated by the subject area information calculation means. It is preferable that the distance map information is updated for each frame during video capture, and the subject area information is also updated. Because the subject displayed during video capture changes constantly, updating the subject area information for each frame makes it possible to apply distortion information appropriate for that frame.

[0022] 2 is a diagram showing an example of distortion information stored in the distortion correction information storage means 14, showing distortion information at an arbitrary zoom position and subject distance. The vertical axis represents image height, and the horizontal axis represents distortion information. A solid line 25 represents an example of distortion information for negative distortion (barrel distortion), and a dashed line 26 represents an example of distortion information for positive distortion (pincushion distortion). The correction means 24 performs distortion correction based on the distortion information to reduce distortion.

[0023] FIG. 3 is a diagram showing an example of magnification ratio information stored in the breathing correction information storage means 15, showing magnification ratio information at an arbitrary zoom position. The vertical axis represents the magnification ratio information, and the horizontal axis represents the position of the focus lens group. A solid line 31 represents magnification ratio information when the peripheral light intensity (light intensity in an area above 90% of the image height) of the input image is 10% or more, and a dashed line 32 represents an example of magnification ratio information when the peripheral light intensity of the input image is less than 10%. The correction means 24 performs correction to reduce breathing based on the magnification ratio information. Furthermore, when the peripheral light intensity of the input image is less than 10%, as shown by the dashed line 32, a natural image without dark peripheries can be obtained by performing enlargement processing using magnification ratio information set so that the magnification ratio β across the entire focus area satisfies conditional expression (1), which will be described later.

[0024] Here, we will provide additional explanation about distortion information. FIG. 4 is a schematic diagram of correction of distortion variation during focusing. To suppress distortion variation during focusing, a distortion correction value is set so that distortion at a predetermined subject distance (in many cases, a distant subject) is corrected across the entire focus range. For example, as shown in FIG. 4(A), distortion of an infinite subject (or a distant subject at a finite distance) is corrected regardless of the position of the focus lens group 12 within its movement range. This makes it possible to correct distortion of a distant subject, which accounts for the majority of the output image, regardless of whether the image is in focus or out of focus. Hereinafter, this correction will be referred to as correction of distortion variation during focusing.

[0025] The distortion information used in the correction of distortion variation during focusing can be generated by arbitrarily setting the subject distance at which you want to minimize the residual distortion. In many cases, the wider the lens, the greater the difference in distortion between in-focus and out-of-focus subjects. Therefore, taking into account subjects photographed with a wide-angle lens, it is preferable that the subject distance at which the residual distortion is minimized is a distant one. On the other hand, while there will be some residual distortion at any subject distance other than the set subject distance, the shooting distance of subjects that occupy a large proportion of the screen will depend to some extent on the lens specifications. Therefore, by setting the distortion correction value according to the lens specifications, it is possible to suppress degradation of image quality due to residual distortion.

[0026] FIG. 5 shows an example of the results of performing focus-time distortion variation correction. Reference numerals 101 and 102 denote distortion information for an infinitely distant object and a close-up object, respectively, when the focus lens group 12 is positioned so that the close-up object is in focus. Reference numerals 103 and 104 denote correction residues when distortion correction (A) is performed on the infinitely distant object and the close-up object using the distortion information 102 to correct the distortion of the close-up object, which is the in-focus plane. Reference numerals 105 and 106 denote correction residues when distortion correction (B) is performed on the infinitely distant object and the close-up object using the distortion information 101 to correct the distortion of the infinitely distant object, which is the out-of-focus plane. Distortion correction (B) corresponds to focus-time distortion variation correction, and by correcting distortion of the optical image of an out-of-focus object across the entire focus range, it becomes possible to accurately correct image point movement after focus breathing has been corrected.

[0027] As described above, according to the configuration of this embodiment, it is possible to obtain a more natural image while suppressing the movement of the image point that accompanies the movement of the focus lens group.

[0028] When performing breathing correction, if the minimum value V1min of the peripheral light intensity of the input image is smaller than 10%, it is preferable that the magnification ratio information be set so that the magnification ratio β of the enlargement processing satisfies the following conditional expression (1) over the entire focus range.

[0029] 1.0<β<2.0 (1) Here, the definition of the magnification ratio β will be explained. In an input image obtained when the focus lens group 12 is located at a predetermined position, the distance AO between the position of image point A located at the diagonal outermost periphery and the image center O when a predetermined angle of view is obtained is defined as Yn. Also, the distance AO when the narrowest angle of view is obtained across the entire focus range is defined as Ymin. In this case, the magnification ratio β when the focus lens group 12 is located at a predetermined position is defined by the following equation (1-1).

[0030] β=Yn / Ymin (1-1) One issue that arises when performing focus-induced distortion variation correction is the reduction in peripheral illumination at focus positions where distortion remains uncorrected (especially barrel distortion). Figure 4(B) shows a schematic diagram of a solution to this issue. When the minimum value V1min of peripheral illumination of the input image is less than 10%, setting the magnification ratio information so that the magnification ratio β satisfies conditional formula (1) across the entire focus range makes it possible to obtain a natural-looking image without dark peripheries when performing focus-induced distortion variation correction and breathing correction. Below the lower limit of conditional formula (1), the peripheral illumination decreases when breathing correction is performed, making it difficult to obtain a natural-looking image, which is undesirable. Above the upper limit of conditional formula (1), the image quality of the input image deteriorates significantly, which is undesirable.

[0031] Furthermore, it is preferable that the magnification ratio information be set so that the minimum value V2min of the peripheral light amount of the corrected image obtained by performing distortion correction processing and magnification processing on the input image satisfies the following conditional expression (2).

[0032] 10≦V2min≦100 (2) By satisfying conditional expression (2), it is possible to obtain a natural image after breathing correction. If the lower limit of conditional expression (2) is not satisfied, the peripheral light amount decreases when breathing correction is performed, making it difficult to obtain a natural image, which is undesirable.

[0033] Furthermore, when the maximum value of the enlargement rate β of the enlargement process in the entire focus range is βmax and the minimum value is βmin, it is preferable to satisfy the following conditional expression (3).

[0034] 1.00<βmax / βmin<2.00 (3) By satisfying conditional expression (3), it is possible to effectively suppress fluctuations in the angle of view during breathing correction. If the lower limit of conditional expression (3) is not satisfied, it is difficult to suppress fluctuations in the angle of view, which is undesirable. If the upper limit of conditional expression (3) is exceeded, image quality degradation with respect to the input image becomes significant, which is undesirable.

[0035] It is more preferable that the numerical ranges of the conditional expressions (1) to (3) are set to the numerical ranges of the following conditional expressions (1a) to (3a), respectively.

[0036] 1.0<β<1.7 (1a) 15≦V2min≦100 (2a) 1.00<βmax / βmin<1.70 (3a) It is more preferable that the numerical ranges of the conditional expressions (1) to (3) are set to the numerical ranges of the following conditional expressions (1b) to (3b), respectively.

[0037] 1.0<β<1.6 (1b) 20≦V2min≦100 (2b) 1.00<βmax / βmin<1.60 (3b) The correction process of each embodiment will be described below. [Example]

[0038] FIG. 6 is a flowchart showing the correction process of this embodiment. This flow starts when the camera 200 is turned on. In step S61, the acquisition unit 23 acquires distortion information and magnification information from the lens device 100. In step S62, the control unit 22 causes the camera 200 to acquire an image and acquires shooting information. In step S63, the control unit 22 determines whether breathing correction is ON (a setting for performing breathing correction) in the shooting information. If the control unit 22 determines that breathing correction is ON, it executes the process of step S65. If it determines that breathing correction is not ON, it executes the process of step S64. In step S64, the correction unit 24 executes distortion correction using first distortion information. The first distortion information is distortion information for correcting distortion related to a focused subject across the entire focus range. In step S65, the correction unit 24 executes distortion correction using second distortion information. The second distortion information is distortion information for correcting distortion associated with an object at infinity throughout the entire focus range, and also includes distortion information for correcting distortion associated with an out-of-focus object. In step S66, the correction means 24 performs breathing correction using the magnification information. In step S67, the control unit 22 outputs the image. The output image may be saved to a recording medium or displayed on a display device such as an external output monitor. [Example]

[0039] FIG. 7 is a flowchart showing the correction process of this embodiment. This flow starts when the camera 200 is turned on. In step S71, the acquisition unit 23 acquires distortion information and magnification information from the lens device 100. In step S72, the control unit 22 causes the camera 200 to acquire an image and acquires shooting information. In step S73, the control unit 22 determines whether breathing correction is ON in the shooting information. If the control unit 22 determines that breathing correction is ON, it executes the process of step S75, and if it determines that breathing correction is not ON, it executes the process of step S74. In step S74, the correction unit 24 executes distortion correction using the first distortion information. The first distortion information is distortion information for correcting distortion related to a focused subject across the entire focus range. In step S75, the correction unit 24 executes distortion correction using the distortion information. The second distortion information is distortion information for correcting distortion associated with an object at infinity throughout the entire focus range, and also includes distortion information for correcting distortion associated with an out-of-focus object. In step S76, the control unit 22 determines whether the minimum value V1min of the peripheral illumination of the input image is less than 10%. If the control unit 22 determines that the minimum value V1min of the peripheral illumination of the input image is less than 10%, it executes the process of step S78. If the control unit 22 determines that the minimum value V1min of the peripheral illumination of the input image is less than 10%, it executes the process of step S77. In step S77, the correction unit 24 performs breathing correction using the first magnification ratio information. In step S78, the correction unit 24 performs breathing correction using the second magnification ratio information. The second magnification ratio information is set so that the magnification ratio β satisfies conditional expression (1) throughout the entire focus range. In step S79, the control unit 22 outputs the image. The output image may be stored on a recording medium or displayed on a display device such as an external output monitor. [Example]

[0040] Unlike the first and second embodiments, this embodiment has two correction modes, A and B. Correction mode A is a mode that corrects distortion associated with an object at infinity over the entire focus range, as in the first and second embodiments. Correction mode B is a mode that corrects distortion associated with an object at a predetermined finite distance.

[0041] FIG. 8 is a flowchart showing the correction process of this embodiment. This flow starts when the camera 200 is turned on. In step S81, the acquisition unit 23 acquires distortion information and magnification information from the lens device 100. In step S82, the control unit 22 causes the camera 200 to acquire an image and acquires shooting information. In step S83, the control unit 22 determines whether breathing correction is ON in the shooting information. If the control unit 22 determines that breathing correction is ON, it executes the process of step S85, and if it determines that breathing correction is not ON, it executes the process of step S84. In step S84, the correction unit 24 executes distortion correction using first distortion information. The first distortion information is distortion information for correcting distortion related to a focused subject across the entire focus range. In step S85, the control unit 22 determines whether correction mode B is set to ON. If the control unit 22 determines that the setting of correction mode B is OB, it executes the process of step S88; if it determines that the setting of correction mode B is not OB, it executes the process of step S86. In step S86, the correction unit 24 executes distortion correction using the second distortion information. The second distortion information is distortion information for correcting distortion related to an object at infinity over the entire focus range, and also includes distortion information for correcting distortion related to an out-of-focus object. In step S87, the correction unit 24 executes breathing correction using magnification information. In step S88, the correction unit 24 executes distortion correction using the third distortion information. The third distortion information is distortion information for correcting distortion related to an object at a predetermined finite distance over the entire focus range, and also includes distortion information for correcting distortion related to an out-of-focus object. In step S89, the correction unit 24 executes breathing correction using the magnification information. In step S90, the control unit 22 outputs the video. The output video may be stored in a recording medium, or may be displayed on a display device such as an external output monitor. [Other Examples] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0042] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) A control device used in a camera system including a lens device having an imaging optical system including a focus lens group, and an imaging device having an imaging element that acquires an image from an optical image formed by the imaging optical system, an acquisition unit that acquires a plurality of pieces of distortion information used when performing a distortion correction process on the image by the imaging optical system; and a correction means for performing the correction process using first distortion aberration information, among the plurality of pieces of distortion aberration information, that is used when performing the correction process for distortion aberration of an optical image of an out-of-focus subject. (Configuration 2) the acquisition means acquires enlargement ratio information to be used when enlarging the image after the correction process has been performed, 2. The control device according to configuration 1, wherein the correction means performs the enlargement process using the enlargement ratio information. (Configuration 3) When the maximum value of the enlargement rate of the enlargement process in the entire focus area included in the enlargement rate information is βmax and the minimum value of the enlargement rate is βmin, 1.00<βmax / βmin<2.00 3. The control device according to configuration 2, wherein the following conditional expression is satisfied: (Configuration 4) the acquisition means acquires a plurality of pieces of enlargement ratio information that are used when enlarging the image after the correction process, and each of the pieces of enlargement ratio information corresponds to one of the plurality of pieces of distortion aberration information; The control device according to configuration 2 or 3, wherein the correction means performs the correction process using the first distortion aberration information, and then performs the enlargement process using enlargement ratio information corresponding to the first distortion aberration information. (Configuration 5) The lens device according to any one of configurations 1 to 4, wherein the position of the focus lens group when the correction process is performed using the first distortion aberration information is not a position that focuses on the closest subject within the movable range. (Configuration 6) 6. The control device according to any one of configurations 1 to 5, wherein the acquisition means acquires a plurality of pieces of first distortion information for each position of the focus lens group. (Configuration 7) 7. The control device according to configuration 6, wherein the first distortion aberration information used when capturing a moving image is different from the first distortion aberration information used when capturing a still image. (Configuration 8) The control device according to any one of configurations 1 to 7, wherein the plurality of pieces of distortion aberration information include second distortion aberration information used when performing a correction process for distortion aberration of an optical image of a focused subject. (Configuration 9) The control device according to any one of configurations 2 to 4, wherein the correction means changes the magnification ratio information when the shape of the distortion aberration of the image is pincushion-shaped, and performs the enlargement processing using the changed magnification ratio information. (Configuration 10) The control device according to any one of configurations 2 to 4 and 9, wherein the correction means performs the enlargement processing using the magnification ratio information corresponding to fluctuations in the position of the focus lens group during video shooting. (Configuration 11) When the minimum value of the peripheral light amount of the image is smaller than 10%, the acquisition means sets the enlargement rate β of the enlargement processing to: 1.0<β<2.0 11. The control device according to any one of configurations 2 to 4, 9, and 10, characterized in that the control device acquires the magnification ratio information set so as to satisfy the following conditional expression: (Configuration 12) The acquisition means determines whether the minimum value V2min [%] of the peripheral light amount of the image after the correction process and the enlargement process is 10≦V2min≦100 12. The control device according to any one of configurations 2 to 4 and 9 to 11, wherein the control device acquires the magnification ratio information set so as to satisfy the following conditional expression: (Configuration 13) 13. The control device according to any one of configurations 1 to 12, wherein each of the plurality of pieces of distortion aberration information is different for each image height. (Configuration 14) the acquiring means acquires ratio information relating to a ratio of an area of ​​the subject to a total area of ​​the image based on distance map information to the subject for each of a plurality of areas of the image; 14. The control device according to any one of configurations 1 to 13, wherein the correction means performs the correction process using distortion information corresponding to the ratio information. (Configuration 15) A control device according to any one of configurations 1 to 14; a lens device comprising the imaging optical system; (Configuration 16) A control device according to any one of configurations 1 to 14; An imaging device comprising the imaging element. (Configuration 17) A control device according to any one of configurations 1 to 14; the imaging optical system; A camera system comprising the imaging element. (Method 1) 1. A control method used in a camera system including a lens device having an imaging optical system including a focus lens group, and an imaging device having an imaging element that acquires an image from an optical image formed by the imaging optical system, comprising: an acquisition step of acquiring a plurality of pieces of distortion information used when performing a distortion correction process on the image by the imaging optical system; a correction step of performing the correction process using first distortion aberration information, among the plurality of pieces of distortion aberration information, that is used when performing the correction process for distortion aberration of an optical image of an out-of-focus subject. (Configuration 18) A program that causes a computer to execute the control method described in Method 1.

[0043] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0044] 11 Imaging optical system 12 Focus lens group 21 Image sensor 22 Control unit (control device) 23 Acquisition means 24 Correction means 100 Lens device 200 Camera (imaging device)

Claims

1. A control device used in a camera system including a lens device having an imaging optical system including a focus lens group, and an imaging device having an imaging element that acquires an image from an optical image formed by the imaging optical system, an acquisition unit that acquires a plurality of pieces of distortion information used when performing a distortion correction process on the image by the imaging optical system; and a correction means for performing the correction process using first distortion aberration information, among the plurality of pieces of distortion aberration information, that is used when performing the correction process for distortion aberration of an optical image of an out-of-focus subject.

2. the acquisition means acquires enlargement ratio information to be used when enlarging the image after the correction process has been performed, 2. The control device according to claim 1, wherein the correction means performs the enlargement process using the enlargement ratio information.

3. When the maximum value of the enlargement rate of the enlargement process in the entire focus area included in the enlargement rate information is βmax and the minimum value of the enlargement rate is βmin, 1.00<βmax / βmin<2.00 3. The control device according to claim 2, wherein the following condition is satisfied:

4. the acquisition means acquires a plurality of pieces of enlargement ratio information that are used when enlarging the image after the correction process, and each of the pieces of enlargement ratio information corresponds to one of the plurality of pieces of distortion aberration information; 4. The control device according to claim 2, wherein the correction means performs the correction process using the first distortion aberration information, and then performs the enlargement process using enlargement ratio information corresponding to the first distortion aberration information.

5. 3. The lens device according to claim 1, wherein the position of the focus lens group when the correction process is performed using the first distortion aberration information is not a position within the movable range that focuses on the closest subject.

6. 3. The control device according to claim 1, wherein the acquisition unit acquires a plurality of pieces of the first distortion information for each position of the focus lens group.

7. 7. The control device according to claim 6, wherein the first distortion information used when capturing a moving image is different from the first distortion information used when capturing a still image.

8. 3. The control device according to claim 1, wherein the plurality of pieces of distortion information include second distortion information used when performing a process of correcting distortion of an optical image of a focused subject.

9. 4. The control device according to claim 2, wherein the correction means changes the magnification ratio information when the shape of the distortion aberration of the image is pincushion-shaped, and performs the enlargement processing using the changed magnification ratio information.

10. 4. The control device according to claim 2, wherein the correction means performs the enlargement process using the enlargement ratio information corresponding to a change in the position of the focus lens group during video shooting.

11. When the minimum value of the peripheral light amount of the image is smaller than 10%, the acquisition means sets the enlargement rate β of the enlargement processing to: １．０＜β＜２．０ 4. The control device according to claim 2, wherein the magnification ratio information is set so as to satisfy the following conditional expression:

12. The acquisition means determines whether the minimum value V2min [%] of the peripheral light amount of the image after the correction process and the enlargement process is 10≦V2min≦100 4. The control device according to claim 2, wherein the magnification ratio information is set so as to satisfy the following conditional expression:

13. 3. The control device according to claim 1, wherein each of the plurality of pieces of distortion information is different for each image height.

14. the acquiring means acquires ratio information relating to a ratio of an area of ​​the subject to a total area of ​​the image based on distance map information to the subject for each of a plurality of areas of the image; 3. The control device according to claim 1, wherein the correction means performs the correction process using distortion information corresponding to the ratio information.

15. The control device according to claim 1 or 2; a lens device comprising the imaging optical system;

16. The control device according to claim 1 or 2; An imaging device comprising the imaging element.

17. The control device according to claim 1 or 2; the imaging optical system; A camera system comprising the imaging element.

18. 1. A control method used in a camera system including a lens device having an imaging optical system including a focus lens group, and an imaging device having an imaging element that acquires an image from an optical image formed by the imaging optical system, comprising: an acquisition step of acquiring a plurality of pieces of distortion information used when performing a distortion correction process on the image by the imaging optical system; a correction step of performing the correction processing using first distortion aberration information, among the plurality of pieces of distortion aberration information, that is used when performing the correction processing of distortion aberration of an optical image of an out-of-focus subject.

19. A program causing a computer to execute the control method according to claim 18.

Images