Imaging device, lens device, camera body, control method, and program

The imaging device addresses the issue of aberration correction in interchangeable lenses by incorporating a correction group and a control system that learns and applies necessary corrections, ensuring high image quality over time.

JP7691222B2Active Publication Date: 2025-06-11CANON KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020170990
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-09
Publication Date
2025-06-11
Estimated Expiration
2040-10-09

AI Technical Summary

Technical Problem

Conventional imaging devices cannot correct aberrations in interchangeable lenses that occur due to changes over time, leading to compromised image quality.

Method used

An imaging device with an optical system including a correction group that moves to correct aberrations, utilizing a drive unit, an aberration acquisition unit, and a control unit to determine and apply the necessary corrections based on learned aberration data.

Benefits of technology

The solution effectively corrects aberrations in interchangeable lenses caused by changes over time, maintaining high image quality and eliminating the need for manual corrections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007691222000001
    Figure 0007691222000001
  • Figure 0007691222000002
    Figure 0007691222000002
  • Figure 0007691222000003
    Figure 0007691222000003
Patent Text Reader

Abstract

To provide an imaging apparatus that corrects the aberration of a lens device caused by changes over time and keeps a high level of quality.SOLUTION: The imaging apparatus of the present invention includes: an optical system including a correction group which moves to correct an aberration; a driving unit for moving the correction group; an imaging element for imaging an optical image formed by the optical system; an aberration acquiring unit for acquiring an aberration on the basis of the taken image by using a learned model obtained by the image and aberration data of the optical system; and a control unit for controlling the driving unit and correcting the aberration on the basis of the aberration.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an imaging device, Lens device, camera body, control a method, and a program.

Background Art

[0002] Conventionally, a technique for correcting errors in focus detection and photometry caused by changes over time in an interchangeable lens has been known. For example, Patent Document 1 discloses a technique for readjusting errors in focus detection and photometry that occur due to changes over time.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology disclosed in Patent Document 1, although it is possible to correct errors related to focus detection, it is not possible to correct aberrations.

[0005] Therefore, an object of the present invention is to provide an imaging device that corrects aberrations of a lens device that occur due to changes over time and maintains high image quality.

Means for Solving the Problems

[0006] To achieve the above object, the As one side imaging device of the present invention By doing so includes an optical system including a correction group that corrects aberrations, The a drive unit that moves the correction group Including the above, an interchangeable lens device and an imaging Lens device imaging element for the optical image formed by the above, Of and Perform learns the image and the above According to the lens device aberration data And as Used learningBy Obtained Obtained Using the trained model, The Imaging Obtained by the above Based on the captured A plurality of according to the lens device An aberration acquisition unit that acquires aberrations, and the above-mentioned A plurality of Based on the aberration Ki A control unit that controls the drive unit Su And, , A storage unit that stores the plurality of aberrations, and The correction group includes a lens group that does not move for focusing, The control unit determines the driving amount of the correction group by the driving unit based on all of the plurality of aberrations stored by the storage unit after the driving of the previous correction group It is characterized by this.

Effect of the Invention

[0007] According to the present invention, it is possible to provide an imaging device that corrects aberrations of a lens device generated due to changes over time and maintains high image quality.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Modes for Carrying Out the Invention

[0009] [Embodiment] Hereinafter, with reference to FIGS. 1 to 4, an aberration correction method and an imaging device according to an embodiment of the present invention will be described. 1-2. Configuration 1-2-1. Configuration of the imaging device First, with reference to FIG. 1, the configuration of an interchangeable lens 100 (interchangeable lens for a single-lens reflex camera), which is a lens barrel of the present invention in an embodiment, will be described. FIG. 1 is a cross-sectional view taken along a plane parallel to the optical axis (X direction in the figure) at the wide-angle end (wide end) of the interchangeable lens 100 in the present embodiment.

[0010] The interchangeable lens 100 as an imaging device in this embodiment is a lens device having a seven-group configuration composed of the first lens group L1 to the seventh lens group L7. By the focusing operation (focusing operation) in the interchangeable lens 100, the focus lens group, which is the sixth lens group L6, and the floating lens group, which is the fourth lens group L4, move in the optical axis direction. Further, by the zooming operation (zoom, variable magnification operation) in the interchangeable lens 100, all the lens groups (the first lens group L1 to the seventh lens group L7) move in the optical axis direction along their respective predetermined trajectories.

[0011] The interchangeable lens 100 is detachably connected to a camera body (not shown). The camera body includes an imaging element such as a CCD or a CMOS that receives the optical image formed by the interchangeable lens 100. The interchangeable lens 100 is configured to be detachable from the camera body, and constitutes an imaging device when connected to the camera body.

[0012] The lens mount 111 has a bayonet portion for attaching to the camera body and is fixed to the fixed cylinder 112 with screws. The guide cylinder 116 is fixed to the fixed cylinder 112 with screws.

[0013] The guide cylinder 116 is formed with a straight groove for guiding each lens group in the straight-ahead direction. The guide cylinder 116 is also provided with a cam groove and is engaged with a third cam follower fixed to the cam cylinder 117 with screws, and the cam cylinder is held so as to be rotatably fed out by zooming.

[0014] The zoom operation cylinder 118 is held in a diameter-fitting manner with the guide cylinder 116 and is rotatable about the optical axis center by a bayonet. Due to the action of the cam groove provided in the zoom operation cylinder 118, the first cam follower 131 provided on the outside of the straight cylinder, and the straight groove of the guide cylinder 116, the rotational force of the zoom operation cylinder 118 is converted into the straight movement of the straight cylinder 122, and the straight cylinder 122 moves straight by the zoom operation.

[0015] Here, the second cam follower 132 provided on the straight cylinder 122 also engages with the cam groove of the cam cylinder 117, and the straight movement of the straight cylinder 122 is converted into the rotational movement of the cam cylinder 117. At this time, as described above, since the cam cylinder 117 is rotatably fed by the engagement of the third cam follower fixed to the cam cylinder 117 and the cam groove of the guide cylinder 116, as a result, the cam cylinder 117 can be rotatably fed with respect to the optical axis by the straight movement of the straight cylinder 122.

[0016] Next, by utilizing the force with which the cam cylinder 117 is rotatably fed with respect to the guide cylinder 116, the rear group unit and the 7-group unit 107 can be driven in the optical axis direction by the action of the fourth cam follower, the fifth cam follower, the straight grooves, and the cam grooves, which are each cam followers. As described above, the mechanical movement of each lens group in this embodiment is caused by the rotation of the zoom ring, 1: The straight cylinder 122 is linearly fed out, 2: The cam cylinder 117 is rotatably fed out, 3: Each group other than the first group is linearly fed out, and has the basic configuration as described above.

[0017] Next, each lens group will be described in detail. The first group unit 101 is a holding frame that holds the first lens group L1. The first group unit 101 is fixed to a straight cylinder 122 that is linearly moved in the optical axis direction by a straight groove, a cam groove, and a roller.

[0018] At the tip of the first group unit 101, a bayonet portion for attaching a hood is provided on the outer peripheral side, and a screw is provided on the inner peripheral side, and accessories such as a filter can be attached.

[0019] The two-group unit 102 is a holding frame that holds the second lens group L2. The two-group unit 102 forms part of the shake correction unit 108. The shake correction unit 108 holds the two-group unit 102 so that it can be driven in a direction orthogonal to the optical axis (the direction orthogonal to the optical axis), and performs shake correction by driving the two-group unit 102 with a shake correction driving unit including a magnet and a coil. The shake correction unit 108 is held by fixing means (not shown) in the guide cylinder 116.

[0020] The three-group unit 103 is a holding frame that holds the third lens group L3 (the first correction group). The three-group unit 103 forms part of the first driving means 141. The first driving means 141 holds the three-group unit 103 so that it can be driven in a direction orthogonal to the optical axis, and drives the three-group unit 103 with a driving unit including a magnet and a coil. The first driving means 141 is fixed to the rear group base 126, and is advanced and retracted in the optical axis direction by a zoom operation by a fourth cam follower provided on the rear group base 126.

[0021] Further, the first driving means 141 holds the electromagnetic diaphragm unit 110 including a diaphragm driving part and a diaphragm vane part at the base part.

[0022] The four-group unit 104 is a holding frame that holds the fourth lens group L4 (the third correction group), which is a floating group. The four-group unit 104 is linearly guided by two guide bars held by the rear group base 126. The lens L4 moves forward and backward in the optical axis direction when the rear group base 126 moves in the zoom operation, and is further driven in the optical axis direction by the third driving means 143 with respect to the rear group base 126.

[0023] The 5-group unit 105 is a holding frame that holds the fifth lens group L5 (the second correction group). The 5-group unit 105 forms part of the second driving means 142. The second driving means 142 holds the 5-group unit 105 so as to be drivable in a direction orthogonal to the optical axis, and drives the 5-group unit 105 by a driving unit including a magnet and a coil. The second driving means 142 is fixed to the rear group base 126, and is simultaneously advanced and retracted by the movement of the rear group base 126 being advanced and retracted in the optical axis direction by a zoom operation.

[0024] The 6-group unit 106 is a holding frame that holds the sixth lens group L6 (the fourth correction group), which is a focus group. The 6-group unit 106 is linearly guided by two guide bars held by the rear group base 126. The lens L6 is advanced and retracted in the optical axis direction by the zoom operation of the rear group base 126, and is further driven in the optical axis direction by the fourth driving means with respect to the rear group base 126.

[0025] The 7-group unit 107 is a holding frame that holds the seventh lens group L7. The 7-group unit 107 is advanced and retracted in the optical axis direction by a zoom operation by the fifth cam follower.

[0026] The rotation information of the zoom operation cylinder 118 is detected by zoom rotation detection means (not shown) and processed by the control means (control unit) 119.

[0027] The rotation information of the focus operation cylinder 114 is detected by focus rotation detection means (not shown) and processed by the control means 119.

[0028] The control means 119 controls the entire interchangeable lens 100, including the first driving means 141 to the fourth driving means, the electromagnetic diaphragm unit 110, and the shake correction unit 108.

[0029] The optical adjustment in the embodiment will be described below. Coma aberration and astigmatism are adjusted by moving the 3-group unit 103 and the 5-group unit 105 in a direction orthogonal to their optical axes. Further, field curvature and spherical aberration are adjusted by moving the 4-group unit 104 and the 6-group unit 106 in the direction of their optical axes. As described above, since the 3-group unit 103 and the 5-group unit 105 are position-controlled by the first driving means and the second driving means, they do not have to be always constant during zooming or focusing, and are held at positions where the optical performance is optimal in each zoom state and focus state. The same applies to the 4-group unit 104 and the 6-group unit 106.

[0030] 1-2-2. Overall processing flow Using FIG. 2, the processing of the aberration correction means (aberration acquisition unit) 120 in this embodiment will be described. The aberration correction means 120 includes a determination unit, a storage unit, a decision unit, and a storage unit, which will be described later.

[0031] In step S1, a captured image is acquired using an imaging device. In step S2, an aberration recognition process is executed on the captured image using a learned model.

[0032] In step S3, based on the result of the aberration recognition process in step S2, it is determined by the determination unit whether the aberration can be evaluated. If it can be evaluated, the process proceeds to step S4, and if the evaluation is impossible, the process ends.

[0033] In step S4, an aberration index is calculated from the aberration determination data. In calculating the aberration index here, the aberration amount is normalized according to the type of aberration.

[0034] In step S5, the aberration index is stored in a storage unit (not shown). Since the aberration index is acquired for each shooting (when the shutter is released), the aberration index will be accumulated by repeating the shooting.

[0035] In step S6, it is determined whether or not to drive (correct aberration) the driving means (the first, second, third, and fourth driving means) using the aberration index stored in the storage unit. If it is necessary to correct the aberration, the process proceeds to step S7, and if it is not necessary to correct, the process ends.

[0036] In step S7, the driving amount of the driving means is obtained based on the aberration index calculated in step S4, and the control means operates the driving means based on the driving amount. The relationship between the aberration index and the driving amount of the driving means is stored in a storage unit (not shown) in advance.

[0037] 1-2-3. Aberration recognition process The aberration recognition process in step S2 by the aberration correction means 120 of this embodiment will be described. First, the storage unit (not shown) will be described. The aberration correction means 120 stores in the storage unit a learned model obtained by machine learning the teacher image, which is an image captured using the interchangeable lens 100, and the type of aberration and the feature amount of the aberration (aberration data) included in the teacher image as teacher data. It is more preferable to include the shooting parameters when the teacher image was obtained as the teacher data. The teacher image is an image of a subject that is easy to distinguish the influence of the aberration when the aberration occurs. For example, images of a point light source, a star, a leaf, a branch, etc. can be given.

[0038] Also, at the stage of creating the learned model, it is preferable to include images captured under conditions giving various types and feature amounts of aberration and shooting conditions as teacher data, so that the type and feature amount of the aberration can be specified with higher accuracy. Further, at the stage of creating the learned model, it is even better to appropriately consider the errors considered in the design. The errors considered in the design are the tolerances of lenses and parts and the performance changes considered in the design. Alternatively, a captured image obtained by intentionally generating aberration by changing the driving amount of the driving means and using an interchangeable lens 100 prepared in advance as a learning image may be used.

[0039] By using a learned model obtained by machine learning the teacher image, the type of aberration included in the teacher image, and the feature amount of the aberration as teacher data, the captured image can be used as input data, and the availability of aberration evaluation for the image can be obtained as output data. Further, when aberration evaluation is possible, the type of aberration and the feature amount of the aberration can be obtained as output data.

[0040] Prepare a plurality of learned models machine-learned for each condition of the shooting parameters when shooting the teacher image, and apply the corresponding learned model to the captured image classified for each condition of the shooting parameters to obtain the type of aberration and the feature amount of the aberration as output data. Alternatively, by using a learned model obtained by machine learning including the shooting parameters when shooting the teacher image in the teacher data, the shooting parameters are also included in the input data, and the type of aberration and the feature amount of the aberration can be obtained as output data with high accuracy and greater flexibility. The shooting parameters are each unique value when shooting the teacher image. For example, the shooting date and time, shutter speed, aperture value, ISO sensitivity, presence or absence of flash use, exposure correction value, focal length, distance to the object (object distance, in the case of an imaging device equipped with a ToF sensor).

[0041] 1-2-4. Determination of necessity of driving of driving means The processing flow of step S6 of the control means 119 in the embodiment will be described. In step S5, the aberration index stored in the storage unit is called.

[0042] FIG. 3 shows an example of the processing of the determination unit of the aberration correction means 120. FIG. 3 shows an aberration index corresponding to the number of aberration determination data (proportional to the number of shooting times). As the aberration determination data increases, the aberration index also increases. This indicates that as the number of shooting times of the imaging device increases and the number of driving times of the movable part of the interchangeable lens 100 increases, the aberration of the interchangeable lens 100 becomes larger. Further, the reason why the aberration index decreases when the number of aberration determination data reaches 90 times is that the driving means operates and the aberration is reduced as described later.

[0043] The determination period shown in FIG. 3 is the range of data referred to for determining whether to operate the driving means in the process of step S6. In this embodiment, after setting the determination criterion to 1.0 of the aberration index, the average value of the latest 10 pieces (first period) of data is obtained, and if the average value exceeds 1.0, the driving means is set to operate.

[0044] 1-2-5. Explanation of the effect as an example of the operation during point light source photography Using FIG. 2, the operation and effect of the driving means when photographing a subject including a point light source as a photographed image will be described. The shooting conditions are as follows. Shooting date and time: 2019 / 11 / 26 17:03 Shutter speed: 1 / 320 (seconds) Aperture value: F1.8 ISO sensitivity: ISO100 Use of flash: None Exposure compensation value: 0 Focal length: 50 mm First, in step S1, a photographed image is acquired.

[0045] In step S2, using the learned model stored in the storage unit, aberration determination information is obtained as output data for the input data of the photographed image. Here, the aberration determination information is information on whether the aberration can be quantitatively evaluated by applying the learned model to the captured image, and when it can be evaluated, it includes information on the type of aberration and the feature amount of the aberration. Based on the aberration determination information obtained by applying this learned model, coma aberration as an example of aberration can be detected, and the shape and size of the coma aberration can be determined.

[0046] In step S3, based on the aberration determination information obtained in step S2, if the aberration can be evaluated, the process proceeds to step S4, and if the aberration cannot be evaluated, the process ends.

[0047] In step S4, for example, in the case of coma aberration, the length of the tail of the coma aberration is used as a feature amount, normalized with an allowable limit of 1.0, and calculated as an aberration index. It is known that a point light source where coma aberration occurs produces an image flow or blur like a trailing tail. If it is an astigmatism aberration, the short side length and long side length of the elliptical image with respect to the point light source can be used as aberration indexes.

[0048] In step S5, the aberration index obtained in step S4 is stored in the storage unit. By storing the aberration indexes obtained from multiple shootings, the reliability of the determination in step S6 described later is improved. If an optical chart for aberration determination used by an expert is used, it is considered that a reliable determination can be made from a single captured image. However, since specialized knowledge and equipment are required, it is inconvenient for general users. Therefore, the result of the aberration recognition process of the present invention is characterized in that the aberration index is calculated from a captured image generally captured in normal shooting, rather than a special subject such as an optical chart prepared for aberration evaluation.

[0049] The process of step S6 will be described with reference to FIG. 3. FIG. 3 shows the aberration index (vertical axis) with respect to the number of aberration determination data (horizontal axis). It can be seen that as the number of aberration determination data increases, the aberration index also increases. This is because as the number of shootings of the interchangeable lens 100 increases, the aberration becomes larger.

[0050] The determination period shown in FIG. 3 is the range of data of the aberration index referred to for determining whether or not to operate the driving means in the process of step S6. Since the threshold value of the determination criterion is set to 1.0 of the aberration index, when the average value of the latest 10 data exceeds 1.0, it is determined that the operation of the driving means (correction of aberration) is necessary. In the example of FIG. 3, when the number of aberration determination data finally reached 90, the aberration index exceeded 1.0, so it was determined that the driving means should be operated. As described above, in step S6, the determination of whether or not to operate the driving means is made based on the average value of a plurality of data. Therefore, a highly reliable determination with reduced influence of variations in the obtained aberration index due to measurement errors or the like can be made.

[0051] In step S7, the driving amount of the driving means is determined from the aberration index received from step S6, and the driving amount is commanded to the control means 119. As described above, the technology of the present invention automatically or actively corrects aberration using the captured image captured by the user as an input value. Aberrations generated due to changes over time and accidentally generated aberrations are also automatically corrected. No special operation by the user is required, and since the images captured during normal use are the objects for judging the occurrence status of aberration, the convenience is high. Even after the imaging device is handed over to the user from the manufacturer of the imaging device, high performance can be maintained over a long period of time. The execution of the aberration recognition process and the acquisition of the aberration index may be performed each time the shutter is released, or may be performed every predetermined number of times the shutter is released (every predetermined number of imaging times). The predetermined number of imaging times can be appropriately set in consideration of the state of the device, imaging conditions, environmental conditions, etc. In any case, during the use of a normal imaging device, the aberration is evaluated without the user being aware of the aberration correction, and the correction optical system moves as necessary based on the illustrated processing flow to correct the aberration.

[0052] 1-2-6. Method for Improving Judgment Performance A typical example of a method for improving the accuracy of the technology of the present invention will be described. As a first method, step S6b, which is different from step S6, will be described with reference to FIG. 4. Step S6b differs from step S6 in the determination period and the calculation method of the aberration index during that period. In step S6b, the determination period is set as the entire period after the driving of the previous correction group (after the correction of the previous aberration), and all aberration determination data are used. The aberration index for the entire period is approximated by an approximate formula of the determination function F(x) (x: number of aberration determination data), and it is determined that the driving of the driving means is necessary when the value of the determination function F(x) exceeds 1.0. In this embodiment, since F(90)>1.0 for the determination function, it was determined that the driving means should be operated.

[0053] The determination period was set as the entire period, but it may also be determined dynamically. For example, when the acceleration sensor provided in the imaging device detects a large acceleration, it can be expected that the aberration index will change significantly. Therefore, the determination period may start when the aberration index changes significantly.

[0054] As a second method, step S6c different from step S6 will be described. Step S6c makes a determination using a plurality of aberration indices. For example, when multiple types of aberrations occur, the operation method of the driving means may be determined so as to minimize based on a predetermined evaluation method for the plurality of aberration indices. Here, the predetermined evaluation method may be, for example, an evaluation method weighted so that an aberration that should be preferentially reduced and is determined based on the shooting conditions is given a larger evaluation value. Alternatively, each type of aberration may be evaluated individually and independently, and each aberration index may be evaluated against a threshold value set for each type of aberration.

[0055] As a third method, step S6d different from step S6 will be described. Step S6d limits the aberration index used for determination according to the shooting conditions. For example, aberrations such as spherical aberration, coma aberration, and astigmatism occur most significantly when the aperture value is the smallest. Therefore, by selectively using and evaluating only the aberration index when the aperture value is the smallest, the accuracy of the processing in step S6d can be improved. Not limited to the aperture value, by evaluating against a population limited by shooting parameters such as the focal length and the color of the light source where aberrations are likely to appear significantly, the accuracy of aberration correction can be further improved.

[0056] As a fourth method, by judging from the aberration indices obtained by photographing different similar subjects, it is possible to prevent overcorrection that may occur in the event that the subject has an aberration shape.

[0057] As a fifth method, at the time of acquiring the photographed image in step S1, it is also effective to perform focus bracketing shooting, perform shooting with the focus position (focal length) changed, and increase the number of data input to the aberration recognition process in step S2.

[0058] As a sixth method, step S6e, which is different from step S6, will be described. In step S6e, considering criteria other than the threshold of the aberration index, the timing for operating the driving means in step S7 is adjusted. If the driving means operates during shooting and the aberration disappears, there is a risk of feeling an incongruity when viewing consecutive captured photos. Therefore, it is better to proceed to step S7 considering indicators other than the aberration index, such as performing correction after continuous shooting is completed.

[0059] As a seventh method, when acquiring a captured image in step S1, it is also effective to intentionally change the focal length during shooting to increase the number of input data for the aberration recognition process in step S2. By such shooting, by using a plurality of captured images obtained from a plurality of shootings with the shooting conditions changed in minute steps as input data for the aberration recognition process in step S2, the reliability of the aberration index can be further enhanced.

[0060] In this embodiment, the first and second driving means are configured to be movable in a direction orthogonal to the optical axis, but the present invention is not limited thereto. For example, it may be a correction lens group having a configuration capable of tilting the optical axis with respect to the optical axis of the lens device, or a configuration capable of driving a combination thereof. Or the driving means may have a configuration of only one. Regarding the number of these correction optical systems, driving methods, driving directions, etc., it is possible to select an appropriate method for the optical system to correct aberration.

[0061] In this embodiment, it is assumed that the first to fourth driving means correct coma aberration, partial blur, field curvature, and spherical aberration, but not all of these configurations are necessary, and a configuration in which a single driving means corrects one aberration may be used. For example, in the case of an optical system where the change in coma aberration is extremely small when each lens group varies, there is no need to provide a group for adjusting coma aberration.

[0062] In this embodiment, in addition to the first and second driving means as driving units that move in a direction orthogonal to the optical axis, there is a shake correction unit 108. However, the shake correction unit 108 may be used for aberration correction. When used for aberration correction, a method of offsetting the driving center position of the two-group unit 102 driven by the shake correction unit 108 and driving it for shake correction around the offset position is appropriate.

[0063] In this embodiment, the aberration correction means 120 is configured in the interchangeable lens 100, but it may also be configured in the camera body. Also, a part of the aberration correction means 120 may be configured in the camera body. For example, a determination unit may be configured in the camera body, and a storage unit, a determination unit, and a storage unit may be configured in the interchangeable lens 100. Furthermore, although the camera body and the interchangeable lens 100 of this embodiment have been described as having a detachable configuration, an integrated configuration may also be acceptable.

[0064] In this embodiment, the aberration correction means 120 uses image recognition by machine learning, but is not limited thereto. Deep learning technology may also be used.

[0065] (Other embodiments) The present invention can also be realized by a process of supplying a program that realizes one or more functions of the above-described embodiments and modified examples to a system or device via a network or a storage medium, and causing a computer of the system or device to read and execute the program. The computer may have one or more processors or circuits, and may include a network of multiple separate computers or multiple separate processors or circuits for reading and executing computer-executable instructions.

[0066] The processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field programmable gateway (FPGA). Further, the processor or circuit may include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

[0067] As described above, the preferred embodiments of the present invention have been described, but the invention is not limited to these embodiments. The invention modified within the scope not contrary to the gist of the present invention, and the invention equivalent to the present invention are also included in the present invention. Further, the above-described examples and each modification can be appropriately combined within the scope not contrary to the gist of the present invention.

Explanation of Reference Numerals

[0068] 100: interchangeable lens L3: first correction group 141: first driving means L5: second correction group 142: second driving means L4: third correction group 143: third driving means L6: fourth correction group 119: control means (control unit) 120: aberration correction means (aberration acquisition unit)

Claims

1. An optical system including a correction group that corrects aberration by moving, a drive unit that moves the correction group, an interchangeable lens device, an image sensor that captures an optical image formed by the lens device, an aberration acquisition unit that acquires a plurality of aberrations corresponding to the lens device based on an image obtained by the imaging using a learned model obtained by learning using an image and aberration data corresponding to the lens device, a control unit that controls the drive unit based on the plurality of aberrations, and a storage unit that stores the plurality of aberrations, wherein the correction group includes a lens group that does not move for focusing, and the control unit determines a driving amount of the correction group by the drive unit based on all of the plurality of aberrations stored by the storage unit after the previous driving of the correction group. An imaging device characterized by that.

2. The learning is performed using information regarding shooting conditions, and the aberration acquisition unit acquires the plurality of aberrations based on an image obtained by the imaging and information regarding shooting conditions corresponding to the image using the learned model. The imaging device according to claim 1, characterized by that.

3. The imaging device according to claim 2, characterized in that the shooting conditions include at least one of shutter speed, aperture value, ISO sensitivity, focal length, object distance, and exposure compensation.

4. The imaging device according to claim 2 or 3, characterized in that the learned model is classified and learned according to the shooting conditions.

5. The control unit determines the driving amount based on approximate expressions of all of the plurality of aberrations stored by the storage unit after the previous driving of the correction group. The imaging device according to any one of claims 1 to 4, characterized by that.

6. The imaging device according to any one of claims 1 to 5, characterized in that the plurality of aberrations include a plurality of types of aberrations.

7. The imaging device according to any one of claims 1 to 6, characterized in that a timing at which the control unit controls the drive unit to correct the aberration and a timing at which the aberration acquisition unit acquires the plurality of aberrations are different from each other.

8. The imaging device according to any one of claims 1 to 7, characterized in that the aberration acquisition unit acquires aberrations using the learned model each time the imaging is performed.

9. The imaging device according to claim 8, wherein the aberration acquisition unit acquires an aberration using the learned model for each of the imaging operations performed a predetermined number of times.

10. An optical system including a correction group that corrects aberrations by moving; A drive unit that moves the correction group; An imaging device that images an optical image formed by the optical system; An aberration acquisition unit that acquires a plurality of aberrations based on an image obtained by the imaging, using a learned model obtained by learning using an image and aberration data of the optical system; A control unit that controls the drive unit based on the plurality of aberrations; And a storage unit that stores the plurality of aberrations, The imaging device, wherein the control unit determines a driving amount of the correction group based on an average value of the plurality of aberrations in a first period stored by the storage unit.

11. A lens device including a correction group that corrects aberrations by moving and a drive unit that moves the correction group, the lens device being replaceable with respect to a camera body, An aberration acquisition unit that acquires a plurality of aberrations corresponding to the lens device based on an image obtained by imaging using the lens device and an imaging device, using a learned model obtained by learning using an image and aberration data corresponding to the lens device; A control unit that controls the drive unit based on the plurality of aberrations; And a storage unit that stores the plurality of aberrations, The correction group includes a lens group that does not move for focusing, The lens device, wherein the control unit determines a driving amount of the correction group by the drive unit based on an average value of the plurality of aberrations in a first period stored by the storage unit.

12. A camera body having a lens device including an optical system including a correction group that corrects aberrations by moving and a drive unit that moves the correction group, the lens device being detachable, An imaging device that images an optical image formed by the lens device; An aberration acquisition unit that acquires a plurality of aberrations corresponding to the lens device based on an image obtained by the imaging, using a learned model obtained by learning using an image and aberration data corresponding to the lens device; A control unit that controls the drive unit based on the plurality of aberrations; And a storage unit that stores the plurality of aberrations, The correction group includes a lens group that does not move for focusing, The camera body is characterized in that the control unit determines the driving amount of the correction group by the driving unit based on the average value of the plurality of aberrations in the first period stored by the storage unit.

13. A control method for a lens device that is interchangeable with a camera body, the method including a correction group that corrects aberrations by moving and a driving unit that moves the correction group, an acquisition step of acquiring a plurality of aberrations corresponding to the lens device based on an image obtained by imaging using the lens device and an image sensor, using a learned model obtained by learning using the image and aberration data corresponding to the lens device; and a control step of controlling the driving unit based on the plurality of aberrations. In the control step, the driving amount of the correction group by the driving unit is determined based on the average value of the plurality of aberrations in the first period.

14. A program characterized in that the computer executes the control method according to Claim 13.

Citation Information

Patent Citations

  • Lens changeable camera system

    JP1994110115A

  • Scan type optical microscope

    JP2005292538A

  • Imaging apparatus

    JP2010237250A

  • Lens device, imaging apparatus and control method

    JP2019074671A

  • Imaging device and focus adjustment method

    JP2019215489A