Processing device, imaging device, lens device, imaging system, image processing device, system, processing method, and program

Abstract

To provide a processing device capable of creating good distortion correction information while suppressing the amount of recorded data.SOLUTION: A processing device includes a first acquisition unit that acquires the shooting resolution and the output resolution, and a second acquisition unit that acquires information about the focal length of the optical system and information about the center position of the image according to the shooting resolution and the output resolution.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a processing device, an imaging device, a lens device, an imaging system, an image processing device, a system, a processing method, and a program. [Background technology]

[0002] VFX (Visual Effects) is a technology that combines CG space (virtual images) with real space (live-action images). In recent years, there has been a demand for high-precision distortion correction to improve the quality of the composite images, and various proposals have been made to meet this demand (see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-295097 [Patent Document 2] Japanese Patent Publication No. 2023-176702 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the configuration of Patent Document 1 does not take into account information on output conditions, and therefore cannot perform correct distortion correction. Also, the configuration of Patent Document 2 stores correction data in a table, which increases the amount of data recorded in the imaging device.

[0005] An object of the present invention is to provide a processing device that can generate good distortion correction information while suppressing the amount of recorded data. [Means for solving the problem]

[0006] A processing device according to one aspect of the present invention is characterized by having a first acquisition unit that acquires the shooting resolution and the output resolution, and a second acquisition unit that acquires information relating to the focal length of the optical system and information relating to the center position of the image according to the shooting resolution and the output resolution. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a processing device that can generate good distortion correction information while suppressing the amount of recorded data. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a configuration diagram of a VFX system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a conceptual diagram of distortion correction. [Figure 3] FIG. 1 is a conceptual diagram of imaging resolution and output resolution. [Figure 4] FIG. 10 is a conceptual diagram showing a case where the relationship between the focal length per pitch and distortion correction data is incorrect. [Figure 5] 10 is a conceptual diagram illustrating a case where the relationship between the image center coordinates and distortion aberration correction data is incorrect. [Figure 6] FIG. 1 is a conceptual diagram of a calculation process. [Figure 7] 10 is a flowchart showing processing relating to distortion correction information in the first embodiment. [Figure 8] FIG. 1 is a schematic diagram of the resolution in the first embodiment. [Figure 9] 10 is a flowchart showing processing relating to distortion correction information in the second embodiment. [Figure 10] 11 is a flowchart showing processing relating to distortion correction information in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same components, and redundant explanations will be omitted.

[0010] 1 is a configuration diagram of a VFX system 1 according to an embodiment of the present invention. The VFX system 1 has an imaging system 2 and an image processing system (image processing device) 6. The imaging system 2 has a lens (lens device) 3 and an imaging device 4. In this embodiment, the lens 3 is configured to be detachable from the imaging device 4, but it may also be configured integrally with the imaging device 4.

[0011] The lens 3 has an optical system (not shown). The optical system includes at least one imaging lens and forms a subject image on the imaging surface of the imaging element. The optical system may include various optical elements such as a prism, or may include a zoom lens, a focus lens, etc.

[0012] The imaging device 4 has an imaging element (not shown) that photoelectrically converts an optical image formed by an optical system. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor, and outputs an image of a subject formed on an imaging surface.

[0013] The imaging device 4 also includes a first acquisition unit 41, a second acquisition unit 42, and a transmission unit 43. The first acquisition unit 41 acquires an imaging resolution and an output resolution. The imaging resolution is the resolution of an image acquired by the imaging element (which can be set arbitrarily as long as it is equal to or lower than the maximum resolution of the imaging element), and the output resolution is the resolution of an image output by the imaging system 2. In this embodiment, the first acquisition unit acquires focal length information and distortion aberration information. The focal length information and distortion aberration information are acquired from the lens 3 if the lens 3 is configured to be detachable from the imaging device 4, or from a storage unit (not shown) provided in the imaging system 2 if the lens 3 is configured integrally with the imaging device 4. The second acquisition unit 42 acquires information related to the focal length of the optical system (focal length relative to pixel pitch) and image center position information (image center coordinates) according to the imaging resolution and the output resolution. The transmission unit 43 transmits (outputs) the focal length information and image center coordinates acquired by the second acquisition unit 42 to an external device (in this embodiment, the image processing system 6). In this embodiment, the transmitter 43 transmits the distortion information to an external device. In this embodiment, the information from the transmitter 43 is transmitted to the image processing system 6 via the cable 5 (by wired communication), but may also be transmitted by wireless communication.

[0014] In this embodiment, the first acquisition unit 41 and the second acquisition unit 42 are provided in the imaging device 4, but the present invention is not limited to this. They may be provided in the lens 3 or the image processing system 6, or in another processing device. When they are provided in the lens 3 or the processing device, the transmission unit 43 may also be provided.

[0015] The image processing system 6 includes a PC and processing software. The PC includes an acquisition unit that acquires images captured by the imaging system 2 and shooting information, and a processing unit that performs processing such as VFX compositing using the information acquired by the acquisition unit. Processing software for VFX compositing generally performs processing compliant with the OpenCV method for distortion correction.

[0016] Information for distortion correction (distortion correction information) conforming to the OpenCV method includes distortion parameters (distortion information), image center coordinates, and focal length (information on focal length) per pitch (pixel spacing).

[0017] Specifically, the distortion parameters are coefficients k1, k2, and k3 for distortion correction. When the horizontal coordinate of the corrected image is x and the image height of the corrected image is r, the horizontal coordinate xc after distortion correction is expressed by the following equation (1a).

[0018] xc=x(1+k1×r 2 +k2×r 4 +k3×r 6 ) (1a) Similarly, when the vertical coordinate of the corrected image is y, the vertical coordinate yc after distortion aberration correction is expressed by the following equation (1b).

[0019] yc=y(1+k1×r 2 +k2×r 4 +k3×r 6 ) (1b) Furthermore, when the focal length of the optical system is f and the pixel size in the horizontal direction is px, the focal length per pitch in the horizontal direction fx is expressed by the following equation (2a).

[0020] fx=f / px (2a) Similarly, when the pixel size in the vertical direction is py, the focal length per pitch in the vertical direction fy is expressed by the following equation (2b).

[0021] fy=f / py (2b) The horizontal coordinate of the image center is Cx, and the vertical coordinate of the image center is Cy.

[0022] In this embodiment, these parameters are transmitted after being appropriately calculated within the imaging system 2. This makes it possible to create good distortion correction information and reduce the amount of recorded data.

[0023] Figure 2 is a conceptual diagram of distortion correction. In distortion correction, a distorted image (pre-distortion aberration correction image DB) is multiplied by distortion correction data DH, which is centrally symmetric and has the inverse magnification of the pre-distortion aberration correction image DB depending on the distance from the center. This makes it possible to correct the image to have less distortion, like the distortion aberration corrected image DA. Here, the size and position are defined using the pre-distortion aberration corrected image DB as the reference resolution, and the image center coordinates relative to the upper left corner of the image as the reference image center coordinates, and the resolution and image center coordinates of the distortion aberration correction data DH are also configured to match these.

[0024] 3 is a conceptual diagram of shooting resolution and output resolution. The photographer (user) arbitrarily selects a shooting resolution SC from the image sensor's available resolution SE to shoot, and then arbitrarily selects an output resolution EO after shooting. The shooting resolution SC and output resolution EO are transmitted to the image processing system 6. However, if the transmitted output resolution EO differs from the resolution of the distortion correction data, problems will occur in the distortion correction in the image processing system 6.

[0025] Two examples of problems occurring in the image processing system 6 will be described below.

[0026] First, the first example will be explained using Fig. 4. Fig. 4 is a conceptual diagram of a case where the relationship between the focal lengths fx, fy per pitch and the distortion correction data is incorrect. The pre-distortion correction image DBR1 is transmitted at a resolution arbitrarily reduced by the photographer, but the distortion correction data DHR1 remains at the standard resolution (before reduction), so when they are combined, distortion cannot be corrected correctly.

[0027] Next, a second example will be described with reference to Fig. 5. Fig. 5 is a conceptual diagram showing a case where the relationship between the image center coordinates Cx, Cy and the distortion correction data is incorrect. The image center coordinate CBR is defined based on the coordinate CK at the top left of the pre-distortion correction image DBR2. If the image center coordinate CAR2 of the distortion correction data DHR2 deviates from the center coordinate CBR, distortion cannot be corrected correctly when they are multiplied.

[0028] In this way, when the pixel size changes relatively due to reduction or enlargement, or when the image center coordinates change, the above-mentioned problem occurs if conventional distortion correction is performed as is.

[0029] Therefore, in this embodiment, processing is performed according to the imaging resolution and output resolution for the focal lengths fx and fy per pitch and the image center coordinates Cx and Cy, thereby enabling accurate distortion correction processing.

[0030] However, since the distortion correction coefficients k1, k2, and k3 and the focal lengths per pitch fx and fy have different values ​​for each zoom position and focus position, storing them in table format would result in an enormous amount of data.

[0031] Therefore, in this embodiment, the distortion correction information is transmitted after calculation processing according to the shooting resolution and output resolution is performed in the imaging system 2. This makes it possible to reduce the amount of recorded data.

[0032] FIG. 6 is a conceptual diagram of the calculation processing of this embodiment. In FIG. 6, the image capture resolution SE of the image sensor is 4320 pixels, the shooting resolution SC is 3240 pixels, and the output resolution EO is 1080 pixels. Because resolution conversion to a lower resolution is performed, the pixel size of the output image becomes relatively large (coarse) with respect to the unit size (or unit angle of view). In FIG. 6, the output pixels are reduced to one-third, from 3240 pixels to 1080 pixels, so the pixel size becomes relatively three times larger (coarser). The pixel size after this change in relative size is defined as the "converted output pixel size." Using the converted output pixel size in the calculation makes it possible to appropriately set the relationship between the output image and distortion aberration correction data.

[0033] In this embodiment, the second obtaining unit 42 obtains the focal length per pitch in the horizontal direction fx and the focal length per pitch in the vertical direction fy using the following equations (3a) and (3b).

[0034] fx=f / (converted output pixel size) (3a) fy=f / (converted output pixel size) (3b) In FIG. 6, when the reference pixel size is px, the converted output pixel size pKx is 3px.

[0035] Furthermore, the second acquisition unit 42 acquires the horizontal image center coordinate Cx and the vertical image center coordinate Cy using the following equations (4a) and (4b).

[0036] Cx=output resolution / 2 (4a) Cy=output resolution / 2 (4b) By performing such processing, distortion can be corrected satisfactorily.

[0037] The unit of resolution is not limited to pixels, but may be expressed in size or length (mm), etc.

[0038] Specific processing methods will be described below in each example. [Example]

[0039] FIG. 7 is a flowchart showing processing related to distortion correction information in this embodiment. This flow is started, for example, by the photographer pressing the "output button." In step S11, the first acquisition unit 41 acquires discrete distortion coefficients and discrete focal length information and performs interpolation processing. In step S12, the first acquisition unit 41 acquires the shooting resolution and output resolution set by the photographer in the imaging system 2. In step S13, the second acquisition unit 42 acquires the focal length per pitch and image center coordinates according to the shooting resolution and output resolution acquired in step S12. In step S14, the transmission unit 43 transmits the focal length per pitch, the image center coordinates, and the distortion coefficient acquired in step S11. Note that the distortion coefficient is not processed by the second acquisition unit 42. The order of the processing in steps S11 and S12 may be reversed.

[0040] 8 is a schematic diagram of the resolution in this embodiment. For convenience of explanation, only the horizontal direction will be described as an example. In this embodiment, the first acquisition unit 41 acquires the reference shooting resolution, the reference output resolution, and the reference focal length per pitch, and the second acquisition unit 42 calculates how the output image has changed relative to the reference.

[0041] In this embodiment, the reference shooting resolution SCB is 3140 pixels, the reference output resolution EOB is 2160 pixels, and the reference focal length per pitch fxb is 2924 pixels. The shooting resolution SC is 4320 pixels, and the output resolution EO is 1080 pixels. In this case, the reference change rate (= reference output resolution / reference shooting resolution), which indicates how much the output resolution changes relative to the shooting resolution at the reference resolution, is 0.688 (= 2160 / 3140). The arbitrary change rate (= output resolution / shooting resolution), which indicates how much the output resolution changes relative to the shooting resolution at an arbitrary resolution, is 0.250 (= 1080 / 4320). The converted output pixel size (= reference change rate / arbitrary change rate) pKx (= (EOB / SCB) / (EO / SC)), which is the pixel size after the relative size change, is 2.752 (= 0.688 / 0.25).

[0042] The second obtaining unit 42 obtains the focal length per pitch fx (=fxb / pKx) as 1063 (=2924 / 2.752).

[0043] The above-mentioned relationship is expressed as the following equation (5).

[0044] (fxb / fx)×(EO / EOB)×(SCB / SC)=1 (5) In this embodiment, it is preferable to satisfy the following conditional expression (6). 0.95<(fxb / fx)×(EO / EOB)×(SCB / SC)<1.05 (6) By satisfying conditional expression (6), it is possible to easily and satisfactorily correct distortion, which is preferable.

[0045] It is more preferable that the range of conditional expression (6) be set to the range of the following conditional expression (6a). 0.97<(fxb / fx)×(EO / EOB)×(SCB / SC)<1.03 (6a) It is more preferable that the range of conditional expression (6) be set to the range of the following conditional expression (6b). 0.99<(fxb / fx)×(EO / EOB)×(SCB / SC)<1.01 (6b) It is also possible to have a configuration in which the output resolution EO, the reference output resolution EOB, the shooting resolution SC, and part of the reference shooting resolution SCB are stored in table format and used in combination with the above calculations. For example, depending on the resolution selected by the user, the value SCB / SC, which is the calculation result of the shooting resolution SC and the reference shooting resolution SCB, may be selected from a table, and then multiplied by the remaining formula (fxb / fx) × (EO / EOB).

[0046] Furthermore, the second acquiring unit 42 acquires the image center coordinates Cx (=EO / 2) as 540 (=1080 / 2).

[0047] In this embodiment, it is preferable to satisfy the following conditional expression (7).

[0048] 0.475 <Cx / EO<0.525 (7) By satisfying conditional expression (7), it is possible to easily and satisfactorily correct distortion, which is preferable.

[0049] It is more preferable that the range of conditional expression (7) be set to the range of the following conditional expression (7a).

[0050] 0.485 <Cx / EO<0.515 (7a) It is more preferable that the range of conditional expression (7) be set to the range of the following conditional expression (7b).

[0051] 0.495 <Cx / EO<0.505 (7b) In this embodiment, the focal length per pitch and the image center coordinates are appropriately calculated, and the processed focal length per pitch and the image center coordinates are transmitted to an external device, thereby achieving good distortion correction while minimizing the amount of recorded data.

[0052] In this embodiment, the imaging system 2 has a table of distortion coefficients and focal length information for zoom and focus positions.

[0053] Furthermore, although the number of coefficients for distortion correction can be set to six or more in OpenCV, in this embodiment, highly accurate calculations are performed based on proportional relationships at the pixel level, and therefore the number of coefficients for distortion correction is set to three, thereby reducing the amount of data. [Example]

[0054] In this embodiment, processing related to distortion correction information when the imaging resolution is not changed will be described. In this embodiment, only configurations different from those in the first embodiment will be described, and a description of common configurations will be omitted.

[0055] FIG. 9 is a flowchart showing processing related to distortion correction information in this embodiment. This flow is started, for example, by the photographer pressing the "output button." In step S21, the first acquisition unit 41 acquires discrete distortion coefficients and discrete focal length information and performs interpolation processing. In step S22, the first acquisition unit 41 acquires the output resolution set by the photographer in the imaging system 2. In step S23, the second acquisition unit 42 acquires the focal length per pitch and the image center coordinates according to the output resolution acquired in step S22. In step S24, the transmission unit 43 transmits the focal length per pitch, the image center coordinates, and the distortion correction coefficients acquired in step S21. Note that the distortion coefficients are not processed by the second acquisition unit 42. The order of the processing in steps S21 and S22 may be reversed.

[0056] In this embodiment, the reference output resolution EOB is 2160 pixels, and the reference focal length per pitch fxb is 2924 pixels. The output resolution EO is 1080 pixels. In this case, the converted output pixel size pKx (= EOB / EO) is 2 (= 2160 / 1080).

[0057] The second acquiring unit 42 acquires the focal length per pitch fx (=fxb / pKx) as 1462 (=2924 / 2). The second acquiring unit 42 also acquires the image center coordinates Cx (=EO / 2) as 540 (=1080 / 2). [Example]

[0058] In this embodiment, processing related to distortion correction information when the output resolution is not changed will be described. This embodiment is an example in which discrete distortion coefficients and discrete focal length information are acquired and interpolation processing is not performed, and is an example of a configuration in which the imaging system 2 acquires distortion coefficients and focal length information in an interpolated state. In this embodiment, only configurations that differ from embodiment 1 will be described, and a description of common configurations will be omitted.

[0059] FIG. 10 is a flowchart showing processing related to distortion correction information in this embodiment. This flow is started, for example, by the photographer pressing the "output button." In step S31, the first acquisition unit 41 acquires interpolated distortion coefficients and focal length information of the optical system. In step S32, the first acquisition unit 41 acquires the shooting resolution set by the photographer in the imaging system 2. In step S33, the second acquisition unit 42 acquires the focal length per pitch and image center coordinates according to the shooting resolution acquired in step S32. In step S34, the transmission unit 43 transmits the focal length per pitch, the image center coordinates, and the distortion coefficient acquired in step S31. Note that the distortion coefficient is not processed by the second acquisition unit 42. The order of the processing in steps S31 and S32 may be reversed.

[0060] In this embodiment, the reference shooting resolution SCB is 3140 pixels, and the reference focal length per pitch fxb is 2924 pixels. The shooting resolution SC is 4320 pixels, and the output resolution EO is 2160 pixels. In this case, the converted output pixel size pKx (= SC / SCB) is 1.3758 (= 4320 / 3140).

[0061] The second acquisition unit 42 acquires the focal length per pitch fx (=fxb / pKx) as 2125 (=2924 / 1.3758). The second acquisition unit 42 also acquires the image center coordinate Cx (=EO / 2) as 1080 (=2160 / 2). [Example]

[0062] In this embodiment, a process when there is an error in the focal length per pitch and the image center coordinates will be described. In this embodiment, only the configuration different from the first embodiment will be described, and a description of the common configuration will be omitted.

[0063] In this embodiment, the reference shooting resolution SCB is 3140 pixels, the reference output resolution EOB is 2160 pixels, and the reference focal length per pitch fxb is 2924 pixels. The shooting resolution SC is 4320 pixels, and the output resolution EO is 1080 pixels.

[0064] At this time, it is assumed that the second acquiring unit 42 acquires the focal length fx per pitch as 1015 and the image center coordinate Cx as 565.

[0065] In this case, (fxb / fx) × (EO / EOB) × (SCB / SC) is 1.047, which satisfies conditional expression (6), and Cx / EO is 0.523, which satisfies conditional expression (7). Therefore, good distortion correction can be easily achieved. [Other Examples] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0066] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) a first acquisition unit that acquires a shooting resolution and an output resolution; a second acquisition unit that acquires information about a focal length of an optical system and information about a center position of an image according to the shooting resolution and the output resolution. (Configuration 2) 2. The processing device according to configuration 1, further comprising a transmitting unit that transmits the information about the focal length and the information about the center position to an external device. (Configuration 3) 3. The processing device according to configuration 1 or 2, wherein the first acquisition unit acquires information relating to a standard shooting resolution, a standard output resolution, and a standard focal length. (Configuration 4) When the information about the focal length is fx, the information about the reference focal length is fxb, the shooting resolution is SC, the reference shooting resolution is SCB, the output resolution is EO, and the reference output resolution is EOB, 0.95<(fxb / fx)×(EO / EOB)×(SCB / SC)<1.05 4. The processing device according to configuration 3, wherein the following condition is satisfied: (Configuration 5) 5. The processing device according to claim 4, wherein the value SCB / SC is stored in a table. (Configuration 6) When the output resolution is EO and the center position information is Cx, 0.475 <Cx / EO<0.525 6. The processing apparatus according to any one of configurations 1 to 5, wherein the following conditional expression is satisfied: (Configuration 7) the first acquisition unit acquires zoom and focus position information; 7. The processing device according to any one of configurations 1 to 6, wherein the second acquisition unit performs interpolation processing on the information on the focal length corresponding to the position information. (Configuration 8) 8. The processing device according to any one of configurations 1 to 7, wherein the first acquisition unit acquires focal length information and distortion information. (Configuration 9) 9. The processing device according to configuration 8, wherein the second acquisition unit does not perform processing on the distortion aberration information according to the shooting resolution and the output resolution. (Configuration 10) 10. The processing device according to configuration 8 or 9, wherein the number of coefficients for distortion correction included in the distortion information is three or less. (Configuration 11) A processing device according to any one of configurations 1 to 10; an imaging element that photoelectrically converts an optical image formed by the optical system; (Configuration 12) 12. The imaging device according to configuration 11, wherein the first acquisition unit acquires focal length information and distortion information. (Configuration 13) 13. The imaging device according to configuration 12, wherein the first acquisition unit acquires the focal length information and the distortion aberration information from a lens device that includes the optical system. (Configuration 14) A processing device according to any one of configurations 1 to 10; and an optical system. (Configuration 15) A processing device according to any one of configurations 1 to 10; An optical system; an imaging element that photoelectrically converts the optical image formed by the optical system. (Configuration 16) an acquisition unit that acquires information about the focal length and the center position information from the processing device according to any one of the configurations 1 to 10; a processing unit that performs processing using the information about the focal length and the information about the center position. (Configuration 17) the imaging system according to configuration 15; A system comprising: the image processing device according to configuration 16. (Method 1) obtaining a capture resolution and an output resolution; and acquiring information about the focal length of an optical system and information about the center position of an image according to the shooting resolution and the output resolution. (Configuration 18) A program that causes a computer to execute the processing method described in Method 1.

[0067] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0068] 41 First acquisition part 42 Second acquisition part

Claims

1. a first acquisition unit that acquires a shooting resolution and an output resolution; a second acquisition unit that acquires information about a focal length of an optical system and information about a center position of an image according to the shooting resolution and the output resolution.

2. 2. The processing device according to claim 1, further comprising a transmitting unit that transmits the information about the focal length and the information about the center position to an external device.

3. The processing device according to claim 1 , wherein the first acquisition unit acquires information relating to a standard shooting resolution, a standard output resolution, and a standard focal length.

4. When the information about the focal length is fx, the information about the reference focal length is fxb, the shooting resolution is SC, the reference shooting resolution is SCB, the output resolution is EO, and the reference output resolution is EOB, 0.95<(fxb / fx)×(EO / EOB)×(SCB / SC)<1.05 4. The processing device according to claim 3, wherein the following condition is satisfied:

5. 5. A processing device according to claim 4, characterized in that it has the value SCB / SC in a table.

6. When the output resolution is EO and the center position information is Cx, 0.475<Cx / EO<0.525 3. The processing apparatus according to claim 1, wherein the following condition is satisfied:

7. the first acquisition unit acquires zoom and focus position information; The processing device according to claim 1 , wherein the second acquisition unit performs an interpolation process on the information about the focal length corresponding to the position information.

8. 3. The processing device according to claim 1, wherein the first acquisition unit acquires focal length information and distortion information.

9. The processing device according to claim 8 , wherein the second acquisition unit does not perform processing on the distortion aberration information according to the imaging resolution and the output resolution.

10. 9. The processing device according to claim 8, wherein the number of coefficients for distortion correction included in the distortion information is three or less.

11. The processing device according to claim 1 or 2; an imaging element that photoelectrically converts an optical image formed by the optical system;

12. The imaging device according to claim 11 , wherein the first acquisition unit acquires focal length information and distortion information.

13. The imaging device according to claim 12 , wherein the first acquisition unit acquires the focal length information and the distortion information from a lens device that includes the optical system.

14. The processing device according to claim 1 or 2; and an optical system.

15. The processing device according to claim 1 or 2; An optical system, an imaging element that photoelectrically converts the optical image formed by the optical system.

16. an acquisition unit that acquires information about the focal length and the center position information from the processing device according to claim 1 or 2; a processing unit that performs processing using the information about the focal length and the information about the center position.

17. The imaging system according to claim 15; A system comprising: the image processing device according to claim 16.

18. obtaining a capture resolution and an output resolution; and acquiring information about the focal length of an optical system and information about the center position of an image according to the shooting resolution and the output resolution.

19. A program causing a computer to execute the processing method according to claim 18.

Images