Image capture device, control method and program for controlling the same, and optical device

Abstract

To prevent reduction in image quality due to aberration in a camera system using a replaceable optical device for an imaging apparatus as a multispectral camera.SOLUTION: An imaging apparatus has: lens information acquisition means that acquires lens information on a lens device; array information acquisition means that acquires array information on an optical device; correction information acquisition means that acquires aberration correction information on the basis of, the lens information and the array information; image creation means that cuts out a plurality of images in tile shapes from an image signal output by picking up an image of a light beam of a subject incident through a predetermined filter of the optical device by using imaging means; and correction means that corrects the aberration of the plurality of images on the basis of, the aberration correction information. The predetermined filter includes a plurality of areas for dividing the light beam of the subject into a plurality of spectral components. The plurality of images corresponds to the plurality of areas of the predetermined filter.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an imaging device as a multispectral camera, which uses an exchangeable optical device for the imaging device to simultaneously acquire multiple images, a control method and program for the imaging device, and an optical device. [Background technology]

[0002] Multispectral cameras (also called multiband cameras) are known to capture multiple different spectral components in a spectrum. Multispectral cameras are used in food inspections and other applications based on images obtained for each spectral component.

[0003] One known capture method for multispectral cameras is a tiled multispectral camera, in which different filters are arranged for each partial area (tile) on the front side (subject side) of the image sensor to match the imaging area of ​​the image sensor. By adopting this method, it is possible to simultaneously acquire multiple tiled band images (tile images) from the image sensor in a single image capture. For example, Patent Document 1 proposes an optical device that can disperse light into multiple different bands and has an interchangeable lens array and bandpass filter array, and an imaging system equipped with the same.

[0004] Images captured using a digital camera suffer from image distortion due to optical devices such as lenses and differences in image size for each band. Generally, image distortion due to lenses and other factors is called distortion aberration, and differences in image size are called lateral chromatic aberration. These aberrations can also occur when using a multispectral camera. For example, Patent Document 2 proposes a technique for correcting distortion aberration and lateral chromatic aberration for each band image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-64164 [Patent Document 2] Japanese Patent Application Publication No. 2019-020951 Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the technology proposed in Patent Document 1, even if the same bandpass filter is used, there is a risk that the distortion and size of the image may differ depending on the filter position on the bandpass filter array.

[0007] Furthermore, the technology proposed in the above-mentioned Patent Document 2 does not disclose a method for reducing image distortion and size according to the lens array and bandpass filter array in an optical device that is interchangeable with a camera, so there is a risk that image distortion according to the optical characteristics of the optical device (interchangeable lens or adapter device) that is interchangeable with a camera cannot be properly corrected.

[0008] Therefore, an object of the present invention is to suppress degradation of image quality due to aberration in a camera system that uses an optical device that is replaceable for an imaging device as a multispectral camera. [Means for solving the problem]

[0009] An imaging device for achieving the above-mentioned object is an imaging device that has an imaging means and can be connected to a lens device and an optical device, and includes: a lens information acquisition means that acquires lens information about the lens device; an array information acquisition means that acquires array information about the optical device; a correction information acquisition means that acquires aberration correction information based on the lens information and the array information; an image generation means that extracts multiple images in a tiled pattern from an image signal output by using the imaging means to capture a light beam of a subject that has entered through a predetermined filter of the optical device; and a correction means that corrects aberrations of the multiple images based on the aberration correction information, wherein the predetermined filter has multiple regions that disperse the light beam of the subject into multiple spectral components, and the multiple images are images that correspond to the multiple regions of the predetermined filter. [Effects of the Invention]

[0010] According to the present invention, in a camera system using an interchangeable optical device for an imaging device as a multispectral camera, degradation of image quality due to aberration can be suppressed. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of the configuration of an imaging device 1 that is a first embodiment of an imaging device embodying the present invention. [Figure 2] 1 is a diagram illustrating an example of an imaging system according to a first embodiment of the present invention. [Figure 3] 5 is a flowchart showing an aberration correction process according to the first embodiment of the present invention. [Figure 4] 3A to 3C are diagrams illustrating an example of a method for cutting out tile images and correcting aberrations according to the first embodiment of the present invention. [Figure 5] 10 is a flowchart showing a density correction process according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] (First embodiment) (Basic configuration of imaging device 1) DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Fig. 1 is a block diagram showing an example of the configuration of an image pickup apparatus 1 which is a first embodiment of an image pickup apparatus embodying the present invention.

[0013] One or more of the functional blocks shown in FIG. 1 may be realized by hardware such as an ASIC or a programmable logic array (PLA), or may be realized by a programmable processor such as a CPU or MPU executing software.

[0014] It may also be realized by a combination of software and hardware.

[0015] Therefore, even when different functional blocks are described as performing operations in the following description, they may be realized as performing operations using the same hardware.

[0016] 1, the imaging device 1 of this embodiment is a so-called interchangeable lens imaging device to which an optical device 2 and a lens device 3 can be attached and detached via a mount unit (not shown), but is not limited to this. For example, the imaging device 1 may be configured to include the optical device 2 and the lens device 3. Alternatively, the optical device 2 and the lens device 3 may be integrally provided. The basic configuration of the imaging device 1 will be described below on the assumption that the optical device 2 and the lens device 3 are attached to the imaging device 1. Details of the optical device 2 and the lens device 3 will be described later.

[0017] The imaging device 1 includes an imaging unit 110, a microcomputer 120, an operation unit 130, a display unit 140, a storage unit 150, a volatile memory 160, a non-volatile memory 170, a correction information acquisition unit 180, and an image processing unit 190.

[0018] The imaging unit 110 is a charge-storage type solid-state imaging element such as a CCD or CMOS that receives an optical image formed by light passing through the lens device 3 being dispersed by the optical device 2. The information of the electric charges acquired by photoelectrically converting (imaging) the light beam of the subject obtained through the lens device 3 is A / D converted, and an image signal, which is digital data, is generated.

[0019] The volatile memory 160 is configured by, for example, RAM (RANDOM ACCESS MEMORY) and is used to temporarily store data. The volatile memory 160 is used as a memory for various controls by the microcomputer 120 and for image processing by the image processing unit 190.

[0020] The nonvolatile memory 170 is configured by, for example, a ROM (Read Only Memory) and stores various programs for operating the microcomputer 120, correction information used by the image processing unit 190, and the like.

[0021] The microcomputer 120 is a control means capable of performing overall control of the imaging device 1, such as controlling the entire imaging device 1 and controlling the sequence of image processing, in accordance with a program stored in the nonvolatile memory 170 and using the volatile memory 160 as a work memory. The microcomputer 120 can also receive lens information related to the lens device 3 and array information related to the optical device 2 from the optical device 2. In other words, the microcomputer 120 is a lens information acquisition means and an array information acquisition means according to the present invention.

[0022] The correction information acquisition unit 180 acquires correction information required for aberration correction and density correction of the image signal. This correction information is calculated in advance by the microcomputer 120 for each combination of lens information and array information, and is stored as a data table linked to the lens information and array information. This data table is preferably stored in the non-volatile memory 170. The correction information acquisition unit 180 can acquire the correction information required for aberration correction and density correction by comparing the acquired lens information and array information with the data table.

[0023] The image processing unit 190 is an image processing means that performs processes such as cutting out a plurality of tiled images (hereinafter simply referred to as tile images), aberration correction, and density correction on the image signal output by the imaging unit 110. The image processing unit 190 may be configured with a dedicated circuit block for performing specific image processing, or the microcomputer 120 may perform image processing according to a program.

[0024] The operation unit 130 is an operation means configured with buttons, switches, dials, a touch panel, etc. that can be manually operated by the user. In the imaging device 1, an operation from the user is accepted by the operation unit, and the microcomputer 120 controls each unit according to the operation content.

[0025] The display unit 140 displays images, GUI screens constituting a GUI (Graphical User Interface), and the like. The microcomputer 120 generates display control signals according to a program, and controls each unit of the imaging device 1 to generate video signals to be displayed on the display unit and output them to the display unit 140. Note that the imaging device 1 itself is only equipped with an interface for outputting video signals to be displayed on the display unit 140, and the display unit 140 may be configured as an external monitor. The storage unit 150 stores image data output by the image processing unit 190. This storage unit 150 may be built into the imaging device 1 or may be removable. These are the details of the imaging device 1 according to the first embodiment of the present invention.

[0026] (Configuration of Optical Device 2 and Details of Imaging System) An optical device 2 and an imaging system according to a first embodiment of the present invention will be described below with reference to Fig. 2. Fig. 2 is a diagram illustrating an example of the imaging system according to the first embodiment of the present invention, and Fig. 2(a) is a diagram illustrating an example of the transition of a light beam of a subject formed in an imaging system using the optical device 2, and the transmission and reception of information between the devices. Fig. 2(b) is a diagram illustrating an example of the configuration of a filter array 212 included in the optical device 2.

[0027] 2(a), the imaging system according to this embodiment includes an imaging device 1, an optical device 2, and a lens device 3, arranged in this order from the image side. The lens device 3 is an optical device that serves to convert the angle of view (imaging angle of view) of the imaging system, and the processing unit 310 is processing means that holds lens information related to the lens device 3. Here, the lens information described above includes an identifier (ID) for identifying the lens type and individual lens, lens-specific information such as aberration information, and imaging information such as the zoom position during imaging.

[0028] The photographing lens 320 is an optical means that guides a light beam from a subject toward the optical device 2 and the imaging device 1. Although not shown in FIG. 2(a), the photographing lens 320 includes a variety of lens groups such as a zoom lens, a focus lens, and a shift lens.

[0029] The optical device 2 functions to separate the light beam from the subject incident from the lens device 3 into a plurality of spectral components. The optical device 2 includes a lens array 211 having a plurality of lens portions each forming an image of the object, and a filter array 212 having a plurality of filters arranged on the optical axis of each lens portion.

[0030] The filter array 212 includes three or more filters arranged in a first direction perpendicular to the optical axis AX0 of the lens device 3 and the optical device 2. In this embodiment, as shown in Fig. 2(b), the filter array 212 includes nine filters F11 to F33 arranged in the X and Y directions. By configuring the filter array 212 with a plurality of filters having different transmission characteristics, it becomes possible to simultaneously acquire images of the same subject based on the subject's light beam dispersed into a plurality of different spectral components.

[0031] Furthermore, in the optical device 2 of this embodiment, a portion including the lens array 211 and the filter array 212 is configured as an accessory device 210 that can be attached to and detached from the optical device 2. Specifically, the optical device 2 has an opening (not shown) on its side, and employs a configuration in which the accessory device 210 can be inserted and removed from the opening. With this configuration, it is possible to appropriately replace the filter array 212 with one having different transmission characteristics depending on the subject to be imaged and the purpose of shooting. Note that, in the optical device 2, the lens array 211 can also be replaced in accordance with the filter array 212, and therefore the number of bands and resolution can be adjusted by increasing or decreasing the number of lenses.

[0032] The first processing unit 213 is a processing means for holding array information related to the optical device 2. The array information is, for example, an identifier (ID) for identifying the type or individuality of the accessory device, or information related to the optical characteristics of the lens array 211 and the transmission characteristics and filter arrangement of the filter array 212. It is assumed that the optical device 2 identifies the type of the accessory device 210, and the above-mentioned array information is changed as appropriate.

[0033] The second processing unit 220 is a processing means that transmits the lens information received from the lens device 3 and the array information acquired from the first processing unit 213 to the imaging device 1. As described above, the optical device 2 and the imaging device 1 can be connected to each other via a mount unit (not shown), and various information is exchanged through communication means such as electrical contacts provided in each mount unit. This configuration allows the imaging device 1 to detect whether the lens device 3 and the optical device 2 are attached and to recognize their types. Note that, because overall control of the imaging system is performed on the imaging device 1 side, it is desirable that communication between the optical device 2 and the imaging device 1 be performed in accordance with the communication protocol of the imaging device side.

[0034] FIG. 2(c) is a diagram illustrating an example of each region of the imaging unit 110 that receives light beams from a subject transmitted through the filter array 212. As shown in FIG. 2(c), the imaging device 1 receives light transmitted through the filter array 212 at the imaging unit 110 (image sensor). Light transmitted through each filter of the filter array 212 is received at each partial region (hereinafter referred to as a tile) on the image sensor corresponding to the filter arrangement. The imaging unit 110 (image sensor) then outputs an image signal (spectral data) to which the intensity value (hereinafter referred to as spectral intensity) of the spectral component corresponding to each filter is added. FIG. 2(c) shows nine tiles T11 to T33 arranged in mutually orthogonal X and Y directions on the imaging unit (image sensor) 110. For example, light transmitted through filter F11 of the filter array 212 is received by tile T11.

[0035] Specific examples of the spectral data include ultraviolet, visible, or infrared spectral data, Raman spectral data, NMR spectral data, mass spectral data, liquid chromatograms, gas chromatograms, and sound frequency spectral data. In particular, the spectral data preferably includes any one of ultraviolet, visible, or infrared spectral data, Raman spectral data, and mass spectral data. When the spectral data is ultraviolet, visible, or infrared spectral data or Raman spectral data, the spectral components can be converted into wavelengths or wave numbers. Furthermore, when the spectral data is mass spectral data, the spectral components can be converted into mass-to-charge ratios or mass numbers. The above is a detailed description of the optical device 2 and imaging system according to the first embodiment of the present invention.

[0036] (Details of aberration correction processing) Image signals acquired using the imaging system shown in FIG. 2(a) suffer from image distortion (distortion aberration) caused by lenses and the like, as well as differences in image size for each tile image (chromatic aberration of magnification). An image processing method for reducing this distortion aberration and chromatic aberration of magnification will be described below. FIG. 3 is a flowchart showing aberration correction processing according to a first embodiment of the present invention. The image processing method according to this embodiment will be described below with reference to FIG. 3. Note that in FIG. 3, steps are abbreviated as S.

[0037] In S301, the microcomputer 120 turns on the power of the imaging device 1 in response to the user's operation of the power switch included in the operation unit .

[0038] Next, in S302, the microcomputer 120 acquires lens information from the currently attached lens device 3. As described above, the lens information includes an identifier (ID) for identifying the type of attached lens, and the like, received from the lens device 3 via the optical device 2. Before executing the processing of S302, the microcomputer 120 determines whether the optical device 2 and the lens device 3 are attached to the imaging device 1, as well as their types, via the electrical contacts provided in the mount unit (not shown).

[0039] Next, in S303, the microcomputer 120 acquires array information from the optical device 2. As described above, the array information received includes identifiers (IDs) for identifying the types of the lens array 211 and the filter array 212.

[0040] Next, in S304, the microcomputer 120 uses the imaging unit 110 to capture an image of the subject, thereby obtaining an image signal.

[0041] Next, in S305, the microcomputer acquires from the lens device 3 via the optical device 2 information such as the focal length (zoom information) of the lens device 3 when the subject was imaged in the process of S304.

[0042] Next, in S306, the microcomputer 120 acquires information to be used for various aberration corrections based on the previously acquired lens information and array information. Generally, aberration correction requires a conversion equation between the coordinates of a pixel in the ideal lattice after correction and the coordinates of the corresponding pixel before correction. For example, the coordinates of pixel P in the ideal lattice after correction are (x, y), the coordinates of the corresponding pixel P' before correction are (x', y'), and the conversion coefficients are A0 to A9 and B0 to B9. An example of the conversion equation in this case is shown in Equation (1) below. The conversion coefficients A0 to A9 and B0 to B9 vary not only depending on the lens type and zoom position, but also depending on the lens array 211 and the filter array 212. In particular, the filter array 212 varies depending on the bandwidth and filter arrangement of the band-pass filter. Therefore, the microcomputer 120 pre-calculates the conversion coefficients A0 to A9 and B0 to B9 for each combination of the previously acquired lens information and array information, and associates them with the lens information and array information to prepare an aberration correction information table. This aberration correction information table is preferably stored in the nonvolatile memory 170 of the imaging device 1, but may also be held in the first processing unit 213 of the optical device 2 or the processing unit 310 of the lens device 3. Then, in the process of S306, the lens identifier and array identifier are compared with the aberration correction information table to obtain the conversion coefficients A0 to A9 and B0 to B9 required for aberration correction for each tile image.

[0043]

number

[0044] When the conversion coefficients A0 to A9 and B0 to B9 are acquired in advance, they are generally calculated based on the results of capturing an image of a known subject, such as a specified chart paper. In this case, the conversion coefficients A0 to A9 and B0 to B9 are calculated for each tile image obtained by capturing an image of the specified chart paper, so that the position, shape, and magnification of the subject are approximately the same for all tile images. This makes it possible to correct distortion, chromatic aberration of magnification, and positional deviation all at once.

[0045] Next, in S307, the microcomputer 120 extracts tile images from the image signal. Details of the processing in S307 and S308 will be described below with reference to FIG. 4. FIG. 4 is a diagram illustrating an example of a method for extracting tile images and correcting aberrations according to the first embodiment of the present invention. FIG. 4(a) shows the original image signal, FIG. 4(b) shows each tile image before aberration correction, FIG. 4(c) shows each tile image after aberration correction, and FIG. 4(d) shows the conversion coefficients for each tile image.

[0046] The original image signal shown in Fig. 4(a) represents an image signal based on the light beams of the subject received through nine tiles arranged in the X and Y directions on the image sensor shown in Fig. 2(c). The processing in S307 corresponds to the processing of cutting out tile images from the original image shown in Fig. 4(a) according to the number of tiles, as shown in Fig. 4(b).

[0047] Next, in S308, the microcomputer 120 corrects the aberration for each tile image based on the aberration correction information obtained in S306. Specifically, in S308, the microcomputer 120 performs coordinate transformation for all pixels based on the transformation coefficients for each tile image obtained in S306 and transformation equation (1), as well as interpolation processing to determine the spectral intensity after the transformation, as shown in FIG. 4(d). The microcomputer 120 then applies the above processing to all tile images, thereby generating all tile images after aberration correction, as shown in FIG. 4(c). In other words, the microcomputer 120 is an image generation means according to the present invention. Note that after the processing of S308, multiple tile images after aberration correction may be reconstructed to generate a single multiband image.

[0048] Finally, in S309, the microcomputer 120 determines whether or not a power-off command has been issued by a user operation, and if a power-off command has been issued in S309, the aberration correction process ends. Note that if it is determined in S309 that a power-off command has not been issued, the processes of S304 to S309 are repeated. Note that, when acquiring a moving image, the processes of S304 to S309 are repeated, but when acquiring a still image, a separate process may be provided before S304 to determine whether or not a command to capture a still image has been issued, and the processes of S304 to S309 may be repeated depending on the determination result of that process. This concludes the details of the aberration correction process according to this embodiment.

[0049] As described above, the imaging device 1 according to this embodiment can acquire aberration correction information for each of multiple tile images (multiband images) based on lens information and array information, and perform aberration correction collectively based on the aberration correction information. This configuration can reduce the time required for aberration correction, for example, by eliminating the need to perform aberration correction for each of multiple images acquired through multiple filter arrays capable of dispersing light into multiple different spectral components.

[0050] (Second embodiment) Next, a configuration example of an imaging device 1 according to a second embodiment of the present invention will be described. Note that the configurations of the imaging device 1, optical device 2, and lens device 3 are the same as those of the first embodiment described above, so a description thereof will be omitted and only the configurations different from those of the first embodiment described above will be described.

[0051] Even if it is assumed that the spectral characteristics of the subject are uniform regardless of wavelength, unevenness in brightness (unevenness in spectral intensity) occurs between tile images obtained through the optical device 2 due to the optical characteristics of the lens device 3, the transmission characteristics of the filter array of the optical device 2, the sensitivity characteristics of the image sensor, etc. Fig. 5 is a flowchart showing a density correction process according to a second embodiment of the present invention. An image processing method for reducing the effects of this unevenness in density will be described below with reference to Fig. 5.

[0052] In S501, the microcomputer 120 turns on the power of the imaging device 1 in response to a user's operation of a power switch included in the operation unit 130. Next, in S502, the microcomputer 120 acquires array information from the optical device 2. Next, in S503, the microcomputer 120 acquires an image signal by capturing an image of a subject using the imaging unit 110. Note that the processing of S501 to S503 is the same as the processing of S301, S303, and S304 in the first embodiment described above.

[0053] Next, in S404, the microcomputer 120 acquires information related to density correction to be applied to the image signal based on the array information acquired earlier. As described above, the brightness of each tile image may differ (density unevenness may occur) due to factors such as the optical characteristics of the lens device 3, the transmission characteristics of the lens array 211 and filter array 212 provided in the optical device 2, and the sensitivity characteristics of the imaging unit 110. If the brightness differs between multiple tile images acquired at the same time, there is a risk that correct processing results will not be obtained when the multiple tile images are used in various processes (for example, when used as training data in AI processing).

[0054] Therefore, in this embodiment, in the process of S404, the density ratio between tile images is calculated in advance for each combination of the above-mentioned array information and imaging device 1, and a density correction information table is prepared in advance as information linking the array information and the imaging device 1. Then, the microcomputer 120 obtains the density ratio between tile images required for density correction by comparing the array identifier with the density correction information table.

[0055] With this configuration, the imaging device 1 of the present invention corrects the brightness (spectral intensity) of each pixel in a tile image based on the density correction information table each time it captures an image of a subject, thereby reducing differences in brightness (density unevenness) between tile images. Note that while it is desirable to store the density correction information table in the nonvolatile memory 170 of the imaging device 1, it may also be configured to hold it in the first processing unit 213 of the optical device 2.

[0056] Note that when calculating the density ratio between tile images in advance, it is common to do so based on the results of capturing an image of an entirely white subject, such as a white balance chart. A method for calculating the density ratio between tile images using this white balance chart involves calculating the average spectral intensity for each tile image for all tile images generated by capturing an image of the white balance chart. At this time, to reduce the effects of shading, it is desirable to calculate the average spectral intensity of the central portion of each tile image. This average spectral intensity is used as the density of the tile image. Alternatively, the spectral intensity may be used as the luminance of each image, and the average value of the central portion of each image may be used as the density of the tile image. Then, a reference tile image is selected, and the density ratio between the reference tile image and each of the other tile images is calculated, thereby generating the density ratio between the tile images.

[0057] Table 1, described below, shows an example of the density ratio (brightness ratio) between tile images, which is density correction information. Table 1 exemplifies a case where the lens array and filter array have a 4x3 array structure (divided into 12 tiles), and the bandpass filters are configured so that the central wavelength ranges from 475 nm to 1025 nm in 50 nm increments. In the example shown in Table 1, the tile image corresponding to the bandpass filter with a central wavelength of 975 nm is used as the reference (density ratio 1), and the density ratios with the other tile images are calculated.

[0058] 5, in S505, the microcomputer 120 extracts tile images from the image signal. The method for extracting tile images is substantially the same as S307 in the first embodiment, and therefore a description thereof will be omitted.

[0059] Next, in S506, the microcomputer 120 corrects density unevenness between tile images based on the information about the density ratio acquired in S504. If the spectral intensity of the pixel at coordinates (x, y) in tile image t is It(x, y), the spectral intensity after density correction is I't(x, y), and the density ratio between reference tile image s and tile image t is Rst, an example of a correction formula is shown in Equation (2). In the processing of S506, the spectral intensity correction based on this correction formula is performed on all pixels in the tile image to generate a density-corrected tile image. Furthermore, the above spectral intensity correction is performed on all tile images to generate all density-corrected tile images.

[0060]

number

[0061] After the process of S506, a single multiband image may be generated by reconstructing a plurality of tile images after aberration correction. Finally, in S507, the microcomputer 120 determines whether a user operation or the like has instructed the power to be turned off, and if the user operation has been instructed, the density correction process ends. If the user operation or the like has been instructed to turn off the power, the density correction process ends. If the user operation or the like is instructed not to turn off the power, the process of S503 to S507 is repeated, and the process procedure in this case is substantially the same as the aberration correction process in the first embodiment described above, and therefore will not be described again. The above is the details of the density correction process according to this embodiment.

[0062] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and various modifications and variations are possible within the scope of the present invention. In the above embodiments, aberration correction and density correction are achieved by processing in each functional unit of the imaging device, but the present invention is not limited to this. For example, some functions of the imaging device may be processed by a separate image processing device connected to the imaging device via a network or the like.

[0063] In the above-described embodiment, the lens array 211 and the filter array 212 provided in the optical device 2 are assumed to be divided into a total of nine 3×3 regions, but the present invention is not limited to this. For example, other configurations may be adopted, such as 4×4 or 4×3 regions, with limitations on the number of regions and the setting method, as long as a table relating to aberration correction and density correction is calculated for each divided region.

[0064] Furthermore, in the above-described embodiment, a method for acquiring lens information and array information from the optical device 2 and the lens device 3 has been described, but the present invention is not limited to this. For example, a configuration may be adopted in which lens information and array information are acquired from another external device (such as a PC or a smartphone) that can be connected to the imaging device 1, and tables related to aberration correction and density correction are calculated based on the acquired information. In other words, a configuration may be adopted in which arbitrary information is acquired from a device other than one directly connected to the imaging device 1, and tables related to aberration correction and density correction are calculated based on the acquired information.

[0065] In the above-described embodiment, a digital camera has been described as an example of an imaging device for implementing the present invention, but the present invention is not limited to this. For example, the present invention may be configured to employ imaging devices other than digital cameras, such as digital video cameras, wearable devices, and security cameras.

[0066] In the above-described embodiment, an example of an imaging device embodying the present invention has been described assuming a digital camera with a so-called interchangeable lens type to which the lens device 3 can be attached or detached, but a so-called integrated lens type digital camera may also be used. In this case, it is sufficient that a component having substantially the same configuration as the optical device 2 can be inserted into the optical path on the body side or lens side of the imaging device.

[0067] In the above-described embodiment, the various components constituting the imaging system, centered around the microcomputer 120, operate in cooperation with one another to control the operation of the entire device. However, this is not a limitation. For example, a (computer) program conforming to the flow illustrated in each of the above-described figures may be stored in advance in a ROM area of ​​the non-volatile memory 170 of the imaging device 1. The microcomputer 120 may then execute the program to control the operation of the entire imaging system. Furthermore, any form of program may be used as long as it has the functionality of a program, such as object code, a program executed by an interpreter, or script data supplied to an OS. Furthermore, the recording medium for supplying the program may be, for example, a magnetic recording medium such as a hard disk or magnetic tape, or an optical / magneto-optical recording medium.

[0068] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0069] [Table 1] [Explanation of symbols]

[0070] 1. Imaging device 2 Optical equipment 3 Lens device 110 Imaging unit (imaging element) 120 Microcomputer 180 Correction information acquisition unit 190 Image Processing Unit 210 Accessory Devices 212 Filter Array

Claims

1. An imaging device that includes an imaging means and can connect to a lens device and an optical device, a lens information acquisition unit that acquires lens information including an identifier for identifying the type and individual lens of the lens device, aberration information related to the lens, and information related to the zoom position at the time of shooting; an array information acquiring means for acquiring array information for identifying the transmission characteristics and filter arrangement of the filter array provided in the optical device; a correction information acquisition means for acquiring, as aberration correction information, a conversion coefficient in a conversion formula for converting pixel coordinates of an ideal lattice after aberration correction into corresponding pixel coordinates before correction, based on the lens information and the array information; an image generating means for extracting a plurality of images in a tiled form from an image signal output by capturing an image of a subject's light beam incident through the filter array included in the optical device using the imaging means; a correction means for correcting aberrations of the plurality of images based on the aberration correction information; and the filter array has a plurality of regions that separate a light beam from an object into a plurality of spectral components; An imaging device, wherein the plurality of images correspond to the plurality of regions of the filter array.

2. The imaging device according to claim 1 , wherein the array information includes information about the type of the filter array.

3. 3. The imaging device according to claim 1, wherein the array information includes information about transmission characteristics of the filter array and the arrangement of the plurality of regions.

4. An imaging device described in any one of claims 1 to 3, characterized in that the filter array is insertable and detachable from the optical device.

5. An imaging device described in any one of claims 1 to 3, characterized in that the filter array is provided in the optical device.

6. the optical device includes a lens array having a plurality of lens portions; The imaging device according to claim 1 , wherein the plurality of images correspond to the plurality of lens portions of the lens array.

7. The imaging device according to claim 6 , wherein the array information includes information about the type of the lens array.

8. 8. The imaging device according to claim 6, wherein the array information includes information about optical characteristics of the lens array and an arrangement of the plurality of lens portions.

9. 9. The imaging device according to claim 6, wherein the lens array is insertable into and removable from the optical device.

10. 9. The imaging device according to claim 6, wherein the lens array is provided in the optical device.

11. 11. The imaging device according to claim 1, wherein the lens information includes information about the type of the lens device.

12. The imaging device according to claim 11 , wherein the lens information includes information about a zoom position.

13. 13. The imaging device according to claim 1, wherein the aberration correction information is information calculated for the plurality of images acquired by imaging a predetermined subject so that the position, shape, and magnification of the subject are approximately the same among the plurality of images.

14. 14. The imaging apparatus according to claim 13, wherein the aberration correction information is information for correcting pixel positions for each of the plurality of images.

15. An optical device connectable to the imaging device according to any one of claims 1 to 14.

16. 16. The optical device according to claim 15, wherein the optical device is detachable from a mount portion provided on the imaging device.

17. An optical device that can be connected to a lens device and an imaging device, a lens information acquisition means for acquiring lens information including an identifier for identifying the type and individual lens of the lens device, aberration information about the lens, and information about the zoom position at the time of shooting; an array information acquiring means for acquiring array information for identifying the transmission characteristics and filter arrangement of a filter array included in the optical device; a correction information acquisition means for acquiring, as aberration correction information, a conversion coefficient in a conversion formula for converting pixel coordinates of an ideal lattice after aberration correction into corresponding pixel coordinates before correction, based on the lens information and the array information; a communication means for transmitting the aberration correction information to the imaging device; and The optical device is characterized in that the filter array has a plurality of regions that separate a light beam from an object into a plurality of spectral components.

18. A control method for an imaging device that includes an imaging means and can connect a lens device and an optical device. a lens information acquisition step of acquiring lens information including an identifier for identifying the type and individual lens of the lens device, aberration information related to the lens, and information related to the zoom position during shooting; an array information acquisition step of acquiring array information for identifying the transmission characteristics and filter arrangement of a filter array included in the optical device; a correction information acquisition step of acquiring, as aberration correction information, conversion coefficients in a conversion formula that converts pixel coordinates of the ideal lattice after aberration correction into corresponding pixel coordinates before correction, based on the lens information and the array information; an image generating step of extracting a plurality of images in a tiled form from an image signal output by capturing an image of a subject's light beam incident through the filter array included in the optical device using the imaging means; a correction step of correcting aberrations of the plurality of images based on the aberration correction information; and 10. A method for controlling an imaging apparatus, wherein the filter array has a plurality of regions that separate a light beam from an object into a plurality of spectral components.

19. A computer-readable program for causing a computer to execute the method for controlling an imaging apparatus according to claim 18.

Images