Accessory, imaging device, imaging system, accessory control method, and program
Patent Information
- Application Number
- JP2021195249
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2021-12-01
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-12-01
AI Technical Summary
Existing image correction technologies fail to provide a sense of discomfort under various photographing conditions due to components beyond optical system deterioration, necessitating an accessory that can correct image data effectively.
An accessory with detachable lens devices that include first and second data groups for correcting image data, allowing communication with an imaging device to transmit correction data based on optical characteristics and imaging device characteristics, enabling effective optical correction.
The accessory allows for high-speed processing and appropriate optical correction, ensuring desired image quality by using correction data tailored to the imaging device's characteristics, reducing discomfort and enhancing image quality.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an accessory, an imaging device, an imaging system, a method for controlling an accessory, and a program.
Background Art
[0002] Images (videos) captured through an optical system often have degradation caused by the optical system. The degradation of images caused by the optical system can be corrected using an imaging device or an image processing device.
[0003] Patent Document 1 discloses an apparatus that performs image processing for correcting image degradation due to chromatic aberration of an optical system. Patent Document 2 discloses an imaging system having a function of correcting a drop in peripheral light quantity by amplifying an image signal.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0005] By the way, data for correction as described above needs to generate a corrected image without a sense of incongruity under various shooting conditions. On the other hand, correction data for generating a corrected image without a sense of incongruity under various shooting conditions includes components other than those related to the optical system, so that a desired image may not be obtained depending on the situation and application.
[0006] An object of the present invention is to provide, for example, an accessory advantageous for obtaining a desired image.
Means for Solving the Problems
[0007] One aspect of the present invention is an accessory that can be attached to and detached from an imaging device, and includes a storage unit that stores first data having a first characteristic for correcting image data obtained by the imaging device and second data having a second characteristic for correcting the image data, and a communication unit that can transmit first information based on the first data and second information based on the second data to an external device.
[0008] Other objects and features of the present invention are described in the following examples. [Effects of the Invention]
[0009] According to the present invention, for example, an accessory advantageous for obtaining a desired image can be provided. [Brief explanation of the drawing]
[0010] [Figure 1] This is a block diagram of the imaging system in Example 1. [Figure 2] This is a block diagram of the imaging system in Example 1. [Figure 3] This graph shows the relationship between image height and light intensity in Example 1. [Figure 4] This is a flowchart of the correction data generation process by the lens device in Example 1. [Figure 5] This is a flowchart of the image generation process by the imaging device in Example 1. [Figure 6] This is a flowchart of the image generation process by the imaging device in Example 1. [Figure 7] This is a block diagram of the imaging system in Example 2. [Figure 8] This graph shows the relationship between image height and light intensity in Example 2. [Figure 9] This is a flowchart of the image generation process by the imaging device in Example 2. [Figure 10] This is a block diagram of the imaging system in Example 3. [Figure 11]It is a block diagram of an imaging system in Embodiment 3. [Figure 12] It is a graph showing the relationship between image height and light quantity in Embodiment 3. [Figure 13] It is a flowchart of correction data generation processing by the adapter device in Embodiment 3. [Figure 14] It is a flowchart of image generation processing by the imaging device in Embodiment 3. [Figure 15] It is a flowchart of image generation processing by the imaging device in Embodiment 3.
Mode for Carrying Out the Invention
[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
Embodiment
[0012] First, referring to FIGS. 1 and 2, an imaging system with an accessory in Embodiment 1 of the present invention will be described. In this embodiment, the accessory is a lens device detachable from the imaging device. FIG. 1 is a block diagram of the imaging system 100A. FIG. 2 is a block diagram of the imaging system 100B.
[0013] The imaging system 100A shown in FIG. 1 includes an imaging device 102A and a lens device 101 detachable from the imaging device 102A. The imaging device 102A performs optical correction using the correction data 2 output from the communication unit 1009 of the lens device 101 as it is.
[0014] The lens device 101 is detachable from the imaging device 102A and forms an optical image (subject image) through an imaging optical system including a focus lens 1001, a zoom lens 1002, and an aperture 1003, which then images the image onto the image sensor 1101 of the imaging device 102A. The F position detection unit 1004, the Z position detection unit 1005, and the I position detection unit 1006 are detection means for detecting the positions (positions of optical elements) of the focus lens 1001, the zoom lens 1002, and the aperture 1003, respectively, and are, for example, potentiometers or encoders.
[0015] Memory 1007 is a data storage unit that stores a first data group X1 (also called first data X1) and a second data group Y1 (also called second data Y1). The first data group X1 is a data group having a first characteristic for correcting image data obtained by the imaging device, and the second data group Y1 is a data group having a second characteristic for correcting image data obtained by the imaging device. Memory 1007 may be either ROM (internal memory) inside the CPU or external memory separate from the CPU. Details of the first data group X1 and the second data group Y1 will be described later.
[0016] The data generation unit 1008 generates correction data to be notified to the imaging device 102A based on the data stored in the memory 1007, according to the detected positions (positions of optical elements) detected by the F position detection unit 1004, the Z position detection unit 1005, and the I position detection unit 1006. Details of the data generation unit 1008 will be described later. The communication unit 1009 sends and receives information to and from the imaging device 102A. In this embodiment, the communication unit 1009 transmits the detected positions detected by the F position detection unit 1004, the Z position detection unit 1005, and the I position detection unit 1006. The communication unit 1009 also transmits the correction data (first data (first information), second data (second information)) generated by the data generation unit (information generation unit) 1008.
[0017] Here, the correction data refers to the first data (first information based on the first data X1) based on the first data group X1 and the second data (second information based on the second data Y1) based on the second data group Y1. The first data (first information) is data relating to the optical characteristics of the lens device 101 as an accessory. The second data (second information) is data for correcting the image captured by the imaging device 102A (image data obtained by the imaging device 102A). In other words, the first characteristic corresponds to the optical characteristics of the accessory (lens device), and the second characteristic corresponds to a characteristic that is a combination of the optical characteristics of the accessory (lens device) and the characteristics of the imaging device.
[0018] The communication unit 1009 transmits the first data and the second data in the same data format. This enables high-speed processing by using a common data format. The communication unit 1009 can also transmit either the first data or the second data individually, according to a request from the imaging device. Alternatively, the communication unit 1009 may be configured to transmit both the first data and the second data as a set (for example, via serial communication) according to a request from the imaging device. The communication unit 1009 can transmit the first data (first information) and the second data (second information) to the imaging device, but it may also be configured to transmit them to an external device (a device other than the imaging device, or a cloud computer, etc.).
[0019] The imaging device 102A performs peripheral light intensity correction (optical correction) on the image captured by the image sensor 1101 using correction data output from the communication unit 1009 of the lens device 101. The communication unit 1102 communicates correction data and the like with the communication unit 1009 of the lens device 101. In other words, the communication unit 1102 can receive first data having a first characteristic and second data having a second characteristic for optical correction from the lens device 101.
[0020] The data generation unit 1103A requests correction data 2 (second data) via the communication unit 1102 and generates data for peripheral light intensity correction based on the correction data 2. In this embodiment, the correction data 2 received by the communication unit 1102 is output as is. Correction data 2 is correction data generated and output by the data generation unit 1008 based on the second data group Y1 stored in the memory 1007 in the lens device 101. Details regarding the generation of correction data 2 in the lens device 101 will be described later. The image processing unit (correction unit) 1104 performs peripheral light intensity correction based on the correction data generated by the data generation unit 1103A. That is, the image processing unit 1104 performs optical correction on the image data from the image sensor 1101 using either the first data or the second data. The image output unit 1105 outputs the image generated by the image processing unit 1104, and outputs to external memory such as an SD card or an HDMI® output terminal, etc.
[0021] Next, referring to Figure 2, we will describe the imaging system 100B connected to the imaging device 102B, which generates new correction data that takes into account the characteristics of the imaging device based on the correction data output from the communication unit 1009 of the lens device 101. Note that the lens device 101 in Figure 2 is the same as the lens device 101 in Figure 1, so its description will be omitted.
[0022] The imaging device 102B shown in Figure 2 generates new correction data that takes into account the characteristics of the imaging device 102B, based on the correction data output from the communication unit 1009 of the lens device 101, and performs peripheral light intensity correction (optical correction) on the image captured by the image sensor 1101. Note that the communication unit 1102, image processing unit 1104, and image output unit 1105 of the imaging device 102B are the same as those of the imaging device 102A, so their descriptions are omitted.
[0023] Memory 1106 is a memory unit that stores the characteristics of the imaging device 102B regarding the amount of ambient light. Here, the characteristics of the imaging device are, for example, the characteristics of the image sensor, but are not limited to this. Data generation unit 1103B requests correction data 1 (first data) via communication unit 1102 and generates correction data 1' for performing ambient light correction based on correction data 1 and the characteristics of the camera side stored in memory 1106. Correction data 1 is correction data that is generated and output by data generation unit 1008 based on the first data group X1 stored in memory 1007 in the lens device 101. Details of the generation of correction data 1 in the lens device 101 will be described later.
[0024] Next, the first data group X1 and the second data group Y1 will be explained with reference to Figure 3. The first data group X1 and the second data group Y1 are data groups that show the amount of light intensity correction for each image height at the focus position, zoom position, and aperture position of the lens device 101. Further details will be described later. Figure 3 is a graph showing the relationship between image height and light intensity for the focus lens 1001, zoom lens 1002, and aperture 1003 at close, wide angle, and wide open, respectively. In Figure 3, the horizontal axis shows the image height [mm] at the image sensor 1101, and the vertical axis shows the light intensity ratio with the center of the image height set to 100[%].
[0025] In Figure 3, L1 is a graph of the optical characteristics of the lens device 101, that is, a graph showing the relationship between image height and light intensity on the imaging plane when uniform light is introduced from the subject side of the lens device 101. L2A is a graph showing the relationship between image height and light intensity when actual shooting is performed with the lens device 101 and imaging device 102A in combination, without correction using correction data. In other words, the difference between graph L1 and graph L2A is the amount of light intensity change caused by the imaging device 102A. L2B is a graph showing the relationship between image height and light intensity when actual shooting is performed with the lens device 101 and imaging device 102B in combination, without correction using correction data. In other words, the difference between graph L1 and graph L2B is the amount of light intensity change caused by the imaging device 102B.
[0026] The first data group X1 is a collection of data showing the correction amounts corresponding to the focus position, zoom position, and aperture position in the optical characteristics of the lens device 101. In other words, it is a data group that includes the correction amounts shown in graph L1 in Figure 3. Generally, the correction amount for the change in light intensity can be the reciprocal of the change in light intensity.
[0027] The second data group Y1 is a data group for performing good correction in combination with the lens device 101 and the imaging device 102A, and is a collection of data indicating the correction amount according to the focus position, zoom position, and aperture position. In other words, it is a data group that includes the correction amount in graph L2A in Figure 3. Since the imaging device 102A performs correction using the correction data output from the lens device 101 as is, the lens device 101 has the second data group Y1 as correction data for the imaging device 102A. Correction data 1 is correction data generated and output by the data generation unit 1008 in the lens device 101 based on the first data group X1 stored in the memory 1007, according to the current focus position, zoom position, and aperture position. Correction data 2 is correction data generated and output by the data generation unit 1008 in the lens device 101 based on the second data group Y1 stored in the memory 1007, according to the current focus position, zoom position, and aperture position.
[0028] Note that the correction amount in graph L2B in Figure 3 is not included in either the first data group X1 or the second data group Y1. The imaging device 102B generates new correction data that takes into account the characteristics of the imaging device 102B based on the correction data output from the lens device 101. Therefore, since the imaging device 102B receives the first data group X1 from the lens device 101 and uses it for correction, the lens device 101 does not need to have correction data for the imaging device 102B.
[0029] Next, with reference to Figure 4, the generation and communication of correction data by the data generation unit 1008 and communication unit 1009 of the lens device 101 will be described. Figure 4 is a flowchart of the correction data generation process by the lens device 101. The flowchart in Figure 4 starts when correction data is requested by communication from the imaging device 102.
[0030] First, in step S100, the lens device 101 starts the correction data generation process. Next, in step S101, the data generation unit 1008 of the lens device 101 determines whether or not correction data 1 is included in the correction data requested by the imaging device 102. If correction data 1 is included, the process proceeds to step S102. On the other hand, if correction data 1 is not included, the process proceeds to step S103.
[0031] In step S102, the data generation unit 1008 generates correction data 1 based on the first data group X1 stored in the memory 1007, corresponding to the detected positions from the F position detection unit 1004, the Z position detection unit 1005, and the I position detection unit 1006. In step S103, the data generation unit 1008 determines whether the correction data requested by the imaging device 102 includes correction data 2. If correction data 2 is included, the process proceeds to step S104. On the other hand, if correction data 2 is not included, the process proceeds to step S105.
[0032] In step S104, the data generation unit 1008 generates correction data 2 based on the second data group Y1 stored in the memory 1007, corresponding to the detected positions from the F position detection unit 1004, the Z position detection unit 1005, and the I position detection unit 1006. In step S105, the communication unit 1009 outputs the correction data generated by the data generation unit 1008 to the imaging device 102. Subsequently, in step S106, this process ends. Following the above flow, the lens device 101 outputs the correction data in response to a request from the imaging device 102.
[0033] Next, the image generation process by imaging devices 102A and 102B will be described with reference to Figures 5 and 6. Figure 5 is a flowchart of the image generation process by imaging device 102A. Figure 6 is a flowchart of the image generation process by imaging device 102B. Note that the flowcharts in Figures 5 and 6 start each time an image is captured.
[0034] First, in step S120 of Figure 5, the imaging device 102A starts the image generation process. Next, in step S121, the data generation unit 1103A of the imaging device 102A requests correction data 2 from the lens device 101. Correction data 2 is correction data generated and output by the data generation unit 1008 based on the second data group Y1 stored in the memory 1007 of the lens device 101.
[0035] Next, in step S122, the data generation unit 1103A determines whether or not it has received correction data from the lens device 101. If correction data is received, the process proceeds to step S123. On the other hand, if correction data is not received, step S122 is repeated.
[0036] In step S123, the data generation unit 1103A outputs the correction data 2 received from the lens device 101 to the image processing unit 1104. Next, in step S124, the image processing unit 1104 uses the correction data 2 to generate a corrected image of the image obtained from the image sensor 1101 (captured image). Next, in step S125, the image output unit 1105 outputs the image (corrected image) generated by the image processing unit 1104. Finally, in step S126, this process is completed.
[0037] In step S140 of Figure 6, the imaging device 102B starts the image generation process. Subsequently, in step S141, the data generation unit 1103B of the imaging device 102B requests correction data 1 from the lens device 101. Correction data 1 is correction data generated and output by the data generation unit 1008 based on the first data group X1 stored in the memory 1007 of the lens device 101.
[0038] Next, in step S142, the data generation unit 1103B determines whether or not it has received correction data from the lens device 101. If correction data is received, the process proceeds to step S143. On the other hand, if correction data is not received, step S142 is repeated.
[0039] In step S143, the data generation unit 1103A generates correction data 1' based on the correction data 1 received from the lens device 101 and the characteristics of the imaging device 102B stored in the memory 1106 (characteristics of the imaging device 102B regarding the amount of ambient light). Next, in step S144, the data generation unit 1103A outputs the generated correction data 1' to the image processing unit 1104. Next, in step S145, the image processing unit 1104 generates a corrected image of the image obtained from the image sensor 1101 (captured image) using the correction data 1'. Next, in step S146, the image output unit 1105 outputs the image (corrected image) generated by the image processing unit 1104. Next, in step S147, this process ends.
[0040] Next, the effects of this embodiment will be explained. First, the case of the imaging device 102A will be explained. The imaging device 102A can obtain correction data for good correction when the lens device 101 and imaging device 102A are combined by requesting correction data 2 from the lens device 101. Therefore, the imaging device 102A can perform good correction by using the correction data 2 output from the lens device 101 as is.
[0041] Next, we will explain the case of the imaging device 102B. The imaging device 102B can obtain correction data for the optical characteristics of the lens device 101 by requesting correction data 1 from the lens device 101. Subsequently, by generating new correction data 1' that takes into account the characteristics of the imaging device 102B based on the correction data 1 output from the lens device 101, good correction can be performed.
[0042] As described above, in this embodiment, the lens device 101 has a first data group X1 indicating the amount of correction in the optical characteristics of the lens device 101, and a second data group Y1 for performing good correction in combination with the lens device 101 and the imaging device 102A. This makes it possible to perform good correction in both the imaging device 102A, which performs correction using the correction data output from the lens device 101 as is, and the imaging device 102B, which generates new correction data that takes into account the characteristics of the imaging device based on the correction data. Furthermore, even with respect to the imaging device 102C, which has different characteristics from the imaging device 102B, it is possible to generate new correction data that takes into account the characteristics of the imaging device 102C based on the correction data 1 in the imaging device 102C. [Examples]
[0043] Next, with reference to Figure 7, an imaging system equipped with an accessory in Embodiment 2 of the present invention will be described. In this embodiment, the accessory is a lens device that can be attached to and detached from the imaging device. Figure 7 is a block diagram of the imaging system 200. The imaging system 200 comprises an imaging device 202 and a lens device 201 that can be attached to and detached from the imaging device 202. In this embodiment, a description of a configuration equivalent to that of the imaging system in Embodiment 1 will be omitted.
[0044] The memory 2007 of the lens device 201 is a data storage unit that stores a first data group X2 and a second data group Y2 that are different from those in Embodiment 1. The mode switching unit 2106 of the imaging device 202 is a switching means that can switch between a normal shooting mode and a composite image shooting mode as the shooting mode of the imaging device 202. The data generation unit 2103 requests appropriate correction data via the communication unit 1102 according to the shooting mode set by the mode switching unit 2106, and generates data for peripheral light intensity correction based on the received correction data. In this embodiment, the correction data received by the communication unit 1102 is output directly to the data generation unit 2103.
[0045] Next, with reference to Figure 8, the first data group X2 and the second data group Y2 in this embodiment will be described. Figure 8 is a graph, similar to Figure 3, showing the relationship between image height and light intensity for the focus lens 1001, zoom lens 1002, and aperture 1003 at close, wide, and wide open, respectively. In Figure 8, the horizontal axis represents the image height [mm] at the image sensor 1101, and the vertical axis represents the light intensity ratio with the image height center set to 100 [%].
[0046] L1 is a graph showing the optical characteristics of the lens device 201, similar to Example 1. That is, it is a graph showing the relationship between image height and light intensity on the imaging plane when uniform light is introduced from the subject side of the lens device 201. Similarly, the first data group X2 is a data group showing the correction amount in the optical characteristics of the lens device 201, similar to Example 1. That is, it includes the correction amount in graph L1. In this embodiment, for the sake of simplicity, it is assumed that there is no change in light intensity caused by the imaging device 202. That is, the graph showing the relationship between image height and light intensity when actual shooting is performed with the combination of lens device 201 and imaging device 202, without correction by the correction data, is considered to be the same as L1.
[0047] N1 is a graph showing the relationship between image height and light intensity after correction using the first data group X2 in the imaging device 202, where the light intensity is uniform across the entire screen. However, in reality, due to the misalignment between the optical axis of the lens device 201 and the center of the imaging device 202, and other influences, it is possible that a portion of the image may be overcorrected. In other words, the first data group X2 is correction data for cases where it is desirable to have uniform light intensity across the entire screen, even if it means anticipating that a portion of the image may be overcorrected.
[0048] On the other hand, N2 is a graph showing the relationship between image height and light intensity after correction using the second data group Y2 in the imaging device 202. Compared to the uncorrected graph L1, the correction result improves peripheral light falloff across the entire screen while preserving the optical characteristics of the lens device 201, resulting in a smooth shading effect in the image. The correction value for the second data group Y2 can be obtained by multiplying the correction value for the first data group X2 by a ratio equivalent to N2.
[0049] In this embodiment, the flow of generation and communication of correction data by the data generation unit 1008 of the lens device 201 is the same as that of Embodiment 1, which was explained with reference to Figure 4, so its explanation will be omitted.
[0050] Next, the image generation process by the imaging device 202 will be explained with reference to Figure 9. Figure 9 is a flowchart of the image generation process by the imaging device 202. Note that the flowchart in Figure 9 starts each time an image is captured.
[0051] First, in step S200, the imaging device 202 starts the image generation process. Next, in step S201, the data generation unit 2103 determines whether the shooting mode set by the mode switching unit 2106 is the composite image shooting mode. If the shooting mode is the composite image shooting mode, the process proceeds to step S202. On the other hand, if the shooting mode is not the composite image shooting mode, the process proceeds to step S203.
[0052] In step S202, the data generation unit 2103 of the imaging device 202 requests correction data 1 from the lens device 201 and proceeds to step S204. In step S203, the data generation unit 2103 requests correction data 2 from the lens device 201 and proceeds to step S204.
[0053] In step S204, the data generation unit 2103 determines whether or not it has received correction data from the lens device 201. If correction data is received, the process proceeds to step S205. On the other hand, if correction data is not received, step S204 is repeated.
[0054] In step S205, the data generation unit 2103 outputs the correction data received from the lens device 201 to the image processing unit 1104. Next, in step S206, the image processing unit 1104 uses the correction data to generate a corrected image of the image obtained from the image sensor 1101 (captured image). Next, in step S207, the image output unit 1105 outputs the image (corrected image) generated by the image processing unit 1104. Finally, in step S208, this process is completed.
[0055] Next, the effects of this embodiment will be described. In normal shooting mode, the imaging device 202 requests correction data 2 from the lens device 201 and performs the correction, thereby achieving the effect of leaving smooth shading in the image, as shown in N2 in Figure 8. On the other hand, in composite image shooting mode, the imaging device 202 requests correction data 1 from the lens device 201 and performs the correction, thereby obtaining an image in which the amount of light is uniform across the entire screen, as shown in N1 in Figure 4. As a result, when performing image synthesis, the amount of light is uniform across the entire screen, so the synthesis process can be performed smoothly.
[0056] As described above, the lens device 201 of this embodiment has a first data group X2 that indicates the amount of correction in the optical characteristics of the lens device 201, and a second data group Y2 for performing correction that leaves smooth shading in the image. As a result, the imaging device 202 can acquire appropriate correction data according to the shooting mode and obtain the desired corrected image.
[0057] In this embodiment, the imaging device 202 is configured to switch the correction data acquired according to the shooting mode, but it is not limited to this configuration. For example, the imaging device 202 can acquire both correction data 1 and correction data 2 and embed them as metadata in the captured image, making it possible to apply either correction to the captured image in post-processing. Furthermore, by embedding both correction values, it is possible to perform correction using correction data 1, then image synthesis, revert the correction using correction data 1, and then perform correction again using correction data 2. In other words, it is possible to obtain a correction result that leaves smooth shading in the image after image synthesis. This is particularly effective when compositing a CG subject with a live-action image as the background. [Examples]
[0058] Next, with reference to Figures 10 and 11, an imaging system with an accessory in Embodiment 3 of the present invention will be described. In this embodiment, the accessory is at least one of a detachable adapter device or lens device between the imaging device and the lens device. In this embodiment, the first data is data relating to the optical properties of the accessory and the optical properties of the lens device, or data relating to the optical properties of the accessory and the optical properties of the adapter.
[0059] Figure 10 is a block diagram of imaging system 300A. Figure 11 is a block diagram of imaging system 300B. The imaging devices 302A and 302B are configured to be directly attachable to (connectable to) the lens device 101, as well as to be attachable to (connectable to) the lens device 101 via the adapter device 303. This embodiment is also applicable to an adapter device that can be attached to the object side of the lens device 101 (i.e., an imaging system in which the adapter device, lens device, and imaging device can be attached in that order).
[0060] The imaging system 300A shown in Figure 10 comprises an imaging device 302A, a lens device 101, and a detachable adapter device 303 between the imaging device 302A and the lens device 101. The imaging device 302A performs optical correction using the correction data output from the communication unit 1009 of the lens device 101. The lens device 101 is equivalent to the lens device described in Example 1, so its description is omitted.
[0061] The adapter device 303 is an intermediate adapter that magnifies the image from the lens device 101 via the variable magnification lens 3001 and forms an image on the image sensor 1101 of the imaging device 302A. For example, it is an extender or a reduction optical system. The internal configuration of the adapter device 303 will be described in detail below.
[0062] Memory 3007 is a data storage unit that stores the first data group X3 and the second data group Y3. Memory 3007 may be, for example, the ROM (internal memory) inside the CPU, or an external memory separate from the CPU. Data generation unit 3008 generates correction data to notify the imaging device 302A based on the identification information of the connected lens device 101 received from the imaging device 302A and the data stored in memory 3007. Details of the data generation unit 3008 will be described later. Communication unit 3009 sends and receives information with the imaging device 302A. In this embodiment, it receives the identification information of the connected lens device 101 from the imaging device 302A and communicates the correction data generated by the data generation unit 3008.
[0063] Similar to the imaging device 102A in Example 1, the imaging device 302A performs peripheral light intensity correction (optical correction) on the image captured by the image sensor 1101 using the received correction data. The communication unit 3102 transmits and receives correction data, etc., to the communication unit 1009 of the lens device 101 and the communication unit 3009 of the adapter device 303, respectively.
[0064] The data generation unit 3103A requests correction data 2 via the communication unit 3102 and generates data for peripheral illumination correction based on the correction data 2. If the lens device 101 and the imaging device 302A are directly connected without the adapter device 303, the data generation unit 3103A requests correction data 2 from the lens device 101. On the other hand, if the lens device 101 and the imaging device 302A are connected via the adapter device 303, the data generation unit 3103A requests correction data 2 from the adapter device 303. Furthermore, based on the correction data 2 received by the communication unit 3102, the data generation unit 3103A acquires various position information from the lens device 101 and generates correction data 2' according to the various position information to perform the correction. Details of this will be described later.
[0065] The imaging system 300B shown in Figure 11 comprises an imaging device 302B, a lens device 101, and a detachable adapter device 303 between the imaging device 302B and the lens device 101. The imaging device 302B generates new correction data that takes into account the characteristics of the imaging device 302B based on the correction data output from the communication unit 1009 of the lens device 101, and performs optical correction. Note that the lens device 101 and the adapter device 303 are equivalent to the lens device and adapter device in Figure 10, respectively, so their descriptions are omitted.
[0066] Similar to the imaging device 102B in Embodiment 1, the imaging device 302B generates new correction data that takes into account the characteristics of the imaging device 302B based on the received correction data for the image captured by the image sensor 1101, and performs peripheral light intensity correction. The communication unit 3102 is the same as that of the imaging device 302A, so its description is omitted. The image processing unit 1104, image output unit 1105, and memory 1106 are the same as those of the imaging device 102B in Embodiment 1, so their descriptions are omitted.
[0067] The data generation unit 3103B requests correction data 1 via the communication unit 3102, generates new correction data that takes into account the characteristics of the imaging device 302B based on the correction data 1, and generates data for peripheral illumination correction. If the lens device 101 and the imaging device 302B are directly connected without the adapter device 303, the data generation unit 3103B requests correction data 1 from the lens device 101. On the other hand, if the lens device 101 and the imaging device 302B are connected via the adapter device 303, the data generation unit 3103B requests correction data 1 from the adapter device 303. The data generation unit 3103B also acquires various position information from the lens device 101. Then, based on the correction data 1 received by the communication unit 3102 and the characteristics of the imaging device 302B stored in the memory 1106, the data generation unit 3103B generates correction data 1' that takes into account the characteristics of the imaging device 302B and the various position information, and performs the correction. Details of this will be described later.
[0068] Next, with reference to Figure 12, the first data group X3 and the second data group Y3 stored in the memory 3007 of the adapter device 303 will be described. Figure 12 is a graph showing the relationship between image height and light intensity for the focus lens 1001, zoom lens 1002, and aperture 1003 at close, wide, and wide open, respectively. In Figure 12, the horizontal axis represents the image height [mm] at the image sensor 1101, and the vertical axis represents the light intensity ratio with the center of the image height set to 100 [%].
[0069] La1 is a graph showing the optical characteristics of the optical system combining the lens device 101 and the adapter device 303. Specifically, it shows the relationship between image height and light intensity on the imaging plane after passing through the adapter device 303, when uniform light is introduced from the subject side of the lens device 101. La2A is a graph showing the relationship between image height and light intensity when taking actual photos with the combination of the lens device 101, the adapter device 303, and the imaging device 302A, without correction using correction data. That is, the difference between graph La1 and graph La2A represents the amount of light intensity change caused by the imaging device 302A. La2B is a graph showing the relationship between image height and light intensity when taking actual photos with the combination of the lens device 101, the adapter device 303, and the imaging device 302B, without correction using correction data. That is, the difference between graph La1 and graph La2B represents the amount of light intensity change caused by the imaging device 302B.
[0070] The first data group X3 is a collection of data showing the correction amounts corresponding to the focus position, zoom position, and aperture position in the optical characteristics of the optical system formed by combining the lens device 101 and the adapter device 303. In other words, it includes the correction amounts in graph La1 in Figure 12. Generally, the correction amount for the change in light intensity can be the reciprocal of the change in light intensity.
[0071] The second data group Y3 is a data set for performing good correction in the combination of the lens device 101, adapter device 303, and imaging device 302A, and is a collection of data indicating the correction amount according to the focus position, zoom position, and aperture position. In other words, it includes the correction amount in graph La2A in Figure 12. This is because the imaging device 302A uses the correction data output from the adapter device 303 as is for correction, so the adapter device 303 has the second data group Y3 as correction data for the imaging device 302A.
[0072] Note that the correction amount in graph La2B in Figure 12 is not included in either the first data group X3 or the second data group Y3. The imaging device 302B generates new correction data that takes into account the characteristics of the imaging device 302B based on the correction data output from the adapter device 303. For this reason, the adapter device 303 does not have correction data for the imaging device 302B, but rather has the first data group X3, which is the correction amount for the optical characteristics of the optical system formed by combining the lens device 101 and the adapter device 303.
[0073] Next, with reference to Figure 13, the generation and communication of correction data by the data generation unit 3008 and communication unit 3009 of the adapter device 303 will be described. Figure 13 is a flowchart of the correction data generation process by the adapter device 303. The flowchart in Figure 13 starts when correction data is requested by communication from the imaging devices 302A and 302B.
[0074] First, in step S300, the adapter device 303 starts the correction data generation process. Next, in step S301, the adapter device 303 receives identification information (lens identification information) for the lens device 101 connected to the adapter device 303 from the imaging devices 302A and 302B. Next, in step S302, the data generation unit 3008 generates correction data corresponding to the lens device 101 connected to the adapter device 303. The correction data generated here is a combination of a first data group X3 and a second data group Y3 corresponding to the lens device 101. Next, in step S303, the communication unit 3009 outputs the correction data generated by the data generation unit 3008 to the imaging devices 302A and 302B. Next, in step S304, this process ends. Through the above flow, the adapter device 303 outputs correction data according to the lens identification information for the lens device 101 connected to the adapter device 303, which it has received from the imaging devices 302A and 302B.
[0075] Next, the image generation process by imaging devices 302A and 302B will be described with reference to Figures 14 and 15. Figure 14 is a flowchart of the image generation process by imaging device 302A. Figure 15 is a flowchart of the image generation process by imaging device 302B. Note that the flowcharts in Figures 14 and 15 start each time an image is captured. In Figures 14 and 15, the same reference numerals are used for components as in Example 1, which was described with reference to Figures 5 and 6, and their descriptions are omitted.
[0076] First, in step S320 of Figure 14, the imaging device 302A starts the image generation process. Next, in step S321, the imaging device 302A determines whether or not it is connected to the lens device 101 via the adapter device 303. If the imaging device 302A is connected to the lens device 101 via the adapter device 303, the process proceeds to step S322. On the other hand, if the imaging device 302A is directly connected to the lens device 101, the process proceeds to step S121.
[0077] In step S322, the data generation unit 3103A of the imaging device 302A requests correction data from the adapter device 303. Subsequently, in step S323, the data generation unit 3103A determines whether or not it has received correction data from the adapter device 303. If correction data is received, the process proceeds to step S324. On the other hand, if correction data is not received, step S323 is repeated. The correction data received from the adapter device 303 is a combination of the first data group X3 and the second data group Y3 corresponding to the lens device 101, as shown in step S302.
[0078] Next, in step S324, the data generation unit 3103A requests various position information from the lens device 101. Then, in step S325, the data generation unit 3103A determines whether or not it has received various position information from the lens device 101. If it has received various position information, it proceeds to step S326. On the other hand, if it has not received various position information, it repeats step S325.
[0079] Next, in step S326, the data generation unit 3103A generates correction data 2' based on the second data group Y3 from the received correction data and various position information. Next, in step S327, the data generation unit 3103A outputs the correction data 2' to the image processing unit 1104. Next, in step S328, the image processing unit 1104 uses the correction data to generate a corrected image (corrected image) by correcting the image obtained from the image sensor 1101 (captured image). Next, in step S329, the image output unit 1105 outputs the image (corrected image) generated by the image processing unit 1104. Next, in step S330, this process ends.
[0080] In step S340 of Figure 15, the imaging device 302B starts the image generation process. Subsequently, in step S341, the imaging device 302B determines whether or not it is connected to the lens device 101 via the adapter device 303. If the imaging device 302A is connected to the lens device 101 via the adapter device 303, the process proceeds to step S342. On the other hand, if the imaging device 302A is directly connected to the lens device 101, the process proceeds to step S141.
[0081] In step S342, the data generation unit 3103B of the imaging device 302B requests correction data from the adapter device 303. Subsequently, in step S343, the data generation unit 3103B determines whether or not it has received correction data from the adapter device 303. If correction data is received, the process proceeds to step S344. On the other hand, if correction data is not received, step S343 is repeated. The correction data received from the adapter device 303 is a combination of the first data group X3 and the second data group Y3 corresponding to the lens device 101, as shown in step S302.
[0082] Next, in step S344, the data generation unit 3103B requests various position information from the lens device 101. Then, in step S345, the data generation unit 3103B determines whether or not it has received the various position information from the lens device 101. If it has received the various position information, it proceeds to step S346. On the other hand, if it has not received the various position information, it repeats step S345.
[0083] Next, in step S346, the data generation unit 3103B generates correction data 1' based on the first data group X3 from the received correction data, various position information, and the characteristics of the imaging device 302B (characteristics related to ambient light) stored in the memory 1106. Next, in step S347, the data generation unit 3103B outputs the correction data 1' to the image processing unit 1104. Next, in step S348, the image processing unit 1104 uses the correction data to generate a corrected image (corrected image) by correcting the image obtained from the image sensor 1101 (captured image). Next, in step S349, the image output unit 1105 outputs the image (corrected image) generated by the image processing unit 1104. Next, in step S350, this process ends.
[0084] Next, the effects of this embodiment will be explained. First, the case of the imaging device 302A will be explained. The imaging device 302A receives a combination of the first data group X3 and the second data group Y3 as correction data related to the lens device 101 from the adapter device 303. When performing correction, the imaging device 302A acquires various position information from the lens device 101 and performs correction by referring to the correction data 2 included in the second data group Y3. As a result, correction data that allows for good correction can be obtained for the combination of the lens device 101, the adapter device 303, and the imaging device 302A. Therefore, the imaging device 302A can perform good correction by using the correction data 2 referenced from the correction value output from the adapter device 303 as is.
[0085] Next, we will explain the case of the imaging device 302B. In the imaging device 302B as well, the adapter device 303 receives a combination of the first data group X3 and the second data group Y3 as correction data related to the lens device 101. When performing correction, various position information is acquired from the lens device 101, and new correction data 1' that takes into account the characteristics of the imaging device 302B is generated based on the correction data 1 included in the first data group X3, thereby enabling effective correction.
[0086] As described above, the adapter device 303 of this embodiment has a first data group X3 that shows a correction amount that does not include the amount of change in light intensity caused by the imaging device 302A, and a second data group Y3 that shows a correction amount that includes the amount of change in light intensity caused by the imaging device 302A. This makes it possible to perform good correction in both the imaging device 302A, which corrects using the correction data output from the adapter device 303 as is, and the imaging device 302B, which generates new correction data that takes into account the characteristics of the imaging device based on the correction data. Furthermore, even with respect to the imaging device 302C, which has different characteristics from the imaging device 302B, it is possible to generate new correction data that takes into account the characteristics of the imaging device 302C based on the correction data 1 in the imaging device 302C.
[0087] In Examples 1 and 2, the data generation unit 1008 of the lens device 101 generates correction data based on various positional information, but is not limited to this. That is, the data group itself may be communicated as correction data, and various positional information may be communicated periodically to the imaging device, so that the imaging device has a function equivalent to the data generation unit. Furthermore, the configuration is not limited to the imaging device requesting the type of correction data. That is, it is also possible for the imaging device to acquire both correction data 1 and correction data 2 and use the correction data according to the situation and application. In addition, the imaging device may receive both the first data group and the second data group as correction data and perform corrections within the imaging device according to the situation, application, and various positional information.
[0088] In Example 3, the imaging device receives both the first data group and the second data group as correction data and performs correction according to the situation, application, and various positional information, but is not limited to this. That is, as described in Example 3, the imaging device may request the type of correction data from the adapter device. Alternatively, the adapter device may acquire various positional information, generate correction data, and notify the imaging device. Furthermore, the adapter device may transmit both the first data group and the second data group it possesses to the lens device, and the lens device may generate correction data based on the various positional information.
[0089] Furthermore, in Example 3, the adapter device holds data regarding the amount of change in light intensity caused by the lens device as a first data group, but is not limited to this. That is, the lens device may also hold data regarding the amount of change in light intensity caused by the adapter device. In that case, the lens device switches the correction data according to the connected adapter device and transmits it to the imaging device. Subsequently, the imaging device should generate correction data to apply to the image, taking into account the characteristics of the imaging device, based on the correction data received from the lens device that takes into account the influence of the adapter device.
[0090] Furthermore, the lens device retains data related to the amount of light intensity change caused by the lens device, and the adapter device retains data related to the amount of light intensity change caused by the adapter device. The imaging device then acquires correction data from the lens device, corresponding to the amount of light intensity change caused by the lens device, and correction data from the adapter device, corresponding to the amount of light intensity change caused by the adapter device. Subsequently, the imaging device can also generate correction data to be applied to the image based on each of these correction data and the characteristics of the imaging device.
[0091] Furthermore, in Examples 1 and 3, data that takes into account the influence of the characteristics of the imaging device was described as an example of a second data group for correcting images captured by the imaging device. In Example 2, an example of data for obtaining the effect of leaving smooth shading in the image was described. However, the examples are not limited to these, and for example, the second data group may be data in which the correction ratio is simply and uniformly reduced compared to the first data group that shows optical characteristics (a data group with a smaller correction amount than the first data group). This makes it possible to perform correction while suppressing the occurrence of overcorrection.
[0092] Furthermore, for example, a second data group may be one in which the correction value changes less steeply in the image height direction compared to the first data group that shows optical characteristics. In other words, the change in the amount of correction of the image data by the second data group in response to a change in image height may be less than the change in the amount of correction of the image data by the first data group in response to a change in image height.
[0093] In particular, when there is an inflection point in the optical properties in the image height direction, it is necessary to correct the first data set, which is used to make the light intensity uniform across the entire range, by also including an inflection point. However, if there is a misalignment between the optical axis center of the optical system and the center of the image sensor, or if the optical axis center moves due to the image stabilization function, the inflection point in the image height direction caused by the optical properties in the image and the inflection point in the correction data will be misaligned. As a result, insufficient or overcorrection may occur around the inflection point, resulting in an unnatural-looking image. On the other hand, by using correction data without an inflection point as the second data set, even if the inflection point in the image height direction caused by the optical properties in the image moves, it is possible to suppress overcorrection because the correction data does not have an inflection point.
[0094] Similarly, a second data group may be selected from the first data group that shows optical characteristics, and which exhibits less steep changes in correction values in the focal length direction for zoom lenses. In other words, the change in the amount of image data correction by the second data group in response to a change in focal length may be less than the change in the amount of image data correction by the first data group in response to a change in focal length.
[0095] If there is a significant change in characteristics in the focal length direction due to a delay in the position detection means or a delay in the optical correction processing, correction deviations will occur in response to zoom operations, which can lead to overcorrection. This phenomenon, in particular, needs to be considered when zooming during video recording. Therefore, by using a second data set that suppresses large changes in the correction value in the focal length direction, it is possible to suppress overcorrection even during zoom operations.
[0096] Furthermore, the second data set may be a correction that incorporates multiple of the aforementioned approaches. For example, the second data set could be data that has been further modified to suppress steep changes in correction values in the image height direction, in addition to the data used to achieve the effect of leaving smooth shading in the image. Alternatively, the second data set could also be data that has been further modified to suppress steep changes in correction values in the focal length direction.
[0097] Furthermore, multiple second data sets may be provided, allowing the lens device or imaging device to select which second data set to transmit. Depending on whether the lens device's image stabilization function is ON or OFF, the system may also choose whether or not to employ correction data that suppresses abrupt changes in correction values in the image height direction. Additionally, depending on whether the imaging device's shooting mode is for still images or video, the system may choose whether or not to employ correction data that suppresses abrupt changes in correction values in the focal length direction.
[0098] Although each embodiment has been described as an example where correction is performed using an imaging device, the invention is not limited to this, and the correction may also be performed using an external device other than the imaging device, such as an image processing device like a PC.
[0099] In each embodiment, the example of transmitting correction data to the imaging device was described, This is not the only possible configuration; the data may also be transmitted to an external device different from the imaging device, such as an image processing device like a PC, or to a data logger that records data by associating the image with correction data.
[0100] In each embodiment, the correction amount for the change in light intensity was described as being the reciprocal of the change in light intensity, but this is not the only example, and similar effects can be achieved with correction values of different forms. For example, even in the case of a correction value that is a coefficient at the current lens position for a predetermined model, it is possible to transmit both the coefficient as correction data for good correction and the coefficient as correction data for optical characteristics.
[0101] In each embodiment, peripheral illumination correction was described as an example of optical correction (image data correction), but it is not limited to this, and other corrections such as chromatic aberration correction or distortion correction may also be used. In other words, the image data correction relates to at least one of peripheral illumination, distortion, and chromatic aberration of the image captured by the imaging device.
[0102] In chromatic aberration correction, overcorrection is more unnatural than undercorrection, so the correction data should allow for a certain degree of undercorrection and should not result in overcorrection under all conceivable shooting conditions. In distortion correction, pincushion distortion is more unnatural than barrel distortion, so the correction data should be designed to produce a slight barrel distortion so that pincushion distortion does not remain in the corrected image under all conceivable shooting conditions.
[0103] Furthermore, similar to peripheral illumination correction, the second data set can be used to suppress steep changes in correction values in the image height direction and to suppress steep changes in correction values in the focal length direction, achieving similar effects.
[0104] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.
[0105] According to each embodiment, for example, it is possible to provide accessories, imaging devices, imaging systems, methods for controlling accessories, and programs that are advantageous for obtaining desired images by performing appropriate optical correction depending on the situation and application.
[0106] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its essence. [Explanation of Symbols]
[0107] 101, 201 Lens device (accessory) 102A, 102B, 202, 302A, 302B Imaging devices 1007, 2007, 3007 Memory (storage unit) 1009, 3009 Communications Department 303 Adapter device (accessory)
Claims
1. An accessory that is detachable from an imaging device, a storage unit that stores first data and second data for correcting image data obtained by the imaging device; a communication unit configured to transmit first information based on the first data and second information based on the second data to an external device; the first data is indicative of an optical characteristic of the accessory; The accessory, wherein the second data indicates a characteristic that is a combination of an optical characteristic of the accessory and a characteristic of the imaging device.
2. An accessory that is detachable from an imaging device, a storage unit that stores first data and second data for correcting image data obtained by the imaging device; a communication unit configured to transmit first information based on the first data and second information based on the second data to an external device; the first data includes a first light amount correction value for each image height at a first focus position, a first zoom position, and a first aperture position of the accessory; The accessory, characterized in that the second data includes a second light amount correction value for each image height at the first focus position, the first zoom position, and the first aperture position of the accessory.
3. An optical element; The accessory described in claim 1 or 2, characterized in having an information generating unit that generates the first information based on the first data and the position of the optical element, and generates the second information based on the second data and the position of the optical element.
4. 4. The accessory according to claim 1, wherein an amount of correction of the image data by the second data is smaller than an amount of correction of the image data by the first data.
5. The accessory according to any one of claims 1 to 4, characterized in that a change in the amount of correction of the image data by the second data in response to a change in image height is smaller than a change in the amount of correction of the image data by the first data in response to a change in image height.
6. The accessory according to any one of claims 1 to 5, characterized in that a change in the amount of correction of the image data by the second data with respect to a change in focal length is smaller than a change in the amount of correction of the image data by the first data with respect to a change in focal length.
7. 7. The accessory according to claim 1, wherein the correction of the image data relates to at least one of peripheral light falloff, distortion, and lateral chromatic aberration of an image captured by an imaging device.
8. The accessory according to claim 1 , wherein the communication unit transmits the first data and the second data in the same data format.
9. The accessory according to claim 1 , wherein the communication unit transmits either the first data or the second data independently.
10. The accessory according to claim 1 , wherein the communication unit transmits both the first data and the second data as a set.
11. 11. The accessory according to any one of claims 1 to 10, wherein the accessory is a lens device.
12. the accessory is an adapter that is detachably attached between the imaging device and a lens device, 11. The accessory of claim 1, wherein the first data is data relating to optical properties of the accessory and optical properties of the lens arrangement.
13. the accessory is a lens device that is detachable from the imaging device via an adapter, 11. The accessory according to claim 1, wherein the first data is data relating to optical characteristics of the accessory and optical characteristics of the adapter.
14. The accessory according to any one of claims 1 to 13, wherein the external device is the imaging device.
15. The accessory according to any one of claims 1 to 13, wherein the external device is a device different from the imaging device.
16. An imaging device to which the accessory according to any one of claims 1 to 15 can be attached or detached, An imaging element; a communication unit capable of receiving the first information and the second information from the accessory; a correction unit that corrects the image data based on at least one of the first information and the second information.
17. An imaging system comprising: an accessory described in any one of claims 1 to 16 that is detachable from the imaging device; and the imaging device.
18. A method for controlling an accessory that is detachable from an imaging device, comprising: an acquisition step of acquiring at least one of the first data and the second data from a storage unit that stores the first data and the second data for correcting image data acquired by the imaging device; transmitting at least one of first information based on the first data and second information based on the second data to an external device; the first data is indicative of an optical characteristic of the accessory; The control method according to claim 1, wherein the second data indicates a characteristic that is a combination of an optical characteristic of the accessory and a characteristic of the imaging device.
19. A method for controlling an accessory detachable from an imaging device, comprising: an acquiring step of acquiring at least one of the first data and the second data from a storage unit that stores the first data and the second data for correcting image data acquired by an imaging device; transmitting at least one of first information based on the first data and second information based on the second data to an external device; the first data includes a first light amount correction value for each image height at a first focus position, a first zoom position, and a first aperture position of the optical system; The control method, wherein the second data includes a second light amount correction value for each image height at the first focus position, the first zoom position, and the first aperture position of the optical system.
20. A program causing a computer to execute the control method according to claim 19.
