Imaging apparatus, control method for the same, and program

Abstract

To obtain an image corrected to user's preferred image quality by varying the degree of application of a 3D-LUT only by a single LUT processing circuit in image processing using a look-up table.SOLUTION: An imaging apparatus has an acquiring unit that acquires a first look-up table for converting image data, a setting unit that sets the degree of application of the first look-up table acquired by the acquiring unit, and a generating unit that generates a second lookup table from the first lookup table on the basis of the degree of application set in the setting unit. The second lookup table generated in the generating unit is used to convert the image data acquired by an imaging apparatus.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method thereof, and a program.

Background Art

[0002] As a means for correcting the color and contrast of an image, a three-dimensional lookup table (hereinafter, 3D-LUT) is generally used. In an imaging device, it is also possible to convert an image based on a 3D-LUT built in the imaging device, or to capture a 3D-LUT created by an external application or the like into the imaging device and convert the image.

[0003] In addition, 3D-LUTs for converting images into cinematic images, 3D-LUTs aiming at special effects, etc. are often provided on the Web, etc., regardless of whether they are paid or free, and users can obtain their favorite 3D-LUTs and convert images.

[0004] However, the 3D-LUTs provided on the Web, etc. are 3D-LUTs for converting images into images that the creator considers good, and not everyone feels that these images are good. Some people may want to convert the image with a weakened effect. In that case, since it is necessary to perform a process of synthesizing the image taken without converting it with the 3D-LUT and the image converted with the 3D-LUT in post-production after shooting the image without converting it with the 3D-LUT once, a great deal of labor is generated.

[0005] As a means for changing the degree of change in an image by a 3D-LUT, for example, Patent Document 1 describes a technique of performing scene detection and synthesizing correction tables for each scene according to the reliability of a plurality of candidate scenes.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

[0007] In the conventional example above, the correction table changes depending on the scene detected, but the degree of correction is what the camera considers appropriate, and this does not necessarily match the user's preference. Furthermore, even if it differs from the user's preference, it is difficult for the user to change it to suit their preference. [Means for solving the problem]

[0008] To solve this problem, for example, the imaging apparatus of the present invention has the following configuration. That is, An imaging device having an imaging means, A means for obtaining a first lookup table in order to convert image data, A setting means for setting the degree to which the first lookup table acquired by the acquisition means is applied, The system includes a generation means that generates a second lookup table from the first lookup table based on the degree of application set by the setting means, The method is characterized by converting the image data obtained by the imaging means using the second lookup table generated by the generation means. [Effects of the Invention]

[0009] According to the present invention, in image processing using a lookup table, the degree of application of the 3D-LUT can be changed using only a single LUT processing circuit to obtain an image corrected to the user's preferred image quality. [Brief explanation of the drawing]

[0010] [Figure 1] A block diagram showing the internal configuration of the imaging device according to the embodiment. [Figure 2] A diagram showing the post-production process flow according to the first embodiment. [Figure 3] A diagram showing the processing flow of the image processing block of the imaging device according to the first embodiment. [Figure 4] A flowchart illustrating the image conversion process according to the first embodiment. [Figure 5A] A figure showing a portion of the 3D-LUT data according to the first embodiment. [Figure 5B] A figure showing a portion of the 3D-LUT data according to the first embodiment. [Figure 5C] A figure showing a portion of the 3D-LUT data according to the first embodiment. [Figure 6] A figure showing an example of a display according to the second embodiment. [Figure 7] A diagram showing the processing flow of the 3D-LUT data generation method for the imaging device according to the third embodiment. [Figure 8] A flowchart illustrating the image conversion process based on a 3D-LUT according to the fourth embodiment. [Figure 9] A figure showing an example of a 3D-LUT file according to the fourth embodiment. [Figure 10] A figure showing an example of a display according to the fourth embodiment. [Modes for carrying out the invention]

[0011] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention to the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted. Also, in the embodiments, the components of the lookup table are described as three-dimensional, but a lookup table other than three-dimensional may also be used.

[0012] [First Embodiment] FIG. 1 is a block diagram showing the internal configuration of an imaging apparatus 100 according to a first embodiment. In FIG. 1, an imaging lens 103 is a lens group including a zoom lens, a focus lens, and a shift lens, and forms an optical image of a subject on an imaging surface of an imaging unit 22. An aperture 101 is an aperture used for adjusting the amount of light, and an ND 104 is an ND (Neutral Density) filter for reducing light. The imaging unit 22 includes an imaging device composed of a CCD, a CMOS element, or the like that converts an optical image formed on its own imaging surface into an electrical signal. The imaging unit 22 also has functions such as control of accumulation by an electronic shutter, change of analog gain, and change of readout speed. An A / D converter 23 is used to convert an analog signal output from the imaging unit 22 into a digital signal.

[0013] An image processing unit 24 performs predetermined pixel interpolation processing, resizing processing such as reduction processing, detection processing of luminance information, color information, characteristic subjects, etc., color conversion processing, gamma correction processing, addition processing of digital gain, etc. on digital image data (hereinafter simply referred to as image data) from the A / D converter 23 or data from a memory control unit 15 under the control of a system control unit 50. Image processing methods include image processing by a dedicated arithmetic circuit, image processing by a 3D-LUT processing circuit, etc. Further, the image processing unit 24 performs predetermined arithmetic processing using the captured image data and transmits the arithmetic result to the system control unit 50. Based on the transmitted arithmetic result, the system control unit 50 performs exposure control, distance measurement control, white balance control, etc. Thereby, AF (Auto Focus) processing, AE (Automatic Exposure) processing, AWB (Auto White Balance) processing, etc. of the TTL (Through-The-Lens) method are performed. Also, with respect to the movement and posture change of the imaging apparatus 100 due to camera shake detected by a gyro 40, etc., the system control unit 50 performs image blur correction by operating the shift lens of the imaging lens 103 or shifting the image by the image processing unit 24.

[0014] The image data from the A / D converter 23 is written directly into the memory 32 via the image processing unit 24 and the memory control unit 15, or via the memory control unit 15. The memory 32 stores the image data captured by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as the image data for display on the display unit 28. Also, this memory 32 is used to temporarily store the images processed by the image processing unit 24 and then send them back to the image processing unit 24 for applying another image processing. The memory 32 has a storage capacity sufficient to store moving images and audio for a predetermined period of time. Further, the memory 32 also serves as a memory for image display (video memory).

[0015] The D / A converter 13 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28. Thus, the image data for display written in the memory 32 is displayed by the display unit 28 via the D / A converter 13. The display unit 28 performs display on a display such as an LCD according to the analog signal from the D / A converter 13. By performing analog conversion of the digital signal that has been A / D converted once by the A / D converter 23 and stored in the memory 32 in the D / A converter 13 and sequentially transferring it to the display unit 28 for display, an electronic viewfinder is realized and through-image display can be performed.

[0016] The non-volatile memory 56 is an electrically erasable and recordable memory, and for example, EEPROM is used. The non-volatile memory 56 stores the programs executed by the system control unit 50, as well as various parameters and constants for processing. Here, the program refers to the program for executing various flowcharts described later.

[0017] The system control unit 50 is composed of a CPU and controls the entire imaging device 100. It executes each of the processes of this embodiment, which will be described later, by running the program recorded in the non-volatile memory 56. RAM is used in the system memory 52 and stores constants, variables, and programs read from the non-volatile memory 56 for the operation of the system control unit 50. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, etc.

[0018] The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock. The mode switching switch 60, recording switch 61, and operation unit 70 are operating means for inputting various operation instructions from the user to the system control unit 50.

[0019] The mode switch 60 switches the operating mode of the system control unit 50 to one of the following: video recording mode, still image recording mode, playback mode, etc. Modes included in the video recording mode and still image recording mode include auto shooting mode, auto scene detection mode, manual mode, various scene modes which are shooting settings for different shooting scenes, program AE mode, custom mode, etc. By operating the mode switch 60, it is possible to directly switch to one of these modes included in the video shooting mode. Alternatively, after switching to the video shooting mode using the mode switch 60, it may be possible to switch to one of these modes included in the video shooting mode using another operating device. The recording switch 61 switches between the shooting standby state and the shooting state. When the recording switch 61 is turned ON, the system control unit 50 starts a series of operations from reading the signal from the imaging unit 22 to writing video data to the external recording medium 150.

[0020] Each operating element of the control unit 70 is assigned a function as appropriate for each situation by selecting various function icons displayed on the display unit 28, and operates as various function buttons. Examples of function buttons include an exit button, back button, image advance button, jump button, filter button, attribute change button, etc. For example, when the menu button is pressed, various configurable menu screens are displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28 and the four-way directional pad (up, down, left, and right) and SET button.

[0021] The power control unit 80 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are energized, and the like, and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage to each part, including the external recording medium 150, for the required period of time.

[0022] The power supply unit 30 consists of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries and Li-ion batteries, and an AC adapter. The I / F 18 is an interface with external recording media 150 such as memory cards and hard disks, and external display devices 160. The external recording media 150 is a recording medium such as a memory card for recording captured images and exchanging data with the outside, and semiconductor memory is used.

[0023] This embodiment describes the operation when the imaging device 100 acquires a 3D-LUT created by an external application running on an information processing device such as a PC or tablet, and converts the image. Therefore, the user is expected to store the 3D-LUT, created by an application running on their own information processing device, as a file on the external recording medium 150.

[0024] First, the user inserts (connects) the external recording medium 150 containing the 3D-LUT file into a slot (not shown) of the imaging device 100. Then, the user operates the operation unit 70 to input the operation to acquire the 3D-LUT. Upon receiving this operation, the system control unit 50 temporarily stores the string described in the 3D-LUT file acquired via the I / F 18 in the system memory 52 and performs string analysis. The system control unit 50 converts the string to numerical values, generates 3D-LUT data in a data format that can be handled by the image processing unit 24, and records it in the system memory 52 or non-volatile memory 56. Subsequently, the 3D-LUT processing unit of the image processing unit 24 converts the generated 3D-LUT data to obtain the desired image. In this embodiment, it is assumed that the 3D-LUT data is described as a string in the 3D-LUT file, but binary format or other formats are also acceptable. In the above example, the external recording medium 150 containing the 3D-LUT file is connected to the imaging device 100. However, for example, the imaging device 100 and the information processing device may be directly connected via the I / F 18, allowing the imaging device 100 to download the 3D-LUT from the information processing device.

[0025] Next, using Figure 2, we will explain an example of a typical post-production process when changing the degree of 3D-LUT application. While many post-production applications have functions to transform images based on 3D-LUTs, some ingenuity is required when changing the degree of 3D-LUT application.

[0026] First, various image processing steps 202 are applied to the input image 201. This is image processing excluding the 3D-LUT whose application degree you want to change, and includes many processes such as gradation and color correction. In this example, the processing is performed on the input image 201, but it can also be done after the image synthesis described later, or it can be omitted. Next, the processing is branched and the image is transformed by the 3D-LUT processing 203 on only one of the branches. Then, the image output from the 3D-LUT processing 203 and the other branched image are combined by the image synthesis processing 204 to obtain the output image 205. By changing the synthesis ratio based on the application degree, it is possible to adjust the application degree of the 3D-LUT. In the example in Figure 2, the application degree is set to 80%.

[0027] When the post-production process described in Figure 2 is performed on the imaging device 100, the image processing unit 24 will have the configuration of a processing block as shown in Figure 3(a). First, the image processing unit 302 performs image processing on the input image 301 before 3D-LUT processing and records it in RAM 303. Next, the 3D-LUT processing unit 304 reads the image from RAM 303, transforms the image based on the 3D-LUT, and records it in RAM 305. After that, the images recorded in RAM 303 and RAM 305 are input to the image synthesis processing unit 306, where image synthesis is performed at a ratio based on the degree of application 307 set in the menu by the operation unit 70, and output as the output image 308. Note that here, image processing is performed in the image processing unit 302 before image synthesis in the image synthesis processing unit 306, but image processing in the image processing unit 302 may be performed after image synthesis, or the image processing unit 302 may not perform any processing at all. Also, here RAM 303 and RAM 305 are represented as separate RAMs, but they may be different areas of the same RAM.

[0028] In this embodiment, the processing performed in the blocks reference numerals 303 to 306 in Figure 3(a) is combined into a single 3D-LUT to generate data, thereby simplifying the processing blocks. The method for generating 3D-LUT data, taking into account the degree of applicability in this case, will be described later.

[0029] Figure 3(b) shows a block diagram of the image processing unit 24 in this embodiment. First, the image processing unit 312 performs image processing on the input image 311 before 3D-LUT processing. Then, the 3D-LUT processing unit 314 converts the image based on the 3D-LUT 319 generated considering the degree of application 317, and generates the output image 318.

[0030] Figure 4 shows a flowchart illustrating the processing flow of the system control unit 50 in this embodiment.

[0031] First, in S401, the system control unit 50 acquires 3D-LUT data. Next, in S402, the system control unit 50 acquires the degree of application set by the user via the menu on the operation unit 70. Then, in S403, the system control unit 50 corrects the data constituting the 3D-LUT based on the degree of application acquired in S402, and generates 3D-LUT data that takes the degree of application into consideration. The method for generating 3D-LUT data that takes the degree of application into consideration will be described later. Finally, in S404, the system control unit 50 sets the generated 3D-LUT to the image processing unit 24 and has it perform image data conversion. This makes it possible to obtain an image with a desirable image quality effect.

[0032] Next, we will explain how to generate 3D-LUT data that takes into account the degree of application.

[0033] In this embodiment, the image obtained by converting an image based on a 3D-LUT designed to enhance image quality has too strong an effect, so the case where the user inputs an instruction via the operation unit 70 to suppress the application degree of the 3D-LUT to 80% is described.

[0034] First, Figure 5A shows a portion of the 3D-LUT (hereinafter also called image quality effect LUT) data created by an external application and imported into the imaging device 100. Here, a 17-grid 3D-LUT for RGB signals is used as an example, with the LUT incrementing from the R component. However, LUTs for signals other than RGB are also acceptable, and the data order may differ. In this embodiment, the values ​​of each RGB component are represented as 0 to 1 (decimal point).

[0035] The system control unit 50 prepares a 3D-LUT (hereinafter referred to as a through-lookup table or through-LUT) where input equals output, in order to reproduce a state in which an image converted based on a 3D-LUT and an image without using a 3D-LUT are combined in an 80:20 ratio using a single 3D-LUT. Since this through-LUT has an input-output relationship, it can be easily created. A portion of the through-LUT data is shown in Figure 5B. The system control unit 50 then combines the data constituting these image quality effect LUTs and through-LUTs in an 80:20 ratio by performing calculations using the formula shown in equation (1) below, and generates a combined LUT. Combined LUT = (Image quality effect LUT data) × 0.8 + (Through LUT data) × 0.2 …(1) For example, in the case of a 17-grid 3D-LUT, by applying the calculation in formula (1) to 17 × 17 × 17 × 3 = 14,739 data points, a composite LUT can be generated with a ratio of 80:20. An example of a composite LUT generated by the system control unit 50 is shown in Figure 5(c). In this embodiment, the gaps between grids are filled in, for example, by linear interpolation.

[0036] The system control unit 50 sets the composite LUT generated as described above to the image processing unit 24. As a result, the image processing unit 24 is able to perform image transformation equivalent to the 3D-LUT processing unit 314 in Figure 3(b), and the result equivalent to image processing in the block shown in Figure 3(a) can be achieved with a simpler block as shown in Figure 3(b).

[0037] In this embodiment, the operation of importing a 3D-LUT created by an external application into the imaging device 100, correcting the image quality effect of the 3D-LUT based on the degree of application, and then converting the image has been described. However, the degree of application correction may also be performed on a 3D-LUT that has been pre-recorded in the imaging device 100. Alternatively, the degree of application correction may be performed again on a 3D-LUT that has already been corrected once. In that case, the degree of application may be expressed in a way that takes into account the degree of application of the first stage of correction, or the state after the first stage of correction may be expressed as 100%.

[0038] Furthermore, while the degree of application is expressed as a percentage in this embodiment, users may be allowed to select from abstract expressions such as large, medium, or small.

[0039] [Second Embodiment] In the first embodiment described above, a method for generating 3D-LUT data based on the degree of application specified by the user was explained. However, it is difficult to estimate what degree of application is needed to achieve the desired image quality from the image converted based on the original image quality effect LUT. Therefore, this embodiment describes a user interface that is effective for determining the degree of application. The configuration of the imaging device in this embodiment is the same as in the first embodiment (Figure 1), so its explanation is omitted.

[0040] The user operates the control unit 70 while viewing the captured image displayed on the display unit 28 or the external display device 160, and sets the application degree value from the menu. This section describes the case where the image is displayed on the display unit 28.

[0041] Based on the application degree set in the menu, the system control unit 50 generates a composite LUT and sets it in the image processing unit 24. The image processing unit 24 then displays the image converted with the composite LUT on the display unit 28. The user then operates the operation unit 70 while viewing the converted image to adjust the composite ratio (application degree) to their liking. This process is repeated until the image desired by the user is displayed.

[0042] However, rather than judging the degree of application solely from the corrected image, comparing it with the image before conversion based on the 3D-LUT or with an image at 100% application allows for a more appropriate determination of the degree of application.

[0043] Therefore, in this embodiment, as shown in Figure 6, the area of ​​the captured image displayed on the display unit 28 is divided into three parts, and an image 601 without 3D-LUT conversion, an image 602 converted based on the 3D-LUT, and an image 603 converted based on the 3D-LUT with corrections based on the degree of application are displayed in each area, making it easy for the user to determine what degree of application will produce the optimal image quality effect. In Figure 6, the user can freely set the degree of application by scrolling up and down the window for setting the degree of application in the upper right corner of the screen using the operation unit 70. Each time the degree of application is changed by the user, the system control unit 50 generates a 3D-LUT based on the degree of application, sets it in the image processing unit 24, and converts the captured image. The system control unit 50 then displays the image data obtained from the conversion as image 603 (updates image 603). Note that instead of having three areas to display the image, images 602 and 603 may be displayed in two areas.

[0044] To simultaneously generate multiple images with different 3D-LUT transformation states, it is necessary to store each image obtained in the block diagram of Figure 3(a) in RAM and combine them into a single screen. However, by reducing the frame rate of each image and generating and combining multiple images in a time-division manner, this can be achieved with a simpler processing block as shown in Figure 3(b). In this case, the frame rate of images other than those applied to the 3D-LUT may also be reduced based on the degree of application. Furthermore, images that have not been transformed by the 3D-LUT and images transformed based on the 3D-LUT may be cropped to show only a portion of the field of view, rather than the entire field of view.

[0045] Alternatively, the system could display images that have not been converted using a 3D-LUT, images converted using a 3D-LUT, and images converted using a 3D-LUT with corrections based on the degree of application, switching between them in a time-division manner. Or, the system could display images that have not been converted using a 3D-LUT or images converted using a 3D-LUT only when instructed by the user. Furthermore, based on user instructions, the system could automatically record multiple still images or a continuous video while changing the degree of application at predetermined intervals, such as one second, and then search for the optimal degree of application from the recorded content.

[0046] This allows users to compare the image quality effects of 3D-LUTs and determine the optimal degree of application.

[0047] [Third Embodiment] In the first embodiment, a method for generating 3D-LUT data was described by performing calculations using formula (1) based on the degree of application specified by the user. However, calculating each component of the color space handled by the 3D-LUT with the same degree of application does not necessarily result in an image preferred by the user. Therefore, in this third embodiment, a method for setting the degree of application with a higher degree of flexibility and a method for generating 3D-LUT data will be described. The configuration of the imaging device in this third embodiment is assumed to be the same as in the first embodiment, and its description will be omitted.

[0048] The 3D-LUT data generation method in this embodiment will be described below using the block diagram illustrated in Figure 7. It should be understood that each component shown in the figure is set by the system control unit 50 to the image processing unit 24.

[0049] First, the system control unit 50 converts the through LUT 701 using the RGB-YUV conversion block 703 to generate a through LUT 701' for the YUV color space, which is represented by one luminance (Y) and two color differences (U, V). Similarly, the system control unit 50 converts the image quality effect LUT 702 using the RGB-YUV conversion block 704 to generate image quality effect LUT data 702' for the YUV color space, which has one luminance (Y) and two color differences (U, V).

[0050] The system control unit 50 then synthesizes these through LUT data 701' and image quality effect LUT data 702' according to the degree of application set independently by the user for luminance and chrominance, respectively, to generate 3D-LUT data 706 for the YUV color space. The system control unit 50 then converts the generated 3D-LUT data 706 for the YUV color space using the YUV-RGB conversion block 707 to generate 3D-LUT data 314 for the RGB space, and sets this in the image processing unit 24.

[0051] The following describes a specific example of a method for generating 3D-LUT data that takes into account the degree of application that can be adjusted for each component of the YUV signal. In this embodiment, the luminance component Y signal is converted using a 3D-LUT that aims to improve image quality, and the resulting image is obtained by utilizing it to its fullest extent. Then, the case in which the degree of application of the 3D-LUT is suppressed to 80% and 50% for the chromatic difference components U and V signals is explained as an example.

[0052] By performing calculations on each data component of the through LUT701' and the image quality effect LUT702' using the formulas shown in equations (2) to (4) below, a 3D-LUT706 for the YUV color space is generated. [Luminance component Y] Combined LUT = (Image quality effect LUT data 702') × 1.0 + (Through LUT data 701') × 0.0 …(1) [Color difference component U] Combined LUT = (Image quality effect LUT data 702') × 0.8 + (Through LUT data 701') × 0.2 …(2) [Color difference component V] Combined LUT = (Image quality effect LUT data 702') × 0.5 + (Through LUT data 701') × 0.5 …(3) By decomposing the image into luminance and color difference components and adjusting the degree of application for each component, a 3D-LUT706 can be generated that fine-tunes the image to the user's preference. However, the generated 3D-LUT is for the YUV color space. Therefore, the system control unit 50 converts the 3D-LUT706 using a YUV-RGB conversion block to generate a 3D-LUT314 for the RGB color space.

[0053] In this embodiment, we have described a case where an RGB signal is converted to a YUV signal and the degree of application is adjusted for each component. However, it is also possible to adjust the degree of application for each component of the RGB signal without performing any conversion. Furthermore, it is not necessary to limit the process to conversion to a YUV signal; the same processing can be performed in other color spaces, such as the L*a*b* space or the ICtCp space.

[0054] [Fourth Embodiment] In the first to third embodiments, a method was described for the user to freely set the degree of application of a 3D-LUT. However, in the case of a 3D-LUT used for color space conversion rather than image quality effects, the aspect of format conversion is stronger, and it may not be desirable for the user to freely set the degree of application. Also, the LUT creator may not want the degree of application to be changed. Furthermore, in order to allow room to change the degree of application in the direction of strengthening it, it may be desirable to set the initial value of the degree of application to a value less than 100%. Therefore, in this fourth embodiment, a method for reading whether the degree of application can be changed, information on deprecation, and the initial value of the degree of application included in the 3D-LUT, and performing actions accordingly, will be explained with reference to the flowchart in Figure 8. Note that the information regarding whether the degree of application can be changed, information on deprecation, and the initial value of the degree of application included in the 3D-LUT only needs to be described in the file header of the 3D-LUT file or other parts of the main 3D-LUT data.

[0055] In S801, the system control unit 50 reads a 3D-LUT file from the external recording medium 150, similar to the first embodiment, and stores it in the system memory 52. ​​When reading a 3D-LUT that includes information about changes in the degree of application or information about the initial value of the degree of application, such as the lines starting with "#" in Figure 9(a) and Figure 9(b), that information is also read.

[0056] In S802, the system control unit 50 determines whether the information read in S801 includes information on the initial application degree. Figure 9(a) shows a 3D-LUT that does not include information on the initial application degree, and Figure 9(b) shows a 3D-LUT that includes information on the initial application degree. If the system control unit 50 determines that the information on the initial application degree is not included, it proceeds to S803; if it determines that it is included, it proceeds to S804. In this embodiment, an example is shown where the 3D-LUT is represented by a string, but the numerical data of the 3D-LUT and the information on the change in the application degree may be represented in binary format or other formats.

[0057] In S803, the system control unit 50 determines in S802 that the 3D-LUT does not include an initial value for the degree of application, and therefore sets the degree of application 317 to 100%.

[0058] In S804, the system control unit 50 sets the degree of application 317 to the degree of application read in S801.

[0059] In S805, the system control unit 50 determines whether the information read in S801 contains information on whether the degree of application can be changed or is not recommended. Figure 9(a) shows a 3D-LUT file containing information on whether the degree of application cannot be changed, and Figure 9(b) shows a 3D-LUT file containing information on whether the degree of application is not recommended. The system control unit 50 attempts to extract information on the degree of application by analyzing the 3D-LUT file. If the system control unit 50 determines that the extracted information contains information on changing the degree of application or is not recommended, it proceeds to S806; if it determines that the information contains information on whether the degree of application cannot be changed, it proceeds to S807. If the system control unit 50 determines that this information is not included, or that it contains information on whether the degree of application can be changed, it proceeds to S808. In this embodiment, an example is shown where the 3D-LUT is represented by a string; however, the numerical data of the 3D-LUT and the information on changing the degree of application may be represented in binary format or other formats.

[0060] In S806, the system control unit 50 changes the user interface to a mode that displays a warning, such as warning 1002 in Figure 10, when the user changes the degree of application through the user interface. Warning 1002 is displayed when the user sets an application degree different from the recommended value. For example, if the recommended value for the degree of application is 50%, and the user tries to set it to 60%, the system control unit 50 displays "The recommended value for the LUT application degree is 50%." The warning may also be displayed when the user enters the user interface for changing the degree of application. In addition to warning 1002, information indicating the recommended value, such as recommended value display 1001, may also be displayed.

[0061] In S807, the system control unit 50 locks the user interface for changing the degree of application, preventing the user from changing the degree of application. Alternatively, for example, it may be necessary to prevent access to the user interface for changing the degree of application, or to invalidate any attempt to select a different degree of application and revert to the original degree of application.

[0062] In S808, the system control unit 50 sets the 3D-LUT 319 generated considering the degree of application 317 in the 3D-LUT processing unit 304, similar to the first embodiment. At this time, the degree of application 317 is the degree of application set in S803 or S804.

[0063] This embodiment describes a method for reading the initial value of the degree of application, whether the degree of application can be changed, and information regarding deprecation from the 3D-LUT, and reflecting this information in the degree of application 317 and the user interface. According to this embodiment, in 3D-LUTs where changing the degree of application is undesirable, it becomes possible to prohibit changing the degree of application or to notify the user that changing it is not recommended. Furthermore, in order to allow room for increasing the degree of application, it becomes possible to set the initial value of the degree of application to a value lower than 100% (maximum value).

[0064] In this embodiment, we have explained whether or not the degree of application can be changed and the patterns that are not recommended. However, it is also conceivable to allow changes only for users who meet certain conditions. For example, the degree of application could be fixed by default, but users who have obtained a license could be allowed to change the degree of application.

[0065] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0066] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0067] 100...Imaging device, 22...Imaging unit, 23...A / D converter, 24...Image processing unit, 50...System control unit, 52...System memory

Claims

1. An imaging device having an imaging means, obtaining means for obtaining a first lookup table for converting image data; a setting means for setting a degree of application of the first lookup table acquired by the acquisition means in response to a user operation; generating means for generating a second lookup table from the first lookup table based on the degree of application set by the setting means; an image capturing apparatus, characterized in that image data obtained by said imaging means is converted using the second lookup table generated by said generating means;

2. 2. The image pickup apparatus according to claim 1, wherein the acquisition means acquires the first lookup table from a predetermined memory included in the image pickup apparatus.

3. 2. The image pickup apparatus according to claim 1, wherein the acquisition means acquires the first lookup table from an external device of the image pickup apparatus.

4. a display means for displaying a first image obtained by the imaging means, a second image obtained by converting the first image using the first lookup table, and a third image obtained by converting the first image using the second lookup table, side by side; regenerating the second lookup table by the generating means every time the degree of application is changed by the setting means; The display means displays a third image obtained by conversion using the second lookup table generated each time the degree of application is changed, alongside the first image and the second image.

4. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

5. a first conversion means for converting a lookup table for an RGB color space into a lookup table for a color space having one luminance component and two color difference components; a second conversion means for converting a lookup table for a color space having one luminance component and two color difference components into a lookup table for an RGB color space; the setting means sets the degree of application for each of the one luminance component and the two color difference components; The generating means includes: a first lookup table for the RGB color space having an input=output relationship and a first lookup table for the RGB color space acquired by the acquisition means are converted by the first conversion means; The luminance component and the chrominance component of the two lookup tables obtained by the conversion are synthesized according to the degree of application of each component, thereby generating a lookup table having data of one synthesized luminance component and two synthesized chrominance components; The generated lookup table is converted by the second conversion means to generate the second lookup table.

5. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

6. The method further includes a determination unit that extracts information associated with the first lookup table acquired by the acquisition unit, and determines whether the extracted information includes information indicating whether the degree of application can be changed and information regarding an initial value of the degree of application, The generating means includes: If the result of the determination by the determining means indicates that an initial value of the applicability is set, generating the second lookup table according to the initial value; generating the second lookup table assuming that the degree of applicability is maximum when it is determined that the initial value of the degree of applicability is not set as a result of the determination by the determining means; When the determination result of the determination means indicates that the application level cannot be changed, the application level setting by the setting means is invalidated; When the result of the judgment by the judging means indicates that the applicability level can be changed, the second lookup table is generated in accordance with the applicability level set by the setting means.

6. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

7. A method for controlling an imaging device having an imaging means, comprising: obtaining a first lookup table for transforming image data; a setting step of setting a degree of application of the first lookup table acquired in the acquisition step in response to a user operation; a generating step of generating a second lookup table from the first lookup table based on the degree of application set in the setting step, A method for controlling an imaging apparatus, comprising converting image data obtained by an imaging means using the second lookup table generated in the generating step.

8. A program for causing a computer to execute each step of the method according to claim 7 when the program is read and executed by the computer.

Images