Image processing apparatus, image processing system, and image processing method

The image processing device generates accurate color profiles by acquiring spectral characteristics in a predetermined environment, eliminating the need for on-site color chart photography, and enabling efficient, remote color profile generation.

JP2024166012AInactive Publication Date: 2024-11-28CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023125468
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2023-08-01
Publication Date
2024-11-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing methods require photographing a color chart in a different environment to regenerate a color profile, which is labor-intensive and inefficient.

Method used

An image processing device that acquires spectral characteristics of a color patch in a predetermined environment and generates camera spectral characteristics without the need for photographing a color chart in a different environment, using camera spectral characteristics generation and color matching 3DLUT generation devices to create accurate color profiles.

Benefits of technology

Eliminates the need for photographing a color chart in a different environment, allowing for efficient generation of accurate color profiles without additional labor, and enables remote generation of color profiles using cloud-based data transfer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166012000001_ABST
    Figure 2024166012000001_ABST
Patent Text Reader

Abstract

To eliminate the need of photographing a color chart in an environment different from an environment where the color chart is photographed, to create a color profile for reproducing a color photographed by a photographing device in the environment.SOLUTION: An image processing apparatus acquires a measured value obtained by measuring the spectral characteristics of a color chart irradiated with illumination light in a first environment, and acquires color chart image data from a reference camera and a color matching target camera that each photograph the color chart irradiated with the illumination light in the first environment. The image processing apparatus generates camera spectral characteristics of the cameras from the measured value and these pieces of color chart image data, and uploads the camera spectral characteristics. Subsequently, the image processing apparatus downloads the uploaded camera spectral characteristics in a second environment different from the first environment, and creates a three-dimensional lookup table on the basis of the spectral characteristics related to the illumination light in the second environment, the spectral characteristics of the color chart measured in advance, and the camera spectral characteristics.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an image processing technique for reproducing colors captured by an image capture device. [Background technology]

[0002] In order to reproduce the colors captured by the camera with high accuracy in a specific environment, it is necessary to generate a color profile based on the measurement values ​​of the color patch measured under illumination in that environment and the shooting values ​​of the color patch photographed by the camera under the same geometric conditions. However, if the environment is different from the environment in which the color profile was generated, it is necessary to perform the same measurements and shooting in the different environment and generate a new color profile in order to reproduce the colors captured by the camera with high accuracy.

[0003] Patent Document 1 discloses a technique for acquiring values ​​equivalent to the measurement values ​​of a color patch by selecting from among multiple environments, instead of measuring a color patch in an environment different from the environment in which the color profile was generated. This technique is said to be capable of generating a highly accurate color profile using an image captured in that environment with an imaging device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-254371 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the method described in Patent Document 1 does not require measurement of the color chart in different environments, but does require photographing the color chart using a photographing device. Therefore, at the actual shooting site where the video is shot, the color chart must be photographed before the actual shooting, which poses a problem of requiring a lot of labor, including setting up the color chart.

[0006] In consideration of the above-mentioned problems, the present invention aims to make it possible to eliminate the need to photograph a color chart in an environment different from the environment in which the color chart was photographed, and to generate a color profile for reproducing colors photographed with an imaging device in that environment. [Means for solving the problem]

[0007] The image processing device according to the present invention is characterized in that it comprises an acquisition means for acquiring measurement values ​​that measure the spectral characteristics of a color chart illuminated by lighting in a specified environment, and acquiring color chart image data obtained by photographing the color chart while illuminated by the lighting in the specified environment, and a generation means for generating camera spectral characteristics of the camera that photographed the color chart from the measurement values ​​and color chart image data acquired by the acquisition means. Effect of the Invention

[0008] According to the present invention, it is possible to eliminate the need to photograph a color chart in an environment different from the environment in which the color chart was photographed, and to generate a color profile for reproducing colors photographed by an imaging device in that environment. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of the overall configuration of an image processing system according to a first embodiment. [Diagram 2] 5 is a flowchart showing an example of a schematic processing procedure in the image processing system according to the first embodiment. [Diagram 3] FIG. 1 is a block diagram showing an example of the configuration of a camera spectral characteristic generating system. [Figure 4] FIG. 1 is a diagram showing an example of a color chart. [Diagram 5] 10 is a flowchart illustrating an example of a processing procedure for generating a camera spectral characteristic. [Figure 6] 10 is a flowchart illustrating an example of a detailed processing procedure for generating a camera spectral characteristic. [Figure 7] FIG. 13 is a diagram showing an example of a camera spectral characteristic generation processing UI. [Figure 8] 1 is a block diagram showing an example of the configuration of a color-matching 3DLUT generation system according to a first embodiment. [Figure 9] 5 is a flowchart showing an example of a processing procedure for generating a color-matched 3DLUT in the first embodiment. [Figure 10] 5 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT in the first embodiment. [Figure 11] FIG. 4 is a diagram illustrating an example of a UI for generating a 3DLUT in the first embodiment. [Figure 12] FIG. 11 is a block diagram showing an example of the configuration of a color-matching 3DLUT generating system according to a second embodiment. [Figure 13] 10 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT in the second embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of a UI for generating a 3DLUT in the second embodiment. [Figure 15] FIG. 13 is a block diagram showing an example of the overall configuration of an image processing system according to a third embodiment. [Figure 16] FIG. 13 is a block diagram showing an example of the overall configuration of an image processing system according to a fourth embodiment. [Figure 17] 13 is a flowchart showing an example of a schematic processing procedure in an image processing system according to a fourth embodiment. [Figure 18] FIG. 13 is a block diagram showing an example of the configuration of a color profile generating system according to a fourth embodiment. [Figure 19] 13 is a flowchart showing an example of a processing procedure for generating a color profile in the fourth embodiment. [Figure 20] 13 is a flowchart showing an example of a detailed processing procedure for generating a color profile in the fourth embodiment. [Figure 21] FIG. 13 is a diagram illustrating an example of a UI for generating a color profile according to the fourth embodiment. [Figure 22]1 is a block diagram showing an example of the hardware configuration of a camera spectral characteristic generation device and a color matching 3DLUT generation device according to an embodiment. FIG. [Figure 23] FIG. 13 is a diagram showing an example of camera spectral characteristics in the fifth embodiment. [Figure 24] 13 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (First embodiment) Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of the overall configuration of an image processing system according to this embodiment. As shown in Fig. 1, the image processing system according to this embodiment is composed of a first environment 1 and a second environment 2 different from the first environment 1. In this embodiment, a camera spectral characteristic is generated in the first environment 1, and a color matching 3DLUT (color matching three-dimensional lookup table) is generated as a color profile in the second environment 2.

[0011] The first environment 1 includes a reference camera 11, a first color-matching target camera 12, a first measuring instrument 13, a color chart 14, a first illumination 15, a camera spectral characteristic generating device 16, and a display device 17. On the other hand, the second environment 2 includes a second color-matching target camera 21, a second measuring instrument 23, a second illumination 25, a color-matching 3DLUT generating device 26, and a display device 27.

[0012] FIG. 22 is a block diagram showing an example of the hardware configuration of the camera spectral characteristic generation device 16 and the color matching 3DLUT generation device 26 according to this embodiment. The CPU 101 reads out a control program stored in the ROM 102 and executes various processes. The RAM 103 is used as a temporary storage area such as the main memory and work area of ​​the CPU 101. The HDD 104 stores various data and programs. The communication I / F 105 is an interface for transmitting and receiving data to and from an external device, etc., via a wired or wireless connection. The input / output I / F 106 is an interface for inputting operation information from a keyboard, mouse, etc., and outputting display data to a display device.

[0013] FIG. 2 is a flowchart showing an example of a schematic processing procedure in the image processing system according to this embodiment. In step S1, a camera spectral characteristic is generated in a first environment 1. A method for generating a camera spectral characteristic will be described in detail later. Then, in step S2, a color-matched 3DLUT is generated in a second environment 2. A method for generating a color-matched 3DLUT will be described in detail later. The process in each step will be described in detail below.

[0014] Fig. 3 is a block diagram showing an example of the configuration of a camera spectral characteristic generation system in the first environment 1. As shown in Fig. 3, the camera spectral characteristic generation device 16 includes a data input / output unit 161, a camera spectral characteristic generation unit 162, a storage 163, and a communication unit 164.

[0015] The reference camera 11 is a camera that serves as a reference for color matching, and is a camera for matching the color captured by the first color matching target camera 12 with the color captured by the reference camera 11. The first measuring device 13 is a measuring device that measures spectral luminance. The color chip 14 is, for example, a color chip as shown in FIG. 4, and for the color chip 14, a commercially available color chip for color design, for example, a color chip having patches that can cover gray gradations, important colors such as skin color and blue sky, and all hues of RGBCMY, is used. The first lighting 15 is lighting that serves as a reference for color design, and is, for example, lighting with high color rendering properties with a color temperature of about 5500K. The display device 17 is a display for a normal personal computer (PC).

[0016] The data input / output unit 161 of the camera spectral characteristic generation device 16 inputs image data and measurement values, and outputs data for displaying a UI to the display device 17. The camera spectral characteristic generation unit 162 generates a camera spectral characteristic using the input image data and measurement values. The storage 163 is a storage unit for holding the camera spectral characteristic generated by the camera spectral characteristic generation unit 162. The communication unit 164 is a communication unit for uploading the camera spectral characteristic held in the storage 163 to a cloud or the like.

[0017] The data input / output unit 161 is connected to the reference camera 11, the first color matching target camera 12, the first measuring instrument 13, and the display device 17 via cables or the like, and can further be connected to a recording medium such as a memory card. The storage 163 also functions as a part of the RAM 103 and a work memory for performing processing described below. Data is exchanged between the reference camera 11, the first color matching target camera 12, and the first measuring instrument 13 and the camera spectral characteristic generating device 16 using cables, but is not limited to this. For example, data may be exchanged using a recording medium such as a memory card, or a communication path such as wireless or infrared.

[0018] FIG. 5 is a flowchart showing an example of a processing procedure for generating a camera spectral characteristic in the camera spectral characteristic generating system in step S1 of FIG. In step S11, the first measuring device 13 measures the color chip 14, and in step S11, the data input / output unit 161 inputs the measurement value from the measuring device 13. When measuring the color chip 14, the color chip 14 is irradiated and measured under predetermined geometric conditions using the first illumination 15. The measurement results are stored in the storage 163 as a measurement value file.

[0019] In step S12, the camera spectral characteristic generating device 16 selects one camera to capture the color chart 14. In this embodiment, either the reference camera 11 or the first color matching target camera 12 is selected. Then, the color chart 14 is captured using the selected camera, and in step S13, the data input / output unit 161 inputs the color chart image data from the selected camera. When capturing the image, the color chart 14 is illuminated under predetermined geometric conditions using the first illumination 15 in the same manner as during measurement, and the selected camera is placed in the same position as the first measuring device 13 to capture the image. The input color chart image data is stored in the storage 163 as a color chart image file.

[0020] In step S14, the camera spectral characteristic generating unit 162 generates a camera spectral characteristic. Details of this process will be described later. In step S15, the communication unit 164 uploads the camera spectral characteristic generated in step S14 to a cloud or the like.

[0021] Next, in step S16, the camera spectral characteristic generating device 16 determines whether or not shooting has been performed with all of the cameras prepared in the first environment 1. If the result of this determination is that shooting has been performed with all of the prepared cameras, the process ends, and if there is a camera that has not yet taken a picture, the process returns to step S12.

[0022] Fig. 6 is a flowchart showing an example of a detailed processing procedure for generating a camera spectral characteristic by the camera spectral characteristic generation unit 162 in step S14 in Fig. 5. Also, Fig. 7 is a diagram showing an example of a camera spectral characteristic generation processing UI displayed on the display device 17 via the data input / output unit 161.

[0023] The camera spectral characteristic generation processing UI shown in Fig. 7 includes a measurement value file selection section 1621, a measurement value file display section 1622, a color chart image file selection section 1623, and a color chart image file display section 1624. The camera spectral characteristic generation processing UI further includes a measurement value display section 1625, a color chart image display section 1626, a camera spectral characteristic display section 1627, and a camera spectral characteristic generation button 1628. First, when a file is designated in the measurement value file selection section 1621 and the color chart image file selection section 1623 by a user's operation, the designated file name is displayed in the measurement value file display section 1622 and the color chart image file display section 1624, respectively. Furthermore, the measurement value display section 1625 displays the measurement value of the selected file name, and the color chart image display section 1626 displays the color chart image of the selected file name. Furthermore, when the camera spectral characteristic generation button 1628 is selected by a user's operation, the processing of the flowchart in Fig. 6 is started.

[0024] In step S141, the camera spectral characteristics generation unit 162 sets the previously measured measurement values. In this process, the measurement values ​​of the file names displayed in the measurement value file display unit 1622 are set. Next, in step S142, the camera spectral characteristics generation unit 162 sets the previously captured color chart image file. In this process, the color chart image file of the file name displayed in the color chart image file display unit 1624 is set.

[0025] Next, in step S143, the camera spectral characteristics generation unit 162 generates a camera spectral characteristics. Details of this process will be described later. Then, in step S144, the camera spectral characteristics generation unit 162 stores the optimized camera spectral characteristics in the storage 163 as a camera spectral characteristics file.

[0026] The process of step S143 will be described in detail below. First, the RGB values ​​(photographed values) of each patch on the color chart 14 are obtained from the color chart image file set in step S142. When obtaining the RGB values, the range of each patch is set by detecting edges from the color chart image, and the average value of a certain number of pixels within the set range is calculated. The photographed values ​​calculated with the patch ID set to i are respectively (Rti, Gti, Bti).

[0027] In addition, the camera spectral characteristics are modeled separately into sensor filter spectral characteristics and camera image processing, and each is calculated using the following formula. The sensor filter spectral characteristics f(λ) for each RGB color are fr(λ), fg(λ), and fb(λ), and the camera image processing is a 3×3 matrix M. If the measurement value of the acquired color patch is g(λ), the predicted shooting values ​​(predicted values) of the color patch (Re, Ge, Be) are expressed by the following formulas (1) to (4).

[0028]

number

[0029] In addition, the sensor filter spectral characteristic f(λ) is approximated by a linear combination model of Gaussian functions. The number of Gaussian functions to be combined is n, and it can be expressed by the following equations (5) and (6).

[0030]

number

[0031] Each Gaussian function has three parameters, μ, ρ, and σ, which are the number of Gaussian functions times the three RGB colors. A 3x3 matrix has nine parameters. From the above, the camera spectral characteristics have (9n+9) parameters, and highly accurate estimation is possible by optimizing these parameters.

[0032] Next, the optimization method is shown below. The previously calculated shooting values ​​(Rti, Gti, Bti) are converted to shooting values ​​(Lti, ati, bti) according to the following formulas (7) to (13). Similarly, the predicted values ​​(Rei, Gei, Bei) of the color chart predicted with patch ID i are converted to predicted values ​​(Lei, aei, bei) according to the following formulas (7) to (13). In the following formulas (9) to (12), Xn = 0.9509, Yn = 1.0000, and Zn = 1.0891.

[0033]

number

[0034] Here, (R', G', B') in the formula (7) refer to the photographed values ​​(Rti, Gti, Bti) or the predicted values ​​(Rei, Gei, Bei). * , a * , b * ) indicates the photographed values ​​(Lti, ati, bti) or the predicted values ​​(Lei, aei, bei). Then, the filter spectral characteristic + 3 × 3 matrix M that minimizes the evaluation value ΔE according to the following formula (14) is obtained using, for example, the damped least squares method.

[0035]

number

[0036] In this way, the camera spectral characteristics are divided into sensor / filter spectral characteristics and camera image processing, and modeled, and the parameters are optimized to accurately predict the shooting values ​​of the color chart. The optimized camera spectral characteristics are displayed in the camera spectral characteristics display section 1627 of the camera spectral characteristics generation processing UI.

[0037] Next, a description will be given of the details of the second environment 2. Fig. 8 is a block diagram showing an example of the configuration of a color matching 3DLUT generation system in the second environment 2. As shown in Fig. 8, the color matching 3DLUT generation device 26 includes a data input / output unit 261, a color matching 3DLUT generation unit 262, a storage 263, and a communication unit 264.

[0038] The second color matching target camera 21 may be of the same model as the first color matching target camera 12 in the first environment 1, but it does not necessarily have to be the same camera. The same camera may be moved from the first environment 1 to the second environment 2 and used. The second measuring device 23 may be a handy measuring device as long as it is capable of acquiring the spectral characteristics (lighting data) of the second lighting 25. The second lighting 25 may be unique to the second environment 2, but it does not necessarily have to be the same as the first lighting 15. Furthermore, sunlight may be used as the second lighting 25 outdoors.

[0039] The data input / output unit 261 of the color matching 3DLUT generation device 26 inputs the measurement results from the second measuring instrument 23 and outputs the generated color matching 3DLUT. The 3DLUT generation unit 262 generates a color matching 3DLUT using the measurement results from the second measuring instrument 23. The storage 263 is a storage unit for holding the generated color matching 3DLUT. The communication unit 264 is a communication unit for uploading the color matching 3DLUT held in the storage 263 and downloading the camera spectral characteristics generated in the first environment 1.

[0040] The data input / output unit 261 is connected to the second measuring instrument 23 via a cable or the like, and can further be connected to a recording medium such as a memory card. The storage 263 also functions as a part of the RAM 103 and a work memory for performing processing described below. Furthermore, data is exchanged between the second color matching target camera 21 and the second measuring instrument 23, and the color matching 3DLUT generation device 26 using cables, but data may also be exchanged using a recording medium such as a memory card, or a communication path such as wireless or infrared.

[0041] FIG. 9 is a flowchart showing an example of a processing procedure for generating a color-matched 3DLUT in the color-matched 3DLUT generating system in the second environment in step S2 of FIG. First, in step S21, the communication unit 264 downloads the uploaded camera spectral characteristics and stores them in the storage 263. At that time, at least two types of camera spectral characteristics, that of the reference camera 11 and the first color matching target camera 12, are downloaded and stored.

[0042] Next, in step S22, the color-matched 3DLUT generation unit 262 generates a color-matched 3DLUT. Details of this process will be described later. Next, in step S23, the data input / output unit 261 transfers the color-matched 3DLUT generated in step S22 to the second target camera 21.

[0043] Fig. 10 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT by the color-matched 3DLUT generation unit 262 in step S22 in Fig. 9. Also, Fig. 11 is a diagram showing an example of a UI for generating a 3DLUT displayed on the display device 27 via the data input / output unit 261.

[0044] 11 includes a reference camera selection drop-down list 2621, a color matching target camera selection drop-down list 2622, and a color chart selection drop-down list 2623. The 3DLUT generation UI further includes a measurement button 2624, a measurement result display unit 2625, and a color matching 3DLUT generation button 2626. First, a camera and a color chart are selected in the reference camera selection drop-down list 2621, the color matching target camera selection drop-down list 2622, and the color chart selection drop-down list 2623 by a user operation. In addition, when the measurement button 2624 is selected by a user operation, the second measuring device 23 operates and the measurement of the spectral characteristics of the second illumination 25 is performed. Then, illumination data related to the spectral characteristics of the second illumination 25 is input as a measurement value file by the data input / output unit 261, and is stored in the storage 263, and the measurement result is displayed on the measurement result display unit 2625. Thereafter, when the user selects the color matching 3DLUT generation button 2626, the process of the flowchart in FIG. 10 starts.

[0045] In step S231, the color matching 3DLUT generation unit 262 sets the camera spectral characteristics of the reference camera selected in the reference camera selection drop-down list 2621. Similarly, the color matching 3DLUT generation unit 262 sets the camera spectral characteristics of the color matching target camera selected in the color matching target camera selection drop-down list 2622. In this embodiment, the camera spectral characteristics uploaded from the first environment 1 are stored in the storage 263. Therefore, in step S231, the camera spectral characteristics of the reference camera 11 and the first color matching target camera 12 are set.

[0046] Next, in step S232, the color matching 3DLUT generation unit 262 sets a color chart file stored in the storage 263 according to the color chart selected in the color chart selection drop-down list 2623. Here, the spectral characteristics of a plurality of color charts are measured in advance, and the spectral characteristics of the plurality of color charts are stored as color chart files in the storage 263. The color chart selected here does not necessarily have to be the same as the color chart 14 used in the first environment 1.

[0047] Next, in step S233, the color matching 3DLUT generation unit 262 reads out the measurement value file of the second measuring instrument 23 stored in the storage 263. Then, in step S234, the color matching 3DLUT generation unit 262 generates a color matching 3DLUT, and in step S235, the color matching 3DLUT generation unit 262 stores the generated color matching 3DLUT in the storage 263. Details of the process of step S234 will be described below.

[0048] As described above, the camera spectral characteristics are modeled separately into the sensor filter spectral characteristics and the camera image processing. Therefore, the sensor filter spectral characteristics f(λ) of each of the RGB colors are expressed as fr(λ), fg(λ), and fb(λ), and the camera image processing is expressed as a 3×3 matrix M. Here, the spectral characteristics of the selected color chip are c(λ), and the measured value of the illumination data by the second measuring device 23 is l(λ). In this case, the shooting values ​​(Rr, Gr, Br) predicted by the reference camera 11 and the shooting values ​​(Ra, Ga, Ba) predicted by the first color matching target camera 12 are calculated using the following formulas (15) to (18).

[0049]

number

[0050] In equation (18), (R, G, B) indicate the shooting values ​​(Rr, Gr, Br) of the reference camera 11 or the shooting values ​​(Ra, Ga, Ba) of the first color matching target camera 12. Next, with the patch ID set to i, the calculated shooting values ​​(Rai, Gai, Bai) of the first color matching target camera 12 are converted to shooting values ​​(R'ai, G'ai, B'ai) according to the following equation (19).

[0051]

number

[0052] M2 in the formula represents a 3×19 matrix. Next, with the patch ID set to i, the calculated photographic values ​​(Rri, Gri, Bri) and (R'ai, G'ai, B'ai) are converted to photographic values ​​(Lri, ari, bri) and (Lai, aai, bai) according to the above-mentioned formulas (7) to (13). * , a * , b * ) indicates the shooting values ​​(Lri, ari, bri) or the shooting values ​​(Lai, aai, bai). Then, the 3 × 19 matrix M2 is optimized, for example, by the least squares method, so that the evaluation value ΔE according to the following equation (20) is minimized.

[0053]

number

[0054] Finally, a color-matched 3DLUT is generated from the obtained 3×19 matrix M2. When generating a 3DLUT, the RGB values ​​are obtained in order as shown in the following formula (21), and the RGB values ​​are converted using the previously optimized 3×19 matrix M2. The relationship between the shooting values ​​(Ra, Ga, Ba) and the shooting values ​​(R'a, G'a, B'a) is the color-matched 3DLUT.

[0055]

number

[0056] In addition, in this embodiment, when optimizing parameters, RGB values ​​are assumed to be sRGB and converted to Lab values ​​using equations (7) to (13). However, it is also possible to assume AdobeRGB and convert using the following equation (22) instead of equation (8).

[0057]

number

[0058] In this embodiment, the evaluation value ΔE in equation (10) is used as the evaluation value when optimizing the parameters. Instead, the evaluation value ΔE in equation (23) below is used. 94 may also be used.

[0059]

number

[0060] In the formula (L * i , a * i , b * i ) refer to the values ​​(Lei, aei, bei), and (L * t, a * t, b * t) refer to the values ​​(Lti, ati, bti), respectively.

[0061] In addition, since the captured image also depends on the spectral characteristics of the lens attached to the camera, a sensor filter spectral characteristic model that takes the lens's spectral characteristics into account may be adopted. In this case, the lens's spectral characteristics are defined as r(λ), and the following equations (24) to (26) are used instead of equations (1) to (3).

[0062]

number

[0063] As described above, according to this embodiment, since the camera spectral characteristics are generated for each camera, it is possible to predict the camera's shooting values ​​even in an environment different from the environment in which the color patch was measured and photographed. This makes it possible to generate a highly accurate color-matched 3DLUT by simply measuring the spectral characteristics of the light source in a different environment, without having to measure or photograph the color patch. In addition, by using the cloud, it is possible to generate a color-matched 3DLUT even in a remote location.

[0064] Second embodiment In the first embodiment, the spectral characteristics of the second illumination are measured using a second measuring device in a second environment, but in this embodiment, instead of measuring, a selection may be made from among multiple candidates. The following mainly describes the differences from the first embodiment.

[0065] 12 is a block diagram showing an example of the overall configuration of an image processing system in this embodiment. Compared to the first embodiment, since measurement in the second environment is omitted, the second measuring device 23 is not connected. The other configurations are the same as those in the first embodiment.

[0066] Fig. 13 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT by the color-matched 3DLUT generator 262 in step S22 in Fig. 9 in this embodiment. Also, Fig. 14 is a diagram showing an example of a UI for generating a 3DLUT in this embodiment.

[0067] The UI for generating a 3DLUT shown in FIG. 14 includes a drop-down list for selecting a reference camera 2621, a drop-down list for selecting a camera to be color-matched 2622, and a drop-down list for selecting a color chart 2623. The UI for generating a 3DLUT further includes a color-matching 3DLUT generation button 2626 and a drop-down list for selecting illumination data 2628. First, a camera and a color chart are selected in the drop-down list for selecting a reference camera 2621, the drop-down list for selecting a camera to be color-matched 2622, and the drop-down list for selecting a color chart 2623 by a user operation. Furthermore, illumination data is also selected in the drop-down list for selecting illumination data 2628 by a user operation. The illumination data includes spectral data of sunlight and spectral data of representative light sources such as a high color rendering fluorescent lamp, a three-wavelength fluorescent lamp, an LED lamp, and a tungsten lamp, and illumination data corresponding to the second illumination 25 is selected from among them. After that, when the color-matching 3DLUT generation button 2626 is selected by a user operation, the process of the flowchart in FIG. 13 is started.

[0068] Steps S231, S232, S234, and S235 in FIG. 13 are similar to steps S231, S232, S234, and S235 in FIG. 10 described in the first embodiment, respectively, and therefore will not be described.

[0069] In step S236, the color-matched 3DLUT generation unit 262 sets the illumination data selected in the illumination data selection drop-down list 2628. Note that the spectral characteristics of the illumination data are measured in advance and stored in the storage 263. In step S234, a color-matched 3DLUT is generated using the measurement values ​​of the selected illumination data.

[0070] As described above, according to this embodiment, even in an environment different from the environment in which the color patch was measured and photographed, a highly accurate color-matched 3DLUT can be generated simply by selecting the illumination data of the light source in that environment, without having to measure or photograph the color patch. In addition, by using the cloud, a color-matched 3DLUT can be generated even in a remote location.

[0071] (Third embodiment) In the first and second embodiments, the camera spectral characteristic generating device 16 and the color matching 3DLUT generating device 26 transmit and receive data via a communication unit via the cloud or the like, but both functions may be implemented in one device. In that case, as shown in Fig. 15, a first generating device 3a that generates both the camera spectral characteristic and the color matching 3DLUT is carried between environments by hand and used in the second environment 2 as a second generating device 3b.

[0072] In addition, in the actual processing, the uploading of the camera spectral characteristics in step S15 in Fig. 5 and the downloading of the camera spectral characteristics in step S21 in Fig. 9 are omitted. Therefore, in this embodiment, the camera spectral characteristics are stored in a storage, and the camera spectral characteristics stored in the storage are read out to generate a color matching 3DLUT. Note that the other processing is the same as in the first embodiment or the second embodiment.

[0073] As described above, according to this embodiment, a highly accurate color-matched 3DLUT can be generated without measuring or photographing a color patch even in an environment different from the environment in which the color patch was measured and photographed. In addition, since no data transmission or reception using communication is involved, a color-matched 3DLUT can be generated even between locations where communication is not possible.

[0074] (Fourth embodiment) In the first to third embodiments, the camera spectral characteristics generation device 16 generates camera spectral characteristics for multiple cameras, and the color matching 3DLUT generation device 26 generates a color matching 3DLUT between the cameras. In contrast, in this embodiment, the camera spectral characteristics generation device generates a camera spectral characteristic using only one camera. Then, instead of generating a color matching 3DLUT in the second environment, a color profile of the camera in the second environment is generated without capturing a color chart. Hereinafter, details of this embodiment will be described with reference to the drawings.

[0075] Fig. 16 is a block diagram showing an example of the overall configuration of an image processing system in this embodiment. As shown in Fig. 16, the first environment 1 includes a first camera 18, a first measuring instrument 13, a color patch 14, a first illumination 15, a camera spectral characteristic generating device 16, and a display device 17. On the other hand, the second environment 2 includes a second camera 28, a second measuring instrument 23, a second illumination 25, a color profile generating device 29, and a display device 27. The hardware configuration of the color profile generating device 29 is the same as that in Fig. 22.

[0076] Fig. 17 is a flowchart showing an example of a schematic processing procedure in the image processing system according to this embodiment. In step S1 of Fig. 17, a camera spectral characteristic is generated in a first environment 1. In this embodiment, only the camera spectral characteristic of a first camera 18 is generated, but the details of the method of generating the camera spectral characteristic are similar to those in the first embodiment, so a description thereof will be omitted. In step S3, a color profile is generated in a second environment 2. Details of the processing in step S3 will be described below.

[0077] 18 is a block diagram showing an example of the configuration of a color profile generation system in the second environment 2. As shown in FIG. 18, a color profile generation device 29 includes a data input / output unit 291, a color profile generation unit 292, a storage 293, and a communication unit 294.

[0078] The second camera 28 need only be the same model as the first camera 18 in the first environment 1, and is not necessarily the same camera. The same camera may be moved from the first environment 1 to the second environment 2 and used. The second measuring instrument 23, the second lighting 25, and the display device 27 are the same as those shown in FIG. 8 in the first embodiment, and therefore description thereof will be omitted.

[0079] The data input / output unit 291 of the color profile generation device 29 inputs the measurement results from the second measuring instrument 23 and outputs the generated color profile. The color profile generation unit 292 generates a color profile using the measurement results from the second measuring instrument 23. The storage 293 is a storage unit for holding the generated color profile. The communication unit 294 is a communication unit for uploading the color profile held in the storage 293 and downloading the camera spectral characteristics generated in the first environment 1.

[0080] The data input / output unit 291 is connected to the second measuring instrument 23 via a cable or the like, and can further be connected to a recording medium such as a memory card. The storage 293 is part of the RAM 103 and also functions as a work memory for processing described below. Data is exchanged between the second camera 28 and the second measuring instrument 23 and the color profile generating device 29 using a cable, but data may also be exchanged using a recording medium such as a memory card, or a communication path such as wireless or infrared.

[0081] FIG. 19 is a flowchart showing an example of a processing procedure for generating a color profile in the color profile generation system in step S3 of FIG. First, in step S31, the communication unit 294 downloads the uploaded camera spectral characteristics and stores them in the storage 293. In this embodiment, the camera spectral characteristics of the first camera 18 are downloaded.

[0082] Next, in step S32, the color profile generating unit 292 generates a color profile. Details of this process will be described later. Next, in step S33, the data input / output unit 291 transfers the generated color profile to the second camera .

[0083] Fig. 20 is a flowchart showing an example of a detailed processing procedure for generating a color profile by the color profile generating unit 292 in step S32 in Fig. 19. Also, Fig. 21 is a diagram showing an example of a UI for color profile generation displayed on the display device 27 via the data input / output unit 291.

[0084] The UI for generating a color profile shown in FIG. 21 includes a camera selection drop-down list 2921, a color patch selection drop-down list 2923, a measurement button 2924, and a measurement result display section 2925. The UI for generating a color profile further includes a color profile generation button 2926 and a color profile save button 2927. First, a camera and a color patch are selected in the camera selection drop-down list 2921 and the color patch selection drop-down list 2923 by a user operation. When the measurement button 2924 is selected by a user operation, the second measuring device 23 operates and measures the spectral characteristics of the second illumination 25. Then, the data is input as a measurement value file by the data input / output section 291 and stored in the storage 293, and the measurement result is displayed in the measurement result display section 2925. After that, when the color profile generation button 2926 is selected by a user operation, the process of the flowchart in FIG. 20 is started.

[0085] In step S321, the color profile generation unit 292 sets a camera spectral characteristic file of the camera selected in the camera selection drop-down list 2921. In this embodiment, it sets the camera spectral characteristic of the first camera 18. The processes of steps S322 and S323 are similar to the processes of steps S232 and S233 in FIG. 10 described in the first embodiment, respectively, and therefore will not be described.

[0086] Next, in step S324, the color profile generation unit 292 generates a color profile. In this embodiment, as described below, a color profile converted into a 3DLUT is generated. Then, in step S325, the color profile generation unit 292 stores the generated color profile converted into a 3DLUT as a 3DLUT file in the storage 293. Details of the process of step S324 will be described below.

[0087] Among the camera spectral characteristics of the first camera 18, the sensor filter spectral characteristics f(λ) of each of the RGB colors are fr(λ), fg(λ), and fb(λ), and the camera image processing is performed using a 3×3 matrix M. Then, when the spectral characteristics of the selected color chip are c(λ) and the illumination data measured by the second measuring device 23 is l(λ), the predicted shooting values ​​(R, G, B) of the first camera 18 are calculated using the above-mentioned formulas (15) to (18). Then, with the patch ID set to i, the calculated shooting values ​​(Ri, Gi, Bi) are converted to shooting values ​​(R'i, G'i, B'i) using the 3×19 matrix M2 in the above-mentioned formula (19), and are then converted to shooting values ​​(Li, ai, bi) according to the above-mentioned formulas (7) to (13).

[0088] Next, when the color matching functions are x(λ), y(λ), and z(λ), the XYZ values ​​(Xt, Yt, Zt) are calculated according to the following equations (27) to (29).

[0089]

number

[0090] Next, assuming that the patch ID is i, the calculated XYZ values ​​(Xti, Yti, Zti) are converted to values ​​(Lti, ati, bti) according to equations (9) to (13). Then, a 3×19 matrix M2 that minimizes the following evaluation value ΔE is found, for example, by using the damped least squares method according to the following equation (30).

[0091]

number

[0092] Finally, a 3DLUT is generated from the obtained 3x19 matrix M2. When generating a 3DLUT, the RGB values ​​are obtained in order as shown in the following formula (31), and the RGB values ​​are converted using the previously optimized 3x19 matrix M2. The relationship between the values ​​before conversion (R, G, B) and the values ​​after conversion (R', G', B') is called the color profile. In this way, a 3DLUT-ized color profile is generated.

[0093]

number

[0094] As described above, according to this embodiment, a highly accurate color profile can be generated by simply measuring the spectral characteristics of the light source in an environment different from the environment in which the color chart was measured and photographed, without having to measure or photograph the color chart again.

[0095] Fifth embodiment In the first to third embodiments, the camera spectral characteristics of a plurality of cameras are generated by the camera spectral characteristics generating device 16, and the color matching 3DLUT generating device 26 generates the color matching 3DLUT between the cameras. In the first to fourth embodiments, the camera spectral characteristics are modeled by dividing them into sensor filter spectral characteristics and camera image processing. In contrast, in this embodiment, the camera spectral characteristics generated by the camera spectral characteristics generating device are modeled by dividing them into four parts, namely, the camera model name, the sensor filter spectral characteristics, the camera image processing (linear), and the camera image processing (nonlinear), as shown in FIG. 23. Then, the pixel values ​​after the camera image processing (linear) are used to generate the color matching 3DLUT between the cameras, thereby enabling the colors to be matched between the cameras with higher accuracy. The configuration of the image processing system according to this embodiment is basically the same as that of the first embodiment. Hereinafter, the differences from the first embodiment will be mainly described.

[0096] The "camera model name" in Fig. 23 is stored as a character string that can identify the camera, such as "CameraA". The "sensor filter spectral characteristics" are expressed as a linear combination of n Gaussian functions as shown in equations (5) and (6), where the sensor filter spectral characteristics f(λ) for each RGB color are fr(λ), fg(λ), and fb(λ). At this time, three parameters μ, ρ, and σ are stored for each Gaussian function, and these parameters are stored as the sensor filter spectral characteristic parameters for the number of Gaussian functions times the three RGB colors.

[0097] "Camera image processing (linear)" is, for example, a 3x3 matrix, and the camera image processing (linear) parameters hold 9 parameters. On the other hand, "Camera image processing (non-linear)" is, for example, an S-curve model + 3x19 matrix, and the camera image processing (non-linear) parameters hold 57 + 5 = 62 parameters.

[0098] Using the above parameters, assuming that the 3 × 3 matrix is ​​M, the 3 × 19 matrix is ​​M2, and the measurement value of the acquired color patch is g(λ), the predicted shooting values ​​of the color patch (Re, Ge, Be) are expressed by the following equations (32) to (37). Note that equations (32) to (34) are conversions due to the sensor filter spectral characteristics, equation (35) is conversions due to camera image processing (linear), and equations (36) and (37) are conversions due to camera image processing (nonlinear).

[0099]

number

[0100]

number

[0101]

number

[0102] As described above, the camera spectral characteristic has a total of 9n+9+62 parameters, and highly accurate estimation is possible by optimizing these parameters in step S143. Note that the camera spectral characteristic generation process in this embodiment is almost the same as the camera spectral characteristic generation process in the first embodiment. However, the number of parameters used in the optimization process in step S143 increases from 9n+9 to 9n+9+62.

[0103] 24 is a flowchart showing an example of a detailed processing procedure for generating a color-matched 3DLUT in this embodiment. The UI for generating a 3DLUT in this embodiment is similar to that in FIG. 11 described in the first embodiment.

[0104] First, the user selects a camera and a color chart in a reference camera selection drop-down list 2621, a color matching target camera selection drop-down list 2622, and a color chart selection drop-down list 2623. When a measurement button 2624 is selected by the user, the second measuring device 23 operates and measures the spectral characteristics of the second illumination 25. Then, illumination data relating to the spectral characteristics of the second illumination 25 is input as a measurement value file by the data input / output unit 261 and stored in the storage 263, and at the same time, the measurement results are displayed on the measurement result display unit 2625. Thereafter, when a color matching 3DLUT generation button 2626 is selected by the user, the processing of the flowchart in FIG. 24 is started.

[0105] Steps S231 to S233 are similar to steps S231 to S233 in FIG. 10, respectively, and therefore their explanation will be omitted. In step S237, the color matching 3DLUT generation unit 262 generates an inverse transformation 3DLUT for performing an inverse transformation of the camera image processing (non-linear) when calculating values ​​after the camera image processing (linear) from the shooting values ​​of the camera to be color matched. When generating the inverse transformation 3DLUT, first, input values ​​(Rin, Gin, Bin) are acquired in order as shown in the following formula (38).

[0106]

number

[0107] Then, the output values ​​(Rout, Gout, Bout) are calculated using equations (36) and (37), which are the camera image processing (nonlinear) processing of the camera to be color matched.Then, the relationship between the output values ​​(Rout, Gout, Bout) and the input values ​​(Rin, Gin, Bin) is stored in the storage 263 as the inverse conversion 3DLUT.In actual conversion, the calculation is performed using the inverse tetrahedral interpolation method for a certain RGB value.

[0108] Next, in step S238, the color matching 3DLUT generation unit 262 optimizes the 3×19 matrix (M3) for inter-camera color matching. The detailed procedure is as follows: First, the spectral characteristic of the selected color patch is c(λ), and the measurement value of the illumination data by the second measuring instrument 23 is l(λ), and the measurement value g(λ) of the color patch is calculated according to the following equation (39).

[0109]

number

[0110] Next, the photographing values ​​(Ra, Ga, Ba) after the camera image processing (linear) of the camera to be color-matched are calculated by the formulas (32) to (35) using the measurement value g(λ) obtained by the formula (39) and the camera spectral characteristics of the camera to be color-matched. Then, the calculated photographing values ​​(Ra, Ga, Ba) after the camera image processing (linear) of the camera to be color-matched are converted according to the following formula (40).

[0111]

number

[0112] After the conversion, the camera image processing (non-linear) parameters of the reference camera are then used to calculate the shooting values ​​(R″a, G″a, B″a) according to equations (36) to (37).

[0113] Next, the shooting values ​​(Rr, Gr, Br) predicted by the reference camera are calculated using the previously obtained measurement value g(λ) and the camera spectral characteristics of the reference camera according to equations (32) to (37). Then, the calculated shooting values ​​(Rr, Gr, Br) and shooting values ​​(R”a, G”a, B”a) are converted to values ​​(Lr, ar, br) and values ​​(La, aa, ba) according to equations (7) to (13), respectively. The 3×19 matrix M3 that minimizes the evaluation value ΔE according to the following equation (41) is optimized, for example, by the least squares method.

[0114]

number

[0115] Next, in step S239, the color-matched 3DLUT generator 262 generates a color-matched 3DLUT. When generating a color-matched 3DLUT, (Ra, Ga, Ba) are obtained in that order as shown in the following equation (42).

[0116]

number

[0117] Next, after the inverse transformation 3DLUT processing, equations (36) to (37) are applied using equation (40) and the camera image processing (non-linear) parameters of the reference camera to find the shooting values ​​(R"a, G"a, B"a). Then, the relationship between the shooting values ​​(Ra, Ga, Ba) and the shooting values ​​(R"a, G"a, B"a) is defined as the color matching 3DLUT. Note that step S235 is similar to step S235 in FIG. 10, so a description thereof will be omitted.

[0118] As described above, according to this embodiment, the camera image processing of the camera spectral characteristics is further divided into linear processing and non-linear processing. In this manner, even in different environments, this embodiment can generate a highly accurate color-matched 3DLUT by simply measuring the spectral characteristics of the light source in that environment, without measuring or photographing color samples.

[0119] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0120] The disclosure of this embodiment includes the following configuration, method, and program.

[0121] (Configuration 1) an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating means for generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired by the acquiring means; 13. An image processing device comprising:

[0122] (Configuration 2) 2. The image processing device according to configuration 1, wherein the generating means generates the spectral characteristics of the image capturing device by dividing the spectral characteristics into those of a sensor and a filter and those of image processing of the image capturing device. (Configuration 3) 3. The image processing device according to configuration 2, wherein the spectral characteristics of the sensor and the filter include the spectral characteristics of a lens.

[0123] (Configuration 4) an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generating means for generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and the color chart image data acquired by the acquiring means; a second generating means for generating a color profile of the photographing device based on a spectral characteristic associated with illumination in a second environment different from the first environment, a spectral characteristic of a color chart measured in advance, and a spectral characteristic of the photographing device generated by the first generating means; 1. An image processing system comprising:

[0124] (Configuration 5) 5. The image processing system according to configuration 4, wherein the first generating means generates the spectral characteristics of the image capturing device by dividing the spectral characteristics into those of a sensor and a filter and those of the image processing of the image capturing device. (Configuration 6) 6. The image processing system according to configuration 5, wherein the spectral characteristics of the sensor and the filter include the spectral characteristics of a lens.

[0125] (Configuration 7) The acquiring means acquires color chart image data captured by a reference photographing device and color chart image data captured by a photographing device to be subjected to color matching, the first generating means generates a spectral characteristic of the reference photographing device and a spectral characteristic of the photographing device to be color-matched, The image processing system according to any one of configurations 4 to 6, wherein the second generation means generates, as the color profile, a lookup table for matching colors captured by the imaging device to be color-matched in the second environment to colors captured by the reference imaging device. (Configuration 8) The image processing system according to any one of configurations 4 to 7, wherein the second generation means acquires the spectral characteristics of the image capturing device generated by the first generation means via a network, and generates the color profile based on the spectral characteristics of the image capturing device acquired via the network.

[0126] (Configuration 9) The method further includes a storage unit that stores the spectral characteristics of the image capturing device generated by the first generation unit, 7. The image processing system according to any one of configurations 4 to 6, wherein the second generating means generates the color profile by reading out the spectral characteristics of the image capturing device stored in the storage means. (Configuration 10) The first generation means generates a spectral characteristic of one image capturing device that captured the color chart, The image processing system according to any one of configurations 4 to 6, wherein the second generation means generates a color profile of the one image capturing device based on the spectral characteristics of the one image capturing device generated by the first generation means.

[0127] (Configuration 11) an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation means for generating a spectral characteristic of the photographing device that photographed the color chart based on the measurement values ​​and the color chart image data acquired by the acquisition means, the spectral characteristic being divided into a sensor and a filter spectral characteristic, a first image processing, and a second image processing; a second generation means for generating a lookup table for matching colors captured by a photographing device to be color-matched in a second environment different from the first environment to colors captured by a reference photographing device, using pixel values ​​after the first image processing; 1. An image processing system comprising: (Configuration 12) 12. The image processing system according to claim 11, wherein the first image processing is linear processing. (Configuration 13) 13. The image processing system according to claim 11, wherein the second image processing is non-linear processing. (Configuration 14) 14. The image processing system according to any one of configurations 11 to 13, wherein the first image processing includes a 3×3 matrix transformation. (Configuration 15) 15. The image processing system according to any one of configurations 11 to 14, wherein the second image processing includes an S-curve and a 3×19 matrix transformation.

[0128] (Method 1) an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquiring step; 13. An image processing method comprising: (Method 2) an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquisition step; a second generation step of generating a color profile of the image capture device based on the spectral characteristics associated with illumination in a second environment different from the first environment, the spectral characteristics of a color chart measured in advance, and the spectral characteristics of the image capture device generated in the first generation step; 13. An image processing method comprising: (Method 3) an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation step of generating the spectral characteristics of the image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquisition step, by dividing the spectral characteristics into the spectral characteristics of a sensor and a filter, a first image processing, and a second image processing; a second generation step of generating a lookup table for matching colors captured by a photographing device to be color-matched in a second environment different from the first environment to colors captured by a reference photographing device, using pixel values ​​after the first image processing; 13. An image processing method comprising:

[0129] (program) an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquiring step; A program for causing a computer to execute the following. [Explanation of symbols]

[0130] 16 Camera spectral characteristic generator, 26 Color matching 3DLUT generator

Claims

1. an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating means for generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired by the acquiring means; 13. An image processing device comprising:

2. 2. The image processing apparatus according to claim 1, wherein the generating means generates the spectral characteristics of the image capturing device by dividing the spectral characteristics into those of a sensor and a filter and those of image processing of the image capturing device.

3. The image processing apparatus according to claim 2 , wherein the spectral characteristics of the sensor and the filter include the spectral characteristics of a lens.

4. an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generating means for generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and the color chart image data acquired by the acquiring means; a second generating means for generating a color profile of the image capturing device based on a spectral characteristic associated with illumination in a second environment different from the first environment, a spectral characteristic of a color chart measured in advance, and a spectral characteristic of the image capturing device generated by the first generating means; 1. An image processing system comprising:

5. 5. The image processing system according to claim 4, wherein the first generating means generates the spectral characteristics of the image capturing device by dividing the spectral characteristics into those of a sensor and a filter and those of image processing of the image capturing device.

6. 6. The image processing system according to claim 5, wherein the spectral characteristics of the sensor and the filter include the spectral characteristics of a lens.

7. The acquiring means acquires color chart image data captured by a reference photographing device and color chart image data captured by a photographing device to be subjected to color matching, the first generating means generates a spectral characteristic of the reference image capture device and a spectral characteristic of the image capture device to be color-matched, 5. The image processing system according to claim 4, wherein the second generation means generates, as the color profile, a lookup table for matching colors captured by the imaging device to be color-matched in the second environment to colors captured by the reference imaging device.

8. The image processing system according to claim 4, characterized in that the second generation means acquires the spectral characteristics of the photographing device generated by the first generation means via a network, and generates the color profile based on the spectral characteristics of the photographing device acquired via the network.

9. The method further includes a storage unit that stores the spectral characteristics of the image capturing device generated by the first generation unit, 5. The image processing system according to claim 4, wherein the second generating means generates the color profile by reading out the spectral characteristics of the image capturing device stored in the storage means.

10. The first generating means generates a spectral characteristic of one image capturing device that captured the color chart, 5. The image processing system according to claim 4, wherein the second generating means generates a color profile of the one image capturing device based on the spectral characteristics of the one image capturing device generated by the first generating means.

11. an acquisition means for acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation means for generating a spectral characteristic of the photographing device that photographed the color chart based on the measurement values ​​and the color chart image data acquired by the acquisition means, the spectral characteristic being divided into a sensor and a filter spectral characteristic, a first image processing, and a second image processing; a second generation means for generating a lookup table for matching colors captured by a photographing device to be color-matched in a second environment different from the first environment to colors captured by a reference photographing device, using pixel values ​​after the first image processing; 1. An image processing system comprising:

12. 12. The image processing system according to claim 11, wherein the first image processing is a linear processing.

13. 12. The image processing system according to claim 11, wherein the second image processing is a non-linear processing.

14. 12. The image processing system of claim 11, wherein the first image processing includes a 3x3 matrix transformation.

15. 12. The image processing system of claim 11, wherein the second image processing includes an S-curve and a 3x19 matrix transformation.

16. an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquiring step; 13. An image processing method comprising:

17. an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquisition step; a second generation step of generating a color profile of the image capture device based on a spectral characteristic associated with illumination in a second environment different from the first environment, a spectral characteristic of a color chart measured in advance, and the spectral characteristic of the image capture device generated in the first generation step; 13. An image processing method comprising:

18. an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a first environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the first environment; a first generation step of generating a spectral characteristic of the image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquisition step, by dividing the spectral characteristic into a sensor and a filter spectral characteristic, a first image processing, and a second image processing; a second generation step of generating a lookup table for matching colors captured by a camera to be color-matched in a second environment different from the first environment to colors captured by a reference camera using pixel values ​​after the first image processing; 13. An image processing method comprising:

19. an acquisition step of acquiring measurement values ​​obtained by measuring the spectral characteristics of a color chart illuminated by an illumination in a predetermined environment, and acquiring color chart image data obtained by photographing the color chart illuminated by the illumination in the predetermined environment; a generating step of generating a spectral characteristic of an image capturing device that captured the color chart based on the measurement values ​​and color chart image data acquired in the acquiring step; A program for causing a computer to execute the following.

Citation Information

Patent Citations

  • Color processing device and its method

    JP2006254371A